CLIP model implementation with example

I'm very impressed how Rust can work in the field of artificial intelligence. I decided to try to port the CLIP model. Mainly focused on https://huggingface.co/openai/clip-vit-base-patch32/tree/main, but in the future I will adapt it to other versions.
I encountered a problem when trying to run from a Mac with the metal feature
Error: Metal contiguous index_select I64 F32 not implemented

I would like try to implement this functionality, could you suggest me the direction to dig.
I also had some misunderstandings regarding
    self.class_embedding = nn.Parameter(radnn)

    let class_embedding = if vs.contains_tensor("class_embedding") {
             vs.get(c.embed_dim, "class_embedding")?
         } else {
             warn!("class_embedding not found in the. Initializing a new one.");
             Tensor::randn(0.0 as f32, 1.0 as f32, &[c.embed_dim], vs.device())?
         };

or
     self.logit_scale = nn.Parameter(torch.tensor(self.config.logit_scale_init_value))

     let logit_scale = if vs.contains_tensor("logit_scale") {
             vs.get(&[], "logit_scale")?
         } else {
             warn!("Creating logit_scale tensor, results may vary.");
             Tensor::new(&[c.logit_scale_init_value], vs.device())?
         };

Spent a lot of time debugging this process with misleading use self initialization
Since originally it is nn.Parameter which, as I understand it, is mainly used during training and when loading the model, it is just loaded under the hood to the current ones weights? In this case, is it ok to just load them as shown?
Also, the text embeddings were mainly taken and adapted from stable diffusion model implementation, I will revise it from the current version of the clip.
Unfortunately not tested on gpu, If there are any problems I will try to fix them
My main goal is to create an example for wasm because I think this is one of the main feature of candle

That looks like a great model to add, re the error Metal contiguous index_select I64 F32 not implemented, this was missing from the metal backend but I just added it in #1951 so should be all good now. That said, if you can it's probably better to use u32 for indexing rather than i64 (indexing with negative values is not supported anyway).

Hi! I tested the implementation with metal feature and also add feature to process batch images with fixing some inaccuracies that prevented that.

Looks pretty good, would you mind removing the images? The repo is already a bit too large so you can either use some of the existing images from other examples or add some wget command to the batch snippets in the readme so that images actually get fetched.

Merged, thanks a lot for adding this. Don't hesitate to communicate about the availability of the model on twitter/reddit/..., always good so that potential users know that it's possible to use clip now!

Merged, thanks a lot for adding this. Don't hesitate to communicate about the availability of the model on twitter/reddit/..., always good so that potential users know that it's possible to use clip now!

thanks, it was interesting working on that


There is no disabled column in account table

Get this error when run php fullPath/yii stats/update-accounts in cmd

Originally posted by @bozorgmehr96 in https://github.com/jakim/ig-monitoring/issues/106#issuecomment-500416698
update: on master branch

Hi @bozorgmehr96
In short, I did not send changes to the repository.
Make a project update, everything should work, just like a demo works.
Sorry for the confusion

Fixed by https://github.com/jakim/ig-monitoring/commit/3cbf3d72291bc213131b1e6de10d35fef3bd4785


How to support multi gpus when fitting the ensemble models?

I need to solve cuda out of memory..

Hi @TIMEXue, I am sorry to tell you that using multi gpus is not supported for now. New features have not been developed for a while, and a PR is much appreciated.


cargo miri setup no longer works for locally installed toolchains

I have a locally installed toolchain that I installed m into RUSTUP_HOME via x.py install.
When I now run cargo +mytoolchain miri setup, this no longer works:
at 18:15:47 ❯ RUST_BACKTRACE=1 ~/.cargo/bin/cargo +local-debug-assertions miri setup
Preparing a sysroot for Miri (target: x86_64-unknown-linux-gnu)...
thread 'main' panicked at src/cargo/util/rustc.rs:86:13:
commit hash must be a hex string
stack backtrace:
   0: rust_begin_unwind
             at /home/matthias/vcs/github/rust_debug_assertions/library/std/src/panicking.rs:645:5
   1: core::panicking::panic_fmt
             at /home/matthias/vcs/github/rust_debug_assertions/library/core/src/panicking.rs:72:14
   2: <cargo::util::rustc::Rustc>::new::{closure#2}
   3: <core::option::Option<&str>>::map::<alloc::string::String, <cargo::util::rustc::Rustc>::new::{closure#2}>
             at /home/matthias/vcs/github/rust_debug_assertions/library/core/src/option.rs:1072:29
   4: <cargo::util::rustc::Rustc>::new
             at /home/matthias/vcs/github/rust_debug_assertions/src/tools/cargo/src/cargo/util/rustc.rs:85:57
   5: <cargo::util::config::Config>::load_global_rustc
             at /home/matthias/vcs/github/rust_debug_assertions/src/tools/cargo/src/cargo/util/config/mod.rs:414:9
   6: <cargo::core::compiler::build_context::target_info::RustcTargetData>::new
             at /home/matthias/vcs/github/rust_debug_assertions/src/tools/cargo/src/cargo/core/compiler/build_context/target_info.rs:885:21
   7: cargo::ops::cargo_compile::create_bcx
             at /home/matthias/vcs/github/rust_debug_assertions/src/tools/cargo/src/cargo/ops/cargo_compile/mod.rs:240:27
   8: cargo::ops::cargo_compile::compile_ws
             at /home/matthias/vcs/github/rust_debug_assertions/src/tools/cargo/src/cargo/ops/cargo_compile/mod.rs:151:15
   9: cargo::ops::cargo_compile::compile_with_exec
             at /home/matthias/vcs/github/rust_debug_assertions/src/tools/cargo/src/cargo/ops/cargo_compile/mod.rs:141:5
  10: cargo::ops::cargo_compile::compile
             at /home/matthias/vcs/github/rust_debug_assertions/src/tools/cargo/src/cargo/ops/cargo_compile/mod.rs:128:5
  11: cargo::commands::check::exec
             at /home/matthias/vcs/github/rust_debug_assertions/src/tools/cargo/src/bin/cargo/commands/check.rs:56:5
  12: cargo::cli::main
             at /home/matthias/vcs/github/rust_debug_assertions/src/tools/cargo/src/bin/cargo/cli.rs:184:5
  13: cargo::main
             at /home/matthias/vcs/github/rust_debug_assertions/src/tools/cargo/src/bin/cargo/main.rs:31:9
  14: <fn() as core::ops::function::FnOnce<()>>::call_once
             at /home/matthias/vcs/github/rust_debug_assertions/library/core/src/ops/function.rs:250:5
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
fatal error: failed to build sysroot: sysroot build failed

wondering if its related to https://github.com/rust-lang/rust/pull/117797

The panic originates here it seems. Unfortunately the panic message doesn't way what it got instead of a hex string.

installed m into RUSTUP_HOME via x.py install.

FWIW I don't know if this ever worked. I usually use a toolchain that's linked to my rustc/build/host directory.

This looks like a cargo or rustc bug to me, Miri doesn't change the output of commit-hash... but it's hard to say. Miri does intercept rustc but when that goes wrong, I'd expect the output to not contain commit-hash: at all any more, and given the codepath this is on, it seems the output was present, it just did not have the expected format.
https://github.com/rust-lang/cargo/pull/12963 should make this easier to debug at least.

When I ask that locally built rustc for its commit-hash, I get unknown:
$ rustc +rustc-s1 -vV
rustc 1.76.0-dev
binary: rustc
commit-hash: unknown
commit-date: unknown
host: x86_64-unknown-linux-gnu
release: 1.76.0-dev
LLVM version: 17.0.4

So that would explain why cargo panics. Cc @weihanglo @ehuss (from https://github.com/rust-lang/cargo/pull/12625)
What I don't understand is why this does not fail in ./x.py test miri. Maybe that is still using the bootstrap cargo?

Maybe cargo should recognize unknown and treat it as None (not having a commit-hash already seems to be an option, just having an invalid one is bad).

Sorry, I forgot about that situation. @weihanglo, can you follow up on this?

Just posted a PR: https://github.com/rust-lang/cargo/pull/12965
Let me know if it doesn't work.

Fixed by https://github.com/rust-lang/cargo/pull/12965. Thanks!


[Bug] npm ps vulnerability CVE-2022-24999

Search before asking

[X] I had searched in the issues and found no similar issues.

Java Version
1.8
Scala Version
2.12.x
StreamPark Version
release-2.1.1
Flink Version
1.17.1-scala_2.12-java8
deploy mode
kubernetes-application
What happened
Found a High Cyber security issue with the apache/streampark:release-2.1.1 docker image.
This issue is related to the npm ps version with vulnerability CVE-2022-24999, more information please see: https://nvd.nist.gov/vuln/detail/CVE-2022-24999.
recommend solution is upgrade package qs to version 6.5.3 or above
Error Exception
No response
Screenshots
No response
Are you willing to submit PR?

[X] Yes I am willing to submit a PR!(您是否要贡献这个PR?)

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Thanks for your report,We looking forward to you submit a PR to fix it

@littlefishermen Thank you for your feedback, according to the vulnerability information, the affected npm versions are all v6, this project uses npm version 8.5.0, not in the scope of the impact, if you use the v6 version in the development phase, we recommend that you upgrade the npm version!
Note: Suggested node version and npm version number for this project
 <configuration>
    <nodeVersion>v16.16.0</nodeVersion>
    <pnpmVersion>8.5.0</pnpmVersion>
 </configuration>


Update Cargo.toml add repository

to allow crates.io, rust-digger and others to link to it

I am building the Rust Digger to help finding small issue to be improved. This page lists your crates. I hope this might help you too.


Python2 compatible

I don't know if python2 compatibility is a goal.  These changes were needed to work with CentOS 7 linux.

Mark,
This is great.  Thanks for doing this!  Are these in the main branch?  I am
not that familiar with git.  If not, can you merge them in?  I think, if
compatibility with Python 2.7 is not that difficult, we should do it.
Did you try the test suite on Python 2.7.  I only use 3.5, so I never tried
2.7.
Sundeep
On Wed, Jan 11, 2017 at 10:02 AM, mborgerding<EMAIL_ADDRESS>wrote:

I don't know if python2 compatibility is a goal. These changes were needed
to work with CentOS 7 linux.
You can view, comment on, or merge this pull request online at:
https://github.com/GAMPTeam/vampyre/pull/1
Commit Summary

ignore .*.swp files
pip --user will install without root privs
"python setup.py test" now works if the system python is python2.7
converted leading spaces to tabs in Makefile. backslashes confound
make, at least on linux.

File Changes

M .gitignore
https://github.com/GAMPTeam/vampyre/pull/1/files#diff-0 (3)
M docs/Makefile
https://github.com/GAMPTeam/vampyre/pull/1/files#diff-1 (12)
M readme.md
https://github.com/GAMPTeam/vampyre/pull/1/files#diff-2 (6)
M test/sparse/vamp_sparse_test.py
https://github.com/GAMPTeam/vampyre/pull/1/files#diff-3 (1)
M test/test_suite.py
https://github.com/GAMPTeam/vampyre/pull/1/files#diff-4 (4)
M vampyre/solver/mlvamp.py
https://github.com/GAMPTeam/vampyre/pull/1/files#diff-5 (1)
M vampyre/solver/vamp.py
https://github.com/GAMPTeam/vampyre/pull/1/files#diff-6 (1)

Patch Links:

https://github.com/GAMPTeam/vampyre/pull/1.patch
https://github.com/GAMPTeam/vampyre/pull/1.diff

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/GAMPTeam/vampyre/pull/1, or mute the thread
https://github.com/notifications/unsubscribe-auth/ANO8I92G_qc-5WkCJGbZkM5STChjdWRjks5rRO7tgaJpZM4LgrXe
.

I do not currently have push permissions.  If you want to add me, see project settings->collaborators

@mborgerding I updated your permissions... I see you've already gotten it integrated, great!


why the parameter 'margin' in the layer 'join_crop_z' is set to be 16 ?

We use that layer to crop the activations to the same size of the baseline (exemplar), so that final scores can be computes with XCorr(x,z)


[ALLUXIO-2605]Deprecate Throwables.propagate with RuntimeException in Configuration.java

https://alluxio.atlassian.net/browse/ALLUXIO-2605

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-Pull-Request-Builder/14396/
Test PASSed.

https://alluxio.atlassian.net/browse/ALLUXIO-2605

alluxio-bot, check this please

@ddzhouxm any updates?

@ddzhouxm feel free to reopen this PR after you address the comments.


Add styling for program cards

Program card component mocks
We will be using the USWDS cards.
Make sure to check screen reader behavior.  The screen reader should start with the heading of each card, then read the image alt text and the categories.  Also, consider if we want to include a SR label for each part of the card, so that it's clear what's being read.  For example:  "program description", or "program categories", etc.
The screen-reader-only text for the program card "View and apply" buttons should be "View and apply to Program name".
Color guidelines

CiviForm and USWDS colors: Unless specified all North Star designs will be implemented using USWDS theme color tokens and USWDS state color tokens

Text styles

All text should use the class usa-prose unless specified otherwise
https://designsystem.digital.gov/components/prose/

Hover states

Use the default USWDS hover styles.

USWDS components used

USWDS tag

See USWDS guidance on the how to use the component
Our version will be using sentence case
See Figma for detailed color specifications

USWDS card

See USWDS guidance on the how to use the component
Our version has the addition of tags above and below the main content
We have versions with images and without images(for my applications section)
See Figma for detailed color specifications

@sijiayam I think you said that mocks for this were finalized.  Would you mind adding a link to them here and a screenshot?

Design QA complete. Issue opened: #9412


Navigate on openpilot went haywire while driving

Describe the bug
Shortly after I input a destination and started driving, navigate on openpilot went haywire. During this drive openpilot's performance was also slightly but noticeably degraded, presumably due to the bad map data being fed into the driving model, so I had to pull into a nearby parking lot and restart the car. Doing so fixed the problem and navigate on openpilot returned to normal.
https://github.com/commaai/openpilot/assets/85845724/b9a961eb-9849-4b5a-8552-57b560466df0
Provide a route where the issue occurs
5c49984c8efb9c9c|2023-08-28--13-24-21--3
openpilot version
0ac9b0ecc5d0e79c21e9e3f60759459da1ca924e
Additional info
No response

We are trying to use our own GPS stack for nagivation. However it seems there are still some edge cases we haven't caught. Reverting until I figure out what happened on your drive.
https://github.com/commaai/openpilot/pull/29687


FAI-11030: Sync additional fields stream when config is updated

Description

Provide description here

Type of change

[ ] Bug fix
[x] New feature
[ ] Breaking change

Related issues

Fix #1

Migration notes

Describe migration notes if any

Extra info

Add any additional information

This is the simplest approach I can think of:

We leave the faros_issue_additional_fields as is (only used when run mode is AdditionalFields).
We augment the faros_issues stream state with a) the oldest date pulled and b) the set of additional fields pulled (per project)
In the faros_issues stream itself, besides pulling issues, we reconcile the additional fields per project (for each project, if the set of additional fields pull differs from the set in the current config, we pull additional fields from oldest date to the start of the current range and update the state for that project)

It might feel kind of weird to emit records of the same shape as faros_issue_additional_fields from faros_issues (we might need to include a boolean or something indicating that the record is just an additional fields update for the task, and reuse some code in the converters). However, I think the alternative would be even more complicated (it'd involve sharing/updating state between streams)

Made some minor changes. PTAL
I think this is good to go since you've already done some testing 🥳


Existing employees invited to an OldDot workspace end up in NewDot creating / editing expenses

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number:
Reproducible in staging?: Needs Reproduction
Reproducible in production?: Needs Reproduction
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Expensify/Expensify Issue URL:
Issue reported by: @maddylewis
Slack conversation: https://expensify.slack.com/archives/C049HHMV9SM/p1724692563749499
Action Performed:

As admin in Olddot invite an employee
Validate the account as employee
As employee create an expense in Olddot
Employee ends up in NewDot trying to edit expense

Note: More details about this issue can be found here https://github.com/Expensify/Expensify/issues/419283
Expected Result:
The employee wouldn't have the option to create/edit expenses in NewDot
Actual Result:
The employee had the option to create/edit expenses in NewDot
Workaround:
Unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android: Native
[ ] Android: mWeb Chrome
[ ] iOS: Native
[ ] iOS: mWeb Safari
[x] MacOS: Chrome / Safari
[ ] MacOS: Desktop

Screenshots/Videos
Add any screenshot/video evidence

View all open jobs on GitHub

This has been labelled "Needs Reproduction". Follow the steps here: https://stackoverflowteams.com/c/expensify/questions/16989

I added the Internal label since it is tied to backend tooling and involves a customer's account details.

I'm going to chat with Maddy about this one today to see how best to handle it.

I forgot to chat with Maddy. I'll do that today.

@sakluger -- i think this needs to stay internal since its a customer bug. i added the hot picks label. and i think we can remove needs reporduction bc i was able to reproduce here?? https://github.com/Expensify/Expensify/issues/419283

Thanks! I'll start recruiting in a few days if nobody grabs it first.

Recruiting tomorrow.

I asked in the original bug report.

Based on the discussion in the original bug report thread, we decided to close this issue for now.


Slugs - Permanent, unbreakable, readable and text changeable slugs for users, posts etc.

Is your feature request related to a problem? Please describe.

An URL – a slug – should potentially last forever and do never break. (We do program for eternity!)
The individual and human readable part of the slug should be changeable. Because real names can change and headlines of posts as well. And since the human readable part of the slug is important for SEO it should be changeable, because you may have typed wrong or your realise that another headline of a post will do much better or even violates rules etc.

Describe the solution you'd like
A solution can be a combination of a unique ID for the user, post etc. followed by a human readable part, that can be changed by the user by changing their names or headlines etc.
As an example stackexchange.com uses them:
https://webmasters.stackexchange.com/questions/113717/will-having-product-id-in-urls-hurt-seo-compared-to-a-url-with-only-keywords
So for HC it will look like:
https://human-connection/profile/85739/peter-lustig
https://human-connection/post/6976396/distinctio-amet-voluptate/
But there have to be some things considered closely !!!
See later …
Describe alternatives you've considered
An alternative could be to put the ID at the very end of the slug.
https://human-connection/profile/peter-lustig/85739
But I read that this has the danger to be cut of by algorithms that truncate the URL after 80 chars as an example. And we would have to be aware to limit the headlines of posts somehow.
Additional context
I have investigate this today more closely after my discussion about this with @roschaefer on Saturday.
If we do so …

… we have do redirect 301 every URL that hits the right ID but does not match the human readable text part. Otherwise the SEO will decrease, because of duplicate URLs to the same content and loose the SEO of the first version.
Every page has to have it’s unique URL as „rel=canonical“ meta tag. Here the readable text should be included, because otherwise this text will be excluded from the SEO by Google.

The ID may have an impact on the SEO as well. But with this the people are not really sure.

On one hand the ID part counts as an additional „word“ of the URL which may lower the wait of the words in the readable text part.
But on the other hand Google itself forces the news companies to put unique numbers at the articles URLs of their news feeds to avoid duplicated URLs to different content.

I would go with some hashed uuid with some 6 chars or so.

You will say the benefit is something shorter?
But than the uniqueness is not safe and for me that is absolut necessary.
Because it is important to use the link in the outer world !

Never use numeric ids, ever as they do not scale at all. Our UUIDs in the other hand are 36 chars long, to long in my opinion for the links. Just save a short version to them and do a fallback an the slug?

@appinteractive numeric ids don't scale, why?

First, numeric values are always a security issue as they can be guessed and brute forces which might end up in unexpected behavior or attacks by script kiddies.
Also can it be problematic in situations where you have several servers running in parallel wanting to write at the same time producing the same ids. I read a good article by someone from eBay about issues they had with something like that. But that obviously depends on the database you are using.
In my opinion we should avoid numeric ids at all costs where not necessary.

There are the following important things to this kind of UUIDs in my eyes @appinteractive @roschaefer :

Uniqueness is the main goal
Safety
Shortness
Readability of the slugs that can be changed
SEO – if it's a number – no matter how we get to it – Google can distinguish between this kind of textual meaningless UUIDs and the readable and SEO part of the slug. Therefore it seems better to me to have pure digits.

What is if we generate such UUIDs separately by a service which just counts and is not related to the database at all? The database just stores this UUIDs. Than it can be very quick and can not be related to safety issues with the database. Or i’ve been taken wrong?

I do not see either why numeric UUIDs don’t scale …

In our discussion @appinteractive had the solution to encode or to compress the UUID somehow to get a non numeric and short URL-ID:

Encoding example: See here URL safe UUIDs in the smallest number of characters
@appinteractive said, he find a solution for compression as well …

We could use nanoid instead of uuid for url friendly ids. https://github.com/ai/nanoid

The other way is to compress our UUIDs for urls https://github.com/oculus42/short-uuid/blob/master/README.md


Deploy

How To Deploy or Run it?

Just follow the guide, hehe.
https://github.com/drbuche/InstaBot/wiki#english-guide


Proposed Changes to Draftpod for accuracy with newer sets, especially Strixhaven

I want to submit a pull request to fix a few issues with the website.
Currently, Draftpod has a number of issues with its treatment of Lessons.

Rare slot allows lessons
Lesson slot allows uncommons
Lesson slot ratios are copied from Mystical Archives

Sources for why these are issues : (wizards article, Tweet from Mike Turian).
I've also gone and reverse engineered the correct ratios by taking a public data set of 8647 sealed pools (STX Bo1 Sealed Game Data), cleaning it (removing duplicate draft_ids, unnecessary data), and then comparing rarities while taking into account the above information. These ratios were the result:

I'm proposing to update the set-stx.js file with changes to fix these issues and implement my ratios, since I believe them to be accurate within a fairly small margin due to sample size (and certainly better than a blind guess). I also may go incorporate the Sealed Bo3 dataset for ~25% larger sample size.
Also of note, the 1/8 chance of a mythic rare in the rare slot (as coded in the packRareSlot function in card-filters.js) is only true for sets up to Zendikar Rising. For ZNR and later sets, the chance is 1/7.4 (source). I'm happy to implement a change reflecting that, although I would appreciate feedback on how that might be done elegantly, since I'm not very familiar with the overall codebase for the project and how one might pass around set information cleanly.
Thank you for your time and this excellent website you've developed.

This all sounds great! Yes, you should be able to get the lesson part done via changes to set-stx.js.
The mythic rare ratio should be part of the set definition. Let me think on exactly how to do that (you can go ahead and submit the PR for STX, I'll probably just implement the dynamic mythic ratio)


Update ansible to 2.3.1

There's a divide by 0 bug that's been fixed upstream. Upgrade ansible to 2.3.1 to fix the failure during a cluster down.

went with <IP_ADDRESS> , as 2.3.1 was listed as a release-candidate on https://github.com/ansible/ansible/releases as of today

The release cycle has slipped a little. 2.3.1 rc1 is 10 days old, rc2 should be released shortly and if no major bugs are found, the final release should be two days later. We should be able to complete this within the next sprint.

putting into blocked and kicking from board.  Will evaluate again later.

This is not blocked as of today.

should this be included in the weekly on-call version checks ? or do we want to be more deliberate about upgrading ansible? btw right now we are using ansible <IP_ADDRESS>, which @joejulian said would fix the divide by 0 bug

but it introduced a new bug (samsung-cnct/k2#434) that is fixed in 2.3.1

Oh! and part of this update will require the new PR include a revert of #45

My gut feeling is that ansible should not be part of the on-call check until if/when we have additional automation. Unlike k8s/helm, we don't really have a strong need to update immediately when there is a new release.
FWIW though, ansible security vulnerabilities exist: https://cve.mitre.org/cgi-bin/cvekey.cgi?keyword=ansible

upgrading ansible for any reason is really only for new features.  I am unconcerned with ansible CVEs.  The attack window that presents to consumers of K2 is probably nothing considering our usage (localhost only, user controlled execution).  Unless I'm missing an attack vector here?

I tend to agree, and actually wrote something similar before deciding check what kind of vulnerabilities Ansible has had. I think it's conceivable that we would care, but not any more than we care about the hundreds of other packages for which we rely on quay.io security scans.

It may suit our use case, but CVE issues being reported by quay would still make for a poor public image.

It's been pointed out that my last comment lacked the necessary context to make it intelligible.
Quay checks for, and reports, CVE issues in images. If we leave known security vulnerabilities in our images just because we know that our use case will never hit them, it still is visible publicly that we have CVE issues in our images. This is bad for our reputation.

Right. I am adding a quay.io security check to the ok on call respkmsiblites...

so after all this chatter, are we cool to move to 2.3.1? so people don't think k2 is held together with duct tape?

done in https://github.com/samsung-cnct/k2-tools/pull/47

LGTM. Tested successfully.


Fix formatting of code editor + console

Looks like it's related to overflow: scroll and the addition of a side bar and lower bar


Issue Related to the flash the code(PREVIEW TARGETS) (IDFGH-4608)

./vendors/espressif/esp-idf/tools/idf.py erase_flash flash monitor -p /dev/ttyUSB0 -B build
When is use this command to flash the code on to the ESP32 board.
I see this type of error.
Traceback (most recent call last):
File "./vendors/espressif/esp-idf/tools/idf.py", line 788, in
main()
File "./vendors/espressif/esp-idf/tools/idf.py", line 705, in main
cli = init_cli(verbose_output=checks_output)
File "./vendors/espressif/esp-idf/tools/idf.py", line 663, in init_cli
extensions[name] = import_module(name)
File "/usr/lib/python3.7/importlib/init.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1006, in _gcd_import
File "", line 983, in _find_and_load
File "", line 967, in _find_and_load_unlocked
File "", line 677, in _load_unlocked
File "", line 728, in exec_module
File "", line 219, in _call_with_frames_removed
File "/home/romit/esp/esp-idf/tools/idf_py_actions/core_ext.py", line 9, in
from idf_py_actions.constants import GENERATORS, SUPPORTED_TARGETS, PREVIEW_TARGETS
ImportError: cannot import name 'PREVIEW_TARGETS' from 'idf_py_actions.constants' (/home/romit/amazon-freertos/vendors/espressif/esp-idf/tools/idf_py_actions/constants.py)
How to solve this error?

Hi @Romit188.
Please try idf.py python-clean to solve the issue. I suspect that you first run the code with latest master and then switched to an older IDF version.
If the above doesn't help then please provide more information as suggested in the issue template. (chip, board version, IDF version, ....)

Hi @Romit188.
Please try idf.py python-clean to solve the issue. I suspect that you first run the code with latest master and then switched to an older IDF version.
If the above doesn't help then please provide more information as suggested in the issue template. (chip, board version, IDF version, ....)

Hi dobairoland.
Thank you for answering. But this command is not work for this error, So i'll try old version of IDF.
So can you help me how to get old version, I am not sure about this.

Hi dobairoland.
Thank you for answering. But this command is not work for this error, So i'll try old version of IDF.
So can you help me how to get old version, I am not sure about this.

@Romit188 I don't think switching to an older version would help you.
You have multiple copies of ESP-IDF (each of different version) which are calling each other: /home/romit/esp/esp-idf &
/home/romit/amazon-freertos/vendors/espressif/esp-idf/. Please examine the value of IDF_PATH by running echo $IDF_PATH.
If you want to switch between those IDF's then it is not enough to use idf.py from a different directory but you also have to change IDF_PATH.
Please read https://docs.espressif.com/projects/esp-idf/en/latest/esp32/get-started/index.html#step-2-get-esp-idf. Changing directory before running install.sh and . export.sh might do the trick.

@Romit188 I don't think switching to an older version would help you.
You have multiple copies of ESP-IDF (each of different version) which are calling each other: /home/romit/esp/esp-idf &
/home/romit/amazon-freertos/vendors/espressif/esp-idf/. Please examine the value of IDF_PATH by running echo $IDF_PATH.
If you want to switch between those IDF's then it is not enough to use idf.py from a different directory but you also have to change IDF_PATH.
Please read https://docs.espressif.com/projects/esp-idf/en/latest/esp32/get-started/index.html#step-2-get-esp-idf. Changing directory before running install.sh and . export.sh might do the trick.

Thank You for your support.
I set IDF_PATH variable and change the version also, But error is not solved yet...
So if you have another solution pls provide me, As soon as possible...

Thank You for your support.
I set IDF_PATH variable and change the version also, But error is not solved yet...
So if you have another solution pls provide me, As soon as possible...

Please don't forget to rerun idf.py python-clean as well. And please post the new error message. It could not be the same.

Please don't forget to rerun idf.py python-clean as well. And please post the new error message. It could not be the same.

Error is same, Nothing change in it.
But error is related to the PREVIEW_TARGETS environment variable , What is it? Any idea about this?

Error is same, Nothing change in it.
But error is related to the PREVIEW_TARGETS environment variable , What is it? Any idea about this?

It is a constant defined here: https://github.com/espressif/esp-idf/blob/master/tools/idf_py_actions/constants.py#L41
core_ext.py tries to import it and cannot find it.

It is a constant defined here: https://github.com/espressif/esp-idf/blob/master/tools/idf_py_actions/constants.py#L41
core_ext.py tries to import it and cannot find it.

./vendors/espressif/esp-idf/tools/idf.py erase_flash flash monitor -p /dev/ttyUSB0 -B build
Thank you, I solved the problem related to the preview targets, But new error is generated.
Usage: ./vendors/espressif/esp-idf/tools/idf.py monitor [OPTIONS]
Try './vendors/espressif/esp-idf/tools/idf.py monitor --help' for help.
Error: Invalid value for '--monitor-baud' / '-B': build is not a valid integer
Can you help for solving this error.

./vendors/espressif/esp-idf/tools/idf.py erase_flash flash monitor -p /dev/ttyUSB0 -B build
Thank you, I solved the problem related to the preview targets, But new error is generated.
Usage: ./vendors/espressif/esp-idf/tools/idf.py monitor [OPTIONS]
Try './vendors/espressif/esp-idf/tools/idf.py monitor --help' for help.
Error: Invalid value for '--monitor-baud' / '-B': build is not a valid integer
Can you help for solving this error.

romit@admin-35:~/amazon-freertos/build$ make all -j4
-- Submodule update
Skipping submodule 'libraries/abstractions/backoff_algorithm/test/unit-test/Unity'
Skipping submodule 'libraries/abstractions/pkcs11/corePKCS11/source/dependency/3rdparty/mbedtls'
Skipping submodule 'libraries/abstractions/pkcs11/corePKCS11/test/cbmc/aws-build-accumulator'
Skipping submodule 'libraries/abstractions/pkcs11/corePKCS11/test/cbmc/aws-templates-for-cbmc-proofs'
Skipping submodule 'libraries/abstractions/pkcs11/corePKCS11/test/unit-test/CMock'
Skipping submodule 'libraries/coreHTTP/test/cbmc/aws-templates-for-cbmc-proofs'
Skipping submodule 'libraries/coreHTTP/test/cbmc/litani'
Skipping submodule 'libraries/coreHTTP/test/unit-test/CMock'
Skipping submodule 'libraries/coreJSON/test/cbmc/aws-templates-for-cbmc-proofs'
Skipping submodule 'libraries/coreJSON/test/cbmc/litani'
Skipping submodule 'libraries/coreJSON/test/unit-test/Unity'
Skipping submodule 'libraries/coreMQTT/test/cbmc/aws-templates-for-cbmc-proofs'
Skipping submodule 'libraries/coreMQTT/test/cbmc/litani'
Skipping submodule 'libraries/coreMQTT/test/unit-test/CMock'
Skipping submodule 'libraries/device_defender_for_aws/test/cbmc/aws-templates-for-cbmc-proofs'
Skipping submodule 'libraries/device_defender_for_aws/test/cbmc/litani'
Skipping submodule 'libraries/device_defender_for_aws/test/unit-test/Unity'
Skipping submodule 'libraries/device_shadow_for_aws/test/cbmc/aws-templates-for-cbmc-proofs'
Skipping submodule 'libraries/device_shadow_for_aws/test/cbmc/litani'
Skipping submodule 'libraries/device_shadow_for_aws/test/unit-test/CMock'
Skipping submodule 'libraries/freertos_plus/standard/freertos_plus_tcp/test/FreeRTOS-Kernel'
Skipping submodule 'libraries/freertos_plus/standard/freertos_plus_tcp/test/litani'
Skipping submodule 'libraries/freertos_plus/standard/freertos_plus_tcp/tools/CMock'
Skipping submodule 'libraries/jobs_for_aws/test/cbmc/aws-templates-for-cbmc-proofs'
Skipping submodule 'libraries/jobs_for_aws/test/cbmc/litani'
Skipping submodule 'libraries/jobs_for_aws/test/unit-test/Unity'
CMake Error at CMakeLists.txt:53 (message):
Board is not supported: vendor.board
-- Configuring incomplete, errors occurred!
See also "/home/romit/amazon-freertos/build/CMakeFiles/CMakeOutput.log".
See also "/home/romit/amazon-freertos/build/CMakeFiles/CMakeError.log".
Makefile:6931: recipe for target 'cmake_check_build_system' failed
make: *** [cmake_check_build_system] Error 1
And also i can't understand how to solve this type of error?

romit@admin-35:~/amazon-freertos/build$ make all -j4
-- Submodule update
Skipping submodule 'libraries/abstractions/backoff_algorithm/test/unit-test/Unity'
Skipping submodule 'libraries/abstractions/pkcs11/corePKCS11/source/dependency/3rdparty/mbedtls'
Skipping submodule 'libraries/abstractions/pkcs11/corePKCS11/test/cbmc/aws-build-accumulator'
Skipping submodule 'libraries/abstractions/pkcs11/corePKCS11/test/cbmc/aws-templates-for-cbmc-proofs'
Skipping submodule 'libraries/abstractions/pkcs11/corePKCS11/test/unit-test/CMock'
Skipping submodule 'libraries/coreHTTP/test/cbmc/aws-templates-for-cbmc-proofs'
Skipping submodule 'libraries/coreHTTP/test/cbmc/litani'
Skipping submodule 'libraries/coreHTTP/test/unit-test/CMock'
Skipping submodule 'libraries/coreJSON/test/cbmc/aws-templates-for-cbmc-proofs'
Skipping submodule 'libraries/coreJSON/test/cbmc/litani'
Skipping submodule 'libraries/coreJSON/test/unit-test/Unity'
Skipping submodule 'libraries/coreMQTT/test/cbmc/aws-templates-for-cbmc-proofs'
Skipping submodule 'libraries/coreMQTT/test/cbmc/litani'
Skipping submodule 'libraries/coreMQTT/test/unit-test/CMock'
Skipping submodule 'libraries/device_defender_for_aws/test/cbmc/aws-templates-for-cbmc-proofs'
Skipping submodule 'libraries/device_defender_for_aws/test/cbmc/litani'
Skipping submodule 'libraries/device_defender_for_aws/test/unit-test/Unity'
Skipping submodule 'libraries/device_shadow_for_aws/test/cbmc/aws-templates-for-cbmc-proofs'
Skipping submodule 'libraries/device_shadow_for_aws/test/cbmc/litani'
Skipping submodule 'libraries/device_shadow_for_aws/test/unit-test/CMock'
Skipping submodule 'libraries/freertos_plus/standard/freertos_plus_tcp/test/FreeRTOS-Kernel'
Skipping submodule 'libraries/freertos_plus/standard/freertos_plus_tcp/test/litani'
Skipping submodule 'libraries/freertos_plus/standard/freertos_plus_tcp/tools/CMock'
Skipping submodule 'libraries/jobs_for_aws/test/cbmc/aws-templates-for-cbmc-proofs'
Skipping submodule 'libraries/jobs_for_aws/test/cbmc/litani'
Skipping submodule 'libraries/jobs_for_aws/test/unit-test/Unity'
CMake Error at CMakeLists.txt:53 (message):
Board is not supported: vendor.board
-- Configuring incomplete, errors occurred!
See also "/home/romit/amazon-freertos/build/CMakeFiles/CMakeOutput.log".
See also "/home/romit/amazon-freertos/build/CMakeFiles/CMakeError.log".
Makefile:6931: recipe for target 'cmake_check_build_system' failed
make: *** [cmake_check_build_system] Error 1
And also i can't understand how to solve this type of error?

Hi @Romit188,
Version of ESP-IDF in Amazon-FreeRTOS is recently upgraded to v4.2. The documentation is not yet updated.
Please try following commands to build and flash the application:

export ESPPORT=<ESP32-serial-port>
cmake -DVENDOR=espressif -DBOARD=esp32_wrover_kit -DCOMPILER=xtensa-esp32 -S . -B build -GNinja (Generates build files)
cd build && ninja all -j4 (builds the application)
ninja flash (flash application on ESP32)

You can skip step 3 and 4 by running ./vendors/espressif/esp-idf/tools/idf.py build flash monitor

Hi @Romit188,
Version of ESP-IDF in Amazon-FreeRTOS is recently upgraded to v4.2. The documentation is not yet updated.
Please try following commands to build and flash the application:

export ESPPORT=<ESP32-serial-port>
cmake -DVENDOR=espressif -DBOARD=esp32_wrover_kit -DCOMPILER=xtensa-esp32 -S . -B build -GNinja (Generates build files)
cd build && ninja all -j4 (builds the application)
ninja flash (flash application on ESP32)

You can skip step 3 and 4 by running ./vendors/espressif/esp-idf/tools/idf.py build flash monitor

Hi Subham
Thank you for answering.
I run this command.
ninja all -j4 , in the Build directory.
[483/1647] Performing configure step for 'bootloader'
FAILED: bootloader-prefix/src/bootloader-stamp/bootloader-configure
cd /home/romit/amazon-freertos/Build/bootloader && /usr/local/bin/cmake -DSDKCONFIG=/home/romit/amazon-freertos/Build/sdkconfig -DIDF_PATH=/home/romit/amazon-freertos/vendors/espressif/esp-idf -DIDF_TARGET=esp32 -DPYTHON_DEPS_CHECKED=1 -DPYTHON=python -DEXTRA_COMPONENT_DIRS=/home/romit/amazon-freertos/vendors/espressif/esp-idf/components/bootloader -DLEGACY_INCLUDE_COMMON_HEADERS= -GNinja /home/romit/amazon-freertos/vendors/espressif/esp-idf/components/bootloader/subproject && /usr/local/bin/cmake -E touch /home/romit/amazon-freertos/Build/bootloader-prefix/src/bootloader-stamp/bootloader-configure
-- Found Git: /usr/bin/git (found version "2.7.4")
-- Component directory /home/romit/amazon-freertos/vendors/espressif/esp-idf/components/mbedtls does not contain a CMakeLists.txt file. No component will be added
-- Component directory /home/romit/amazon-freertos/vendors/espressif/esp-idf/components/unity does not contain a CMakeLists.txt file. No component will be added
-- The C compiler identification is GNU 5.2.0
-- The CXX compiler identification is GNU 5.2.0
-- The ASM compiler identification is GNU
-- Found assembler: /home/romit/esp/xtensa-esp32-elf/bin/xtensa-esp32-elf-gcc
-- Check for working C compiler: /home/romit/esp/xtensa-esp32-elf/bin/xtensa-esp32-elf-gcc
-- Check for working C compiler: /home/romit/esp/xtensa-esp32-elf/bin/xtensa-esp32-elf-gcc -- broken
CMake Error at /usr/local/share/cmake-3.15/Modules/CMakeTestCCompiler.cmake:60 (message):
The C compiler
"/home/romit/esp/xtensa-esp32-elf/bin/xtensa-esp32-elf-gcc"

is not able to compile a simple test program.
It fails with the following output:
Change Dir: /home/romit/amazon-freertos/Build/bootloader/CMakeFiles/CMakeTmp

Run Build Command(s):/usr/local/bin/ninja cmTC_8e5aa && [1/2] Building C object CMakeFiles/cmTC_8e5aa.dir/testCCompiler.c.obj
[2/2] Linking C executable cmTC_8e5aa
FAILED: cmTC_8e5aa
: && /home/romit/esp/xtensa-esp32-elf/bin/xtensa-esp32-elf-gcc -mlongcalls -Wno-frame-address   CMakeFiles/cmTC_8e5aa.dir/testCCompiler.c.obj  -o cmTC_8e5aa   && :
/home/romit/esp/xtensa-esp32-elf/bin/../lib/gcc/xtensa-esp32-elf/5.2.0/../../../../xtensa-esp32-elf/bin/ld: cannot find crt1-sim.o: No such file or directory
/home/romit/esp/xtensa-esp32-elf/bin/../lib/gcc/xtensa-esp32-elf/5.2.0/../../../../xtensa-esp32-elf/bin/ld: cannot find _vectors.o: No such file or directory
/home/romit/esp/xtensa-esp32-elf/bin/../lib/gcc/xtensa-esp32-elf/5.2.0/../../../../xtensa-esp32-elf/bin/ld: cannot find -lsim
/home/romit/esp/xtensa-esp32-elf/bin/../lib/gcc/xtensa-esp32-elf/5.2.0/../../../../xtensa-esp32-elf/bin/ld: cannot find -lhandlers-sim
/home/romit/esp/xtensa-esp32-elf/bin/../lib/gcc/xtensa-esp32-elf/5.2.0/../../../../xtensa-esp32-elf/bin/ld: cannot find -lhal
collect2: error: ld returned 1 exit status
ninja: build stopped: subcommand failed.

CMake will not be able to correctly generate this project.
Call Stack (most recent call first):
/home/romit/amazon-freertos/vendors/espressif/esp-idf/tools/cmake/project.cmake:260 (__project)
CMakeLists.txt:27 (project)
-- Configuring incomplete, errors occurred!
See also "/home/romit/amazon-freertos/Build/bootloader/CMakeFiles/CMakeOutput.log".
See also "/home/romit/amazon-freertos/Build/bootloader/CMakeFiles/CMakeError.log".
[486/1647] Building C object esp-idf/app_update/CMakeFiles/__idf_app_update.dir/esp_ota_ops.c.obj
ninja: build stopped: subcommand failed.
But give me this type error , related to bootloader....
So can you help me ?

Hi Subham
Thank you for answering.
I run this command.
ninja all -j4 , in the Build directory.
[483/1647] Performing configure step for 'bootloader'
FAILED: bootloader-prefix/src/bootloader-stamp/bootloader-configure
cd /home/romit/amazon-freertos/Build/bootloader && /usr/local/bin/cmake -DSDKCONFIG=/home/romit/amazon-freertos/Build/sdkconfig -DIDF_PATH=/home/romit/amazon-freertos/vendors/espressif/esp-idf -DIDF_TARGET=esp32 -DPYTHON_DEPS_CHECKED=1 -DPYTHON=python -DEXTRA_COMPONENT_DIRS=/home/romit/amazon-freertos/vendors/espressif/esp-idf/components/bootloader -DLEGACY_INCLUDE_COMMON_HEADERS= -GNinja /home/romit/amazon-freertos/vendors/espressif/esp-idf/components/bootloader/subproject && /usr/local/bin/cmake -E touch /home/romit/amazon-freertos/Build/bootloader-prefix/src/bootloader-stamp/bootloader-configure
-- Found Git: /usr/bin/git (found version "2.7.4")
-- Component directory /home/romit/amazon-freertos/vendors/espressif/esp-idf/components/mbedtls does not contain a CMakeLists.txt file. No component will be added
-- Component directory /home/romit/amazon-freertos/vendors/espressif/esp-idf/components/unity does not contain a CMakeLists.txt file. No component will be added
-- The C compiler identification is GNU 5.2.0
-- The CXX compiler identification is GNU 5.2.0
-- The ASM compiler identification is GNU
-- Found assembler: /home/romit/esp/xtensa-esp32-elf/bin/xtensa-esp32-elf-gcc
-- Check for working C compiler: /home/romit/esp/xtensa-esp32-elf/bin/xtensa-esp32-elf-gcc
-- Check for working C compiler: /home/romit/esp/xtensa-esp32-elf/bin/xtensa-esp32-elf-gcc -- broken
CMake Error at /usr/local/share/cmake-3.15/Modules/CMakeTestCCompiler.cmake:60 (message):
The C compiler
"/home/romit/esp/xtensa-esp32-elf/bin/xtensa-esp32-elf-gcc"

is not able to compile a simple test program.
It fails with the following output:
Change Dir: /home/romit/amazon-freertos/Build/bootloader/CMakeFiles/CMakeTmp

Run Build Command(s):/usr/local/bin/ninja cmTC_8e5aa && [1/2] Building C object CMakeFiles/cmTC_8e5aa.dir/testCCompiler.c.obj
[2/2] Linking C executable cmTC_8e5aa
FAILED: cmTC_8e5aa
: && /home/romit/esp/xtensa-esp32-elf/bin/xtensa-esp32-elf-gcc -mlongcalls -Wno-frame-address   CMakeFiles/cmTC_8e5aa.dir/testCCompiler.c.obj  -o cmTC_8e5aa   && :
/home/romit/esp/xtensa-esp32-elf/bin/../lib/gcc/xtensa-esp32-elf/5.2.0/../../../../xtensa-esp32-elf/bin/ld: cannot find crt1-sim.o: No such file or directory
/home/romit/esp/xtensa-esp32-elf/bin/../lib/gcc/xtensa-esp32-elf/5.2.0/../../../../xtensa-esp32-elf/bin/ld: cannot find _vectors.o: No such file or directory
/home/romit/esp/xtensa-esp32-elf/bin/../lib/gcc/xtensa-esp32-elf/5.2.0/../../../../xtensa-esp32-elf/bin/ld: cannot find -lsim
/home/romit/esp/xtensa-esp32-elf/bin/../lib/gcc/xtensa-esp32-elf/5.2.0/../../../../xtensa-esp32-elf/bin/ld: cannot find -lhandlers-sim
/home/romit/esp/xtensa-esp32-elf/bin/../lib/gcc/xtensa-esp32-elf/5.2.0/../../../../xtensa-esp32-elf/bin/ld: cannot find -lhal
collect2: error: ld returned 1 exit status
ninja: build stopped: subcommand failed.

CMake will not be able to correctly generate this project.
Call Stack (most recent call first):
/home/romit/amazon-freertos/vendors/espressif/esp-idf/tools/cmake/project.cmake:260 (__project)
CMakeLists.txt:27 (project)
-- Configuring incomplete, errors occurred!
See also "/home/romit/amazon-freertos/Build/bootloader/CMakeFiles/CMakeOutput.log".
See also "/home/romit/amazon-freertos/Build/bootloader/CMakeFiles/CMakeError.log".
[486/1647] Building C object esp-idf/app_update/CMakeFiles/__idf_app_update.dir/esp_ota_ops.c.obj
ninja: build stopped: subcommand failed.
But give me this type error , related to bootloader....
So can you help me ?

@Romit188, you are using older version of xtensa toolchain. ESP-IDF v4.2 is compatible with xtensa-esp32-elf-gcc (crosstool-NG esp-2020r3) 8.4.0.
To update the toolchain, please follow these steps:

cd vendors/espressif/esp-idf
./install.sh (installs required tools)
. ./export.sh (adds tools to PATH)
unset IDF_PATH

You should be able to run the applications after executing these commands

@Romit188, you are using older version of xtensa toolchain. ESP-IDF v4.2 is compatible with xtensa-esp32-elf-gcc (crosstool-NG esp-2020r3) 8.4.0.
To update the toolchain, please follow these steps:

cd vendors/espressif/esp-idf
./install.sh (installs required tools)
. ./export.sh (adds tools to PATH)
unset IDF_PATH

You should be able to run the applications after executing these commands

Thank you Shubham , it was work another type of error generated, How to solve this?
-c ../vendors/espressif/esp-idf/components/soc/src/hal/i2s_hal.c
In file included from ../vendors/espressif/esp-idf/components/soc/src/esp32/include/hal/i2s_ll.h:30:0,
from ../vendors/espressif/esp-idf/components/soc/include/hal/i2s_hal.h:28,
from ../vendors/espressif/esp-idf/components/soc/src/hal/i2s_hal.c:18:
../vendors/espressif/esp-idf/components/soc/include/hal/i2s_types.h:70:31: error: expected ',' or '}' before 'attribute'
I2S_COMM_FORMAT_I2S       attribute((deprecated)) = 0x01, /!< I2S communication format I2S, correspond to I2S_COMM_FORMAT_STAND_I2S/
^
../vendors/espressif/esp-idf/components/soc/src/hal/i2s_hal.c: In function 'i2s_hal_format_config':
../vendors/espressif/esp-idf/components/soc/src/hal/i2s_hal.c:117:9: error: case value '3' not in enumerated type 'i2s_comm_format_t {aka const enum }' [-Werror=switch]
case I2S_COMM_FORMAT_STAND_MSB:
^
../vendors/espressif/esp-idf/components/soc/src/hal/i2s_hal.c:125:9: error: case value '4' not in enumerated type 'i2s_comm_format_t {aka const enum }' [-Werror=switch]
case I2S_COMM_FORMAT_STAND_PCM_SHORT:
^
../vendors/espressif/esp-idf/components/soc/src/hal/i2s_hal.c:133:9: error: case value '12' not in enumerated type 'i2s_comm_format_t {aka const enum }' [-Werror=switch]
case I2S_COMM_FORMAT_STAND_PCM_LONG:
^
../vendors/espressif/esp-idf/components/soc/src/hal/i2s_hal.c: At top level:

Thank you Shubham , it was work another type of error generated, How to solve this?
-c ../vendors/espressif/esp-idf/components/soc/src/hal/i2s_hal.c
In file included from ../vendors/espressif/esp-idf/components/soc/src/esp32/include/hal/i2s_ll.h:30:0,
from ../vendors/espressif/esp-idf/components/soc/include/hal/i2s_hal.h:28,
from ../vendors/espressif/esp-idf/components/soc/src/hal/i2s_hal.c:18:
../vendors/espressif/esp-idf/components/soc/include/hal/i2s_types.h:70:31: error: expected ',' or '}' before 'attribute'
I2S_COMM_FORMAT_I2S       attribute((deprecated)) = 0x01, /!< I2S communication format I2S, correspond to I2S_COMM_FORMAT_STAND_I2S/
^
../vendors/espressif/esp-idf/components/soc/src/hal/i2s_hal.c: In function 'i2s_hal_format_config':
../vendors/espressif/esp-idf/components/soc/src/hal/i2s_hal.c:117:9: error: case value '3' not in enumerated type 'i2s_comm_format_t {aka const enum }' [-Werror=switch]
case I2S_COMM_FORMAT_STAND_MSB:
^
../vendors/espressif/esp-idf/components/soc/src/hal/i2s_hal.c:125:9: error: case value '4' not in enumerated type 'i2s_comm_format_t {aka const enum }' [-Werror=switch]
case I2S_COMM_FORMAT_STAND_PCM_SHORT:
^
../vendors/espressif/esp-idf/components/soc/src/hal/i2s_hal.c:133:9: error: case value '12' not in enumerated type 'i2s_comm_format_t {aka const enum }' [-Werror=switch]
case I2S_COMM_FORMAT_STAND_PCM_LONG:
^
../vendors/espressif/esp-idf/components/soc/src/hal/i2s_hal.c: At top level:

[101/101] Generating binary image from built executable
esptool.py v3.0
Generated /home/romit/amazon-freertos/Build/bootloader/bootloader.bin
ninja: build stopped: subcommand failed.
At this point error was generated.

[101/101] Generating binary image from built executable
esptool.py v3.0
Generated /home/romit/amazon-freertos/Build/bootloader/bootloader.bin
ninja: build stopped: subcommand failed.
At this point error was generated.

I update the version also, and also build the directory and run "ninja all -j4" command , and it is work also,
and i run the following command
./vendors/espressif/esp-idf/tools/idf.py erase_flash flash monitor -p /dev/ttyUSB0 -B builde
but not flash the code and give me the error.
shown in below.
Usage: ./vendors/espressif/esp-idf/tools/idf.py monitor [OPTIONS]
Try './vendors/espressif/esp-idf/tools/idf.py monitor --help' for help.
Error: Invalid value for '--monitor-baud' / '-B': builde is not a valid integer
So what is problem i can't understand.

I update the version also, and also build the directory and run "ninja all -j4" command , and it is work also,
and i run the following command
./vendors/espressif/esp-idf/tools/idf.py erase_flash flash monitor -p /dev/ttyUSB0 -B builde
but not flash the code and give me the error.
shown in below.
Usage: ./vendors/espressif/esp-idf/tools/idf.py monitor [OPTIONS]
Try './vendors/espressif/esp-idf/tools/idf.py monitor --help' for help.
Error: Invalid value for '--monitor-baud' / '-B': builde is not a valid integer
So what is problem i can't understand.

./vendors/espressif/esp-idf/tools/idf.py erase_flash flash monitor -p /dev/ttyUSB0 -B builde

If you write it this way then "-p /dev/ttyUSB0 -B builde" is a local argument of "monitor". "-B" is the baudrate for "monitor". You want "-B" as build directory for "idf.py". Also the port should be set for all commands and not just "monitor". The correct order is:

./vendors/espressif/esp-idf/tools/idf.py -p /dev/ttyUSB0 -B builde erase_flash flash monitor

./vendors/espressif/esp-idf/tools/idf.py erase_flash flash monitor -p /dev/ttyUSB0 -B builde

If you write it this way then "-p /dev/ttyUSB0 -B builde" is a local argument of "monitor". "-B" is the baudrate for "monitor". You want "-B" as build directory for "idf.py". Also the port should be set for all commands and not just "monitor". The correct order is:

./vendors/espressif/esp-idf/tools/idf.py -p /dev/ttyUSB0 -B builde erase_flash flash monitor

Executing action: erase_flash
Traceback (most recent call last):
File "./vendors/espressif/esp-idf/tools/idf.py", line 788, in
main()
File "./vendors/espressif/esp-idf/tools/idf.py", line 706, in main
cli(sys.argv[1:], prog_name=PROG)
File "/home/romit/.local/lib/python3.7/site-packages/click/core.py", line 829, in call
return self.main(*args, **kwargs)
File "/home/romit/.local/lib/python3.7/site-packages/click/core.py", line 782, in main
rv = self.invoke(ctx)
File "/home/romit/.local/lib/python3.7/site-packages/click/core.py", line 1290, in invoke
return _process_result(rv)
File "/home/romit/.local/lib/python3.7/site-packages/click/core.py", line 1224, in _process_result
value = ctx.invoke(self.result_callback, value, **ctx.params)
File "/home/romit/.local/lib/python3.7/site-packages/click/core.py", line 610, in invoke
return callback(*args, **kwargs)
File "./vendors/espressif/esp-idf/tools/idf.py", line 622, in execute_tasks
task(ctx, global_args, task.action_args)
File "./vendors/espressif/esp-idf/tools/idf.py", line 211, in call
self.callback(self.name, context, global_args, **action_args)
File "/home/romit/amazon-freertos/vendors/espressif/esp-idf/tools/idf_py_actions/serial_ext.py", line 128, in erase_flash
esptool_args = _get_esptool_args(args)
File "/home/romit/amazon-freertos/vendors/espressif/esp-idf/tools/idf_py_actions/serial_ext.py", line 41, in _get_esptool_args
with open(os.path.join(args.build_dir, "flasher_args.json")) as f:
FileNotFoundError: [Errno 2] No such file or directory: '/home/romit/amazon-freertos/builde/flasher_args.json'
Error is like this.... I can't understand

Executing action: erase_flash
Traceback (most recent call last):
File "./vendors/espressif/esp-idf/tools/idf.py", line 788, in
main()
File "./vendors/espressif/esp-idf/tools/idf.py", line 706, in main
cli(sys.argv[1:], prog_name=PROG)
File "/home/romit/.local/lib/python3.7/site-packages/click/core.py", line 829, in call
return self.main(*args, **kwargs)
File "/home/romit/.local/lib/python3.7/site-packages/click/core.py", line 782, in main
rv = self.invoke(ctx)
File "/home/romit/.local/lib/python3.7/site-packages/click/core.py", line 1290, in invoke
return _process_result(rv)
File "/home/romit/.local/lib/python3.7/site-packages/click/core.py", line 1224, in _process_result
value = ctx.invoke(self.result_callback, value, **ctx.params)
File "/home/romit/.local/lib/python3.7/site-packages/click/core.py", line 610, in invoke
return callback(*args, **kwargs)
File "./vendors/espressif/esp-idf/tools/idf.py", line 622, in execute_tasks
task(ctx, global_args, task.action_args)
File "./vendors/espressif/esp-idf/tools/idf.py", line 211, in call
self.callback(self.name, context, global_args, **action_args)
File "/home/romit/amazon-freertos/vendors/espressif/esp-idf/tools/idf_py_actions/serial_ext.py", line 128, in erase_flash
esptool_args = _get_esptool_args(args)
File "/home/romit/amazon-freertos/vendors/espressif/esp-idf/tools/idf_py_actions/serial_ext.py", line 41, in _get_esptool_args
with open(os.path.join(args.build_dir, "flasher_args.json")) as f:
FileNotFoundError: [Errno 2] No such file or directory: '/home/romit/amazon-freertos/builde/flasher_args.json'
Error is like this.... I can't understand

@Romit188 Please check if you have provided correct build directory name in idf.py command. Also check if directory with same name exists.

@Romit188 Please check if you have provided correct build directory name in idf.py command. Also check if directory with same name exists.

Yeah shubham,
It is correct Build directory.

Yeah shubham,
It is correct Build directory.

If you have not problem so can you share zip file of the amazon-freertos?

If you have not problem so can you share zip file of the amazon-freertos?

Component directory /home/romit/amazon-freertos/vendors/espressif/esp-idf/components/mbedtls does not contain a CMakeLists.txt file. No component will be added
-- Component directory /home/romit/amazon-freertos/vendors/espressif/esp-idf/components/unity does not contain a CMakeLists.txt file. No component will be added
-- Checking Python dependencies...
How to solve this error?

Component directory /home/romit/amazon-freertos/vendors/espressif/esp-idf/components/mbedtls does not contain a CMakeLists.txt file. No component will be added
-- Component directory /home/romit/amazon-freertos/vendors/espressif/esp-idf/components/unity does not contain a CMakeLists.txt file. No component will be added
-- Checking Python dependencies...
How to solve this error?

@Romit188, You can download zip file from amazon-freertos GitHub portal.

Component directory /home/romit/amazon-freertos/vendors/espressif/esp-idf/components/mbedtls does not contain a CMakeLists.txt file. No component will be added
-- Component directory /home/romit/amazon-freertos/vendors/espressif/esp-idf/components/unity does not contain a CMakeLists.txt file. No component will be added

These are just warnings and build should work fine.

@Romit188, You can download zip file from amazon-freertos GitHub portal.

Component directory /home/romit/amazon-freertos/vendors/espressif/esp-idf/components/mbedtls does not contain a CMakeLists.txt file. No component will be added
-- Component directory /home/romit/amazon-freertos/vendors/espressif/esp-idf/components/unity does not contain a CMakeLists.txt file. No component will be added

These are just warnings and build should work fine.

Marking this as closed as it this is related to Amazon FreeRTO project. Please see my comment at https://github.com/espressif/esp-idf/issues/6472#issuecomment-768930866

Marking this as closed as it this is related to Amazon FreeRTO project. Please see my comment at https://github.com/espressif/esp-idf/issues/6472#issuecomment-768930866


Disable logging of conntrack stats traffic

Description
Fixes: #6718
Changes the default behavior of conntrackd to stop logging verbose conntrack-ed traffic to /var/log/daemon.log. This is expensive in terms of performance and also costly in terms of the limited disk capacity in a VR. In cases of large quantities of traffic, /var fills up and causes the VR to either stop passing traffic or perform necessary tasks in the VPC.
Types of changes

[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] New feature (non-breaking change which adds functionality)
[x] Bug fix (non-breaking change which fixes an issue)
[ ] Enhancement (improves an existing feature and functionality)
[ ] Cleanup (Code refactoring and cleanup, that may add test cases)

Feature/Enhancement Scale or Bug Severity
Feature/Enhancement Scale

[ ] Major
[ ] Minor

Bug Severity

[ ] BLOCKER
[ ] Critical
[x] Major
[ ] Minor
[ ] Trivial

Screenshots (if appropriate):
How Has This Been Tested?
Change applied to opt/cloud/templates/conntrackd.conf.templ in systemvm.iso inside of cloud-scripts.tgz.  systemvm.iso distributed to all Cloudstack KVM hosts and placed at /usr/share/cloudstack-common/vms/systemvm.iso.  Redundant VPC restarted with cleanup.  Confirmed change present and monitored /var/log/daemon.log for traffic entries while generating traffic via a private gateway using iperf.

@blueorangutan package

@DaanHoogland a Jenkins job has been kicked to build packages. It will be bundled with  KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

@blueorangutan test

@rohityadavcloud a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan package

@rohityadavcloud a Jenkins job has been kicked to build packages. It will be bundled with  KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

Packaging result: :heavy_multiplication_x: el7 :heavy_multiplication_x: el8 :heavy_multiplication_x: debian :heavy_multiplication_x: suse15. SL-JID 4378

@blueorangutan package

@rohityadavcloud a Jenkins job has been kicked to build packages. It will be bundled with  KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

Packaging result: :heavy_multiplication_x: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 4397

@blueorangutan package

@rohityadavcloud a Jenkins job has been kicked to build packages. It will be bundled with  SystemVM template(s). I'll keep you posted as I make progress.

Packaging result: :heavy_multiplication_x: el7 :heavy_multiplication_x: el8 :heavy_multiplication_x: debian :heavy_multiplication_x: suse15. SL-JID 4403

@blueorangutan package

@rohityadavcloud a Jenkins job has been kicked to build packages. It will be bundled with  KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_multiplication_x: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 4404

@blueorangutan test

@rohityadavcloud a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Trillian test result (tid-5093)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 45525 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr6738-t5093-kvm-centos7.zip
Smoke tests completed. 104 look OK, 0 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test
Result
Time (s)
Test File

@shawniverson I'm marking this PR as draft for now

@shawniverson can you resolve the conflicts here, please?

@DaanHoogland I need guidance on the source code. I need to add a global setting for this to toggle the logging in conntrackd, but I am struggling to find where in the source this change would be made.  Sorry, but I'm not terribly familiar with the source and it is quite vast.

ok  @shawniverson , that is a big question. If you need more work than this done or are maintaining a cloud it can pay off to work through the hackerbook.
The making of a global setting is done by defining a ConfigKey<> in a service. I think in your case it should be the NetworkService but there could be a better location.
Next the value of the setting must be passed to the actual virtual router.
Finally the code that installs the template that you editted must take the value of the setting into account.
I understand that this can be daunting especially as you say, because the code base is huge. Please ask any questions you have. I may know the answer and if not, I may know someone that does.

@DaanHoogland  Thank you that helps a lot.  This looks like a good starting point for me to work on this.  I can track some of the existing settings defined here through the source to application on the VRs themselves, I believe.
https://github.com/apache/cloudstack/tree/main/server/src/main/java/com/cloud/network/router

yes, VirtualNetworkApplianceManager seems like a good start. Good luck and let us know ;)

@shawniverson are you still working on this?

Well, I'm trying to figure out how to get the global setting into the vr configuration scripts. I'm still working on this.

ok @shawniverson , I'll move this to 4.18.1 for now, if you get anything we can always change that.

@blueorangutan package

@DaanHoogland a [SF] Jenkins job has been kicked to build packages. It will be bundled with  KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

Packaging result [SF]: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: el9 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 6313

@blueorangutan test

@DaanHoogland a [SF] Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

[SF] Trillian test result (tid-6825)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 43253 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr6738-t6825-kvm-centos7.zip
Smoke tests completed. 106 look OK, 2 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test
Result
Time (s)
Test File

test_01_migrate_VM_and_root_volume
Error
79.71
test_vm_life_cycle.py

test_02_migrate_VM_with_two_data_disks
Error
52.37
test_vm_life_cycle.py

test_01_vpc_site2site_vpn_multiple_options
Failure
405.91
test_vpc_vpn.py

@shawniverson are you still interested in making this configurable?

ping @shawniverson

@blueorangutan package

@DaanHoogland a [SF] Jenkins job has been kicked to build packages. It will be bundled with  KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

Packaging result [SF]: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: el9 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 6571

@blueorangutan package

@DaanHoogland a [SF] Jenkins job has been kicked to build packages. It will be bundled with  KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

Packaging result [SF]: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: el9 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 6596

@blueorangutan test

@DaanHoogland a [SF] Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

[SF] Trillian Build Failed (tid-7198)

@shawniverson are we expecting any further changes, asking as PR is in draft
@blueorangutan package

@rohityadavcloud a [SF] Jenkins job has been kicked to build packages. It will be bundled with  KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

Packaging result [SF]: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: el9 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 6849

Are you still looking at this @shawniverson ?

@shawniverson I am closing this, please reopen if you feel this still has potential.


I think I'm pushing just commit history? I'm somehow 2 commits ahead

I think I'm pushing just commit history? I'm somehow 2 commits ahead

no files were changed, so its not needed to be merged


0.10.1 on PyPI

Good morning,
are you planning to update toml on PyPI too soon? It is now still at version 0.10.0.
Thank you,
-Filippo

Bump,
I am waiting to do a PyPI release on my project because I can't have git dependencies, but I need 0.10.1 in my project.

Hello,
are there any updates on this?
Best wishes.

Greetings,
Just a friendly comment to bump activity on this issue. Our team is desperate for the "preserve comments" feature and w/ poetry we can't really afford to build from source.
Best wishes and be healthy :)

Any update on this? If not I'm going to just copy and paste the code from 10.1 into my repo.

They are not paid to do this so your comment is unnecessary. This repo has an MIT license so this gives you a lot of freedom.

If being paid would help, there's a modest amount up for grabs via Tidelift:
https://tidelift.com/lifter/search/pypi/toml

@uiri If there's a lack of availability of maintainer time on this project, I am happy to share the maintenance burden on the project.
I'm fairly... involved in both TOML and Python ecosystems, so I'd be more than happy to help. :)

@uiri bump/ping

yay! looks like a new release is up on pypy
https://pypi.org/project/toml/0.10.1/
Thanks @uiri

woot woot!

Hmm... there hasn't been much activity since 0.10.1. :(
@uiri My offer from https://github.com/uiri/toml/issues/267#issuecomment-609112291 still stands.

@uiri It is rather sad and worrying that what seems to be the most popular TOML library currently has been entirely unmaintained and does not support the current, stable 1.0 version of the spec, despite a large amount of community interest in contributing and moving things forward.
There seem to be several options, from most to least preferred:
Ideally, this repository could be moved to a Github org with the appropriate contributors added, which would reduce avoid a single point of failure with it depending on a user's personal account; however, it would require the project adopt a new name on PyPI, and downstream users manually update their dependencies.
Collaborator access could be granted to one or more experienced contributors, and development continued here.
Finally, this repo could be archived and users pointed toward an active fork or replacement project.
All of these, however, are better for everyone involved than simply keeping the status quo, as eventually either users will have to fork the project, choose a new name on PyPI and rebuild the community anew, or abandon it altogether and have it die a slow, easily avoidable death.
Given @pradyunsg , an experienced, well-known, clearly deeply subject-matter-knowledgeable community member willing to take on the work has offered to step in to move things forward, it would certainly be ideal if maintainership (and more importantly, PyPI deploy access) could be shared with them. However, after a year of no response, and very little Github activity by the current maintainer, it might be time to consider a fork, unless the community prefers adopting an alternative toml parser (Tomli seems nice, but doesn't have widespread adoption yet, and I've ran into a number of edge-case bugs and subtle incompatibilities with tomlkit for use cases that don't need to preserve style).


Deis builder does not keep a cache between buildpack deploys

Summary
Deis builder is not keeping an (observable) cache between buildpack builds
Replication Steps

Deply an app with git push (preferably an app that would use caching, like a rails app with multiple Gems)
Wait for a while (in my case more than 15 minutes) for the deploy to finish
Commit a small change (not to anything that would break the cache, so nothing in the Gemfile)
Deploy again with git push

I would  expect the second push to go a lot faster as all the Gemfiles and assets should still be in the cache, and should be easily rebuildable. This is not the case.
I am using a stateless cluster, but that should not matter as I expect all state either to be pushed to S3, or stored locally
Note I did not test any other buildpacks except for the rails buildpack, it might actually just be an interaction bug between the buildpack and the slugbuilder
In Deis V1 this worked fine (assuming the builder did not restart)

I have found the exact same issue. I am on workflow 2.1.0, and I use GCS as a storage backend (not minio).

Please see https://github.com/deis/slugbuilder/issues/95


Feat demo creme cycles second

Changes

Checklist

[ ] I followed contributing guidelines

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.2 out of 3 committers have signed the CLA.:white_check_mark: patzick:white_check_mark: mkucmus:x: mmularczykdivanteYou have signed the CLA already but the status is still pending? Let us recheck it.


Question about route progress updates

Is there a way to force instructions to jump into determined route lag and step based on the current user's location?
In our current project, we have a fixed route situation, like a delivery route from a warehouse to the factory for example. And for some scenarios, the user might be alongside and off route.
The problem is when the user goes in the route and start the trip, we are not receiving the updates in the instruction view, I already debugged the NavigationRouteProcessor, NavigationHelper and OffRouteDetector.
In this case the NavigationIndices are not receiving any updates in the NavigationRouteProcessor.
In this case, Is there any approach to solve the instructions update?

You can set the leg and step index from the OffRouteDetector using the methods in the OffRouteCallback which is registered there.

has a type check, limiting its compatibility to the OffRouteDetector

I think you can extend the OffRouteDetector and this will work.

modify the OffRouteDetector to accommodate this case or expose the setOffRouteCallback method

I think this is something we could add, this would make the code easier as well. Feel free to open a PR for this.

Just to clarify, I think it would make sense to add setOffRouteDetectorCallback method to the abstract class OffRoute. I am not sure we should expose the method onShouldIncreaseIndex publicly, as this is kind of a corner case of OffrouteDetection.


feat: New saveSwagger config allows an alternate mechanism for saving

A new saveSwagger() configuration function allows an alternate
mechanism for saving the generated Swagger to be specified, rather
than the standard writing a file to the filesystem.
This supports deployment to environments that do not allow writing to the
filesystem e.g. store in memory or database.

For easy reference: https://travis-ci.org/github/theoomoregbee/sails-hook-swagger-generator/builds/726570799

just fixed the Travis CI bug: https://travis-ci.community/t/github-pr-is-being-built-but-result-is-not-shown/7025/2
restarted the build to see if it will show up here

Let’s go that way. I could not make up my mind given the small amount of post-processing (tag clean-up) that currently happens after postProcess is called.
I had originally left tag cleanup after postProcess to allow that method to reference tags before cleanup occurs. If we utilise postProcess it probably makes sense to move cleanup before it is called to ensure consistency between between the two save methods.

:tada: This PR is included in version 3.3.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


[FEATURE]

Is it possible to get the user's most recent media only?

I'm not sure what you mean. Are you trying to get a user's most recent
post, of the oldest available one?
On Tue, Jul 16, 2019, 9:53 PM arnaudjnn<EMAIL_ADDRESS>wrote:

Is it possible to scrape only the last user post? When I set --count=1 it
doesn't export the last media
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/ScriptSmith/instamancer/issues/12?email_source=notifications&email_token=AEDSVHP3XVYBWWG6IY4L37TP7WZBXA5CNFSM4IEADON2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4G7ONUIA,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AEDSVHMOR65TF24YWYH4M4DP7WZBXANCNFSM4IEADONQ
.

I'm not sure what you mean. Are you trying to get a user's most recent post, of the oldest available one?

Yes

Then I think this is a duplicate of #3
You need to use instamancer user [username] -c1 -d --full.
Follower usernames isn't something that instamancer can do, but there are probably other tools that will work.


remote has conflict issues with topography

when using remote with this mod it spams the hella out of server on every use of the remote.
https://pastebin.com/wd419ddG
this error repeats on every use

Not sure what topography is, but I'm also getting this when people use the remote, and then the server crashes.

Not sure what topography is, but I'm also getting this when people use the remote, and then the server crashes.


Display errors in event_label() widget.

Display network connection and download errors/failure in the event_label() widget.

hello can i get some more context on this issue please

@klorine28 The event_label widget (or function) is commonly utilized to display errors and notify users about various events, such as loading codecs. However, it lacks the capability to effectively notify users when errors occur during the downloading of a file. This inconsistency becomes apparent as the widget fails to display any error message or notification when something goes wrong during the file download process. To enhance user experience and ensure comprehensive error handling, the event_label widget should be modified to consistently notify users whenever an error occurs, regardless of the specific nature of the error.

So the enhancement is changing the code on the event_label() to make it consistent?

@klorine28 Not really, but one effective approach is to maintain an error log and utilize the event_label() function to promptly display any errors that arise, irrespective of their occurrence within the project. This way, we can easily track and display the specific error(s) encountered during the execution of the project.


Performance and compatibility improvements

Maybe marginal gains, but they follow best practices for cache-control and other file header related optimizations.
See individual commits for some more detail.
See: https://www.pivotaltracker.com/story/show/174968005

The OpenConext deploy changes are going to be implemented, so these changes will make sense in the greater picture. If CI is green, I'm going to merge this.

The OpenConext deploy changes are going to be implemented, so these changes will make sense in the greater picture. If CI is green, I'm going to merge this.


File converter

Description of the new feature / enhancement
A file converter available in the file explorer capable of converting video files to audio files, mp3 to ogg etc.
Scenario when this would be used?
A user may use this program when they want to extract the audio from a video file or convert an audio file to a format that is compatible with a specific application.
Supporting information
No response

duplicate whoops


[W6.4d][T11-B3]JEREMY LEE JUN WEI

@Sebry9
Some comments added. Please close the PR after reading comments.


103 extract link from a element

I'll create a mockup for this then we can proceed with this ticket again once done.


Remove redundant space after enum/flags word in editor docs

Just cosmetic change, I think it's a typo?

Before

After

I don't believe that was a typo but it's... whatever

RST docs use one space:

I'm fine either way. I also imagine this was done on purpose to have more separation between the keyword and the enum name, but it's pretty arbitrary. Since we don't have it in the online docs and it looks fine, I think we can go for consistency.

Thanks!


add angular min libraries

[x] I have read freeCodeCamp's contribution guidelines.
[ ] My pull request has a descriptive title (not a vague title like Update index.md)
[ ] My pull request targets the master branch of freeCodeCamp.
[ ] None of my changes are plagiarized from another source without proper attribution.
[ ] My article does not contain shortened URLs or affiliate links.

If your pull request closes a GitHub issue, replace the XXXXX below with the issue number.
Closes #XXXXX

Add Angular Min.js library

Thank you for opening this pull request.
This is a standard message notifying you that we’ve reviewed your pull request and have decided not to merge it. We would welcome future pull requests from you.
Thank you and happy coding.


Abort a download

Hello,
I'm looking for the possibility to abort an unfinished download.
Is there any way to do that ?
I didn't find anything in the Node documentation (https://nodejs.org/api/stream.html) about it.
Thank you by advance.

+1

+1

I found and use this solution
video._source.stream.abort();
where video is a handler

you could also do this
video.pause();
video.unpipe()

This isn't possible when calling the youtube binary directly, at least not now. But, it should be possible: the execa module used does return a child process. This can be used to manually kill the download as needed.
For now, I'm getting around this limitation by using ps-node to find and kill the relevant process.
function killAllDownloads() {
    var ps = require('ps-node');
    ps.lookup({
        command: 'youtube-dl',
        }, function(err, resultList ) {
        if (err) {
            // failed to get list of processes
        }

        // processes that contain the string 'youtube-dl' in the name will be looped
        resultList.forEach(function( process ){
            if (process) {
                // filter out the relevant process in here -- in this case no filtering is done so all will be killed
                console.log( 'PID: %s, COMMAND: %s, ARGUMENTS: %s', process.pid, process.command, process.arguments );
                // A simple pid lookup
                console.log(process.pid)
                ps.kill(process.pid, 'SIGKILL', function( err ) {
                    if (err) {
                        // failed to kill, process may have ended on its own
                    }
                    else {
                        console.log( 'Process %s has been killed!', process.pid );
                    }
                });
            }
        });

    });
}

But this isn't perfect and process names can differ by platform and environment. It also takes some time to get the processes and kill each one. Having youtubedl.exec return a child process would be a huge improvement on this!


Wasm build should use a custom graphics layer instead of WebGL directly

Instead of bringing WebGL API into zig, I should make a custom graphics API with just what I need, then implement a backend in JS. Even if the JS backend looks pretty much the same as the Zig OpenGL backend (or alternatively it could use Canvas API instead of WebGL). This would be a good exercise to make my codebase not dependent on OpenGL.
Maybe do this in addition to the WebGL Zig API. It's probably useful to maintain Zig WebGL bindings anyway. So that means three modes: native+OpenGL, wasm+WebGL, wasm+custom API.
edit: this is an "unaccepted proposal". Could turn into a big waste of time.

I've heard of bgfx for 3D, is there a decent established generic graphics interface for 2D?
Not going to follow up on this. My next game will probably be 3D anyway.


Improve friendly forwarding

The site should keep track of friendly forwarding links for after_sign_in_path_for and after_sign_out_path_for.
Currently a user is typically redirect to the landing page or the dashboard which breaks flow from pages on the forum and in the blog.

This will have to be done after a sign up process has been simplified, #954. Removing from milestone.


Support other Databases

Are there plans to support databases other databases, such as Google Datastore?

It works with any database compatible with the database/sql package: https://github.com/golang/go/wiki/SQLDrivers
Google Datastore is a NoSQL database. I have seen in other frameworks for other programming languages ppl making sql adapters for nosql databases. There are none on the list above and I did a quick google search and there doesn't seem to be any for Google Datastore.
There is a security issue as well. NoSQL databases are "eventually consistent" which means that if you were to remove a Secret/Key, it is possible that the database changes do not propagate immediately and for a short period of time someone may still be able to access your endpoint with an old secret/key.
My recommendation is you use Google Cloud Sql which is part of the Google App Engine ecosystem JUST for restgate keys and secrets.
This mysql adapter is compatible with Google Cloud Sql:
https://github.com/go-sql-driver/mysql/#examples

https://cloud.google.com/datastore/docs/articles/balancing-strong-and-eventual-consistency-with-google-cloud-datastore/

Goo point, I hadn't thought of the datastore's eventual consistency in relation to authentication.
The article you posted talked about the same solutions I had seen elsewhere: using memcached and/or ancestor based transactions.
There's even a project utilizing some of these ideas: https://github.com/qedus/nds

Try this: https://github.com/averni/restgate


bind hash join with space vs. colon. add missing resource config cookbook property

Description
The bind property when set as a hash, joins using a space instead of a colon.
Adds the missing config_cookbook property to all resources and docs
Issues Resolved
Resolves #388 - the bind property when set as a hash, joins using a space instead of a colon.
Contribution Check List

[ ] All tests pass.
[ ] New functionality includes testing.
[ ] New functionality has been documented in the README if applicable

          1 Error

:no_entry_sign:
Please include a CHANGELOG entry.

  Generated by :no_entry_sign: Danger

Looks liek you missed one conf cookbook?


Add in display description

Looks like this field is missing from the display? This is handy to have for web clients.

I can't seem to find the corresponding method for Enum, it looks like they don't have this unfortunately. https://github.com/epics-base/epicsCoreJava/issues/132

Note that "description" is only available for PVA, not CA,sim,loc,...


Error while importing tensorflow (DLL Load Failed+No module named '_pywrap_tensorflow_internal')

Please go to Stack Overflow for help and support:
https://stackoverflow.com/questions/tagged/tensorflow
If you open a GitHub issue, here is our policy:

It must be a bug, a feature request, or a significant problem with documentation (for small docs fixes please send a PR instead).
The form below must be filled out.
It shouldn't be a TensorBoard issue. Those go here.

Here's why we have that policy: TensorFlow developers respond to issues. We want to focus on work that benefits the whole community, e.g., fixing bugs and adding features. Support only helps individuals. GitHub also notifies thousands of people when issues are filed. We want them to see you communicating an interesting problem, rather than being redirected to Stack Overflow.

Hello, this is my first time on github so forgive me if I do something wrong.
I've been interested in machine learning and i've tried to install tensorflow (to use keras).
When I finally thought everything was installed and ready, I got this issue when importing tensorflow on python. Can someone help me?
System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): nope
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Windows10 64 bits
TensorFlow installed from (source or binary): pip3 install --upgrade tensorflow
TensorFlow version (use command below): 1.8.0
Python version: 3.5.2
Bazel version (if compiling from source): don't know what that is
GCC/Compiler version (if compiling from source): neither that
CUDA/cuDNN version: neither that
GPU model and memory: i have an intel CPU
Exact command to reproduce: import tensorflow

You can collect some of this information using our environment capture script:
https://github.com/tensorflow/tensorflow/tree/master/tools/tf_env_collect.sh
You can obtain the TensorFlow version with
python -c "import tensorflow as tf; print(tf.GIT_VERSION, tf.VERSION)"
Describe the problem
Describe the problem clearly here. Be sure to convey here why it's a bug in TensorFlow or a feature request.
Source code / logs
Traceback (most recent call last):
File "", line 1, in
File "c:\users\antoine rollet\appdata\local\programs\python\python35\lib\site-packages\tensorflow_init_.py", line 24, in
from tensorflow.python import pywrap_tensorflow  # pylint: disable=unused-import
File "c:\users\antoine rollet\appdata\local\programs\python\python35\lib\site-packages\tensorflow\python_init_.py", line 49, in
from tensorflow.python import pywrap_tensorflow
File "c:\users\antoine rollet\appdata\local\programs\python\python35\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 74, in
raise ImportError(msg)
ImportError: Traceback (most recent call last):
File "c:\users\antoine rollet\appdata\local\programs\python\python35\lib\site-packages\tensorflow\python\pywrap_tensorflow_internal.py", line 14, in swig_import_helper
return importlib.import_module(mname)
File "c:\users\antoine rollet\appdata\local\programs\python\python35\lib\importlib_init_.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 986, in _gcd_import
File "", line 969, in _find_and_load
File "", line 958, in _find_and_load_unlocked
File "", line 666, in _load_unlocked
File "", line 577, in module_from_spec
File "", line 906, in create_module
File "", line 222, in _call_with_frames_removed
ImportError: DLL load failed: Une routine d’initialisation d’une bibliothèque de liens dynamiques (DLL) a échoué.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "c:\users\antoine rollet\appdata\local\programs\python\python35\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 58, in
from tensorflow.python.pywrap_tensorflow_internal import *
File "c:\users\antoine rollet\appdata\local\programs\python\python35\lib\site-packages\tensorflow\python\pywrap_tensorflow_internal.py", line 17, in
_pywrap_tensorflow_internal = swig_import_helper()
File "c:\users\antoine rollet\appdata\local\programs\python\python35\lib\site-packages\tensorflow\python\pywrap_tensorflow_internal.py", line 16, in swig_import_helper
return importlib.import_module('pywrap_tensorflow_internal')
File "c:\users\antoine rollet\appdata\local\programs\python\python35\lib\importlib_init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
ImportError: No module named '_pywrap_tensorflow_internal'
Failed to load the native TensorFlow runtime.
See https://www.tensorflow.org/install/install_sources#common_installation_problems
for some common reasons and solutions.  Include the entire stack trace
above this error message when asking for help.

I'm facing the same issue :(

Ok I managed to avoid the problem by installing tensorflow 1.5 instead of 1.8. It does not solve the issue but might help some people

In my case it still doesn't solve the issue. 1.5 works well but doesn't have the 'eager execution' feature.

Nagging Assignee @rohan100jain: It has been 17 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @rohan100jain: It has been 32 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @rohan100jain: It has been 47 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @rohan100jain: It has been 62 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Did you look at https://stackoverflow.com/questions/42011070/on-windows-running-import-tensorflow-generates-no-module-named-pywrap-tenso which might have some pointers?

It has been 15 days with no activity and the awaiting response label was assigned. Is this still an issue?

yeah it is still an issue
i am using python 3.6.5
windows 7
the issue is still same if i try to install tensorflow 1.66 or above

It has been 14 days with no activity and the awaiting response label was assigned. Is this still an issue?

It has been 30 days with no activity and the awaiting response label was assigned. Is this still an issue?

It has been 44 days with no activity and the awaiting response label was assigned. Is this still an issue?

@Kundan999  - Hi, have you tried with tensorflow v 1.11 ?

Closing this issue due to staleness.
Please use the latest version of TensorFlow and build again. Feel free to open a new issue if the problem still persists.


Question regarding the force flag and the cloud-nuke-excluded tag

In my cloud I have a VPC, subnet and an EC2.
I tried to run cloud Nuke:
          ./cloud-nuke_linux_amd64 aws \
            --older-than 1m \
            --region us-east-1 \
            --delete-unaliased-kms-keys \
            --exclude-resource-type vpc \
            --exclude-resource-type ec2_dhcp_option \
            --exclude-resource-type kmscustomerkeys \
            --exclude-resource-type app-runner-service \
            --exclude-resource-type managed-prometheus \
            --config config/config.yaml \
            --force

I wanted to exclude a specific EC2 and a specific subnet, tagged with cloud-nuke-excluded: true

this is the scan result:

BUT THE EC2 WAS DELETED!
I don't get the rules here, if someone can explain me
edit: my config file is:
OIDCProvider:
  exclude:
    names_regex:
      - AWSSSO*
      - token.actions.githubusercontent.com
  protect_until_expire: true

CloudtrailTrail:
  exclude:
      names_regex:
          - controltower*
  protect_until_expire: true

LambdaFunction:
  exclude:
    names_regex:
      - controltower*
  protect_until_expire: true

CloudWatchLogGroup:
  exclude:
    names_regex:
      - controltower*
  protect_until_expire: true

ConfigServiceRecorder:
  exclude:
    names_regex:
      - controltower*
  protect_until_expire: true

ECRRepository:
  exclude:
    names_regex:
      - cdk*
  protect_until_expire: true

DynamoDB:
  exclude:
    names_regex:
      - terraform*
  protect_until_expire: true

s3:
  exclude:
    names_regex:
      - cdk*
      - terraform*
  protect_until_expire: true

IAMRoles:
  exclude:
    names_regex:
      - ControlTower*
      - controltower*
      - cdk*
      - ExecutionRole*
      - ServiceRole*
      - stacksets*
      - admin*
  protect_until_expire: true

IAMServiceLinkedRoles:
  exclude:
    names_regex:
      - ControlTower*
      - ServiceRole*
  protect_until_expire: true

SNS:
  exclude:
    names_regex:
      - controltower*
  protect_until_expire: true

found it. The EC2 prevented the eni and the subnet from being deleted so it deletes it and ignore the tag.