Users should be able to configure a bot account and provider service or jwtAuthToken from the UI

Feature
If anyone is setting up Ingestion,  currently, we ask them to create a service account and go to https://github.com/open-metadata/OpenMetadata/blob/main/conf/openmetadata.yaml#L177 to set up the auth config and restart the server.
This is prone to several issues in debugging and getting it right.
In some cases, such as google SSO we will ask users to create the private key file and copy that file to the airflow container, which requires volumes to be set up.
We are increasing the steps and potential failures when we are asking users to secure the cluster.
Describe the task
Improvements

We have user-level authentication mechanisms https://github.com/open-metadata/OpenMetadata/blob/main/openmetadata-core/src/main/resources/json/schema/entity/teams/user.json#L10
UI should allow users to create bot accounts. During this setup, they can select an SSO (service account) or JWT Token
If they select an SSO account based on the SSO provider they selected, we should show the required fields for admins to copy token contents
Here, it's important that we get an identity created. Example ingestion-bot is pre-added, data quality-bot, etc if the users want to create a different user identity, that's ok as long as they associate the user to the ingest-bot entity. So that in cases of azure where service account identity can be a UUID, they should be able to add that as the user, we will create the respective user and associate with the bot account.
In the case JWT token, we need to validate if the JWT token is set up. For docker, we will ship default JWT configs. So all of the docker POC can be done through JWT Token
During any workflow deployment, we associate the identity of a bot to a service. Example ingestion bot identity is associated with all the service ingestion workflows, and data quality bot identity is associated with DQ tests deployment and so on..

The above approach allows users to configure everything through the UI and add bot identity and secrets through the UI as well. This will help reduce the no.of steps required to set up.
cc @chirag-madlani @vivekratnavel @mohitdeuex

@nahuelverdugo lets try to close it out in 0.12.1

@harshach can we have some UI mockups?

@nahuelverdugo can you take a look

Some questions:

What is the purpose of the Role?
Do we want to have a fixed botUser, for example, ingestion-bot?
Once we store the credentials, how do we use them when creating an ingestion workflow from UI and CLI?
If my OM server has Google SSO enabled, does it make sense to configure, for example, Azure SSO?

@nahuelverdugo , Please Let @open-metadata/ui know once backend changes are landed.

@devyani-kaushik, we will need an updated mock for this.


test(routes): GET /accounts/{id} with invalid session

closes hoodiehq/camp#64

Can you check what’s up with the coverage? If you could add a few more tests to increase coverage, that’d be A+


A+C: add Jordan Stoker

As requested in https://github.com/gonum/gonum/pull/1892

Codecov Report
Patch coverage has no change and project coverage change: -0.02% :warning:

Comparison is base (93223b4) 74.00% compared to head (de27dd5) 73.99%.

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@            Coverage Diff             @@
##           master    #1895      +/-   ##
==========================================
- Coverage   74.00%   73.99%   -0.02%
==========================================
  Files         526      521       -5
  Lines       63210    63030     -180
==========================================
- Hits        46778    46638     -140
+ Misses      13854    13825      -29
+ Partials     2578     2567      -11

see 6 files with indirect coverage changes

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Wrong results with frequency

Hi,
I've been playing with frequency a bit, but got odd results, and here is what I found.
Take this simple csv file
alpha,num
"a",1
"b",2
"b",1
"a",2

run xsv frequency -s alpha,num
result:
field,value,count
alpha,b,2
alpha,a,2
num,2,2
num,1,2
then run xsv frequency -s num,alpha
result:
field,value,count
num,a,2
num,b,2
alpha,1,2
alpha,2,2
I get the correct result only if I put the fields in the same order as the file header

When I debug the Frequencies I do see the proper cardinality of values and content.
// https://github.com/BurntSushi/xsv/blob/master/src/cmd/frequency.rs#L89
for (i, (header, ftab)) in head_ftables.enumerate() {
  println!("{:?}: {:?}", &ftab, &ftab.cardinality());
  let mut header = header.to_vec();
  ...

does print the expected hash-map and proper cardinality:
{[107]: 1, [102]: 1, [106]: 1, [97]: 1, [103]: 1, [105]: 1, []: 1, [98]: 1, [104]: 1, [100]: 1, [101]: 1, [99]: 1}: 12

It seems counts.into_iter() (https://github.com/BurntSushi/xsv/blob/master/src/cmd/frequency.rs#L124) is where we loose some items.
I am a real newbie at rust and did not spend enough time to grasp what is going on there.
I hope this helps.

I’ve also been surprised about some missing items when using frequency until I found out about its --limit option. By default, this option is set to 10 so you’ll never see more than 10 items.
Of course, this doesn’t explain all of the issues mentioned above but is hopefully helpful for some.

This issue still exists. Really hope this issue gets more attention.

@sonicdoe Thanks — just got tripped up by this myself.
@BurntSushi IMHO if --limit is going to eliminate some categories by default, it absolutely should not do so silently. For example, it could print + 12 categories (at equal or lower frequency) after the table. If we then need another switch to suppress that message, so be it.


added Randommeme command

Added Randommeme command alongside GSON as a Dependency using Maven
Had to be written without any real IDE so mistakes may have been made; code itself works

Please change the line-ending in your IDE to CRLF to get proper diffs

Please change the line-ending in your IDE to CRLF to get proper diffs

On it

Github closed the PR since i force-pushed into master, you'd need to reopen another PR, sorry about that.


Hadoop -> Ceph transition

Updated paths and files to write to /ceph instead of /hadoop

Merged, though the tests need to get updated eventually. Closing #27


Request to add KSP version checking via .version file to bluedog design bureau

Bluedog design bureau's current netkan file is handled via the Spacedock API. as such it is only marked as compatible with KSP 1.8
However the .version file in the zip will have the correct KSP compatibility info (back to ksp 1.6.1).
We would really appreciate if you guys could set it up so that the backwards compatibility is picked up from the version file. Thanks a lot!
https://github.com/KSP-CKAN/CKAN-meta/tree/master/BluedogDB

Done in #7450, see https://github.com/KSP-CKAN/CKAN-meta/commit/4bf8612320aa64218b06cbbd369d15c1333e5cc3

Thanks so much!


felix/bpf: fix err handling in bpf_program_attach_cgroup

As the error is encoded in the link pointer, it it not NULL in case of
an error.
Description

Related issues/PRs

Todos

[ ] Tests
[ ] Documentation
[ ] Release note

Release Note

None required

/merge-when-ready delete-branch

/merge-when-ready

/merge-when-ready

/merge-when-ready

/merge-when-ready


Proposal: [Create Defi App to Airdrop and Farm Altcoin on Kairos]

Description

The Airdrop N Farm  program is designed to provide users with a hands-on experience interacting with on-chain smart contracts.
Airdrop action to transfer Altcoin to user wallets and send them to the Altcoin farming.

Bounty track

[Defi]

Github: https://github.com/olym3labs/OKAirdropNFarm
Demo: https://ok-airdrop-n-farm.vercel.app/

Hmmm... reviewing this. Give me a day or two.


Wrong project after cancel when creating new syncer

Environment:

Existing Syncers:
* Name
    * Server: localhost
    * Project: [Name]
    * Repo: stash.company.com:port
    * Template: [Name]PRs
* Buildasaur
    * Server: localhost
    * Project: Buildasaur
    * Repo:stash.company.com

What happened was I was creating a new Syncer to point to a 2nd project instance of Buildasaur on public GitHub instead of my copy on our Stash server
It reached the page to test the repo-server connection and this failed (possibly due to our company firewall).
I clicked "Cancel"
Then tried to recereate the Syncer again
Selected LocalHost.  Next.  OK
Xcode Server: Next.  OK
Select Xcode Project:  Add new xcode project...  Next.
Now the screen shows me the template for my "Name" project already filled in instead of letting me choose a project.
I suspect that something remembers that a project was selected, or something didn't get cleared out.  The Name project syncer was running at the time.
=======
Seeing if it is repeatable::
Quit Buildasaur  (was running in debug mode in Xcode)
Tell Xcode: Run
Tell Buildasaur: View "Name" Syncer
Start Syncer "Name"
Click on [New Syncer]
Select Xcode Server...  https://localhost (user)  [Next].
Xcode Server:  https://localhost, user, password    [Next].
access verified
Select Xcode Project...  Add New Xcode Project   [Next].
Hmmmm... something is stuck.  Comes up with
https://localhost + "Name" + New Build Template
showing the "Name" project already selected, showing the stash URL, and ssh keys already filled in
Not good.
It appears to be stuck on the "Name" Syncer even though I selected "Add New Xcode Project..."

Additional Info:
Checked Syncers.json.  Looks OK.

[
  {
    "preferred_template_ref" : "9FB36056-E824-4B17-B6C6-0A509ABB53CF",
    "id" : "651B80E6-FB03-427C-96FE-8BF40BFF235C",
    "sync_interval" : 300,
    "server_ref" : "C88C41F4-C4D3-4111-AF0C-A4757EF38AA7",
    "post_status_comments" : true,
    "project_ref" : "2D993DA2-2E3B-4C12-B3C3-0CDD1EC3CCD2",
    "wait_for_lttm" : false,
    "watched_branches" : [

    ]
  },
  {
    "preferred_template_ref" : "D31B0052-101E-4DD9-8E25-EB0B871DC902",
    "id" : "4ABE76A1-D1B5-4E2A-82D9-17C45E03AA7F",
    "sync_interval" : 120,
    "server_ref" : "C88C41F4-C4D3-4111-AF0C-A4757EF38AA7",
    "post_status_comments" : true,
    "project_ref" : "19D91C4D-04B8-4088-9D96-51DBFE479D13",
    "wait_for_lttm" : false,
    "watched_branches" : [

    ]
  }
]

Checked Projects.json
Shows 3 projects, although the project pop-up only showed two: Name, Buildasaur
The 2nd project was created with the same project name even though the syncer was never created.

[
  {
    "service_type" : "github",
    "ssh_public_key_url" : "\/Users\/user\/.ssh\/id_rsa.pub",
    "id" : "2D993DA2-2E3B-4C12-B3C3-0CDD1EC3CCD2",
    "url" : "\/Users\/user\/buildasaur\/buildasaur\/Buildasaur.xcworkspace",
    "ssh_private_key_url" : "\/Users\/user\/.ssh\/id_rsa"
  },
  {
    "service_type" : "github",
    "ssh_public_key_url" : "\/Users\/user\/.ssh\/id_rsa.pub",
    "id" : "19D91C4D-04B8-4088-9D96-51DBFE479D13",
    "url" : "\/Users\/user\/name\/myrepo\/Name\/Name.xcworkspace",
    "ssh_private_key_url" : "\/Users\/user\/.ssh\/id_rsa"
  },
  {
    "service_type" : "github",
    "ssh_public_key_url" : "\/Users\/user\/.ssh\/id_rsa.pub",
    "id" : "AB5EDAF0-8C6B-4401-ABE1-188F0CC45C0F",
    "url" : "\/Users\/user\/buildasaur\/myrepo\/Buildasaur.xcworkspace",
    "ssh_private_key_url" : "\/Users\/user\/.ssh\/id_rsa"
  }
]

I presume you've tested having multiple syncers with the same project name, but different projects.
It is possible that this could be related to having two projects with the same name existing on different repos.  (I am guessing, without looking at the code)
Note: There is no Template file created for  the 3rd project entry, which makes sense since we never got to creating a new template.
I'll be looking at the code next.

A little more info...
When I select the "Name" project, then it used the 2nd Buildasaur project.
This seems like there is an ordering issue which is getting the order wrong.
Popup shows:

Buildasaur
Name
New Project...

Selecting each of these we get:

Buildasaur - stash
Buildasaur - github
Name - stash

Once again, this could be an issue with the fork. If you can reproduce this error with the official release of buildasaur (just with BitBucket Cloud and GitHub.com projects, I'll take a look because that would mean it's an issue in main repo Buildasaur).

I'll let you know.
The branch I forked from gchiong currently only works on my Stash server,
as the JSON shows all projects are "github".
So, the plan come Monday is to work off a direct fork of your repo, and add
in the Stash server and verify we see something other than just "github" it
can work against both Stansh and GitHub at the same time.
Once that is working I will test against github, or possibly will try a
test against github before I add the Stash stuff to see if it is
reproducible on your master build.
Cheers,
-Carl
On Fri, Jun 3, 2016 at 1:28 AM, Honza Dvorsky<EMAIL_ADDRESS>wrote:

Once again, this could be an issue with the fork. If you can reproduce
this error with the official release of buildasaur (just with BitBucket
Cloud and GitHub.com projects, I'll take a look because that would mean
it's an issue in main repo Buildasaur).
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/czechboy0/Buildasaur/issues/277#issuecomment-223521001,
or mute the thread
https://github.com/notifications/unsubscribe/AARgKcF6VrDRSkXBYa11Yj6kN9tZ4MMAks5qH-WsgaJpZM4IoAb8
.


Error after adding the firebase_auth_ui dependence

Hello!
Thank you for the module!
Do you have any idea what is the reason for these errors even if I don't call any auth methods?
Launching lib\main.dart on AOSP on IA Emulator in debug mode...
√ Built build\app\outputs\flutter-apk\app-debug.apk.
  The application may be doing too much work on its main thread.
 I'll look into it ASAP :)

Thanks man!On May 23, 2020 13:29, Sandip Fichadiya<EMAIL_ADDRESS>wrote:
Hi, I haven't seen this error earlier. I'll look into it ASAP :)
—You are receiving this because you authored the thread.Reply to this email directly, view it on GitHub, or unsubscribe.

I recently downloaded this package last night and am receiving the same errors. Appreciate you looking into this @sam0829!

@sam0829 My only purpose at the moment is email/password and the error does not seem to break anything. When I look into other sign-in methods, I will let you know if anything breaks.

getting similar error when i select google account .Any updates ?


gtld functionality

Here is the first pass at a PR, it is ready for comments but not a merge. Here is why:

No tests. I have the test JSON files but I haven't written the tests yet.
We are displaying Registrar Addresses but in the examples they don't do that. We can rip that out but I wanted the functionality b/c I thought it was very odd that it wasn't in there and didn't want to have to do the work for it later if we needed it.
in Tech/Admin etc.  every part of the address fields displays even if it doesn't have data. The examples always have data. I am unclear whether we should display empty fields or not.
Every role except for abuse is missing the contact email. How the heck did I miss this? 🫨
The files. error.rs. help.rs, types.rs. network.rs I thought we would originally need them. We may need them in the future? I don't know. I believe we could just remove them. They are NOPs.
In entity.rs we have a String utility, I should move it to somewhere else. It looks weird just sitting there by itself. But where to move it? The other string util is in the md directory, and it doesn't really fit. Do we create our own string.rs for one util? Stick in mod.rs? 🤷

Code Organization. I'm not sure what you envisioned for how the code is broken out and utilized. We can certainly change it however you want.

Also, I had forgot to mention that the phone and the fax numbers were missing for roles. I have that working now but is not in this PR. Yet.

Addressing the bullet points:

No tests. I have the test JSON files but I haven't written the tests yet.

I believe in tests.

We are displaying Registrar Addresses but in the examples they don't do that. We can rip that out but I wanted the functionality b/c I thought it was very odd that it wasn't in there and didn't want to have to do the work for it later if we needed it.

Leave it. Seems useful.

in Tech/Admin etc. every part of the address fields displays even if it doesn't have data. The examples always have data. I am unclear whether we should display empty fields or not.

If we ever get redacted right, we'll probably display "REDACTED" or something. So just leave it, IMHO.

Every role except for abuse is missing the contact email. How the heck did I miss this? 🫨

There are a lot of tedious things in this.

The files. error.rs. help.rs, types.rs. network.rs I thought we would originally need them. We may need them in the future? I don't know. I believe we could just remove them. They are NOPs.

I vote to remove them if the have no value.

In entity.rs we have a String utility, I should move it to somewhere else. It looks weird just sitting there by itself. But where to move it? The other string util is in the md directory, and it doesn't really fit. Do we create our own string.rs for one util? Stick in mod.rs? 🤷

I commented in the code review, but with just one helper function it is fine to leave it there. If a bunch of string related helper functions start building up, then we can consider a refactor. The great thing about software is that it is malleable.

Removed the CentailNiC test file, added some others, finished the tests, added Role emails and fax, used the Contact API and changed the name to GtldWhois.
The one remaining bit that's left hanging that I can think of it the functions (fn) are still all to_gtld not to_gtldwhois.
Which do you prefer?

I think to_gtld_whois.

Done!


Can't register the edited WSA

The PC, which I use for this, hasn't any Sideloading-Product-Keys installed 🤔😢

Settings > Privacy & security > For developers
Open Developer Mode


BlSpaceBuilder uses BlMorphicWindowHost ?

Shouldn't it use BAMorphicWindowHost ?
BlSpaceBuilder>>initialize
super initialize.

space := BlSpace new.
spaceExtent := 100 asPoint.
host := BlMorphicWindowHost new.

....

Yes, we can change it.
I'm not sure about the whole BlSpaceBuilder, in fact. I wrote it with the goal of reduce the length of the test examples (which I called fixtures).


[ICE: TBD] WETH-nextWETH position on Arbitrum is not visible in the UI

Describe the bug
The user has a WETH-nextWETH position in our pools on Arbitrum. (addy: 0xa6c7bb04e35d98ed775fe78efe330ebfe7d059a4)
But he can't see his position in our site.
He already tried rotating RPCs which didn't help.
I requested him to check the console, this is the result:

Is the issue similar to this one? : https://github.com/connext/monorepo/issues/6171 (btw i don't understand why it appears like "base" if the user is trying to access the pool on arbitrum)
Additional context
https://app.intercom.com/a/inbox/qge2vd8z/inbox/shared/all/conversation/977?view=List
@oncall

Having difficulty reproducing this one. Will backlog until prioritized.

#6171 connected? @just-a-node

#6229

A note on this:
One of the users who reported this says they deposited 0.51 ETH. Then kept it there for 1 month+ @20-22% APR. And now when they go to withdraw (and debank says the same), the total amount to withdraw is less than 100.1% of the initial deposit, when at these rates it should be closer to 101-102%

Keep me informed about the status. @jwtong

Need more info, can they share what info is missing in a screenshot?

It's happening on Base now
https://app.intercom.com/a/inbox/qge2vd8z/inbox/shared/all/conversation/1555?view=List

Another user having the same issue with not loading the nextWETH balance on Base
https://app.intercom.com/a/inbox/qge2vd8z/inbox/shared/all/conversation/1557?view=List


Transpile node4 compatibility

changed short hand notation to long-hand old school notation

oh, and cleaned up folders so there is only one version of the parser.


Bug report

Description
Without buying we can use party poppers for unlimited time pls fix that , some issues in badges i can't claim badges and have gaved like powers in shop by buying a item it will give some extra lucky chance but that not working so fix it mainluy
Steps To Reproduce
Explained all in description
Expected behavior
Need to be fixed as soon as possible
Discord Version
Latest
Shard Id
Idk
Relevant Assets/Logs
No response

Greetings, kindly ensure that all the fields are filled out accurately and comprehensively, providing as much relevant information as possible for each issue. The reason for the inclusion of these questions is to facilitate a thorough and effective investigation of the matter at hand.
Overview of the form

Steps to Reproduce means explain the steps, commands, arguments you provided when you encountered each error or bug. The preview text shows an outline of how it should be answered.

Expected Behaviour. What is the command suppose to do and what did it do instead? At what stage did you receive the incorrect behaviour.

Versions. Simply run the /about command to get the Shard ID and go into the client settings to view the Discord Version. Simply stating "latest" doesn't explain anything - how do you know it is the latest, what if a new version came out afterwards etc etc.

Relevant Assets/Logs. Show us evidence, screenshots, that there is a problem.


[Registry Preview] Copy context menu, data toltip, MULTI_SZ fix

Summary of the Pull Request
This PR...

fixes line break parsing for REG_MULTI_SZ
adds a tool tip to show the multiline version of value data.
adds context menu with various copy actions to Key tree and Value list.

Screenshots

PR Checklist

[x] Closes: #36629 , #36627
[x] Communication: I've discussed this with core contributors already. If work hasn't been agreed, this work might be rejected
[x] Tests: Added/updated and all pass
[x] Localization: All end user facing strings can be localized
[ ] Dev docs: Added/updated
[ ] New binaries: Added on the required places

[ ] JSON for signing for new binaries
[ ] WXS for installer for new binaries and localization folder
[ ] YML for CI pipeline for new test projects
[ ] YML for signed pipeline

[ ] Documentation updated: If checked, please file a pull request on our docs repo and link it here: #xxx

Detailed Description of the Pull Request / Additional comments

Validation Steps Performed
Manual testing.

Can someone please restart the pipeline. I worry that we have conflicts as the FancyZones UI test failed on some context menu stuff. 🤔


Change the OnOff buton by the switch

Really nice work ! Merging this right now :)
Just one feedback about CSS files, you should not add the CSS file path to the layout.ejs file. You should add them to the "tasks/pipeline.js" file, because CSS files are concatenated + minified during build process ! And the resulting CSS file is injected in the layout.


create a bat script to run mamute on Windows

http://www.guj.com.br/23858-como-instalarconfigurar-o-mamute

Seems like it is already installed at windows 7 or above.
If you use a previous version os windows you will need to install it manually

I tried to start it with windows, and even made the proper configuration in pom,
to user windows and non windows trigger a profile,
But was stack with grunt modified my files, and even don't create a proper link to the resource
because the link without suffix (jquery[suffix].js) if any one can help it would be great and the community will grow with windows users.


Consider Gatekeeper Integration

https://github.com/pagekit/pagekit/blob/91d06369914dc4e246f60d9398f8e34c8b9ff6d2/app/modules/auth/src/RememberMe.php#L191
This is not a good model for storing long-term "remember me" authentication tokens. Check out psecio/gatekeeper, which implements the strategy I outlined in the blog post in the previous sentence.

N.B. Thanks for the link to the article, it's brilliant and now saved to my bookmarks! I especially like the PasswordLock library they mentioned.
You're absolutely right, however I don't think implementing an entire authentication & authorisation library like psecio/gatekeeper is necessary for this, so I thought I would add some context and a solution.
Firstly, Pagekit is an impressive project and I can see large adoption in the future. With Pagekit supporting extensions you have no idea who could be using it or how - it's even possible that government (think local council website that links to national government services) could be using it! Security is obviously important for being a reputable open-source project.
Scenario
Imagine you have an information leak: a full or partial set of the database (which happens to include user data) along with the applications secret key is released. This is more likely than most people think: outsourced developers having read-only access to the database, insecure backups or replication connections, disgruntled employees, the fact that FTP is still a thing, etc.
We're going to assume that the attacker doesn't have access to the server to make modifications, and since the passwords are hashed with BCrypt we (foolishly, though predictably) thought the worst has happened.
The Problem
sha1($usernameFromLeak . $futureExpiraryDate . $passwordHashFromLeak . $compromisedKey);

The attacker now has all the data required for constructing the correct Remember Me cookie value for any user exposed in the information leak, and therefore is able to pose as the user without ever having to enter a password - they even get to choose when they want the cookie to expire.
If you thought confidential data leaking was bad, imagine how catastrophic it would be if an attacker could perform actions as another user? Think:

Updating address information and making purchases instead of just being able to view order history.
In the case of the government example above, modifying personal tax information or sending license revocation requests.

A lot of people may think this is all doom and gloom but you'll be amazed at what people build on top of a CMS. Know how much of the internet WordPress powers?
The Solution
Regardless of whether you hash or encrypt the cookie value, this problem will always occur when using a constructable value (ie, always have the same value given a set of predetermined data like username, password hash and secret key) - it has to be sufficiently random.
As the replacement for the Remember Me hash is now random and unable to be generated again, this "token" will have to be persisted into storage and treated as if it were a plaintext password (since it holds the same authentication potential): hash that bad boy!
Violà, an attacker cannot construct a Remember Me cookie without brute-forcing a BCrypt hash! In fact, not even the application can predict the value of the Remember Me cookie until the user presents it in a request.

Consider concatenating the Remember Me token with the users IP and user agent. Makes them a little less portable.

Performance

One extra random sequence generation, hash, and database insert on the generation of the cookie.
Once extra hash comparison on the authentication of a remembered user.

I think that's a fair compromise.

Just so you're aware, another solution would be to use JWTs to validate that the value of the Remember Me cookie was generated by your application and hasn't been tampered with. This approach however is entirely based on the assumption that the application secret or private key used doesn't get compromised.
Just pointing out that there's more than one way to do something, and there may be a solution out there better than the one I've presented.

@zanderbaldwin Thanks for your input! We reworked Pagekits session and "remember me" management.

No remember me cookie anymore
'remember me' information is stored in the session (stored at database)
Session IDs are hashed
Auto logout after 15 minutes inactivity
After a 'remember me' auto login the session id changes

What do you think?
https://github.com/pagekit/pagekit/commit/48a812b2e08747f28b558ac55df98f4ab42ae645
https://github.com/pagekit/pagekit/commit/e66dd047a4511de1113b0b631c27b52a720d028e

Hi, I'll take a look at the two commits over the weekend - I'm moving today so probably won't have a computer available until Sunday.


GeForce 3090 incompatibility with Nightly

System information

Using a stock example script provided in TensorFlow
Linux Ubuntu 18.04
TensorFlow installed from Nightly
TensorFlow version v1.12.1-45908-g9af48cb079
Python version 3.8
CUDA 11.1 cuDNN <IP_ADDRESS>
GeForce RTX 3090 with 24265MiB

Describe the current behavior
Training does not run on the GPU, shows "warning":
Your CUDA software stack is old. We fallback to the NVIDIA driver for some compilation. Update your CUDA version to get the best performance. The ptxas error was: ptxas fatal   : Value 'sm_86' is not defined for option 'gpu-name'
Describe the expected behavior
Training should run on the GPU
Standalone code to reproduce the issue
Install GeForce 3090 then install nightly GPU:
conda create -n tf-n-gpu python=3.8
conda activate tf-n-gpu
pip install tf-nightly-gpu
pip install matplotlib
pip install IPython

Run:
https://www.tensorflow.org/tutorials/generative/pix2pix

We don't officially support conda here.

I thought that was the recommend method of installation.
What installation method is supported then?

https://www.tensorflow.org/install/pip

I'm having the same issue.
System Info

RTX 3080
Linux Ubuntu 20.04
tensorflow 2.4.0rc1-gpu (Docker Image)

@Harsh188,
Could you please submit a new issue from this link and fill in the template, so that we can track the issue there. Thanks!

Upgrading to tensorflow==2.4.0rc2 fixed this issue for me.

@3DTOPO,
Any updates regarding this? Please feel free to close the issue if resolved. Thanks!

Sorry I haven't had time to go back and check. Looks like rc2 may address it so I will try that soon and report back.

I have the same problem.
RTX 3090
tensorflow-gpu 2.4.0rc3
cuda 11.1.105 (tried 11.0, same error)
cudnn <IP_ADDRESS>
It showed Your CUDA software stack is old. We fallback to the NVIDIA driver for some compilation. Update your CUDA version to get the best performance. The ptxas error was: ptxas fatal   : Value 'sm_86' is not defined for option 'gpu-name' for a few hundred times and started training. The training seemed fine though.

I followed the directions in this article: Install TensorFlow & PyTorch for the RTX 3090, 3080, 3070. So far it works pretty well and allows me to utilize my 3080 with TF 2.3.

This is still a problem

I have the same problem.
RTX 3080
Ubuntu 18.04
tensorflow-gpu 2.4.0(official release)
cuda 11.0
cudnn <IP_ADDRESS>
Have use the same packages mention by tensorflow link
It showed Your CUDA software stack is old. We fallback to the NVIDIA driver for some compilation. Update your CUDA version to get the best performance. The ptxas error was: ptxas fatal : Value 'sm_86' is not defined for option 'gpu-name' for a few hundred times and started training. The training seemed fine though.

This is still an issue for me.
RTX 3080
Ubuntu 20.04
NVIDIA driver 455.38
tensorflow-gpu 2.4.0
Tried with both cuda 11.0 and 11.1
cudnn <IP_ADDRESS>

Same here,
GTX 3090
TF 2.4.0
CUDA 11.0
cudnn 8.0.4

Yeah also the same here.
GTX 3090
tensorflow/tensorflow:2.4.0-gpu docker image

Yeah also the same here.
GTX 3090
tensorflow/tensorflow:2.4.0-gpu docker image

It works with the latest nightly-gpu docker image (https://hub.docker.com/layers/tensorflow/tensorflow/nightly-gpu/images/sha256-f9c8333811c5426be605352f307d665a089343cd699e0b49da128dbde18008ad?context=explore) though.

I got the same error many times while running the notebook. But finally the training is running on the gpu:
I additional put this code at the beginning of the notebook:
import tensorflow as tf
gpu = tf.config.list_physical_devices('GPU')
tf.config.experimental.set_memory_growth(gpu[0], True) #limits gpu memory

see: https://github.com/tensorflow/tensorflow/issues/45635#event-4131192988
GPU: RTX 3060 TI
Ubuntu-Server-20.04
Driver Version: 455.45.01
cuda_11.0.3_450.51.06
cudnn-11.0-linux-x64-v<IP_ADDRESS>
Tensorflow: 2.4.0

I am having the same issue and non of the above solutions worked for me

I am having the same issue and non of the above solutions worked for me

@drahmad89,
Could you please submit a new issue from this link and fill in the template, so that we can track the issue there. Thanks!

@drahmad89,
Could you please submit a new issue from this link and fill in the template, so that we can track the issue there. Thanks!


MSDKUI-2106: Update for iPhones X*

Signed-off-by: Piotr Szmyt<EMAIL_ADDRESS>

Codecov Report

Merging #141 into master will decrease coverage by 0.01%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master     #141      +/-   ##
==========================================
- Coverage   87.55%   87.53%   -0.02%
==========================================
  Files          89       59      -30
  Lines        5931     3683    -2248
==========================================
- Hits         5193     3224    -1969
+ Misses        738      459     -279

Flag
Coverage Δ

#ios
87.53% <ø> (-0.02%)
:arrow_down:

Impacted Files
Coverage Δ

MSDKUI_Demo/IconButton.swift

MSDKUI_Demo/OptionsViewController.swift

MSDKUI_Demo/ManeuversOverviewViewController.swift

MSDKUI_Demo/GuidanceDashboardViewController.swift

MSDKUI_Demo/ExtensionArray.swift

MSDKUI_Demo/RouteViewController.swift

MSDKUI_Demo/ExtensionUITableViewCell.swift

MSDKUI_Demo/ExtensionBundle.swift

MSDKUI_Demo/ExtensionNMAMapMarker.swift

...UI_Demo/GuidanceDashboardTableViewDataSource.swift

... and 18 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3762fe4...2b324e8. Read the comment docs.


Visualise the WorkflowTemplate in the UI without submitting a Workflow

Summary
Currently, the UI does not show the complete graph for workflows unless the tasks/steps are scheduled. A visual representation of the workflow in the UI would go a long way. This was a blocker for convincing developers to adopt Argo Workflows
Use Cases
Visual representation of Workflow templates would be beneficial for people who are not familiar with that template. The only option right now is to view the manifest.

Message from the maintainers:
Love this enhancement proposal? Give it a 👍. We prioritise the proposals with the most 👍.

Duplicate of #8646


⚠ Samsung has degraded performance

In 0dba1e1, Samsung (https://samsung.com) experienced degraded performance:

HTTP code: 200
Response time: 2740 ms

Resolved: Samsung performance has improved in f02104f.


Tag filter: double tags

"Österreich" is a tag occured in at least two categories. If I selected both and search for profiles in the tag search field are six tag buttons shown. I think that is a special case that not really happen that often but should be solved sometime ;)

In comparison "Afghanistan" is always shown once although it is listed in two categories; and "Afrika" is shown twice, but the same color (but listed in two different categories).

seems to work now, I can't reproduce the error


[go_router] Extra parameter is always null in route level redirect callback

Extra parameter is always null in route level redirect, but it's working fine for top-level redirect.
It was working fine in v3, the issue only exists for latest v4.
Steps to Reproduce

Clone the repo https://github.com/sarbagyastha/router
Run the app and tap on "Go to Second page"
In the console, you'll be able to see that the extra is printed as null, though it's being passed.

Expected results: I should see the extra parameter printed in console.
Actual results: The extra parameter is printed as null in console.

flutter doctor -v
[✓] Flutter (Channel stable, 3.0.2, on macOS 12.4 21F79 darwin-arm, locale en-NP)
    • Flutter version 3.0.2 at /Users/sarbagya/Development/flutter
    • Upstream repository<EMAIL_ADDRESS>    • FLUTTER_GIT_URL =<EMAIL_ADDRESS>    • Framework revision cd41fdd495 (9 days ago), 2022-06-08 09:52:13 -0700
    • Engine revision f15f824b57
    • Dart version 2.17.3
    • DevTools version 2.12.2

[✓] Android toolchain - develop for Android devices (Android SDK version 32.1.0-rc1)
    • Android SDK at /Users/sarbagya/Library/Android/sdk
    • Platform android-32, build-tools 32.1.0-rc1
    • ANDROID_HOME = /Users/sarbagya/Library/Android/sdk
    • Java binary at: /Applications/Android Studio.app/Contents/jre/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 11.0.12+0-b1504.28-7817840)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 13.4.1)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • CocoaPods version 1.11.3

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] Android Studio (version 2021.2)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.12+0-b1504.28-7817840)

[✓] VS Code (version 1.68.0)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.42.0

[✓] Connected device (3 available)
    • iPhone 13 Pro Max (mobile) • 52A89D3C-1D4B-42EE-817A-C77345806588 • ios            • com.apple.CoreSimulator.SimRuntime.iOS-15-5 (simulator)
    • macOS (desktop)            • macos                                • darwin-arm64   • macOS 12.4 21F79 darwin-arm
    • Chrome (web)               • chrome                               • web-javascript • Google Chrome 102.0.5005.115

[✓] HTTP Host Availability
    • All required HTTP hosts are available

• No issues found!

/cc @chunhtai @johnpryan

I can reproduce this on stable and master.
I have modified the route like this:
    GoRoute(
      path: '/second',
      name: 'second',
      builder: (_, state) => SecondPage(
        queryParams: state.queryParams,
        extra: state.extra,
      ),
      redirect: (state) {
        print('state.location: ${state.location}');
        print('state.queryParams: ${state.queryParams}');
        print('state.extra: ${state.extra}');
        return null;
      },
    ),

Navigation code as follows:
            router.pushNamed(
              'second',
              queryParams: {'a': 'b'},
              extra: 'test-extra',
            );

The logs printed are:
flutter: state.location: /second?a=b
flutter: state.queryParams: {a: b}
flutter: state.extra: null

Extra is available in builder but not in redirect
flutter doctor -v (Stable)
[✓] Flutter (Channel stable, 3.0.2, on macOS 12.4 21F79 darwin-arm, locale en-US)
    • Flutter version 3.0.2 at /Users/nabeelparkar/fvm/versions/stable
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision cd41fdd495 (8 days ago), 2022-06-08 09:52:13 -0700
    • Engine revision f15f824b57
    • Dart version 2.17.3
    • DevTools version 2.12.2

[✓] Android toolchain - develop for Android devices (Android SDK version 33.0.0-rc4)
    • Android SDK at /Users/nabeelparkar/Library/Android/sdk/
    • Platform android-33, build-tools 33.0.0-rc4
    • ANDROID_SDK_ROOT = /Users/nabeelparkar/Library/Android/sdk/
    • Java binary at: /Applications/Android Studio.app/Contents/jre/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 11.0.12+0-b1504.28-7817840)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 13.4.1)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • CocoaPods version 1.11.3

[✓] Chrome - develop for the web
    • CHROME_EXECUTABLE = /Applications/Brave Browser.app/Contents/MacOS/Brave Browser

[✓] Android Studio (version 2021.2)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.12+0-b1504.28-7817840)

[✓] IntelliJ IDEA Ultimate Edition (version 2022.1.2)
    • IntelliJ at /Applications/IntelliJ IDEA.app
    • Flutter plugin version 68.1.4
    • Dart plugin version 221.5787.37

[✓] VS Code (version 1.68.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.42.0

[✓] Connected device (2 available)
    • macOS (desktop) • macos  • darwin-arm64   • macOS 12.4 21F79 darwin-arm
    • Chrome (web)    • chrome • web-javascript • Brave Browser <IP_ADDRESS>

[✓] HTTP Host Availability
    • All required HTTP hosts are available

• No issues found!

flutter doctor -v (Master)
[✓] Flutter (Channel master, 3.1.0-0.0.pre.1284, on macOS 12.4 21F79 darwin-arm, locale en-US)
    • Flutter version 3.1.0-0.0.pre.1284 at /Users/nabeelparkar/fvm/versions/master
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision fae31eecce (55 minutes ago), 2022-06-16 19:58:05 -0700
    • Engine revision f8c0dc87bc
    • Dart version 2.18.0 (build 2.18.0-189.0.dev)
    • DevTools version 2.14.0

[✓] Android toolchain - develop for Android devices (Android SDK version 33.0.0-rc4)
    • Android SDK at /Users/nabeelparkar/Library/Android/sdk/
    • Platform android-33, build-tools 33.0.0-rc4
    • ANDROID_SDK_ROOT = /Users/nabeelparkar/Library/Android/sdk/
    • Java binary at: /Applications/Android Studio.app/Contents/jre/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 11.0.12+0-b1504.28-7817840)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 13.4.1)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Build 13F100
    • CocoaPods version 1.11.3

[✓] Chrome - develop for the web
    • CHROME_EXECUTABLE = /Applications/Brave Browser.app/Contents/MacOS/Brave Browser

[✓] Android Studio (version 2021.2)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.12+0-b1504.28-7817840)

[✓] IntelliJ IDEA Ultimate Edition (version 2022.1.2)
    • IntelliJ at /Applications/IntelliJ IDEA.app
    • Flutter plugin version 68.1.4
    • Dart plugin version 221.5787.37

[✓] VS Code (version 1.68.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.42.0

[✓] Connected device (2 available)
    • macOS (desktop) • macos  • darwin-arm64   • macOS 12.4 21F79 darwin-arm
    • Chrome (web)    • chrome • web-javascript • Brave Browser <IP_ADDRESS>

[✓] HTTP Host Availability
    • All required HTTP hosts are available

• No issues found!

Fixed by https://github.com/flutter/packages/pull/2404


[Bug] Incorrect surrogate key combination used in search report

Is there an existing issue for this?

[X] I have searched the existing issues

Describe the issue
The Microsoft ads search report model uses the following columns as a surrogate key:
        - date_day
        - account_id
        - campaign_id
        - ad_group_id
        - ad_id
        - keyword_id
        - search_query
        - device_os
        - device_type
        - network

This combination of columns does not uniquely identify a record, and the test fails. The cause of this is:

match_type (a concatenation of two fields) is used in the select from the base table, but not included in the surrogate key. The two fields that are concatenated into match_type are actually part of the key for the base table (bingads.keyword_performance_daily_report). This is a screenshot of Fivetran as evidence:

Additionally, keyword_id is part of the composite key, but that field is left joined from the keyword history table. Since it's left joined, and keywords are apparently hard deleted from the history table (wtf Microsoft!), the resulting value will be null, which is no bueno for a field that is used in a surrogate key.

Proposed solution:

add match_type to the unique test in microsoft_ads.yml
Inner join to keyword to remove the possibility of null keyword_id values in the surrogate key

Relevant error log or model output
Failure in test dbt_utils_unique_combination_of_columns_microsoft_ads__search_report_date_day__account_id__campaign_id__ad_group_id__ad_id__keyword_id__search_query__device_os__device_type__network (models/microsoft_ads.yml)

Expected behavior
Passing tests
dbt Project configurations
vars:
prod_database: analytics
prod_schema: business
operdb_schema_pattern: 'operdb%'
raw_data_db: GONG
"dbt_date:time_zone": "America/Los_Angeles"
timezone_constant: "America/Los_Angeles"
ad_reporting__apple_search_ads_enabled: False # by default this is assumed to be True
ad_reporting__pinterest_ads_enabled: False # by default this is assumed to be True
ad_reporting__twitter_ads_enabled: False # by default this is assumed to be True
ad_reporting__facebook_ads_enabled: False # by default this is assumed to be True
ad_reporting__snapchat_ads_enabled: False # by default this is assumed to be True
ad_reporting__tiktok_ads_enabled: False # by default this is assumed to be True
linkedin_ads_schema: linkedin_ads
linkedin_ads_database: source_raw
google_ads_schema: google_ads
google_ads_database: source_raw
microsoft_ads_schema: bingads
microsoft_ads_database: source_raw
Package versions
packages:

package: fivetran/salesforce_formula_utils
version: 0.6.4

package: calogica/dbt_date
version: 0.5.7

package: fivetran/ad_reporting
version: [">=1.0.0", "<1.1.0"]

What database are you using dbt with?
snowflake
dbt Version
1.0.1
Additional Context
No response
Are you willing to open a PR to help address this issue?

[X] Yes.
[ ] Yes, but I will need assistance and will schedule time during our office hours for guidance
[ ] No.

Hi @clay-walker thanks for opening this issue. Someone from my team will follow up here in the next few days to discuss the issue further and determine a possible solution.

hey @clay-walker i definitely agree that match_type should be included in the surrogate key!
as for your second point, does microsoft hard-delete keyword_id from the daily search report? i am wondering if changing this line to reference report.keyword_id (instead of keyword_history) would result in no nulls. i must admit i'm a little apprehensive to apply an inner join 😨
also just curious - do you know if microsoft hard deletes IDs from other history tables (ie campaign or ad_group?)

looks like someone else is seeing this issue with the microsoft ad_group report as well - https://github.com/fivetran/dbt_microsoft_ads/issues/18. and we've just confirmed that keyword_id or other ids are not hard-deleted from the report tables.
so my next question would be, what's your opinion on referencing the report.keyword_id instead, so that if a keyword has been hard-deleted, you'd still have its ID but not any other info about it from the keyword_history table? would that be valuable or confusing/unnecessary to have, as opposed to filtering them out with an inner join? i presume that some people would at least want to keep them 🤔
i am thinking that the path forward will be

adding match_type to the surrogate key
auditing the whole microsoft package for any instances in which we selecting an id (such as keyword_id) in the final CTE of a model, but from the right side of the join. we should change this to reference the report on the left side of the join

Hi @clay-walker the latest version of the package (v1.0.4) should address this issue you identified within this bug report. Feel free to upgrade to the latest version and the initial issue should be addressed.
For the time being I will close this issue as the fix has been rolled out. Please feel free to reopen or create a new issue if you experience any other questions when using the package.


validVersions=$(curl -sL https://$downloadURL | jq .tags[])

this line should have some retry in case of some trancient network issue.

referenced code is no longer used


simple circleci.com px4_fmu-v5 build & archive example

We don't need this in PX4/Firmware, but it serves as a nice simple example for both public and private forks. Circleci is one of the only continuous integration services that has a free tier for private projects, so having this in tree (and maintained) makes it trivial to get started.
FYI @LorenzMeier @julianoes @mrpollo @hamishwillee

Does it need docs? Ie perhaps a page "Circle CI" in http://dev.px4.io/master/en/test_and_ci/ ?
I don't know enough to write that, but if you can bullet point what you'd like to say ....

It's not high priority or anything, but it might be worth a quick mention in the Dev guide that it only takes a few clicks/seconds to have your own personal/private build system going. It's for anyone with their own fork of PX4 (public or private) that typically wouldn't bother setting up this kind of thing (small companies, students, researchers, etc).
To use it you just login to Circleci via github (https://circleci.com/), point it at your repo (PX4/Firmware fork) and it will start building and storing px4_fmu-v5_default binaries using our docker containers. You could try this yourself with a fork.


Fix daily builds tests failures

Steps to reproduce
Check daily builds
https://ci.appveyor.com/project/PowerShell/powershell-f975h/history
Expected behavior
No error
Actual behavior
InvokeOnRunspace method on remote runspace.Error occurred in Describe block

Exception calling "Open" with "0" argument(s): "Connecting to remote server localhost failed with the following error message : Access is denied. For more information, see the about_Remote_Troubleshooting Help topic."

At C:\projects\powershell-f975h\test\powershell\Host\HostUtilities.Tests.ps1:54 char:9

This is related to the recent changes with admin / non-admin test separation
Start-Process.Should should handle stdin redirection without error

Expected {0} to be greater than {0}

at line: 69 in C:\projects\powershell-f975h\test\powershell\Modules\Microsoft.PowerShell.Management\Start-Process.Tests.ps1
69: 	$dirEntry.Length | Should BeGreaterThan 0

Apparently @adityapatwardhan already took care about disabling the first one, and @PaulHigin is in the process of addressing the second on in #2362


Peep, URLs in requirements files & Travis cache invalidation

We have several entries in the Treeherder requirements file which refer to a github zip archive rather than a pypi version release:
https://github.com/mozilla/treeherder/blob/c7205463351910f4c63f43f349975502a4a8aa7d/requirements/common.txt#L60
This means peep tries to download it on every Travis run, which doesn't actually take long, however it then means that changes are detected in the cached virtualenv directory, causing a 60s file upload to S3 for the new cache. eg:
https://travis-ci.org/mozilla/treeherder/builds/59898650
Strangely, only one of the ZIP-using packages shows up in the "changed files" list at the bottom of the Travis log:
store build cache
change detected: /home/travis/virtualenv/python2.7.9/lib/python2.7/site-packages/datasource/DataHub.py
changes detected, packing new archive
uploading archive

So (a) do you know what might be different about this package to cause changes to be found, and (b) is there any way I can either get peep to not re-install the package (eg instead of using just "#egg=datasource" on the end of the URL, add a feature to allow using "#egg=datasource-0.6"?) or else can I trick Travis into playing ball?

The package in question is:
https://github.com/jeads/datasource
I guess one explanation might be that Travis only shows the first changed file in the cache, and then just skips to the upload rather than checking the rest (ie all of the URL packages might be changed, but datasource was just the first seen).
Ideally we'd just upload datasource to pypi, however (a) it's not my package and the owner has left Mozilla, (b) there is already a package on pypi with the same name, so I'm going to have to change it, and (c) we're wanting to move off this package in the next 6 months anyway.

eg instead of using just "#egg=datasource" on the end of the URL, add a feature to allow using "#egg=datasource-0.6"

ie make _is_always_unsatisfied() less strict, if we can extract a version number from the #egg=foo-0.9:
https://github.com/erikrose/peep/blob/62e83473dc537fa3b998d6b031ad18729e0ef244/peep.py#L389

Some notes from IRC:

Well, the -x.y would not be compatible with existing pip behavior.
Unfortunately, the hard bit is that, once installed, the tarball is obliterated. It isn't anywhere in the venv. You'd have to define a way to unpack the new tarball and compare its contents with what's currently installed in the cached venv. And, unless it's a wheel, installing runs arbitrary code, so that's hard.
Let me sketch something crazy: You could wrap peep in a tool that caches the old reqs file and compares it with the current one. Then, have it remove all lines except the new ones, and install just those new packages into the existing venv.

Yeah I wasn't meaning actually comparing the tarballs, I was meaning cheating and just trusting the user provided string in the reqs file.
This all said, I guess it's such an edge case (using a tarball for something that does update it's versions properly but isn't on pypi) that perhaps I should just hack around this by setting the mtime in the new Travis before_cache step (only just seen https://github.com/travis-ci/docs-travis-ci-com/commit/088be0f8de1c45135bcfa6d3b48ee0a561448716)

Oh wait, I'd missed the is_git_sha() part - ah I thought this applied to all URL-specified requirements, but it's only those with a SHA for a filename. That's easy then - we'll just make sure there is a Github release zip available for this package, and we won't have to use the SHA :-)
I might add something to the docs to make this clearer.

Ha. :-) I was never too enthusiastic about special-casing the GH SHAs, but it seemed to fill an important niche for Mozilla and probably wouldn't surprise anybody.

The current readme says:
  into a non-empty virtualenv--Peep doesn't bother downloading or building it
  again.```

Perhaps adding an "except in the case of URLs that contain SHA-like filenames (eg Github revision source zips)", might be clearer?

Yes, and we should explain why we make the exception, if we don't do it elsewhere: because people don't update the version number with every commit.


TypeError: expected str, bytes or os.PathLike object, not NoneType

Hi, thanks for sharing your excellent work!!
I followed your installation tutorial, but I encounter the problem of sacred == 0.7.2(from oxwhirl/fork)
Traceback (most recent call last):   File "src/main.py", line 19, in <module>     ex = Experiment("pymarl")   File "/home/public/anaconda3/envs/torch/lib/python3.8/site-packages/sacred/experiment.py", line 72, in __init__     super(Experiment, self).__init__(path=name,   File "/home/public/anaconda3/envs/torch/lib/python3.8/site-packages/sacred/ingredient.py", line 57, in __init__     gather_sources_and_dependencies(_caller_globals)   File "/home/public/anaconda3/envs/torch/lib/python3.8/site-packages/sacred/dependencies.py", line 487, in gather_sources_and_dependencies     sources = gather_sources(globs, experiment_path)   File "/home/public/anaconda3/envs/torch/lib/python3.8/site-packages/sacred/dependencies.py", line 440, in get_sources_from_imported_modules     return get_sources_from_modules(iterate_imported_modules(globs), base_path)   File "/home/public/anaconda3/envs/torch/lib/python3.8/site-packages/sacred/dependencies.py", line 409, in get_sources_from_modules     filename = os.path.abspath(mod.__file__)   File "/home/public/anaconda3/envs/torch/lib/python3.8/posixpath.py", line 374, in abspath     path = os.fspath(path) TypeError: expected str, bytes or os.PathLike object, not NoneType
How can I do?

Hi FanScy,
I guess a newer version of sacred can solve this problem. You can first install it by running
pip install git+https://github.com/oxwhirl/smac.git
If this does not work, add an if clause
if mod.__file__ is not None
before this line!


Automating Windows Application with Pywinauto

Article checklist
Formatting and structure checks

[x] Have you used the correct folder and file structure? - see Contribution Guidelines

[x] Is your article properly formatted in Markdown? - see Github Markdown guide

[x] Have you used our preferred heading structure? - H3 (###) and up

[x] Does your article follow any of the suggested structure formats? - see example formats

[x] Is your article over 750 words? - Tool: Wordcounter.net

[x] Is the article you are submitting an in-depth and unique article? Does it go beyond what is in the official docs and what is covered in other blog sites. See these articles as examples.

[x] Does your article provide enough value and detail about your topic? - Articles should be clear, accurate, and fully explained.

[x] Can your article be understood by beginners? - Assume the audience is smart but has no prior exposure to the common terminology in your article.

[x] Have you included a hero image that is 600x400 pixels, under 300KB in size, and have the copyright to use it? - Tools: Pixlr Image Editor for resizing and Unsplash for Creative Commons images

Grammar & plagiarism checks

[x] Have you spellchecked and grammar checked your article? - Tools: Write&Improve - ProWritingAid - Grammarly
[x] Please place your article through a 3rd party plagiarism checker. We suggest using Quetext, this tool is free and has a daily limit. We typically accept articles with 10% or less.
[x] Have you checked your article for readability? - Tool: Hemmingway
[x] Have you added sources for quotes and images that aren't yours?

Technical checks

[x] Are your code snippets properly formatted for syntax highlighting - see Syntax guide
[x] Have you checked your code runs correctly and you've highlighted all necessary dependencies for installation?
[x] Are the software programs and packages you're highlighting in your article up to date, using current versions and not deprecated?

Topic suggestion this closes

Remove the backticks and add the issue number below to link and close your Topic Suggestion (issue) when your article has been published (PR has been merged). See this video for more details.

This closes #5906

Finally, delete the article checklist notes in blockquotes and submit your PR. We look forward to reviewing your article.

Hi @Bonimum
Your article appears to have many sentences that are taken verbatim from third-party sources. We can't publish any content that is not original or properly cited/referenced. There are many free online tools where you can check this (such as quetext.com, and if you're uncertain about the definitions around plagiarism, this is a good resource to reference. We're really looking for unique/original content.
Automating Windows Application with Pywinauto #6353 Copyleaks Report.pdf

Hello @Dawe-7 Have reopened a new article here  #7401


SMOG - SmogToAge

Your SMOG formula matches the values in https://en.wikipedia.org/wiki/SMOG, which you refer to.
That site says the result is a grade.
Your smog-formula returns 11.2 for the Gettysburg Address, which is an appropriate grade level based on the other tests' scores.
But your smogToAge method must have been based on something else, and is returning age 6 as the result for an 11.2 score. I think you just want it to be the same gradeToAge call you have for the other tests.

Weird, the code “inverts” the smog formula to get a score instead of an age. For some reason I must’ve thought that smog-formula didn‘t return a grade-level (which dale-chall-formula also doesn’t do) 🤷♂


Init before drivers are used

The user should be able to import the module with parameters, such as whether test mode and/or verbosity is wanted.
This could be in the form of being able to run an initiation function before the GPIO board is set up; this is currently attempted on import.

Idea: a config file containing true/false for test mode etc.
For example, a file called l293d-config.py,
containing the line test_mode_enabled = false.
This file could be edited manually, or there could be a script to prompt for changes.

I've used a Python file, config.py, to store values needed throughout l293d.py.


Add an SBOM

Here at CloudNativeSecurityCon there's a lot of talk about SBOMs. I realized this project doesn't have one yet which appears to be a serious issue especially since the executive order.

It does and it's nothing


chore: prettier 3.0.3 fixes

Description

run npm run format

:tada: This PR is included in version 1.233.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Is there the possibility of bringing to Flutter?

I know the extension is for node -based environments, but is there a possibility to bring to the flutter?

I've tried with React Native, it must be similar, my conclusion is that if you have a Quarkus backend for a mobile native app, then Quinoa can be nice if you also have a browser based app from it.. Else I don't really see the point:

Quinoa can easily be configured to start the web app like any node framework
To test the mobile native app, I suggest you start it manually as I am not sure how we could nicely deal with device simulators

For non node framework like flutter, in theory it should be possible but I am not sure if it would fit the Quinoa workflow.
Let's keep this issue open as a reminder for me to have look ;-)

I would like to create a Flutter Web SPA and deploy with Quarkus backend. Inside the same container image.

We could imagine having something like this:
quarkus.quinoa.custom-package-manager.install=some-binary install
quarkus.quinoa.custom-package-manager.dev=some-binary start
quarkus.quinoa.custom-package-manager.build=some-binary build
quarkus.quinoa.custom-package-manager.test=some-binary test

See #133


feat: GET /api/slack-login

closes #44

I cannot reproduce the problem locally. What I found out when ssh'ing into the actions build is if I only run these two tests

POST /api/github-webhooks with timeout
setupApp() - called twice

Then I am able to reproduce the error


Expose Request\Response events

I would like to use ServiceRemotingServiceEvents.SendResponse to do global exception handling\logging. The problem is there is no way to say I want my SendResponse to be called before yours, so sometimes the exception is logged after the app insights operation is finished in your SendResponse, so my exception is not correlated to any of the messages in the chain. Could you expose events before closing the operation?

@festivus So we register our event handler at here, which is triggered in initializing the ServiceRemotingRequestTrackingTelemetryModule.
Can you try to register your SendReponse event handler before initializing ServiceRemotingRequestTrackingTelemetryModule?


feat: new sidebar position options

feat: new sidebar position options

rightAbsolute: the default, fixed to the right of the screen
rightRelative: immediatly right to the content
leftRelative: immediatly left to the content

possible, but currently not implemented fully:

leftAbsolute: left on the screen

:tada: This PR is included in version 4.7.0 :tada:
The release is available on:

v4.7.0
GitHub release

Your semantic-release bot :package::rocket:


There is an issue in initializing variable directly in the return type; unlike in other EVM.

Minimal Example:
Reproducible Example:
call getUserMaxBorrowables with the following data on this contract. The function returns undefined .
user = 0xa445BC34f142808c5dCB0A68679159CC7Ac58329
assets = [0x2Cf0D30D00D88113dA4f0Ec04C7C336E5c3714B8]
Basically the code does a loop on getUserMaxBorrowable, which can take the same input except 1 asset only.
  function getUserMaxBorrowables(address user, address[] memory assets) public view returns(uint256[] memory borrowables){
        if (assets.length > 0) {
            borrowables = new uint256[](assets.length);
            for (uint i;i < assets.length; i++) {
                borrowables[i] = getUserMaxBorrowable(user, assets[i]);
            }
        }
  }

However after the return value in the function is initialised separately outside the returns spec in this instance, it works:
  function getUserMaxBorrowables(address user, address[] memory assets) public view returns(uint256[] memory){
    if (assets.length > 0) {
        uint256[] memory borrowables = new uint256[](assets.length);
            for (uint i;i < assets.length; i++) {
                borrowables[i] = getUserMaxBorrowable(user, assets[i]);
            }
        return borrowables;
        }
    }

The 1st version of contract instance is working fine in BSC on our deployments, so I wonder what caused the discrepancy.

Which version did you use?

Could you please provide an example of a function call, including the parameters needed to reproduce it?

sure, the issue includes the details and instances for reproduction:
function call:
getUserMaxBorrowables
user = 0xa445BC34f142808c5dCB0A68679159CC7Ac58329
assets = [0x2Cf0D30D00D88113dA4f0Ec04C7C336E5c3714B8]
Instance that does not work, return undefined
this contract
Instance that works
this instance
The difference between these two instances is described on above, where the returned data is specified in return type versus defined within the function.
The 1st instance works in BSC, that's why i wonder.

The issue has been fixed.


Allow set values back to null

Properties variableSymbol, specificSymbol, constantSymbol, dueDate and xzPath have default value null.
Their getters allow to return null (for symbol properties) or use fallback value.
Their setters don't allow set these properties back to null.
Please allow set mentioned properties back to null by allowing nullable type in parameters of setters.

I'll look into it tonight.

I tested the change and it works as expected.
Thank you.


station-R

overview
creates "station R" protocol for station C replacement downstream of sample plating and RNA extraction protocols
changelog
3/24/2020

new files (adding thermocycling option to existing station C protocol)

see comments from @SyntaxColoring above. closing PR without merging


Planet Card Design

### Goal: Design Planet Card when user clicks on planet.
Basic layout
[Name]
[Wookie Link]
[Image]
[Coordinates]
[Relevant RP Links]
[Planet Description]
In progress:

Matching style of card to index page
Building Map Tools to help create the coord data more efficiently
Build a Search function native to the map to search planets
More to come with progress

Feel free to add more in a comment.

Basic layout example


Missing "get started approval" information

The current process consists in an additional "get certified approval" step right after the test+connect,  which is not mentioned in this guide. Moreover, there is no information on the device submission page about who is giving approval, what is the time range to get feedback, who should we contact if we want to update the getting started guide.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: cc3d1d7a-39b1-400d-d019-3061405c0ad3
Version Independent ID: 5ad5a207-b6b9-168a-ecac-35f8b0a70589
Content: Certify your IoT Plug and Play Preview device
Content Source: articles/iot-pnp/tutorial-certification-test.md
Service: iot-pnp
GitHub Login: @konichi3
Microsoft Alias: koichih

@enricomarongiu Thanks for the feedback! I have assigned the issue to the content author to evaluate and update as appropriate.

Hi @enricomarongiu - We've just published some updated guidance about the certification process. Please take a look at: https://docs.microsoft.com/en-us/azure/iot-pnp/howto-certify-device.

#please-close


Create Test Connection Workflow

Currently, the Test Connection endpoint is part of the Ingestion Pipeline Resource. However, the payload we send to the Test Connection endpoint, is not entirely related to an Ingestion Pipeline.
Context
In https://github.com/open-metadata/OpenMetadata/pull/10383, we are adding greater support for Testing Connections to services, as well as a property in services to show their latest test connection results.
Proposal
The goal is to separate the Test Connection from the Ingestion Pipeline into a new Workflow/Automations Resource.
The process will be as follows:

The UI triggers a new Test Connection Workflow, generating a workflow ID & the service name we are testing
OM receives the request, and passes it to the Ingestion Framework
The ingestion Framework flags the Workflow as RUNNING while it tests all the connection steps
The UI keeps polling the Workflow by ID to get the results until the state is SUCCESS/FAILED
When the Ingestion Framework finishes the processing, it updates the state of the Workflow and updates the services Test Connection Results.
OM will have a garbage collector to clean up old workflows -> Maybe we can reuse something from the Data Insights? I believe we might be cleaning some data already (or at least we wanted to) 🤔

What happens if we test a workflow during service creation?

The UI triggers a new Test Connection workflow with a new ID and does not send a service name, but a set of credentials to test.
The Ingestion Framework receives the credentials. As there is no underlying service, creds cannot be fetched from the Ingestion Framework, they are received.
Polling from the UI + updates from the Ingestion side in the Workflow ID remain the same.
At the end, there is no service to update the Test Connection Results.

TBD: Add secrets manager logic
We'll create:

Workflow Resource
SQL table
method in each service to PUT the Test Connection Results (similar to sending Sample Data to a table)
We also need to add descriptions to steps in the Test Connection Definition

We have 3 possible test connections:

We have only connection (we are creating a service for the first time)
We test the connection of an existing service from the connection page (we just send the service name)
We test the connection of an existing service that we are currently editing (we need to send the service name + the edited connection to merge the changes + unmask -> and then send to Airflow)


Port ranges in network policies

The new endPort field for K8s' NetworkPolicies is in alpha in v1.21 and likely to become stable soon. It allows policies to target a range of ports instead of a single port.
Supporting this in Cilium will require changes in the datapath.
Tasks:

[ ] Add port range management mechanism

https://github.com/cilium/cilium/pull/20633

[ ] Add support for parsing/embedding port ranges from the API into the policy engine
[ ] Extend datapath for port range support
[ ] Implement policy engine -> datapath map generation logic

yay thanks !

@aanm 👋
This subject came into sig-network meeting, and we need one more CNI to graduate this. I've asked to move this to GA only in v1.24, wanted to know if this is going to be viable from Cilium side.
BTW sorry about not being helpful and opening a PR to this, but I have some lack of eBPF and C knowledge!
Thanks

I think that the simplest implementation of this is "just" a matter of doing some processing in the policy internals to process the policy with a port range to generate multiple BPF map entries, one for each port. This shouldn't necessarily require BPF datapath changes. The only danger is that if the user configures many of these, they could run into BPF map size limits though. These are also configurable so they don't have to be a hard limit, but the user should be made aware of the limits so they can account for this. Ideally we'd either have a good way to limit the user against programming too many ports like this (eg pick an arbitrary port range size like 5 ports and ignore policies with more than that + warn), or alternatively we come up with a more nuanced datapath implementation that is aware of port ranges.

@joestringer thanks for that.
Yeah, so I was afraid of a bad user doing something like
- port: 1
   endPort: 65534

In this case, there would be some problem like adding 65533 items in a map for each port right?
I will reflect a bit about this, maybe try to learn something and check if and how can I help on this, even adding some safeguards and some user feedback when the user tries to add more than X ports per rule

So per the suggested approach, here is what I'm going to do. In:
https://github.com/cilium/cilium/blob/a8e3fa283cf40b330035265bf83d63800b296bcf/pkg/k8s/network_policy.go#L280-L284
if endPort != nil, I'll iterate through port -> endPort and add all of those in []api.PortProtocol array.
Will make some tests this week and check how it goes.

@joestringer added: https://github.com/cilium/cilium/pull/17315
And btw, Cilium already limits for 40 ports per PortProtocol array in rules (discovered while writing the unit test) so I guess this works.
Now, putting my hat of "user", my only concern here is that I don't properly get feedback when I add more than 40 ports (other than errors in Cilium logs).
I'll start working on some KEP for Network Policy status and this way CNIs can provide feedback for users like "this rule was processed, or not, and why not" and I guess for Cilium and other CNIs would be good to say that "endPort is limited for 40 ports" , for example.
Thanks again for your help on this!

@rikatz thanks for taking a first stab at it. I agree there's definitely still some concerns there to grapple with.
Do you have a link to the original KEP and use cases? I feel like supporting huge port ranges in this kind of policies is counterproductive to the goals of nudging users towards the principle of least privilege.

Sure, here is the KEP link: https://github.com/kubernetes/enhancements/tree/master/keps/sig-network/2079-network-policy-port-range

I've looked through the use cases raised in https://github.com/kubernetes/enhancements/tree/master/keps/sig-network/2079-network-policy-port-range#user-stories . It seems to me like they have alternative implementations or workarounds that would work in Cilium without supporting endPort:

Story 1 - Opening communication to NodePorts of other cluster

Rather than implementing cluster<->cluster services via NodePorts, the user could use ClusterMesh to provide global services. Then the policy enforcement would be based on backend port numbers rather than NodePort service port numbers. Richer policy could also be used to match on backend pod labels rather than IPs.

Story 2 - Blocking the egress for not allowed insecure ports

A combination of a permissive allow policy (at L3) plus Deny Policies would allow the user to block communication to specific well-known ports that should always be denied.

Story 3 - Containerized Passive FTP Server

If the containerized FTP server is only hosting the server on port 21 as a regular (non-hostnetwork) pod, then there should be no functional difference between allowing inbound L3 access from authorized clients vs. allowing only ports 21 and 49152+ from authorized clients, since the containerization is providing isolation between this FTP server and the other services that would traditionally run adjacent to the FTP server in the same network namespace.

Based on the above, the question that comes to mind is basically whether it is worthwhile to integrate a partial solution like the initial proposal or not. Even if users wish to deploy these use cases using the endPort feature, the current proposal would restrict the ability to solve story 1 / 3 due to the port limitations. The "nice" effect would be to assist upstream k8s in the standardization of this new policy primitive. At the same time, I wonder if we would be in some sense undermining the standardization process if k8s netpol users cannot rely on all CNIs supporting all of these stories consistently.

I wasn't really tracking the implementation of this in Cilium, but it "came up" today.  Limiting this to small-N ports and creating N rules feels like a pretty severe limitation to me.  It sort of says "not implementable" to me. :(
My questions are:
a) Is my "not implementable" assessment too dramatic?
b) Is there anyone actually working on this?  (I really do not want to GA the feature without support in such a major impl)
c) Why did nobody jump up and down and scream that this design doesn't work for eBPF?  This has been on sig-net for a long time.
While Cilium is not part of Kubernetes, it's an important piece of the ecosystem.  We rely on the ecosystem, and that includes letting us know when we are making problems for you.

hiya folks, in general, the NetworkPolicy GA features, API  isn't fully supported by all providers. We have a tool https://github.com/mattfenwick/cyclonus that we've been using to evaluate this overall problem holistically (tabulates all evolved from the upstream e2es)
https://kubernetes.io/blog/2021/04/20/defining-networkpolicy-conformance-cni-providers/#results
There are other examples (pod CIDR policies) which are GA which also arent implemented in some cases.
We could do a new run of Cyclonus / netpol E2Es against

antrea 1.4
calico 3.21
cillium 1.11
kube-router
ovn-kubernetes @astoyocos

And evaluate this if its useful to have a more holistic picture of all the holes in the ecosystem .  Maybe we could just run them together on friday (we usually have a networking related hangout at 2pm EST/11 PST if folks want to join).
In general, Im pretty sure that we'll find a pretty broad range of results.

@rikatz FYI

FYI, as of Kubernetes v1.25, endPort is stable https://kubernetes.io/blog/2022/08/23/kubernetes-v1-25-release/#promoted-endport-in-network-policy-to-stable.

Just as a brief update, I added a short breakdown of the tasks necessary to support this use case efficiently in eBPF in order to minimize per-packet latency while supporting this new feature.

@joestringer What is the status of this issue?

Hello 👋

Hi! thanks to open this issue,  same problem here , cilium doesn't support port ranges,  any plan to launch the fix in future releases?

Seems like https://github.com/cilium/cilium/pull/23016 is the implementation, not sure how far away from merging though

@paurosello Considering that the 1.14 feature freeze is this Friday, that seems unlikely.

v1.14 feature freeze was last friday, we're not accepting new features at this time. I can't make any promises on behalf of other contributors about the status or plans to support it in newer releases, but your feedback is welcome on the PR.

Any update?

The datapath portion of this work has already been completed. We now need to make use of it in the agent. It should be out with 1.15.

Bad news. This is not going to make 1.15 and will be delayed to 1.16. Much more userspace code had to be refactored than initially estimated. Keeping a data structure of port ranges that is searchable is something that we needed to implement to merge L4-L7 policies by port-protocol ranges (for example, checking if an allow-policy overlaps with a deny-policy and then automatically attenuating the allow-policy range because of it).

Any update on this feature? 🙏

@kollender-noname it's making good progress, but it is contingent on https://github.com/cilium/cilium/pull/29717 and https://github.com/cilium/cilium/pull/30749.

Thanks @nathanjsweet
We hope to use this feature soon.
Are you still planning to release it in 1.16?
And if so - any estimation on when 1.16 is gonna be out?

@nathanjsweet There was mention in the past by @rikatz that cilium caps every PortProtocol array at 40 ports. Will that limit be greatly increased by this change? Is there a theoretical maximum that we know of at this time?

Hi cillium ! I'd also like to know if we can pin this to a specific release.... in the future ?

@sethstuart

There was mention in the past by @rikatz that cilium caps every PortProtocol array at 40 ports. Will that limit be greatly increased by this change? Is there a theoretical maximum that we know of at this time?

No. You'll be able to create any size range.
@jayunit100

Hi cillium ! I'd also like to know if we can pin this port range implementation to a specific release.... in the future ?

Very hopeful that we can make 1.16.

sorry, I've no idea what I did I was just looking at the project board and must have clicked something accidently. Completely unintentional

@nathanjsweet could you close it again as completed?

So is this still not completed? I'm confused.

Not yet. That large PR you reference is all of the work, but it is being broken up into smaller PRs (per reviewer feedback). Part 2 of 3 was just approved. The final PR will be open tomorrow.

https://github.com/cilium/cilium/pull/32807 is the last PR that needs to be merged for this issue to close.

We got quite a lot of work done on this, but it didn't quite make the cut for v1.16. Moving to the v1.17 milestone.

#32807 is the last PR that needs to be merged for this issue to close.

Isn't https://github.com/cilium/cilium/pull/32807 a good as done?

We got quite a lot of work done on this, but it didn't quite make the cut for v1.16. Moving to the v1.17 milestone.

Would that not be in time for v1.16?

Due to the active progress and community support for this feature we've made a feature freeze exception for this feature and merged the corresponding PRs into the main branch. This puts it on track for the upcoming v1.16 feature release ETA next month. We'll tag a release candidate v1.16.0-rc.1 with the feature likely early July, so it would be awesome to get some validation from users in their own staging / development environments about the experience with this feature in the release candidate.

Tested and worked fine for me!


Locale ru_RU. Update translation

Wow! Thanks for the reminder! Too much time has passed since last time. Ready to update.

I made some edits, think everything is ok. And I think you can merge now.

Great job @Arttse, thanks for your time.


shell_print crashes the board on bt bonds and bt connections

board - Particle Xenon
Zephyr ver (using main ref in west.yml) - c51aa88046ca5c9d687e3e6802b32ddd57dd6de4
toolchain zephyr 0.13.2

My project is mostly (using the Just Works pairing method by not running bt_conn_auth_cb_register) the same as peripheral_hids. The problem is that:

I erase the flash nrfjprog -e
flash the board

Then I run following commands in the RTT shell:
rtt:~$ bt bonds
bt bonds
Bonded devices:
Total 0
rtt:~$ bt connections
bt connections
Connected devices:
[00:00:19.206,909] <err> os: ***** USAGE FAULT *****
[00:00:19.206,909] <err> os:   Unaligned memory access
[00:00:19.206,909] <err> os: r0/a1:  0x00028d8f  r1/a2:  0x00001000  r2/a3:  0x00032f6f
[00:00:19.206,939] <err> os: r3/a4:  0x00028d8f r12/ip:  0x0000000a r14/lr:  0x0002626f
[00:00:19.206,939] <err> os:  xpsr:  0x21000000
[00:00:19.206,939] <err> os: Faulting instruction address (r15/pc): 0x00026076
[00:00:19.206,939] <err> os: >>> ZEPHYR FATAL ERROR 0: CPU exception on CPU 0
[00:00:19.206,970] <err> os: Current thread: 0x200010a0 (shell_rtt)
[00:00:19.531,158] <err> os: Halting system

Running addr2line -e zephyr/zephyr.elf 0x00026076 puts me here /home/mc/gits/magknob-zephyr-ble/zephyr/include/sys/atomic_builtin.h:243
Assume I also paired the board with an iPhone. Then running bt bonds crashes the board also.
rtt:~$ Connected 6C:6D:7D:A0:83:C4 (random)
Security changed: 6C:6D:7D:A0:83:C4 (random) level 2
bt bonds
bt bonds
Bonded devices:
[00:00:54.425,994] <err> os: ***** USAGE FAULT *****
[00:00:54.425,994] <err> os:   Unaligned memory access
[00:00:54.425,994] <err> os: r0/a1:  0x00028d8f  r1/a2:  0x00001000  r2/a3:  0x00032f3f
[00:00:54.425,994] <err> os: r3/a4:  0x00028d8f r12/ip:  0x0000000a r14/lr:  0x0002626f
[00:00:54.426,025] <err> os:  xpsr:  0x21000000
[00:00:54.426,025] <err> os: Faulting instruction address (r15/pc): 0x00026076
[00:00:54.426,025] <err> os: >>> ZEPHYR FATAL ERROR 0: CPU exception on CPU 0
[00:00:54.426,025] <err> os: Current thread: 0x200010a0 (shell_rtt)
[00:00:54.747,894] <err> os: Halting system

The address points me to /home/mc/gits/magknob-zephyr-ble/zephyr/include/sys/atomic_builtin.h:243 again.
The crash doesn't happen if I comment out the shell_print in this function (which gets run by cmd_bonds):
static void bond_info(const struct bt_bond_info *info, void *user_data)
{
    char addr[BT_ADDR_LE_STR_LEN];
    int *bond_count = user_data;

    bt_addr_le_to_str(&info->addr, addr, sizeof(addr));
    shell_print(ctx_shell, "Remote Identity: %s", addr);  // < if I comment this out, it works
    (*bond_count)++;
}

In general I can pair with iPhone for the first time (when prompted for pairing) but after disconnecting and trying to reconnect I get:
rtt:~$ Connected 78:7F:AE:13:34:85 (random)
Security failed: 78:7F:AE:13:34:85 (random) level 1 err 2
Disconnected from 78:7F:AE:13:34:85 (random) (reason 0x13)

That's for Just Works. When using setup reconnecting works fine. I need to pair without any pin though. This might be a separate issue but maybe connected...?

Trying to debug this.
I have added CONFIG_SHELL_BACKEND_SERIAL=n since I don't need it.
I see that the problem stems from the subsys/shell/shell.c:shel_vfprintf doing
void shell_vfprintf(const struct shell *sh, enum shell_vt100_color color,
		   const char *fmt, va_list args)
{
	__ASSERT_NO_MSG(sh);
	__ASSERT(!k_is_in_isr(), "Thread context required.");
	__ASSERT_NO_MSG(sh->ctx);
	__ASSERT_NO_MSG(z_flag_cmd_ctx_get(sh) ||
			(k_current_get() != sh->ctx->tid));
	__ASSERT_NO_MSG(sh->fprintf_ctx);
	__ASSERT_NO_MSG(fmt);

	/* Sending a message to a non-active shell leads to a dead lock. */
	if (state_get(sh) != SHELL_STATE_ACTIVE) {
		z_flag_print_noinit_set(sh, true);
		return;
	}
   ...
}

The sh->ctx->state has value of 255 and not the SHELL_STATE_ACTIVE/2. That means it executes z_flag_print_noinit_set(sh, true) to set the sh->ctx->print_noinit flag. It ends in atomic_or. The argument in atomic_or, atomic_t *target has address of 0x28a85. The ldrex op tries to read from that address into r0 register. That's where my firmware crashes!
0x25d66 <atomic_or>     mov     r3, r0
0x25d68 <atomic_or+2>   dmb     ish
0x25d6c <atomic_or+6>   ldrex   r0, [r3]
0x25d70 <atomic_or+10>  orr.w   r2, r0, r1
0x25d74 <atomic_or+14>  strex   r12, r2, [r3]
0x25d78 <atomic_or+18>  cmp.w   r12, #0
0x25d7c <atomic_or+22>  bne.n   0x25d6c <atomic_or+6>
0x25d7e <atomic_or+24>  dmb     ish
0x25d82 <atomic_or+28>  bx      lr
0x25d84 <atomic_and>    mov     r3, r0
0x25d86 <atomic_and+2>  dmb     ish
0x25d8a <atomic_and+6>  ldrex   r0, [r3]
0x25d8e <atomic_and+10> and.w   r2, r0, r1
0x25d92 <atomic_and+14> strex   r12, r2, [r3]
0x25d96 <atomic_and+18> cmp.w   r12, #0
0x25d9a <atomic_and+22> bne.n   0x25d8a <atomic_and+6>

In cmd_bonds printing to shell is done with sh pointer which points to shell_rtt but in the bond_info the shell is:
(gdb) p shell
$24 = (const struct shell *) 0x0 <_vector_table>

???

ctx_shell is invalid because the cmd_init never runs! Running bt init manually actually runs that function which binds ctx_shell.

I've created a PR with a simple solution https://github.com/zephyrproject-rtos/zephyr/pull/41844

I downgraded this to an Enhancelent/Feature request, since the current Bluetooth shell has been intentionally designed with the assumption that the Bluetooth stack is always initialised through the shell. Please also see my comments in the linked PR.

the current Bluetooth shell has been intentionally designed with the assumption that the Bluetooth stack is always initialised through the shell

Not disagreeing that that's how it is, but it's a really weird design, right? Shell applications are first and foremost debugging tools, if I'm debugging some bluetooth issue I'm not gonna start rewriting my application to no longer initialize the bluetooth stack by itself. bt is the only shell command I'm aware of that works like this.

I downgraded this to an Enhancelent/Feature request, since the current Bluetooth shell has been intentionally designed with the assumption that the Bluetooth stack is always initialised through the shell. Please also see my comments in the linked PR.

Just had a quick look at this.
Does it even make sense that bt_foreach_bond calls the callback before BT has been enabled?
The main issue here (in the shell) is that callbacks always assume that ctx_shell has been, which clearly is not the case.
Rather than trying to fix all the different places where ctx_shell can be incorrectly used, we should really just get rid of it as requested by https://github.com/zephyrproject-rtos/zephyr/issues/70945

I've encountered this bug as well. Calling bt init manually seems counter intuitive, also it throws some errors as some part of the bluetooth subsystem is initialized twice when calling it manually with error -120.

I think issue will be resolved by https://github.com/zephyrproject-rtos/zephyr/pull/74652


yarn install failing in Windows

I'm submitting a ...  (check one with "x")
[x] bug report => search github for a similar issue or PR before submitting

Current behavior
$ yarn
yarn install v0.17.0
[1/4] Resolving packages...
warning compodoc > angular2-dependencies-graph ><EMAIL_ADDRESS>Viz.js is deprecated.
[2/4] Fetching packages...
warning<EMAIL_ADDRESS>The platform "win32" is incompatible with this module.
info<EMAIL_ADDRESS>is an optional dependency and failed compatibility check. Excluding it from installation.
error<EMAIL_ADDRESS>The engine "node" is incompatible with this module. Expected version ">= 5.4.1 < 7".
error Found incompatible module
info Visit https://yarnpkg.com/en/docs/cli/install for documentation about this command.
Expected behavior
install should succeed
What is the motivation / use case for changing the behavior?
Caused by PR #1623
Please tell us about your environment:
Windows 10
Angular Seed Version: aaaaf75
2f90871
Node: node --version =
$ node --version
v7.1.0
$ yarn --version
0.17.0

try yarn install --ignore-engines

I'm on Linux and I'm seeing the same error. The --ignore-engines flag @Shyam-Chen mentioned is the only workaround, other than using npm install.


Stoneholm crashes Fabric 1.17.1 server when Fading is loaded

Describe the bug
When loaded on a Fabric server with the mod Fading (and all dependencies) the console reads this message:
****************** Blame Report Worldgen Import 1.17-4.0.1-fabric ******************

 Failed to load resource file: stoneholm:crypter

 Reason stated: Not a json array

 Possibly helpful hint (hopefully):
     This error typically means you need an certain kind of JSON array surrounding
     the current JSON. This is typically seen with worldgen JSON. If this is a worldgen JSON file, then
     check out slicedlime's example datapack for worldgen to find what's off: https://t.co/cm3pJcAHcy?amp=1

 Prettified form of the broken JSON:
{
  "processors": [
    {
      "rules": [
        {
          "output_state": {
            "Name": "minecraft:mossy_cobblestone"
          },
          "input_predicate": {
            "block": "minecraft:cobblestone",
            "probability": 0.01,
            "predicate_type": "minecraft:random_block_match"
          },
          "location_predicate": {
            "predicate_type": "minecraft:always_true"
          }
        },
        {
          "output_state": {
            "Name": "minecraft:cobblestone"
          },
          "input_predicate": {
            "block": "minecraft:barrel",
            "probability": 0.85,
            "predicate_type": "minecraft:random_block_match"
          },
          "location_predicate": {
            "predicate_type": "minecraft:always_true"
          }
        },
        {
          "output_state": {
            "Properties": {
              "rotation": "12"
            },
            "Name": "minecraft:wither_skeleton_skull"
          },
          "input_predicate": {
            "block": "minecraft:skeleton_skull",
            "probability": 0.005,
            "predicate_type": "minecraft:random_block_match"
          },
          "location_predicate": {
            "predicate_type": "minecraft:always_true"
          }
        },
        {
          "output_state": {
            "Name": "minecraft:air"
          },
          "input_predicate": {
            "block": "minecraft:skeleton_skull",
            "probability": 0.6,
            "predicate_type": "minecraft:random_block_match"
          },
          "location_predicate": {
            "predicate_type": "minecraft:always_true"
          }
        },
        {
          "output_state": {
            "Properties": {
              "facing": "north",
              "lit": "false",
              "signal_fire": "false",
              "waterlogged": "false"
            },
            "Name": "minecraft:campfire"
          },
          "input_predicate": {
            "block": "minecraft:campfire",
            "probability": 0.15,
            "predicate_type": "minecraft:random_block_match"
          },
          "location_predicate": {
            "predicate_type": "minecraft:always_true"
          }
        }
      ],
      "processor_type": "minecraft:rule"
    }
  ]
}

To Reproduce
Steps to reproduce the behaviour:

Make Fabric 1.17.1 server
Load Fading and Stoneholm (and dependencies)
See error

Expected behaviour
The mod is loaded on a Fabric 1.17 server and the message appears when Fading  is loaded
**Mod version:1.3
**Fabric API version:0.37.1+1.17
**Minecraft version:1.17.1
Additional Context:

I'm debating if I should also contact the Author of Fading about the problem.

The two mods run perfectly well individually from each other

Likely something to do with blockstates. I'll have a look.

Months too late to respond to this but I am aware of why this happens and I believe this is something that must be fixed on Fading's side.
Basically structure processors when placing blocks need to specify blockstates. When a mod adds additional blockstates this will break the structure processor as it hasn't specified those blockstates. Minecraft doesn't handle this leading to kaboom!


Type for unmarshalling CVE descriptions

Also sorts cves by id for consistency.

Closing in favor of #5.


Update-Notification for Services

⚠ Please verify that this feature request has NOT been suggested before.

[X] I checked and didn't find similar feature request

🏷 Feature Request Type
New Monitor
🔖 Feature description
I am hosting a few services myself, and the majority of these are "off the shelf" things like nextcloud, mattermost or WordPress.
I would love if uptime kuma could
a) identify the installed version
and
b) check against a canonical source for updates
then
c) notifying you, in case you're falling behind with updates
✔ Solution
uptime-kuma would provide a way to easily add software packages to it. Each software package would consist of

name
canonical "this version is latest" url/api (for example: github releases page of the project)
a way to identify the installed version (for example: HTTP-Header, HTML-Meta-Tag Generator, embedded as info in the site's footer, or wherever a software offers that information)

❓ Alternatives
Hand-Checking for Updates or subscribing to mailinglists, release notes and other things for all the software you deploy.
📝 Additional Context
No response

Candidates:

nextcloud:
a server will report its version at <hostname>/status.php{
  "installed":true,
  "maintenance":false,
  "needsDbUpgrade":false,
  "version":"<IP_ADDRESS>",
  "versionstring":"22.2.0",
  "edition":"",
  "productname":"Nextcloud",
  "extendedSupport":false
}

Current version could be obtained from https://nextcloud.com/changelog/
WordPress
an installation will usually have the version as part of the cache-busting in any pages' script-tag (better source probably needed)
current version can be obtained here: https://wordpress.org/download/releases/
HedgeDoc
the overwiew page has a link to the source code that's used, including git hash

current version can be obtained from https://github.com/hedgedoc/hedgedoc/releases

I do believe this is inline with what UK is for given the cert monitors, and I think this is JUST inside of feasible with an extension to the current http monitor, but I feel it would require jumping through some hoops to where I am not sure if it is worth it at this time.

I think it would make more sense if we have a plugin interface for these things, then the user can optionally enable it and reduce UI clutter. The EditMonitor screen is a lot more complicated than it was already.

I would be perfectly happy with a plugin system! In that case we could perhaps collect more examples here to make sure a plugin system's specification can support a good variety?

Other interesting candidates:

GitLab
minio
Matomo (Piwik)
BBB
JitsiMeet
FreeScout Helpdesk
Lemmy

Cross referencing: plugins is currently grouped in #117
Custom monitors are indeed one of the best examples of where plugins would be usefull. This issue and #805 (along with the ones that @ccoenen brought up) would likely best be implemented via custom plugins.

For these checks, I'd find it useful if they were tied to an existing monitor, somehow. In a way that's similar to the existing certificate checks.
I monitor git.example.com anyway for uptime. But if I could somehow give it the "Gitlab" trait, then I would have this information in one place. Also, the update check would not have to happen every minute. It would probably suffice to have that daily.

For these checks, I'd find it useful if they were tied to an existing monitor, somehow. In a way that's similar to the existing certificate checks.
I monitor git.example.com anyway for uptime. But if I could somehow give it the "Gitlab" trait, then I would have this information in one place. Also, the update check would not have to happen every minute. It would probably suffice to have that daily.

Oh yes, that would be insanely useful. I haven't seen any other tool which can lookup up new software updates on different servers. This can cause so many headaches handling not up-to-date software on various servers.


feat: Add support for running helm tests for a release

Description
This PR adds support for running the tests packaged in a helm release, and checking whether they passed or not.
Implements #190 , and takes inspiration from #140 since it seemed abandoned

@elenz97 can you have a look


Cache Functions instances by app

Fixes #7783.

Is the incremental coverage checker correct with its four reports? cc: @granluo

For the latest reports, I double checked with the xcresult artifact in this run. The reports should be correct.

Talked to Ryan offline and we agreed it'd be best to move Functions to broader FIRComponent adoption, with these specific points:

Functions should attempt to minimize creation of new instances as much as possible
Functions should return a new instance per combination of app, region, and custom domain

It's a bit late for code freeze, but we can punt to M99 if necessary.