side effects?

with the removal of constructors, and use of GPU, how can HVM be used for general purpose programming?
in HVM1 the a constructor could be implemented by the runtime as a built-in function, which could then do side effects, so without them how are things like syscalls called?
in fact by reducing the network on the GPU you might not be able to do side effects at all since you don't have access to the CPU OS from the GPU.

This is just a wip, there are no syscalls yet.

let me rephrase: what is the plan for integrating side-effects into this version of HVM?
the constructors might be replaceable with something else in the future, but the use of the GPU fundamentally limits what can run on this implementation.
so if the plan is for HVM to be used for general purpose programming (which requires side effects), and this repository isn't just to demonstrate that HVM can be fast, but is an actually planned to be a future version of HVM, then shouldn't this be something to consider early?

syscalls can be done via a monadic interface as with other pure functional languages, being on the GPU doesn't prevent that in any way, although it does add some overhead communicating with the CPU. on the ideal, finished runtime, I believe most of the code should run on the CPU, with gthe GPU being an opt-in for specific functions (like, if you're rendering an image using pure recursive functions, you probably want that on the gpu)

@nivkner you may be interested in this explanation of how to interact with the outside world in a purely functional language: https://lean-lang.org/functional_programming_in_lean/hello-world/running-a-program.html#functional-programming-vs-effects
It's for the Lean language, but the same concept could be applied to hvm-core, too. It helped me understand things at least. 😁


fixes #142

Previously the wrongly named variable was causing all resources to be
unlinked

Wow, big bug! Thanks for the PR. We should really have some better tests for this.


BirdDog P100/P120

Hi,
I'm new to Companion but already in love with it.
Hoping someone can help?
I'm eventually looking for PTZ camera control within my Unreal Engine virtual sets.
I received my new BirdDog P120 yesterday - it connects OK, but I get the following response when trying to control it.
2022-07-15T01:53:30.947Z,"instance(BirdDog PTZ)","info","Connected to birddog-XXXX"
2022-07-15T01:53:30.948Z,"instance(BirdDog PTZ)","error","Unrecognized camera model: P120"
2022-07-15T01:53:30.986Z,"instance(BirdDog PTZ)","info","Connected to birddog-XXXX"
2022-07-15T01:53:42.025Z,"instance(BirdDog PTZ)","warn","Error executing action: Cannot read property 'actions' of undefined"
API https://birddog.tv/AV/API/index.html

Closed by #63


magnific popup opening an another magnific popup

Can I open modal iframe from an already oppened modal inline?

[ Resolved ]
https://codepen.io/dimsemenov/pen/hwIng


Wildcard Let's Encrypt SSL certificate for Galaxy Interactive Environments

We need a wildcard DNS record for our Galaxy servers (main and test) and a method for obtaining a wildcard SSL certificate for both.
Preferably configured so we can use certbot via Ansible.
https://training.galaxyproject.org/training-material/topics/admin/tutorials/interactive-tools/tutorial.html
https://certbot.eff.org/docs/using.html#dns-plugins
@olsarnow, are you the<EMAIL_ADDRESS>Could you assist?

Hi Torfin,
Unfortunately, I am not the hostmaster of usegalaxy.no. It has been set up before my time. I'm sorry. I'll ask Kjell about that and come back afterwards.
BR Olaf

Ok.
@kjellp: What is needed, it seems, is to create the new zones 'interactivetool.usegalaxy.no' and interactivetool.test.usegalaxy.no'. Delegate these to a NS where we can do rfc2136 (dynamic DNS updates) using the rfc2136 plugin from certbot. I.e. PowerDNS and BIND should support this.
domeneshop.no does not support rfc2136. Can we use the nameservers at uib.no for this?

I guess it would be even easier to just move the NS of usegalaxy.no to Cloudflare. Free NS hosting, and there exists a certbot plugin.

Hi Torfinn,
I got access to the domeneshop tool, I'll check it and give you feedback asap.
Have a good start in the new week!
Olaf
ps. You added my personal github account with my private email to this repo. Maybe we can switch to<EMAIL_ADDRESS>or do I need to create a 2nd github account for that? :)

@olsarnow; Great, thanks! Do ask if you have questions. I use Domeneshop for registry services, and CloudFront for NS, for my personal domains.
We should be moving this repo to a new usegalaxy-no organization soon, so we can add you there when you sort of your GitHub account(s). :-)

Do you mean Cloudfront or Cloudflare? Cloudflare is correct, isn't it?

Sorry, meant Cloudflare, yes.

Yes, cloudflare works great. Good idea! I'll discuss it with Kjell.

Hi Torfinn,
who of us will drive the cloudflare topic?
Shall I do it?
BR,
Olaf

@olsarnow Yes, I think it makes sense for you to manage it?

@olsarnow Yes, I think it makes sense for you to manage it?

Ok I'll do. I take on this task.

Hi Torfinn,
this is my correct github account. The other one is just for private things. It would be great, if you can change it here :-) Thanks a lot!
Olaf

Status update:

I've created a cloudflare account for usegalaxy.no
i will check the dns zone files again
switch to cloudflare DNS on 23.4.2020


readlink: error while loading shared libraries

Describe the bug
The game does not start, only the steam.
Expected behavior
I was expecting the game to start even that there is sometimes a bug (not always) with the processor architecture, because I have the correct (x64).
Command
truckersmp-cli -euspn benoshito -vv

Terminal output
Collapsed log
** DEBUG **  No moddir set, setting to default
** INFO **  Mod directory: /home/bronislaw/.local/share/truckersmp-cli/TruckersMP
** WARNING **  '--ets2' ('-e') option is deprecated, use new syntax instead
** WARNING **  '--update' ('-u') option is deprecated, use new syntax instead
** WARNING **  '--start' ('-s') option is deprecated, use new syntax instead
** INFO **  AppID/GameID: 227300 (ets2)
** INFO **  Game directory: /home/bronislaw/.local/share/truckersmp-cli/Euro Truck Simulator 2/data
** INFO **  Prefix: /home/bronislaw/.local/share/truckersmp-cli/Euro Truck Simulator 2/prefix
** INFO **  Proton directory: /home/bronislaw/.local/share/truckersmp-cli/Proton
** INFO **  Steam Runtime directory: /home/bronislaw/.local/share/truckersmp-cli/SteamRuntime
** DEBUG **  Updating game files
** INFO **  SteamCMD: /home/bronislaw/.local/share/truckersmp-cli/steamcmd/steamcmd.sh
** DEBUG **  Updating Steam Runtime (AppID:1391110)
** INFO **  Running SteamCMD:
  /home/bronislaw/.local/share/truckersmp-cli/steamcmd/steamcmd.sh
    +login benoshito
    +force_install_dir /home/bronislaw/.local/share/truckersmp-cli/SteamRuntime
    +app_update 1391110 validate
    +quit
Redirecting stderr to '/home/bronislaw/.local/share/Steam/logs/stderr.txt'
Looks like steam didn't shutdown cleanly, scheduling immediate update check
[  0%] Wyszukiwanie dostępnych aktualizacji...
[----] Weryfikowanie instalacji...
Steam Console Client (c) Valve Corporation
-- type 'quit' to exit --
Loading Steam API...OK.
Logging in user 'benoshito' to Steam Public ...
Logged in OK
Waiting for user info...OK
 Update state (0x3) reconfiguring, progress: 0.00 (0 / 0)
 Update state (0x5) verifying install, progress: 36.86 (83915791 / 227657853)
Success! App '1391110' fully installed.
** DEBUG **  Updating Proton (AppID:1580130)
** INFO **  Running SteamCMD:
  /home/bronislaw/.local/share/truckersmp-cli/steamcmd/steamcmd.sh
    +login benoshito
    +force_install_dir /home/bronislaw/.local/share/truckersmp-cli/Proton
    +app_update 1580130 validate
    +quit
Redirecting stderr to '/home/bronislaw/.local/share/Steam/logs/stderr.txt'
[  0%] Wyszukiwanie dostępnych aktualizacji...
[----] Weryfikowanie instalacji...
Steam Console Client (c) Valve Corporation
-- type 'quit' to exit --
Loading Steam API...OK.
Logging in user 'benoshito' to Steam Public ...
Logged in OK
Waiting for user info...OK
 Update state (0x3) reconfiguring, progress: 0.00 (0 / 0)
 Update state (0x5) verifying install, progress: 14.77 (154735739 /<PHONE_NUMBER>)
 Update state (0x5) verifying install, progress: 59.64 (624958035 /<PHONE_NUMBER>)
Success! App '1580130' fully installed.
** INFO **  Game branch: public
** DEBUG **  Updating Game (AppID:227300)
** INFO **  Running SteamCMD:
  /home/bronislaw/.local/share/truckersmp-cli/steamcmd/steamcmd.sh
    +@sSteamCmdForcePlatformType windows
    +login benoshito
    +force_install_dir /home/bronislaw/.local/share/truckersmp-cli/Euro Truck Simulator 2/data
    +app_update 227300 -beta public validate
    +quit
Redirecting stderr to '/home/bronislaw/.local/share/Steam/logs/stderr.txt'
[  0%] Wyszukiwanie dostępnych aktualizacji...
[----] Weryfikowanie instalacji...
Steam Console Client (c) Valve Corporation
-- type 'quit' to exit --
Loading Steam API...OK.
"@sSteamCmdForcePlatformType" = "windows"
Logging in user 'benoshito' to Steam Public ...
Logged in OK
Waiting for user info...OK
 Update state (0x5) verifying install, progress: 0.04 (2644929 /<PHONE_NUMBER>)
 Update state (0x5) verifying install, progress: 6.13 (388931867 /<PHONE_NUMBER>)
 Update state (0x5) verifying install, progress: 13.60 (863207306 /<PHONE_NUMBER>)
 Update state (0x5) verifying install, progress: 20.92<PHONE_NUMBER> /<PHONE_NUMBER>)
 Update state (0x5) verifying install, progress: 28.25<PHONE_NUMBER> /<PHONE_NUMBER>)
 Update state (0x5) verifying install, progress: 35.75<PHONE_NUMBER> /<PHONE_NUMBER>)
 Update state (0x5) verifying install, progress: 43.69<PHONE_NUMBER> /<PHONE_NUMBER>)
 Update state (0x5) verifying install, progress: 51.68<PHONE_NUMBER> /<PHONE_NUMBER>)
 Update state (0x5) verifying install, progress: 59.58<PHONE_NUMBER> /<PHONE_NUMBER>)
 Update state (0x5) verifying install, progress: 67.38<PHONE_NUMBER> /<PHONE_NUMBER>)
 Update state (0x5) verifying install, progress: 75.12<PHONE_NUMBER> /<PHONE_NUMBER>)
 Update state (0x5) verifying install, progress: 82.54<PHONE_NUMBER> /<PHONE_NUMBER>)
 Update state (0x5) verifying install, progress: 90.21<PHONE_NUMBER> /<PHONE_NUMBER>)
 Update state (0x5) verifying install, progress: 97.67<PHONE_NUMBER> /<PHONE_NUMBER>)
Success! App '227300' fully installed.
** DEBUG **  Updating mod files
** DEBUG **  Creating directory /home/bronislaw/.local/share/truckersmp-cli/TruckersMP if it doesn't exist
** DEBUG **  No files to download
** DEBUG **  Starting game with Proton
** DEBUG **  Starting Steam...

** DEBUG **  Steam should now be up and running and the user logged in.
** INFO **  Steam installation directory: /home/bronislaw/.local/share/Steam
** DEBUG **  Creating directory /home/bronislaw/.local/share/truckersmp-cli/Euro Truck Simulator 2/prefix if it doesn't exist
** INFO **  Proton version is (major=6, minor=3)
** INFO **  Using Steam Runtime container
** DEBUG **  Shared paths: ['/home/bronislaw/.local/share/truckersmp-cli/Euro Truck Simulator 2/data', '/home/bronislaw/.local/share/truckersmp-cli/Proton', '/home/bronislaw/.local/share/truckersmp-cli/Euro Truck Simulator 2/prefix', '/home/bronislaw/.local/share/truckersmp-cli/TruckersMP', '/home/bronislaw/.local/share/truckersmp-cli', '/home/bronislaw/.local/lib/python3.8/site-packages/truckersmp_cli', '/run/user/1000/discord-ipc-0']
** INFO **  Running Steam Runtime helper:
  SteamAppId=227300
  SteamGameId=227300
  LD_PRELOAD=/home/bronislaw/.local/share/Steam/ubuntu12_64/gameoverlayrenderer.so
  PROTON_NO_D3D11=1
  PROTON_USE_WINED3D=0
  STEAM_COMPAT_CLIENT_INSTALL_PATH=/home/bronislaw/.local/share/Steam
  STEAM_COMPAT_DATA_PATH=/home/bronislaw/.local/share/truckersmp-cli/Euro Truck Simulator 2/prefix
  python3
    /home/bronislaw/.local/share/truckersmp-cli/Proton/proton
    run
    /home/bronislaw/.local/lib/python3.8/site-packages/truckersmp_cli/truckersmp-cli.exe
    /home/bronislaw/.local/share/truckersmp-cli/Euro Truck Simulator 2/data
    /home/bronislaw/.local/share/truckersmp-cli/TruckersMP
    -nointro
    -64bit
readlink: error while loading shared libraries: /lib/x86_64-linux-gnu/libc.so.6: file too short
readlink: error while loading shared libraries: /lib/x86_64-linux-gnu/libc.so.6: file too short
pressure-vessel-wrap[35973]: E: None of the supported CPU architectures are common to the host system and the container (tried: x86_64-linux-gnu, i386-linux-gnu)

Screenshots
Collapsed screenshots
What happens when a command runs (only steam starts) : #

Information

OS: Ubuntu 20.04.2 LTS.
Proton or Wine version: Proton 6.3, Wine 5.0
truckersmp-cli version: 0.6.2

Additional context

As a workaround you could try --without-steam-runtime.

Thank you very much for help! Finally I can play my favorite game with multiplayer on my favorite system! Again thank you very much!

Thank you very much for help! Finally I can play my favorite game with multiplayer on my favorite system! Again thank you very much!


django 3.0 support

pip install django-recaptcha cause version rollback
Collecting django<3.0,>1.11

This has already been fixed here:
https://github.com/praekelt/django-recaptcha/pull/200
But we are currently awaiting the fix to be merged.


Enable uploading to S3, add pages for index and upload for country platforms

This PR introduces ActiveStorage + AWS gem for uploading files to S3

AWS gem is needed as ActiveStorage doesn't support uploading to specific folders in S3 bucket
Add a dropdown menu for each platform divided into sections
Add uploading files for specific datasets
Add support for downloading single files
Add support for zipping and downloading multiple files
Integrate importers -> create workers for importers, add sidekiq
For test purposes right now, everything uploads to /test folders, however importers are operating on already uploaded files to correct folder in S3.

To test this locally, make sure that you have aws credentials in your .env file.
Seed the db with new AdminUser (there's already an example in db/seeds.rb)
Then, go to /admin and log in to see the admin panel.
This PR does not include content management (texts, translations).
Note that:
Each section (apart from Ndc Texts) is exactly the same:

It has a table with its datasets to which we can upload associated datafile (one dataset - one datafile). The Upload button creates an association with ActiveStorage (for recognizing which datafiles are linked to which datasets) and uploads datafile to respective folder in S3.
If datafile is uploaded, we can download that file (it's pulled from S3 and we again rely on the association with ActiveStorage to know which datafile it is)
We can download all the files linked to the section (i.e. all the datafiles for Historical Emissions) -> zipped
We can run the importers linked to the section (button Run Importers) - it triggers a worker, we can check the status of it in Sidekiq ----> TO IMPROVE

With all of the specifities of ActiveAdmin I couldn't think of an idea to make the pages generic (they all share the same functionalities but they redirect to different pages upon success etc (paths). If you've got an idea how to avoid repeating functionalities code, let me know. ActiveAdmin has its own DSL and even moving part of code out of page_action is not that straightforward. I tried concerns but failed to make them work. So, give me your thoughts ☺

Remember to run:
rails db:admin_boilerplate_create
To test it all, otherwise sections will be missing.

Changes addressed, ready again!
Although I didn't add a validation for not being able to edit your own account; I think admin might want to change his password for example.


Port forward on Fitzbox for both UDP and TCP

Hi,
my docker instance for the satisfactory server is planned to run on my NAS at home behind a fritz box.
As I just have realized, the ports are changed to be the same port (default 7777) for UDP as for TCP.
This is bad.. as far as I understand, I cannot forward the same port on my FritzBox 7590 for both types...
I know that that should usually work, as TCP and UDP are separate things, but the GUI won't let me.
My compose is below as a reference.
The SERVERGAMEPORT changes the port for both is that correct?
Any suggestions or help would be welcome!
version: '3'
services:
    satisfactory-server:
        container_name: 'satisfactory-exp-server'
        hostname: 'NilzWorld'
        image: 'wolveix/satisfactory-server:latest'
        ports:
            - '6254:7777/udp'
            - '6255:7777/tcp'
        volumes:
            - '/homes/steam_games/satisfactory_exp:/config'
        environment:
            - MAXPLAYERS=4
            - PGID=1002
            - PUID=1002
        restart: unless-stopped

Hey @nkucza!
Yeah, I saw a few people mentioning this issue in the Satisfactory Discord server. Yes, both ports are changed together, this is a limitation of the game server, not the container :(
According to someone with the same problem:

You sure you chose different protocols?  But I could just first pick one and then the other (UDP TCP) and both got mapped to same external port oO
Did you choose the same local port as well?

Of course that's possible, I'm doing it right now.

I'm using the 7530, so it will work with your's as well

Of course that's possible, I'm doing it right now.
I'm using the 7530, so it will work with your's as well

sadly that is not working for me..
if I try that, one of them is getting assigned another port instead.
Maybe thats also dependent from the provider..?

Sure? Do this

and then again only with UDP as protocol. Like i said, I've done this multiple times, I've even tried it with multiple ports

Maybe update the Firmware on the FritzBox, I talked to a frind of mine who has done the same and it's also working for him

@opiswahn yes, that is exactly what i do and tried with multiple ports.
Sadly I just have a range of ports I can use and 7777 is not among them.
But at least that shouldn´t be a problem..

As you can see, the TCP I created here second is changed to another port...

this is obvious some ISP branding - what's your ISP? contact customer service and request arbitrary port forwarding - if they deny end your contract with them and switch to another isp
never seen this alteration - and I was customer support for avm for about 18 months


geocoder?.geocode returns undefined

const geocoder = useGeocodingService();

const handleOnClick = async () => {
  const x = await geocoder?.geocode({
    location: { lat: 59.27240992362248, lng: 15.213029186736854 },
  });
  console.log(x?.results); //undefined
};

In what context did you used this code? Did you have se tup the provider correct and did you read teh documentaion about the hooks?
Here you can find the example for the geocoding service. https://github.com/ubilabs/google-maps-react-hooks/tree/develop/examples/geocoding-service

Hi, I'm also facing this issue right now. The provider is set up correctly on my end. But this issue seems to be happening when it is ran on useEffect for the first load.

In what context did you used this code? Did you have set up the provider (referring to #143) correct and did you read teh documentaion about the hooks?
Here you can find the example for the geocoding service. https://github.com/ubilabs/google-maps-react-hooks/tree/develop/examples/geocoding-service

The sample code above did not seem to define the parameters for geocode() method which could have caused the "undefined".


jobrentin1

2485606517-visa-176988798.pdf
[Enter feedback here]

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 5400b01e-9831-79bc-6b0b-df2ad5f3d39e
Version Independent ID: ad6cc61e-58e6-a1af-eefa-9ed9b6496db5
Content: Continuous access evaluation for workload identities in Azure AD - Microsoft Entra
Content Source: articles/active-directory/conditional-access/concept-continuous-access-evaluation-workload.md
Service: active-directory
Sub-service: conditional-access
GitHub Login: @MicrosoftGuyJFlo
Microsoft Alias: joflore

@jobrentin1
Could you please elaborate the query for better understanding. So, we can assist you further.

#reassign:@MicrosoftGuyJFlo


[Popover] Text gets slightly adjusted after open animation

[x] The issue is present in the latest release.
[x] I have searched the issues of this repository and believe that this is not a duplicate.

Current Behavior 😯

I'm not sure how this happens, but sometimes the content for the Popover component gets slightly shifted to the left right after it's opened. The issue can be seen better at the documentation for the Menu component here. Here's a gif of what happens:

Expected Behavior 🤔

The Popover component shouldn't move it's content around after the open animation.
Steps to Reproduce 🕹

Interestingly enough, when we try the demo above in codesandbox, the issue dosen't appear. After some digging, i found that there may be an issue on how the positioning is set by Popover. To reproduce the problem, the codesandbox below is an exact copy of the demo above, but with an added left margin of 175.5px. With this suspicious margin we are able to reproduce the problem.

Apparently, the issue seems to be caused by a resulting fractioned value of left positioning (image below).

If we force a whole number on the left css property through the Chrome Devtools (image below), then the issue seems to be resolved.

Your Environment 🌎

Tech
Version

Material-UI
v4.8.0

React
v16.12.0

Browser
Chrome v79.0.3945.79

@KevinAsher Thanks for the detailed report. I could reproduce. What do you think about this diff? Do you want to submit a pull request? :)
diff --git a/packages/material-ui/src/Popover/Popover.js b/packages/material-ui/src/Popover/Popover.js
index 9f23c25e2a..ce7a3773e6 100644
--- a/packages/material-ui/src/Popover/Popover.js
+++ b/packages/material-ui/src/Popover/Popover.js
@@ -293,7 +293,7 @@ const Popover = React.forwardRef(function Popover(props, ref) {

       return {
         top: `${top}px`,
-        left: `${left}px`,
+        left: `${Math.round(left)}px`,
         transformOrigin: getTransformOriginValue(elemTransformOrigin),
       };
     },

@oliviertassinari Yup, I think that will do. I'll submit PR.


Tested without bugs, suggestions only

Description

UI is clean, great.
Since I tested late, the fund is already full. I am not able to test the conversion.
0xee5A9ce66b400Adf3D2212A5EBAe1641A482c75F

Screenshot

Suggestion

Add more Web3 contents which might be popular in users, if it is possible

Twitter: @Neoeco3
DC: peter45465#7974
i would like to make some youtube content or write some articles for our project as an influencer, influence in English, Chinese (Mandarin and Cantonese). data analysis background, skill in python, solidity(in learning process). i would like to help if it is needed.


New version: Soulseek.SoulseekQt version 2024.2.1

Pull request has been created with komac v2.1.0 :rocket:

Resolves #140069

Microsoft Reviewers: Open in CodeFlow

Hi @Exorcism0666,
Could you add a PackageUrl?
(Automated response - build 792.)

@wingetbot waivers Add Validation-Domain


(#140) Add books category

PR for #140
Removed Reed button from the book listing.
A User can change the book category.

@rathorevaibhav this is ready for review.


Add more platforms to CI

aarch64-unknown-linux-musl
sparc64-unknown-linux-gnu
x86_64-unknown-linux-gnux32

These don't pass yet, but should be supportable by nix, so let's add them now as platforms that are allowed to fail so we can move towards fully supporting them.

Not certain why these weren't working by just adding them. Tried hacking them in, but need to come back and relearn our CI setup to actually get these fixed.

Don't forget to add new platforms to the README, if we're going to support them.

Coming back to this now, so rebased and updated the CHANGELOG and README, but will likely wait until #1035 is merged to really dig into why these platforms are failing.

Close this PR for the same reason as #2255


Fix hang due to missing condition vaiable wake

Hi,
The condition variable 'space' in EncoderQueue.h is never woken up.
Because of this the wait on EncoderQueue.h:318 blocks forever. This probably only happens on platforms that use the pthread implementation of ConditionVariable, because the other implementations seem to have a timeout.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.


Error "No such file or directory @ realpath_rec" on send capybara-screenshot to ReportPortal

Ruby-agent isn't correctly work with capybara-screenshot, when screenshot sent to Report Portal error log you can see below. Issue can be reproduced with Docker container from repository   https://github.com/esoskovets/reportportal_ruby_capybara_cucumber_env

Fixnum    HTML screenshot: /opt/app/features/reports/screenshot_2017-01-03-12-02-25.551.html
Image screenshot: /opt/app/features/reports/screenshot_2017-01-03-12-02-25.551.png
No such file or directory @ realpath_rec - /opt/app/iVBORw0KGgoAAAANSUhEUgAAB3IAAAQ4CAYAAAD8ap3nAAAACXBIWXMAAA9h
AAAPYQGoP6dpAAAgAElEQVR4nOzdeXxU1f3 (Errno::ENOENT)

fix was merged https://github.com/reportportal/agent-ruby/pull/9
@esoskovets can you pull latest version and confirm that issue fixed?

Hello, issue is fixed but warning message appeared:

/usr/local/bundle/gems/rest-client-2.0.1/lib/restclient/request.rb:377:in `block in make_headers' : warning: Overriding "Content-Type" header "multipart/form-data" with "multipart/form-data; boundary=----RubyFormBoundarysbHKPADhUv4TrCbd" due to payload (StructuredWarnings::StandardWarning)


[wip] add python script to check links

Created a script to evaluate the intra-site links on localized pages and report results.
General ideas:

Check for localized versions of link.
If no localized page, check and validate en link.
Thinking about updating the links in the file if a localized link exists.
Need to extend check to test links containing page anchors.
Initial testing on the docs concepts directory.

@tengqm,
Just started on this. Would it be helpful to evaluate (and possibly update) the page intra-site links?

Thanks for the feedback @sftim.
I will make the file executable.
Definitely need to improve the reporting/diagnostics.
More things to consider.

will review this in a day or two.

I plan to continue to work on this depending if this direction is correct.

Ya. +2
I'd like to contribute to this as well.

/cc

I'm placing a hold on this as it is a preliminary sketch.
@tengqm , let me know if you need help. Thanks.
/hold

For functionalities other than main if we can do some kind of unit test it will be helpful eg, expecting input and output for the test

@kbhawkey I was thinking if I can carry on this by pushing into your fork, :)

@kbhawkey I was thinking if I can carry on this by pushing into your fork, :)

Hi @tengqm . Whatever you think. I am happy to hand this over to you, or feel free to continue working with this branch.

@kbhawkey I'll be working on this in the coming days and get back to team soon.

@kbhawkey I'll be working on this in the coming days and get back to team soon.

👍

See pull request #22541 .
/close


clusterloader2: completely switch to secure port

What type of PR is this?
/kind cleanup
/kind deprecation
What this PR does / why we need it:
Now both controller-manager and scheduler are migrating off the insecure port, and the progress is being blocked by the job pull-kubernetes-e2e-gce-100-performance, because clusterloader2 in this job would fetch metrics from the insecure port of scheduler.
This PR picks up @ingvagabund 's great work #1562, and make clusterloader2 no longer depend on the insecure port of controller-manager and scheduler.
Which issue(s) this PR fixes:
Fixes #
Special notes for your reviewer:
Does this PR introduce a user-facing change?:

clusterloader2: grab metrics from the secure port of kube-controller-manager and kube-scheduler

Additional documentation e.g., KEPs (Kubernetes Enhancement Proposals), usage docs, etc.:

/assign @tosi3k @marseel
@tosi3k @marseel - Can you please verify that we have all metrics we want (i.e. this works as expected)?

/assign @tosi3k @marseel
@tosi3k @marseel - Can you please verify that we have all metrics we want (i.e. this works as expected)?

@knight42 you can drop WIP:  bit from the first commit message
Is this really sufficient? :)

@knight42 you can drop WIP:  bit from the first commit message
Is this really sufficient? :)

https://storage.googleapis.com/kubernetes-jenkins/pr-logs/pull/perf-tests/1647/pull-perf-tests-clusterloader2/1347043219300421632/artifacts/SchedulingMetrics_load_2021-01-07T05:16:52Z.json looks good
From https://storage.googleapis.com/kubernetes-jenkins/pr-logs/pull/perf-tests/1647/pull-perf-tests-clusterloader2/1347043219300421632/build-log.txt:
W0107 05:00:24.464] I0107 05:00:24.464530   15135 framework.go:239] Applying /go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/master-endpoints.yaml
W0107 05:00:24.501] I0107 05:00:24.501108   15135 framework.go:239] Applying /go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/master-service.yaml
W0107 05:00:24.540] I0107 05:00:24.539715   15135 framework.go:239] Applying /go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/master-serviceMonitor.yaml
W0107 05:00:24.577] I0107 05:00:24.577648   15135 prometheus.go:320] Waiting for Prometheus stack to become healthy...
W0107 05:00:54.614] W0107 05:00:54.613997   15135 util.go:64] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: "k8s\x00\n\f\n\x02v1\x12\x06Status\x12]\n\x06\n\x00\x12\x00\x1a\x00\x12\aFailure\x1a3no endpoints available for service \"prometheus-k8s\"\"\x12ServiceUnavailable0\xf7\x03\x1a\x00\"\x00"
W0107 05:01:24.720] I0107 05:01:24.719797   15135 util.go:93] 97/116 targets are ready, example not ready target: {map[endpoint:http-metrics instance:<IP_ADDRESS>:10249 job:kube-proxy namespace:kube-system pod:kube-proxy-e2e-1647-62db2-minion-group-9l8j service:kube-proxy] unknown}
W0107 05:01:54.683] I0107 05:01:54.683511   15135 util.go:96] All 116 expected targets are ready
W0107 05:01:54.764] I0107 05:01:54.764602   15135 util.go:96] All 1 expected targets are ready
W0107 05:01:54.765] I0107 05:01:54.764660   15135 prometheus.go:199] Prometheus stack set up successfully

Interesting :) How did you manage to get the authentication/authorization working?

https://storage.googleapis.com/kubernetes-jenkins/pr-logs/pull/perf-tests/1647/pull-perf-tests-clusterloader2/1347043219300421632/artifacts/SchedulingMetrics_load_2021-01-07T05:16:52Z.json looks good
From https://storage.googleapis.com/kubernetes-jenkins/pr-logs/pull/perf-tests/1647/pull-perf-tests-clusterloader2/1347043219300421632/build-log.txt:
W0107 05:00:24.464] I0107 05:00:24.464530   15135 framework.go:239] Applying /go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/master-endpoints.yaml
W0107 05:00:24.501] I0107 05:00:24.501108   15135 framework.go:239] Applying /go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/master-service.yaml
W0107 05:00:24.540] I0107 05:00:24.539715   15135 framework.go:239] Applying /go/src/k8s.io/perf-tests/clusterloader2/pkg/prometheus/manifests/master-ip/master-serviceMonitor.yaml
W0107 05:00:24.577] I0107 05:00:24.577648   15135 prometheus.go:320] Waiting for Prometheus stack to become healthy...
W0107 05:00:54.614] W0107 05:00:54.613997   15135 util.go:64] error while calling prometheus api: the server is currently unable to handle the request (get services http:prometheus-k8s:9090), response: "k8s\x00\n\f\n\x02v1\x12\x06Status\x12]\n\x06\n\x00\x12\x00\x1a\x00\x12\aFailure\x1a3no endpoints available for service \"prometheus-k8s\"\"\x12ServiceUnavailable0\xf7\x03\x1a\x00\"\x00"
W0107 05:01:24.720] I0107 05:01:24.719797   15135 util.go:93] 97/116 targets are ready, example not ready target: {map[endpoint:http-metrics instance:<IP_ADDRESS>:10249 job:kube-proxy namespace:kube-system pod:kube-proxy-e2e-1647-62db2-minion-group-9l8j service:kube-proxy] unknown}
W0107 05:01:54.683] I0107 05:01:54.683511   15135 util.go:96] All 116 expected targets are ready
W0107 05:01:54.764] I0107 05:01:54.764602   15135 util.go:96] All 1 expected targets are ready
W0107 05:01:54.765] I0107 05:01:54.764660   15135 prometheus.go:199] Prometheus stack set up successfully

Interesting :) How did you manage to get the authentication/authorization working?

How did you manage to get the authentication/authorization working?

@ingvagabund because the flags --authentication-kubeconfig and --authorization-kubeconfig are set now: https://github.com/kubernetes/kubernetes/pull/96550

How did you manage to get the authentication/authorization working?

@ingvagabund because the flags --authentication-kubeconfig and --authorization-kubeconfig are set now: https://github.com/kubernetes/kubernetes/pull/96550

Awesome!!! I did not check that PR yet. Well done :)

Awesome!!! I did not check that PR yet. Well done :)

@tosi3k @marseel - Can you please verify that we have all metrics we want (i.e. this works as expected)?

Sorry, I was OOO yesterday. I'll take a look at this later today.

@tosi3k @marseel - Can you please verify that we have all metrics we want (i.e. this works as expected)?

Sorry, I was OOO yesterday. I'll take a look at this later today.

/lgtm

/lgtm

Nice - thanks!
/approve

Nice - thanks!
/approve


Avoid requesting a password change on first vagrant login

That prevented Vagrant from configuring the box.

parallels.log
Relevant log lines:
==> parallels-iso.image: + USERNAME=vagrant
==> parallels-iso.image: + HOME_DIR=/home/vagrant
==> parallels-iso.image: + pubkey_url=https://raw.githubusercontent.com/hashicorp/vagrant/main/keys/vagrant.pub
==> parallels-iso.image: + mkdir -p /home/vagrant/.ssh
==> parallels-iso.image: + command -v wget
==> parallels-iso.image: + wget --no-check-certificate https://raw.githubusercontent.com/hashicorp/vagrant/main/keys/vagrant.pub -O /home/vagrant/.ssh/authorized_keys
==> parallels-iso.image: --2024-10-22 09:17:41--  https://raw.githubusercontent.com/hashicorp/vagrant/main/keys/vagrant.pub
==> parallels-iso.image: Resolving raw.githubusercontent.com (raw.githubusercontent.com)... <IP_ADDRESS>, <IP_ADDRESS>, <IP_ADDRESS>, ...
==> parallels-iso.image: Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|<IP_ADDRESS>|:443... connected.
==> parallels-iso.image: HTTP request sent, awaiting response... 200 OK
==> parallels-iso.image: Length: 518 [text/plain]
==> parallels-iso.image: Saving to: '/home/vagrant/.ssh/authorized_keys'
==> parallels-iso.image:
==> parallels-iso.image:      0K                                                       100% 30.0M=0s
==> parallels-iso.image:
==> parallels-iso.image: 2024-10-22 09:17:46 (30.0 MB/s) - '/home/vagrant/.ssh/authorized_keys' saved [518/518]
==> parallels-iso.image:
==> parallels-iso.image: + chown -R vagrant:vagrant /home/vagrant/.ssh
==> parallels-iso.image: + chmod -R go-rwsx /home/vagrant/.ssh
==> parallels-iso.image: Provisioning with shell script: ./../scripts/kali-linux/base/remove_password.sh
==> parallels-iso.image: + passwd --delete vagrant
    parallels-iso.image: passwd: password changed.


Ecosystem support for tooling that is outside of the language or os specific package management system

It would be incredibly useful to have some standard way of referring to generic tooling that is part of a language or OS ecosystem, but not actually installed via that ecosystem's package registry.
An example might be cargo, which is a part of the rust ecosystem and has advisories issued from the Rust Advisory Database but is apart from the existing crates.io OSV ecosystem (some previous discussion on this)
Or a very recent example would be some way to refer to generic nodejs that hasn't been installed via a system package manager and would be separate from the existing npm OSV ecosystem, but still quite important to have some standard way of representing security advisories for.  That would also hopefully open the door to flagging these tools within the existing GitHub Advisory Database for the languages they currently support

My original though was to potentially add a new ecosystem value for these, so could be something like:

Rust
Nodejs
Python

Where the name would then be the name of the tool within that ecosystem, but that doesn't work particularly well for go since the existing package-centric OSV namespace is already called Go, and having both a language name and registry name ecosystem might be confusing for people anyways

I'm not entirely sure ecosystem makes sense here, this could be a new way to categorize software.
Let's use Node.js and OpenSSL as an example.
The Node.js binary, node, has OpenSSL statically linked in. If I install node, it's not part of an ecosystem or package manager. So now we have a binary file, that statically links in OpenSSL, that's not installed via any traceable system.
I think the value in the ecosystem tags is knowing where to go look for more details.
In the case of this OpenSSL, you can maybe go see if Node.js published anything. But for other things we have to try to track every possible binary vendor for details about whatever binaries they are building and distributing which is not realistic.
I think we need a tag that denotes this is a known problem, like tagging an OpenSSL vulnerability with node affects details, but also makes it clear this is not something we can easily programmatically determine. We maybe need humans to get involved to add and update the data.

As a note I would expect this to start out very narrowly scoped to cover existing well-known tools that are important parts of language ecosystems and are not frequently installed via package managers

Hmm, this is certainly missing in the OSV schema, but I'm also a little wary of building something similar to CPEs, where we define our own custom registry of identifiers (as opposed to our ecosystem ones which just defer to that ecosystem).
Are there any other alternatives where we can be unambiguous are less bespoke? One possibility might be to use the source/repo path to do this. e.g.

Python: https://github.com/python/cpython/blob/main/Programs/python.c
Node: https://github.com/nodejs/node/blob/main/src/node_main.cc
Rust: https://github.com/rust-lang/rust/blob/master/compiler/rustc/src/main.rs

There are probably other alternatives, but something like this would be much more deterministic and predictable as opposed to a custom dictionary.

@oliverchang, yes I definitely agree on not maintaining our own registry of identifiers if we can possibly avoid it.  I think the idea of using the source repo path could potentially work.  What might the actual OSV entry look like in that case?

Hmm, what about something specific for GitHub release artifacts?  And maybe something general for source control URLs or just general URLs for published binaries?

@oliverchang, yes I definitely agree on not maintaining our own registry of identifiers if we can possibly avoid it. I think the idea of using the source repo path could potentially work. What might the actual OSV entry look like in that case?

Maybe something like:
{
  "type": "Program",
  "name": "https://github.com/python/cpython:Programs/python.c"
}

If we go with this there will need to be some rules around canonicalising git/repo URL, and a bit other details to figure out that I'm handwaving here.
GitHub release artifacts, general URLs could also work, but it may introduce more inconsistencies because there can be many different correct IDs if it's mirrored in a lot of places. Everything goes back to the source repo, so perhaps that would be more stable as an identifier.

Or a very recent example would be some way to refer to generic nodejs that hasn't been installed via a system package manager

The PURL spec accounts for this via the generic type. Syft, for eg - already uses pkg:generic/node when it detects nodejs installed outside the system package manager.
Ref: https://github.com/anchore/syft/blob/bb6fc6525c6b791999a21d014b7557075202a2e8/syft/pkg/cataloger/binary/default_classifiers.go#L74-L82
OSV should still support this usecase, and maybe support a generic ecosystem. Or given that we already have a PURL, which should be resolvable to the relevant ecosystem anyway - why do we need a separate ecosystem field?

The problem with generic is that it's essentially a free-for-all that does not enforce any form of consistency. i.e. is pkg:generic/node the canonical Node, or is pkg:generic/Node.js or some other variation?
I think we need something more machine readable and consistent here. One possibility that can be made to be more consistent without us maintaining a custom registry (similar to CPEs) is something like https://github.com/ossf/osv-schema/issues/94#issuecomment-1299595670, but there are likely other approaches.

Thinking more here, everything really goes back to source here, and we can already encode vulns in things like language interpreters through git commits hashes and version tags. This gives us the most consistent way to describe vulns in open source software that don't have a canonical package ecosystem.
e.g. from https://github.com/google/oss-fuzz-vulns/blob/main/vulns/mruby/OSV-2020-744.yaml
id: OSV-2020-744
summary: Heap-double-free in mrb_default_allocf
details: ...
modified: '2022-04-13T03:04:39.780694Z'
published: '2020-07-04T00:00:01.948828Z'
references:
- type: REPORT
  url: https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=23801
affected:
  ranges:
  - type: GIT
    repo: https://github.com/mruby/mruby
    events:
    - introduced: 9cdf439db52b66447b4e37c61179d54fad6c8f33
    - fixed: 97319697c8f9f6ff27b32589947e1918e3015503
  versions:
  - 2.1.2
  - 2.1.2-rc
  - 2.1.2-rc2
  ecosystem_specific:
    severity: HIGH

The entrypoint is missing here from my original proposal at https://github.com/ossf/osv-schema/issues/94#issuecomment-1301608831, but that was also flawed in that entrypoints can easily move across versions as part of refactoring.

The curl project is experimenting with publishing its security vulnerabilities in OSV (in curl/curl-www#237) and has hit this OSV limitation. Technically, OSV can't be used for this because ecosystem is mandatory and there's no appropriate value for upstream packages. Most PURL types can specify a unversioned package (e.g. pkg:deb/debian/curl) but the generic type cannot; it is tied to a download URL that must point to a specific version of a package.
Fixing PURL to allow an unambiguous, unversioned generic package type would be one way to fix this. e.g. pkg:generic/curl?package_url=https://curl.se/download/#curl

The curl project is experimenting with publishing its security vulnerabilities in OSV (in curl/curl-www#237) and has hit this OSV limitation. Technically, OSV can't be used for this because ecosystem is mandatory and there's no appropriate value for upstream packages. Most PURL types can specify a unversioned package (e.g. pkg:deb/debian/curl) but the generic type cannot; it is tied to a download URL that must point to a specific version of a package.
Fixing PURL to allow an unambiguous, unversioned generic package type would be one way to fix this. e.g. pkg:generic/curl?package_url=https://curl.se/download/#curl

That's awesome to hear! And sorry we don't have a clear story for this yet.
Would the approach of just including the source repository information (e.g. the example in https://github.com/ossf/osv-schema/issues/94#issuecomment-1486192372) without an ecosystem/package work for curl?

Here are some existing curl examples in OSV (based off OSS-Fuzz automation): https://github.com/google/oss-fuzz-vulns/blob/main/vulns/curl/OSV-2022-450.yaml

Using a Github URL would work to disambiguate this curl from any others, but there's a technicality: the curl releases are almost-but-not-quite what's tagged in git, so doing so would leave the wrong impression. The git sources are the basis of a release, but then things like autoreconf are run to get automake files, man pages are prebuilt, etc. and that final result ends up as the curl release tarball. That's also why we can't really use a Github PURL like pkg:github/curl/curl@curl-8_0_1 to talk about a curl release since a release is more than just those tagged files. An autoconf security bug that necessitates a new curl point release could (theoretically) use exactly the same tagged git files yet not contain the security bug.
The OSS-Fuzz example is a bit unfair because OSS-Fuzz gets its own ecosystem and can do whatever it wants with it, in this case defining "curl" conveniently as our project. The OSV docs also say that the OSS-Fuzz ecosystem is only to be used for bugs related to OSS-Fuzz findings, so we can't use it. It's interesting that they're actually using the almost-useless too-generic PURL pkg:generic/curl as curl also has ended up doing due to nothing better being available.

Using a Github URL would work to disambiguate this curl from any others, but there's a technicality: the curl releases are almost-but-not-quite what's tagged in git, so doing so would leave the wrong impression. The git sources are the basis of a release, but then things like autoreconf are run to get automake files, man pages are prebuilt, etc. and that final result ends up as the curl release tarball. That's also why we can't really use a Github PURL like pkg:github/curl/curl@curl-8_0_1 to talk about a curl release since a release is more than just those tagged files. An autoconf security bug that necessitates a new curl point release could (theoretically) use exactly the same tagged git files yet not contain the security bug.

Ah, that's a very interesting point that I don't have a good answer for.
If it's available though, I believe the git metadata would still be useful in most cases though to consumers though, for people who are pulling curl by source (e.g. as a submodule to use as a library) and as a fallback identification mechanism that works in most cases. This enables them to make use of this vulnerability feed in an automated way just by looking at their git hashes.

The OSS-Fuzz example is a bit unfair because OSS-Fuzz gets its own ecosystem and can do whatever it wants with it, in this case defining "curl" conveniently as our project. The OSV docs also say that the OSS-Fuzz ecosystem is only to be used for bugs related to OSS-Fuzz findings, so we can't use it. It's interesting that they're actually using the almost-useless too-generic PURL pkg:generic/curl as curl also has ended up doing due to nothing better being available.

Yeah the PURL really is a best effort at that point as a hint in this case. Even pkg:generic/curl?package_url=https://curl.se/download/#curl seems hard to maintain consistency around with the URL formatting, and across the open source ecosystem with other projects. We've tried to avoid adding a similar "Generic", as such fields are hard to automate on and maintain consistency.
Instead, how about we define a "Curl" ecosystem in the OSV spec? That way we can define the naming and the version rules very precisely and remove any ambiguity.

In the curl project we now provide JSON objects according to this schema for all published CVEs. 141 of them at today's count.
We can however not identify the project in the JSON objects because curl is not part of any valid "ecosystem". I assume this might be problematic for some users of this data.

Noting here that we're running into the same problem for projects like CPython, there is no ecosystem value for OSV that matches PURL's "generic" ecosystem.

Would something like the suggestions in https://github.com/ossf/osv-schema/issues/94#issuecomment-1486192372 or https://github.com/ossf/osv-schema/issues/94#issuecomment-1301608831 work for the CPython use case?
We need a well defined namespace for describing non-package-manager ecosystems and the versions associated with them. The problem with "generic" is it offers little consistency nor automatability for consumers, which is what OSV has tried to fix.

@oliverchang Thanks for the suggestions! I believe https://github.com/ossf/osv-schema/issues/94#issuecomment-1486192372 would work for CPython's use-case if I'm reading it correctly, essentially omitting the affected.package key altogether and use only ranges and versions (I'm also assuming that ranges of type ECOSYSTEM continue to work)
The OSV database structure I'm planning already separates OSV documents (is that the right word for them?) into separate directories depending on the project, so advisories/python/CVE-YYYY-NNNN.json and then the content of the file wouldn't need to have an identifier putting it as Python necessarily.
Will this structure and omission of affected.package play nicely with the OSV database?

While https://github.com/ossf/osv-schema/issues/94#issuecomment-1640134859 mentions that it's not a goal to replicate the CPE format, it would be very useful to include some information included in CPEs. For example, certain vulnerabilities may only affect particular platforms (e.g. Windows), and this information is included in the platform field of CPEs that NVD includes with their data.
This is especially relevant to generic packages, where the package may be used on any platform, but is also relevant to ecosystem-specific packages. As an example, this Python package vulnerability (GHSA-rxff-vr5r-8cj5) only affects Windows versions of the package. There is no standard way to include that information in the OSV JSON, and so far as I'm aware there is no standard mechanism for including such information in the PURL.

While #94 (comment) mentions that it's not a goal to replicate the CPE format, it would be very useful to include some information included in CPEs. For example, certain vulnerabilities may only affect particular platforms (e.g. Windows), and this information is included in the platform field of CPEs that NVD includes with their data.
This is especially relevant to generic packages, where the package may be used on any platform, but is also relevant to ecosystem-specific packages. As an example, this Python package vulnerability (GHSA-rxff-vr5r-8cj5) only affects Windows versions of the package. There is no standard way to include that information in the OSV JSON, and so far as I'm aware there is no standard mechanism for including such information in the PURL.

Thanks for the feedback. Regarding specific OSes, I've created https://github.com/ossf/osv-schema/issues/281


Property initializers output for non-initialized types

Bug Report
This is technically not a bug, given ES Spec, however, I'm filing an issue in case an consideration needs to be made on how to handle with regard to documentation, etc, and/or to provide a solution for people facing the same.
Issue Summary

ESNext spec seems to call for defining all class fields. This also affects those which are optional or specified with a boom.
Spec also dictates that property initializers are called after the super call. (https://github.com/tc39/proposal-class-fields)

This results in any properties specified in the inherited class that are assigned during the base class constructor to be overwritten, even if they do not have initializer values specified in the inherited class.
The behaviour which causes the error can be seen below:
class A {
  a?: string
}

Output is:
// target = ESNext
class A {
  a; // Outputs a statement without initialized value, which is treated as a = undefined;
}

// target = ES2020
class A {
}

Here is a simplified version of how this affected me
abstract class Base<T extends Record<string, any>> {
  // Single constructor for all derivatives
  constructor(o: Omit<T, typeof Base>) {
    Object.assign(this, o);
  }
}

class A extends Base<A> {
  myProp?: string
  myProp2!: string
}

const a = new A({ myProp2: 'hello' });

// ESNext: a = { myProp2: undefined, myProp: undefined }
// ES2020: a = { myProp2: 'hello' }

The above produces:
// TypeScript target=ESNext
class A extends Base {
  myProp;
  myProp2; // Note the boomed property still gets output here, so it is initialized after the super call - which maybe surprising behaviour
}

// ES2020 / Babel
class A extends Base {
}

🔎 Search Terms

property initializers

🕗 Version & Regression Information
TS 4.3.5
Solution
For those facing this issue, simply change property declarations to ambient.
ie:
class A extends Base<A> {
  declare myProp?: string
  declare myProp2: string
}

Relevant: the --useDefineForClassFields compiler flag is what controls this behavior, and this behavior is documented since TypeScript 3.7.   From TypeScript 3.7 until TypeScript 4.2, this compiler flag was disabled by default in all circumstances.
It seems that starting in TypeScript 4.3, this compiler option is now enabled by default if your target is ESNext.  (See #42663 for implementation).  This is likely what you are running into here.  But, according to this comment in #34787, this change is not documented anywhere in the release notes for TypeScript 4.3.
So possibly this bug report is a request that the TypeScript 4.3 release notes should mention this as a breaking change?  (And maybe it belongs on the TypeScript-website issue list instead of here?)

It seems that starting in TypeScript 4.3, this compiler option is now enabled by default if your target is ESNext. (See #42663 for implementation).

Ah! That's the culprit. Thanks.

So possibly this bug report is a request that the TypeScript 4.3 release notes should mention this as a breaking change?

That seems reasonable. I see several people commented that they ran into it as well, and it took some time to track down. It sidelined a good chunk of my day, also, when I bumped TS versions. Was a little tricky to figure out what was happening.
Adding to the documentation is probably a good idea. Looks like the issue was flagged as breaking change also, so it probably was intended to be in the notes

It seems that starting in TypeScript 4.3, this compiler option is now enabled by default if your target is ESNext. (See #42663 for implementation). This is likely what you are running into here. But, according to this comment in #34787, this change is not documented anywhere in the release notes for TypeScript 4.3.

To be fair, "ESNext" is not really a stable target and is breaking by definition. :-)

For what it’s worth: useDefineForClassFields makes sense to enable by default when targeting ESNext, since otherwise behavior for each property may differ depending on whether a property has an initializer or not (esnext implies no transpilation and native class fields use [[Define]] semantics).
The change definitely should be documented, though.


Letters colors with black even changing darkmode status.

Im changing the darkmode to true/false, but the color of the letters still black, becaming unreadable.

It's darkMode not darkmode

I have the same problem. The font is black and does not follow the theme.


Execute multiple Projects (STS, Admin and API)

Hello,
Great respect for the work in your repo so far!
I'm currently testing the repo and I noticed that you can't run the projects STS (IdentityServer), Admin and API at the same time. Apparently STS starts on the same port as the API?
API
"ApiBaseUrl": "http://localhost:5001",
"IdentityServerBaseUrl": "http://localhost:5000",
Admin
"IdentityAdminRedirectUri": "http://localhost:9000/signin-oidc",
"IdentityServerBaseUrl": "http://localhost:5000",
STS
"IdentityAdminBaseUrl": "http://localhost:9000",
I got always the error message
[11:51:48 FTL] Unable to start Kestrel.
System.IO.IOException: Failed to bind to address https://localhost:5001.
I tested the starting order of the projects is as follows:
STS
Admin
API
or
Admin
STS
API
I downloaded your repo yesterday, maybe in the appsettings is the mistake?
Thank you and Best Regards,
nk-cmd

Yes that`s true. The default configuration of each project needs manual tweeking before this works. For example, my configuration looks like
STS.Identity HTTPS 44300, HTTP 44200
Admin HTTPS 44301, HTTP 44201
Admin.Api HTTPS 44302, HTTP 44202

It looks like that there is a colision in ports for Kestrel configuration, I will check it and fix it.
Sorry for that I use IIS Express by default. ;-)
STS starts for HTTPS on 5001 same like API on this port for HTTP.
For now you can fix it manually in launchSettings.json - in STS project, remove https://localhost:5001 and keep only http://localhost:5000.
Or like @ViRuSTriNiTy suggested use your own configuration, but you need change all urls for IS4 clients.
BTW: I need these all ports reconfigure because issue: #550.

Fixed in master, thanks for reporting.


Update data-lake-storage-multi-protocol-access.md

Change notifications is now GA

@swums : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Hi @swums - Microsoft authors and contributors need to make content contributions through the private repository so the content can be staged and validated by the current validation rules. Could you open future pull requests in the private repo? Thanks.


Windows RBE testing improvements

make sure we are running tests on master without test caching, to get more insight on which test cases are flaky on Win RBE.

Known failures:
https://github.com/grpc/grpc/issues/20421


Please document realtime push

How are we able to leverage realtime push, such as Firebase features. I believe it's available in the SDK but unsure how to use it. Are there examples?
thanks!

We had some issues with the NativeScript SDK, regarding Live Service. They have been resolved as of yesterday's release and Live Service should be usable in NativeScript. The docs for Live Service are right here.
There's also a sample app over here. It is an Angular app for the browser, but since NativeScript can use Angular as well, it should be useful. There are no differences in the Live Service API between the platforms. It also has (a simplified) live model binding, which soulds like the thing you're looking for (as it doesn't come out of the box with Live Service).


BTCC Servers

https://github.com/Aaahh/electrum-btcc/blob/master/electrum_btcc/util.py
https://github.com/Aaahh/electrum-btcc/blob/master/electrum_btcc/servers.json
https://github.com/Aaahh/electrum-btcc/blob/master/electrum_btcc/servers_testnet.json

https://github.com/Aaahh/electrum-btcc/blob/master/electrum_btcc/network.py


Cleanup network usage in NBitcoin #6

This mostly covers ConcurrentChain

I'll do this one.

@bokobza I need to fix some tests ;)

@bokobza tests have been fixed :)

Looks good, I'll wait for the tests.


docs: move telemetry info to its own guide, so we can link to it from the readme

Hello @dbentley, @jazzdan,
Please review the following commits I made in branch nicks/telemetry:
7101eb782d896c6f826f2fcd54622acf75fb6b6d (2019-11-14 20:48:25 -0500)
docs: move telemetry info to its own guide, so we can link to it from the readme

i'm going to merge all this for now so that we have everything in-place for this week. if you have any other comments, happy to address them in a follow-up pr


export is now a readable object stream

cc @diasdavid @dignifiedquire could use a look at this :D

CR'ed :)

One comment, but otherwise :horse: LGTM

@nginnever squash the 'updates commit' and update the README, then we are all set :)

Awesome! :D

Niiice


support internal usage of remove types for ComponentHolder

coverage: 84.583% (-0.3%) from 84.914%
when pulling fb531a15c5acb37217a951f5cbf0ebe84488e893 on internal-compatible
into 9c3bcb2b69f27e6aeb0ab3657b2e385429feb87b on main.


Error:use tensorflow_cifar-10 model on tensorflow android camera

I am very new to tensorflow. Now I am trying to use tensorflow_cifar-10 model on tensorflow android camera, the app is running but there is no output.
At first I have tried this example:
https://github.com/tensorflow/tensorflow/tree/master/tensorflow/examples/android
This example uses the .pb file at:
https://storage.googleapis.com/download.tensorflow.org/models/inception5h.zip
It works well.
Then I tried to replace the .pb file with the tensorflow_cifar-10. I followed some of the instructions here:
https://github.com/tensorflow/tensorflow/issues/616
and add the save__graph() function in /tensorflow/models/image/cifar10/cifar10_train.py
code:
def save_graph():
g = tf.Graph()
vars = {}
with g.as_default():
    with tf.Session() as sess:
        d = np.ones([1,24,24,3],dtype=np.float32)
        input_data = tf.placeholder(tf.float32,shape=[1,24,24,3], name="input_placeholder")
        images, labels = cifar10.distorted_inputs()
        logits = cifar10.inference(images)
        init = tf.initialize_all_variables()
        sess.run(init)
        saver = tf.train.Saver(tf.trainable_variables(),max_to_keep=0)
        saver.restore(sess,os.path.join(FLAGS.train_dir, 'model.ckpt'))
        print (sess.run(logits,{images:d}))
        for v in tf.trainable_variables():
            vars[v.value().name] = sess.run(v)

g2 = tf.Graph()
consts = {}
with g2.as_default():
    with tf.Session() as sess:
        for k in vars.keys():
            consts[k] = tf.constant(vars[k])
        tf.import_graph_def(g.as_graph_def(),input_map={name:consts[name] for name in consts.keys()})
        tf.train.write_graph(sess.graph_def,'/home/eli/Documents/TensorflowProjetos/ProtobufFiles','graph.pb',False)

return os.path.join('/home/eli/Documents/TensorflowProjetos/ProtobufFiles','graph.pb')

I use the save__graph() to get the .pb file after the end of training. Then I replace the tensorflow_inception_graph.pb, whice is from inception5h.zip and used in tensorflow_android_camera, with the new .pb file from the cifar10 model.
Finally I run the tensorflow_android_camera app but there is no output. The error in log is:
Error during inference: Not found: FeedInputs: unable to find feed output input:0
I do not know why it happened, please help me ,thank you!

You will need to either name your input_data "input", or change the demo code to feed "input_placeholder:0".

@qemb01 Please can you supply the exact code you are now running and the command lines necessary to reproduce this problem?

@prb12 Of course, here is my code in cifar10_train.py:
from future import absolute_import
from future import division
from future import print_function
from datetime import datetime
import os.path
import time
import os
import numpy as np
from six.moves import xrange  # pylint: disable=redefined-builtin
import tensorflow as tf
import os
from tensorflow.python.platform import gfile
from tensorflow.models.image.cifar10 import cifar10
FLAGS = tf.app.flags.FLAGS
tf.app.flags.DEFINE_string('train_dir', '/tmp/cifar10_train',
"""Directory where to write event logs """
"""and checkpoint.""")
tf.app.flags.DEFINE_integer('max_steps', 20000,
"""Number of batches to run.""")
tf.app.flags.DEFINE_boolean('log_device_placement', False,
"""Whether to log device placement.""")
def train():
"""Train CIFAR-10 for a number of steps."""
with tf.Graph().as_default():
global_step = tf.Variable(0, trainable=False)
# Get images and labels for CIFAR-10.
images, labels = cifar10.distorted_inputs()

# Build a Graph that computes the logits predictions from the
# inference model.
logits = cifar10.inference(images)

# Calculate loss.
loss = cifar10.loss(logits, labels)

# Build a Graph that trains the model with one batch of examples and
# updates the model parameters.
train_op = cifar10.train(loss, global_step)

# Create a saver.
saver = tf.train.Saver(tf.all_variables())

# Build the summary operation based on the TF collection of Summaries.
summary_op = tf.merge_all_summaries()

# Build an initialization operation to run below.
init = tf.initialize_all_variables()

# Start running operations on the Graph.
sess = tf.Session(config=tf.ConfigProto(
    log_device_placement=FLAGS.log_device_placement))
sess.run(init)

# Start the queue runners.
tf.train.start_queue_runners(sess=sess)

summary_writer = tf.train.SummaryWriter(FLAGS.train_dir,
                                        graph_def=sess.graph_def)

for step in xrange(FLAGS.max_steps):
  start_time = time.time()
  _, loss_value = sess.run([train_op, loss])
  duration = time.time() - start_time

  assert not np.isnan(loss_value), 'Model diverged with loss = NaN'

  if step % 10 == 0:
    num_examples_per_step = FLAGS.batch_size
    examples_per_sec = num_examples_per_step / duration
    sec_per_batch = float(duration)

    format_str = ('%s: step %d, loss = %.2f (%.1f examples/sec; %.3f '
                  'sec/batch)')
    print (format_str % (datetime.now(), step, loss_value,
                         examples_per_sec, sec_per_batch))

  if step % 100 == 0:
    summary_str = sess.run(summary_op)
    summary_writer.add_summary(summary_str, step)

  # Save the model checkpoint periodically.
  if step % 1000 == 0 or (step + 1) == FLAGS.max_steps:
    checkpoint_path = os.path.join(FLAGS.train_dir, 'model.ckpt')
    saver.save(sess, checkpoint_path, global_step=step)

def save_graph():
g = tf.Graph()
vars = {}
with g.as_default():
    with tf.Session() as sess:
        d = np.ones([128,24,24,3],dtype=np.float32)

input_data = tf.placeholder(tf.float32,shape=[128,24,24,3], name="input")
        images, labels = cifar10.distorted_inputs()
        logits = cifar10.inference(images)

        init = tf.initialize_all_variables()
        sess.run(init)
        saver = tf.train.Saver(tf.trainable_variables(),max_to_keep=0)
        saver.restore(sess,os.path.join(FLAGS.train_dir, 'model.ckpt-19999'))

        print (sess.run(logits,{images:d}))
        for v in tf.trainable_variables():
            vars[v.value().name] = sess.run(v)

g2 = tf.Graph()
consts = {}
with g2.as_default():
    with tf.Session() as sess:
        for k in vars.keys():
            consts[k] = tf.constant(vars[k])
        tf.import_graph_def(g.as_graph_def(),input_map={name:consts[name] for name in consts.keys()})

        tf.train.write_graph(sess.graph_def,'/home/eli/Documents/TensorflowProjetos/ProtobufFiles','graph.pb',False)

return os.path.join('/home/eli/Documents/TensorflowProjetos/ProtobufFiles','graph.pb')

def main(argv=None):  # pylint: disable=unused-argument
cifar10.maybe_download_and_extract()
if tf.gfile.Exists(FLAGS.train_dir):
tf.gfile.DeleteRecursively(FLAGS.train_dir)
tf.gfile.MakeDirs(FLAGS.train_dir)
train()
save_graph()
if name == 'main':
tf.app.run()
I have run the cifar10_train.py to get pb file. Then I replace the tensorflow_inception_graph.pb with it. The tensorflow_inception_graph.pb is in the /tensorflow/tensorflow/tree/master/tensorflow/examples/android/assets/ of tensorflow android camera demo.
Tensorflow android camera demo:
https://github.com/tensorflow/tensorflow/tree/master/tensorflow/examples/android

I'm sorry - but this code looks pretty confused to me.  As @sherrym said above, the android example is expecting a graphdef with a placeholder node called 'input' into which it will presumably feed images from the camera.  Your original code had an unused placeholder node called input_data:
input_data = tf.placeholder(tf.float32,shape=[1,24,24,3], name="input_placeholder")

The new code above calls cifar10.distorted_inputs() which I believe generates a graph to read input images from files in the filesystem (whose names are retrieved from a queue!) and randomly mutates them.  If you want this to work you will need to create a graphdef which accepts images via a node called 'input' and feeds them into cifar10.inference.
Since it isn't a TensorFlow bug, but really a general programming question, you should probably re-ask this on StackOverflow. (please ensure you tag the question 'tensorflow').

@prb12 Thank you very much. I will try to do it.

@qemb01  Have you successful to replace the model file?


A/B test stories landing comics

Part of #9083
This is A (what we currently have) vs. C from this comment on the ticket (which felt like the option with least problems to me).
Is 'total comics viewed' the right measure of success? On the one hand, it would seem to be slightly unfair on the A condition since it would require first visiting a series landing page. On the other hand, perhaps that's a more appealing journey from the off?
Or if we don't think it's a fair test, do we need something more along the lines of 'more clicks on one of the three cards in the comics section on the stories landing page' as the measure?
@taceybadgerbrook and @jennpb do you have any opinions/thoughts about the above?

A/B testing works best where there is volume. As there have only been 34 page views of https://wellcomecollection.org/series/Y8aThBEAAKREABhL in the last 7 days, maybe we could go for something simpler and just see whether people are encouraged to click to on older comics or just the latest. I think A/B testing stories content is always going to be tricky analytically because some stories are just more compelling to some users than others.


Runtime crash with Xcode 9.1

I run into random runtime crashes on deflate(&stream, Z_FINISH) and inflate(&stream, Z_SYNC_FLUSH) when I build with Xcode 9.1.0.
Environment:
Xcode: Version 9.1 (9B55)
iPhone 8: iOS 11.0.3 (15A432)
GzipSwift: 4.0.0 (cocoapods)
minimum example project:
https://github.com/banjun/GzipSwiftXcode910
When Build & Run the project, randomly crash on the deflate or the inflate (or may cause malformed gunzipped data...?).
I have tried so far, Xcode 9.1 Simulator does not crash. also, building with Xcode 9.0.1 cannot cause crashes.
Reason why the example project uses fragmented data
URLSession.dataTask response with data as OS_dispatch_data referencing numbers of 8K block data. I think this is one of the main usecases of gzip.
Analysis
withUnsafeBytes codes are suspicious, especially at https://github.com/1024jp/GzipSwift/blob/72e16b884600b98ac77a871daecaea34aec87f8e/Sources/Data%2BGzip.swift#L279
withUnsafe... methods are not responsible for pointer uses outside the trailing closure. it actually make creating Data -> z_stream difficult.
Some memory copies into a new Data with contiguous memory can resolve the crashes.

Thank you for the report and the pull-request.
I've just released GzipSwift 4.0.3 with your fix.


Question!

Hey dude! been working with some new structures and just wanted to bounce something off you.
But do you know, if you can use jigsaw pieces inside another structure? for example I have a 30x30 structure which is a ring and inside I have a courtyard with a jigsaw pointing into it. The idea is to randomly generate a different courtyard but all my tests seem to not be spawning it.
If I use the jigsaw piece manually, it'll generate my courtyard but if I generate my starting jigsaw/structure with max generation, it doesn't work! :(
Even tried spawning it naturally in the world using the code, etc and no avail/ not sure what i'm doing wrong or if i'm missing something.

Yes it is possible to spawn jigsaw pieces inside other pieces but the limitation is that the jigsaw pieces cannot be partially intersection. The child piece must either fit entirely within the parent piece or entirely outside the parent piece. Pillager outposts has a base plate piece which is ginormous and inside it, they have a Jigsaw piece that generates the outpost so that the outpost fits entirely within the base plate piece's bounds.
If you are still stuck, can you share your repo? I can clone and take a look.

I think that make sense actually, my initial structure is only 8 blocks or so tall but I made my courtyards atleast 15 blocks tall to have something tall like a tree, so i'm guessing its extruding outside the parent and not spawning, so if thats the case, if I increase the base structure height, I should be good? i'll go test that out and if not, i'll send you the repo! Thanks :D
Also do you have any tutorials or tips for processors? I was checking out your repurposed structures and saw that you use them to randomise or spawn pillars with the data blocks? I'd love to know more about them also!

Yup, that fixed the issue! thanks a lot! Just got to remember that room for later!

Glad that helps!
For processors, I would recommend sticking with the json ones. Specifically, the rule processor as that is easiest to understand and randomize blocks for instead of making your own processors.
The first step is to make a json file in resources/data/<mod_id>/worldgen/processor_list and then fill it with this. The input_predicate will look for the block to replace along with a probability of how often it will use the output_state for what blockstate to use as the replacement for the block. output_state must always list every property of the block though so keep that in mind. This rule processor has only 1 rule.
https://github.com/TelepathicGrunt/RepurposedStructures/blob/master/src/main/resources/data/repurposed_structures/worldgen/processor_list/village/birch/mossify.json
Then in your pool file, put in the resourcelocation for the processor file you made and the game will use that
https://github.com/TelepathicGrunt/RepurposedStructures/blob/d2383aaa70fd5f7480d69aa2810aca5b5046f53d/src/main/resources/data/repurposed_structures/worldgen/template_pool/village/birch/houses.json#L9
In fact, you can list multiple rules like this. Notice how some of the location_predicate will check for if the structure block is going to replace water. This is how villages turns their roads into planks when replacing water!
https://github.com/TelepathicGrunt/RepurposedStructures/blob/master/src/main/resources/data/repurposed_structures/worldgen/processor_list/village/birch/path_randomizer.json
This should help you really get started!
If you get stuck or want to dive deeper, check out this discord full of modders who will be glad to help! I'm often on there as well too in my #telepathicgrunt-mods channel as well as in the #mod-dev-1.16 channel for helping people


mycms and YubiHSM2

YubiHSM2 requires login to see the objects in the token. Without performing a login the object list is empty including public and certificate type objects.
When trying to perform a signature, the operation fails because the certificate is not found.

ERROR: 00100004: No object found
MYCMS ERROR DUMP - BEGIN
Version: mycms-0.2.0_master ()
Entries (most recent call last):
#0
SOURCE_FILE=mycms-certificate-driver-pkcs11.c
SOURCE_LINE=356
SOURCE_FUNC=__find_object
HINT=certificate.driver.pkcs11.find
CODE=0x00100004
AUTHORITATIVE=1
DESCRIPTION=No object found
MYCMS ERROR DUMP - END

On Sat, Feb 3, 2024 at 7:16 PM gilweis @.***> wrote:

YubiHSM2 requires login to see the objects in the token. Without
performing a login the object list is empty including public and
certificate type objects.
When trying to perform a signature, the operation fails because the
certificate is not found.

You should be able to set certificate as public when creating the object
just like the other providers.Message ID: @.***
com>

With YubiHSM2  it's Impossible to access pubic keys and certificates objects without login.
No problem with softhsm or yubikey to access them without login.
$ pkcs11-tool --module /usr/lib/x86_64-linux-gnu/pkcs11/yubihsm_pkcs11.so -O  --pin 0001password
Private Key Object; RSA
  label:      label_perm2
  ID:         0066
  Usage:      decrypt
  Access:     sensitive, always sensitive, extractable, local
  Allowed mechanisms: RSA-PKCS,RSA-PKCS-OAEP
Public Key Object; RSA 2048 bits
  label:      label_perm2
  ID:         0066
  Usage:      encrypt
  Access:     local

$ pkcs11-tool --module /usr/lib/x86_64-linux-gnu/pkcs11/yubihsm_pkcs11.so -O
Using slot 0 with a present token (0x0)

I see that they support[1] CKA_PRIVATE attribute, so if you store the
certificate object you can control the attribute. A provider that does not
allow public access to certificate will not work with most of the
applications, so it is strange.
[1]
https://docs.yubico.com/hardware/yubihsm-2/hsm-2-user-guide/hsm2-initial-provision-deploy-guide.html#pkcs11-rsa

As you can see, the public key and cert are not public.

I could not see how you placed them there... :)

https://developers.yubico.com/YubiHSM2/Component_Reference/PKCS_11/
Section "PKCS#11 Attributes":
There are a number of attributes defined in PKCS#11 that do not translate to Capabilities of the YubiHSM 2 device, and are therefore treated as always having a fixed value.

Bummer...
CKA_PRIVATE|CK_TRUE|Login is always required
You can modify the attribute of the certificate and add a flag that it is
private so that login will be done earlier.
On Sat, Feb 3, 2024 at 11:14 PM gilweis @.***> wrote:

https://developers.yubico.com/YubiHSM2/Component_Reference/PKCS_11/
Section "PKCS#11 Attributes":
There are a number of attributes defined in PKCS#11 that do not translate
to Capabilities of the YubiHSM 2 device, and are therefore treated as
always having a fixed value.
—
Reply to this email directly, view it on GitHub
https://github.com/alonbl/mycms/issues/10#issuecomment-1925456939, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAJURLP446EFJ4ATETDJ32TYR2SEFAVCNFSM6AAAAABCYFLH7KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMRVGQ2TMOJTHE
.

Why not give mycms-tool an option to force login for reading the objects (like --pin option in pkcs11-tool and like openssl pkcs11 engine and openssl pkcs11 provider)?

This is what I referred to in my last comment.
Do you have anyone to workout a patch?

Yes, I can test a patch

Hi,
I tried to change the code and do the login at __driver_load() function (if necessery) instead at __open_private_key() function.
It's working with this change :-)
It's ok to change the code in such way?

Please test #11

Thanks.
Tested (sign,verify,encrypt-add,encrypt) with:
SoftHSM and cert-is-private=0
YubiHSM and cert-is-private=1
YubiKey5 and cert-is-private=0
All the tests passed!

Fixed with #11.


This is a bug in the provider

Describe the bug
When I configure dynatrace problem notification through terraform, the headers parameter is abnormal. This is very strange. The same configuration is normal when it is created for the first time. However, when I change some configurations (such as changing the configuration status to true) and re-run the code, this problem occurs, as shown in the attachment.
Expected behavior
The official description of dynatrace_webhook_notification configuration is as follows, "secret_value and value are mutually exclusive. Only one of those two is allowed to be specified." However, this bug seems to require both values to be specified when reading the module, which is not a reasonable place.
Screenshots

Desktop (please complete the following information):

OS: [ubuntu]
Browser [chrome]
Version [22.04]

Hello @Tony-WangQAQ
Would you be able to provide the HCL code for the dynatrace_webhook_notification you're using here?
I've tried to reproduce with a couple of samples, but so far wasn't able to get the results you're seeing.
thanks,
Reinhard

Hello @Reinhard-Pilz-Dynatrace
Thanks a lot
Because there is some sensitive information in the current test code, I need to modify it. If the modification is completed, I will update it to you.
Thanks,
Tony

Hi Tony,
I unfortunately still cannot reproduce that error message. But based on the wording in that error I have a hunch that it has something to do with this bug in the Terraform Plugin SDK. We have to circumvent that phenomenon in several resources. And that bit of information
cty.ObjectVal(map[string]cty.Value{"name":cty.NullVal(cty.String), "secret_value":cty.StringVal(""), "value":cty.NullVal(cty.String)})

makes me believe, that it might be the root cause.
Right now we don't have a proper way to handle this case. But with the release of the provider scheduled for tomorrow I have added something that hopefully allows you to avoid the error:
When running terraform apply or terraform plan, you need to set the environment variable DYNATRACE_FORCE_NEW_ON_HEADERS to true. In that case the provider will enforce that any changes within the headers require Terraform to recreate the whole resource.
I've hidden that feature behind an environment variable for the moment, so we can collect feedback from you first. If it is indeed a solution we will make that default behavior in the future.
Let me know once you were able to try this out with the upcoming release of the provider. I will keep this ticket open until then.

Hello @Reinhard-Pilz-Dynatrace
Thanks very mush.
Currently I am ignoring the Header content by adding the following code.
lifecycle {
    ignore_changes = [
      headers
    ]
  }

Because I have other work to complete urgently, if I have enough time, I will test and verify it and feedback the results to you
Thanks a lot，
Tony


GetQuote.Field should be a link

https://schwab-py.readthedocs.io/en/latest/client.html#schwab.client.Client.get_quote

Created by https://github.com/alexgolec/schwab-py/commit/f4e09573932897293c50d38e96ffbca40219005a and not updating the comment there.
If the github workflow for building documentation is changed to sphinx-build -W -n docs/ docs-build (add -n), then the nag message would have said that there was an issue. Otherwise, sphinx-build wasn't making any kind of warning/etc.
I changed it locally on my system, but it still complains, even when it seems correct. Unsure...
schwab/client/base.py:docstring of schwab.client.base.BaseClient.get_quote:7:py:class reference target not found: Quote.Fields


segment-anything-web Demo not working on iPhone

System Info
https://huggingface.co/spaces/Xenova/segment-anything-web
with Google Chrome (v125.0.6422.80) on iphone (iOS Version 16.5.1, Model iPhone SE)
Description
Hey,
first, transformers.js is an amazing project. THANK YOU
Second, Xenova/slimsam-77-uniform does not work on my phone. I am using the official demo.
https://huggingface.co/spaces/Xenova/segment-anything-web
Chrome (v125.0.6422.80) on my iphone (iOS Version 16.5.1, Model Name iPhone SE) is stuck at the "extracting embedding" step:

I did a quick debug with Web Inspector and this is what I get on the console

Seems like<EMAIL_ADDRESS>goes 404, not sure if this is the cause but I don't get this error when I run it on my desktop.
Any help appreciated.
Reproduction

open Chrome on iOS
https://huggingface.co/spaces/Xenova/segment-anything-web
Click "try example"

Hi there! 👋 Thanks for debugging - the console logs are really helpful here. Indeed OrtRun(). error code = 6 is typically for out-of-memory issues, which is a bit unexpected due to the small model size, but supposedly the RAM usage increases significantly during embedding computation. 😞 This might be improved with v3 - which uses a more up-to-date version of onnxruntime-web, but I haven't tested yet 👀

thank you!
something maybe related, I just noticed that the space uses a lot of memory, at least that's what Chrome says.
Is this expected?

Mine says something way different 👀 (this is after loading and using the model):


Cannot read properties of undefined (reading 'dragStartDisposable')

I closed all editor groups and settings editor was opened:
  ERR Cannot read properties of undefined (reading 'dragStartDisposable'): TypeError: Cannot read properties of undefined (reading 'dragStartDisposable')
    at ListView._splice (vscode-file://vscode-app/Users/bpasero/Development/Microsoft/vscode/out/vs/base/browser/ui/list/listView.js:350:22)
    at ListView.splice (vscode-file://vscode-app/Users/bpasero/Development/Microsoft/vscode/out/vs/base/browser/ui/list/listView.js:335:29)
    at vscode-file://vscode-app/Users/bpasero/Development/Microsoft/vscode/out/vs/base/browser/ui/list/splice.js:14:45
    at Array.forEach (<anonymous>)
    at CombinedSpliceable.splice (vscode-file://vscode-app/Users/bpasero/Development/Microsoft/vscode/out/vs/base/browser/ui/list/splice.js:14:30)
    at vscode-file://vscode-app/Users/bpasero/Development/Microsoft/vscode/out/vs/base/browser/ui/list/listWidget.js:1152:67
    at EventBufferer.bufferEvents (vscode-file://vscode-app/Users/bpasero/Development/Microsoft/vscode/out/vs/base/common/event.js:1235:23)
    at TreeNodeList.splice (vscode-file://vscode-app/Users/bpasero/Development/Microsoft/vscode/out/vs/base/browser/ui/list/listWidget.js:1152:32)
    at TreeNodeList.splice (vscode-file://vscode-app/Users/bpasero/Development/Microsoft/vscode/out/vs/base/browser/ui/tree/abstractTree.js:1072:19)
    at IndexTreeModel._setListNodeCollapseState (vscode-file://vscode-app/Users/bpasero/Development/Microsoft/vscode/out/vs/base/browser/ui/tree/indexTreeModel.js:266:23)
    at IndexTreeModel._setCollapseState (vscode-file://vscode-app/Users/bpasero/Development/Microsoft/vscode/out/vs/base/browser/ui/tree/indexTreeModel.js:237:33)
    at vscode-file://vscode-app/Users/bpasero/Development/Microsoft/vscode/out/vs/base/browser/ui/tree/indexTreeModel.js:233:63
    at EventBufferer.bufferEvents (vscode-file://vscode-app/Users/bpasero/Development/Microsoft/vscode/out/vs/base/common/event.js:1235:23)
    at IndexTreeModel.setCollapsed (vscode-file://vscode-app/Users/bpasero/Development/Microsoft/vscode/out/vs/base/browser/ui/tree/indexTreeModel.js:233:39)
    at ObjectTreeModel.setCollapsed (vscode-file://vscode-app/Users/bpasero/Development/Microsoft/vscode/out/vs/base/browser/ui/tree/objectTreeModel.js:181:31)
    at TOCTree.collapseAll (vscode-file://vscode-app/Users/bpasero/Development/Microsoft/vscode/out/vs/base/browser/ui/tree/abstractTree.js:1361:24)
    at SettingsEditor2.triggerSearch (vscode-file://vscode-app/Users/bpasero/Development/Microsoft/vscode/out/vs/workbench/contrib/preferences/browser/settingsEditor2.js:1227:34)
    at SettingsEditor2.onSearchInputChanged (vscode-file://vscode-app/Users/bpasero/Development/Microsoft/vscode/out/vs/workbench/contrib/preferences/browser/settingsEditor2.js:1170:24)
    at vscode-file://vscode-app/Users/bpasero/Development/Microsoft/vscode/out/vs/workbench/contrib/preferences/browser/settingsEditor2.js:439:60
    at vscode-file://vscode-app/Users/bpasero/Development/Microsoft/vscode/out/vs/base/common/async.js:288:32

https://github.com/microsoft/vscode/issues/171041
cc @rzhao271


Update circle workflow

Q
A

Bug fix?
no

New feature?
no

API breaks?
no

Deprecations?
no

License
Apache 2.0

What's in this PR?
Improve circle workflow

It does not seem to improve anything. 😞


Column headers shifted when hidden column present

I'm encountering a problem with TableHeaderColumn headers (<th>) being improperly positioned when a hidden column is present in the table.
In the following example, I have a 3rd column set as hidden: true.

Notice how "Definition" is shifted over to the right.
To reproduce:

Add a new column to the end, set hidden: true

My recommendation to fix this would be to remove the hidden column DOM entirely rather than using display: none. I don't see any reason for keeping the DOM there anyway.
This would also fix a related CSS issue I have, where styling td.last-child still gets applied to a hidden last column - whereas I want it applied to the last visible one. I realize I can probably fix this  now by adding something like a 'visible' className to each visible column - but that makes my table logic pretty hairy.
Thoughts? Might submit a pull request with a fix...

I'm seeing the same issue

@applebya, I'll check this out. PR is welcome, thanks :)

Same issue here.

hi there, sorry for lately fixing, check<EMAIL_ADDRESS>by
npm install<EMAIL_ADDRESS>and I thought this beta release already fixed couples unalign problem, if it work and stability, I'll consider to forward to production as soon as possible.
Let me know if the problems still there. thanks


Added padding to help command

For real this time... hopefully.

UH.
Just wait until Evie merges master back into indev before you do the PR ;-;


[feature] config: override and unbind

Override
Previously, a duplicated keybinding is ignored. But in some use cases, we may want to override some hotkeys defined in a file included using the include statement.
For example:
I have
print
   scrot

in my ~/.config/swhkd/swhkdrc
And
include /home/eden/.config/swhkd/swhkdrc
print
    wayshot

in my ~/.config/wayfire/swhkdrc
Using the overriding function, the command bind to print would be wayshot rather than scrot
Unbind
In some use cases, we may want to ignore some hotkeys defined in a file included using the include statement.
For example:
I have
super + d
    dunstify "$(date)"

in my ~/.config/swhkd/swhkdrc
And
include /home/eden/.config/swhkd/swhkdrc
ignore super + d

in my ~/.config/wayfire/swhkdrc
Using the unbinding function (the keyword is now ignore, which is defined as a const), the super + d keybinding would be ignored for all the included files.

Another thing while we're at it, now's probably the time to write a man page. We have way too much documentation spread around various markdown files some of which aren't even there and instead in release notes.

@angelofallars Feel free to leave your review here. However, please don't merge till we get documentation done. The current mess of md files and release notes need to be sorted.

I'll write man page when I get home.


Compare activation functions, not batch sizes

@edgararuiz, our conversation yesterday was extremely helpful, both for establishing the direction and priorities of the drake + keras workshop and enhancing this example workflow. Based on your feedback, I have updated the notebook to compare models with different activation functions which, I agree, seems more realistic and interesting than tuning batch size.
@andrie, Edgar suggested that I reach out to you for advice. In your opinion, what are some interesting and useful model properties to tune in this case study?
I am exploring ways that drake can help manage machine learning workflows, and I am preparing a half-day workshop at R/Pharma based on this case study intro slides here. For the sake of demonstration, I would like to try multiple variants of the same model and compare them in terms of performance. My current focus is on the activation function and number of units of each layer.

Thanks @wlandau !


Making the Contents Controller more general extending it with Some Contente Metadata permissions

Working on that fix #8092  I realize that we could abstract a bit more the logic for permissions in order to consent developers to use the same Contents/Edit controller/view instead of cloining it. As per Metadata.EditorRouteValues we could add to new propoerties to metadata with the permissions to check over Display/Edit/Delete/Publish actions and so on. So we could use the Contents Controller without copying/pasting the Controller Actions and Views.
@sebastienros What about the suggestion?

I don't think that is necessary. Usually you will need to adapt the actions specifically to your items, and this is why you wan't to create custom ones, or you would just use the default ContentItem ones.


Add Chromecast improvements

This PR adds some Chromecast improvements:

Receiver
Play
Stop

Play and Stop and be done through Chrome interface or Google Home.
Will iterate on this further later.


feat(index): align indexes with new content structure

Updated all indexes to align with new structure. All content would need to be re-indexed, I have created new empty query-index.xlsx everywhere and will get rid of the old ones.
For the English site, the blog is indexed separately but blog pages are indexes in both the language index and the blog index. I do not think this is an issue for now, I do not know what we do with the language index anyway. But maybe @dominique-pfister, you have a magic regex to index everything under /express except pages in /express/learn/blog.

you have a magic regex to index everything under /express except pages in /express/learn/blog
You don't have to put everything in one regex. The following combination:

include:
  - 'express/**/*.(docx|md)'
exclude:
  - 'express/learn/blog/*.(docx|md)'

should do the trick

@dominique-pfister would the 2 excludes work ?
https://github.com/adobe/spark-website/blob/f5cb78eaae006c8055e9b3d17927d0083855a777/helix-query.yaml#L51-L53

@dominique-pfister would the 2 excludes work ?
https://github.com/adobe/spark-website/blob/f5cb78eaae006c8055e9b3d17927d0083855a777/helix-query.yaml#L51-L53

Yes, it will. The indexer does the following with that section:
return match(cfg.include, path, true) && !match(cfg.exclude, path, false);

So it includes everything in include that is not in exclude.


Getting hcsshim::ImportLayer failed in Win32 error when creating a new SQL Server Developer Windows image

I have been happily creating my own SQL Server Developer windows image, using the same DockerFile as the image on the public repository but with FullText feature ON.
Here is my DockerFile:
https://github.com/robinho81/mssql-server-windows-developer-fts
This was working fine until I did the latest Windows update (1709) on my machine.
Now I am getting the following error everytime I try to create the SQL Server image:

Success

SQL Server 2017 transmits information about your installation experience, as well as other usage and performance data, to Microsoft to help improve the product. To learn more about SQL Server 2017 data processing and privacy controls, please see the Privacy Statement.
Microsoft (R) SQL Server 2017 14.00.1000.169
Copyright (c) 2017 Microsoft.  All rights reserved.
re-exec error: exit status 1: output: time="2017-11-02T16:30:34+01:00" level=error msg="hcsshim::ImportLayer failed in Win32: The system cannot find the path specified. (0x3) layerId=\?\C:\ProgramData\Docker\windowsfilter\4b52122b26a9cc8fa14e8d9f17d3c220c9205ce002895e4e01db713626e66aab flavour=1 folder=C:\WINDOWS\TEMP\hcs387709727"
hcsshim::ImportLayer failed in Win32: The system cannot find the path specified. (0x3) layerId=\?\C:\ProgramData\Docker\windowsfilter\4b52122b26a9cc8fa14e8d9f17d3c220c9205ce002895e4e01db713626e66aab flavour=1 folder=C:\WINDOWS\TEMP\hcs387709727

Any ideas why this could be happening?
Some info on my environment:
Docker for Windows Version:
Version 17.09.0-ce-win33 (13620)
Channel: stable
Windows 10 Version:
Version: 1709
OS Build: 16299.19

I'm getting this error when trying to build the mssql-server-windows-developer image after adding the FullText option (see the dockerfile here: https://github.com/TacomaSoftware/mssql-docker/commit/7f19eb189b8f89ffdcc20e1c1b17d61ebca521f3).
I used this command:
docker build -t mssql-server-windows-developer-fulltext:latest mssql-server-windows-developer --no-cache
I get the following error:

re-exec error: exit status 1: output: time="2018-02-18T16:44:08-05:00" level=error msg="hcsshim::ImportLayer failed in Win32: The system cannot
find the path specified. (0x3) layerId=\\?\C:\ProgramData\Docker\windowsfilter\28dbd991cc2db4f90bccb635ffe62dfdc34a4dcba0e445f2a9d50fd80db24289 flavour=1 folder=C:\ProgramData\Docker\tmp\hcs462522975"
hcsshim::ImportLayer failed in Win32: The system cannot find the path specified. (0x3) layerId=\?\C:\ProgramData\Docker\windowsfilter\28dbd991cc2db4f90bccb635ffe62dfdc34a4dcba0e445f2a9d50fd80db24289 flavour=1 folder=C:\ProgramData\Docker\tmp\hcs462522975

Note that I can build successfully without the FullText Feature.


Enable clients to set flags

Updates #198
This PR adds a new method to the OpAMPClient that allows clients to set their own flags (such as RequestInstanceUid).
This new method deviates a little bit from other ones as it just sets a uint64 instead of a pointer struct field, and doesn't use the same errors and nil checks.
Thank you in advance for taking and look, and please let me know if I'm missing anything! 🙌

cc @srikanthccv I followed your hint over at #198, let me know if I'm missing anything 🙌

I think this is missing a couple additional things:

Use the Flags from ClientSyncedState in PrepareFirstMessage. This will allow calling SetFlags() before Start() too, which I imagine is useful so that we ask for a new instance id immediately, not after the first request is sent.

Also use the Flags from ClientSyncedState when the server asks ServerToAgentFlags_ServerToAgentFlags_ReportFullState here. This is important since the agent may reconnect to a different server instance after the first sending attempt is done but reply carrying the new instance id was not received.

Once 1 and 2 are added we need to reset the RequestInstanceUid flag after we receive new_instance_uid from the Server, otherwise we will keep asking for new ids every time. Perhaps do it in rcvAgentIdentification after SetInstanceUid returns success.

I may be missing some more things. This needs a bit more thought and additional test cases that demonstrate the real use cases and behavior in presence of failures.

Thanks for the feedback @tigrannajaryan
I focused only on the client-side implementation but I realize it's a more interconnected change. I'll try to set up an end-to-end test to have at hand and figure out the entire lifecycle of the IDs.

Hey there @tigrannajaryan @srikanthccv 👋 Hope your week is going well!
I've pushed a couple of commits; bd001cf that handles the cases Tigran mentioned on your last message and ca66f1d that adds a test for how messages containing valid/invalid AgentIdentification fields interact with the state of the flag we're tracking.
Let me know how this looks, and if you have any concerns, or ideas. I'm still trying to understand all the moving pieces, so if I'm missing anything please let me know!

Thank you @tpaschalis


replit thinking "telebot" is another package and downloading the wrong one

I tried getting the bot to run on repl.it, but when having import telebot in the code, replit thinks that I want to use this package, instead of pyTelegramBotAPI. So, when running the program, replit automatically installs and starts trying to use that other package in the program, leading it to fail when calling message_handler, an attribute of the TeleBot class in the pyTelegramBotAPI package, but not in telebot
Example code:
import telebot
import os

bot = telebot.TeleBot(os.environ["token"])

@bot.message_handler(commands=["start"])
def hi(message):
    bot.send_message(chat_id=message.chat.id, text="hello there, this is an example"

bot.infinity_polling()

Error:

I am writing import telebot here instead of import pyTelegramBotAPI because:

It says so in the docs of the pyTelegramBotAPI package
It gives a ModuleNotFound error if I write import pyTelegramBotAPI

Just realized this isn' the right place to post this. Oops!)

You are right. i have the same issue here, and i can't find the answer...