Error running GUI program on windows

Hi.
I downloaded the app for windows, and I get this error.
I changed the email address for privacy.
Starting script...
(node:20020) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead.
(Use node --trace-deprecation ... to show where the warning was created)
Going to: https://learninghub.sap.com/login
Entering login<EMAIL_ADDRESS>--> edited by me to hide email address
Entering password: ***
Error during login: Error: Execution context was destroyed, most likely because of a navigation.
at P (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:60512)
at processTicksAndRejections (node:internal/process/task_queues:93:5)
at async n.ExecutionContext._evaluateInternal (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:60018)
at async o.evaluateHandle (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:20934)
at async o.$ (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:27288)
at async DOMWorld.$ (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:1078210)
at async DOMWorld.type (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:1081772)
-- ASYNC --
at n.ExecutionContext. (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:7836)
at o.evaluateHandle (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:20964)
at o. (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:7859)
at o.$ (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:27299)
at o. (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:7859)
at DOMWorld.$ (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:1078218)
at processTicksAndRejections (node:internal/process/task_queues:93:5)
at async DOMWorld.type (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:1081772)
-- ASYNC --
at f. (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:7836)
at W.type (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:55697)
at D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:18:847502
at s (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:1024897)
at Generator._invoke (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:1024650)
at Generator.forEach.e. [as next] (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:1025254)
at t (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:12899)
at c (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:13110)
at processTicksAndRejections (node:internal/process/task_queues:93:5)
Error: Error during init
at D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:18:854325
at s (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:1024897)
at Generator._invoke (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:1024650)
at Generator.forEach.e. [as next] (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:1025254)
at t (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:12899)
at c (D:\Documents\Downloads\saplearninghub-pdf-downloader-gui\index.js:1:13110)
at processTicksAndRejections (node:internal/process/task_queues:93:5)

It happens to me too sometimes. I don't know where that comes from.
Usually, I start again and it works. Could you try again ?

Hi.
Thank you for the quick reply!
I've tried several times, but it always fails.
Is it better if I try on linux? Even the no-gui doesn't work for me, I cannot compile.


urlSync.threshold seems not to work

According to the docs

urlSync.threshold should update the URL but delayed by700 ms. This seems not to work for me, it even seems to block typing into the search box while the URL is beeing updated. (Can not be proven.)
But it definitely does not delay the URL update by 1000 ms.
var search = instantsearch({
	appId:		'...',
	apiKey:		'...',
	indexName:	'...',
	urlSync:	{
		useHash:	true,
		threshold:	1000 // This seems not to work
	},
	searchFunction: function (helper) {
		helper.search();
	},
	searchParameters: {
		typoTolerance: true,
	},
});

search.addWidget(
	instantsearch.widgets.searchBox({
		container: 		'#q',
		autofocus:		true,
		wrapInput:		false,
		queryHook:		$.throttle(function(query, search) {
			if ($.trim(query).length == 0) {
				return false;
			} else { /* set empty result list */ }
			search(query);
	    }, 1000),
	})
);

Or is this only about the browser history?

Hi Simon, thanks for the issue. Our doc is lacking real explanation about that. The URL sync mechanism is implemented in a way that it will update the URL (and not creating new browser history steps) if under the threshold. Beyond the threshold it will create a new entry. It is not using throttle or debounce.

@bobylito Ah! I see, so either the "internal" browser history is used with useHash: true OR a "real" browser history is rendered into the browsers search bar.
Anyway the threshold seems not to be recognized.

@powtac at each keystroke we update the url (no matter if we use native browser history or fake one using location.hash).
Then, when using native browser history API, on top of updating the url at each keystroke, we create a new history state after the thresold.
The states we are talking about are the ones used when you hit "back", only. They should represent the times where you stop typing/meaningful queries/half queries.
Here's an example:

history state is empty query
t0: type t (url bar has: t, history state is empty query)
t0+30ms: type e (url bar has: te, history state is empty query)
t0+600ms: type s (url bar has: tes, history state is empty query)
t0 + 700ms: type t (url bar has: test, new state is created)
t0 + 900ms: type e (url bar has: teste, history state is "test")

Then if you stop writing, url bar is "teste", history state should be "teste" (because you stopped typing for more than 500ms more (900 + 500 = 1400 so two times thresold).

Hope this long explanation is clearer.
I think a lot of people thinks thresold might be a debounce url bar set. It's just the time after we create a new history state entry in the browser.

@vvo clear! I got it.
Anyway. The case I tried to describe in this ticket is, that it looks like the hash URL is updated immediately and not only every 700ms. I thought it only will be updated once every 700 ms as you described it. But I can not see a delay even when setting threshold to 10000 ms. Or is the threshold option only for useHash: false?

In both cases no matter the value of thresold the URL is always updated. Thresold is only saying "every 700ms create a new state that will be available when using the back button".
So, if you use "useHash", do you have a state per letter when clicking on back button? That would be a bug.
Thanks

So, if you use "useHash", do you have a state per letter when clicking on back button? That would be a bug.

I will check that! Thanks for clarifying!

Definitely the value of threshold is not recognized. When I set it to 10000 the URL is updated roughly every second. Probably every 700 ms but not every 10 seconds!

Ok thanks for that I will have a look

I have been double checking this and it's "on purpose" that we update the url at every keystroke to provide the right feedback to our users.
Then, the thresold is only the minimum time between two search states where we decide to create a new state.
So when putting thresold: 10000 (10s) it means that we will create new search states every 10s. The thresold is our way of saying "After xxxms of inactivity, we consider the state to be one to remember when going back".

I understand this may not be the behavior you might want to build into your application but this is the correct behavior given the implementation.
I will update the documentation on this part.
If you want to have a different behavior or a new parameter then please open a new issue. Thanks!


Using multiple USB serial adapters

Is there any way with this library to have multiple serial connections open?
If I plug in two USB serial ports, it just randomly connects to one of them.
If I was to use two USB serial ports from different vendors and opened them using the vid/pid options, would the library allow me to operate the ports independently and simultaneously, or is this library limited to using a single USB serial port.?
Thanks,

Hello @DragonNZ
That's a good question! I don't have the hardware to test it, but it seems that passing VID/PID may work.
Let me know if you can test it
Regards

Any updates?

Didn't have any luck with getting the alternate device to work on it's own, so didn't have the hardware to test it with in the end.
For this project I am building an external interface that is going to multiplex 4 serial ports and some analog input data through a single USB serial input. So that has solved the issue for me at least.

Hi,
I am using a binary protocol over the serial port and I have struck an issue.
When using Serial.Write with a binary sequence, I am getting extra bytes injected for bytes of value 127 or greater in the string.
Looking at the source code, it looks like String.getBytes() is returning a unicode sequence rather than the raw bytes themselves.
Do you know of any work around for this, or maybe the string shouldn't be converted via the getBytes function?

Hi,
In regard to the binary protocol, took me a while to realise that the writeSerialHex is what I was looking for, which is already there.

Hi @DragonNZ so you're ok?
If you find the docs lack of clarity, please tell me how to update them.
Regards

Yep I am ok and the documents are fine. It just my inability to read them.
I saw the writeSerial function and that was enough for me, until I hit the issue with Unicode and Strings.
I initially added a writeSerialBase64 function to your code, until I finally read the code in the writeSerialHex function and realised what it did.
I usually program in C++, not javascript, but I couldn't find a function to convert binary to a hex string in JS, so I wrote my own function for that.
I note that JS includes the btoa function which encodes a byte sequence into a base64 string.
Have you considered using base64 instead of hex for that function?
Regards


/ssh endpoint should be disabled by default

also, the changelogs on the release page do not state there is an ssh server, to begin with, and I think it is a decent security issue, because there may be people who don't use ssh for reasons or people who hold a STRICT ssh policy and this is just an ssh server without any user configurability by the looks of it, and it is enabled by default.

We might remove the SSH endpoint. Initially, it was added to do port-forwarding and a buncha other things, but isn't really needed anymore.

a better idea, dont remove it, leave it there, but make it so it is disabled by default.
because i can see a use. Like you have a server in which a few people need to access and you dont trust them with the user password (in fear they may attempt to sudo or su), you can provide the code-server password to them.
and add documentation on the things existence.

@Merith-TK There are plenty of ways to accomplish this without building in an SSH server. For example, you can load up a docker container and mount the workspace volume in it and give SSH access to that container. Maintaining an SSH server inside another application is a security nightmare especially given better alternatives exist.

@jrebey that is not related to this issue. nor did you ping the correct person to talk about this. I am merely the user who pointed out the issue. please do not talk to me about a project i do not maintain, as if i am the one who had the idea to have it there in the first place

@jrebey We're going to just remove it. A docker container dependency isn't something we want users to think about.


backport gha for 4.17

Description
This PR...

Types of changes

[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] New feature (non-breaking change which adds functionality)
[ ] Bug fix (non-breaking change which fixes an issue)
[ ] Enhancement (improves an existing feature and functionality)
[ ] Cleanup (Code refactoring and cleanup, that may add test cases)

Feature/Enhancement Scale or Bug Severity
Feature/Enhancement Scale

[ ] Major
[ ] Minor

Bug Severity

[ ] BLOCKER
[ ] Critical
[ ] Major
[ ] Minor
[ ] Trivial

Screenshots (if appropriate):
How Has This Been Tested?

With 4.18 branch and main/4.19 on the way, I'm not sure if we need it. If it's simple enough, then sure!

With 4.18 branch and main/4.19 on the way, I'm not sure if we need it. If it's simple enough, then sure!

letś abandon than, most tests fail

closing on your remarks, thanks @DaanHoogland


made a minor change to _zoomOrSpiderfy to Spiderfy without zooming

If everything in the cluster is at the same lat long. This prevents zooming into max level if there is no real reason to do so, since all points will be at the same location. This minor change increased usability in a personal project.
Thought you guys might appreciate it. This is my first pull request ever, so if I am doing this totally wrong, please let me know.

This is really helpful @rdenniston! Thanks for putting it together.


nixos-upgrade.service and nixos-rebuild-switch-configuration.service (system.autoUpgrade) hang and do not exit

Describe the bug
On all three of my flake enabled systems, which are all running almost identical configs, I frequently log into the systems in the morning and run systemctl status to see both nixos-upgrade.service and nixos-rebuild-switch-to-configuration.service hung, and there is no related log output beyond the minute or two after they started. It only seems to hang and when it actually updates an input and has to change something.
Killing the upgrade with systemctl stop nixos-upgrade.service clears the hung services, and doing a rebuild immediately after works with no issues. It's never seem to hung when an update is done manually and inputs changed with nixos-rebuild switch --recreate-lock-file --commit-lock-file --flake /etc/nixos
Steps To Reproduce
Steps to reproduce the behavior:

Set system.autoUpgrade to enabled
Wait for there to be an actual update.

Expected behavior
The system is updated fully and the services are no longer running.
Additional context
Snippet of relevant systemctl status output:
           | |─nixos-rebuild-switch-to-configuration.service
           │ │ ├─3465 /nix/store/5ydyzdwlar4ssmhfjg154dy2s2bbyhj3-perl-5.38.2/bin/perl /nix/store/y50rs1ba163w064irdd55gnf25cm4xaw-nixos-system-hyperion-24.05.20241006.ecbc1ca/bin/switch-to-configuration switch
           │ │ └─3667 /nix/store/nswmyag3qi9ars0mxw5lp8zm0wv5zxld-systemd-255.9/bin/systemctl start -- basic.target cryptsetup.target getty.target local-fs.target machines.target multi-user.target network-online.target paths.target remote-fs.target slices.target sockets.target swap.target sysinit.target timers.target zfs-import.target zfs.target
           │ ├─nixos-upgrade.service
           │ │ ├─3281 /nix/store/516kai7nl5dxr792c0nzq0jp8m4zvxpi-bash-5.2p32/bin/bash /nix/store/gr8i06n09q7p5x58vfdiq3wx1x0lpkq6-unit-script-nixos-upgrade-start/bin/nixos-upgrade-start
           │ │ ├─3418 /nix/store/516kai7nl5dxr792c0nzq0jp8m4zvxpi-bash-5.2p32/bin/bash /nix/store/sdg1fzgzwikr36p2zd36vfqmh281h1hl-nixos-rebuild/bin/nixos-rebuild switch --recreate-lock-file --commit-lock-file --flake /etc/nixos
           │ │ └─3464 systemd-run -E LOCALE_ARCHIVE -E NIXOS_INSTALL_BOOTLOADER= --collect --no-ask-password --pipe --quiet --same-dir --service-type=exec --unit=nixos-rebuild-switch-to-configuration --wait /nix/store/y50rs1ba163w064irdd55gnf25cm4xaw-nixos-system-hyperion-24.05.20241006.ecbc1ca/bin/switch-to-configuration switch

Relevant logs output:
Oct 08 05:00:04 argent systemd[1]: Started Logrotate Service.
Oct 08 05:00:04 argent systemd[1]: Starting NixOS Upgrade...
Oct 08 05:00:04 argent systemd[1]: Starting Sanoid snapshot service...
Oct 08 05:00:04 argent systemd[1]: logrotate.service: Deactivated successfully.
Oct 08 05:01:30 argent nixos-upgrade-start[10615]: [60B blob data]
Oct 08 05:01:30 argent nixos-upgrade-start[10615]: • Updated input 'nixpkgs-unstable':
Oct 08 05:01:30 argent nixos-upgrade-start[10615]:     'github:NixOS/nixpkgs/bc947f541ae55e999ffdb4013441347d83b00feb' (2024-10-04)
Oct 08 05:01:30 argent nixos-upgrade-start[10615]:   → 'github:NixOS/nixpkgs/c31898adf5a8ed202ce5bea9f347b1c6871f32d1' (2024-10-06)
Oct 08 05:01:30 argent nixos-upgrade-start[10615]: [82B blob data]
Oct 08 05:01:44 argent systemd[1]: Starting /nix/store/mr63za5vkxj0yip6wj3j9lya2frdm3zc-coreutils-9.5/bin/true...
Oct 08 05:01:44 argent systemd[1]: nixos-rebuild-switch-to-configuration.service: Deactivated successfully.
Oct 08 05:01:44 argent systemd[1]: Started /nix/store/mr63za5vkxj0yip6wj3j9lya2frdm3zc-coreutils-9.5/bin/true.
Oct 08 05:01:44 argent systemd[1]: Starting /nix/store/8rc6psklxgqqryy4ivb6k3mwf16d08b4-nixos-system-argent-24.05.20241006.ecbc1ca/bin/switch-to-configuration boot...
Oct 08 05:01:44 argent systemd[1]: Started /nix/store/8rc6psklxgqqryy4ivb6k3mwf16d08b4-nixos-system-argent-24.05.20241006.ecbc1ca/bin/switch-to-configuration boot.
Oct 08 05:01:45 argent nixos-upgrade-start[11001]: updating GRUB 2 menu...
Oct 08 05:01:45 argent nixos-upgrade-start[11085]: updating GRUB 2 menu...
Oct 08 05:01:46 argent systemd[1]: nixos-rebuild-switch-to-configuration.service: Deactivated successfully.
Oct 08 05:01:46 argent systemd[1]: nixos-rebuild-switch-to-configuration.service: Consumed 1.463s CPU time, 2.2M memory peak, 0B memory swap peak, read 56.0K from disk, written 0B to disk, no IP traffic.
Oct 08 05:01:47 argent nixos-upgrade-start[11181]: [8B blob data]
Oct 08 05:01:47 argent nixos-upgrade-start[11177]: building the system configuration...
Oct 08 05:01:49 argent systemd[1]: Starting /nix/store/mr63za5vkxj0yip6wj3j9lya2frdm3zc-coreutils-9.5/bin/true...
Oct 08 05:01:49 argent systemd[1]: Started /nix/store/mr63za5vkxj0yip6wj3j9lya2frdm3zc-coreutils-9.5/bin/true.
Oct 08 05:01:49 argent systemd[1]: nixos-rebuild-switch-to-configuration.service: Deactivated successfully.
Oct 08 05:01:49 argent systemd[1]: Starting /nix/store/8rc6psklxgqqryy4ivb6k3mwf16d08b4-nixos-system-argent-24.05.20241006.ecbc1ca/bin/switch-to-configuration switch...
Oct 08 05:01:49 argent systemd[1]: Started /nix/store/8rc6psklxgqqryy4ivb6k3mwf16d08b4-nixos-system-argent-24.05.20241006.ecbc1ca/bin/switch-to-configuration switch.
Oct 08 05:01:49 argent nixos-upgrade-start[11208]: [8B blob data]
Oct 08 05:01:49 argent nixos-upgrade-start[11229]: updating GRUB 2 menu...
Oct 08 05:01:50 argent nixos-upgrade-start[11319]: updating GRUB 2 menu...
Oct 08 05:01:51 argent nixos[11227]: switching to system configuration /nix/store/8rc6psklxgqqryy4ivb6k3mwf16d08b4-nixos-system-argent-24.05.20241006.ecbc1ca
Oct 08 05:01:51 argent systemd[1]: Stopped target Local File Systems.
Oct 08 05:01:51 argent systemd[1]: Stopped target Remote File Systems.
Oct 08 05:01:51 argent nixos-upgrade-start[11227]: activating the configuration...
Oct 08 05:01:51 argent nixos-upgrade-start[11421]: setting up /etc...
Oct 08 05:01:51 argent polkitd[3984]: Reloading rules
Oct 08 05:01:51 argent polkitd[3984]: Collecting garbage unconditionally...
Oct 08 05:01:51 argent polkitd[3984]: Loading rules from directory /etc/polkit-1/rules.d
Oct 08 05:01:51 argent polkitd[3984]: Loading rules from directory /run/current-system/sw/share/polkit-1/rules.d
Oct 08 05:01:51 argent polkitd[3984]: Finished loading, compiling and executing 3 rules
Oct 08 05:01:51 argent polkitd[3984]: Reloading rules
Oct 08 05:01:51 argent polkitd[3984]: Collecting garbage unconditionally...
Oct 08 05:01:51 argent polkitd[3984]: Loading rules from directory /etc/polkit-1/rules.d
Oct 08 05:01:51 argent polkitd[3984]: Loading rules from directory /run/current-system/sw/share/polkit-1/rules.d
Oct 08 05:01:51 argent polkitd[3984]: Finished loading, compiling and executing 3 rules
Oct 08 05:01:51 argent systemd[1]: Reloading requested from client PID 11558 ('systemctl') (unit nixos-rebuild-switch-to-configuration.service)...
Oct 08 05:01:51 argent systemd[1]: Reloading...
Oct 08 05:01:52 argent systemd[1]: /etc/systemd/system/nvidia-persistenced.service:10: PIDFile= references a path below legacy directory /var/run/, updating /var/run/nvidia-persistenced/nvidia-persistenced.pid → /run/nvidia-persistence>
Oct 08 05:01:52 argent systemd[1]: Reloading finished in 417 ms.
Oct 08 05:01:52 argent systemd[1]: Couldn't stat device /dev/tun: No such file or directory
Oct 08 05:01:52 argent nixos-upgrade-start[11227]: restarting sysinit-reactivation.target
Oct 08 05:01:52 argent systemd[1]: Starting Re-setup tmpfiles on a system that is already running....
Oct 08 05:01:52 argent systemd[1]: Finished Re-setup tmpfiles on a system that is already running..
Oct 08 05:01:52 argent systemd[1]: Reached target Reactivate sysinit units.
Oct 08 05:01:52 argent systemd[1]: Reached target Local File Systems.
Oct 08 05:01:52 argent systemd[1]: Reached target Remote File Systems.
Oct 08 05:01:52 argent systemd[1]: Starting tailscaled-set.service...
Oct 08 05:01:52 argent systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
Oct 08 05:01:52 argent systemd[1]: Starting domainname.service...
Oct 08 05:01:52 argent systemd[1]: Starting Load Kernel Module efi_pstore...
Oct 08 05:01:52 argent systemd[1]: Starting Create SUID/SGID Wrappers...
Oct 08 05:01:52 argent systemd[1]: Update Boot Loader Random Seed was skipped because no trigger condition checks were met.
Oct 08 05:01:52 argent systemd[1]: tailscaled-set.service: Deactivated successfully.
Oct 08 05:01:52 argent systemd[1]: Finished tailscaled-set.service.
Oct 08 05:01:52 argent systemd[1]: domainname.service: Deactivated successfully.
Oct 08 05:01:52 argent systemd[1]: Finished domainname.service.
Oct 08 05:01:52 argent systemd[1]<EMAIL_ADDRESS>Deactivated successfully.
Oct 08 05:01:52 argent systemd[1]: Finished Load Kernel Module efi_pstore.
Oct 08 05:01:52 argent systemd[1]: Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore).
Oct 08 05:01:52 argent systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.
Oct 08 05:01:52 argent systemd[1]: Finished Create SUID/SGID Wrappers.

Config of system.autoUpgrade
system.autoUpgrade = {
    enable = true;
    dates = "05:00";
    flake = "/etc/nixos";
    flags = [
      "--recreate-lock-file"
      "--commit-lock-file"
    ];
    allowReboot = true;
    rebootWindow = {
      lower = "05:00";
      upper = "07:30";
    };
  };

Metadata
- system: `"x86_64-linux"`
 - host os: `Linux 6.6.54, NixOS, 24.05 (Uakari), 24.05.20241006.ecbc1ca`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.18.8`
 - nixpkgs: `/nix/store/5cypwijbjdxmr4i7ckpq1in7f09547fc-source`

Add a :+1: reaction to issues you find important.

Could you see if system.swtich.enableNG = false fixes the issue? we recently replaced switch-to-configuration with a rust reimplementation and there might be bugs

Also does this usually happens during  boot?

Could you see if system.swtich.enableNG = false fixes the issue? we recently replaced switch-to-configuration with a rust reimplementation and there might be bugs

I am on 24.05 (only importing unstable for some specific packages), so system.switch.enable = false is default, but I also tried with it enabled, and it still hung with the same logs, and nearly systemctl status output:
           | |─nixos-rebuild-switch-to-configuration.service
           │ │ └─110006 /nix/store/cxi72wfnfg11g6zylrv0a5kkxm0ppvlc-nixos-system-argent-24.05.20241007.1bfbbbe/bin/switch-to-configuration switch
           │ ├─nixos-upgrade.service
           │ │ ├─109741 /nix/store/516kai7nl5dxr792c0nzq0jp8m4zvxpi-bash-5.2p32/bin/bash /nix/store/gr8i06n09q7p5x58vfdiq3wx1x0lpkq6-unit-script-nixos-upgrade-start/bin/nixos-upgrade-start
           │ │ ├─109967 /nix/store/516kai7nl5dxr792c0nzq0jp8m4zvxpi-bash-5.2p32/bin/bash /nix/store/sdg1fzgzwikr36p2zd36vfqmh281h1hl-nixos-rebuild/bin/nixos-rebuild switch --recreate-lock-file --commit-lock-file --flake /etc/nixos
           │ │ └─110005 systemd-run -E LOCALE_ARCHIVE -E NIXOS_INSTALL_BOOTLOADER= --collect --no-ask-password --pipe --quiet --same-dir --service-type=exec --unit=nixos-rebuild-switch-to-configuration --wait /nix/store/cxi72wfnfg11g6zylrv0a5kkxm0ppvlc-nixos-system-argent-24.05.20241007.1bfbbbe/bin/switch-to-configuration switch

Interestingly, with the old version I caught it's initial execution in systemctl spawning seemingly two instances of the command, which might be the issue?
           | |─nixos-upgrade.service
           │ │ ├─101737 /nix/store/516kai7nl5dxr792c0nzq0jp8m4zvxpi-bash-5.2p32/bin/bash /nix/store/gr8i06n09q7p5x58vfdiq3wx1x0lpkq6-unit-script-nixos-upgrade-start/bin/nixos-upgrade-start
           │ │ ├─101738 /nix/store/516kai7nl5dxr792c0nzq0jp8m4zvxpi-bash-5.2p32/bin/bash /nix/store/sdg1fzgzwikr36p2zd36vfqmh281h1hl-nixos-rebuild/bin/nixos-rebuild boot --recreate-lock-file --commit-lock-file --flake /etc/nixos --upgrade
           │ │ ├─102022 /nix/store/516kai7nl5dxr792c0nzq0jp8m4zvxpi-bash-5.2p32/bin/bash /nix/store/sdg1fzgzwikr36p2zd36vfqmh281h1hl-nixos-rebuild/bin/nixos-rebuild boot --recreate-lock-file --commit-lock-file --flake /etc/nixos --upgrade
           │ │ ├─102023 nix --extra-experimental-features "nix-command flakes" build "/etc/nixos#nixosConfigurations.\"argent\".config.system.build.toplevel" --recreate-lock-file --commit-lock-file --out-link /tmp/nixos-rebuild.87mkCn/result
           │ │ └─103601 nix --extra-experimental-features "nix-command flakes" build "/etc/nixos#nixosConfigurations.\"argent\".config.system.build.toplevel" --recreate-lock-file --commit-lock-file --out-link /tmp/nixos-rebuild.87mkCn/result

For reference, my nixos-upgrade.service is being generated:
# /etc/systemd/system/nixos-upgrade.service
[Unit]
After=network-online.target
Description=NixOS Upgrade
Wants=network-online.target
X-StopOnRemoval=false

[Service]
Environment="HOME=/root"
Environment="LOCALE_ARCHIVE=/nix/store/c0v6ayqhwap6g8rdzibk9qqcljff1dji-glibc-locales-2.39-52/lib/locale/locale-archive"
Environment="NIX_PATH=nixpkgs=flake:nixpkgs:/nix/var/nix/profiles/per-user/root/channels"
Environment="Environment="PATH=/nix/store/mr63za5vkxj0yip6wj3j9lya2frdm3zc-coreutils-9.5/bin:/nix/store/wqbq6prmrhgm19qqdqm3ijjbap9x74cn-gnutar-1.35/bin:/nix/store/kpabg6z89nfry6frc3p5m3zfmk94zyqn-xz-5.4.7-bin/bin:/nix/store/jpqm5igl1gmahp7lxx8j1dy874zvirgm-gzip-1.13/bin:/nix/store/qi21rq4si1x72ab1wc06h0mrp485i6r6-git-minimal-2.44.1/bin:/nix/store/x6b4rr799djkf8a2abwf59fadcbyasc1-nix-2.18.8/bin:/nix/store/1m888byzaqaig6azrrfpmjdyhg>...
Environment="TZDIR=/nix/store/b7ipdvixma2jn8xv50kl2i55pb7ccb7q-tzdata-2024a/share/zoneinfo"
X-RestartIfChanged=false
ExecStart=/nix/store/gr8i06n09q7p5x58vfdiq3wx1x0lpkq6-unit-script-nixos-upgrade-start/bin/nixos-upgrade-start
Type=oneshot

And the script:
#!/nix/store/516kai7nl5dxr792c0nzq0jp8m4zvxpi-bash-5.2p32/bin/bash
set -e
/nix/store/sdg1fzgzwikr36p2zd36vfqmh281h1hl-nixos-rebuild/bin/nixos-rebuild boot --recreate-lock-file --commit-lock-file --flake /etc/nixos --upgrade
booted="$(/nix/store/mr63za5vkxj0yip6wj3j9lya2frdm3zc-coreutils-9.5/bin/readlink /run/booted-system/{initrd,kernel,kernel-modules})"
built="$(/nix/store/mr63za5vkxj0yip6wj3j9lya2frdm3zc-coreutils-9.5/bin/readlink /nix/var/nix/profiles/system/{initrd,kernel,kernel-modules})"

current_time="$(/nix/store/mr63za5vkxj0yip6wj3j9lya2frdm3zc-coreutils-9.5/bin/date +%H:%M)"

lower="05:00"
upper="07:30"

if [[ "${lower}" < "${upper}" ]]; then
  if [[ "${current_time}" > "${lower}" ]] && \
     [[ "${current_time}" < "${upper}" ]]; then
    do_reboot="true"
  else
    do_reboot="false"
  fi
else
  # lower > upper, so we are crossing midnight (e.g. lower=23h, upper=6h)
  # we want to reboot if cur > 23h or cur < 6h
  if [[ "${current_time}" < "${upper}" ]] || \
     [[ "${current_time}" > "${lower}" ]]; then
    do_reboot="true"
  else
    do_reboot="false"
  fi
fi

if [ "${booted}" = "${built}" ]; then
  /nix/store/sdg1fzgzwikr36p2zd36vfqmh281h1hl-nixos-rebuild/bin/nixos-rebuild switch --recreate-lock-file --commit-lock-file --flake /etc/nixos
elif [ "${do_reboot}" != true ]; then
  echo "Outside of configured reboot window, skipping."

else
  /nix/store/nswmyag3qi9ars0mxw5lp8zm0wv5zxld-systemd-255.9/bin/shutdown -r +1
fi

There might be a config issue, but aside from auto upgrade, my systems are working perfect on 24.05, and I can freely rebuild and upgrade the system with the command run.

Also does this usually happens during boot?

It doesn't hang boot, but if the timer dictates autoupgrade needs to run, it can cause it to happen during boot. I will be able to log in however and see the upgrade service hung up. It more frequently happens when it runs off it's timer at 5am though.

I have my own service that checks git commit sign and then runs nixos-rebuild switch. It started hanging, too. So it just hangs on a clean nixos-rebuild call. Module can be found here.

If I restart it manually, then it exits as expected. But after boot it hangs.

Note that often "hanging" can often also just be waiting for a Type=oneshot unit being restarted.  If you are restarting a cron job that takes a few minutes to finish; nixos-rebuild switch will take a few minutes to finish.  Systemd waits synchronously for Type=oneshot,dbus,notify,notify-reload,forking units.

Note that often "hanging" can often also just be waiting for a Type=oneshot unit being restarted. If you are restarting a cron job that takes a few minutes to finish; nixos-rebuild switch will take a few minutes to finish. Systemd waits synchronously for Type=oneshot,dbus,notify,notify-reload,forking units.
I've often seen people complain it's hanging only for there to be an active job in systemctl list-jobs

Well my update service hangs for hours to be clear. Will hang for more if I don't kill it.
And it used to work just fine untill one of the flake updates.

># systemctl status autoupdate.service
● autoupdate.service - Signed system auto-update.
     Loaded: loaded (/etc/systemd/system/autoupdate.service; linked; preset: ignored)
     Active: activating (start) since Mon 2024-10-14 12:56:46 MSK; 3h 45min ago
 Invocation: 9bd116cc97e44e579cc57821633d8301
TriggeredBy: ● autoupdate.timer
   Main PID: 2274 (autoupdate-star)
         IP: 2.1G in, 44.8M out
         IO: 451M read, 86.6M written
      Tasks: 5 (limit: 18399)
     Memory: 14M (peak: 3.5G swap: 44K swap peak: 44K)
        CPU: 1min 11.433s
     CGroup: /system.slice/autoupdate.service
             ├─2274 /nix/store/izpf49b74i15pcr9708s3xdwyqs4jxwl-bash-5.2p32/bin/bash /nix/store/8daz9p2adkf851vd5wq82ainppfq52fp-unit-script-autoupdate-start/bin/autoupdate-start
             ├─2296 make switch
             ├─2300 /nix/store/516kai7nl5dxr792c0nzq0jp8m4zvxpi-bash-5.2p32/bin/bash /nix/store/sdg1fzgzwikr36p2zd36vfqmh281h1hl-nixos-rebuild/bin/nixos-rebuild switch --option eval-cache false --fallback --print-build-logs --verbose --flake .
             ├─2586 "ssh: /root/.ssh/nixbuilder@<IP_ADDRESS>:22143.socket [mux]"
             └─4501 systemd-run -E LOCALE_ARCHIVE -E NIXOS_INSTALL_BOOTLOADER= --collect --no-ask-password --pipe --quiet --same-dir --service-type=exec --unit=nixos-rebuild-switch-to-configuration --wait /nix/store/8av5wjkcli5x3d0dbpc00zw6qda4a49i-nixos-system-laptop-24.11.20241006.c31898a/bin/switch-to-configuration switch

Oct 14 12:57:41 laptop autoupdate-start[2327]: linking '/nix/store/8av5wjkcli5x3d0dbpc00zw6qda4a49i-nixos-system-laptop-24.11.20241006.c31898a/initrd' to '/nix/store/.links/0r3rrfjr157lb0v7sx200pj9fls7d0xnvawg8f1fi2mnwhk6iwbm'
Oct 14 12:57:41 laptop autoupdate-start[2327]: linking '/nix/store/8av5wjkcli5x3d0dbpc00zw6qda4a49i-nixos-system-laptop-24.11.20241006.c31898a/append-initrd-secrets' to '/nix/store/.links/1pwmzwfn2qxijka08fmys8rdpsixprg9a50padl594j27hv7dsqs'
Oct 14 12:57:41 laptop autoupdate-start[2327]: linking '/nix/store/8av5wjkcli5x3d0dbpc00zw6qda4a49i-nixos-system-laptop-24.11.20241006.c31898a/systemd' to '/nix/store/.links/104ahjvj74pq1hbvsyllwxh68x9mgd0qr9r6dfpj0mw9q68h9wrx'
Oct 14 12:57:41 laptop autoupdate-start[2327]: linking '/nix/store/8av5wjkcli5x3d0dbpc00zw6qda4a49i-nixos-system-laptop-24.11.20241006.c31898a/extra-dependencies' to '/nix/store/.links/0ip26j2h11n1kgkz36rl4akv694yz65hr72q4kv4b3lxcbi65b3p'
Oct 14 12:57:41 laptop autoupdate-start[2327]: linking '/nix/store/8av5wjkcli5x3d0dbpc00zw6qda4a49i-nixos-system-laptop-24.11.20241006.c31898a/kernel-modules' to '/nix/store/.links/1kavw6l9awd7zbb73gkjq581fh7z6rds1rd2chk3jmp3z45y0ig9'
Oct 14 12:57:41 laptop autoupdate-start[2327]: linking '/nix/store/8av5wjkcli5x3d0dbpc00zw6qda4a49i-nixos-system-laptop-24.11.20241006.c31898a/kernel' to '/nix/store/.links/1viq6adh9qcc5zqnnz65p0v0w21z42n49wka5xn7khp3s0nfkvz5'
Oct 14 12:57:41 laptop autoupdate-start[2300]: $ nix-env -p /nix/var/nix/profiles/system --set /nix/store/8av5wjkcli5x3d0dbpc00zw6qda4a49i-nixos-system-laptop-24.11.20241006.c31898a
Oct 14 12:57:41 laptop autoupdate-start[2300]: $ systemd-run -E LOCALE_ARCHIVE -E NIXOS_INSTALL_BOOTLOADER= --collect --no-ask-password --pipe --quiet --same-dir --service-type=exec --unit=nixos-rebuild-switch-to-configuration --wait true
Oct 14 12:57:41 laptop autoupdate-start[2300]: Using systemd-run to switch configuration.
Oct 14 12:57:41 laptop autoupdate-start[2300]: $ systemd-run -E LOCALE_ARCHIVE -E NIXOS_INSTALL_BOOTLOADER= --collect --no-ask-password --pipe --quiet --same-dir --service-type=exec --unit=nixos-rebuild-switch-to-configuration --wait /nix/store/8av5wjkcli5x3d0dbpc00zw6qda4a49i-nixos-system-laptop-24.11.20241006.c31898a/bin/switch-to-configuration switch

Or picture just in case.

What's noticeable tho, is that it drops memory usage from 3 GB to just 14 MB.

Could you see if system.swtich.enableNG = false fixes the issue? we recently replaced switch-to-configuration with a rust reimplementation and there might be bugs

I get the error: The option system.swtich' does not exist. Definition values:`

I think I've encountered the same issue myself. On a flake based system config, I cannot complete a test rebuild because the transitive nixos-rebuild-switch-to-configuration service does not exist, so stuff like Getty doesn't start and the system is in an unusable state.

Identical symptoms when using the AWS EC2 rebuild services. Hangs on the rebuild called at boot, but works just fine when called manually.

I've personally reverted to stable 24.05 and the issue is no longer present.

Identical symptoms when using the AWS EC2 rebuild services. Hangs on the rebuild called at boot, but works just fine when called manually.

I added a delay and it seems to work.


Support retry connection

The exception Cassandra.NoHostAvailableException will be raised if it cannot connect to any contact points.

https://github.com/ultimicro/cassandra-migrator/commit/27658537daab00ebed5a85dcb1f5cd8c74916c87


client lib v2.0.0 (the pure go version), can't re-create client

Within the same process, once a client is "Shutdown()", it is not able to create a same client again (same GroupName, NameServers, and InstanceName).
Demo code: minor modification upon official example "examples/consumer/simple/main.go":
package main

import (
        "context"
        "fmt"
        "os"
        "time"

        "github.com/apache/rocketmq-client-go/v2"
        "github.com/apache/rocketmq-client-go/v2/consumer"
        "github.com/apache/rocketmq-client-go/v2/primitive"
)

func sub(name string) {
        c, _ := rocketmq.NewPushConsumer(
                consumer.WithGroupName("testGroup"),
                consumer.WithNameServer([]string{"<IP_ADDRESS>:9876"}),
                consumer.WithInstance(name),
        )
        err := c.Subscribe("test", consumer.MessageSelector{}, func(ctx context.Context,
                msgs ...*primitive.MessageExt) (consumer.ConsumeResult, error) {
                for i := range msgs {
                        fmt.Printf("subscribe callback: %v \n", msgs[i])
                }

                return consumer.ConsumeSuccess, nil
        })
        if err != nil {
                fmt.Println(err.Error())
        }
        // Note: start after subscribe
        err = c.Start()
        if err != nil {
                fmt.Println(err.Error())
                os.Exit(-1)
        }
        // Shutdown after 10s
        time.Sleep(time.Second*10)
        err = c.Shutdown()
        if err != nil {
                fmt.Printf("shutdown Consumer error: %s", err.Error())
        }
}

func main() {
        // this will run OK
        sub("name1")
        // this will fail
        sub("name1")
}

@liye-github it would be better if you can submit an issue in this repo:https://github.com/apache/rocketmq-client-go, but RocketMQ does not support restarting the client currently.


New term: increased spongiotrophoblast cell number

If this is a request for a new term, please provide us with the following information.

Preferred term label (e.g., asplenia)

increased spongiotrophoblast cell number

Synonyms (e.g., absent spleen)

higher spongiotrophoblast cell number

Textual definition (the definition should be understandable even for non-specialists. Include a PubMed ID or URL(s) to refer to any relevant article(s) that provides information about the suggested term).

increase in the number of trophoblast cells that arise in the junctional zone of the placenta

Any additional notes to clarify the meaning or use of the term. Please provide a PubMed ID or URL(s) for the source of this information.

PMID:34982814

Suggested parent term (Please look in the hierarchy of the MP using the MP Browser or other browsers such as OLS and find the place in the MP where the new term best fits)

MP:0008959:abnormal spongiotrophoblast cell morphology
More broadly: It may be worthwhile to create matching increased-reduced (or increased-decreased) and higher-lower pairs for all terms where only one such child exists. And the same for any other binary terms that may exist.

We've been trying to pick these up as we come across them. Current policy is to add increased/decreased pairs but this wasn't always the case.
Thanks for catching this one.

Added new term:
increased spongiotrophoblast cell number MP:0031431


CI: Use packaged version of Verilator

Reduce CI times by using a packaged version of Verilator. The packaging
is done by me on Open Build Service, which provides Verilator packages
for various distributions. The packages are versioned to help choose the
exact version in CI.
This is experimental for now, let's see if that's a suitable path
forward in the longer term.

OK, going from roughly 9 min to 3:30 min CI latency sounds worth it :smile:

Think we can get this into OpenTitan CI too?

That was actually the main motivation for all of this packaging :smile:

Minor concern: it's not very good hygiene to change both the packaging and the verilator version at the same time.

Sounds great! Is it possible to host the packages on a lowRISC server?

Sorry Alex and Tom, things were overlapping.

Alex: I agree, however I didn't want to build the old version as well, and the update seemed safe. So saving myself and the builders a bit of time here for a shortcut.
Tom: We could (in various ways), but it's not giving us much other than cleaner download URLs (which would certainly be nice). We could go in various directions, e.g. hosting a own OBS instance, mirroring repositories, etc. My hope was to give that effort a try on "mini scale" for now and see how much work is involved in maintaining those packages before we announce it more widely, when questions like hosting will come up again.

Thinking about @asb's comment again, there obviously is a way to avoid combining the Verilator update and the binary change in the same PR by just getting the order of updates right. Done that for OT in https://github.com/lowRISC/opentitan/pull/2016.


add the ability to fill radio inputs from Custom Fields as randomized…

add the ability to fill radio inputs from Custom Fields as randomized list

hello @husainshabbir
actually this is my first contribution in for an open-source project 😍
the radio inputs currently cannot be selected from custom fields
so I did add the ability to select radio inputs randomly from array given by the user from the custom fields as "randomized-list" so that the user can specify which to select from

Radio's are already filled randomly based on the selectable options. What is the use case for adding support for randomized list?

when you have radio inputs where some of them are not selected usually and choosing them will change the workflow at any point, they may be selected.
or where you have a usual scenario to test and you always want one option to be selected.
in my case it's the nationality, the default option is "Saudi citizen" and if you choose "resident" the next page will be very different with fewer inputs and it's not used a lot, I want to select Saudi always and if I want to change it I will do it manually.
the PR will select randomly from the list given in custom fields if there any, not from all available options on the page.
I hope the reason is clear


fixes for Numba 0.53.0dev0

It seems like previous Numba versions (up to 0.51.2) may have worked 'by
accident'. When running pynndescent against a recent development version
of Numba. I receievd many errors during test collection of the form:
E   numba.core.errors.LoweringError: Failed in nopython mode pipeline (step: nopython mode backend)
E   Storing i64 to ptr of i32 ('dim'). FE type uint32
E
E   File "../miniconda3/envs/umap/lib/python3.7/site-packages/pynndescent/utils.py", line 88:
E   def norm(vec):
E       <source elided>
E       result = 0.0
E       dim = vec.shape[0]
E       ^
E
E   During: lowering "dim = static_getitem(value=$8load_attr.2, index=0, index_var=$const10.3, fn=<built-in function getitem>)" at /Users/vhaenel/git/numba-integration-testing/miniconda3/envs/umap/lib/python3.7/site-packages/pynndescent/utils.py (88)

Not all errors are shown immediately as pytest fails on the first
encounter, so they have to be fixed one-by-one.

Thanks for this. Part of the reason for the declarations being as they are is that I wanted the compiler to know that the values couldn't be negative since they were about to be used in range loops for indexing into arrays. I presume it figures that out itself anyway?

Steps to reproduce:
$ cd git/pynndescent
...
$ conda create -n pynndescent -c numba/label/dev numba=0.53.0dev0 python=3.8 pytest nose scikit-learn
...
$ conda activate pynndescent
...
$ python setup.py install
...
$ pytest
....

I think it would be good for someone besides me to reproduce this.

You may be able to use uint64 also, will have to try.

From what I can tell, this was fine with Numba 0.52.0 -- but it would also be good for someone else to verify this.

And I should, for the sake of completeness, mention that similar issues exist in UMAP and I do have a patch locally and plan to make a PR for that project soon.

I can reproduce it, so I think it's best to just merge this now. I can try out the uint64 and see if that works, but I suspect (hope) it makes relatively little difference.

🎉

Thank you for taking care of this, it is something that would have caused bugs down the road that I would have had a great deal of difficulty tracking down. As always you are way ahead of me :-)

So, it turns out that intp might actually  be better than int64. I was just informed of this as part of an OOB discussion.

Sounds reasonable, and would be more portable, assuming there are platforms we expect to run on that still use 32 bit pointers. I'll take a looks when I get a chance. That seems less urgent for now.

I made a followup for this at: #114 -- also, I think it would be good to get new versions for pynndescent and umap out in time for the Numba 0.53.0 final release, if there is time.

Thanks. I'll try to get releases out today; hopefully that will head off any issues.

@lmcinnes wonderful, looks like the Numba integration tests are all green against the latest UMAP release:
================= 149 passed, 87 warnings in 819.32s (0:13:39) =================
::>> running: 'conda list -n umap'
# packages in environment at /home/circleci/repo/miniconda3/envs/umap:
#
# Name                    Version                   Build  Channel
llvmlite                  0.36.0rc1        py38hf484d3e_0    numba/label/dev
numba                     0.53.0rc1       np1.11py3.8h04863e7_ga3d29a7f4_0    numba/label/dev
umap-learn                0.5.1                     dev_0    <develop>
::>> All integration tests successful


Adding PivotTables to the ToC

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/excel/excel-add-ins-pivottables.md
:white_check_mark:Succeeded

docs/toc.yml
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


I've got a question / request...

How could I make my node-steam "bot" be for raffling in a specific group?
Like it'd go through a list of an array of items it can give in the raffle... And in the group chat people would state "!joinraffle" and it'd put them in a randomized selection of users?
I'd like to make this bot for csgo raffling...

Sorry but this is not a place to ask for generic help.

Were should I place this question then?

You might want to try Reddit. /r/devsteam and /r/steamdevelopment seem the most relevant, but there might be a subreddit for node-steam.

There is a new subreddit for Node-Steam and it's probably where questions like this should go.
http://www.reddit.com/r/nodesteam/


chore: add kind column by default to TechDocsTable

Hey, I just made a Pull Request!
Adds kind column by default to TechDocsTable. Having only type makes it a bit useless.
:heavy_check_mark: Checklist

[x] A changeset describing the change and affected packages. (more info)
[ ] Added or updated documentation
[ ] Tests for new functionality and regression tests for bug fixes
[ ] Screenshots attached (for UI changes)
[x] All your commits have a Signed-off-by line in the message. (more info)

Well, just because not all entities that have TechDocs are necessary components. We use TechDocs also for systems and templates. And now it's just impossible to identify the docs context.

Closing because the pipeline build checks seem to be stuck and are blocking merge. I'm unable to trigger a rebuild on the stuck checks from  this PR, so going to close and then re-open in order to merge it.


Configure Azure Pipelines

This pipeline configuration builds the application and produces a build for the Release configuration.

ok

ok

ok

ok


Unable to create a new asset using the New Asset toolbar button in the Finder

Describe the bug
This behavior seems to be introduced in 8.1.3, worked fine in 8.1.2  In the Finder when you select an Asset folder and New Asset from the Toolbar the screen is refresh but the new Asset Dialog is never displayed preventing you from creating a new shared asset.

@ramdev1980  Did this behavior change after the rollback we did with PR #987 ?

@natechadwick  yes, backing out the pull request, solve the problem. So I am closing this issue.


[Bug Report] Unit tests fail on machine with GPU

Describe the bug
Unit tests are failing when run on a machine with a GPU, because to_tokens parameter move_to_device defaults to True, but the expected tokens are kept on the CPU.
Code example
git clone https://github.com/neelnanda-io/TransformerLens.git
cd TransformerLens
curl -sSL https://install.python-poetry.org | python3 -
PATH="/root/.local/bin:$PATH"
poetry run pytest tests/unit/test_tokenization_methods.py

Output:
====================================== short test summary info =======================================
FAILED tests/unit/test_tokenization_methods.py::test_to_tokens_default - RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda...
FAILED tests/unit/test_tokenization_methods.py::test_to_tokens_without_bos - RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda...
FAILED tests/unit/test_tokenization_methods.py::test_to_tokens_device - RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu ...
FAILED tests/unit/test_tokenization_methods.py::test_get_token_position_not_found - RuntimeError: indices should be either on cpu or on the same device as the indexed tensor (cpu)
FAILED tests/unit/test_tokenization_methods.py::test_get_token_position_str - RuntimeError: indices should be either on cpu or on the same device as the indexed tensor (cpu)
FAILED tests/unit/test_tokenization_methods.py::test_get_token_position_str_without_bos - RuntimeError: indices should be either on cpu or on the same device as the indexed tensor (cpu)
==================================== 6 failed, 13 passed in 5.34s ====================================

System Info

I ran this on a lambda labs instance with an A10
Should be possible to repro on any linux instance with a GPU
Python 3.8.10

Checklist

[x] I have checked that there is no similar issue in the repo (required)

I think this is evidence that when I accept PR's I just need to be using a gpu machine and re-running locally from now on. Thanks for raising this.


Add a DB to store the Worlds metadata

This will improve the way we query information for the about and the caches as well as enable the development of new features on top of the World content server.

Done


unable to train and run

Hi!
Just builded my Jetracer (latrax 1:18 -> youtube video )
I created a setup track:

After following instructions:

basic motion works correctly;
interactive regression gives me always right-bottom blue point during "evaluation";
road following: car always go right.

I always tried with a simple path:

And car goes right.
Installed camera is: IMX219 with wide angle.
How do I choice correctly points?  Which is correct sequence (create images -> train button -> evaluate -> save)?
Is my track correct or are necessary other stuffs such as central line and uniform colours?
Thank you in advance!

Hi gbr1,
Thanks for reaching out and sharing your video!  Very well done!
The track you created looks good to me, should certainly be able to work on that.  Hopefully we can get you up and running soon.
Could you provide the following information

How many data samples did you collect / how was car placed?  (data variance is very important)
How many epochs did you train for?  (it usually takes many, I'd guess at least 15+ to converge)

Best,
John

Hi @jaybdub!
I took about 200 photos and 3 epochs maybe that was the problem.
Then I moved on donkeycar software so I didn't try more.
Thank you.

Hi, John:
I took >200 photos but epoch always = 0 and car always do circle, not steering straight.
Could you give me a correct training sequence (live -> train button -> click left image -> count# inceasing -> evaluate -> save model)?
How to set another epoch or find out which point need more training/images?
Thanks

Hi RyanC1681,
The work flow is generally to

Collect images
Train for several epochs until loss converges
Run live to visualization how well the network is performing
Repeat 1->3 until you are happy with the performance, at this point save the model

Please let me know if this helps.
Best,
John

Hi jaybdub,
I know this is a bit old, but perhaps you could help me out with my current situation if you have time.
I can get to the point where I'm consistently training a model that performs well after 100+ images and 15 or so epochs. It tracks movements around the track with a high degree of accuracy.
I essentially do exactly the work flow you described above: collect images, train for several epochs, and run it live to make sure the model is performing well. Rinse and repeat, then save the model when I'm satisfied.
However, when I attempt to run it with the Road Following notebook, it just turns in a continuous circle to the right. It does seem to adjust the degree of turning at times, which indicates that some commands seem to be going through.
Do you have any idea why this may be happening, considering the perceived accurate performance running the Interactive Regression notebook?
Thanks!


Merge more efficient propagator

Current coverage is 82.01%

Merging #80 into strange-fix will increase coverage by +2.11% as of 56dcdfc

@@            strange-fix     #80   diff @@
===========================================
  Files                 6       6
  Stmts               836     784    -52
  Branches              0       0
  Methods               0       0
===========================================
- Hit                 668     643    -25
  Partial               0       0
+ Missed              168     141    -27

Review entire Coverage Diff as of 56dcdfc

Powered by Codecov. Updated on successful CI builds.


[Help] Open window info on click example needed

Hello !
I've been at it for hours and my brain is going to melt. Would it be possible to get an example on how to open/close info window based on the click on the marker ?
I tried setting the opened attribute to true/false through $refs.markerRef.$infoWindowObject.opened but the method openInfoWindow is not triggered.
I cannot add a value to the marker's data though, which seemed to be the obvious solution.
Thanks for any help :)

Well, it is quite simple.
You can simply modify the :opened prop using click event on the marker.
I updated docs and added an example here:
https://vue-map.netlify.app/components/info-window.html#open-close-info-window-on-marker-click

Amazing :) I must have been tired to not think about this...
Thanks as well for the clear example !


Unable to update human_user

Initial state
User does not exist.
Approach
Terraform main.tf:
resource zitadel_org zitadel {
  name = "ZITADEL"
}

resource zitadel_human_user dmg_admin {
  depends_on = [zitadel_org.zitadel]

  org_id             = zitadel_org.zitadel.id
  user_name          = "foobar-admin"
  first_name         = "Foo"
  last_name          = "Bar"
  email              =<EMAIL_ADDRESS>  is_email_verified  = "true"
  initial_password   = "Test_1234"
}

Terraform plan and apply for creating the user.
$ terraform apply
zitadel_org.zitadel: Refreshing state... [id=176640833305486796]

Terraform used the selected providers to generate the following execution plan. Resource actions are indicated with the following
symbols:
  + create

Terraform will perform the following actions:

  # zitadel_human_user.dmg_admin will be created
  + resource "zitadel_human_user" "dmg_admin" {
      + email                =<EMAIL_ADDRESS>      + first_name           = "Foo"
      + id                   = (known after apply)
      + initial_password     = "Test_1234"
      + is_email_verified    = true
      + last_name            = "Bar"
      + login_names          = (known after apply)
      + org_id               = "176640833305486796"
      + preferred_login_name = (known after apply)
      + state                = (known after apply)
      + user_name            = "foobar-admin"
    }

Plan: 1 to add, 0 to change, 0 to destroy.

Do you want to perform these actions?
  Terraform will perform the actions described above.
  Only 'yes' will be accepted to approve.

  Enter a value: yes

zitadel_human_user.dmg_admin: Creating...
zitadel_human_user.dmg_admin: Creation complete after 2s [id=176749781777909810]

Apply complete! Resources: 1 added, 0 changed, 0 destroyed.

User was created.
Afterwards the user object was not adjusted in the main.tf file and terraform applied again. The apply fails.
$ terraform apply
zitadel_org.zitadel: Refreshing state... [id=176640833305486796]
zitadel_human_user.dmg_admin: Refreshing state... [id=176749781777909810]

Terraform used the selected providers to generate the following execution plan. Resource actions are indicated with the following
symbols:
  ~ update in-place

Terraform will perform the following actions:

  # zitadel_human_user.dmg_admin will be updated in-place
  ~ resource "zitadel_human_user" "dmg_admin" {
      - display_name         = "Foo Bar" -> null
      - gender               = "GENDER_UNSPECIFIED" -> null
        id                   = "176749781777909810"
      ~ is_email_verified    = false -> true
      - preferred_language   = "und" -> null
        # (10 unchanged attributes hidden)
    }

Plan: 0 to add, 1 to change, 0 to destroy.

Do you want to perform these actions?
  Terraform will perform the actions described above.
  Only 'yes' will be accepted to approve.

  Enter a value: yes

zitadel_human_user.dmg_admin: Modifying... [id=176749781777909810]
2022-08-30T10:11:30.788+0200 [ERROR] vertex "zitadel_human_user.dmg_admin" error: failed to update human profile: rpc error: code = InvalidArgument desc = invalid UpdateHumanProfileRequest.DisplayName: value length must be between 1 and 200 runes, inclusive
╷
│ Error: failed to update human profile: rpc error: code = InvalidArgument desc = invalid UpdateHumanProfileRequest.DisplayName: value length must be between 1 and 200 runes, inclusive
│
│   with zitadel_human_user.dmg_admin,
│   on main.tf line 13, in resource "zitadel_human_user" "dmg_admin":
│   13: resource zitadel_human_user dmg_admin {

Expected behaviour
Terraform apply succeeds and the user is not updated because nothing changed in the terraform plan.

Fixed after upgrade to 1.0.0-alpha.7 😃


Automatic commit: Move 'iot-locations-geofence', 'iot-locations-geoma…

…tch' from QA to Production
Updated with final changes from review comments

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

A quick glance shows the formatting not quite correct (e.g., title casing not correct, no period after description, ordered lists are bulleted, multiple steps shown bunched into a single step) and in general the flow is not made simple for users. Please set up a meeting with me to review.


Update installation instructions

Work in progress.

This is coupled to https://github.com/coderefinery/coderefinery.org/pull/283.

great work, i approve. i can clarify that point on Anaconda Prompt in a follow-up PR

Thanks! I will send a patch to add your suggested sentence (you can also suggest changes directly in the review which I can commit via button) while also adjusting the text on Read the Docs account, later today.

I am merging since the chance increases by the day that participants already start to install software.


Circle CI: Ignore gh-pages branch for building.

Fixes Circle CI build errors in gh-pages
Describe the changes you have made in this PR -
Added a branch filter for the job build which will ignore gh-pages branch
Screenshots of the changes (If any) -

Thanks!


How to choose the other Table format in excel

Hi team,
I need to generate an excel sheet using Table style Light 9 format in excel. But in the class you have created it has only Table style Light 1-5. Would request you to kindly assist me on how to choose the style 9.
Attached screenshot for your reference.
Thanks & Regards,
Sanjay D

Have you tried to pass a string TableStyleLight9 instead of the constant?
Ivan

On Jun 2, 2016, at 2:30 AM, sanjayabap<EMAIL_ADDRESS>wrote:
D

I did a test as Ivan proposed, and it worked for me. I copied the program ZDEMO_EXCEL10 and I changed this line:
*ls_table_settings-table_style  = zcl_excel_table=>builtinstyle_medium5.
ls_table_settings-table_style  = 'TableStyleLight13'.

If it solves your question, could you close the question? Thanks.

No answer. Closing.


Possible FileUpload bug

I'm try to using file upload from this commit
https://github.com/aspnet/Mvc/commit/437eb93bdec0d9238d672711ebd7bd3097b6537d
Microsoft.AspNet.Mvc.ModelBinding have 6.0.0-beta3-12431 version.
View:

        File Upload:

        <form action="~/Storage/UploadFile" method="post" enctype="multipart/form-data">
            <input type="file" name="files" id="file1" />
            <input type="file" name="files" id="file2" />
            <input type="submit" value="submit" />
        </form>

Controller:
    public class StorageController : Controller
    {
        public IActionResult UploadFile(IEnumerable<IFormFile> files)
        {
             ...
             return View("SuccessUploaded");
        }
    }

Seems to files is always 0 count. But Request.Form.Files contain two files.
ContentDispositionHeaderValue.Parse(f.ContentDisposition).FileName
surrounded with quotes and have Encoding iso-8859-1. This makes it difficult to use with non Western European languages.

FYI @ajaybhargavb

We are going to fix the quotes issue for Beta3. And followup with a bug in Http Abstraction for the aspnet/HttpAbstractions#175

Checked in - 67b078862ee36a846af1b81088e3f2f73f5de3e2


merge package template from Kronos-Tools/npm-package-template-minimal

package.json

chore(scripts): update semantic-release@semantic-release from template
chore(devDependencies): update<EMAIL_ADDRESS>from template
chore(devDependencies): update<EMAIL_ADDRESS>from template
chore(engines): update<EMAIL_ADDRESS>from template

.travis.yml

chore(travis): merge from template .travis.yml

.npmignore

chore(npm): update .npmignore from template

Coverage decreased (-25.0%) to 75.0% when pulling 288b33ba180f8e98a817044e31d482fc84ee1936 on template-sync-2 into 1efae69ba153f1a7d0d1b0d24eaf6ce39bc6600d on master.


Fix issue-30

Fix Issue: #30
Only user variable is enough, adding group variable will create issues.
Linux creates both user and group during an user creation, and we can use the same user and group for running an application. If we provide another separate variable for group then someone may use two different values for user and group that requires another group creation and further group management which is unnecessary and tedious process.

/review @peterzhuamazon


question about pre training　and  feat model

Hello, thank you for your thoughtful paper and open code. I have gained a lot after reading it, but I have some questions to ask you
　　First, about pre training, if I don't load the pre training model, the accuracy of res12 and convnet used by feat in the backbone network is 47% and 59% respectively, which is far lower than 80% of RESNET loaded with the pre training model. I  understand that pre training can speed up the training speed, but why it can greatly improve the accuracy. Then I see that there is a pretrain.py  in the project , so can I use my own data to train the model？

In the code here, the training set does not follow the small sample k-ways-n-shot method, but sends all data into the training in batches. Just like the ordinary CNN training, why not follow the feat training method？What should I pay attention to when I train with my own data set？
　　Second, as for the feat model, I carefully read the code and found that instead of using transformer completely, simply used multiheadattention to input the proto to generate a new proto. I can simply understand that using self-attention strengthens the correlation between prototypes.and about loss fucntion？

Here you use the prototype loss function + regularization function. I looked at the regularization function. It uses all the data of the support set and query set to average the prototype, and then calculates the Euclidean distance with these data sets. Is this loss function obviously helpful to improve the accuracy of the model, or may it not be obvious?Thank you for your reply

@Han-Jia

Hi,
The pre-training stages works the same as the standard classification task over all meta-training classes. You can replace the dataloader in the pretrain.py file to use your own dataset. To select the best model, I follow the few-shot learning setting with episodes of few-shot tasks (on meta-val classes).
Optimizing the meta-model directly could not get as good preformance as the pre-training. Please see this paper for more discussions.
The self-attention works as the a transformation. It indeed strengthens the correlation between prototypes due to the query-key-value architecture. The influence of the regularization could be found in the ablation study in our paper.


Academy fixes

What does this PR do?
Fixes issues mentioned in https://github.com/buidl-labs/crypto-code-school-inside-tezos/issues/162
Problems left to tackle

[ ] Need to re-write FA2 module to include metadata.
[x] Need to add another chapter to Taquito module to teach char2Bytes.
[x] Need to make chapter-7 in taquito module better.
[ ] Tiny layout fixes for taquito module.

@manangouhari  Can you abstract out all the variables that you changed from carthagenet to Delphi so that it can be updated by changing a single variable since it's going to break every 3 months due to tezos ever evolving protocol updates. This way it would be easier to update it in case module 4 code runner breaks in the future.


Cloud Provider Azure : add check on mandatory fields

kind : enhancement
Steps to reproduce :

Add a cluster on Azure IaaS and select "cloud Provider" Azure
Confirm the creation without fill in mandatory fields

Result:
Rancher UI don't display any warning, but the Cluster provisioning stuck in "provisioning"
Environment information

Rancher version : v2.1.1

request
Add check on  mandatory fields

subscription_id
tenant_id
aad_client_id
aad_client_secret

Note: blocked by #16893 and #16887 (not able to fully test and validate all is working correctly because cannot successfully fully provision azure cloud)

We are able to provision Azure / custom RKE with azure cloud option now.
Version: master 2.2 (12/10/18)
Confirmed fixed. Verified that the form is validated by checking each of the required fields. Tested with both Azure RKE and custom RKE with azure cloud option. This worked in both cases. Confirmed I could stand up a cluster for each. Halo tested.


Persona and empathy map

Description
this is a persona and an empathy map for our community
Empathy map and persona.pdf
Screenshots
No response
Additional information
The use of personas and empathy maps are popular techniques in user experience (UX) design, marketing, product development, and beyond. Both tools aim to deepen the understanding of user needs, preferences, and behaviors, helping teams create more user-centered products and services.
Code of Conduct

[X] I agree to follow this project's Code of Conduct

@kabir0x23 ?

@ZizouX0 Could you give some more info about this? What do you want to do with it?

@ZizouX0 ok, I understand the general benefits of it. What is the road map / next actual steps that we require to implement to make the whole ux better?

@ZizouX0 🤔

@kabir0x23 what do you think?

@ZizouX0 Thank you for the suggestion, after a consideration, we don't think it is suitable for this time so we close this issue.


EXT: add disableEdit and Delete flag

Description
Changes proposed in this pull request:

...
...
...

Related issue(s)
Closes #1670

/test pre-busola-smoke-test-docker

/test pre-busola-integration-test-k3s-cluster

/test pre-busola-integration-test-k3s-namespace

/test pre-busola-integration-test-k3s-cluster


[BUG] PowerPoint: Cannot Play Media

Description
After playing a few slides correctly, it looks like some media starts to bug / glitch / or just do not play.
One example is my EuCAP 2024 slides. Here, it starts to glitch on slide 30 (see screenshot below).
If you hide the slides before slide 30, or just start presenting on slide 30, the next slides display correctly. The bug does not seem to be caused by the use of PyAV or notes (relevant changes from since year), but rather because it seems to load all slides into memory, and it somehow takes too much space (?) at some point.
Slides with issue: https://github.com/jeertmans/jeertmans.github.io/blob/677c519d1867fa87720eee25821692465a3ba47c/assets/slides/2024-03-18-eucap-presentation.pptx
Lowered quality from full HD to HD, and this seems to have fixed the slides: https://github.com/jeertmans/jeertmans.github.io/blob/3fe208cbed7a44974a077423931cc37948f9fbe6/assets/slides/2024-03-18-eucap-presentation.pptx
This fix is not very nice because:

I don't know if it works every time (e.g., on very large presentations I might need to lower the quality even more);
Lowering the quality is not super nice.

Version
v5.1.3
Platform
Windows
Screenshots

Additional information
No response

I have reported this issue to Microsoft: https://answers.microsoft.com/en-us/msoffice/forum/all/powerpoint-too-many-media-cause-a-cannot-play/36a06d53-c564-4735-902f-53d333d7f73f.

I encountered a similar issue when changing the device from having 16 GB of RAM to 8 GB. It didn't freeze but skips some animations and refuses to show others.

Hi, I had the issue on several computer and disabling Power Point Hardware/GPU accelaration in presentation mode (as advised here  ) did solve the issue.
Also, I never had the issue on my personal laptop but it does not have a GPU.

This also fixes the issue for me, thanks. This fix could be mentioned in the Readme file, but it certainly not ideal because when the presenters delivers the presentation on a different laptop (e.g. at a conference as I had), he/she should be remember to turn this setting on before the presentation and off afterwards.

Hi, I had the issue on several computer and disabling Power Point Hardware/GPU accelaration in presentation mode (as advised here  ) did solve the issue.
Also, I never had the issue on my personal laptop but it does not have a GPU.

Good to know, thanks @Azercoco! Is it a real fix, or does it just postpone the issue to even larger presentations, as we usually have more standard RAM available than on GPUs?
Also, when I did my tests, it appeared it was my usual RAM that was getting filled, not the one from my GPU.
The best would be to test your suggested fix on a very large number of media, and see if it still holds.
Anyway, I think it is worth being documented somewhere in Manim Slides’ docs!

Good to know, thanks @Azercoco! Is it a real fix, or does it just postpone the issue to even larger presentations, as we usually have more standard RAM available than on GPUs?

I don't really know. My presentation worked fine for a total of 4 min of animation in full HD on 16GB of RAM.

So I have tested locally, with the below script, and while it seems that PowerPoint keeps using more and more RAM, at least it does not break when it reaches the limit of available RAM, and still manages to play the animations correctly. I could both play all slides in HD and 4K on my computer. The 4K presentation eats all my RAM, but still plays fine.
#475 added some notes about this in the FAQ.
import random

from manim import *

from manim_slides import Slide

class Test(Slide):
    def construct(self):
        circle = Dot(radius=1, color=BLUE)
        slide_number = Integer(0, mob_class=Text).to_corner(DL)
        self.add(circle)
        self.add(slide_number)

        random.seed(1234)

        for i in range(100):
            self.next_slide()
            radius = random.random() + 0.5
            scale = radius / circle.radius
            color = ManimColor.from_rgb(
                (random.random(), random.random(), random.random())
            )
            slide_number.set_value(i + 1)
            self.play(circle.animate.scale(scale).set_color(color))


linking spyder installed with pip to pyqt installed with homebrew on macOSX 10.6.8

From<EMAIL_ADDRESS>on 2014-04-05T20:34:58Z
Please note that reporting bugs from Spyder's help menu ("?" > "Report
issue...") will fill version details for Spyder, Python and Qt in this description for you.
What steps will reproduce the problem?

install spyder using $pip install spyder
install pyqt using $brew install pyqt
and launch spyder from the terminal by typing $spyder What is the expected output? What do you see instead? I should have installed spyder as well as pyqt, but spyder stop launching asking me to install PyQt4, which has been done through homebrew What version of the product are you using? On what operating system? latest update of pyqt and spyder installed on a MacOSX 10.6.8

Please provide any additional information below
. So I can't figure how to "tell" the spyder installed with pip to refer to the pyqt installed with homebrew to launch.
Thanks
Original issue: http://code.google.com/p/spyderlib/issues/detail?id=1781

From<EMAIL_ADDRESS>on 2014-04-05T18:50:44Z
Solved the problem by installing PyQT from source following recommendations by: http://www.noktec.be/python/how-to-install-pyqt4-on-osx sorry for buggin, but hopefully it might help someone

From ccordoba12 on 2014-04-16T09:34:36Z
Really glad you solve it by yourself!
Status: Invalid


[SPARK-6383][SQL]Fixed compiler and errors in Dataframe examples

Can one of the admins verify this patch?

Thanks. This is great. Going to merge it.


harvester machine driver: bump to v0.7.0

Bump Harvester machine driver to version v0.7.0. This version contains a hook, giving Rancher the ability to update the cloud credentials, used by the Harvester machine driver, for existing downstream clusters.
Issue:
related-to: harvester/harvester#6645
related-to: rancher/rancher#44912
related-to: rancher/dashboard#11270
Problem
When rotating cloud credentials for a Harvester cluster (e.g. as instructed by https://harvesterhci.io/kb/renew_harvester_cloud_credentials/), the new credentials aren't correctly loaded for existing downstream clusters into the Harvester machine driver. The fix for that is the implementation of the UnmarshalJSON hook (https://github.com/harvester/docker-machine-driver-harvester/pull/61) in the Harvester machine driver.
Solution
To include this fix in Rancher, a new release of the Harvester machine driver has been made (https://github.com/harvester/docker-machine-driver-harvester/releases/tag/v0.7.0), which should be included in the Rancher container image and the references in the code should be updated for the new version.
Testing

Confirm that the Harvester node driver shows up in Version v0.7.0
Install a Harvester cluster and import into Rancher for virtualization management
Create new cloud credentials
Create a downstream cluster using the Harvester node driver
Rotate cloud credentials as explained in https://harvesterhci.io/kb/renew_harvester_cloud_credentials/
Scale down / delete the downstream cluster. This should complete without errors.

Engineering Testing
Manual Testing

Automated Testing

Test types added/modified:

None

If "None" - Reason: EXPLAIN THE REASON
Non-exhaustive list of reasons:

Lack of the framework capable of testing this fix/change
Other (explain): Version bump of dependency

If "None" - GH Issue/PR: LINK TO GH ISSUE/PR TO ADD TESTS

Summary: TODO
QA Testing Considerations

Regressions Considerations

Existing / newly added automated tests that provide evidence there are no regressions:

TODO

I think the CI failure is unrelated to this change:

=== RUN   TestClusterRepoTestSuite/TestGitRepoRetries
    cluster_repo_test.go:942:
        	Error Trace:	/home/runner/_work/rancher/rancher/tests/v2/integration/catalogv2/cluster_repo_test.go:942
        	            				/home/runner/_work/rancher/rancher/tests/v2/integration/catalogv2/cluster_repo_test.go:147
        	Error:      	Received unexpected error:
        	            	timed out waiting for the condition
        	Test:       	TestClusterRepoTestSuite/TestGitRepoRetries
--- FAIL: TestClusterRepoTestSuite (612.36s)
    --- PASS: TestClusterRepoTestSuite/TestGitRepo (9.04s)
    --- FAIL: TestClusterRepoTestSuite/TestGitRepoRetries (600.01s)
FAIL
FAIL	github.com/rancher/rancher/tests/v2/integration/catalogv2	704.074s
=== RUN   TestProjectUserTestSuite
=== RUN   TestProjectUserTestSuite/TestCreateNamespaceProjectMember
time="2024-10-09T12:47:45Z" level=error msg="failed to cleanup resource. Backoff error: timed out waiting for the condition. Cleanup error: Resource type [namespace] can not be deleted"
=== RUN   TestProjectUserTestSuite/TestCreateNamespaceProjectOwner
time="2024-10-09T12:48:04Z" level=error msg="failed to cleanup resource. Backoff error: timed out waiting for the condition. Cleanup error: Resource type [namespace] can not be deleted"

@gaktive can you confirm?

I noticed that https://github.com/rancher/rancher/pull/46089 has been merged already, but it's only been merged on the release/v2.9 branch. To fix that, I cherry-picked the commit and fixed it up, so now it's included in this PR.
The purpose of PR#46089 was to add ARM64 support for the Harvester node driver.


Responses with multiple representations are not handled properly

Responses with multiple representations, for example the BankID Polling step which contains the BankID autostart URI and a QR code are not triggering the ClientOperationStep. Instead they are used as HaapiRepresentations.
The problem can be identified in the switch in line 101 of FlowActivity.kt

BankID has been fixed for same device


Prohibit conflicting 'fields' and 'include' params

I don't understand most of what goes on in PR #548, so I decided to offer this alternative that addresses the core issue in two sentences.

@bintoro, I agree that #548 stretched the original scope of the issue and became too clumsy -- my apologies to tired readers! Your alternative provides exactly what is required.

I appreciate the simplification, but still have concerns about how appropriate this is for heterogeneous collections (as expressed in an earlier comment). There are going to be cases where one type in a collection has a specific relationship and another type in the same collection does not. In those cases, this seems unnecessarily strict.

Closing in favor of #666


GCM is a bit more general than just AGCM

The header Run the GCM needs to reflect the fact that gcm_setup sets up not only AGCM

Question: Can you actually run the OGCM in what's in GEOSadas-5_27_1_p3? I know we can in the GEOSgcm for sure, but does it work in the ADAS tag?

Question: Can you actually run the OGCM in what's in GEOSadas-5_27_1_p3? I know we can in the GEOSgcm for sure, but does it work in the ADAS tag?

@mathomp4 I would have to clone, build and check. Will try sometime ... and report here.

Santha: can you change this so that the PR is to merge onto develop instead of main?
The workflow I want for the DAS is user -> develop -> main
The Edit button next to the PR title allows you to redirect the request (I learned it from Matt)

I suggest we simply close this ticket

BTW: the change is still sitting in my work dir since I have another change and have not committed things yet - but I will.

I suggest we simply close this ticket

@rtodling,
I have no problem closing the draft PR.
However, I did follow up on above promise:

cloned: git clone git@github.com:GEOS-ESM/GEOSadas.git
build: ./parallel_build.csh -tmpdir /tmp the -tmpdir /tmp is because of some intel bug that @mathomp4 told me! He would know better.
set up a coupled model exp from scratch: with gcm_setup but clearly did not work since my experiment directory only has:

GEOSgcm.x*
RC/
sedfile
SETENV.commands

Which leads me to ask:

What would you want to do? Fix gcm_setup which probably would get fixed as adas components.yaml gets caught up with gcm components.yaml https://github.com/GEOS-ESM/GEOSadas/issues/53#issuecomment-786826446 ?
Set up a coupled model exp from gcm_forecast.setup?

Either way, we must check GCM = AGCM or AOGCM?

For what its worth, following is the STDOUT from gcm_setup:
discover15.sakella 179> gcm_setup

Enter the Experiment ID:
test_MM
Enter a 1-line Experiment Description:
test_mom5_adas
Do you wish to CLONE an old experiment? (Default: NO or FALSE)

Enter the Atmospheric Horizontal Resolution code:
-----------------------------------------------------------
     Lat/Lon                     Cubed-Sphere
-----------------------------------------------------------
   b --  2  deg                c48  --  2   deg
   c --  1  deg                c90  --  1   deg
   d -- 1/2 deg                c180 -- 1/2  deg (56-km)
   e -- 1/4 deg (35-km)        c360 -- 1/4  deg (28-km)
   c720 -- 1/8  deg (14-km)
   c1440 - 1/16 deg ( 7-km)
             DYAMOND Grids
   c768 -- 1/8  deg (12-km)
   c1536 - 1/16 deg ( 6-km)
   c3072 - 1/32 deg ( 3-km)

c90
Enter the Atmospheric Model Vertical Resolution: LM (Default: 72)

Do you wish to run the COUPLED Ocean/Sea-Ice Model? (Default: NO or FALSE)
YES

Enter the Ocean Lat/Lon Horizontal Resolution: IM JM (Default: 360 200)

Enter the Ocean Model Vertical Resolution: LM (Default: 50)

Enter the choice of  Land Surface Boundary Conditions using: 1 (Default: Icarus), 2 (Latest Icarus-NL)

Do you wish to run  the Runoff Routing Model? (Default: NO or FALSE)

Do you wish to run GOCART with Actual or Climatological Aerosols? (Enter: A (Default) or C)

Enter the GOCART Emission Files to use: MERRA2 (Default), PIESA, CMIP, NR, MERRA2-DD or OPS:

Enter the directory (/filename) of the HISTORY.AGCM.rc.tmpl to use
(To use HISTORY.AGCM.rc.tmpl from current build, Type:  Current         )
-------------------------------------------------------------------------
Hit ENTER to use Default Location: (HISTORY.AOGCM.rc.tmpl)

Enter Desired Location for the HOME Directory (to contain scripts and RC files)
Hit ENTER to use Default Location:
----------------------------------
Default:  /discover/nobackup/sakella/test_MM

Enter Desired Location for the EXPERIMENT Directory (to contain model output and restart files)
Hit ENTER to use Default Location:
----------------------------------
Default:  /discover/nobackup/sakella/test_MM

Enter Location for Build directory containing:  bin/ etc/ include/ etc...
Hit ENTER to use Default Location:
----------------------------------
Default:  /gpfsm/dnb32/sakella/geosDas/develop_04Mar2021/GEOSadas/install

Current GROUPS: g0613 s0818 s2313 soca gmaoint advda m2val
Enter your GROUP ID for Current EXP: (Default: advda)
-----------------------------------

sending incremental file list
GEOSgcm.x

sent 210,883,578 bytes  received 35 bytes  60,252,460.86 bytes/sec
total size is 210,832,000  speedup is 1.00
OCEAN_NAME: Undefined variable.

So it died for OCEAN_NAME which is either MOM (=MOM5 by default) or MOM6 which was added to gcm_setup in some version of GEOSgcm. Probably this version of ADAS does not use it (yet). That's my guess. @mathomp4 would you agree?

Fixed in develop.


expire usage bug (invalid defaults)

when testing nipap for a massive import/conversion of our current IPAM I ran into the following issue using nipap-www.  When the expire field is missing it's default is None is is then represented as str(self.expire).  This makes the default value in the webform invalid. related commit
In a related matter clearing the expires field sets the expire date to midnight.  It appears that setting the expires = None using pynipap doesn't quite have the desired results, which is always setting the expired attribute even when you don't want it to expire.

Can't read code now because I'm on a phone, so this is from the top of my head.
In the database we represent the case of no expiration date as positive infinity, since postgres timestamps can handle that. Unfortunately this cannot be represented over XML-RPC so instead we have null to signify that.
I know this was a little bit tricky with pynipap so I'm not very surprised if there is a bug in there. I'll have a look to see if we can weed this out.

This causes the web interface to produce the following XML:
<methodCall>
<methodName>edit_prefix</methodName>
<params>
[...]
<member>
<name>attr</name>
<value><struct>
[...]
<member>
<name>expires</name>
<value><string>None</string></value>
</member>
[...]

This in turn appears to be interpreted by the backend as "right now", so by simply opening a prefix for editing and pressing "save" will cause the prefix to end up as having expired.
I think a simple fix would be to strip out the expires attribute if its value is equal to None. At least when I call edit_prefix directly from my scripts, and omit the expires attribute in the attr struct, the stored expires value stays the same (i.e., no expiration date).

The issue is likely that None, as in NULL/nil, is expected while "None" is sent. In XML-RPC this is explicitly shown with the string tag in <value><string>None</string></value>. I'll have a deeper look into this.


Minimizer bug

Minimize the sidebar
Increase the height of the browser window -> the minimizer button will follow the edge of the window
Decrease the height of the window -> The minimizer button will not follow the edge of the window, and will no longer be visible in the browser.

Can you check latest version?

Still having the same issue, verified on git commit f244f0258577eba9d509ec7e23186a9927ee264f

Seems to work now.


Wrong number of students after writing vastapalaute

Before writing vastapalaute I could see the feedback given by students. There were more than five students who had given feedback. However, after writing vastapalaute the system doesn't show the feedback and claims that the number of students is less than five.

The system also shows that 29 out of 0 students have given feedback which is weird. The correct number of students is 87.

I'm not sure if this is actually related to writing vastapalaute, but at least the bug appeared after writing vastapalaute.

A similar issue: #1315

Duplicate of #1315, as you mentioned. Closing, but leaving as a reference.


Travis CI better integration

CI has already helped us a lot so far and we can still improve some things as soon as we get the time.

[ ] Run the entire flow (including enqueue-jobs, export, verify and merge)
[ ] More detailed integration test (instead of just "it runs through")
[ ] Build should be triggered by Docker Hub webhook. Currently we just always build the images (at two places - this could be solved cleaner)

Has been moved several times and at the moment our workflow actually works well in practice. The suggestions mentioned above won't bring significant improvement now.
However if we have good idea how to improve automated testing we should create a new issue.


Added README for variable files

Connects https://github.com/rcbops/u-suk-dev/issues/833

TODO: Convert to RST

@mattt416 I've addressed your feedback.

👍

Backport to newton-14.0 branch is here: https://github.com/rcbops/rpc-openstack/pull/1734


Check the identity email address case insensitively

Fixes #6933

Unfortunately, there's a larger issue. Our method to compare email addresses for equality is wrong (local parts should be decoded and compared case sensitive, domains case insensitive). I got us started moving in the right direction with PR #6938.
To fix the display issue reported in #6933, I suggest we avoid the email equality check in DisplayRecipientsExtractor. Given that we don't actually need the Identity instance, we can change the code to the following:
    fun extractDisplayRecipients(message: Message, account: Account): DisplayRecipients {
        val toRecipients = message.getRecipients(Message.RecipientType.TO)
        val ccRecipients = message.getRecipients(Message.RecipientType.CC)
        val bccRecipients = message.getRecipients(Message.RecipientType.BCC)

        val numberOfRecipients = toRecipients.size + ccRecipients.size + bccRecipients.size

        val identityAddress = sequenceOf(toRecipients, ccRecipients, bccRecipients)
            .flatMap { addressArray -> addressArray.asSequence() }
            .filter { address -> account.isAnIdentity(address) }
            .firstOrNull()

        val maxAdditionalRecipients = if (identityAddress != null) {
            maxNumberOfDisplayRecipients - 1
        } else {
            maxNumberOfDisplayRecipients
        }

        val recipientNames = sequenceOf(toRecipients, ccRecipients, bccRecipients)
            .flatMap { addressArray -> addressArray.asSequence() }
            .filter { address -> address !== identityAddress }
            .map { address -> recipientFormatter.getDisplayName(address, account) }
            .take(maxAdditionalRecipients)
            .toList()

        return if (identityAddress != null) {
            val meName = recipientFormatter.getDisplayName(identityAddress, account)
            val recipients = listOf(meName) + recipientNames

            DisplayRecipients(recipients, numberOfRecipients)
        } else {
            DisplayRecipients(recipientNames, numberOfRecipients)
        }
    }

This way the checks triggered via Account.isAnIdentity() are still wrong, but at least we don't have to duplicate the wrong check in DisplayRecipientsExtractor.

It looks like you're arbitrarily truncating the last recipient even if the identity address couldn't be found by exact match? That'll pass the test case but go wrong with additional recipients.
Domains are case insensitive so it's still going to fail to match.
Uppercasing the entire email address is quite common. Lowercasing it may be even more common because it'd be hidden a lot of the time. Uppercasing the first letter is going to happen a lot on Android when it's uppercasing the start of a text entry.
Local parts are de facto case insensitive.

Superseded by #6946


Individual colors for each letter

To make it easier to visually identify each word, it would be beneficial if each letter was their own color.
For instance, the letter 'a' is blue, 'b' is red, 'c' is teal and so.
Perhaps it is better to change the background and text/color for each letter.

User choice is good, but changing the color of each letter poses a few potential issues for accessibility. WCAG 2.1 specifies that the contrast for small text should be at least 4.5:1. Rango already ensures user adjustable high contrast by adapting the hint colors according to the background it's sitting on top of (it's really quite neat how it does it, too).  The other aspect of this is that various color blind  adjustments would need to be added to ensure the colors that are chosen aren't going to make the letters invisible if the user is, as an example, blue/green, purple/red, and yellow/pink colorblind (tritanopia). This is usually done through a menu in the tool settings where the user chooses the specific color blind adjustment needed.
Adding different colors for each letter and/or the background would mean also adjusting it on the fly so that the text has sufficient contrast against the background color and the background on the page. For a page with a lot of hints, that could be a lot of additional client side calculation needed to render the hints.
It might work out nicely if this was an optional rendering style provided via a toggle in the options menu though.
Just a few things to consider.

Do you have any issues identifying the letters of the hints? There are a lot of settings you can customize to make it easier for you:

Use uppercase letters.
Use bold letters.
Increase the size of the hints.
Change the font family.
Require a minimum contrast ratio.
Change the background and font colors so they are constant.

I don't see how changing the color of each individual letter is going to make it easier for you to identify them. And for that I would have to make the background color constant (white, probably) and find 26 colors that have good contrast with white, that are distinctive enough between them and that take into consideration all the things mentioned by @bacall213.

Closing this one due to the inactivity and the impracticality of the proposed feature.


GetSecret grpc api incorrectly uses key name as store name.

GetSecret grpc api incorrectly uses key name as store name.

Fixed in https://github.com/dapr/dapr/pull/1224


Create monster.data.json

Process monster.com site. Example query:
https://www.monster.com/jobs/search/?q=computer-science-internship
Post results in monster.data.json.  If multiple queries, make multiple files.

Documentation | Data | Code


Create guide for Data Review process

Hi Anand, can you add some more information. Specifically, what kind of information should a guide to data review process contain?

The purpose of this guide could be for example"

Consistency in data throughout the process flow at various steps where data transformation happens.
Cross verify if the data matches with its metadata, its source and location
Data processing steps
Creation of simulated data to cross check.
Also the stuff that you mentioned in Data test could be added here.
How could someone review this ? (Personally I do not know much about this either)

How about:

Is there data?
If yes, where can it be found
What is the data format?
Is there software to interpret the data format?
If yes, where can the software be found?
What is the content and structure of the data?
Where can additional documentation on the data be found? E.g. scientific papers
Where can additional documentation be found on the process that processed the data?
Has the data been used in science before? If yes, where and how?
Are links between subsets of the data present, are they clear, and are they correct?
Is there domain specific documentation on how to verify the quality of the data?
Is the dataset complete?
What is the size of the data and is there a plan for storing/archiving it?
In case of animal or human data: Has approval been obtained to collect the data been obtained?
If yes, what is the approval reference number?
What are the desired access rights for the data?
What obligations does the owner of the data have in terms of data protection?
Is there documentation on how the data should be cited?

For what exactly is this a guide, for releasing data? Or just for using it?
I'd like to add some legal issues, of course:

If you want to use an external data set, does it come with any restrictions on how it can be used, e.g. only non-commercial or academic use? Does your project fulfill these restrictions? (Think about commercial partners and such, just because we're a scientific not-for-profit organisation doesn't automatically make everything we do non-commercial.)

Does the data you want to release incorporate (modified versions of) third-party data that you got elsewhere?

If so, under what licenses are these other data sets available, and do you have the necessary rights (copyright, database right where applicable, click-wrap licenses, disclaimers, etc.) to redistribute them?

How can one cross verify if the data matches with its metadata, source and location ?
Can we reproduce data from a previous step (as mentioned in point 7. in above statement from Vincent) ?
How to create simulated data with expected characteristics as the original data?

Is there any guideline for data driven usecases ?

This content would be more appropriate for The Turing Way


Setting auth scope based on a returned type

Hello, this is a related two part issue regarding error data on auth scoped queries, and returning query data based on individual return type values for a group of items.
In the absence of setting auth scope based on the return value of a field, I have implemented using a check on a return type as recommended per documentation. For more context of our situation, we are aiming to restrict access to a returned product depending on if a specified attribute value is present. If a user is not authorized to view the product, we will return null. Otherwise, they can view the data and specified fields per their query.
First issue: while we have successfully returned null on an entire query result by setting runScopesOnType to true on the underlying type, I cannot find a way to disable the error being sent as well. We were hoping to return only the data property (with null return for the specific query) and cannot find a way to turn off the error return per documentation, but only how to customize it.
Second issue: when searching for a group of items, if the query includes one restricted item with additional non-restricted items, the entire query returns null and also throws the error. We were hoping to return null for the restricted item only, while returning the appropriate data for the remainder of the query and bypass any error. This object reference uses the same underlying type for returning one product which the auth scope has been set on, which is working as mentioned above.
Apologies for any oversight on my end with regards to available documentation. Thank you!

First issue: while we have successfully returned null on an entire query result by setting runScopesOnType to true on the underlying type, I cannot find a way to disable the error being sent as well. We were hoping to return only the data property (with null return for the specific query) and cannot find a way to turn off the error return per documentation, but only how to customize it.

This one is hard to work around.  runScopesOnType run the auth checks in the isTypeOf check for a type.  By that point in execution GraphQL already thinks that the value was resolved to a non-nul value, which can't be changed without an error.  Pothos doesn't control the execution, and works almost entirely by wrapping resolvers and other functions (resolveType, isTypeOf) to add additional behavior.

Second issue: when searching for a group of items, if the query includes one restricted item with additional non-restricted items, the entire query returns null and also throws the error. We were hoping to return null for the restricted item only, while returning the appropriate data for the remainder of the query and bypass any error. This object reference uses the same underlying type for returning one product which the auth scope has been set on, which is working as mentioned above.

This should work the way you want if you make the list items nullable (nullable: { list: true, items: true }), but let me know if thats not working the way you expect.
I am open to adding a better way to have post-resolver auth checks to the plugin, but getting that API to work in a consistent/predictable way can be challenging.  If you have a specific way you would like to define those types of auth checks, let me know, and I can try to see if it's possible, or at least explain the challenges/tradeoffs for why that might be hard to make work correclty