Blank screen/out of memory with root loader and hash history

Describe the bug
I'm trying to use a root route with a loader and hash history (which is needed for Electron, though this issue also occurs on the web). I have the following:
// __root.tsx
export const Route = createRootRoute({
  loader: () => {
    return { data: 'data' };
  },
  component: RootComponent,
});

// main.tsx
const history = createHashHistory();

// Set up a Router instance
const router = createRouter({
  routeTree,
  history,
  defaultPreload: 'intent',
});

When both of these are used, the page fails to load. This doesn't always occur when viewing a StackBlitz preview as part of the editor, but will occur if you open the preview in a new tab. The page loads forever and does not show anything. Dev tools are also empty.

Eventually, there is an out of memory error.

If the loader is removed or the history is removed from the above code, the page loads normally.
Your Example Website or App
https://stackblitz.com/edit/tanstack-router-veongn?file=src%2Froutes%2F__root.tsx
Steps to Reproduce the Bug or Issue

Open the StackBlitz reproduction and open the preview in a separate browser window
The page loads forever and nothing is rendered
Comment out the history, in line 12 in main.tsx. Notice that the page loads properly. Uncomment the line.
Comment out the loader in lines 6 - 8 of __root.tsx. Notice that the page no longer loads.

Expected behavior
I expected that the page will load fine even when the root route has a loader and hash history is used.
Screenshots or Videos
No response
Platform

OS: Windows
Browser: StackBlitz running in Chrome or FireFox
Occurs using<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>
Additional context
No response

looks like this was introduced in 1.45.3
@tannerlinsley can you please have a look?
it works in 1.45.2: https://stackblitz.com/edit/tanstack-router-yaeuoc?file=package.json

@BrendanC23 as a workaround, you can use createMemoryHistory instead of hash history

I think it's broader than that. I'm getting oom by simply returning the zod result in validateSearch of my index root. If I don't return anything it's fine.

@geoff-harper can you please provide a reproducer?

I'm pretty swamped at the moment. I may be able to get to it next week if it isn't found by then. It's a basic router with a query client in context. Here's the entire tree I have after removing everything I could
declare module '@tanstack/react-router' {
  interface FileRoutesByPath {
    '/_page/': {
      id: '/_page/';
      path: '/';
      fullPath: '/';
      preLoaderRoute: typeof PageIndexImport;
      parentRoute: typeof rootRoute;
    };
  }
}

My __root is nothing but an Outlet. _page has an Outlet and plain text pending and error components. _page.index is just an Outlet with a validate search of
validateSearch(search) {
    const cached = sessionStorage.getItem(storageKey) || '';
    const parsed = defaultParseSearch(cached);
    const validated = schema.parse(parsed);

    return validated;
  }

Here's the router
export const router = createRouter({
  routeTree,

  defaultPreload: false,
  defaultPreloadStaleTime: 0,

  context: {queryClient},
});

It's as stripped down as I can make it. If this isn't enough to go off of I can try and do a full repro when I'm available

I'm having the same issue with file based route and createRootRouteWithContext when using valibot validate search, but in a strange cenario, when I navigate to the route it works, if I press F5 it crash.
const SearchSchema = v.object({
  'max-date': v.fallback(v.union([v.string(), v.null()]), null),
  'min-date': v.fallback(v.union([v.string(), v.null()]), null),
  page: v.fallback(v.number(), DEFAULT_TABLE_PAGE),
  size: v.fallback(v.number(), DEFAULT_ROWS_PER_PAGE),
});

export const Route = createFileRoute('/_private/private/supplies/')({
  component: () => <ListSuppliesPage />,
  validateSearch: (search): Required<GetSuppliesParams> => v.parse(SearchSchema, search),
});

@geoff-harper Are you using Router Devtools? If so, can you try again without? I found that it was the cause of my issues.

I can confirm that there is somewhere a bug with the HashHistory which leads to an infinite loop and tab freeze
I can`t reproduce it in an isolated environment, yet and I can't post my whole codebase here.
But so far I could narrow it down slightly. Maybe this helps.
Tested in Chrome and Firefox.
The error causes the Browser tab to freeze, which usually happens with an infinite loop.
The error occurs only when accessing the root URL directly without the /#/
e.g. localhost:5000 will freeze
localhost:5000/#/ works fine
I can also confirm, that you can work that issue by either using the Memory or BrwoserHistory or by downgrading the version   to 1.45.2 or below.
So it must have been introduced in 1.45.3

I checked out 1.45.11 and it's tentatively working. I'm not using HashHistory so I suppose my issue was different and potentially resolved along the way. If it pops up again I'll open a new issue with repro (and try w/o dev tools)

I can also confirm, that this issue exist in version 1.45.3 onwards for hashRouter and its exactly the same as mentioned by @itshallrun

@devarsh do you have a reproduction? Your project may be smaller than mine.

I don't have a repo to show reproducibility as I'm using it in production, but I'm still having the issue. Our smoke tests are still failing with version v1.45.15 so we are sticking to v1.45.2 until we get a green build

Seems like v1.46.4 (or more recent, didn't test before) fixed this issue. Thanks!

Closing since retesting with 1.52.0 no longer shows this bug.


Handling authentication for multiple applications on localhost

Core Library
MSAL.js v2 (@azure/msal-browser)
Core Library Version
1.4.11
Wrapper Library
MSAL Angular (@azure/msal-angular)
Wrapper Library Version
2.0.0
Description
I have multiple Angular applications that can be run locally on localhost:4200 (not simultaneously though).
Authentication using msal-angular 2.0  works fine for the first app when launching the ng serve my-first-app command.
Then I stop ng  serve and I start it again for another app ng serve my-second-app.
This time, authentication fails with the error : ClientAuthError: token_refresh_required: Cannot return token from cache because it must be refreshed.
At application startup I run the following code (see snippet below). For the first app, getAllAccounts() returned nothing so I was redirected to the login page and all was fine.
When I run the second app though, getAllAccounts() return the account that was created after successful login when I ran the first app.
However this is inccorect because they are two different app, and the audience of the first one is different from the audience of the second one.
I'm not sure how this should be handled ? Is there a way to filter what getAllAccounts returns ?  What is the correct way to do this ?
MSAL Configuration
No response
Relevant Code Snippets
this._authService.msalService.instance.handleRedirectPromise().then(res => {
                if (this._authService.msalService.instance.getAllAccounts().length > 0) {
                    resolve(true);

                } else {
                    this._authService.msalService.loginRedirect({ scopes: [], redirectStartPage: window.location.href });
                    reject('User is not signed in. Redirecting to login page.');
                }
            });

Identity Provider
Azure AD / MSA
Source
External (Customer)

Hi @graphicsxp . This behavior is expected from getAllAccounts in MSAL Browser. The getAllAccounts API does not filter based on an application's clientId, but instead relies on the browser's own storage restrictions to filter by domain (localhost:4200 in this case).
In this case, since both of your angular apps are running on localhost:4200, the browser believes it is the same application and therefore allows App "B" access to App "A"'s cache items.
The important thing is that as long as both apps have different domains in production, this should not be a concern, since this will only happen in localhost.
For a workaround during local testing, you have two options:

Make sure you logout from each app before running the other app so this doesn't happen
Run your apps on different ports to avoid the cache "collision"

Please let us know if you have any further questions or if we can close this issue. Thanks!

Hello @hectormmg
In the end I chose to run each of my local apps on a different port. This solves the problem. And indeed onc deployed to different domains, there is no such issue.
thank you for the answer.


Add objects for representing autosar specifics

this is completely analogous to the handling of dbc specifics. Thes objects itself currently only contain a list of the ARXML paths of all PDUs which are featured in a given message.
Andreas Lauser<EMAIL_ADDRESS>on behalf of MBition GmbH.
Provider Information

@juleq: As usual, merge at will...

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

69 of 73 (94.52%)  changed or added relevant lines in 4 files are covered.
1 unchanged line in 1 file lost coverage.
Overall coverage decreased (-3.6%) to 92.832%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

cantools/database/can/database.py
7
8
87.5%

cantools/database/can/message.py
6
7
85.71%

cantools/database/can/formats/arxml.py
55
57
96.49%

Files with Coverage Reduction
New Missed Lines
%

cantools/database/can/formats/arxml.py
1
93.97%

Totals

Change from base Build<PHONE_NUMBER>:
-3.6%

Covered Lines:
5478

Relevant Lines:
5901

💛  - Coveralls


Support Python 3.8, pin virtualenv dependency, update CI config

This will start testing Pew with ~the upcoming~ Python 3.8.
~NOTE: The Travis tests are configured to use the "3.8-dev" version and should be switched to "3.8" once it is released.~
I've also pinned virtualenv dependency to <20.0.0 (support for virtualenv 20+ is tracked in #219) for now and rewritten the AppVeyor configuration to fix test issues there.

@pfmoore, this is ready for review.

Travis build is failing. Also, needs confirmation that dropping support for the older Python versions is acceptable (I'm OK with doing so myself, but it's not my call).

Travis build is failing.

Yes, the Nix job is failing but apparently, it has been failing for a while since the last successful build on the master branch is from Oct 5, 2019 (Build 557).

Also, needs confirmation that dropping support for the older Python versions is acceptable (I'm OK with doing so myself, but it's not my call).

Ok, let's wait for @berdario.

Travis build is failing. Also, needs confirmation that dropping support for the older Python versions is acceptable (I'm OK with doing so myself, but it's not my call).

@pfmoore, I've removed the dropping of Python 3.4 commit to be able to get this PR merged quicker.

Travis build is failing.

Yes, the Nix job is failing but apparently, it has been failing for a while since the last successful build on the master branch is from Oct 5, 2019 (Build 557).

I've filled #221 and temporarily allowed Nix build jobs to fail on Travis CI since this issue is unrelated to this (or other open) PRs.
Please, take another look at this PR.

Still needs @berdario to comment. But I have pointed out that I don't want the project to force an older version of virtualenv. So I'd rather the virtualenv wasn't pinned, but #219 gets addressed. I'd object to a release that pinned to the old version, so I see no point in adding a pin now, just to have taking it out again be a release blocker...


Update the game over message

Update the game over message so people know how to play again!

ive added a comment


Tree gatherer randomly stops

Industrial Foregoing Version: 1.8.3-122
My tree gatherer will just randomly stop chopping trees even tho it has plenty of power and the inventory is not full. if i pull the range addon out of it for a minute and put it back in it will run for a while then stop again.

Same issue here, plant gatherer ignores trees (and plants) within its working range after gathering trees for some time. Pull and put range addon fixes issue for a minute then it comes back.

 Working area is shown too. Plant Fertilizer with bone meal is also utilized.
Tested with vanilla Dark Oak trees and Jungle trees, with range 3 addon.
DW20 1.12.2 pack (version 1.9.0)
Industrial Foregoing Version: 1.8.2-121

@Bobbert1921 are you sure that you are in version 1.8.3?
@asukaceres update to 1.8.3


Allow highlight.js to guess the correct language syntax for init tweaks

Fixes #193

Coverage remained the same at 81.56% when pulling b1c4eb55d675ee05b0c341c3fb95c1592bbf5070 on js-init into 255faba2279c61c9afaf527a0d66858d0e31fdbd on master.


Automatic update checking leads to broken URL

Tested versions

Reproducible in Godot 4.3 beta 1

System information
Windows 11 - Godot v4.3.beta1.official [a4f2ea91a]
Issue description
Automatic update checking lists an invalid version 4.3-4.3. available for download, and links to a non-existent page on the Godot website.
https://godotengine.org/download/archive/4.3-4.3

Steps to reproduce

Download Godot v4.3 beta 1 from the website
Launch it once and turn Network mode -> Online
Open a project and do whatever
Close editor
Re-open Godot 4.3

Minimal reproduction project (MRP)
N/A

Duplicate of #92593

Thank you for reporting, consolidating in:

#92593


Upstream fixes from henryleberre/[amdgpu, gcc-acc] and other things

This PR aims to upstream non-experimental changes made in my amdgpu and gcc-acc branches, including:

CMake on CCE: Fixed argument splitting (and combining) with the SHELL: prefix.
Fypp Macros: Improved logging (stdout flushing).
mfc.sh load: Bumped CCE version for Crusher & created toolchain/modules.
gnu_acc.sh: A script that automates the process of building an offloading GNU compiler on the correct development branch with support for NVIDIA and AMD targets.
Refactored parts of mfc.sh test and add the --add-new-variables (see documentation).
Refactored the CI workflows (expanded scope & simplified .yml).
Docker: Rewrote the Dockerfile to use an Ubuntu base image and updated the publishing workflow to fix #171.
Updated the documentation website's theme to look nicer (see the new version here)
Testing without MPI installed is now supported (—-no-mpi). There was a bug that required that an MPI binary (e.g. mpirun/srun/…) be present
Some miscellaneous improvements.

@sbryngelson Phoenix' queue appears to have been full:

I'm on it

@sbryngelson Once you create the Docker Hub account, I can update the mfc.sh file to pull from that account.

Found a problem with the website update here: https://henryleberre.github.io/MFC-DOC.github.io/documentation/md_case.html syntax problem with <tt>

The problem with your Phoenix CI is that you are loading different modules in Build and Test. In build it looks like you changed the command a bit, and it's also using GNU compilers. In the SLURM files in /misc you will see the problem https://github.com/MFlowCode/MFC/blob/master/misc/run-phoenix-release-cpu.sh
https://github.com/MFlowCode/MFC/blob/5e7fc2a3278adcd33bdd9fb445ef51789d51fb5c/misc/run-phoenix-release-cpu.sh#L1-L14
https://github.com/MFlowCode/MFC/blob/5e7fc2a3278adcd33bdd9fb445ef51789d51fb5c/misc/run-phoenix-release-gpu.sh#L1-L14
They load the same modules for CPU and GPU on Phoenix, then runs one case on CPUs and another on GPUs (via different CIs).

@sbryngelson Thanks, that explains the error for the CPU case. I think my last push should fix the GPU issue. For the documentation problem, it actually is already visible on the regular MFC website (https://mflowcode.github.io/documentation/md_case.html). It doesn't seem critical so I might take a look at this later (we may have to file an issue with Doxygen).

@sbryngelson Thanks, that explains the error for the CPU case. I think my last push should fix the GPU issue. For the documentation problem, it actually is already visible on the regular MFC website (mflowcode.github.io/documentation/md_case.html). It doesn't seem critical so I might take a look at this later (we may have to file an issue with Doxygen).

FYI for the Doxygen I would accept just getting rid of that part of the subsection title for now. I think it doesn't warrant trying to fix Doxygen and instead we can just rephrase the title so it doesn't need <tt>

@sbryngelson After some extensive Git trickery and debugging, this PR should be ready now.

@henryleberre thanks, this is perfect! (aside from the fact that it seems to have broken some tests?)

@sbryngelson Turns out it was a spurious error with GT Phoenix. I reran the job and it passed!

@henryleberre this latest commit has failed macos mpi no-debug testing a few times now.


Fix frontend warnings

When building the frontend in CI, it fails because warning are treated as errors.

fix warnings
remove CI=false flag from npm script

Fixed and done


Time limit exceeded

I am trying to use DNS challenge with Google Cloud DNS servers from cli run command. I keep getting the following error (tried 3-4 times):

Could not obtain certificates
Time limit exceeded. Last error: NS ns-1318.awsdns-36.org. did not return the expected TXT record

I am using .computer TLD. I was able to successfully obtain SAN cert with same command for .io TLD.

I increased the time out to 6 mins from 60 secs. Now, I am getting the following DNS errors even for .io TLD.

Could not obtain certificates
Time limit exceeded. Last error: NS ns-1318.awsdns-36.org. returned REFUSED for _acme-challenge.abc.xyz.org.

Which timeout did you increase in particular?

I increased the timeout inside DNS challenge file. https://github.com/xenolf/lego/blob/master/acme/dns_challenge.go#L79

You said you are using google cloud DNS but we are asking the AWS DNS servers for your zone. Could you give me a bit more information about your DNS setup? It seems like we are resolving to the wrong authoritative DNS server for your domains.

I purchased by domains on Namecheap and changed DNS servers to Google Cloud DNS. Everything in pretty much standard setup as far as DNS goes.

Would you be able to share the domain name with me? You can send me a private message on gitter or something.

I have not heard back from you in quite some time. Is this issue still relevant?

Closing this as there haven't been any updates.


Prepare release 0.1.0

This PR should bring everything needed to cut the 1st release.
Sadly I needed to remove pys2index from the environment, as it is now also broken on Binder (it still works on RTD). I hope conda-forge linux packages will be somehow fixed soon.
@willirath do you see anything else that we should add in README (e.g., funding source / reference to the ESM project?)

I'll just update the doc's index page with the updated description from readme and it should be ready I think.

All right. I'll be unavailable till some time this afternoon. So please don't wait for me and feel free to go ahead merging this and releasing as you think.


Not Able to Create Relationships BREAD

Version information

Laravel: v5.6
Voyager: v1.1.2
PHP: 7.1.3
Database: [type] [version] (e.g. MySQL 8.0)

Description

Not Able to Create Relationships BREAD. I created a new table and it's field after that I created the model via Artisan and a BREAD from BREAD Builder I can see the Bread fine in the view then I tried to create relationships via BREAD Builder but as you can see in the attachment the selects are all empty: the belonging select, category select, etc.
Screenshots

I can not see that the select are empty. They are just not opened (the arrow would show up if it was open).
Also please fill in your Database version.

They are not opening because there is nothing in them. Even when I inspect the element there is no option created for select.

You wont see any options when inspecting the element as select2 does some magic there (pushing a options-div somewhere before the closing html tag an so on)
And there is an option id.
Did you upgrade from an older version? What is your browser?

Ok found out there should be something with my JS codes or CSS codes thanks for your help.

By the way, I'm trying to Join Slack and getting Failed! token_revoked

By the way, I'm trying to Join Slack and getting Failed! token_revoked

Thanks, we will take care of it.

See even in the edit section of Bread in view my Selects are opening funny in Firefox Latest Version and Chrome Latest Version

Thats why I asked if you upgraded, and what your browser is.
There were some problems with select2 in modals back in version 1.0.x

How can I upgrade it? As you can see in the bottom of the attachment below my version is 1.1.2

Any comment on my issue?

1.1.2 is the latest, so no need to try to upgrade.
Slack link has been fixed, so feel free to try again.
What do you mean by "opening funny"?

As you can see in attachment I provided select open in wrong place and on some select doesn’t open at all

As this refer to a quite old version, please update and open another issue if you are still experiencing this problem.


gateway: simplify defaults for policy file config

The interpretation of the configured ip_routing_policy_file
configuration option was:

if the value is identical to the default file path and the file does
not exist, ignore it and return a default routing policy
otherwise, read the file at the specified location (and fail if it
doesn't exist)

Not only does this seem a bit convoluted, but it can also fail in
interesting ways; when the user does not want to specify an
ip_routing_policy_file and there is an error stat-ing the file at the
default location (e.g. no permission to read directory, error while
accessing network file system, etc.), the SIG would refuse to start.
Simplified to only handle the empty value as special default.
The consequence of this is that the configuration files now must
specify the ip_routing_policy file path if it should be loaded.
Also, removed the default for the traffic_policy_file option, making
this option mandatory in the configuration file.
Finally, removed the unused dispatcher configuration entry.

This change is

a discussion (no related file):

Also, removed the default for the traffic_policy_file option, making
this option mandatory in the configuration file.

What are the benefits of this change? We have this pattern of a default for "" for most of the required files in other applications (e.g., all the TOML configs and DBs have filename defaults). This leads to some inconsistency in how (required) files are handled.

a discussion (no related file):
Previously, matzf (Matthias Frei) wrote…
Reverted it, I hadn't seen this was an established pattern. It seems fairly arbitrary.

Cool, thanks!
(We use this pattern because it allows us to skip generating most of the config file contents.)


llvm6: 6.0.0 -> 6.0.1 (18.03 edition)

Triggers rebuild on Linux, so suggesting sent to staging-18.03
(and using PR instead of just picking onto the branch directly).
Like other point releases for LLVM lots of bug-fixes of varying importance.
No official summary of changes (other than looking at SVN/git for commits merged) AFAIK.

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option build-use-sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[x] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Fits CONTRIBUTING.md.

Is the jobset for staging-18.03 still active? The release staging branches are only used when stabilising the release AFAIK. There's generally not much activity on a stable release to require a staging workflow (unlike master 😄 ).

Oh, I'm not sure.  I should probably read that RFC again -- I mostly wanted a +1 for this change on 18.03 and to avoid blocking things there unnecessarily since AFAIK this isn't a priority but should make it there eventually :).

Oh, haha there's no mesa dep on 18.03 so it's not a mass-rebuild anyway!
Well alright then this seems like an easy win.  Okay to pick these onto release-18.03 directly?

Success on aarch64-linux (full log)
Attempted: llvm_6
Partial log (click to expand)
/nix/store/wkdgwflxv1adazbs6fwrsimjxirlxpj0-llvm-6.0.1-python/share/opt-viewer/opt-stats.py: interpreter directive changed from "/usr/bin/env python2.7" to "/nix/store/ff7mnr83nr700g6wp2svbaf5fkisb0f9-python-2.7.15/bin/python2.7"
/nix/store/wkdgwflxv1adazbs6fwrsimjxirlxpj0-llvm-6.0.1-python/share/opt-viewer/opt-diff.py: interpreter directive changed from "/usr/bin/env python2.7" to "/nix/store/ff7mnr83nr700g6wp2svbaf5fkisb0f9-python-2.7.15/bin/python2.7"
checking for references to /build in /nix/store/wkdgwflxv1adazbs6fwrsimjxirlxpj0-llvm-6.0.1-python...
shrinking RPATHs of ELF executables and libraries in /nix/store/n7p8qrdfr52lxvkiz9rndl2q485mqa3y-llvm-6.0.1-lib
shrinking /nix/store/n7p8qrdfr52lxvkiz9rndl2q485mqa3y-llvm-6.0.1-lib/lib/libLLVM-6.0.so
strip is /nix/store/ppn001bfygzlqx4h50n9zgxc3kqv2d6k-binutils-2.28.1/bin/strip
stripping (with command strip and flags -S) in /nix/store/n7p8qrdfr52lxvkiz9rndl2q485mqa3y-llvm-6.0.1-lib/lib
patching script interpreter paths in /nix/store/n7p8qrdfr52lxvkiz9rndl2q485mqa3y-llvm-6.0.1-lib
checking for references to /build in /nix/store/n7p8qrdfr52lxvkiz9rndl2q485mqa3y-llvm-6.0.1-lib...
/nix/store/4byxvl1apxk6p6xgxlk50pd58v6n6k08-llvm-6.0.1

Success on x86_64-linux (full log)
Attempted: llvm_6
Partial log (click to expand)
/nix/store/0y7i19y84imkcp98b4dxlcmvri72j5pb-llvm-6.0.1-python/share/opt-viewer/opt-stats.py: interpreter directive changed from "/usr/bin/env python2.7" to "/nix/store/2k0ap4hvl25rxlwhhva9ydhcsx8z3p0k-python-2.7.15/bin/python2.7"
/nix/store/0y7i19y84imkcp98b4dxlcmvri72j5pb-llvm-6.0.1-python/share/opt-viewer/opt-viewer.py: interpreter directive changed from "/usr/bin/env python2.7" to "/nix/store/2k0ap4hvl25rxlwhhva9ydhcsx8z3p0k-python-2.7.15/bin/python2.7"
/nix/store/0y7i19y84imkcp98b4dxlcmvri72j5pb-llvm-6.0.1-python/share/opt-viewer/optrecord.py: interpreter directive changed from "/usr/bin/env python2.7" to "/nix/store/2k0ap4hvl25rxlwhhva9ydhcsx8z3p0k-python-2.7.15/bin/python2.7"
checking for references to /build in /nix/store/0y7i19y84imkcp98b4dxlcmvri72j5pb-llvm-6.0.1-python...
shrinking RPATHs of ELF executables and libraries in /nix/store/949cwdicqnhhdwcyqwg2iw2k8fljcxwz-llvm-6.0.1-lib
shrinking /nix/store/949cwdicqnhhdwcyqwg2iw2k8fljcxwz-llvm-6.0.1-lib/lib/libLLVM-6.0.so
strip is /nix/store/b0zlxla7dmy1iwc3g459rjznx59797xy-binutils-2.28.1/bin/strip
stripping (with command strip and flags -S) in /nix/store/949cwdicqnhhdwcyqwg2iw2k8fljcxwz-llvm-6.0.1-lib/lib
patching script interpreter paths in /nix/store/949cwdicqnhhdwcyqwg2iw2k8fljcxwz-llvm-6.0.1-lib
checking for references to /build in /nix/store/949cwdicqnhhdwcyqwg2iw2k8fljcxwz-llvm-6.0.1-lib...

Failure on x86_64-darwin (full log)
Attempted: llvm_6
Partial log (click to expand)
[ 18%] Building CXX object lib/Analysis/CMakeFiles/LLVMAnalysis.dir/AssumptionCache.cpp.o
[ 18%] Building CXX object lib/Analysis/CMakeFiles/LLVMAnalysis.dir/BasicAliasAnalysis.cpp.o
[ 18%] Building CXX object lib/Analysis/CMakeFiles/LLVMAnalysis.dir/BlockFrequencyInfo.cpp.o
[ 18%] Building CXX object lib/Analysis/CMakeFiles/LLVMAnalysis.dir/BlockFrequencyInfoImpl.cpp.o
[ 18%] Building CXX object lib/Analysis/CMakeFiles/LLVMAnalysis.dir/BranchProbabilityInfo.cpp.o
[ 18%] Building CXX object lib/Analysis/CMakeFiles/LLVMAnalysis.dir/CFG.cpp.o
[ 18%] Building CXX object lib/Analysis/CMakeFiles/LLVMAnalysis.dir/CFGPrinter.cpp.o
[ 18%] Building CXX object lib/Analysis/CMakeFiles/LLVMAnalysis.dir/CFLAndersAliasAnalysis.cpp.o
building of '/nix/store/ijc040mda1q19i8jqskjzgfa5cg426fx-llvm-6.0.1.drv' timed out after 1800 seconds
error: build of '/nix/store/ijc040mda1q19i8jqskjzgfa5cg426fx-llvm-6.0.1.drv' failed

Success on aarch64-linux (full log)
Attempted: llvm_6
Partial log (click to expand)
/nix/store/4byxvl1apxk6p6xgxlk50pd58v6n6k08-llvm-6.0.1

Success on x86_64-linux (full log)
Attempted: llvm_6
Partial log (click to expand)
/nix/store/33ql1qj7pmv255f48nw7jiy685nkpcv9-llvm-6.0.1

Has the hydra eval finished building stuff with 6.0.1 yet. Maybe take a quick look at that to make sure everything looks sane, but I don't see a problem with backporting this.

Failure on x86_64-darwin (full log)
Attempted: llvm_6
Partial log (click to expand)
[ 18%] Building CXX object lib/Analysis/CMakeFiles/LLVMAnalysis.dir/AliasAnalysisSummary.cpp.o
[ 18%] Building CXX object lib/Analysis/CMakeFiles/LLVMAnalysis.dir/AliasSetTracker.cpp.o
[ 18%] Building CXX object lib/Analysis/CMakeFiles/LLVMAnalysis.dir/Analysis.cpp.o
[ 18%] Building CXX object lib/Analysis/CMakeFiles/LLVMAnalysis.dir/AssumptionCache.cpp.o
[ 18%] Building CXX object lib/Analysis/CMakeFiles/LLVMAnalysis.dir/BasicAliasAnalysis.cpp.o
[ 18%] Building CXX object lib/Analysis/CMakeFiles/LLVMAnalysis.dir/BlockFrequencyInfo.cpp.o
[ 18%] Building CXX object lib/Analysis/CMakeFiles/LLVMAnalysis.dir/BlockFrequencyInfoImpl.cpp.o
[ 18%] Building CXX object lib/Analysis/CMakeFiles/LLVMAnalysis.dir/BranchProbabilityInfo.cpp.o
building of '/nix/store/ijc040mda1q19i8jqskjzgfa5cg426fx-llvm-6.0.1.drv' timed out after 1800 seconds
error: build of '/nix/store/ijc040mda1q19i8jqskjzgfa5cg426fx-llvm-6.0.1.drv' failed

Has the hydra eval finished building stuff with 6.0.1 yet. Maybe take a quick look at that to make sure everything looks sane, but I don't see a problem with backporting this.

Not sure which job this would be--with cancels and such.  I think this one, assuming things aren't aborted?
https://hydra.nixos.org/eval/1466589
If so, it looks very much still underway.  If that's correct, then perhaps we should give this a day or two to sit first?

Up to you, I'm guessing it's probably fine if you don't want to wait.

Welp LGTM but not sure what to make of that evaluation.  But as you say it's unlikely to be especially problematic, but regardless please ping me if anything breaks that I've missed!


Adding named parameters to strings

This should let compile #3519 3519

@coolreader18 something something "bleeding edge"… something something "backwards compatibility"…

Im using rustc 1.57.0 (f1edd0429 2021-11-29) also on main page
RustPython requires Rust latest stable version (e.g 1.43.0 at May 24th 2020)

Thank you for contributing. But we concentrate on supporting only the latest stable Rust compilers for now. As you commented, it will run on 1.58 the most recent version which fit for our expectation.


Update to latest KTX version

Description
This PR updates the KTX library to the latest release.
Fixes #1089
Tested with

NV RTX 4070 on Windows 11
Google Pixel 9a on Android 13

General Checklist:
Please ensure the following points are checked:

[x] My code follows the coding style
[x] I have reviewed file licenses
[x] I have commented any added functions (in line with Doxygen)
[x] I have commented any code that could be hard to understand
[x] My changes do not add any new compiler warnings
[x] My changes do not add any new validation layer errors or warnings
[x] I have used existing framework/helper functions where possible
[x] My changes do not add any regressions
[x] I have tested every sample to ensure everything runs correctly
[x] This PR describes the scope and expected impact of the changes I am making

Note: The Samples CI runs a number of checks including:

[x] I have updated the header Copyright to reflect the current year (CI build will fail if Copyright is out of date)
[x] My changes build on Windows, Linux, macOS and Android. Otherwise I have documented any exceptions

If this PR contains framework changes:

[x] I did a full batch run using the batch command line argument to make sure all samples still work properly

Merging - 3 approvals


make setup.py better handle Cython not available

Similarly to how it already checks that numpy is available,
check whether Cython is available, an if not emit a proper error
message and exit.

Looks good @taleinat - thanks!


[BEAM-9747] Deprecate RedisIO.readAll() and add RedisIO.readKeyPatterns as a replacement

The idea is to let this deprecation for two releases before introducing the ReadAll pattern based on Reads for RedisIO to like proposed in BEAM-9403.
R: @aromanenko-dev

Run Java PreCommit

PR updated with the suggested changes can you PTAL @aromanenko-dev

Run Java PreCommit

Thanks Alexey!


[beta] Goto next/previous error unusable

Key command for goto next/previous error is broken and really a regression from SL3.

As a user, I want to go to the next/previous error from my current position.
If I never opened the new panel the keybindings do not work at all.
After an edit, hitting e.g. F4 start the list from the beginning again, which can be in any file.
If I open the panel, I want to see the closest errors first; t.i. at least the errors from the file I am currently editing.
If you have errors in an yet untitled view, you cannot jump into them. Instead, a new, empty scratch view will open.

As a user, I want to go to the next/previous error from my current position.

That’s a good point, the current solution cannot offer this.

If I never opened the new panel the keybindings do not work at all.

I thought they would... I’d have to check.

After an edit, hitting e.g. F4 start the list from the beginning again, which can be in any file.

I’m not sure we should try to solve this, but a solution that finds the next closest error from your cursor position would help here too.

If I open the panel, I want to see the closest errors first; t.i. at least the errors from the file I am currently editing.

There is an issue open for this.

If you have errors in an yet untitled view, you cannot jump into them. Instead, a new, empty scratch view will open.

Good catch.

If I never opened the new panel the keybindings do not work at all.

Checked, works fine without ever opening the panel: I can git next_error and go there immediately.


MailUser objects are also covered by the Compliance retention policy

Hello,
MailUsers objects (without mailboxes) are also covered and retained by the retention policy and yet there is nothing about that in the official documentations.
So, whenever a compliance retention policy is created with "All Mailboxes", MailUsers are being held as softdeleted users and can only be deleted after running set-mailuser  -ExcludeFromAllOrgHolds.
Could you please update the documentation to reflect the above.
Thank you
BR

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 3a1c2e44-357c-8096-5bdf-40e205778ded
Version Independent ID: 19c7b5d9-1e0c-501b-7b70-df5aab48b36e
Content: Learn about retention for Exchange - Microsoft Purview (compliance)
Content Source: microsoft-365/compliance/retention-policies-exchange.md
Service: o365-seccomp
GitHub Login: @cabailey
Microsoft Alias: cabailey

@cabailey Please help us in resolving this issue. Thanks

Investigating

Although closed, I wanted to note that this request is acknowledged and on the backlog but no new documentation to share at this point.


ImageMaxWidth does not work...

RN 0.55 Lastest
I have tried to hard input the number in the imagemaxwidth or using Dimensions but, the image is still showing full size and overflow out of frame.
FYI, I fetch content from wordpress api. The images does not show correctly.
Any idea, what i did wrong?

⚠ You did not follow the contributing guidelines!
As stated in these:

You need to fill out the issue template. This step is mandatory! Not doing so will result in your issue getting closed. Don't take this personally if this happens, and feel free to open a new issue once you've gathered all the information required by the template.
Although we might still help you without all these informations, it would be unfair to let some people post issues without filling everything.


Auto play last play progress

Now is stop,must click the play button to play.

Upon app open, playback resumes only if video was playing when leaving the player and the app wasn't killed by yet (either by using back button or by OS usually after few minutes in background)

yes, have this problem too, atv nvidia shield pro 2019
And if you start from begining is too hapens, must click button for start play.

Yes, it's annoying. Since when you start a video from another file manager (for example, by smb), the focus remains on the selection of files. And to start the video, you need to make an additional three clicks with the remote control.)

Yes, it's annoying. Since when you start a video from another file manager (for example, by smb), the focus remains on the selection of files. And to start the video, you need to make an additional three clicks with the remote control.)

I can understand the thing with focus so I'm changing that.

I can understand the thing with focus so I'm changing that.

I have a question?
Why not autoplay after changing the frame rate?
Or is it difficult?
Thanks in advance.)

Closing in favor of #176


Allow migrations to skip postgres or mongo or vault

SERVER-1288
Some customers may only have Postgres externalized
and need help migrating. DCEs would have to do the
process manually without this script.

I found errors when trying to apply the skip database flags.
whether i uses --skip-databases or --skip-postgres, the script still looks for postgres data to migrate.
I also found that i have to pass the host via --hostname. If i dont pass this flag, the script does not request i provide the hostname and will try to connect without it which naturally fails but because of a timeout.


Plotting vector fields with quiver

Although iris.plot provides useful wrappers for certain matplotlib functions (e.g. plot, contour and contourf), one notable omission is quiver.  For example, it would be very useful to be able to plot a wind field using two Cubes which represent zonal and meridional wind:
import iris
import iris.plot as iplt
u, v = iris.load('wind.nc', ['eastward_wind', 'northward_wind'])
iplt.quiver(u, v)

This has been mentioned before  but as far as I can see no-one has opened an issue specifically for this feature request.

Thanks for raising this @SimonPeatman! We will see what we can do to introduce this functionality to Iris.
Alternatively we always welcome code changes so if you felt like having a go yourself at introducing this functionality into Iris then we would be very happy both to receive the proposed change and to help you with getting it merged :smile:

iplt.quiver was added at #3111.


Snackbar not dismissing properly in async callback

Bug, feature request, or proposal:
Bug
What is the expected behavior?
When dismiss is called, the snackbar should close.
What is the current behavior?
When dismiss is called in async callback, snackbar does not close, nor does the afterDismissed callback get called until the screen is resized. As soon as I change screen size, the snackbar disappears and the afterDismissed is called.
What are the steps to reproduce?
Call dismiss in any async callback, does not work.
What is the use-case or motivation for changing an existing behavior?
Works properly inline, not async.  Want to show snackbar message of loading... until the async function completes.
Which versions of Angular, Material, OS, browsers are affected?
Angular 4.0.2, Material: 2.0.0-beta-2, Chrome
Extra
I have noticed this same problem when using angular 2 router.  If the router.navigateByUrl('next page') is called in the async callback function, the next page does not properly update/refresh page until the screen size changes.  Similar problem with calling dismiss to the snackbar inside async function, it will not update (in this case close), until the screen size changes.  Thinks its an issue with angular 2 (or 4 now), but still its affecting this module.

Can you post a Plunkr that shows the issue? You can use this one as a starting point.

I created a Plunkr and it worked! Lol, I figured out it was an issue with NgZone and not detecting changes properly.  Using the zone.run fixes the issue for anyone else who is having this problem.
generatePumpReport() {
	this.disableSummaryReport = true;

	let ref = this._snackBar.open('Job Summary Report is being generated, please wait.');

	Meteor.call('generatePDF', this.reportPump.getHtml(), 'Pump Report.pdf', 'landscape', (err, res) => {

		window.open(res);

		this._zone.run(() => {
			this.disableSummaryReport = false;

			ref.dismiss();
		});
	});
}


about chinese language

my english is poor , consider chinese language package ?

@ivanmissu
of course, but that will be a tough work.

thanks for contribution

@xxhomey19 thanks for contribution

I think this is low priority for me. This won't be done in the near future.
Furthermore, some terms are translated differently between simplified Chinese and traditional Chinese. I prefer to develop traditional Chinese first.

consider add the localization setting?

@hkongm
That would be good.

I mean we can have a short term solution in google translate (translation may be spotty) if using localization setting isn't enough

Visit https://china.nba.com/static and you'll find useful data.
https://china.nba.com/static/data/game/playbyplay_0041800224_4.json
i18n would not be that hard to implement (maybe add a map to player name, team name and event type and that sort of things), but this just seems unnecessary.


save_state crash when saving environment variables that contain double quotes

Description
OpenLane crashes when running the example design.
The source of the crash is the save_state function which crashes when it encounters environment variables with double quotes
To Reproduce
Define an environment variable that contains double quotes, such as:
function urg() { command urg -full64 "$@"; }; export -f urg
run
make test
You will observe the following:
[INFO]: Saving Runtime Environment
extra characters after close-quote
    while executing
"set ::env(BASH_FUNC_urg()) "() {  command urg -full64 "$@"
}""
    ("uplevel" body line 1)
    invoked from within
"uplevel #0 ${cmd}"
    (procedure "set_log" line 3)
    invoked from within
"set_log ::env($index) $::env($index) $::env(GLB_CFG_FILE) 1"
    (procedure "save_state" line 8)
    invoked from within
"save_state"
    (procedure "run_non_interactive_mode" line 69)
    invoked from within
"run_non_interactive_mode {*}$argv"
    invoked from within
"if { [info exists flags_map(-interactive)] || [info exists flags_map(-it)] } {
        puts_info "Running interactively"
        if { [info exists arg_values(-file)..."
    (file "./flow.tcl" line 346)

Expected behavior
OpenLane crashes
Desktop (please complete the following information):

OS: Springdale Linux release 7.9 (Verona)
Openlane Version:

v0.22-3-g7b3af66
master branch ( 02c16938aea3770c1d2e03fc8beed763fa83f30f )

Additional context
A simple solution is to escape the double quotes. See https://github.com/getziadz/OpenLane/commit/ec2d52f5df8d7fe30f04323931b4be71f235fc8e

Thank you so much @getziadz- I'll merge the fix within the next few days.

No problem. Should I create a pull request?

That would greatly accelerate things, yes.

Just created the pull request.

Thank you so much.

Think this should be fine now, I just made all variables use {}.
If you have a variable with {} that's your problem.


Change the default action when deleting a release to not delete tag

This will resolve #378. After delete a release, you also delete a tag via git command.

LGTM

LGTM

Backport to 1.0.1?


Add Vue as 3rd party language

Please see our 3rd party guide. You can use our own build process to create the dist folder which you can then check into your project - that will provide a packaged and ready to go versions (CJS and ES6) that can just be dropped into a browser - like how all our CDN grammars are packaged.

Please see our 3rd party guide. You can use our own build process to create the dist folder which you can then check into your project - that will provide a packaged and ready to go versions (CJS and ES6) that can just be dropped into a browser - like how all our CDN grammars are packaged.

Hi 👋🏻, I'm not sure to understand that comment. I saw SUPPORTED_LANGUAGES.md was listing the natively supported languages as well as the languages supported via 3rd party repositories. I saw a 3rd party repository existed for Vue.js but was missing from the list. I thought it was a mistake, so I PRed so it is listed.
As you mentioned it, I quickly checked docs/language-contribution.rst and extra/3RD_PARTY_QUICK_START.md. Maybe you mean the state the vue repository is in is so that it's not ready? But by no mean I meant to offer to maintain it.

Yeah this isn't ready/good to use as is, we'd like it to be "drop in" line every other grammar we publish.


'LengthBatcher' object has no attribute 'sample_order'

Hey Jason and Team, thanks for the amazing repo!!
I tried to retrain on SCOPe on my setup (2 RTX3090s) and am running into this issue attached below that's causing the training to stop and crash. I also tried it with 1 GPU and it still crashed the same way.
To reproduce: python train_se3_flows.py (I reorganised the files a bit to make it cleaner/more manageable)
Error executing job with overrides: []
Traceback (most recent call last):
  File "/home/rishabh/protein-frame-flow/train_se3_flows.py", line 97, in main
    exp.train()
  File "/home/rishabh/protein-frame-flow/train_se3_flows.py", line 72, in train
    trainer.fit(
  File "/home/rishabh/miniconda3/envs/fyp/lib/python3.10/site-packages/pytorch_lightning/trainer/trainer.py", line 544, in fit
    call._call_and_handle_interrupt(
  File "/home/rishabh/miniconda3/envs/fyp/lib/python3.10/site-packages/pytorch_lightning/trainer/call.py", line 43, in _call_and_handle_interrupt
    return trainer.strategy.launcher.launch(trainer_fn, *args, trainer=trainer, **kwargs)
  File "/home/rishabh/miniconda3/envs/fyp/lib/python3.10/site-packages/pytorch_lightning/strategies/launchers/subprocess_script.py", line 102, in launch
    return function(*args, **kwargs)
  File "/home/rishabh/miniconda3/envs/fyp/lib/python3.10/site-packages/pytorch_lightning/trainer/trainer.py", line 580, in _fit_impl
    self._run(model, ckpt_path=ckpt_path)
  File "/home/rishabh/miniconda3/envs/fyp/lib/python3.10/site-packages/pytorch_lightning/trainer/trainer.py", line 989, in _run
    results = self._run_stage()
  File "/home/rishabh/miniconda3/envs/fyp/lib/python3.10/site-packages/pytorch_lightning/trainer/trainer.py", line 1035, in _run_stage
    self.fit_loop.run()
  File "/home/rishabh/miniconda3/envs/fyp/lib/python3.10/site-packages/pytorch_lightning/loops/fit_loop.py", line 194, in run
    self.setup_data()
  File "/home/rishabh/miniconda3/envs/fyp/lib/python3.10/site-packages/pytorch_lightning/loops/fit_loop.py", line 250, in setup_data
    length = len(dl) if has_len_all_ranks(dl, trainer.strategy, allow_zero_length) else float("inf")
  File "/home/rishabh/miniconda3/envs/fyp/lib/python3.10/site-packages/pytorch_lightning/utilities/data.py", line 97, in has_len_all_ranks
    local_length = sized_len(dataloader)
  File "/home/rishabh/miniconda3/envs/fyp/lib/python3.10/site-packages/lightning_fabric/utilities/data.py", line 51, in sized_len
    length = len(dataloader)  # type: ignore [arg-type]
  File "/home/rishabh/miniconda3/envs/fyp/lib/python3.10/site-packages/torch/utils/data/dataloader.py", line 483, in __len__
    return len(self._index_sampler)
  File "/home/rishabh/protein-frame-flow/src/data/pdb_dataloader.py", line 250, in __len__
    return len(self.sample_order)
AttributeError: 'LengthBatcher' object has no attribute 'sample_order'

I've narrowed down the issue to this line: https://github.com/microsoft/protein-frame-flow/blob/main/data/pdb_dataloader.py#L245
My guess is that the self._create_batches() method in L245 isn't really being called in the __iter__(...) method; tried printing the sample_order variable and nothing was printed (so that line isn't run at all). Do you think it's a PyTorch / Lightning issue?
I've been trying to find workarounds for a while but nothing has worked yet. Appreciate any leads on this :)

That's odd. Are you using the same version of lightning as what's in the fm.yml? I wonder if lightning changed something so it calles len before it calls iter.

Hi, closing this for now but please reopen if you are stil running into problems.


DNN-7133 - Ensured that Content Items are created before Versioning u…

…ses them

@francescorivola Is this going in 7.4.2?

Cherry picked into 7.4.2


log version negotiation packets

Codecov Report

Merging #1186 into master will increase coverage by 0.01%.
The diff coverage is 100%.

@@            Coverage Diff            @@
##           master   #1186      +/-   ##
=========================================
+ Coverage   91.09%   91.1%   +0.01%
=========================================
  Files         114     114
  Lines        7711    7712       +1
=========================================
+ Hits         7024    7026       +2
+ Misses        460     459       -1
  Partials      227     227

Impacted Files
Coverage Δ

client.go
91.44% <100%> (+0.04%)
:arrow_up:

internal/protocol/version.go
100% <100%> (+1.72%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d191449...d206162. Read the comment docs.


CodeCop warning AA0237 is not correct

Describe the bug
CodeCop warning AA0237 is given if the record variable starts with 'Temp' and the record var is not defined temporary:
https://docs.microsoft.com/nl-be/dynamics365/business-central/dev-itpro/developer/analyzers/codecop-aa0237-nontemporaryvariablesmustnotbeprefixedtemp
But I have a record variable based on a table that starts with the name 'Template'
To Reproduce
Steps and to reproduce the behavior:

Go to '...'
             trigger OnAction()
             var
                 TemplateHeader: Record "IGO Template Header";

Expected behavior
No Warning at all.
Screenshots

5. Versions:

AL Language: v6.0.313479

Business Central: NL Business Central 17.0 (Platform 17.0.15306.0 + Application 17.0.15311.0)

I am closing this issue because it appears that it has been resolved, check the latest developer preview . Please open a new issue if you believe this has not been resolved and reference the current issue.

either it is not resolved with v6.1.397164 or it still not released or it is a regression. :-(

The issue is probably related to the prefix, IGO in the original post. The warning is not raised if a table is called Template Name Test and a variable TemplateNameTest. It is raised if the table name is prefixed like MYCO Template Name Test but the variable is not.

The issue is probably related to the prefix, IGO in the original post. The warning is not raised if a table is called Template Name Test and a variable TemplateNameTest. It is raised if the table name is prefixed like MYCO Template Name Test but the variable is not.

Doesn't matter. If you try to move records from
  TemplateIGOTemplateHeader: Record "IGO Template Header";
to
  IGOTemplateHeader: Record "IGO Template Header";
you get the same warning for the first record, although it is a good description of the record/the task you wanted to do.

It doesn't seem to be fixed.
And the affix doesn't seem to be the problem either.
The codecop does seem to assume that any variable starting with 'Temp' should be a temporary variable.

check the latest developer preview .

This means it is supposed to be fixed in the next main version of the AL Language, in this case: 7.x - have you tested that version?

Ah, just tested with 7.0.415152 and it seems to work fine now!
😊


iSCSI volumes fail to connect when different versions of open-iscsi installed on node and kubelet container

Rancher versions:
Rancher Server:  v2.0.2
rancher/rancher     latest              88526c7bea4e        4 weeks ago         521MB

The nodes had the following version of kubelet. rancher/hyperkube:v1.10.1-rancher2
Infrastructure Stack versions:
Kubernetes Version:
Client Version: version.Info{Major:"1", Minor:"10", GitVersion:"v1.10.3", GitCommit:"2bba0127d85d5a46ab4b778548be28623b32d0b0", GitTreeState:"clean", BuildDate:"2018-05-21T09:17:39Z", GoVersion:"go1.9.3", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"10", GitVersion:"v1.10.1", GitCommit:"d4ab47518836c750f9949b9e0d387f20fb92260b", GitTreeState:"clean", BuildDate:"2018-04-12T14:14:26Z", GoVersion:"go1.9.3", Compiler:"gc", Platform:"linux/amd64"}

Docker version: (docker version,docker info preferred)
root@worker3 ~ # docker version
Client:
 Version:      17.03.2-ce
 API version:  1.27
 Go version:   go1.7.5
 Git commit:   f5ec1e2
 Built:        Tue Jun 27 03:35:14 2017
 OS/Arch:      linux/amd64

Server:
 Version:      17.03.2-ce
 API version:  1.27 (minimum version 1.12)
 Go version:   go1.7.5
 Git commit:   f5ec1e2
 Built:        Tue Jun 27 03:35:14 2017
 OS/Arch:      linux/amd64
 Experimental: false
root@worker3 ~ #

Operating system and kernel: (cat /etc/os-release, uname -r preferred)
Linux worker3 4.4.0-127-generic #153-Ubuntu SMP Sat May 19 10:58:46 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Type/provider of hosts: (VirtualBox/Bare-metal/AWS/GCE/DO)
Hetzner
Setup details: (single node rancher vs. HA rancher, internal DB vs. external DB)
Single Rancher Server.
Kubernetes Cluster 3 node master, 4 node workers
Environment Template: (Cattle/Kubernetes/Swarm/Mesos)
Steps to Reproduce:

Add Hetzner node driver to Rancher ( https://github.com/mxschmitt/ui-driver-hetzner)
Create Kubernetes cluster of 3 master + 4 worker nodes
Install OpenEBS (via the Kubernetes helm chart)
Apply the OpenEBS Storage Classes via rancher cli
rancher kubectl apply -f https://raw.githubusercontent.com/openebs/openebs/master/k8s/openebs-storageclasses.yaml
Run the mongo stateful set
https://raw.githubusercontent.com/openebs/openebs/master/k8s/demo/mongodb/mongo-statefulset.yml

Results:

The mongo0 pod remains in ContainerCreating state. The error shows:

iscsiadm: Could not login to [iface: default, target: iqn.2016-09.com.openebs.jiva:pvc-767b47cb-7492-11e8-9e87-9600000bf699, portal: <IP_ADDRESS>,3260].
iscsiadm: initiator reported error (12 - iSCSI driver not found. Please make sure it is loaded, and retry the operation)
iscsiadm: Could not log into all portals

After analysis, found that different versions of open-iscsi are installed on the node and the kubelet container.

kubelet has open-iscsi/stable,now 2.0.874-3~deb9u1 amd64 [installed]
node has open-iscsi/xenial-updates,xenial-updates,now 2.0.873+git0.3b4b4500-14ubuntu3.4 amd64 [installed]

As a workaround I removed the open-iscsi from the node, and the volumes got connected.

This error also happens with OpenEBS depolyed directly via Operator:
https://github.com/openebs/openebs#installation-and-getting-started

I think this issue is related with:

https://github.com/openebs/openebs/issues/1688
https://github.com/openebs/openebs/issues/2243

For self testing:
Using rancher v2.1.1 deploy openebs(0.6) by catalog app. Creating a pos with pvc failed with:

I upgraded the cluster with the suggestion according to the above issue:
kubelet:
extra_binds:
- "/etc/iscsi:/etc/iscsi"
- "/sbin/iscsiadm:/sbin/iscsiadm"
- "/lib/modules"
And everything goes fine.

FYI, Binding /sbin/iscsiadm can fail when iscsiadm on the host depends on additional shared libraries. (e.g. host is bionic and container is built on xenial)


fix(windows): properly resolve custom protocol with threaded resolver

What kind of change does this PR introduce?

[x] Bugfix
[ ] Feature
[ ] Docs
[ ] Code style update
[ ] Refactor
[ ] Build-related changes
[ ] Other, please describe:

Does this PR introduce a breaking change?

[ ] Yes
[ ] No

Checklist

[ ] This PR will resolve #___
[x] A change file is added if any packages will require a version bump due to this PR per the instructions in the readme.
[ ] I have added a convincing reason for adding this feature, if necessary
[ ] It can be built on all targets and pass CI/CD.

Other information
Needs https://github.com/tauri-apps/tao/pull/792

Can it be achieved without patch from tao? We have to work with winit as well.

I've implemented the messaging logic manually. Let me know what you think @wusyong @amrbashir


Implementing (basic) RAPPOR

Added a rust implementation for basic rappor for locally private frequency estimation. This includes the randomiser, a de-bias function, and a proof (work in progress).
This function requires that each input is one-hot encoded, or hashed onto a bloom filter. It then noises each vector by xor'ing each bit with Bern(f/2). If you are using a bloom filter you must specify $m$ as the number of hash functions used.
Any feedback, changes, and proof checking is greatly appreciated!
Abigail

If m is the number of bits that can change, how do you feel about changing the input metric to the Hamming distance, and then d_in corresponds to m?

Greatly appreciate all the notes! To be honest I am unsure how local protocols relate to the distance metrics, but Hamming distance likely makes sense, two inputs should be at most 2m apart. Or alternatively the input domain should be all bit-strings with hamming distance <= m from the zero vector.
To clarify, m is the number of bits set in the non-private input, mostly just needed to ensure privacy (if you have 10/20 bits set, you have a lower eps than someone with 2/20 even with the same f).
I'll finish the proof document and update the docs soon, I think a jupyter notebook would be a great idea to introduce concepts of LDP, and allow people to experiment.

Ah, based on your comment, neither of my suggestions were quite correct. Any two adjacent data sets could have completely disjoint set bits- the ideal metric is still the discrete metric. However, the domain is restricted to those input vectors with only at most m (or h, as in the paper) bits set. If m can be less than the vector's size, then we might want to add another descriptor to VectorDomain, alongside size.

I've been reading the documentation for domains, and issue-1600121842 and am wondering if the best bet is to create a domain for balls on metric spaces. This would take a domain, a distance metric d, a centre-point p, a distance r(and whether to include the boundary, whether the ball is open or closed). Checking membership would just be d(p,x) <[=] r
This seems preferable to adding anything inside the vector domain struct, which is why I propose it, but I am open to other ideas.
In the case of RAPPOR the domain would have:

D: VectorDomain<Bool> with size k
d: Hamming distance
p: The zero vector
r:  The maximum number of bits set in each input (m in the proof or the number of hash functions used to map inputs onto a bloom filter h in the original RAPPOR paper)
On a closed ball (including the boundaries)

I think we should use the bitvec crate and introduce a new domain for it.

Rust Vec<bool> does not optimize for space: https://stackoverflow.com/questions/48875251/rust-seems-to-allocate-the-same-space-in-memory-for-an-array-of-booleans-as-an-a
We want a specialized descriptor for this case (and we also can't specialize, so it's un-ergonomic to implement the member check on VectorDomain)

The de-facto crate for bit vectors is this one: https://crates.io/crates/bitvec

Agreed! Bitvecs are great and seem necessary in this case. Also simplifies doing anything with the other domains. That seems like the go-to crate, so that would be nice to set up. I've had a look at the documentation and I think writing a few transformations (for one-hot encoding , Vec -> BitVec etc.) would help a lot (as the constructors provided are quite easy to misunderstand)

Ok I have created a BitVectorDomain, which has a max_weight (i.e. maximum hamming weight), and also created a pub type BitVector which aliases BitVec<usize, Lsb0>, which is apparently the most performant variety in the module. I placed the alias in domains, but that doesn't seem like the right place for it.
I also updated the RAPPOR code to use these new implementations, but I wonder if I should implement Hamming distance for BitVectors and use that rather than DiscreteDistance?

I would only implement the case where the input metric could be the Hamming distance if you anticipate settings where adjacent bit vectors may differ in only at most d_in bits: IE, changing any one individual's answer can change only at most d_in bits, instead of the entire bitvec.
For instance, [1, 1, 1, 0] would not be considered an adjacent bit vector to [1, 0, 0, 0] when d_in=1 under Hamming distance, as an individual could only influence up to one bit. But in this local-dp setting, I'd anticipate the entire bit vector comes from one individual.
You're more familiar with these algorithms than I, but my guess would be that this is unlikely?

I took a first pass at the FFI. For the most part it was all pretty straightforward, until I got to how bit vectors are represented in Python and R. I might iterate on the internal rust type for the bit buffer while I look for the ideal Python and R bit vector data types.
For now, ignore the failing CI check for R linting.

Touched up the docs, hope they're clear enough :)
I did end up deleting the transformations folder, but thinking on it, implementing some basic machinery for converting a bounded AtomDomain or a hash set to a one-hot encoding seems worth doing so that a basic Jupyter notebook can be set up. It still could be another issue though, I'm just pretty happy it's all working.

Reviewing with @Shoeboxam
Items left:

[ ] Proof for @vikrantsinghal
[ ] R FFI for bit vector (@Shoeboxam)

Greatly appreciate the feedback!

I would describe in the doc what m is.

I added a clarification through two examples, one for categorical data and one for strings hashed into a Bloom filter.

I would also explicitly state the assumption that 2m+1<=k, and why we are making that assumption.

Still need to make this clear, and possibly even enforce it as a requirement in the Measurement. The assumption comes from the fact that a Bloom filter would be massively inefficient with that many hash functions.

On page 3, can't the fourth equality follow directly from the first inequality? Why is the third equality a necessary step? Is it adding any new info? I would use \tag in the \align* environment to describe that. If the third equality isn't doing anything, then might as well get rid of it.

I added a ref which points out that the cancellation in that line (if I'm looking at the same one) shows that privacy does not depend on k.

What is each user sending, and what is the final function being computed? Is each user a sequence of k bits? Is a vector the final quantity that is being computed? I would clearly describe the nature of the input and the output in the doc.
Is N the total number of users? Or is it the vector of total counts for each bit position or coordinate?

Updated the descriptions of both, would love further feedback on readability though. Each user (currently represented by a row in a database though) is a sequence of k bits. In order to perform frequency estimation on categorical data this should be a one-hot encoding. To do frequency estimation on strings (or other large domains) a bloom filter or other sketch should be used to decrease the domain size.

The proof of Theorem 2.5 seems not so correct to me in terms of the notation. The first equality in the \align* environment equates the L1 norm to the L2 norm squared.

Correct! Fixed that thank you

Also, in statistics, people generally tend to use the term "Mean Squared Error (MSE)" as opposed to "Average Squared Error". Might want to switch to that?

Good point!
Thanks so much, I have pushed some updates which I hope clarify the usage. Could probably still do with further expansion.

There were some major errors in the MSE proof which I have now corrected 🤞, I hope I have also made the wording and notation clearer, but as I was changing some things I may have missed some symbols, I will give it a read with fresh eyes later.

The git history was messed up, I think due to the merge from main-- couldn't rebase. I pushed a copy of the old history to the implement-rappor-backup2 branch and rewrote this history.

#1279  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @abigail-gentle and the rest of your teammates on  Graphite

I split the FFI into a separate PR and updated it to work with R as well (see above comment).
I also made a few adjustments:

changed the type of max_weight to usize
Vikrant made some changes to the proof
I pulled the code out of the proof and updated it
removed a MetricSpace impl
temporary edit to the setup.cfg to resolve an unrelated CI issue having to do with the release of Numpy 2.0
renamed the mechanism (pending)

How do you feel about renaming the mechanism to just make_randomized_response_bitvec? I'd imagine that a separate constructor, make_rappor would just chain the bloom filter and this generalized rr mechanism.

Hey Michael, greatly appreciate the updates, and huge thank you to Vikrant for the notes on the proof, I agree with all of them, and will make the changes recommended.
I also agree with the name change, and think that leaving it in the form it is right now would be best. The current view on using Bloom filters seems to be that using them can incur more error than privacy (see this follow up noting that it requires a lot of domain specific tuning), and you still need to have a known domain (which you then also need to perform a Lasso regression against, which seems beyond the scope of OpenDP, but probably has implementations in Python already). It still seems good to keep the implementation and proof in full generality, parameterised by m so that a user can implement Bloom filters as they wish (as no other protocol right now can handle this form of input as far as I understand), but for the reasons stated above it may be best to push forward with the implementation as it stands right now, and not expand the scope any further.
One question, is there a transformation which can turn a categorical value into a BitVec right now? Seems like quickly wrapping make_find  and make_index for the back-and-forth would work, unless I'm missing an existing implementation.
If that is all good, then the changes to the proof seem like the last thing missing and hopefully we can close all of this out. I will make these changes Wednesday I've got the day off, and hope we can wrap this up :)

The bloom filter/lasso could certainly be handled in a Python transformation, and then chained with this mechanism.
If someone has a single categorical value, wouldn't they be better off using make_randomized_response?
Are there other variants of local-DP algorithms that would be useful to support?

I'm thinking that given k categories, it would be nice to map them to their indices in [k] and then have an easy transform to the standard basis vectors so they can be fed into rr_bitvec
In frequency estimation it would be nice to have subset selection (poor communication, great performance) and projective geometry response (great communication, good performance). Performance here is of course optimal for both, but small variation in constants and rounding.


Implement limits for nested queries

There are a couple of ways to do this:

a time limit - after Xms start cutting off queries
a number-of-nested-queries limit

I'm going to start with just a time limit - I think 1000ms total is a sensible default, configurable with a plugin setting.

The check can go here: https://github.com/simonw/datasette-graphql/blob/efe40393b932d731953ef04b1ec79fca912d4efb/datasette_graphql/utils.py#L224-#235
One way to implement this would be to record a start time on the info.context object and then have each call to that function check to see if 1000ms has expired since the start of the request.

I'm still going to implement a query limit too. Even if queries are executed super-fast there could be nasty consequences of generating a giant nested JSON structure with results from hundreds of nested table calls.

I've got a proof of concept working. Needs configuration and tests and documentation.

Documentation: https://github.com/simonw/datasette-graphql#execution-limits


implemented a sticky nav

We need a border bottom or box shadow to distinguish the header from full-width blue-colored sections.


Is there any chance to get a GUI version for this?

Hello,
Thank you for the latest version, it is easily the best CR downloader.
it can download the subtitle for both HTML5 and Flash player, and it attaches the fonts, I mean it has everything that anyone who loves to store CR videos need.
what I think would be better is getting a GUI, I am planning to make one, but unfortunately I do it in C#, so it won't be cross-platform, it will be for Windows only, so since you do program in Javascript with node js could you make a GUI for this application?
Thank you again for your beautiful application.

Sorry, I currently don't have plans making a GUI. It is "possible", that I make one in the future, but I'm not promising anything.

Since you don't have plans, I might try to make one sometime soon, I just need to wait for #18 to be solved, then I should be able to release it with no worries.

The GUI is ready:
https://github.com/Abu3safeer/CR-dl-gui/releases

I upgraded the GUI to support changes made in version 4.


Regarding train_batch_size

According to the documentation,

train_batch_size is aggregated by the batch size that a single GPU processes in one forward/backward pass (a.k.a., train_step_batch_size), the gradient accumulation steps (a.k.a., gradient_accumulation_steps), and the number of GPUs.

How exactly are these variables related? If no gradient accumulation is used, I believe its just train_batch_size = train_step_batch_size * n_gpu, but how does gradient accumulation come into play? I get a RecursionError: maximum recursion depth exceeded while calling a Python object when the batch sizes in my script and the deepspeed config disagree. Here is the complete error:
> finished creating GPT2 datasets ...
setting training data start iteration to 0
setting validation data start iteration to 0
done with setups ...
time (ms) | model and optimizer: 2350.12 | train/valid/test data iterators: 1179.34
training ...
Traceback (most recent call last):
  File "pretrain_gpt2.py", line 156, in <module>
    pretrain(train_valid_test_datasets_provider, model_provider, forward_step,
  File "/root/megatron-3d/megatron/training.py", line 97, in pretrain
    iteration = train(forward_step_func,
  File "/root/megatron-3d/megatron/training.py", line 481, in train
    loss_dict, skipped_iter = train_step(forward_step_func,
  File "/root/megatron-3d/megatron/training.py", line 324, in train_step
    return train_step_pipe(model, data_iterator)
  File "/root/megatron-3d/megatron/training.py", line 358, in train_step_pipe
    loss = model.train_batch(data_iter=data_iterator)
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 273, in train_batch
    self._exec_schedule(sched)
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 1162, in _exec_schedule
    self._exec_instr(**cmd.kwargs)
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 621, in _exec_load_micro_batch
    batch = self._next_batch()
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 480, in _next_batch
    return self._next_batch()
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 480, in _next_batch
    return self._next_batch()
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 480, in _next_batch
    return self._next_batch()
  [Previous line repeated 978 more times]
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 469, in _next_batch
    batch = self.batch_fn(batch)
  File "pretrain_gpt2.py", line 110, in get_batch_pipe
    return fp32_to_fp16((tokens, position_ids, attention_mask)), fp32_to_fp16((labels, loss_mask))
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 53, in fp32_to_fp16
    return conversion_helper(val, half_conversion)
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 38, in conversion_helper
    rtn = [conversion_helper(v, conversion) for v in val]
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 38, in <listcomp>
    rtn = [conversion_helper(v, conversion) for v in val]
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 37, in conversion_helper
    return conversion(val)
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 48, in half_conversion
    if isinstance(val_typecheck, (Parameter, Variable)):
  File "/root/anaconda3/lib/python3.8/site-packages/torch/autograd/variable.py", line 7, in __instancecheck__
    return isinstance(other, torch.Tensor)
RecursionError: maximum recursion depth exceeded while calling a Python object
Traceback (most recent call last):
  File "pretrain_gpt2.py", line 156, in <module>
    pretrain(train_valid_test_datasets_provider, model_provider, forward_step,
  File "/root/megatron-3d/megatron/training.py", line 97, in pretrain
    iteration = train(forward_step_func,
  File "/root/megatron-3d/megatron/training.py", line 481, in train
    loss_dict, skipped_iter = train_step(forward_step_func,
  File "/root/megatron-3d/megatron/training.py", line 324, in train_step
    return train_step_pipe(model, data_iterator)
  File "/root/megatron-3d/megatron/training.py", line 358, in train_step_pipe
    loss = model.train_batch(data_iter=data_iterator)
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 273, in train_batch
    self._exec_schedule(sched)
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 1162, in _exec_schedule
    self._exec_instr(**cmd.kwargs)
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 621, in _exec_load_micro_batch
    batch = self._next_batch()
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 480, in _next_batch
    return self._next_batch()
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 480, in _next_batch
    return self._next_batch()
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 480, in _next_batch
    return self._next_batch()
  [Previous line repeated 978 more times]
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 469, in _next_batch
    batch = self.batch_fn(batch)
  File "pretrain_gpt2.py", line 110, in get_batch_pipe
    return fp32_to_fp16((tokens, position_ids, attention_mask)), fp32_to_fp16((labels, loss_mask))
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 53, in fp32_to_fp16
    return conversion_helper(val, half_conversion)
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 38, in conversion_helper
    rtn = [conversion_helper(v, conversion) for v in val]
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 38, in <listcomp>
    rtn = [conversion_helper(v, conversion) for v in val]
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 37, in conversion_helper
    return conversion(val)
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 48, in half_conversion
    if isinstance(val_typecheck, (Parameter, Variable)):
  File "/root/anaconda3/lib/python3.8/site-packages/torch/autograd/variable.py", line 7, in __instancecheck__
    return isinstance(other, torch.Tensor)
RecursionError: maximum recursion depth exceeded while calling a Python object
Traceback (most recent call last):
  File "pretrain_gpt2.py", line 156, in <module>
    pretrain(train_valid_test_datasets_provider, model_provider, forward_step,
  File "/root/megatron-3d/megatron/training.py", line 97, in pretrain
    iteration = train(forward_step_func,
  File "/root/megatron-3d/megatron/training.py", line 481, in train
    loss_dict, skipped_iter = train_step(forward_step_func,
  File "/root/megatron-3d/megatron/training.py", line 324, in train_step
    return train_step_pipe(model, data_iterator)
  File "/root/megatron-3d/megatron/training.py", line 358, in train_step_pipe
    loss = model.train_batch(data_iter=data_iterator)
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 273, in train_batch
    self._exec_schedule(sched)
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 1162, in _exec_schedule
    self._exec_instr(**cmd.kwargs)
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 621, in _exec_load_micro_batch
    batch = self._next_batch()
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 480, in _next_batch
    return self._next_batch()
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 480, in _next_batch
    return self._next_batch()
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 480, in _next_batch
    return self._next_batch()
  [Previous line repeated 978 more times]
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 469, in _next_batch
    batch = self.batch_fn(batch)
  File "pretrain_gpt2.py", line 110, in get_batch_pipe
    return fp32_to_fp16((tokens, position_ids, attention_mask)), fp32_to_fp16((labels, loss_mask))
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 53, in fp32_to_fp16
    return conversion_helper(val, half_conversion)
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 38, in conversion_helper
    rtn = [conversion_helper(v, conversion) for v in val]
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 38, in <listcomp>
    rtn = [conversion_helper(v, conversion) for v in val]
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 37, in conversion_helper
    return conversion(val)
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 48, in half_conversion
    if isinstance(val_typecheck, (Parameter, Variable)):
  File "/root/anaconda3/lib/python3.8/site-packages/torch/autograd/variable.py", line 7, in __instancecheck__
    return isinstance(other, torch.Tensor)
RecursionError: maximum recursion depth exceeded while calling a Python object
Traceback (most recent call last):
  File "pretrain_gpt2.py", line 156, in <module>
    pretrain(train_valid_test_datasets_provider, model_provider, forward_step,
  File "/root/megatron-3d/megatron/training.py", line 97, in pretrain
    iteration = train(forward_step_func,
  File "/root/megatron-3d/megatron/training.py", line 481, in train
    loss_dict, skipped_iter = train_step(forward_step_func,
  File "/root/megatron-3d/megatron/training.py", line 324, in train_step
    return train_step_pipe(model, data_iterator)
  File "/root/megatron-3d/megatron/training.py", line 358, in train_step_pipe
    loss = model.train_batch(data_iter=data_iterator)
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 273, in train_batch
    self._exec_schedule(sched)
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 1162, in _exec_schedule
    self._exec_instr(**cmd.kwargs)
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 621, in _exec_load_micro_batch
    batch = self._next_batch()
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 480, in _next_batch
    return self._next_batch()
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 480, in _next_batch
    return self._next_batch()
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 480, in _next_batch
    return self._next_batch()
  [Previous line repeated 978 more times]
  File "/root/anaconda3/lib/python3.8/site-packages/deepspeed/runtime/pipe/engine.py", line 469, in _next_batch
    batch = self.batch_fn(batch)
  File "pretrain_gpt2.py", line 110, in get_batch_pipe
    return fp32_to_fp16((tokens, position_ids, attention_mask)), fp32_to_fp16((labels, loss_mask))
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 53, in fp32_to_fp16
    return conversion_helper(val, half_conversion)
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 38, in conversion_helper
    rtn = [conversion_helper(v, conversion) for v in val]
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 38, in <listcomp>
    rtn = [conversion_helper(v, conversion) for v in val]
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 37, in conversion_helper
    return conversion(val)
  File "/root/megatron-3d/megatron/fp16/fp16.py", line 48, in half_conversion
    if isinstance(val_typecheck, (Parameter, Variable)):
  File "/root/anaconda3/lib/python3.8/site-packages/torch/autograd/variable.py", line 7, in __instancecheck__
    return isinstance(other, torch.Tensor)
RecursionError: maximum recursion depth exceeded while calling a Python object

@ShivanshuPurohit Thanks for reporting this issue.
The relationship is : train_batch_size = train_step_batch_size * ngpus * gradient_accumulation_steps. DeepSpeed calls optimizer.step() every gradient_accumulation_steps  of forward()/backward().

Can you give more details on the mismatch of batch size values that is triggering this issue?
Does that mean there is no problem when there is a match?
Do you see this issue without 3D parallelism?

Hi. Thanks for the reply.
So my training script is fairly similar to this deepspeed megatron one. With a mismatch in batch sizes, I get this error, but when they align, it freezes operation, which might be some mistake on my part. I am curious about why this recursion error shows up. I should also mention that it only appears when I use a config that has ZeRO implemented. With ZeRO disabled and batch sizes aligned, training goes on. But with ZeRO on and batch sizes differing, I get this error.

Hi @ShivanshuPurohit , it looks like you are using the new example with DeepSpeed's pipeline parallelism and Megatron. Gradient accumulation steps are especially important here, as our pipeline parallel training relies on gradient accumulation to expose parallelism.
Which version of deepspeed are you using? We recently merged a commit that should avoid the RecursionError that you're experiencing. It looks like it will be shipped in v0.3.11, but you can grab it now from a source installation.
The pipeline engine has some strong assumptions on the data loader that are documented in the pipeline tutorial. In short, each the training data iterator will be next()ed a total of gradient_accumulation_steps number of times per batch.

Hi @ShivanshuPurohit, here's our driver script that sets up gradient accumulation, etc.: https://github.com/microsoft/DeepSpeedExamples/blob/master/Megatron-LM-v1.1.5-3D_parallelism/examples/ds_pretrain_gpt2_pipe.sh

I am using deepspeed v0.3.10. Thanks for the suggestion. I'll report back if the error persists.

Also, may I ask why this gpt2 pipeline script has ds_config.json enabled rather than ds_zero_stage_2_config.json? The original training script I ran was almost exactly similar to this one, with the same zero2 config disabled. Enabling it also gives the recursion error.


v-popover vs. vuetify sloted component

Versions and Environment
Vuetify: 1.3.12
Vue: 2.5.17
v-tooltip: 2.0.0-rc33
Steps to reproduce
Have the popover slot with a Vuetify component such as v-checkbox or v-range-slider
Expected Behavior
Normal functionality of the v-popover with the sloted component inside
Actual Behavior
Vuetify components have a delay when closing the v-popover, and they don't work properly.
Reproduction Link
https://codesandbox.io/s/lpm863vq3m

cc @johnleider

Something in the container is stopping the mouse move event. You can see this by either clicking on the track (works as expected) or clicking on the dot, leave the mouse pressed down, move it below outside of the container and move it left to right.

After looking at VSlider source code, I think the issue is that the mousemove event is listened on the vuetify app element, but the popper instance is added on the <body>, so it's not triggering the mousemove listener.

For v-tooltip 2.x:
Vue.use(VTooltip, {
  popover: {
    defaultContainer: "[data-app]"
  }
})

https://codesandbox.io/s/2opo3lkrp

For v-tooltip 3.x:
Vue.use(VTooltip, {
  container: '[data-app]'
})

https://codesandbox.io/s/7yx8r59nkj

thank you so much!

I used the components directly and solved the problem this way:
import * as FloatingVue from "floating-vue";

FloatingVue.options.container = "[data-app]";

Vue.component("FVDropdown", FloatingVue.Dropdown);
Vue.component("FVTooltip", FloatingVue.Tooltip);


Any plan to support S3?

Thanks for the great project! However, I was wondering if you have any plan to support S3 in the near future :-)

Thank you for your interest. I have no plan for s3 support at the time of this writing.

Understood. Thanks for your quick response.


Improved pagination for new dashboard

Fixes #2413

Added the "edge" (only 1 as it was defined in the issue) if there are more pages than can be visible, just like how Github's own pagination works.
Also update the pagination model immediately on click, to avoid the re-render delay until a response returns.

ping @xavijam code review
@saleiva you never answered my question in the issue, you want the "previous" and "next" links on the edges as well? :)

First and last items don't have round corners and they "hide" grey border

.

Ouch, good catch. I'll look into that one

Fixed -->

Frontend tests were OK :+1: (details)

Frontend tests were OK :+1: (details)

Apart from that detail, any more feedback or OK to go?

Reviewing :)

:gb:

Frontend tests were OK :+1: (details)


Update mx.graphics.Stroke

Only 4. Update Stroke.as  5. Update MXRoyaleClasses  (4 and 5 commits ) Should be Added


handle socket timeouts (sleep, turn off network, etc.)

You will want to make sure you push this fix into the vso-node-api repo


Unable to compile in 4.16.2

Thanks for posting this and writing the tutorials. I'm trying to do something similar with other third party libraries and this has helped a lot.  I did run into an issue though.  It looks like they've changed the module constructors to accept the argument ReadOnlyTargetRules instead of TargetInfo.   I was unable to compile until I made the change in MyProject.Build.cs from this :
public bool LoadMyModule(TargetInfo Target)
to this:
public bool LoadMyModule(ReadOnlyTargetRules Target)
Still not sure if everything is working correctly but it compiles now.

I think I was unable to compile for another reason, but this change did resolve a compiler warning.

First of all thank you for the plugin, but now I face some bad situation, I now use the UE4 version is 4.192, I put the inside of the plug-in (Binaries, Plugins, ThirdParty) the three root folder copy to my UE4 project, but later UE4 error, error prompt content as follows:
(Running C: / Program Files/Epic19 / Engine/Games/UE_4 Binaries/DotNET/UnrealBuildTool. Exe - projectfiles - project = "D: / UnrealProjects/TestOpenCV TestOpenCV uproject" - game - rocket - the progress
Alias modules, targets and source code for project...
While the compiling D: \ UnrealProjects \ TestOpenCV/Intermediate/Build/BuildRules \ TestOpenCVModuleRules DLL:
ERROR: d:\UnrealProjects, TestOpenCV, Plugins, OpenCV\OpenCV, OpenCV\ opencv. build.cs (16,9) : ERROR CS1729:?UnrealBuildTool. ModuleRules?????????????A?0?????????????Ĺ??캯??
ERROR: d:\UnrealProjects, TestOpenCV, Plugins, OpenCV\OpenCV, OpenCV\ opencv. build.cs (29,83) : ERROR CS0122:?UnrealBuildTool. BuildConfiguration???????ɷ??ʣ???Ϊ???ܱ?????????????
ERROR: UnrealBuildTool Exception: Unable to compile source files.)

Also prompted in vs2017 is the opencv.build.cs script error message :(the severity code indicates that the project file line is not allowed to display status
Error d: UnrealProjects, TestOpenCV, Plugins, OpenCV, Source\OpenCV, opencv. build.cs (29,83) : error CS0122:"UnrealBuildTool. BuildConfiguration" inaccessible because it protected level limit TestOpenCV D: \ UnrealProjects \ TestOpenCV \ Intermediate \ ProjectFiles \ UnrealBuildTool 1
I hope you can help me. Thank you very much

Unable to compile in 4.20，the file opencv. build.cs have too much error

I modified the build script to work on the latest unreal 4.21, hope it helps someone :)
[https://gist.github.com/PreyK/b56f310b225f2308398706b158913b45]


Session token expirey

After ~24 hours the DBD session token will expire, and then you cannot use the API, though i tried to counter this by adding a check for the return and re-generating it seems to still not work. (which is why the backend just restarts the dotnet app every 10 hours or so)

So, with that, just send empty post request to api/v1/me/logout.
You can see it makes a difference, when You try to login twice in a row without logging out, even with different steam tokens, the second request will have the same TokenId and won't have full body.


fix(llvm) change return type of LLVMLookupIntrinsicID function(s) in generated bindings from void to (unsigned) int

As the title suggests, this fixes the LLVMLookupIntrinsicID family of functions in the generated bindings to allow accessing things like llvm.trap and llvm.debugtrap.

Don't wanna be annoying but i'm just gonna.. @Spasi bump again xP

@KitsuneAlex thanks!

No, thank you good sir! :)


Inconsistent tests and code bloat

Currently, the tests are extremely scattershot. This is detrimental to code maintainability.
We should try to refactor the tests to be more standardised (e.g. use test_rng() or XorshiftRng?), extract the common elements. Similar to what is done in algebra-bench and algebra/tests

The test-templates repo has moved to algebra, and all the tests are consistent now.


Added local cache

The work in this PR was done by sethmoo.

This PR has the local cache changes, but is missing the second changeset in which the cache is integrated into the fetch.
@soccerGB, did you intend to make two PRs? If so, that's actually not a bad idea. I really like keeping changes separate.

@soccerGB
After https://github.com/Microsoft/Azure-DCAP-Client/pull/20  is merged , please rebase and run the tests again

Hello @soccerGB!
I found why the CI fails with this PR, but succeeds on the master branch.
In this PR, we have a new binary tests that is built by the make check target. As part of the CI testing, we build the Azure-DCAP-Client inside a Docker container (using base ubuntu1604 Docker image). Unfortunately, due to the fact that Jenkins runs the command using the Jenkins user, the  tests binary gives segmentation fault when executed, because the Jenkins user is not present in the container. Snippet from the Jenkins log:
[Non-Simulation Container SGX1-FLC RelWithDebInfo] LD_LIBRARY_PATH=`dirname libdcap_quoteprov.so ` ./tests
[Non-Simulation Container SGX1-FLC RelWithDebInfo] Segmentation fault (core dumped)

Recall that this happens ONLY if you execute the tests binary inside a container with an unknown user. I fixed this by creating the Jenkins user in the Docker container image.
This is the pull request with my fix https://github.com/Microsoft/Azure-DCAP-Client/pull/24.
I already successfully validated this fix by adding it on top of your pull request here. And the CI is green!
Please merge https://github.com/Microsoft/Azure-DCAP-Client/pull/24 and rebase this pull request on top of the new master branch.
Best regards,
Ionut


Updated details

Update my details in contributors.js and contributors.md

Good job @varunKT001 .
Congrats 🎉, your PR got merged. To be eligible for the swags from ClueLess. Follow this steps.

SignIn / SignUp in ClueLess Website.

Go to profile section from the top right hand corner.

Comment your profile URL under this comment tagging the person who merged your PR.

That’s it. Follow the leaderboard !
And don’t forget to share your achievement with your friends.

@Rajdip019
Clueless Profle: Varun Kumar Tiwari
PS: I think you forgot to add the hacktoberfest-accepted label :)

That's not mandatory your contribution will get rejected in your profile with in 15 minutes. Still adding the tag! @varunKT001

Your contribution will get rejected in your profile with in 15 minutes.

Why so?

Please read the page of Hacktoberfest it's clearly written there.
And the leaderborad of clueless will be live with in a week.👀 @varunKT001

Please read the page of Hacktoberfest it's clearly written there

Ohh! I missed it, sorry 😞


Transfer ownership

@r-darwish, you're the main maintainer of this project now.
Would you like me to transfer the project to you?

Yes, thanks
On Fri, May 8, 2015, 00:25 Evan Hahn<EMAIL_ADDRESS>wrote:

@r-darwish https://github.com/r-darwish, you're the main maintainer of
this project now.
Would you like me to transfer the project to you?
—
Reply to this email directly or view it on GitHub
https://github.com/EvanHahn/pushbullet-cli/issues/16.


TraceDiagnosticObserver: Random Null Reference Exception

Describe the bug
We are randomly getting object reference exception from TraceDiagnosticObserver
Steps to reproduce
Not able to reproduce this issue and it's happening randomly
Expected behavior
Null Check should be added to handle this scenario
Environment (please complete the following information):

Platform: PCF
OS: Linux
.NET Core 3.1.0,
Steeltoe Version 2.4.3

Exception

Could you please prioritize this?

Not exactly sure why this is happening, but seems similar to https://github.com/dotnet/aspnetcore/issues/3219. Since we don't what other middleware are configured etc, I am adding a try/catch for these to log an error message and move on.

@vivekkjain @Sudhakar85  can you share the project dependencies and even startup / program for this or better a full project that can reproduce this. How random is it. Does it happen only at startup or at other times in the lifecycle of the app.

@hananiel  this is happening frequently and not limited to startup. As this might be due to health check. We have this application vmware tanzu where the instance are randomly crashing and restarting.

Program.cs
`
public static class Program
{
public static void Main(string[] args)
{
try
{
WebHostDefaultBuilder.CreateWebHostBuilder(args)
.UseStartup()
.ConfigureAppConfiguration((context, builder) =>
{
builder.AddConfigServer(context.HostingEnvironment.EnvironmentName, "XXXXXX");
})
.Build()
.Run();
}
catch (Exception ex)
{
Log.Fatal(ex, "Host Quit Unexpectedly");
}
finally
{
Log.CloseAndFlush();
}
}
}
Startup.cs
[ExcludeFromCodeCoverage]
public class Startup
{
public Startup(IConfiguration configuration)
{
Configuration = configuration;
}
public IConfiguration Configuration { get; }

public void ConfigureServices(IServiceCollection services)
{
	services.AddApiVersioning(options => options.AssumeDefaultVersionWhenUnspecified = true);
	services.Configure<CookiePolicyOptions>(options =>
	{
		// This lambda determines whether user consent for non-essential cookies is needed for a given request.
		options.CheckConsentNeeded = context => true;
		options.MinimumSameSitePolicy = SameSiteMode.None;
	});

	services.AddMvc(options =>
					{
						options.Filters.Add(new MiddlewareFilterAttribute(typeof(LocalizationPipeline)));
						options.Filters.Add(new MiddlewareFilterAttribute(typeof(ComponentConfigurationPipeline)));
						options.Filters.Add(new HttpResponseExceptionFilter());
					})
		.SetCompatibilityVersion(CompatibilityVersion.Version_3_0)
		.AddFeatureFolders();

	services.AddMemoryCache();

}

public void Configure(IApplicationBuilder app, IWebHostEnvironment env)
{
	app.UseStaticFiles();

	if (env.IsDevelopment())
	{
		app.UseDeveloperExceptionPage();
	}
	else
	{
		app.UseMiddleware<ErrorHandlerMiddleware>();
	}
	app.UseHsts();

	if (env.IsStaging() || env.IsProduction())
			app.UseHttpsRedirection();

	app.UseRouting();

	app.UseCookiePolicy();
	app.UseEndpoints(endpoint =>
	{
		endpoint.MapDefaultControllerRoute();
	});

	if (!env.IsDevelopment())
	{
		app.UseCloudFoundryActuators();
	}

	app.UseBrowserLink();

}

}
`

@Sudhakar85 this Startup.cs doesn't look right to me. Any UseCloudFoundryActuators must be preceded by AddCloudFoundryActuators.  Can you checkin a complete project somewhere or attach a zip file?

@hananiel , sorry i can't share entire code, yes i do have AddCloudFoundryActuators but not AddDistrubutedTracing.

@hananiel , as highlighted below, i can see the TraceDiagnosticObserver is registered inside AddCloudFoundryActuators

@Sudhakar85 Ok makes sense. Can you do me a favor and run this sample: https://github.com/SteeltoeOSS/Samples/tree/2.x/Management/src/AspDotNetCore/Tracing and see if you are getting the same error?
If you want you can comment out the addDistributedTracing ( which is only needed if you want traces exported to Zipkin).

@Sudhakar85  can you come on steeltoe slack and we can walk through this? steeltoeteam.slack.com

@Sudhakar85 After looking into this further, https://github.com/dotnet/aspnetcore/issues/11069  is another example of this sort of issue. The main thing seems to be multiple threads accessing the httpContext. The pattern we are using with DiagnosticListener in Steeltoe is a well-documented and widely used pattern and I don't see any other issues with the code. So I am suspecting some other element of the application code causing this issue. So unless we can have a reproduction project, we cannot troubleshoot anymore. So I am closing this ticket for now. Feel free to reopen with a small reproduction project if needed.


Loading of images on some sites

I have two problems with the performance of some sites from the territory of the CIS (Russia): blocked access from the territory of the Russian Federation on the site itself (not by providers in the Russian Federation) - e-hentai.org: is it possible to use your application to bypass (somehow) restrictions on this site?
And the second: -booru forums of a similar theme (simple arts on characters of geek-culture, and hentai) there are problems: sfw site: danbooru.donmai.us opens the pictures correctly, but gelbooru.com loads the thumbnails, but does not open the pictures. What do you think could be the matter?
I can’t remember exactly, but it seems I used to work with the "-1 -a" settings, but now it’s not working. Today I updated application to the latest version (used two outdated versions earlier) and still have a prob. :C

No response, closing.