SSOProviderInvalidToken: the SSO session has expired or is invalid

When using aws configure sso setting AWS_PROFILE=devsandbox does not let Pulumi authenticate. It fails with a generic message.
Expected behavior
pulumi up uses SSO auth

Current behavior
With this patch:

	if _, err := awsbase.GetCredentials(config); err != nil {
		fmt.Printf("THE ERROR WAS: %s\n", err)

		return fmt.Errorf("Wrapping error: %w", err)

		// return errors.New("unable to discover AWS AccessKeyID and/or SecretAccessKey " +
		// 	"- see https://pulumi.io/install/aws.html for details on configuration")
	}

I get:
  pulumi:pulumi:Stack (temp-aws-thingy-dev):
    THE ERROR WAS: no valid credential sources for  found.
    Please see
    for more information about providing credentials.
    Error: SSOProviderInvalidToken: the SSO session has expired or is invalid
    caused by: expected RFC3339 timestamp: parsing time "2021-04-03T01:19:00UTC" as "2006-01-02T15:04:05Z07:00": cannot parse "UTC" as "Z07:00"

Context (Environment)
aws-cli/2.1.29 Python/3.8.8 Darwin/19.6.0 source/x86_64 prompt/off

$ pulumi version
v2.23.1

Affected feature

Possibly related:
https://github.com/hashicorp/terraform-provider-aws/issues/17372

OK. I had a token from an older version of was-cli that was not compatible. Had to do this: rm -rf ~/.aws/cli/cache/*


How to use fontconfig in a derivation?

Issue description
To use some functions of the psychopy python library it is also necessary to use pyglet and to have access to the fonts. This fails for me. Is there a way to fix by exporting a fontconfig file?
Steps to reproduce
Minimal:
nix-shell --pure -p python -p pkgs.pythonPackages.pyglet
python
import pyglet
pyglet.lib.load_library('fontconfig')

Actual use:
I run nix-shell with the following default.nix:
with import <nixpkgs> {};

(let
  psychopy = pkgs.pythonPackages.buildPythonPackage rec {
       name = "psychopy-${version}";
       version = "1.85.1";

       src = pkgs.fetchurl{
         url = "https://github.com/psychopy/psychopy/archive/1.85.1.tar.gz";
         sha256 = "d6a487bd8617ec68c7e56b6a7a855f3fd19e12282463025ae209fbc68fcb34b5";
       };

       buildInputs = [pkgs.pythonPackages.configobj];
       propagatedBuildInputs = [pkgs.pythonPackages.configobj];

       meta = {
         homepage = "https://github.com/psychopy/psychopy/releases";
       };
  };

 in  pkgs.python.buildEnv.override rec {
extraLibs = with pkgs.pythonPackages; [fontconfig python configobj numpy scipy matplotlib pandas pyopengl pyglet pillow psychopy];
}
).env

then
cd ./result/lib/python2.7/site-packages/psychopy/demos//coder/stimuli/
python dots.py

N.B. The library seems to work as python face_jpg.py works fine.
Technical details

System: nixos unstable
nix-env (Nix) 1.11.9
Nixpkgs version: "17.09pre107928.65477dcd34"

See https://github.com/NixOS/nixpkgs/issues/25828#issuecomment-302003174 for an example.

Thank you for the pointer, but I am afraid it is not enough for me. Although I am trying to set up an environment for Psychopy, the code that I am trying to run needs Pyglet and it is pyglet that is not able to find the fontconfig. It also strikes me as puzzling that python libraries that need access to the location of fonts, such as matplotlib and pyglet, don't get those environment variables built for them.
In my case, the demos for psychopy that I am trying to run might need both matplotlib and pyglet. Is each of those going to require its own unique FONT_CONFIG line?
So, I appreciate your help, and I do think the inability to import pyglet and have it find the fonts it needs without setting special path variables is an issue, but I will close it as I am not going to pursue this further at this time. The lure or reproducibility is offset by the time required to figure out how to achieve it.
I did see your partial draft of a python tutorial, but it doesn't mention anything about run commands and the like which feature in your matplotlib comment. You might consider enclosing instructions for how to do something like this in your tutorial when you get back to it. I look forward to reading future versions.Thanks.

It also strikes me as puzzling that python libraries that need access to the location of fonts, such as matplotlib and pyglet, don't get those environment variables built for them.

Users typically do not use them in derivations (aside from my example and what you're looking for) and so therefore the derivations do not include them. We could add a fontconfig hook like I made.

In my case, the demos for psychopy that I am trying to run might need both matplotlib and pyglet. Is each of those going to require its own unique FONT_CONFIG line?

If I understand correctly, each demo will be a derivation. Therefore, each demo will have to have a fontconfig. Again, when using a hook, its very easy, just add the hook to the buildInputs and you're done.
Also, pyglet.lib.load_library('fontconfig') is likely using a FFI and we do not support that. Instead, we hardcode paths to libraries.


Add versioning support to DLPack APIs

xref https://github.com/dmlc/dlpack/issues/116

Currently, this PR adds a max_version kwarg, which assumes that a consumer can handle any version prior to the specified max version

It doesn't really. It indicates nothing beyond what the max version is, with the intended effect being "if the producer supports a version >max_version as well as one <=max_version, please return the latter.

Given that major versions indicate ABI breaks, would it be preferable to use something like semver ranges in order to be able to accommodate both min and max versions? This would allow a single kwarg for handling version support in a general way.

What does knowing the minimum version change? I think nothing, either way it's either okay or the user gets an error.

That puts the onus on the consumer to effectively support all versions if different producers vary in their supported max versions.

It doesn't, the consumer is free to raise an exception if it has dropped support for some old version.

@leofang I see that you self-requested a review. You have any further thoughts on this PR?

@rgommers do you have time to address the review, or should I take over this PR?

If you'd be able to take over @leofang, that would help I think. I'm not fully up to speed on what happened with the removed 1.0 tag, and am pretty swamped with the last mile for NumPy 2.0

@leofang Would you like me to go ahead and resolve the merge conflicts on this PR, so that you can just focus on making the updates?

If you have time, yes please, but otherwise no worries I'll get to it tonight or tomorrow 😓

@tqchen @seberg @rgommers @oleksandr-pavlyk Could you review the change here? We're finalizing the v2023 standard. Thanks! 🙂

Thanks for the updates! This looks ready to merge to me.

Thanks all, let's merge and refine if needed, then.


delays don't work

@rultor release, tag is 0.0.6

@rultor release, tag is 0.0.6

@yegor256 OK, I will release it now. Please check the progress here

@rultor release, tag is 0.0.6

@yegor256 Done! FYI, the full log is here (took me 2min)


net/wireguard: Check if wg-kmod exists; if so then hide in services

I think this is a quite small, handy, non-invasive change to hide the wireguard-go service when the kmod module is found on the OPNsense system. That should avoid any confusion going forward from end-users. The logic can be improved over time if needed.
root@OPNsense:~ # ls -lsh /boot/modules/if_wg.ko
144 -r-xr-xr-x  1 root  wheel   142K Jan 19 01:57 /boot/modules/if_wg.ko

root@OPNsense:~ # [ -f "/boot/modules/if_wg.ko" ] && echo true || echo false
true

root@OPNsense:~ # configctl wireguard status_kmod
true

If it returns true, the service will be hidden.
IMHO this should be included in 23.1 before GA and is an acceptable workaround/solution until a more complex solution has been found. Should avoid confusion, anger that e.g. start action not working or similar.
Closes #3268

Perhaps it would be beneficial to change the system to show the tunnel state instead. stop, start , restart are more or less operationally the same and likely beneficial to users.

Doesn't wg show provide the necessary information per interface?

Yes, it is identical. But when you have 4 tunnels up and 1 down, I wouldn't consider the wireguard service as down.
For wireguard-go the service is considered up, when the daemon is running - no matter how many tunnels are configured or active. And both implementations should have identical behavior. But as wireguard-kmod is a kernel module (and loaded automatically), I don't think you can actually replicate the same behavior.
In other words, I don't think we need a service status for the kmod implementation at all, as it's always loaded. The individual WG tunnels should be brought up/down in a different way. Maybe some kind of implementation as with ipsec to disable/enable then via simple click.

If you look at OpenVPN it’s trivial to register multiple instances per service and report each status individually.


fix: comment out image update status

Description
This just comments out the image update notifications in app because we can't consistently tell if an image has been updated yet and right now it's designed to always just say there's an updated image.
Motivation and Context
See https://github.com/tari-project/tari-launchpad/issues/104
How Has This Been Tested?
Manually

Closing this. Band-aid doesn't feel right. Feels like we have more info now to make a more informed decision / direction and get it working.


Refactor DecompilerMachine - use AstNode in stack

Currently we have stack and root field in the DecompilerMachine, but we can significantly simplify the class by using AstNode directly in stack. In this case you might need to change handlers logic a bit.

@volodya-lombrozo the puzzle #49 is still not solved.


Animated transitions on era steppers

What do you think about this content sliding in/out to the left and right? I think it could help with orientation in time, given we don't have a graphic indicator besides the date stamp.

In addition, I'm wondering about a transition for the thumbnail filmstrip below to make it clear that its content is linked to the era you've just stepped to. I'm not sure the loading indicators on each thumb are enough.
Should the whole filmstrip panel close and open with each step? Should a new panel slide upward and replace the existing? Should the thumbnails follow the text above and also slide in/out to the left and right?

This isn't super smooth, I guess because of all the photo elements being added at the same time, but it's there. As for the filmstrip panel itself, I added the era years to the tab. Maybe that helps?

Cool, I like it. It's pretty smooth for me actually. The filmstrip dates are a good, too. Should we also include the year here when you're on the map? Might not hurt, if it isn't too much trouble.


Fix issues and improve Saved Badges screen when no badges are saved

Please change Saved Badges screen as follows, when no badges are saved:

Ensure all design is showing on screen also for small screens
Simplify smiley to one color using the design of a "Badge Smiley" instead of a full colored smiley

Ok sir


Possibe bug while reading the tape buffer?

Hello,
For a small project i'm working in, i want to refactor some code out of the interrupt handler, specially calculating the pulse lengths in the main loop. That would produce a mismatch between the number of bytes read from the file, and the number of pulses to fire, as "overflow" bytes need 4 bytes if the version is not 0.
So, theoretically,  to correctly convert  X bytes from the file to pulses, i need to be sure the buffer grows, if necessary, up to X+3 bytes, in case the last byte read is 0x00 (overflow byte), and version is not 0.
So i went to check how this is managed in tapuino, but (correct me if i'm wrong) looks like a fixed chunk of  FAT_BUF_SIZE bytes are read, and the isr code is supposing that, if a 0x00 byte is found, the other 3 bytes do exist in the buffer
 if (tap_data != 0) {
          g_pulse_length_save = tap_data * g_cycle_mult_8;
        } else {
          g_pulse_length_save =  (unsigned long) g_fat_buffer[g_read_index++];
          g_pulse_length_save |= ((unsigned long) g_fat_buffer[g_read_index++]) << 8;
          g_pulse_length_save |= ((unsigned long) g_fat_buffer[g_read_index++]) << 16;
         ...
   }

So, if a 0x00 byte is found at g_fat_buffer[FAT_BUF_SIZE-1], arent those lines accessing unitialized memory?

I think you are correct. Amazingly this doesn't seem to have caused a problem in real life. Even more so as the potentially out of bound bytes are the most significant values of the timing signal and random data could really skew the value.
The issue for me is that the buffer swapping and handling is tightly coupled to the buffer size and would require significant rework to fix. I really need to rewrite this codebase at some point to use a more modern mcu like an ESP.

On further reflection this isn't actually a problem :)
The buffer that the data is read from is a 256 byte buffer, indexed by a byte-wide variable (g_read_index).
Think of the buffer as two 128 byte buffers joined together.
As the longer pulse lengths are computed 1 byte at a time, if the index is 255 it will overflow back to zero.
This is half of the story. What is happening outside of the interrupt is that the buffer index is monitored, as it moves to the 2nd half of the buffer, the first half is filled with an SD load and same as it moves to the first half.
This means that as long as the TAP data is valid, no uninitialized memory is accessed.


PDF JS opens a file encoded in gb2312 with garbled code

Attach (recommended) or Link to PDF file here:
Configuration:

Web browser and its version:Chrome 111.0.5563.149
Operating system and its version: Win10
PDF.js version:3.5.141
Is a browser extension:

Steps to reproduce the problem:
I opened a Chinese PDF file and displayed garbled code. The tracking code found that in the charToGlyph method of pdf.worker.js, a Chinese character is composed of two fontCharCodes. However, when the charToGlyph method parses it, it parses each fontCharCode as a separate character, resulting in garbled code. How can I solve this problem
What is the expected behavior? (add screenshot)

What went wrong? (add screenshot)

Link to a viewer (if hosted on a site other than mozilla.github.io/pdf.js or as Firefox/Chrome extension):

Attach (recommended) or Link to PDF file here:

compressed.tracemonkey-pldi-09.pdf


gofakeit.Number with too low min value panics

To reproduce:
gofakeit.Number(math.MinInt64, 0)
gofakeit.Number(math.MinInt64+1, 0)

However, this runs just fine:
gofakeit.Number(math.MinInt64+2, 0)

I'd suggest either checking for those two values in gofakeit.Number and circumvent them (with this being mentioned in the godoc), or panic with a more fitting error message


Default pagination option with PDF

Do I need to create a new custom renderer if I need the paginated state to false by default ? Or a config exist to customize the initialPDFState. Thank you
`export type IPDFState = {
zoomLevel: number;
paginated: boolean;
numPages: number;
currentPage: number;
mainState?: IMainState;
};
export const initialPDFState: IPDFState = {
zoomLevel: 1,
paginated: true,
numPages: 0,
currentPage: 1,
};`

Did you find a solution @fredc97?

@blackhill please try the following,
import * as state from 'react-doc-viewer/build/plugins/pdf/state/reducer';
state.initialPDFState.paginated = false;

@zhuweicz your solution, works for me.. thanks..


chore: change the code owners of "/docs/" and "/tensorbay/client/"

/docs/: @Lee-000 -> @graczhual
/tensorbay/client/: @rexzheng324-c -> @AChenQ

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 86.31%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
6065

Relevant Lines:
7027

💛  - Coveralls


composer.json suggestion in README.md is wrong

{
    "require": {
        "nfauchelle\PhergieKeepAlive": "dev-master"
    }
}

Firstly, it's not valid JSON - / instead of \.
Secondly, the composer.json requires the name on packagist: "nfauchelle/phergie-keep-alive".

Note that this becomes obsolete when you follow my advice in #3.

This is sorted :)


[65] Remove the registration feature

Resolves #65

Description

Removed the sign-up feature from the app

Type of change

Breaking change (fix or feature that would cause existing functionality to not work as expected)

@garettarrowood I removed the registration feature


Typo

Second sentence, there is a typo. "Use is to create conditions that contain condition expressions."
I think you meant it.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 45242659-a731-0b7f-7cce-73856b350391
Version Independent ID: 9a138c9c-3379-03cc-51ec-dff50c6efa38
Content: Administer servers using Policy-Based Management - SQL Server
Content Source: docs/relational-databases/policy-based-management/administer-servers-by-using-policy-based-management.md
Product: sql
Technology: security
GitHub Login: @VanMSFT
Microsoft Alias: vanto

@jrmclennan -- thank you for catching this.  I am updating the article.


[Suggestion] Go to this localisation

It 'll be great if it was possible to have a tool "go here" at the click of the mouse.
What do you think?

yea, this would be a good feature to implement


Account Lockout

Just like any website / email:
If a user attempted more than the allowed amount of tries (config option)  it will tempban the account for X amount of time (config option)

players can brutefoce any password without this

Added in the last commit.


Proper installation of redis+hiredis library on RPi4

Hello,
I'm trying to setup RPi4 to connect to external Redis server (connected through TCP/IP).
Redis-server 6.2.6 (along with client) is installed using https://redis.io/topics/quickstart guide on both, client (RPi), and server machine.
Server itself is running on Ubuntu(WLS), and I can interact with it through redis-cli on raspberry. Server is configured in unprotected mode (because net is local) with password.
"Hiredis" is installed with
git clone https://github.com/redis/hiredis.git
make
make install
Demo program (taken from https://programmer.group/5c14b1b42b192.html) ends with timeout error. As I understand, this happens because conn = redisConnectWithTimeout(hostname, port, timeout); returns err to conn. So it create connection but with error.
Demo program (example.c modified to be able to make authentication) ends with same Connection error: Connection timed out.
What can be a problem? What is proper way to install all necessary on raspberry?

Closing this old issue, but I'm happy to help if you are still having trouble.


Indonesian Translation

Language
Indonesian
Can you help with the translation?
Yes

Hi @elmotan95 thanks for your interest. A branch named "lang/id" has been created and you can see 4 string files in id.lproj
For each file you will see several "some identifier here" = "some text in English here"; and only "some text in English here" part need translation. Besides, /* ... */ are comments and they don't need translation.
Thanks!


Docfix leaf documentation in attributes docs

Docfix for Attributes section in the advanced section

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Thanks!


Fix readme

Coverage remained the same at 57.895% when pulling 0334b45180e78283db24b52bb403164ec451f231 on fix_readme into ad97146d7332b6834a3990d358a6885ba2516d3d on master.

Coverage remained the same at 57.895% when pulling 0334b45180e78283db24b52bb403164ec451f231 on fix_readme into ad97146d7332b6834a3990d358a6885ba2516d3d on master.


Promods is not available

Support for Promods should be added as well. The map isn't shown exactly as in the game, because I'm playing on TruckersMP with Promods.

Hi! At the moment, you can download the map for Promod via 4.0.7 version, the archive name is Additional_ets2_PROMOD-RUSMAP_v148.7z

Oh, great! But there are two config.json files, what I should do?

config.json is not required.
The most important thing is the tiles and the js folder
Just replace everything

So I just have to extract the titles and the js folder in a mobile-advisor directory?

Yes, for reliability, you can even completely delete tiles and js in ets2-mobile-route-advisor and then unpack the tiles and js folders from the Promod archive to this place.

I tried that, but I'm still seeing an incorrect map (the usual map that doesn't include cities that are in Promods only, as well as cities that are having changes in Promods).

What if get version 4.0.6? Is the situation similar?

It's not any better.

Promod added in ver 4.0.8 release in a separate archive .7z


Dracula for LimeChat

Repo
I suppose still a work in progress but updating as I go along.

Anything new with this? Feedback or anything?

I tried to get in touch with @zenorocha on Slack to see how I could help him maintain the organization. Hopefully he'll see this and maybe reach out soon.

@zenorocha let me know what you're thinking about this issue. At the least, some feedback would be nice so I could improve.

Hey @shmink 👋 Would you like to move the theme to the organization?

Yes that sounds great. The only issue is I no longer have a mac to test and update the theme for limechat and future updates. With that in mind however the code should all be fine and with your approval, I'll go ahead and do what you suggest,

Just sent you the invite! Let me know once you've move the repo and I'll change the permissions.
I wouldn't worry too much about that for now. If there's anything that needs to be updated people will probably open a issue to complain about it. I'll add myself as a member of the team to make sure I'm also notified 👍

Apologies for the tardy responses. I haven't received any invitation I'm afraid. With that, I'll be able to move the repo to the organisation?

Update: There was definitely no notification that I received but I just used the following answer to accept. I then went into the settings of my limechat repo and transferred the ownership to dracula. Hopefully, that's worked out.

Just changed the repo name and set the right permissions. Let me know if you need my help with anything else. Thank you for your contribution!


Known Issues in AWS Iot SDK C++

Hi,
I successfully made the sdk targets. But when I'm running them through Visual Studio, I get linking errors. I saw that there are some known issues in the SDK. The source has mentioned,
"Project structure in Solution Explorer needs to be updated" and "Working directory needs to be updated every time CMake solution is rebuilt to ${OutDir} for configuration to be picked up as expected".
Can someone please explain me how to achieve above?
Thank you

Hi @Preemali ,
you can change the working directory on visual studio under:
Open Project > Properties > Configuration Properties > Debugging.

Can you please post the full build output so we can see the specific linker error?

I'd also like to mention that we have a completely new version of the SDK. It is a complete rewrite, and it is where we will be focusing our features and stability efforts going forward:
aws-iot-device-sdk-cpp-v2
If you're just getting started on a new project, I would strongly advise starting with the new SDK

@KaibaLopez Do I need to change it for all the projects including ALL_BUILD, ZERO_CHECK and INSTALL? I changed the working directory for all projects except above three.

@graebm  I was able to correct the linking errors after adding libeay32MD.lib to additional dependencies in the project. Now there are no building errors. But I cannot run the project. It says something similar to  "ZERO_CHECK cannot start. Access is denied."
My project requires mqtt client in the sdk. Because I have to publish and subscribe to a system via iot.  Can I still use version 2 for my project? I didn't see pub-sub sample in the v2.

Yes, you can still use version 2 to publish and subscribe to any topic.
I just added pub-sub samples, try getting latest.

@graebm Thanks a lot mate.


IE11 fromJS bug

Version v4.0.0-rc.12
Function fromJS.
example:
console.log(fromJS({test: 'qqq'}))
In most of the browsers it returns Map object, but IE11 returns the same object.
Other case:
console.log(fromJS([{test: 'qqq'}]))
In most of the browsers it returns List and Map as first element, but IE11 returns List and initial object.
Version 3.8.2 works as expected

Any chance this will be addressed? It completely broke my application on internet explorer as I use fromJS a lot.
I can confirm that the issue was introduced with 4.0.0-rc10, up to  4.0.0-rc9 everything works fine

@thenano I had the same issue and was able to fix it installing the core-js es6.function.name polyfill.

List structure seems to be broken by using .concat() on IE11 on 4.0.0-rc.12.
But v3.8.2 works good.
Is it related to this issue?
How to reproduce
Please open below by IE11.
http://another.geniee.jp/test/ysato/immutable-bug/map.html
var MyRecord = Immutable.Record({a: 1});
var list = Immutable.List([]);
list = list.concat([new MyRecord({a: 2}), new MyRecord({a: 3})]);
console.log(JSON.stringify(list));
// from Chrome: [{"a":2},{"a":3}]
// from IE11: [[{"a":2},{"a":3}]]     <- it is incorrect

@cauethenorio You're the real mvp, the polyfill fixed it for me.

Thank you for your bug report. The immutable-js oss fork will soon be merged and a fix for this issue has been included in #1833. Once this PR is merged, this issue will be resolved in the main branch. We will then do our best to to release the 4.0.0 version.
Commit reference: https://github.com/immutable-js/immutable-js/pull/1833/commits/f3a6d5ce75bb9d60b87074240838f5429e896b60


Extension reported as Trojan by ESET

Output from ESET Endpoint Security:
2018-10-09 2:55:48 PM
Real-time file system protection
C:\Users\<username>\.vscode\extensions\eamodio.gitlens-8.5.6\out\extension.js
a variant of Generik.DHSMSJE trojan
cleaned by deleting
Event occurred during an attempt to access the file by the application: C:\Users\<username>\AppData\Local\Programs\Microsoft VS Code\Code.exe

GitLens Version: 8.5.6

VSCode Version: 1.27.2
OS Version: Windows 10

Steps to Reproduce:
I had GitLens installed for quite some time now, this appeared while working in vscode.

Yep same here with exactly the same file. ESET just deleted the file and GitLens stopped working :(

VS Code version: 1.28.0
GitLens version 8.5.6
OS: windows 10

Same thing here.
GitLens: 8.5.6
VS Code: 1.28.0
OS: macOS Sierra 10.12.6

Interestingly enough, I have downloaded, extracted the vsix file from the release page, scanned it with Eset manually and found nothing. When installing it as a plugin from the marketplace, it is infected.
Could it be that the marketplace file is hijacked and infected?

I had the same problem. Scanning the extension.js file with VirusTotal shows that ESET is the only program flagging it as malicious. False positive?
https://www.virustotal.com/#/file/a81e9e9ee185c98648db5701a72f0cb9ae9fd4fd2a58a5d6a517d6e4345440e7/detection

I'm not sure what to say on this one -- I've scanned the files and everything comes up clean, and Microsoft scans the extensions as they are published to the marketplace. This must be a false positive. I also can't seem to find a way to report it to ESET as a false positive. Anyone know how?

Also from the virustotal scan, it seems that ESET is now reporting it clean. Does anyone still see this issue after ensuring ESET is up to date?

Closing this as it is a false positive


Hyperfridge last milestone amendment

just changed the duration to 5 month from the delivery of the last milestone. let me know if this works.
thanks for patience @keeganquigley

Thanks @dastansam could you please explain the reason for this change and give an update on the current progress?

the main reason is availability and an additional effort that was spent to upgrade some on-chain and offchain components. And current progress is that, we are done with the auxillary changes and working on completing the UI component


Python version is located on other side and in a different format to TypeScript

Python extension on left side:

TS extension on right side:

Can the Python extension move it to the right side next to the language selector and remove the word Python to align it with how the same feature in TS works?

Duplicate of https://github.com/microsoft/vscode-python/issues/5429


Problem running the speaker embedding network while training from scratch.

Hi @caizexin ,
I have been trying to implement your work on my own dataset. I am trying to run the speaker embedding network in the deep_speaker folder using python train.py, but I keep running into this error:
Automatic speaker valification training set to a maximum of 300000 steps.
2021-02-22 20:42:02.327491: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX AVX2
2021-02-22 20:42:02.358786: I tensorflow/stream_executor/platform/default/dso_loader.cc:42] Successfully opened dynamic library nvcuda.dll
2021-02-22 20:42:02.446559: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1640] Found device 0 with properties:
name: GeForce RTX 2080 Ti major: 7 minor: 5 memoryClockRate(GHz): 1.545
pciBusID: 0000:17:00.0
2021-02-22 20:42:02.463437: I tensorflow/stream_executor/platform/default/dlopen_checker_stub.cc:25] GPU libraries are statically linked, skip dlopen check.
2021-02-22 20:42:02.476295: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1763] Adding visible gpu devices: 0
2021-02-22 20:42:03.162290: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1181] Device interconnect StreamExecutor with strength 1 edge matrix:
2021-02-22 20:42:03.170635: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1187]      0
2021-02-22 20:42:03.179616: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1200] 0:   N
2021-02-22 20:42:03.188728: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1326] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8616 MB memory) -> physical GPU (device: 0, name: GeForce RTX 2080 Ti, pci bus id: 0000:17:00.0, compute capability: 7.5)
Loading checkpoint voxmyst_resnet34\gvector.ckpt-0
WARNING:tensorflow:From C:\Users\rjain\AppData\Local\Continuum\anaconda3\envs\mstts\lib\site-packages\tensorflow\python\training\saver.py:1276: checkpoint_exists (from tensorflow.python.training.checkpoint_management) is deprecated and will be removed in a future version.
Instructions for updating:
Use standard file APIs to check for files with this prefix.
2021-02-22 20:42:09.033503: W .\tensorflow/core/framework/model.h:213] Encountered a stop event that was not preceded by a start event.
Exiting due to exception: 2 root error(s) found.
  (0) Invalid argument: 1-th value returned by pyfunc_0 is int32, but expects int64
         [[{{node PyFunc}}]]
         [[IteratorGetNext]]
         [[resnet/unit_2_1/sub1/bn1/AssignMovingAvg/AssignSub/_1213]]
  (1) Invalid argument: 1-th value returned by pyfunc_0 is int32, but expects int64
         [[{{node PyFunc}}]]
         [[IteratorGetNext]]
0 successful operations.
0 derived errors ignored.
Traceback (most recent call last):
  File "C:\Users\rjain\AppData\Local\Continuum\anaconda3\envs\mstts\lib\site-packages\tensorflow\python\client\session.py", line 1356, in _do_call
    return fn(*args)
  File "C:\Users\rjain\AppData\Local\Continuum\anaconda3\envs\mstts\lib\site-packages\tensorflow\python\client\session.py", line 1341, in _run_fn
    options, feed_dict, fetch_list, target_list, run_metadata)
  File "C:\Users\rjain\AppData\Local\Continuum\anaconda3\envs\mstts\lib\site-packages\tensorflow\python\client\session.py", line 1429, in _call_tf_sessionrun
    run_metadata)
tensorflow.python.framework.errors_impl.InvalidArgumentError: 2 root error(s) found.
  (0) Invalid argument: 1-th value returned by pyfunc_0 is int32, but expects int64
         [[{{node PyFunc}}]]
         [[IteratorGetNext]]
         [[resnet/unit_2_1/sub1/bn1/AssignMovingAvg/AssignSub/_1213]]
  (1) Invalid argument: 1-th value returned by pyfunc_0 is int32, but expects int64
         [[{{node PyFunc}}]]
         [[IteratorGetNext]]
0 successful operations.
0 derived errors ignored.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "train.py", line 113, in <module>
    step, _, loss, acc = sess.run(fetches=fetches, feed_dict=feed_dict)
  File "C:\Users\rjain\AppData\Local\Continuum\anaconda3\envs\mstts\lib\site-packages\tensorflow\python\client\session.py", line 950, in run
    run_metadata_ptr)
  File "C:\Users\rjain\AppData\Local\Continuum\anaconda3\envs\mstts\lib\site-packages\tensorflow\python\client\session.py", line 1173, in _run
    feed_dict_tensor, options, run_metadata)
  File "C:\Users\rjain\AppData\Local\Continuum\anaconda3\envs\mstts\lib\site-packages\tensorflow\python\client\session.py", line 1350, in _do_run
    run_metadata)
  File "C:\Users\rjain\AppData\Local\Continuum\anaconda3\envs\mstts\lib\site-packages\tensorflow\python\client\session.py", line 1370, in _do_call
    raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InvalidArgumentError: 2 root error(s) found.
  (0) Invalid argument: 1-th value returned by pyfunc_0 is int32, but expects int64
         [[{{node PyFunc}}]]
         [[IteratorGetNext]]
         [[resnet/unit_2_1/sub1/bn1/AssignMovingAvg/AssignSub/_1213]]
  (1) Invalid argument: 1-th value returned by pyfunc_0 is int32, but expects int64
         [[{{node PyFunc}}]]
         [[IteratorGetNext]]
0 successful operations.
0 derived errors ignored.

I have preprocessed the dataset as per the instructions mentioned in the repo. Here is an example:
data_voxtest.zip
I can't really find a workaround for this. Any help is appreciated.
Thanks in advance.

I would also appreciate if you have any documentation for training from scratch. I am sure it will also help the others who try to implement your work from the scratch. Your paper is really interesting and I am trying to reimplement it with my own dataset. So any help is really appreciated for reimplementing your work from scratch.

Hi Rishabh, I assume you are running the code on a Windows system. The error is raised because Windows and Linux system have different default integer type. I think the answer from this link may help you.  However, it's strange that the process raise an error on node unit_2_1 while pass other nodes like (unit_0_0, 1_0), and I did not see any return integer here or in the feed dictionary.
My advice for this issue would be

I suspect that the main problem is not from the line specified in the error log. Try to assign x before or after this line to another variable and run a session that fetch the value of this variable to see if the problem is caused by any specific node. It may be a general issue that is difficult to identify which function or assignment causes the error.
Since I do not have a windows machine for debugging, I would recommend you to train on ubuntu or other linux machines if you have one.

Hi @caizexin,
Thank you so much for your help and getting back to me.

Hi Rishabh, I assume you are running the code on a Windows system. The error is raised because Windows and Linux system have different default integer type. I think the answer from this link may help you. However, it's strange that the process raise an error on node unit_2_1 while pass other nodes like (unit_0_0, 1_0), and I did not see any return integer here or in the feed dictionary.

Yes, I am using a windows machine at the moment. I don't have a Linux machine, but I think I can try installing docker and find a workaround for that. I did read that link before that you have mentioned above and tried changing the integer type in the code itself but that didn't work (Just to give you an update).

My advice for this issue would be

I suspect that the main problem is not from the line specified in the error log. Try to assign x before or after this line to another variable and run a session that fetch the value of this variable to see if the problem is caused by any specific node. It may be a general issue that is difficult to identify which function or assignment causes the error.

I didn't quite understand what you mean here by assigning x to another variable and run session to fetch the value of this variable. I am new to tensorflow so it would be great if you can give me an example on how to do this?
Do you mean something like this?
x = tf.Variable([1.0, 2.0])
init = tf.global_variables_initializer()
with tf.Session() as sess:
    sess.run(init)
    v = sess.run(x)
    print(v)

Another thing is that the line you have mentioned above belongs to the Resnet.py in the feedback_synthesizer/models/embedding/Resnet.py but what I am trying to run is the speaker embedding model in deep_speaker folder which contains a different resnet.py. I can see that both the directory contains similar files and folder but they do have a difference in resnet.py and Resnet.py. So shouldn't I modify the resnet.py in deep_speaker folder? Not sure if they are connected somehow.

Since I do not have a windows machine for debugging, I would recommend you to train on ubuntu or other Linux machines if you have one.

Yes, I will try to prepare a Linux machine and will try running my experiment again on that as well to see if it works.

Just to give you an update, I started my encoder training again using Docker Ubuntu machine and my model seems to be working on it. I still have some doubts though. Let's hope it works fine for now.

Great. Good to hear that things are getting better. Just to answer your previous question regrading variable assignment and debugging. What I meant is that we can assign the x after that line in resnet.py (sorry I was referring to the wrong Resnet.py last time) to a variable named self.tmp_var.
self.tmp_var = x

Then in the training code, instead of fetching our results with fetches = [train_resnet.global_step, train_resnet.train_op, train_resnet.cost, train_resnet.accuracy], you can use fetches = [train_resnet.tmp_var] to get the x value.
Good luck.

Got it. Thanks a ton. I will try it out over the windows machine to see if I coud figure out the problem.
I have another query which I have been trying to figure out. So I think dataset that I am using might contain some empty folders or folders with voices having small duration. I am not so sure about that. That's what I inferred from the error I am getting. I have tried a few things I found online but couldn't get my head around it. So my embedding model runs for around 1000 steps (approx.) and gives the following error.
W tensorflow/core/framework/op_kernel.cc:1490] Invalid argument: ValueError: can't extend empty axis 0 using modes other than 'constant' or 'empty'
Traceback (most recent call last):

  File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/ops/script_ops.py", line 209, in __call__
    ret = func(*args)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/feeder_wav.py", line 49, in _parse_func
    fbanks = self._process_wave(wav_file.decode(), num_frames)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/feeder_wav.py", line 30, in _process_wave
    wav = audio.trim_silence(wav, audio_hparams)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/datasets/audio.py", line 36, in trim_silence
    return librosa.effects.trim(wav, top_db= hparams.trim_top_db, frame_length=hparams.trim_fft_size, hop_length=hparams.trim_hop_size)[0]

  File "/opt/conda/lib/python3.7/site-packages/librosa/effects.py", line 498, in trim
    y, frame_length=frame_length, hop_length=hop_length, ref=ref, top_db=top_db

  File "/opt/conda/lib/python3.7/site-packages/librosa/effects.py", line 448, in _signal_to_frame_nonsilent
    mse = feature.rms(y=y_mono, frame_length=frame_length, hop_length=hop_length) ** 2

  File "/opt/conda/lib/python3.7/site-packages/librosa/feature/spectral.py", line 925, in rms
    y = np.pad(y, int(frame_length // 2), mode=pad_mode)

  File "<__array_function__ internals>", line 6, in pad

  File "/opt/conda/lib/python3.7/site-packages/numpy/lib/arraypad.py", line 816, in pad
    "'constant' or 'empty'".format(axis)

ValueError: can't extend empty axis 0 using modes other than 'constant' or 'empty'

2021-03-03 11:54:54.504139: W tensorflow/core/framework/op_kernel.cc:1490] Invalid argument: ValueError: can't extend empty axis 0 using modes other than 'constant' or 'empty'
Traceback (most recent call last):

  File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/ops/script_ops.py", line 209, in __call__
    ret = func(*args)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/feeder_wav.py", line 49, in _parse_func
    fbanks = self._process_wave(wav_file.decode(), num_frames)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/feeder_wav.py", line 30, in _process_wave
    wav = audio.trim_silence(wav, audio_hparams)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/datasets/audio.py", line 36, in trim_silence
    return librosa.effects.trim(wav, top_db= hparams.trim_top_db, frame_length=hparams.trim_fft_size, hop_length=hparams.trim_hop_size)[0]

  File "/opt/conda/lib/python3.7/site-packages/librosa/effects.py", line 498, in trim
    y, frame_length=frame_length, hop_length=hop_length, ref=ref, top_db=top_db

  File "/opt/conda/lib/python3.7/site-packages/librosa/effects.py", line 448, in _signal_to_frame_nonsilent
    mse = feature.rms(y=y_mono, frame_length=frame_length, hop_length=hop_length) ** 2

  File "/opt/conda/lib/python3.7/site-packages/librosa/feature/spectral.py", line 925, in rms
    y = np.pad(y, int(frame_length // 2), mode=pad_mode)

  File "<__array_function__ internals>", line 6, in pad

  File "/opt/conda/lib/python3.7/site-packages/numpy/lib/arraypad.py", line 816, in pad
    "'constant' or 'empty'".format(axis)

ValueError: can't extend empty axis 0 using modes other than 'constant' or 'empty'

2021-03-03 11:54:54.561372: W tensorflow/core/framework/op_kernel.cc:1490] Invalid argument: ValueError: can't extend empty axis 0 using modes other than 'constant' or 'empty'
Traceback (most recent call last):

  File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/ops/script_ops.py", line 209, in __call__
    ret = func(*args)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/feeder_wav.py", line 49, in _parse_func
    fbanks = self._process_wave(wav_file.decode(), num_frames)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/feeder_wav.py", line 30, in _process_wave
    wav = audio.trim_silence(wav, audio_hparams)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/datasets/audio.py", line 36, in trim_silence
    return librosa.effects.trim(wav, top_db= hparams.trim_top_db, frame_length=hparams.trim_fft_size, hop_length=hparams.trim_hop_size)[0]

  File "/opt/conda/lib/python3.7/site-packages/librosa/effects.py", line 498, in trim
    y, frame_length=frame_length, hop_length=hop_length, ref=ref, top_db=top_db

  File "/opt/conda/lib/python3.7/site-packages/librosa/effects.py", line 448, in _signal_to_frame_nonsilent
    mse = feature.rms(y=y_mono, frame_length=frame_length, hop_length=hop_length) ** 2

  File "/opt/conda/lib/python3.7/site-packages/librosa/feature/spectral.py", line 925, in rms
    y = np.pad(y, int(frame_length // 2), mode=pad_mode)

  File "<__array_function__ internals>", line 6, in pad

  File "/opt/conda/lib/python3.7/site-packages/numpy/lib/arraypad.py", line 816, in pad
    "'constant' or 'empty'".format(axis)

ValueError: can't extend empty axis 0 using modes other than 'constant' or 'empty'

Exiting due to exception: ValueError: can't extend empty axis 0 using modes other than 'constant' or 'empty'
Traceback (most recent call last):

  File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/ops/script_ops.py", line 209, in __call__
    ret = func(*args)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/feeder_wav.py", line 49, in _parse_func
    fbanks = self._process_wave(wav_file.decode(), num_frames)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/feeder_wav.py", line 30, in _process_wave
    wav = audio.trim_silence(wav, audio_hparams)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/datasets/audio.py", line 36, in trim_silence
    return librosa.effects.trim(wav, top_db= hparams.trim_top_db, frame_length=hparams.trim_fft_size, hop_length=hparams.trim_hop_size)[0]

  File "/opt/conda/lib/python3.7/site-packages/librosa/effects.py", line 498, in trim
    y, frame_length=frame_length, hop_length=hop_length, ref=ref, top_db=top_db

  File "/opt/conda/lib/python3.7/site-packages/librosa/effects.py", line 448, in _signal_to_frame_nonsilent
    mse = feature.rms(y=y_mono, frame_length=frame_length, hop_length=hop_length) ** 2

  File "/opt/conda/lib/python3.7/site-packages/librosa/feature/spectral.py", line 925, in rms
    y = np.pad(y, int(frame_length // 2), mode=pad_mode)

  File "<__array_function__ internals>", line 6, in pad

  File "/opt/conda/lib/python3.7/site-packages/numpy/lib/arraypad.py", line 816, in pad
    "'constant' or 'empty'".format(axis)

ValueError: can't extend empty axis 0 using modes other than 'constant' or 'empty'

         [[{{node PyFunc}}]]
         [[IteratorGetNext]]
Traceback (most recent call last):
2021-03-03 11:55:01.787093: W tensorflow/core/framework/op_kernel.cc:1490] Invalid argument: ValueError: can't extend empty axis 0 using modes other than 'constant' or 'empty'
Traceback (most recent call last):

  File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/ops/script_ops.py", line 209, in __call__
    ret = func(*args)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/feeder_wav.py", line 49, in _parse_func
    fbanks = self._process_wave(wav_file.decode(), num_frames)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/feeder_wav.py", line 30, in _process_wave
    wav = audio.trim_silence(wav, audio_hparams)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/datasets/audio.py", line 36, in trim_silence
    return librosa.effects.trim(wav, top_db= hparams.trim_top_db, frame_length=hparams.trim_fft_size, hop_length=hparams.trim_hop_size)[0]

  File "/opt/conda/lib/python3.7/site-packages/librosa/effects.py", line 498, in trim
    y, frame_length=frame_length, hop_length=hop_length, ref=ref, top_db=top_db

  File "/opt/conda/lib/python3.7/site-packages/librosa/effects.py", line 448, in _signal_to_frame_nonsilent
    mse = feature.rms(y=y_mono, frame_length=frame_length, hop_length=hop_length) ** 2

  File "/opt/conda/lib/python3.7/site-packages/librosa/feature/spectral.py", line 925, in rms
    y = np.pad(y, int(frame_length // 2), mode=pad_mode)

  File "<__array_function__ internals>", line 6, in pad

  File "/opt/conda/lib/python3.7/site-packages/numpy/lib/arraypad.py", line 816, in pad
    "'constant' or 'empty'".format(axis)

ValueError: can't extend empty axis 0 using modes other than 'constant' or 'empty'

2021-03-03 11:55:01.788145: W tensorflow/core/framework/op_kernel.cc:1490] Invalid argument: ValueError: can't extend empty axis 0 using modes other than 'constant' or 'empty'
Traceback (most recent call last):

  File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/ops/script_ops.py", line 209, in __call__
    ret = func(*args)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/feeder_wav.py", line 49, in _parse_func
    fbanks = self._process_wave(wav_file.decode(), num_frames)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/feeder_wav.py", line 30, in _process_wave
    wav = audio.trim_silence(wav, audio_hparams)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/datasets/audio.py", line 36, in trim_silence
    return librosa.effects.trim(wav, top_db= hparams.trim_top_db, frame_length=hparams.trim_fft_size, hop_length=hparams.trim_hop_size)[0]

  File "/opt/conda/lib/python3.7/site-packages/librosa/effects.py", line 498, in trim
    y, frame_length=frame_length, hop_length=hop_length, ref=ref, top_db=top_db

  File "/opt/conda/lib/python3.7/site-packages/librosa/effects.py", line 448, in _signal_to_frame_nonsilent
    mse = feature.rms(y=y_mono, frame_length=frame_length, hop_length=hop_length) ** 2

  File "/opt/conda/lib/python3.7/site-packages/librosa/feature/spectral.py", line 925, in rms
    y = np.pad(y, int(frame_length // 2), mode=pad_mode)

  File "<__array_function__ internals>", line 6, in pad

  File "/opt/conda/lib/python3.7/site-packages/numpy/lib/arraypad.py", line 816, in pad
    "'constant' or 'empty'".format(axis)

ValueError: can't extend empty axis 0 using modes other than 'constant' or 'empty'

  File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1356, in _do_call
    return fn(*args)
  File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1341, in _run_fn
    options, feed_dict, fetch_list, target_list, run_metadata)
2021-03-03 11:55:01.793062: W tensorflow/core/framework/op_kernel.cc:1490] Invalid argument: ValueError: can't extend empty axis 0 using modes other than 'constant' or 'empty'
Traceback (most recent call last):

  File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/ops/script_ops.py", line 209, in __call__
    ret = func(*args)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/feeder_wav.py", line 49, in _parse_func
    fbanks = self._process_wave(wav_file.decode(), num_frames)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/feeder_wav.py", line 30, in _process_wave
    wav = audio.trim_silence(wav, audio_hparams)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/datasets/audio.py", line 36, in trim_silence
    return librosa.effects.trim(wav, top_db= hparams.trim_top_db, frame_length=hparams.trim_fft_size, hop_length=hparams.trim_hop_size)[0]

  File "/opt/conda/lib/python3.7/site-packages/librosa/effects.py", line 498, in trim
    y, frame_length=frame_length, hop_length=hop_length, ref=ref, top_db=top_db

  File "/opt/conda/lib/python3.7/site-packages/librosa/effects.py", line 448, in _signal_to_frame_nonsilent
    mse = feature.rms(y=y_mono, frame_length=frame_length, hop_length=hop_length) ** 2

  File "/opt/conda/lib/python3.7/site-packages/librosa/feature/spectral.py", line 925, in rms
    y = np.pad(y, int(frame_length // 2), mode=pad_mode)

  File "<__array_function__ internals>", line 6, in pad

  File "/opt/conda/lib/python3.7/site-packages/numpy/lib/arraypad.py", line 816, in pad
    "'constant' or 'empty'".format(axis)

ValueError: can't extend empty axis 0 using modes other than 'constant' or 'empty'

  File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1429, in _call_tf_sessionrun
    run_metadata)
tensorflow.python.framework.errors_impl.InvalidArgumentError: ValueError: can't extend empty axis 0 using modes other than 'constant' or 'empty'
Traceback (most recent call last):

  File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/ops/script_ops.py", line 209, in __call__
    ret = func(*args)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/feeder_wav.py", line 49, in _parse_func
    fbanks = self._process_wave(wav_file.decode(), num_frames)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/feeder_wav.py", line 30, in _process_wave
    wav = audio.trim_silence(wav, audio_hparams)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/datasets/audio.py", line 36, in trim_silence
    return librosa.effects.trim(wav, top_db= hparams.trim_top_db, frame_length=hparams.trim_fft_size, hop_length=hparams.trim_hop_size)[0]

  File "/opt/conda/lib/python3.7/site-packages/librosa/effects.py", line 498, in trim
    y, frame_length=frame_length, hop_length=hop_length, ref=ref, top_db=top_db

  File "/opt/conda/lib/python3.7/site-packages/librosa/effects.py", line 448, in _signal_to_frame_nonsilent
    mse = feature.rms(y=y_mono, frame_length=frame_length, hop_length=hop_length) ** 2

  File "/opt/conda/lib/python3.7/site-packages/librosa/feature/spectral.py", line 925, in rms
    y = np.pad(y, int(frame_length // 2), mode=pad_mode)

  File "<__array_function__ internals>", line 6, in pad

  File "/opt/conda/lib/python3.7/site-packages/numpy/lib/arraypad.py", line 816, in pad
    "'constant' or 'empty'".format(axis)

ValueError: can't extend empty axis 0 using modes other than 'constant' or 'empty'

         [[{{node PyFunc}}]]
         [[IteratorGetNext]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "train.py", line 113, in <module>
    step, _, loss, acc = sess.run(fetches=fetches, feed_dict=feed_dict)
  File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 950, in run
    run_metadata_ptr)
  File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1173, in _run
    feed_dict_tensor, options, run_metadata)
  File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1350, in _do_run
    run_metadata)
  File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1370, in _do_call
    raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InvalidArgumentError: ValueError: can't extend empty axis 0 using modes other than 'constant' or 'empty'
Traceback (most recent call last):

  File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/ops/script_ops.py", line 209, in __call__
    ret = func(*args)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/feeder_wav.py", line 49, in _parse_func
    fbanks = self._process_wave(wav_file.decode(), num_frames)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/feeder_wav.py", line 30, in _process_wave
    wav = audio.trim_silence(wav, audio_hparams)

  File "/home/rjain/TTS_Exp_and_Data/tf_multispeakerTTS_fc/deep_speaker/datasets/audio.py", line 36, in trim_silence
    return librosa.effects.trim(wav, top_db= hparams.trim_top_db, frame_length=hparams.trim_fft_size, hop_length=hparams.trim_hop_size)[0]

  File "/opt/conda/lib/python3.7/site-packages/librosa/effects.py", line 498, in trim
    y, frame_length=frame_length, hop_length=hop_length, ref=ref, top_db=top_db

  File "/opt/conda/lib/python3.7/site-packages/librosa/effects.py", line 448, in _signal_to_frame_nonsilent
    mse = feature.rms(y=y_mono, frame_length=frame_length, hop_length=hop_length) ** 2

  File "/opt/conda/lib/python3.7/site-packages/librosa/feature/spectral.py", line 925, in rms
    y = np.pad(y, int(frame_length // 2), mode=pad_mode)

  File "<__array_function__ internals>", line 6, in pad

  File "/opt/conda/lib/python3.7/site-packages/numpy/lib/arraypad.py", line 816, in pad
    "'constant' or 'empty'".format(axis)

ValueError: can't extend empty axis 0 using modes other than 'constant' or 'empty'

         [[{{node PyFunc}}]]
         [[IteratorGetNext]]

What do you think I should do? Or what could be the reason for this error? Thanks in advance.

I would recommend you to check your data first. It should not take too long. For this specific issue, you can just simply use a for loop to load all your data and call audio.trim_silence(wav, audio_hparams). Then you can know which file cause the problem, look at that wav file and address the issue.

Okay. I will do that. Thanks


List of supported OS versions for Red Hat OS family is out of date

Currently, the code that validates the Red Hat OS version is structured in a way that requires a code change each time a new fedora or EL version is released. The code has not been kept up to date, and doesn't recognize fedora > 26 or EL > 7.
I plan to submit a pull request that addresses this.

Hi @ASBishop , unfortunately I don't have time to maintain this module anymore.
If you want to take care of it, plase fork it and send me a link to your project. I will add a message on the readme that this module is deprecated and point to yours instead.

Thank you for accepting my pull request. I'll need to work with my employer to determine how to proceed now that you aren't able to continue maintaining the code.

Hey!
I'm planning to take this over instead of Alan if you'd like.  I went ahead and created an org for the project and forked it here:
https://github.com/puppet-etcd/puppet-etcd


TEXTURETYPE_UNSIGNED_INT confusion

TEXTURETYPE_UNSIGNED_INT is 8bits/component
TEXTURETYPE_UNSIGNED_INTEGER is 32bits/component
TEXTURETYPE_INT is 32bits/component
To avoid confusion, this PR use more explicit TEXTURETYPE_UNSIGNED_BYTE instead of TEXTURETYPE_UNSIGNED_INT and deprecates its definition.

Please make sure to label your PR with "bug", "new feature" or "breaking change" label(s).
To prevent this PR from going to the changelog marked it with the "skip changelog" label.

Please make sure to label your PR with "bug", "new feature" or "breaking change" label(s).
To prevent this PR from going to the changelog marked it with the "skip changelog" label.

Snapshot stored with reference name:
refs/pull/15905/merge
Test environment:
https://snapshots-cvgtc2eugrd3cgfd.z01.azurefd.net/refs/pull/15905/merge/index.html
To test a playground add it to the URL, for example:
https://snapshots-cvgtc2eugrd3cgfd.z01.azurefd.net/refs/pull/15905/merge/index.html#WGZLGJ#4600
Links to test babylon tools with this snapshot:
https://playground.babylonjs.com/?snapshot=refs/pull/15905/merge
https://sandbox.babylonjs.com/?snapshot=refs/pull/15905/merge
https://gui.babylonjs.com/?snapshot=refs/pull/15905/merge
https://nme.babylonjs.com/?snapshot=refs/pull/15905/merge
To test the snapshot in the playground with a playground ID add it after the snapshot query string:
https://playground.babylonjs.com/?snapshot=refs/pull/15905/merge#BCU1XR#0

WebGL2 visualization test reporter:
https://snapshots-cvgtc2eugrd3cgfd.z01.azurefd.net/refs/pull/15905/merge/testResults/webgl2playwright/index.html

Visualization tests for WebGPU (Experimental)
https://snapshots-cvgtc2eugrd3cgfd.z01.azurefd.net/refs/pull/15905/merge/testResults/webgpuplaywright/index.html


Move Country Above Region in UserProfile.cs

Moved country above region to help resolve any issues from trying to set the region prior to setting the country might be concerned.
https://github.com/dnnsoftware/Dnn.Platform/issues/2140 I can reference this issue but I will not say it will fix it.  But it makes more sense to have it show up here in this file so I propose the change.
Summary

alright no additional commits!

I was not changing the order in the UI, just in the code to match the UI and make the code get the country list set first I was hoping to help cure any issues regarding loading the UI automatically.

@valadas I thought you had changed this already for newer installations?

I was not changing the order in the UI, just in the code to match the UI

Oh I am sorry, I misunderstood this PR then, reopening...

Does it look right now?  When I saved it in GitHub it was moving all over the place but I think it settled in the right place this last time.

Does it look right now? When I saved it in GitHub it was moving all over the place but I think it settled in the right place this last time.

Hmm, looks like in 5dd0331 it got pushed more than necessary, then in 2fb8727 it got back too much left.
Not a huge deal and we are planning to add an editor config to avoid those inconsistencies anyway, just a remark.

Might also be just a github UI glitch who knows, I will checkout the actual file after 9.4.2 is out...


Created v1 of email service

Most users will throw an error when using the email service due to differences between loaded patients and CCDA patients, but there is a commented-out id for testing on "patient_detail.hbs". Functionality can be verified with this.

Email URL now runs over https and now references webpack config file.


Fixes #119

In many of the tests, a BitcoindMock was being created and, alongside it, a jsonrpc-http server started to receive jsonrpc request from the tower. However, these servers were never stopped after every individual test (only by the end of the test suite) resulting in a high number of opened file descriptors.
Turns out jsonrpc-http-server::Server has a CloseHandle that allows us to close the server from a different thread.
h/t to @erikarvstedt for pointing out the root of the issue.

@seberm this should have fixed the issue of reaching the fd limit when running tests on nix. Can you give it a try?
@erikarvstedt this does the trick but is really verbose, not sure if you're aware of a simpler way of fixing it.

@sr-gi, add a helper server struct that implements Drop to stop the server on scope exit. You could use it like so:
#[tokio::test]
async fn test_mytest() {
    let server = make_test_server();
    // Use server in test
    my_use_server_fn(server.addr);
    // ...
    // Server is dropped here
}

@sr-gi, add a helper server struct that implements Drop to stop the server on scope exit. You could use it like so:
#[tokio::test]
async fn test_mytest() {
    let server = make_test_server();
    // Use server in test
    my_use_server_fn(server.addr);
    // ...
    // Server is dropped here
}

That was my initial approach, the issue is that the server needs to be run by a different thread, so ownership is transferred (that's happening in start_server) therefore it cannot be dropped by the test that initially created it when it goes out of scope. As a matter of fact, jsonrpc_http_server::Server implements Drop, but looks like it doesn't go out of scope until the whole test suite if completed.

Hint: You can always transform Rust code of the form
var resource = make_resource();
# ...
resource.destroy();

to
var resource_wrapper = make_resource();
# ...
# End of scope: implicit call to resource_wrapper.drop()

... by creating a wrapper type. This is also the case here (and highly recommended, as evidenced by your force-push 😃).

Yeah, I got to that conclusion after having to force-push 😅
99a9f3d should be more idiomatic


[Feature Request] Set stride

I would like to be able to set the stride of the FFT. This is very useful for computing 2D and 3D FFTs.
Example usage:
let mut buffer2d = [1,0,0,0,
                    0,0,0,0];

// x direction
let mut fft = fft_planner.plan_fft(4, FftDirection::Forward);
fft.set_stride(1);
fft.process(&mut buffer2d);
assert_eq!(buffer2d, [1,1,1,1,
                      0,0,0,0]);

// y direction
fft = fft_planner.plan_fft(2, FftDirection::Inverse);
fft.set_stride(4);
fft.process(&mut buffer2d);
assert_eq!(buffer2d, [1,1,1,1,
                      1,1,1,1]);

This would complicate things a lot, and very likely give a significant performance drop. Why not just transpose the data between the fft steps? Check "transpose" on crates.io for nice fast 2D transposes.

I did end up manually transposing the data. I just thought that adding a stride parameter would have a minimal performance impact. However, if this is not the case, I think the library's speed is more valuable than the convenience of having a stride parameter.

I do think there is some room in rustFFT for stride, but it would work by copying the data to a contiguous scratch buffer, and then doing the FFT contiguously. This would have the potential for being faster than the standard width -> transpose -> height ->transpose process, since it would be much more cache friendly.
I don't think I'll be able to get to it in the near future, unfortunately.


Mplug_owl 2 support video training?

Dose mplug_owl 2 support video training?

You can decode video as multiple images for training.

You can decode video as multiple images for training.

Hi,
I tried to use image frames from a video as sequence of images and tried inferencing on multiple images as below:
image_tensor = process_images([image1, image2], image_processor)
with torch.inference_mode():     output_ids = model.generate(         input_ids,         images=image_tensor,         do_sample=True,         temperature=temperature,         max_new_tokens=max_new_tokens,         streamer=streamer,         use_cache=True,         stopping_criteria=[stopping_criteria])
outputs = tokenizer.decode(output_ids[0, input_ids.shape[1]:]).strip()
print(outputs)
Even though the first line in the above code gives me a tensor of shape [2, 3, 448, 448], the summary generated by the model solely focus on the content of the image1. Is it the right way to do it?

You can decode video as multiple images for training.

Hi, I tried to use image frames from a video as sequence of images and tried inferencing on multiple images as below:
image_tensor = process_images([image1, image2], image_processor) query = "Summarize the images" with torch.inference_mode(): output_ids = model.generate( input_ids, images=image_tensor, do_sample=True, temperature=temperature, max_new_tokens=max_new_tokens, streamer=streamer, use_cache=True, stopping_criteria=[stopping_criteria])
outputs = tokenizer.decode(output_ids[0, input_ids.shape[1]:]).strip() print(outputs)
Even though the first line in the above code gives me a tensor of shape [2, 3, 448, 448], the summary generated by the model solely focus on the content of the image1. Is it the right way to do it?

I am also curious how to use image sequence to understand entire video, how to build context? @MAGAer13


Update graph_nets_basic example to TF2

see #115

Thanks for the PR @Mistobaan !
It seems like the outputs of the notebook look reasonable! To make the review easier, do you think it would be possible to:

Empty the notebook outputs (we prefer not committing binary data, and the demos are super easy to run in Google Colaboratory anyway).
Is the first commit a pristine copy? Ideally, the first commit would be a verbatim forked version of the tf1 version and the second commit should show a relatively clean diff for reviewing purposes, do you think that you can split/squash the commits into that?

Thanks in advance :)

@alvarosg I agree with your points. re-created the commits and pushed.

Just to update on my end:
Thanks for the latest changes @Mistobaan , I will review it all at once the small TF2 specific example of usage with tf.function is provided, please let me know if plans change :)

Hi @Mistobaan, I was wondering if you were planning to add the tf.function example. Let me know!

Thanks for the contribution!
I am merging this for now. Please, let me know if you are interested on adding the tf.function example on a separate PR.
Thanks again!


All Cards are not visible in small screen

Describe the bug:
when we open the site in small screen the first two cards below the text "Apply to a fiscal host" are not visible.
To Reproduce
Steps to reproduce the behavior:

Go to 'https://opencollective.com/pricing?tab=singleCollectiveWithoutAccount'
Scroll down to '....'
See error

Expected behavior:
As we open the site on small screen the first two cards i.e "Open source Collective" and "Women who code" are not completely visible.
Screenshots:

taking this one up

@Betree I have a pr for this.


Uploading pictures from Gallery does not support descriptions

I uploaded a few pictures en mass by sharing them from the Gallery app. This is a great way to upload pictures (within a common category) but there is no way to provide a unified description. The pictures end up flagged as "description missing".

Thanks for reporting this. :) Yeah, this is a known bug - lots of things are missing from this entry point, including saving geotagged locations. We intend to overhaul uploading in the near future (hopefully, after 2.7.1 is done). In that case, we would streamline multiple uploads - they would work the same way via "Share" and via the app, which should solve this problem. #1091

OK, largely duplicate with #604


Fix incorrect bigtable check.

This change looks fine to me, and it's arguably clearer in its intent. Out of curiosity, however, what test case did you find that exposed a problem? The existing code tests for a non-empty string vector, and the new code tests for a non-empty string, but I believe the effect is the same, since absl::StrSplit gives an empty vector for an empty string.

I tried to run the following command: bazel run -c opt --define=board_size=9 //cc:main -- --engine=tf --mode=selfplay --model=$HOME/mlperf/models/model --parallel_games=2 --num_readouts=200 --virtual_losses=8
The bigtable_spec.size() is 1, triggering the MG_FATAL. It looks like absl::SplitStr returns an empty string if given an empty string: https://github.com/abseil/abseil-cpp/blob/e821380d69a549dc64900693942789d21aa4df5e/absl/strings/str_split_test.cc#L343

Beg your pardon! Blind spot on my part. Thanks for the example.


Fix Lost Imports in Generated Code

fixes #476

@rbygrave please review and deploy an RC when you get time


feat: add multiplerelateddropdownfilter with cache cupport

Add multiplerelateddropdowncachefilter to reduce response time of admin list pages of huge related filter tables

I think the functionality might be good but isn't it better to put your custom caching into your project directly? You can extend the filter by your own business logic in your project and then just reuse new class.


Typo in /examples/esp32_time.ino causes strange behaviour

I tried your great library and used esp32_time.ino for that. In the following line is a typo:
rtc.setTime(30, 24, 15, 17, 1, 2042);  // 17th Jan 2021 15:24:30
With manually rtc.setTime() and the year greater than 2035 you get a strange behaviour when you use the ntp function afterwards:
configTime(gmtOffset_sec, daylightOffset_sec, ntpServer);
In this case the year sets up to 2088, the rest of date and time is updated correctly.
If you use a year 2035 or lower, the NTP corrects to the actual year as well.
I am not a professional C++ developer, therefore I can not analyse your code in detail.

Might be related https://docs.espressif.com/projects/esp-idf/en/stable/esp32/api-reference/system/system_time.html#year-2036-and-2038-overflow-issues

The overflow is handled internally by the library using a flag, so you need to re-set the time using the library function after configuring with ntp
https://github.com/fbiego/ESP32Time/blob/56c7cca5838249db5bff3cbc4f67e7da0f91b126/examples/esp32_time/esp32_time.ino#L36-L41


Reference scaling: Reference

Do not understand the usage of the 'Reference' tick box. Is this to enable drawing a reference scale in the future? In that case, I suggest changing the text to: "Draw scale on image"

At the moment this is not implemented at all, i.e. the Reference checkbox does nothing for now. The idea was to reference the line's length. This means if we changed the line's length, then the scale would also update accordingly. At the moment this is not updated and probably not that useful so it might not even be implemented.

Agreed; I do not envisage a scenario in which this functionality could be useful.

Looks like it will be removed next version then 👍


KeyringController:signPersonalMessage does not fail if empty data is passed.

KeyringController:signMessage fails if empty data is passed but KeyringController:signPersonalMessage does not fails if empty data is passed.

Does the spec require that the data be non-empty? Worth confirming that  - maybe this is fine.
Also we should check to see if it's possible that a dapp is relying upon this. We might be forced to preserve this behavior for backwards-compatibility.


chore(deps): update dependency go to v1.23.3

This PR contains the following updates:

Package
Type
Update
Change

go (source)
toolchain
patch
1.23.2 -> 1.23.3

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

/run pipeline

:tada: This PR is included in version 4.16.8 :tada:
The release is available on:

GitHub release
v4.16.8

Your semantic-release bot :package::rocket:


Build docs: openssl-static -> openssl-devel on Fedora

openssl-static doesn't exist anymore. The new name is openssl-devel now https://packages.fedoraproject.org/pkgs/openssl/openssl-devel/

? https://packages.fedoraproject.org/pkgs/openssl/openssl-static/index.html

@poco0317  --

you've send screenshots of the same pages i read. that's not particularly helpful. im interested in whether its useful information to add different dependency names depending on os. linux continues to prove itself as insane and annoying to deal with

Pointing out that openssl-static isn't being used anymore since Fedora 36 :)
(You seem confused by Poco's PR, so thought I'd add some context)

you've send screenshots of the same pages i read. that's not particularly helpful. im interested in whether its useful information to add different dependency names depending on os. linux continues to prove itself as insane and annoying to deal with

Fair point. But Fedora 35 has been EOL since December 2022 and other Fedora openssl guides on the internet don't mention the old package name either, so it should be fine


Gulp Serve Error: Error parsing file 'config.json', section [undefined]

Windows Server 2012 R2. Patched today.
Running the command "gulp serve" produces the following error and output:
Build target: DEBUG
Error: Error parsing file 'config.json', section [undefined]:
(undefined) JSON_OBJECT_VALIDATION_FAILED
[21:23:42] Error - Unknown
Error: Error parsing file 'config.json', section [undefined]:
(undefined) JSON_OBJECT_VALIDATION_FAILED
[21:23:42] =========[ Finished ]===========
[21:23:43] Project helloworld-webpart version: 0.0.1
[21:23:43] Build tools version: 0.7.1
[21:23:43] Node version: v4.5.0
[21:23:43] Total duration: 2.1 min
[21:23:43] Task errors: 5

fixed by doing the following things:
npm update
reboot server
check the original web part but still got error
created new folder and started over
got the es6-module error again
installed that again
now working for second folder

Unclear what the original issue was here.  However as for bugs / improvements to make to understand or debug this, one thing that jumps out here is to actually state what the parse error is.

@patmill sorry for any confusion, what i typed in the first bug report was exactly what was shown in powershell, verbatim, when running the "gulp serve" command. There was no more info available.

To be honest, we have not tested in Windows Server and unclear what is needed. Can you make sure you have the NodeJS LTS installed along with other tools? I am also not clear on how much other dev tools support Windows Server.

All of the tools should work fine in Windows Server. My primary dev environment is Windows Server 2012 R2 and all of our tools work fine there (because most of them were written there).
For the original issue - can you confirm you're running Node 4.X (we're running 4.4.7 internally) and NPM 3.10.X? My first guess would be that you're running either an incompatible version of Node or an incorrect version of Z-Schema got installed which is incorrectly validating the config files.
It's also possible that your config files are messed up. Is this a vanilla, yeoman-generated project?

node v4.5.0, npm 2.15.9, yeoman-generated project.

You'll want to be on npm3.  We've updated the setup docs to reflect this.  Run
 npm -g install npm@next

@chakkaradeep  I just built a new Windows Server 2016 Technical Preview 5 server, fresh install of all the SPFx Tooling, VS Code, etc. Everything worked fine, including Workbench locally.  Loaded SPApp to Dev Tenant, and that presented too. My previous SPFx install was on Windows 10.
So far my experience is in alignment with what @iclanton stated.

Closing this issue as it appears to be an NPM2 problem. Documentation has been updated.


This library supports Explicit flow for login?[question]

I would like to use the explicit flow for signin, get the authorization code and pass it to my backend service. As I read in the documentation offlineAccess: true is the way to achieve this behavior, but im  not sure.

Hi! I'm not sure what you mean by "explicit flow for sign in" and what you mean by "authorization code". Can you please clarify?


[SPARK-25956] Make Scala 2.12 as default Scala version in Spark 3.0

What changes were proposed in this pull request?
This PR makes Spark's default Scala version as 2.12, and Scala 2.11 will be the alternative version. This implies that Scala 2.12 will be used by our CI builds including pull request builds.
We'll update the Jenkins to include a new compile-only jobs for Scala 2.11 to ensure the code can be still compiled with Scala 2.11.
How was this patch tested?
existing tests

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/4824/
Test PASSed.

Test build #98571 has started for PR 22967 at commit eb10e5a.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/4825/
Test PASSed.

Test build #98571 has finished for PR 22967 at commit eb10e5a.

This patch fails to build.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98571/
Test FAILed.

Ur, it seems to due to 63ca4bbe792718029f6d6196e8a6bb11d1f20fca. I'll the master branch.

@dongjoon-hyun Yeah, seems https://github.com/apache/spark/commit/63ca4bbe792718029f6d6196e8a6bb11d1f20fca breaks the Scala 2.12 build.
I'll re-trigger the build once Scala 2.12 build is fixed.
Thanks.

retest this please

Test build #98579 has started for PR 22967 at commit eb10e5a.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/4833/
Test PASSed.

Test build #98579 has finished for PR 22967 at commit eb10e5a.

This patch fails MiMa tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98579/
Test FAILed.

At this time, this is MiMa issue.
[error]  * method compressed()org.apache.spark.ml.linalg.Matrix in trait org.apache.spark.ml.linalg.Matrix does not have a correspondent in current version
[error]    filter with: ProblemFilters.exclude[DirectMissingMethodProblem]("org.apache.spark.ml.linalg.Matrix.compressed")
[error]  * method compressedRowMajor()org.apache.spark.ml.linalg.Matrix in trait org.apache.spark.ml.linalg.Matrix does not have a correspondent in current version
[error]    filter with: ProblemFilters.exclude[DirectMissingMethodProblem]("org.apache.spark.ml.linalg.Matrix.compressedRowMajor")

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/4834/
Test PASSed.

Test build #98580 has started for PR 22967 at commit 2eea387.

Test build #98580 has finished for PR 22967 at commit 2eea387.

This patch fails MiMa tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98580/
Test FAILed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/4865/
Test PASSed.

Test build #98620 has started for PR 22967 at commit c4b6bed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/4936/
Test PASSed.

Test build #98709 has started for PR 22967 at commit b4d2d4f.

Test build #98709 has finished for PR 22967 at commit b4d2d4f.

This patch fails MiMa tests.
This patch merges cleanly.
This patch adds no public classes.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98709/
Test FAILed.

Merged build finished. Test FAILed.

Waiting https://github.com/apache/spark/pull/22977 to be merged, and I'll rebase from it and fix the remaining binary incompatibilities.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/4968/
Test PASSed.

Test build #98756 has started for PR 22967 at commit 52dc4a1.

Test build #98756 has finished for PR 22967 at commit 52dc4a1.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98756/
Test FAILed.

Retest this please.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/4996/
Test PASSed.

Test build #98786 has started for PR 22967 at commit 52dc4a1.

Test build #98786 has finished for PR 22967 at commit 52dc4a1.

This patch fails PySpark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98786/
Test FAILed.

Retest this please.

Test build #98807 has started for PR 22967 at commit 52dc4a1.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/5009/
Test PASSed.

Test build #98807 has finished for PR 22967 at commit 52dc4a1.

This patch fails PySpark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98807/
Test FAILed.

Test build #98812 has started for PR 22967 at commit a5cc336.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/5014/
Test PASSed.

Merged build finished. Test PASSed.

@dongjoon-hyun thanks for trigging the build. The python test script was only looking for scala 2.11 jars resulting python test failures. I just fixed it in the latest push. Let's see how it goes.

Test build #98813 has started for PR 22967 at commit 8b6b474.

Test build #98812 has finished for PR 22967 at commit a5cc336.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Test build #98813 has finished for PR 22967 at commit 8b6b474.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98813/
Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98812/
Test FAILed.

Retest this please.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/5016/
Test PASSed.

Test build #98815 has started for PR 22967 at commit 8b6b474.

Test build #98815 has finished for PR 22967 at commit 8b6b474.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98815/
Test PASSed.

Could you take a look at this once more, @HyukjinKwon and @felixcheung , @gatorsmile ?

Hi, @shaneknapp.
If we make Scala 2.11 as our default, can we reuse the following Job for Scala 2.11 instead?

https://amplab.cs.berkeley.edu/jenkins/view/Spark QA Test (Dashboard)/job/spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.12/

Merged to master. Thank you all!

@dongjoon-hyun not a problem, i'll need to update the build config(s)....  what branches will need 2.12 vs 2.11?

Thank you, @shaneknapp . Like the current job spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.12/, master branch will need it.  So,
from spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.12
to spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.11?

Thank you for all the efforts to make this happen!
Spark has been the last resort before deprecating Scala 2.11.
After Spark 3.0, as an OSS contributor, we can stop maintaining cross builds for Scala 2.11 and can completely migrate to Scala 2.12 or later after Spark 3.0.


chore(karpenter-core): go get<EMAIL_ADDRESS>

Fixes #
Description
This core bump is based off of the following aws PR:

https://github.com/aws/karpenter-provider-aws/commit/dafe148a327a8df619955bef0a8150edd27805dd#diff-33ef32bf6c23acb95f5902d7097b7a1d5128ca061167ec0716715b0b9eeaa5f6

How was this change tested?

Does this change impact docs?

[ ] Yes, PR includes docs updates
[ ] Yes, issue opened: #
[ ] No

Release Note

Pull Request Test Coverage Report for Build<PHONE_NUMBER>
Details

0 of 1 (100.0%)  changed or added relevant line in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 97.624%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
35625

Relevant Lines:
36492

💛  - Coveralls


Workflow Action Fails

hi, I'm trying to set this up to publish an starters directory for a repo.
I've setup a secret called API_TOKEN_GITHUB and added the folder and my username as args in the workflow file.
However, when the action runs it just seems to fail after Clone dir: __gatsby-starter-hyperobjekt__clone__ with no error.
any idea what is going wrong?

I'm not sure what was going wrong, but it works now! :shrug:


Title: Adding a email spam detection project under machine learning (basic) projects

Is your feature request related to a problem? Please describe.
it would be really helpful to add this project as well. It is a beginner friendly project which helps in understanding logistic regression better.
Describe the solution you'd like.
I would like to add email spam detection model using logistic regression, under the machine learning basic projects
Describe alternatives you've considered.
We can add spam email or sms detection and use other models as well to train it like svm or navies bayes
Add any other context or screenshots about the feature request here.
No response

i would like to work on this issue so please assign it to me

I would like to contribute to this project.


CloudFront improves security and speed by protecting APIs from DDoS attacks and also serving content from edge locations.

I will close this for now because ATM it's hard to answer these questions:

if we use HTTP protocol between CF and ALB will that be an issue for some projects due to sensitive information?
if we use HTTPS protocol between CF and ALB will that be an issue for some projects due to the extra latency required to perform another TLS handshake


hhhh

Here's a breakdown of the P2pTrades::PaymentMethodsController class:
Controller Overview

Namespace: Api::V1
Class: P2pTrades::PaymentMethodsController
Base Class: Api::BaseController
Module Included: P2pTrades::PaymentMethodHelper

Actions

index:

This action retrieves and renders a list of payment methods.
It uses the payment_methods method from the included PaymentMethodHelper module to get the payment methods.
Renders the data in JSON format.

Helper Module: PaymentMethodHelper
The controller includes the P2pTrades::PaymentMethodHelper module, which is likely providing the payment_methods method. The payment_methods method probably encapsulates the logic to fetch and format payment methods data.
Example PaymentMethodHelper
For completeness, here's a simplified example of what PaymentMethodHelper might look like:
module P2pTrades
  module PaymentMethodHelper
    def payment_methods
      # Fetch and format the payment methods data
      PaymentMethod.all.map do |payment_method|
        {
          id: payment_method.id,
          name: payment_method.name,
          type: payment_method.type
        }
      end
    end
  end
end

Summary

Purpose: This controller handles requests related to payment methods in the context of P2P trades.
Data Handling: Uses a helper module to fetch and format the payment methods before rendering them as JSON.

If you have any more questions or need further details, feel free to ask!


Poetry.lock is not consistent with pyproject.toml

matt@WSL2:~/working$ git clone https://github.com/yoheinakajima/prettygraph
Cloning into 'prettygraph'...
remote: Enumerating objects: 29, done.
remote: Counting objects: 100% (29/29), done.
remote: Compressing objects: 100% (28/28), done.
remote: Total 29 (delta 11), reused 0 (delta 0), pack-reused 0
Receiving objects: 100% (29/29), 103.88 KiB | 1.85 MiB/s, done.
Resolving deltas: 100% (11/11), done.
matt@WSL2:~/working$ cd prettygraph/
matt@WSL2:~/working/prettygraph (main)$ poetry install
Creating virtualenv python-template-hgXLYGdK-py3.10 in /home/matt/.cache/pypoetry/virtualenvs
Installing dependencies from lock file
Warning: poetry.lock is not consistent with pyproject.toml. You may be getting improper dependencies. Run `poetry lock [--no-update]` to fix it.

Because python-template depends on python-dotenv (^0.20.0) which doesn't match any versions, version solving failed.
matt@WSL2:~/working/prettygraph (main)$ poetry run python main.py
Traceback (most recent call last):
  File "/home/matt/working/prettygraph/main.py", line 1, in <module>
    from flask import Flask, render_template, request, jsonify
ModuleNotFoundError: No module named 'flask'

Ran into this while following the README.md

Same here getting a warning message asking me to fix the lock file

Run poetry lock


Add Istanbul locally

This adds istanbul as a dev dependency so it can be used with npm run test:istanbul, rather than having to install a global package on their machines.

Thanks!


Include program counter value in backtrace when -v is passed

This can help when debugging.
stack backtrace:
   0: 0x000015b0 @ HardFaultTrampoline
      <exception entry>
   1: 0x000008de @ lib::inline::__udf
        at ./asm/inline.rs:172:5
   2: 0x000008de @ __udf
        at ./asm/lib.rs:49:17
   3: 0x000001c8 @ cortex_m::asm::udf
        at [cortex-m-0.7.3]/src/asm.rs:43:5
   4: 0x000001d2 @ _defmt_panic
        at /tmp/app/src/lib.rs:11:5
   5: 0x000001be @ defmt::export::panic
        at /home/japaric/.cargo/git/checkouts/defmt-52fbd7917982cfac/e021e7d/src/export.rs:266:14
   6: 0x000001be @ panic::__cortex_m_rt_main
        at /tmp/app/src/bin/panic.rs:8:5
   7: 0x00000194 @ main
        at /tmp/app/src/bin/panic.rs:6:1
   8: 0x000001dc @ ResetTrampoline
        at [cortex-m-rt-0.6.14]/src/lib.rs:547:26
   9: 0x0000018a @ Reset
        at [cortex-m-rt-0.6.14]/src/lib.rs:550:13

bors r=jonathanpallant


Source map file points to wrong line

I don't really understand how rollup handles source map file generation and modification, since I'm very new to it. However, trying to create my own replacement/modification plugin and after that using your plugin, I'm facing the same issue.
For whatever reason though, it seems like @rollup/plugin-replace, doesn't have this issue and I can't figure out why. 😕
Edit: probably because they are using magicString.overwrite. I'll close this then.

Ok. But I can can a look if you want to.

Ok. But I can take a look if you want to.

I was trying to do replace with regexp, which isn't supported by @rollup/plugin-replace.
Returning the map from a magic string instance, plus the code of course, seems to do the trick.
  const magicStringInstance = new MagicString(source);
  magicStringInstance.replace(/foo/g, 'bar');
  const code = magicStringInstance.toString();
  const map = magicStringInstance.generateMap({ hires: true });

Thank you very much though. 😄

Hey. Finally I had some time to look into this.
I know, that you already found a solution, that is great. I was just curious if there is any problem with the default source map generation of this plugin.
What I did was, that I created a dummy project and used the plugin as an input and an output plugin. The created source map files where looking fine. But only if the modifications are not changing the lines of the original code. After having thought about this topic for a while the problem turned out to be pretty obvious. :smile:
By modifying the source, you basically create a virtual new source file, which differs a little or actually a lot from the original, the goal of a correct source map with absolute correctness is therefore impossible, unless you keep the line numbers in sync.
I don't think that magic string would make a difference, to be honest. Yes, it helps you to manually generate a source map file, but still it always depends on the fact whether the lines are still matching or not. At least for my understanding

I don't think that magic string would make a difference, to be honest. Yes, it helps you to manually generate a source map file, but still it always depends on the fact whether the lines are still matching or not. At least for my understanding

It took me a while to understand it (if I actually did 😄 ). When you return a new map after modifying the source, Rollup use this map and (matches/processes) it against the original, read here.

Oh dear. I really had a misconception about that. So, yes you are right, as magic string keeps track of the changes it produces a correct source map.
For this plugin, it would be nice, if the user wouldn't be forced to use magic string and the changes however they are made would get detected and "transmitted" to rollup. I am working on a solution right now!

Oh dear. I really had a misconception about that. So, yes you are right, as magic string keeps track of the changes it produces a correct source map.
For this plugin, it would be nice, if the user wouldn't be forced to use magic string and the changes however they are made would get detected and "transmitted" to rollup. I am working on a solution right now!
edit: I have opened the issue again.

Would be nice indeed. Not sure if it's something easy to achieve though.

Yeah, easy is a relative term  :wink:
I solved it, with the help of diff.  I you don't mind, you can test it. It is integrated in the 0.5.0-Banch.

Yeah, "easy" is a relative term 😉
I solved it, with the help of diff. I you don't mind, you can test it. It is integrated in the 0.5.0-Branch.

It works. I need more time understanding how diff works though.
Thank you for your elegant solution and this plugin. 😄

I need more time understanding how diff works though.

It is a JS version of  GNU-diffutils, which is designed to compare (two) files and apply patches.

Would this method work if the code was to be heavily transformed like in minifying?

Yes

Thank you for your elegant solution and this plugin.

Thanks for reporting this issue.


engine.release(); 异常

example 中
hook/JoinChannelVideo/JoinChannelVideo.tsx 使用报错

@LichKing-2234 I can reproduce the same error with:
      try {
        console.log('release type: ', typeof engine.current.release);
        engine.current.release();
      } catch (e) {
        console.log('release error: ', e);
      }

log:
 LOG  release type: function
 LOG  release error: [TypeError: undefined is not a function]

@EkaanshArora What is engine.current?

@LichKing-2234 it's likey a useRef usage

@EkaanshArora
but in demo file use "useState"
const [engine] = useState(createAgoraRtcEngine());

For immutable values in React it's recommended to use a ref. Nevertheless, the error with the release method is consistent across both usages.

@EkaanshArora
I already use "useRef", but not work.

@LichKing-2234 I updated our v3.x quickstart example to v4.0.0 it reproduces this issue. You can test it here.
 LOG  JoinChannelSuccess {"channelId": "test", "localUid":<PHONE_NUMBER>}
 LOG  UserJoined {"channelId": "test", "localUid":<PHONE_NUMBER>}<PHONE_NUMBER>
 LOG  release error: [TypeError: undefined is not a function]

Will be fixed in the 4.1.0 version.

Will be fixed in the 4.1.0 version.

I have same issues. How to most succinctly unregister all listenners when engine.release() throw above error? @LichKing-2234


improve safety of fill_buffer

Fixes #260
This implements a fix for a safety issue found in fill_buffer as reported in #260. This is the implementation suggested by @Dr-Emann.

Thank you!