Deploying a vm with uefi fails

BUG REPORT
/kind bug
What happened:
Deploying a vm with uefi fails with a message about secure boot
HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"admission webhook "virtualmachine-validator.kubevirt.io" denied the request: spec.template.spec.domain has EFI SecureBoot enabled. SecureBoot requires SMM, which is currently disabled.","reason":"Invalid","details":{"causes":[{"reason":"FieldValueInvalid","message":"spec.template.spec.domain has EFI SecureBoot enabled. SecureBoot requires SMM, which is currently disabled.","field":"spec.template.spec.domain"}]},"code":422}
What you expected to happen:
Vm would launch
How to reproduce it (as minimally and precisely as possible):
apiVersion: kubevirt.io/v1alpha3
kind: VirtualMachine
metadata:
  annotations:
    kcli/image: quay.io/karmab/debian-container-disk-demo
    kcli/plan: kvirt
    kcli/profile: quay.io/karmab/debian-container-disk-demo
  labels:
    kubevirt.io/os: linux
    special: vmi-migratable
  name: lonely-ptolemy
  namespace: default
spec:
  running: true
  template:
    metadata:
      labels:
        kubevirt.io/domain: lonely-ptolemy
        kubevirt.io/provider: kcli
    spec:
      domain:
        cpu:
          cores: 2
        devices:
          disks:
          - disk:
              bus: virtio
            name: lonely-ptolemy-disk0
          - cdrom:
              bus: sata
            name: cloudinitdisk
          interfaces:
          - bridge: {}
            name: default
        firmware:
          bootloader:
            efi: {}
        machine:
          type: q35
        resources:
          requests:
            memory: 1024M
      networks:
      - name: default
        pod: {}
      volumes:
      - containerDisk:
          image: quay.io/karmab/debian-container-disk-demo
        name: lonely-ptolemy-disk0
      - cloudInitNoCloud:
          secretRef:
            name: lonely-ptolemy-userdata-secret
        name: cloudinitdisk

Anything else we need to know?:
Environment:

KubeVirt version (use virtctl version): v0.37
Kubernetes version (use kubectl version): v1.20.2
VM or VMI specifications:
Cloud provider or hardware configuration:
OS (e.g. from /etc/os-release):
Kernel (e.g. uname -a):
Install tools:
Others:

/cc @jean-edouard  can you please take a look?

/cc @jean-edouard  can you please take a look?

I think what you want is to turn off Secure Boot, which is enabled by default for security reasons:
        firmware:
          bootloader:
            efi:
              secureBoot: false

Thanks for the heads-up @vladikr!

I think what you want is to turn off Secure Boot, which is enabled by default for security reasons:
        firmware:
          bootloader:
            efi:
              secureBoot: false

Thanks for the heads-up @vladikr!

ah, that makes sense, my bad
that said, it s a bit incoherent to silently enable secureboot but not the corresponding SMM feature?

ah, that makes sense, my bad
that said, it s a bit incoherent to silently enable secureboot but not the corresponding SMM feature?

Yeah, well SMM is kinda the opposite of a security feature, we want to make sure the user knows its enabled...
I agree this is not ideal, we should improve the UX here but I'm not sure how.

Yeah, well SMM is kinda the opposite of a security feature, we want to make sure the user knows its enabled...
I agree this is not ideal, we should improve the UX here but I'm not sure how.

Scrubbing: We consider this the most secure option. If somebody wants to opt-out, they should do it explicitly.

Scrubbing: We consider this the most secure option. If somebody wants to opt-out, they should do it explicitly.


Issue where having time-steps over the allocated time gives an error

timestep over the allocated time to the last time a device retrieves an info or wire would cause an error to happen, an extended timestep should just be blank

this is an error due to generation and not relevant to wire.py


upgrade yargs to support parsing of negative numbers

yargs@6 seems to be the latest version that works without too many changes.
All others fails with
Error: Too many arguments provided. Expected max 2 but received 3.
    at module.exports (C:\workspace\github\mocha-webpack\node_modules\yargs\lib\argsert.js:31:13)
    at Object.Yargs.self.alias (C:\workspace\github\mocha-webpack\node_modules\yargs\yargs.js:244:5)
    at parseArgv (C:\workspace\github\mocha-webpack\lib\cli\parseArgv.js:298:60)
    at Object.<anonymous> (C:\workspace\github\mocha-webpack\lib\cli\index.js:57:42)
    at Module._compile (module.js:652:30)
    at Object.Module._extensions..js (module.js:663:10)
    at Module.load (module.js:565:32)
    at tryModuleLoad (module.js:505:12)
    at Function.Module._load (module.js:497:3)
    at Module.require (module.js:596:17)

fixes #200

Codecov Report

Merging #213 into master will decrease coverage by <.01%.
The diff coverage is n/a.

@@            Coverage Diff            @@
##           master    #213      +/-   ##
=========================================
- Coverage    97.1%   97.1%   -0.01%
=========================================
  Files          28      28
  Lines         761     760       -1
=========================================
- Hits          739     738       -1
  Misses         22      22

Impacted Files
Coverage Δ

src/cli/parseArgv.js
97.87% <ø> (-0.05%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 02864e2...45a6ef9. Read the comment docs.


Homeassistant docker image doesn't include build tools. DHT can't work

Home Assistant release with the issue:

Docker hub image:
homeassistant/raspberrypi3-homeassistant
Looks like alpine based
Last working Home Assistant release (if known):
N/A
Operating environment (Hass.io/Docker/Windows/etc.):

Raspbian, hassio, docker
Component/platform:

https://www.home-assistant.io/components/sensor.dht/
Description of problem:
It requires a wheel module which can't be build without gcc.
Problem-relevant configuration.yaml entries and (fill out even if it seems unimportant):
sensor:
  - platform: dht
    sensor: DHT11
    pin: 4
    monitored_conditions:
      - temperature
      - humidity

Traceback (if applicable):
Command "/usr/local/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-install-i52jguvt/Adafruit-Python-DHT/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /tmp/pip-record-eivkfo33/install-record.txt --single-version-externally-managed --prefix  --compile --user --prefix=" failed with error code 1 in /tmp/pip-install-i52jguvt/Adafruit-Python-DHT/

Additional information:
Apart of that, Adafruit_Python_DHT==1.3.2 looks broken: https://github.com/adafruit/Adafruit_Python_DHT/issues/102
So 2 issues to fix:

add gcc to homeassistant issues (to be able to install wheel addons)
change Adafruit_Python_DHT version to 1.3.4

Looks like second issue mitigated by https://github.com/home-assistant/home-assistant/pull/15706

Is there any other output in the failure? I don't see anything mentioning gcc specifically.
I'm trying to figure out what tags and publishes these, but there isn't any info on dockerhub 🤔 https://hub.docker.com/r/homeassistant/raspberrypi3-homeassistant/

I think this might be a duplicate of https://github.com/home-assistant/home-assistant/issues/15712 ... no solution there though.

Well, here's how I figured it was absense of gcc:

Run pip install Adafruit_Python_DHT==1.3.2
Failure message doesn't mention anything specific
Run apk add alpine-sdk
Run pip install again
See the failure now mentions missing *.c files
Run pip install Adafruit_DHT==1.3.4
See the package successfully installed

I've tried to figure out the source Dockerfile for raspberry too. So I went to microbadger service which decompiles "closed source" images (apparently there's no such thing):
https://microbadger.com/images/homeassistant/raspberrypi3-homeassistant
Now I see that gcc is there, so I'm totally confused.
Maybe it has been recently replaced.

Ok, I think I found what puts images to Docker Hub:
https://github.com/home-assistant/hassio-build/tree/master/autodeploy
According to the source it does the following (looping forever each 10 minutes):

Fetches the GitHub releases page through API
For each release runs the builder
Builder builds docker images for each architecture and machine by cloning dockerfiles from git repo

Now the important part. Where are these dockerfiles for each architecture and machine are stored?
TADA :tada:
That was quite hard to find.
That's the most advanced build system for docker images I've ever seen. It builds images with container builders built in containers by cloning git repo with dockerfiles for each machine.

I think I have an idea. The new Dockerfile change now installs "Adafruit_Python_DHT==1.3.3" while homeassistant dht plugin still requires 1.3.2
So here's a much bigger problem: there's disconnect between hassio images and pip requirement in the source code of dht:
https://github.com/home-assistant/home-assistant/blob/master/homeassistant/components/sensor/dht.py
Well, I don't even know how that would work. This whole system is so complicated. I don't think it's gonna work without extracting all the plugins into their own containers with some kind of rpc (grpc?) to talk with homeassistant core.

Yeah, it looks like I have latest image of raspberrypi3-homeassistant which has dht 0.3.2 hardcoded in dht.py, but 0.3.3 in the Dockerfile.
Even if we pull dev branch of hass and latest branch of hassio-hass there's mismatch:
Adafruit-DHT==1.3.3 vs Adafruit_Python_DHT=1.3.3

#15706 is not in 0.75.0, and just be included in 0.75.1

@awarecan Even with this change, are you sure it won't require changes on hassio-homeassistant repo?

@Vanuan nice sleuthing 🎉
One trick I'm using over in https://github.com/home-assistant/home-assistant/pull/15698 to avoid mentioning a version number in a Dockerfile is to grep & sed it out of requirements.txt in a Dockerfile. I'm not sure if the context the machine builds, if they would have access to that file though 🤔

@Vanuan please report hassio issue in its repo home-assistant/hassio

/move to home-assistant/hassio


URL: Do not prepend baseUrl if the URL is not a relative URL

Summary
Fix for bug #26006 URL with base is always used, even when absolute URL is provided
Changelog
[Javascript] [Fixed] - URL: Base url value is ignored when the input url is not a relative url.
Test Plan
new URL('http://github.com', 'http://google.com') now returns http://github.com/
Added a test case to URL-test.js to verify the same.

@cpojer Done.

Did this break something? I'm trying new URL('/a', 'http://xy.com/b/c/d/e').toString() and getting the wrong output
Currently getting: http://xy.com/b/c/d/e/a
Should be getting: http://xy.com/a


CAMEL-19295: Basic thread-safe LRU cache

Backport of https://github.com/apache/camel/pull/10157 for Camel 3.21

The checkstyle issue is not related to those changes and will be fixed by https://github.com/apache/camel/pull/10216


Does not work

I guess it stoped working. Where are no projects shown in the app, after connecting vercel. It worked fine previously.
App Version: 3.1		Device: iPhone 12 Pro
OS: iOS 17.1.1

#97 fixes this. Soon it will be pushed to the App Store.

I tested 3.2.1: if I connect it to vercel and select exact projects everything is fine. But if I grant access to all projects — it does not show any project.


[FIXED JENKINS-28752] - Properly handle null imageIds

This change provides multiple workarounds, which allow to restore imageId in submissions according to the report data and previous submissions for the container.
@reviewbybees @jtnord

Just some nits, but :+1:

mainly nits in comments.
:+1:

:+1:

:+1:


[Snyk] Upgrade build.buf:protovalidate from 0.1.9 to 0.2.1

This PR was automatically created by Snyk using the credentials of a real user.Snyk has created this PR to upgrade build.buf:protovalidate from 0.1.9 to 0.2.1.
:information_source: Keep your dependencies up-to-date. This makes it easier to fix existing vulnerabilities and to more quickly identify and fix newly disclosed vulnerabilities when they affect your project.

The recommended version is 2 versions ahead of your current version.
The recommended version was released a month ago, on 2024-04-02.

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open upgrade PRs.
For more information:
🧐 View latest project report
🛠 Adjust upgrade PR settings
🔕 Ignore this dependency or unsubscribe from future upgrade PRs

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


raftstore: use gc to delete snap files

It's hard and tricky to make sure snap file not leak when using ref count. So this pr changes to use GC to delete stale snap files.
@ngaut @siddontang @disksing PTAL

LGTM

PTAL @disksing @zhangjinpeng1987

Coverage decreased (-19.9%) to 62.746% when pulling 6f78717ad27d23b666188542a25616d9b24b96b6 on busyjay/adjust-snap-count into c052d1ced52ad252621e701baa3f14d89bce6d55 on master.

Coverage decreased (-17.5%) to 65.209% when pulling 4d4f4c86eb9e60cfac7505b8f85394651a4ce3d3 on busyjay/adjust-snap-count into c052d1ced52ad252621e701baa3f14d89bce6d55 on master.

LGTM

@siddontang PTAL

LGTM

Coverage decreased (-17.8%) to 64.879% when pulling fbccbaa586dab59951aa4cc97fdcecf663b84837 on busyjay/adjust-snap-count into c052d1ced52ad252621e701baa3f14d89bce6d55 on master.


Adds some method implementation for Complex type

Methods implemented are:-

abs()

conjugate()

Ok will update it soon! Thanks.

@freakboy3742 Now that builds have passed can this PR be merged. Thanks


Indonesian Translation for IONIC Framework Documentation

Hi, Can I contribute to translate IONIC Framework documentation into Indonesian Language?

This issue was moved to ionic-team/ionic-site#1327


Column name vs. column label

When you have a query where you assign a different name to a column:
select
toto as "My very long column name"
from
mytable
The long column name is shown in the output. But when you click on your result set and choose "Advanced Copy > Copy column name(s)", the short column name is copied (in my case, "toto" instead of "My very long column name").
My guess is that there is a confusion between ResultSetMetaData.getColumnName() and ResultSetMetaData.getColumnLabel().
I honestly don't know if that's a feature or a bug, in other words: is that working as intended?

Looks like a kind of bug. This should be consistent.
But I can't reproduce this right now (this might be database dependent). What is your database?

I did reproduce that in MySQL.

Sorry for the late answer.
I'm on DB2, but it looks like you could reproduce it!
Thanks for the extremly fast reaction and your good product!!!


Remove deprecated graph code and demos using graph.

We will bring back some of the demos when we rewrite them using eager API.

This change is

Review status: 0 of 107 files reviewed at latest revision, all discussions resolved.

demos/fast-style-transfer/net.ts, line 22 at r1 (raw file):

    'https://storage.googleapis.com/learnjs-data/checkpoint_zoo/transformnet/';

export class TransformNet implements dl.Model {

out of curiosity, what is the long term plan for this? It would be nice to have a dl.Model interface generally so that when Ping converter is done, it's got the same API as other porters / model constructors.

src/optimizers/adadelta_optimizer.ts, line 104 at r1 (raw file):

  }

  private one: Scalar;

remove this

src/optimizers/adagrad_optimizer.ts, line 81 at r1 (raw file):

  }

  private one: Scalar;

remove this

src/optimizers/sgd_optimizer.ts, line 67 at r1 (raw file):

  }

  protected one: Scalar;

remove this (I kept all graph stuff at the bottom of the file so this would be trivial to axe)

Comments from Reviewable

Review status: 0 of 107 files reviewed at latest revision, 4 unresolved discussions, all commit checks successful.

demos/fast-style-transfer/net.ts, line 22 at r1 (raw file):
Previously, nsthorat (Nikhil Thorat) wrote…
out of curiosity, what is the long term plan for this? It would be nice to have a dl.Model interface generally so that when Ping converter is done, it's got the same API as other porters / model constructors.

I was thinking ideally moving the Model from layers to core, or at least adding Model interface in core that follows the Model from layers

src/optimizers/adadelta_optimizer.ts, line 104 at r1 (raw file):
Previously, nsthorat (Nikhil Thorat) wrote…
remove this

Done.

src/optimizers/adagrad_optimizer.ts, line 81 at r1 (raw file):
Previously, nsthorat (Nikhil Thorat) wrote…
remove this

Done.

src/optimizers/sgd_optimizer.ts, line 67 at r1 (raw file):
Previously, nsthorat (Nikhil Thorat) wrote…
remove this (I kept all graph stuff at the bottom of the file so this would be trivial to axe)

Done.

Comments from Reviewable


SHA1 created users cannot authenticate

I'm running directly against sorcery master to use the multi-identifier login (e.g. email or login) feature.  In setting things up I noticed that there is a problem if you create a user from the command line, exit, go back in and try to authenticate that user via User.authenticate.
Steps to reproduce:

Create a base rails app, add sorcery, generate standard user model.
rails c
User.create(:email =><EMAIL_ADDRESS>:password => 'password')
<EMAIL_ADDRESS>'password') => User model returned
Exit console
rails c
<EMAIL_ADDRESS>'password') => nil

I was able to track down the issue to a problem with the salt_join_token.  The SHA1 provider attempts to default the join_token to '--' if it's not set.  Unfortunately in one case it is nil (during authenticate) but during create (encrypt) it gets set to an empty string which overrides the ||= default in the provider.
When creating a user (which calls Sorcery::Model#encrypt) the code does:
@sorcery_config.encryption_provider.join_token = @sorcery_config.salt_join_token if @sorcery_config.encryption_provider.respond_to?(:join_token) && @sorcery_config.salt_join_token
which sets the join token to whatever's in the config.  The config (in the same file) defaults to an emtpy string for that key instead of nil so join token is ''.  The code for authenticate however does NOT appear to set the join_token so the the defaulting in the provider uses '--' as the join token and winds up with a different digest than when it was originally encrypted.
I "fixed" the problem for now by setting the salt_join_token default to nil in Sorcery::Model line 210 instead of "".  All the other values were already being defaulted to nil.  This change makes it so SHA1 uses '--' both during initial encryption and during authentication.
I'm guessing that Sorcery::Model#authenticate actually needs to pass the join_token (and stretches?) value down to the encryption provider like Sorcery::Model#encrypt does currently which would probably make my "fix" unnecessary.  My "fix" would still be required though for SHA1 to override the default value to be '--' instead of nil/'' though.
I tried to fork/fix but was unable to get the test suite to run.

+1
I was running into this same bug a few days ago while building a custom encryption provider based on the SHA1 class.


Fix sign-on url pattern and add reply url step

The Reply URL is required.

@trevordevore : Thanks for your contribution! The author, @jeevansd, has been notified to review your proposed change.

@chetansriv can you please review this and make the changes?

@trevordevore I have verified the SAML request which is being sent to Azure AD and I can see the Reply URL (Assertion Consumer URL) in it. In this case, Azure AD reads the Reply URL from the request and we don't need to specify this on Azure portal. Are you getting any error if you don't specify the Reply URL on portal? Attaching the SAML request for your reference.
cc: @jeevansd

@chetansriv I don't actually have a system set up for testing. I was on a screen sharing session with a customer who was trying to set things up and couldn't get it to work after following the instructions. The error mentioned the Reply url so he added it in and then the Azure/ScreenSteps connection started working.

@trevordevore In this case we need to retest the app before making any change in the tutorial. I'll try to create a trail account and try to test the integration. I'll also try to reach out to ScreenSteps support team to understand if there is any change in the Reply URL pattern etc. Also, it would be good if you can tell me the URL that customer entered to get this work? and/or check with that customer again if they recall the error message.

@trevordevore Although you dont specify this URL, the integration will work. But the pre-requisite on this is you have added the ScreenSteps applications from the gallery. The gallery application will not need the reply URL configuration in Azure AD. Still the integration will work.

@jeevansd So if the user tried to configure by hand rather than adding from the gallery than they would have to add the Reply-To url? If so I can check with my customer to see how they added it.

@trevordevore Yes, if they are adding the non-gallery application then they have to manually configure it. This is where we suggest that customer should use the gallery app where it requires minimum configuration and can still work with it.

#please-close


Add "Button looks like a link" variant

What
Add button that looks like a link variant of a button
Why
The toggle to expand content, such as show updates are links but should be buttons, like "Show more search options"  which we updated thanks to some prodding
View Changes
https://govuk-publishing-compo-pr-1135.herokuapp.com/component-guide/button/button_looks_like_link/preview

I'd consider making this a component in its own right, rather than a modifier on a button. Given you don't really want any of the styling that comes from the button component, and this is having to effectively 'unset' the majority of the button styling, it seems likely that future 'non-breaking' changes to the button component could break this.

ok will close this for now until I have time to work on the new component


Upgrade Minimum API version to Vulkan 1.3 (de facto, 1.2 de jure) and ROADMAP 2022

Description

Testing

TODO list:

Comments from old PR #503 :

https://github.com/Devsh-Graphics-Programming/Nabla/pull/503#discussion_r1213755793
https://github.com/Devsh-Graphics-Programming/Nabla/pull/503#discussion_r1218109647
https://github.com/Devsh-Graphics-Programming/Nabla/pull/503#discussion_r1218141038

/execute order 0x45ull

/execute order 0x45ull

/execute order 0x45ull

/execute order 0x45ull


CLOUDSTACK-10287 package require open jdk 1.8

Description

Types of changes

[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] New feature (non-breaking change which adds functionality)
[x] Bug fix (non-breaking change which fixes an issue)
[ ] Enhancement (improves an existing feature and functionality)
[ ] Cleanup (Code refactoring and cleanup, that may add test cases)

Screenshots (if appropriate):
How Has This Been Tested?

Checklist:

[ ] I have read the CONTRIBUTING document.
[ ] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[ ] I have added tests to cover my changes.
[ ] All new and existing tests passed.

@blueorangutan package

@DaanHoogland a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-1863

@DaanHoogland a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-1867


Health Check restriction (m-1)

Feature Description
The user should not be able to receive the funds if the health check is due for than m or more device

They should be warned!!!

Implemented the functionality just need the UX.
Dependent on #4567

Completed


A question about numerical values

Access the MYSQL database, and the return value is processed by goja.
Since the ID definition in the database is of bigint(20) type, it was found that the value was modified when returned.
Later tested in function:
return<PHONE_NUMBER>6993883;
The value I got from golang is<PHONE_NUMBER>6993890
Thank you so much for the effort you put into this project!

89758002686993883  exceeds JavaScript's safe integer range (2^53 - 1), leading to precision loss. To handle large integers beyond the safe range, you can use the BigInt type.
func main() {
	runtime := goja.New()
	value, ok := new(big.Int).SetString("89758002686993883", 0)
	if !ok {
		return
	}
	runtime.Set("value", value)
	result, _ := runtime.RunString(`value - BigInt('89758002686993883');`)
	fmt.Println(result.Export().(*big.Int))
}

@shiroyk Great, there is already support for BigInt.
I found that I need to update goja.
Thank you so much!


[SMALLFIX] Replace explicit type argument with template

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-Pull-Request-Builder/2531/
Test PASSed.

alluxio-bot, merge this please


Restrict profiles by users/groups

Can you implement a mechanism to enable profiles only  to specific users/groups so users won't be able to see all profiles by default?

Hi @diego-cocacola ,
Thank you for your suggestion. It's a good idea and something that others have asked for also.
Best approach would be to use the built in features for data sharing.
Today the user security role gives access to all access profiles. Will look at updating it to support your scenario and also look at documenting how to use this feature.
Please keep feedback like this coming!
Thanks

Hi @diego-cocacola,
The latest release restricts users from request access via profiles unless they are shared with the user or a team the user is in.
For details on how to share records please see the official docs here: https://learn.microsoft.com/en-us/power-apps/user/share-row
Would love your feedback on this :)


Record run history and setting shortcut for specific script for building and other things.

I wanna contribute for this, where to start..

The title isn't clearing up for me what you'd like to do, can you clarify it a bit more?

At the current time, we can only open a script file and running it, I hope there is a way to running a script even the script file is closed.
By using shortcut or menu list. That's need to record a list of historical commands.


Could not capture RTSP camera

Device: Jetson nano
TensorRT: 7.1.0-1
Cuda: 10.2
`NvMMLiteOpen : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteOpen : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 261 `
The program get static and does not show the camera. I guess may be an incompatibility between gtsCamera and Cuda version.

Were You able to solve this problem?


File System search using Spotter on Windows is broken.

Debug messages appear in the Spotter window when opening Spotter in the FIle System tool on Windows.  No search is possible.

Thanks

It will be integrated in the release after v0.8.2625


removing prod and technology metadata

removing prod and technology as they are not valid metadata values

OPS Build status updates of commit 8f2dc1b:
:warning: Validation status: warnings

File
Status
Preview URL
Details

docs-ref-autogen/microsoft-cognitiveservices-speech-sdk/index.yml
:warning:Warning
View (azure-node-latest)
Details

docs-ref-services/automation.md
:white_check_mark:Succeeded
View (azure-node-latest) View (azure-node-preview)

docs-ref-autogen/microsoft-cognitiveservices-speech-sdk/index.yml

[Warning] Uid(microsoft-cognitiveservices-speech-sdk) has already been defined in docs-ref-autogen/microsoft-cognitiveservices-speech-sdk/index.yml.

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

#sign-off


Feature request: Support element.createChild (and maybe a few other DOM methods)

After working on the Chrome DevTools source, what I miss most in vanilla JS is element.createChild and a few related methods.
It turns this:
var span = document.createElement("span");
span.classList.add("class-name");
span.textContent = "Hi!";
document.getElementById("parent").appendChild(span);

into:
document.getElementById("parent").createChild("span", "class-name").textContent = "Hi!";

See DOMExtension.js for the definition in Chrome.

Ooh, I missed the create method.


Upgrade numpy version from 1.2 to 2.x

Currently there's a hard dependency on numpy being < 2.x. This is probably due to Shap.
Check if we can use the 2.x versions without altering user environment.

Shap seems to have a new version. It might prompt us to upgrade Shap and fairlearn both (with other dependencies)


Muting words: for English language users, tokenize 's as a separate word

Currently, the way word mutes work, if you mute "Bob", you will still see posts that contain "Bob's".
When using English language mode, the tokenizer should regard the apostrophe as a word separator. So "Bob's" tokenizes as ["Bob", "'", "s"].
That way muting "Bob" would correctly hide posts containing "Bob's".
Not all languages work this way but from what I understand the same rule would also be helpful for Turkish.

Also French and Italian use l' as an article. The same rule would help these languages, if you mute "orange" it should also mute "l'orange". I haven't tested this and I don't know if this is actually a problem because I've only seen the version of this problem with English 's.

Slight modification to my proposal:

Make it based on the post's language. I noticed that it's possible to set a post's language in the corner of the new post box.
Use a list of apostrophe clitics for each language that has them. For English it's 's, 'm, and 've. For French it's l' and d'. These clitics would be parsed as separate "words" from the words they're attached to. In English words like don't and can't, the 't is not a clitic.

This was apparently fixed in the most recent update.


buildPythonPackage: recompile bytecode for reproducibility

Due to a change in pip the unpacked wheels are no longer reproducible.
We recompile the bytecode to cleanup this error.
https://github.com/NixOS/nixpkgs/issues/81441

Motivation for this change
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[ ] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[ ] Fits CONTRIBUTING.md.

@GrahamcOfBorg build python3Packages.requests
@GrahamcOfBorg build azure-cli

pycrypto is not building:
$ nix-build . -A pkgs.python37Packages.pycrypto
these derivations will be built:
  /nix/store/rb8djlzgnm3sb3l56z8976rnw8w3x8yq-python3.7-pycrypto-3.9.7.drv
building '/nix/store/rb8djlzgnm3sb3l56z8976rnw8w3x8yq-python3.7-pycrypto-3.9.7.drv'...
Sourcing python-recompile-bytecode-hook.sh
Sourcing python-remove-tests-dir-hook
Sourcing python-catch-conflicts-hook.sh
Sourcing python-remove-bin-bytecode-hook.sh
Sourcing setuptools-build-hook
Using setuptoolsBuildPhase
Using setuptoolsShellHook
Sourcing pip-install-hook
Using pipInstallPhase
Sourcing python-imports-check-hook.sh
Using pythonImportsCheckPhase
Sourcing python-namespaces-hook
unpacking sources
patching sources
configuring
no configure script, doing nothing
building
Executing setuptoolsBuildPhase
running bdist_wheel
running build
installing to build/bdist.linux-x86_64/wheel
running install
running install_egg_info
running egg_info
creating pycrypto.egg-info
writing pycrypto.egg-info/PKG-INFO
writing dependency_links to pycrypto.egg-info/dependency_links.txt
writing requirements to pycrypto.egg-info/requires.txt
writing top-level names to pycrypto.egg-info/top_level.txt
writing manifest file 'pycrypto.egg-info/SOURCES.txt'
reading manifest file 'pycrypto.egg-info/SOURCES.txt'
writing manifest file 'pycrypto.egg-info/SOURCES.txt'
Copying pycrypto.egg-info to build/bdist.linux-x86_64/wheel/pycrypto-3.9.7-py3.7.egg-info
running install_scripts
creating build/bdist.linux-x86_64/wheel/pycrypto-3.9.7.dist-info/WHEEL
creating 'dist/pycrypto-3.9.7-py3-none-any.whl' and adding 'build/bdist.linux-x86_64/wheel' to it
adding 'pycrypto-3.9.7.dist-info/METADATA'
adding 'pycrypto-3.9.7.dist-info/WHEEL'
adding 'pycrypto-3.9.7.dist-info/top_level.txt'
adding 'pycrypto-3.9.7.dist-info/RECORD'
removing build/bdist.linux-x86_64/wheel
Finished executing setuptoolsBuildPhase
installing
Executing pipInstallPhase
/build/dist /build
Processing ./pycrypto-3.9.7-py3-none-any.whl
Requirement already satisfied: pycryptodome in /nix/store/6qjnk13bsxhcqgbqw1qsz1y0l8cxh5bv-python3.7-pycryptodome-3.9.7/lib/python3.7/site-packages (from pycrypto==3.9.7) (3.9.7)
Installing collected packages: pycrypto
Successfully installed pycrypto-3.9.7
/build
Finished executing pipInstallPhase
post-installation fixup
shrinking RPATHs of ELF executables and libraries in /nix/store/gjch87j13jcx1kbazjsl8rxzvywr8fwf-python3.7-pycrypto-3.9.7
strip is /nix/store/bh3r88sv8wckwmfyhjxbqmxcha0hrm8h-binutils-2.31.1/bin/strip
stripping (with command strip and flags -S) in /nix/store/gjch87j13jcx1kbazjsl8rxzvywr8fwf-python3.7-pycrypto-3.9.7/lib
patching script interpreter paths in /nix/store/gjch87j13jcx1kbazjsl8rxzvywr8fwf-python3.7-pycrypto-3.9.7
checking for references to /build/ in /nix/store/gjch87j13jcx1kbazjsl8rxzvywr8fwf-python3.7-pycrypto-3.9.7...
Executing pythonRemoveTestsDir
Finished executing pythonRemoveTestsDir
pythonRecompileBytecodePhase
*** Error compiling '/nix/store/6xmiwapzvgx4a444b9qaz5ldfv2jqw1c-python3-3.7.7/lib/python3.7/site-packages/sitecustomize.py'...
PermissionError: [Errno 13] Permission denied: '/nix/store/6xmiwapzvgx4a444b9qaz5ldfv2jqw1c-python3-3.7.7/lib/python3.7/site-packages/__pycache__/sitecustomize.cpython-37.opt-2.pyc.140737341708784'
builder for '/nix/store/rb8djlzgnm3sb3l56z8976rnw8w3x8yq-python3.7-pycrypto-3.9.7.drv' failed with exit code 123
error: build of '/nix/store/rb8djlzgnm3sb3l56z8976rnw8w3x8yq-python3.7-pycrypto-3.9.7.drv' failed

maybe exclude the top level of site-packages?

actually, figured out root cause, some packages don't ship any .py's, and in that case, it errors out

Ah yes, pycrypto, my dummy package providing pycryptodome. Would be nice if we could finally get rid of it.

Thanks for the feedback, it's building now.

Oh, now we have another failure
$ nix-build -A python2.pkgs.setuptools
...
option -j not recognized
usage: python compileall.py [-l] [-f] [-q] [-d destdir] [-x regexp] [-i list] [directory|file ...]

arguments: zero or more file and directory names to compile; if no arguments given,
           defaults to the equivalent of -l sys.path

options:
-l: don't recurse into subdirectories
-f: force rebuild even if timestamps are up-to-date
-q: output only error messages
-d destdir: directory to prepend to file paths for use in compile-time tracebacks and in
            runtime tracebacks in cases where the source file is unavailable
-x regexp: skip files matching the regular expression regexp; the regexp is searched for
           in the full path of each file considered for compilation
-i file: add all the files and directories listed in file to the list considered for
         compilation; if "-", names are read from stdin
builder for '/nix/store/9hrz8wjl5ij1psq4b47yj0gbc4w3p3wm-python2.7-setuptools-44.0.0.drv' failed with exit code 1

Seems like Python 2 version does not have -j

gtk-doc fails with
pythonRecompileBytecodePhase
find: ‘/nix/store/i5cla9rwy1kaakwy7k4vdjgrlw6qawrj-gtk-doc-1.32/lib/python3.8/site-packages’: No such file or directory
builder for '/nix/store/7clc8qpva22qcq06w0fw9hiccicfziiv-gtk-doc-1.32.drv' failed with exit code 1

https://hydra.nixos.org/build/122153227
For now I'll pass

Issue tracking regressions https://github.com/NixOS/nixpkgs/issues/90516.

@adisbladis @davhau you may want to pass dontUsePythonRecompileBytecode = true; in poetry2nix and mach-nix. I don't expect trouble with Python 3 but there are already some Python 2 regressions. Depending on how many there are it may be disabled altogether for Python 2.

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/python-builds-keep-pyc-in-store-dockertools/8784/6


Remove explicit GOMAXPROCS configuration [phab:D578]

Created by schroederc at 2015-10-26 20:27:05:
Since we build our releases with Go 1.5, this configuration has become unnecessary.

shahms accepted this revision at 2015-10-26 20:30:30

schroederc closed via commit 361b2cf90ec9b7a0357d6165233d7dc4750af444 at 2015-10-26 20:33:11


[Feature] k3d-managed registry for v3

Overview
First Level

[ ] new command k3d create registry

[ ] --cluster (multiple): clusters to attach to upon creation

[ ] new command k3d delete registry
[ ] new command k3d start registry
[ ] new command k3d stop registry

Second Level

[ ] new flag k3d create cluster --use-registry REGISTRY_NAME

Important Notes

we need to keep track of the clusters using a registry, so that we can update the respective registries.yaml files when creating/starting/stopping/deleting a registry

Status

draft of first level k3d create registry command

@iwilltry check https://github.com/kubernetes/enhancements/blob/0d69f7cea6fbe73a7d70fab569c6898f5ccb7be0/keps/sig-cluster-lifecycle/generic/1755-communicating-a-local-registry/README.md which is accepted/merged. It proposes an incluster standardized ConfigMap for state that third party tooling can support.

Closed in favor of #334 which is adapted to the new project setup!


Inconsistent copyright attribution in license

During the contributors meeting we observed that the copyright attribution in the various license files is inconsistent between projects and between reality.
I would suggest using "Cucumber Ltd and Contributors".

As part of SmartBear, I have to suggest to also put "SmartBear" in the copyright. I am pretty sure we will have to, in addition or in replacement of the "Cucumber Ltd" one.
However, I would encourage putting the contributors first.
Maybe we may also consider having an explicit list of contributors, in a dedicated file (CONTRIBUTORS.md?) listing all contributors - even people who have contributed a single time - to the code? Git would then help to associate contributors to line of codes if this would be required later.

Maybe we may also consider having an explicit list of contributors, in a dedicated file (CONTRIBUTORS.md?) listing all contributors - even people who have contributed a single time - to the code?

I'd consider that another issue that can be resolved separately from or after this one.

For reference, Swagger (anther SmartBear open source project) uses "SmartBear Software Inc." https://github.com/swagger-api/swagger-ui/blob/master/LICENSE


Support byte[] payloads of type x-spring-tuple

To produce correct text output, the Log Sink is required to turn
any byte-encoded payloads of text type (such as text to json) back into strings.
This is implemented for text and json content-types and needs to be extended
for byte encoded Tuple payloads with x-spring-tuple content type header.
Tuple objects can be serialized ONLY by the TupleJsonMessageConverter.
The ApplicationJsonMessageMarshallingConverter fails to serialize Tuples
because the DefaultTuple contains non-serializable fields such as
configurableConversionService.
While TupleJsonMessageConverter supports application/json types its preceding lays below
the ApplicationJsonMessageMarshallingConverter in the list of pre-configured default
converters (CompositeMessageConverterFactory).
Therefore a Tuple payload outbound message with application/json content-type header
is matched by the ApplicationJsonMessageMarshallingConverter and fails to convert.
To handle the outbound messages to the TupleJsonMessageConverter the they
must use the x-spring-tuple content-type.
The TupleJsonMessageConverter converts the Tuple into a json message and encodes as byte array.
Note that the older TupleJsonMessageConverter 1.x versions encode the payload as string and
don't require special handling by the Log Sink.
Resolves #9
Related-To #7

@artembilan the commit message is updated to capture the problem context.


feat: add multi line yaml string to vars doc

Description & motivation
We are internally using dbt run or dbt run-operations commands that have many vars / args, which can make them hard to read in a readme or an Airflow DAG, if the command is a one liner. So we are usually using the proposed way of inputting vars, but realized that not everyone in the team was aware that this is a valid YAML string as well. So we added it to our internal documentation, but I thought this might be relevant for other dbt users as well. If not, feel free to reject the PR.

We appreciate your contributions to the dbt product documentation! Unfortunately, we are closing this PR as outdated with merge conflicts. We don't have permissions to edit this fork to fix the merge conflicts so we cannot update this content for publishing.
Feel free to open a new PR if you want to add this content to the docs! 🙇🏻


Slow answer

Hi,
is there anyone who know how to reduce the answer time to respond?
i read on some place that someone figured how to use the protocol S3( like the official bot is using) instead of S4 (like we are using in line-py) and it reduce from 6 second to 0.4 sec (way faster like the official bot).
Any idea?
This is the other place im talking about but its using the same base as line-py
(yes i read that we had to modify thrift and config)
https://github.com/cslinmiso/LINE-instant-messenger-protocol/issues/5
Thanks

Checkout your Internet uplink, remove unused code that may increase your task working time.

easier said than done :) unused code shouldnt increase the task working time no? but basically you are telling me that i need to remove some validation code the process dont really need to work?

It probably your long polling, sometimes LINE kinda buggy (like there's already new Op, but long polling not emitted new one, or it just like... died socket)

@anysz i thought that the long polling was the action(events) received?..... because that part is really quick.
I wanted to add stuff to my bot before looking more about that. im gonna time every part and look for what slow it down lol.
i read what you were talking about going into http or the point that the https wasn't always connected so it was slowing thing down so ill look into it.
if i can ask you something else.... do you have any idea how the bot could download an image sent by an other user?
i managed kick/protection/ban/tagall/sending image (really really slow cause of the same issue here) lots of other stuff linking the bot with my db but cant manage to download an image sent by a user lol


why I got different size of sents for training on wmt17_en_zh

❓ Questions and Help
Before asking:

search the issues.
search the docs.

What is your question?
When I preprocess the wmt17_en_zh data using the following command:
fairseq-preprocess --source-lang en --target-lang zh  --trainpref $TEXT/train --validpref $TEXT/valid --testpref $TEXT/test   --destdir data-bin --workers 3 --tokenizer space --thresholdtgt 0 --task translation
And I got the results:
2020-07-02 18:38:26 | INFO | fairseq_cli.preprocess | [en] Dictionary: 80128 types
2020-07-02 18:38:31 | INFO | fairseq_cli.preprocess | [en] /home/anbo/nmt/data/wmt17_en_zh/train.en: 227062 sents, 5960840 tokens, 0.0% replaced by
2020-07-02 18:38:31 | INFO | fairseq_cli.preprocess | [en] Dictionary: 80128 types
2020-07-02 18:38:32 | INFO | fairseq_cli.preprocess | [en] /home/anbo/nmt/data/wmt17_en_zh/valid.en: 2002 sents, 60441 tokens, 3.32% replaced by
2020-07-02 18:38:32 | INFO | fairseq_cli.preprocess | [en] Dictionary: 80128 types
2020-07-02 18:38:33 | INFO | fairseq_cli.preprocess | [en] /home/anbo/nmt/data/wmt17_en_zh/test.en: 2001 sents, 55915 tokens, 3.42% replaced by
2020-07-02 18:38:33 | INFO | fairseq_cli.preprocess | [zh] Dictionary: 79312 types
2020-07-02 18:38:39 | INFO | fairseq_cli.preprocess | [zh] /home/anbo/nmt/data/wmt17_en_zh/train.zh: 185743 sents, 4564331 tokens, 0.00532% replaced by
2020-07-02 18:38:39 | INFO | fairseq_cli.preprocess | [zh] Dictionary: 79312 types
2020-07-02 18:38:40 | INFO | fairseq_cli.preprocess | [zh] /home/anbo/nmt/data/wmt17_en_zh/valid.zh: 2002 sents, 52303 tokens, 5.95% replaced by
2020-07-02 18:38:40 | INFO | fairseq_cli.preprocess | [zh] Dictionary: 79312 types
2020-07-02 18:38:41 | INFO | fairseq_cli.preprocess | [zh] /home/anbo/nmt/data/wmt17_en_zh/test.zh: 2001 sents, 49145 tokens, 6.89% replaced by
2020-07-02 18:38:41 | INFO | fairseq_cli.preprocess | Wrote preprocessed data to data-bin
which means that I got different size of sents for English and Chinese.
I have segment the Chinese data using jieba, and the number of data as follows:
2001 test.en
2001 test.zh
227062 train.en
227062 train.zh
2002 valid.en
2002 valid.zh
So any suggestion?
The last version of fairseq.

Is there a specific example you are following?  Please provide the original data source where you downloaded the data and any kind of pre-processing you did to the data prior to calling fairseq-preprocess.

This isn't something we've seen before. Is it possible you have empty lines in your train.zh file?

So I also face the same issue, but after removing '\r' from the text my problem solve

So I also face the same issue, but after removing '\r' from the text my problem solve


Pwa-332 add Test IDs and StartPage test

Pull Request Test Coverage Report for Build 676

1 of 30 (3.33%) changed or added relevant lines in 3 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.2%) to 33.566%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

components/TabBar/index.jsx
0
1
0.0%

e2e/integration/StartPage.js
0
28
0.0%

Totals

Change from base Build 675:
-0.2%

Covered Lines:
1238

Relevant Lines:
3579

💛  - Coveralls


Why is includes for empty string is always true.

I tried 'abc'.includes('')  it returns true. Is this correct ? I was expecting it to return false.

Why would you expect it to return false? Every string includes the empty string an infinite number of times.

Note that this is the repository for Array.prototype.includes, not String.prototype.includes. And since both are in the upstream spec now, issues should be filed there: https://github.com/tc39/ecma262/issues


[Feature] Generate API TS types from OpenAPI/Swagger

Is your feature request related to a problem? Please describe.
Supporting and maintaining types manually on the frontend is troublesome and leads to runtime errors
Describe the solution you'd like
Generate the typescript types based on the swagger/openapi spec that we automatically export from the API
Consider the following tools:

https://github.com/drwpow/openapi-typescript

Describe alternatives you've considered
Generate types based on Prisma schema - not consistent with the actual API responses, just provides DB schema

npx openapi-typescript http://localhost:5010/docs-json --output defs.ts

Sample output:
https://gist.github.com/kachar/500d1d018a0e2d0c2e58733b5285be89

cc @dimitur2204


txt files don't appear in search?

Hi. I've used .txt extensions with my markdown files since forever (mostly so I can edit them even with apps that know nothing about markdown), so I was very happy to find this plugin for Obsidian. Thanks!
However, I've noticed that Obsidian search doesn't seem to find anything in .txt files. Is this something that can be addressed via the plugin?

I just noticed this myself! Hopefully there is an easy fix.


Change areItemsEqual to areItemStacksEqual

Because areItemsEqual does not compare NBT.

Thats also wrong. areItemStacksEqual compares the stack size, which you definitly not want in this case.
The correct way would be ItemHandlerHelper.canItemStacksStack().


Delete confirmation dialogue

In setting, the app doesn't ask confirmation to delete temporary files. I think we should add an alert dialogue for that. I am done with code, making PR for that.

BTW, don't you think the temporary files are useless? So no need of showing confirmation messages. If user deletes it, then it hardly make any problem.


TravisCI cleanup

Second attempt at general TravisCI cleanup. Changes:

Binaries fetched from the pre-install phase are now cached, which should speed things up and reduce test failures from network glitches
Remove unused code

Getting the binaries to cache ended up being pretty cumbersome, and have some sharp edges (see the comment added to travis.sh for details. I still think these changes are worthwhile, but could see the argument for why it's not. Deferring to JD or Matt on whether we should go forward with this.

This build passed: https://travis-ci.org/pachyderm/pachyderm/builds/490701483?utm_source=github_status&utm_medium=notification
Even though it shouldn't because there were test functions that called testDeploy which was removed: https://github.com/pachyderm/pachyderm/blob/a39c8539f5b110238016a4f0dfee257183fdf42c/src/server/cmd/pachctl/cmd/cmd_test.go#L16-L34
Is cmd_test.go just not running at all?
@jdoliner I know you hit issues on master when testDeploy was removed in the earlier cleanup PR. Did you come across that on a normal CI run, or something else?

That was on a normal CI run I believe.

In that case, it seems like the issue was transient, but I'm not sure why it happened.


Use fasthttp at consumer

Use fasthttp to improve rest api performance at consumer
Log level was hardcoded to Debug level. Fix this to take level from env
variable.
Fix an error for deploy/undelpoy-example in Makefile
Updated sdk-go version.

Signed-off-by: Jack Ding<EMAIL_ADDRESS>

/retest-required

/retest

@jzding , can this wait till we finish code freeze.

@jzding rebase pls

@jzding rebase pls

rebased

/lgtm


[SMALLFIX] Cleanup exceptions in RawTableMaster

I came across this when cleaning up a previously left TODO in RawTableMaster.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/Tachyon-Pull-Request-Builder/5997/
Test PASSed.

LGTM


add support for SCM type column in list views

Hi! Long time no see. Thanks for cleaning up the tests.


Streaming is very Slow

face_recognition version: 1.2.3
Python version: 3.5.2
Operating System: Ubuntu 16.0.4

Description
Describe what you were trying to get done.
Try to recognize the faces on live streaming
What I Did
Build the Model with pickel tool and used it in the source code.
Problem
The streaming from the webcam was very slow due to that face recognization is very slow in live streaming.
I running the code on  CPU  SO, Is there any way to increase the streaming speed.

For increase your fps, you can decrease your video resolution and use threading for streaming data like this


In general load is assumed to be fast, but recently two tenants went over multiple times the page_service.rs's get_active_tenant_with_timeout from: https://github.com/neondatabase/neon/blob/b6c7c3290f795d918f726de2df0015bb4a3cd260/pageserver/src/page_service.rs#L347
Quick log analysis revealed no obvious reason. Working assumption is that we were busy, perhaps with even blocking work as earlier initial logical size calculations most likely had started at this point (re: #2975).
Post-analysis ideas in general so we'd learn these early:

@koivunej thought of a "load takes more than hardcoded seconds => warn!"
@problame suggested an alert on long times

Aside note: we do log so much during startup and shutdown it's probably something to look into as well.

Put the storage operation time histograms on https://neonprod.grafana.net/d/b7a5a5e2-1276-4bb0-9e3a-b4528adb6eb6/storage-operations-histograms-in-prod?orgId=1&var-datasource=victoria-metrics-aws-prod&var-instance=All&var-operation=All

There seems to be a lot of fluctuation; a tenant with 10 timelines took over 100s to activate, this time only 70s.

I know you believe it's not the concurrency limiter semaphore, but, we could rule it out by introducing metrics that measure it.
I think you believe the root cause for this is the synchronous IO that we do. My https://github.com/neondatabase/neon/pull/4215 might fix this.

I at least in the past weeks have been thinking it could be the s3 semaphore which is why I had hoped to continue on that, one or two weeks. I did not deprioritize it.
I still don't agree we can just add permits, because it's trivial to go over the rps limits and recently all aws limit exceeding has resulted in unclear failures.
Would very much want to add the task metrics but it will be requiring a different set of buckets if we can get the spawn_blocking.

There's a more fresh duplicate: #4183 and an maybe an epic as well.
Fixes are in place: #4399 and are working, at best giving us 1ms per timeline, but at worst much more. Added #4892 for us to get understanding how long do things take.
Closing this to focus on #4183.


Cannot connect to Godaddy with ssh/rsync : doesn't prompt for password.

Please use the following bug reporting template to help produce actionable and reproducible issues. Please try to ensure that the reproduction is minimal so that the team can go through more bugs!
* A brief description
Will not ssh or rsync if a password is required
* Expected results
ssh -v<EMAIL_ADDRESS>OpenSSH_7.2p2 Ubuntu-4ubuntu2.1, OpenSSL 1.0.2g-fips  1 Mar 2016
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: /etc/ssh/ssh_config line 19: Applying options for *
debug1: Connecting to godaddyserver.com [<IP_ADDRESS>] port 22.
debug1: Connection established.
debug1: key_load_public: No such file or directory
debug1: identity file /home/user/.ssh/id_rsa type -1
debug1: key_load_public: No such file or directory
debug1: identity file /home/user/.ssh/id_rsa-cert type -1
debug1: key_load_public: No such file or directory
debug1: identity file /home/user/.ssh/id_dsa type -1
debug1: key_load_public: No such file or directory
debug1: identity file /home/user/.ssh/id_dsa-cert type -1
debug1: key_load_public: No such file or directory
debug1: identity file /home/user/.ssh/id_ecdsa type -1
debug1: key_load_public: No such file or directory
debug1: identity file /home/user/.ssh/id_ecdsa-cert type -1
debug1: key_load_public: No such file or directory
debug1: identity file /home/user/.ssh/id_ed25519 type -1
debug1: key_load_public: No such file or directory
debug1: identity file /home/user/.ssh/id_ed25519-cert type -1
debug1: Enabling compatibility mode for protocol 2.0
debug1: Local version string SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.1
debug1: Remote protocol version 2.0, remote software version OpenSSH_5.3
debug1: match: OpenSSH_5.3 pat OpenSSH_5* compat 0x0c000000
debug1: Authenticating to susieferry.com:22 as 'userhosting'
debug1: SSH2_MSG_KEXINIT sent
debug1: SSH2_MSG_KEXINIT received
debug1: kex: algorithm: diffie-hellman-group-exchange-sha256
debug1: kex: host key algorithm: ssh-rsa
debug1: kex: server->client cipher: aes128-ctr MAC<EMAIL_ADDRESS>compression: none
debug1: kex: client->server cipher: aes128-ctr MAC<EMAIL_ADDRESS>compression: none
debug1: SSH2_MSG_KEX_DH_GEX_REQUEST(2048<3072<8192) sent
debug1: got SSH2_MSG_KEX_DH_GEX_GROUP
debug1: SSH2_MSG_KEX_DH_GEX_INIT sent
debug1: got SSH2_MSG_KEX_DH_GEX_REPLY
debug1: Server host key: ssh-rsa SHA256:Mhpi2amT34lUMXtsrOVHKKoRkGlb6xW4AXPw+lMe4fY
debug1: Host 'susieferry.com' is known and matches the RSA host key.
debug1: Found key in /home/user/.ssh/known_hosts:1
debug1: rekey after<PHONE_NUMBER> blocks
debug1: SSH2_MSG_NEWKEYS sent
debug1: expecting SSH2_MSG_NEWKEYS
debug1: rekey after<PHONE_NUMBER> blocks
debug1: SSH2_MSG_NEWKEYS received
debug1: SSH2_MSG_SERVICE_ACCEPT received
debug1: Authentications that can continue: publickey,gssapi-keyex,gssapi-with-mic,password
debug1: Next authentication method: gssapi-keyex
debug1: No valid Key exchange context
debug1: Next authentication method: gssapi-with-mic
debug1: Unspecified GSS failure.  Minor code may provide more information
No Kerberos credentials available
debug1: Unspecified GSS failure.  Minor code may provide more information
No Kerberos credentials available
debug1: Unspecified GSS failure.  Minor code may provide more information
debug1: Unspecified GSS failure.  Minor code may provide more information
No Kerberos credentials available
debug1: Next authentication method: publickey
debug1: Offering ECDSA public key: normal
debug1: Authentications that can continue: publickey,gssapi-keyex,gssapi-with-mic,password
debug1: Trying private key: /home/user/.ssh/id_rsa
debug1: Trying private key: /home/user/.ssh/id_dsa
debug1: Trying private key: /home/user/.ssh/id_ecdsa
debug1: Trying private key: /home/user/.ssh/id_ed25519
debug1: Next authentication method: password
<EMAIL_ADDRESS>password:
debug1: Authentication succeeded (password).
* Actual results (with terminal output if applicable)
ssh -v<EMAIL_ADDRESS>OpenSSH_6.6.1, OpenSSL 1.0.1f 6 Jan 2014
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: /etc/ssh/ssh_config line 19: Applying options for godaddyserver.com
debug1: Connecting to godaddyserver.com [<IP_ADDRESS>] port 22.
debug1: Connection established.
debug1: identity file /home/user/.ssh/id_rsa type -1
debug1: identity file /home/user/.ssh/id_rsa-cert type -1
debug1: identity file /home/user/.ssh/id_dsa type -1
debug1: identity file /home/user/.ssh/id_dsa-cert type -1
debug1: identity file /home/user/.ssh/id_ecdsa type -1
debug1: identity file /home/user/.ssh/id_ecdsa-cert type -1
debug1: identity file /home/user/.ssh/id_ed25519 type -1
debug1: identity file /home/user/.ssh/id_ed25519-cert type -1
debug1: Enabling compatibility mode for protocol 2.0
debug1: Local version string SSH-2.0-OpenSSH_6.6.1p1 Ubuntu-2ubuntu2.8
ssh_exchange_identification: Connection closed by remote host
* Your Windows build number
1607 14393.105
* Steps / commands required to reproduce the error
see above
* Strace of the failing command
see above
* Required packages and commands to install
none
See our contributing instructions for assistance.

Thanks @OldSurferDude for posting -- do you have anything in your ~/.ssh/config or any customizations in /etc/ssh/ssh_config?  Password-based SSH works fine from me in WSL.

Sorry forgot to note that.  Thanks for reminding me.
Nothing in ~/.ssh
/etc/ssh/ssh_config is
Host *
PreferredAuthentications=password
PasswordAuthentication yes
SendEnv LANG LC_*
HashKnownHosts yes
GSSAPIAuthentication yes
GSSAPIDelegateCredentials no

Linking to https://github.com/Microsoft/WSL/issues/2138. Please refer there for rsync updates

debug1: Local version string SSH-2.0-OpenSSH_6.6.1p1 Ubuntu-2ubuntu2.8
ssh_exchange_identification: Connection closed by remote host

Not related to rsync but dupe all the "need help with ssh" question posts. rsync was never spawned; the remote sshd server hung up the phone before it got to that point.

OpenSSH_5.1 on the server appears to be an issue.
This is the case for some GoDaddy servers - other GoDaddy servers that are running OpenSSH_7.5 connect without issue (for me).


Refinement of the existing image component rendering

With the current implementation of the image component, it is difficult to find the re-upload and delete icons, especially when the uploaded image has a white background.
If a user uploads a file type other than an image, it is still difficult to locate the options to re-upload.

See attached video
https://github.com/shesha-io/shesha-framework/assets/151041759/5f0d3c8e-853f-4001-b0e1-1a6451a12e98

Hi @AlexanderSlavchovUX, please assist with a mockup which can be easier for end-users to find the options to re-upload/delete

Hi @hlayisanimazuze :)
The solution to this item is to create a shadow in the background of the image on hover and to show to circles which use the theme primary colour with the icons. See image and video below.
https://github.com/shesha-io/shesha-framework/assets/153498650/303f394c-be9b-42c1-9a2e-0ab9933a4ebd


Icon Request: Flask, Postman, Heroku

These main icons are missing.

[x] Flask Python Framework
[ ] Postman API Platform
[x] Heroku Cloud Platform

It will be good if you can add this. Reply back so that I can send the files :)

added flask and heroku in 2.1.0


About the main file

Hi, I'm going to host this lib on cdnjs.
The files of this lib are too large.
So I don't know which files should be added.
Could you help me?
Thanks!
https://github.com/cdnjs/cdnjs/issues/8855

I'm not sure to know what you need to host the lib on cdnjs.
I think that we need to solve #262 first.

Closing that issue for #6437.


Create WebViewProvider API

We need to change the way the web view api works so the renderer can reach out and get web views from the backend for the following benefits:

Changing layouts is possible
WebViews can have persistent state
Possibly embed WebViews in each other
WebViews persist through refreshing the page
Can open multiple of the same type of WebView if the extension allows

We need a WebViewProvider (or WebViewDeserializer or something) API similar to VSCode's WebViewPanelSerializer (example) that is a network object that has a method to deserialize a webview (aka provide the information needed to create the webview. Primarily the react function component or the html page) based on the state given to it (if we want to do this state thing).
Then the web view service would run these when it is loading its layout, then pass them into the dock layout react component once it gets the results.
The general flow would be according to the following very rough design diagram:

It seems to make sense also that we would have some web view service function or something that creates a panel with a specified web view type (similar to the current addWebView command, but you don't have to provide the contents. Just the panel/layout properties and the webview type). In that, the webview service would reach out to the appropriate WebViewProvider to get the actual web view information to display it.

To do:

[ ] No more including content in OnDidAddWebView event
[ ] No more including content in webViewService.addWebView
[ ] Web View Provider provides content for a WebView
[ ] Types distinguish different kinds of WebViews
[ ] Some way to open a new webview
[ ] WebViews persist through refresh
[ ] WebView state?

WebView state split off to #222

Created pull request on rc-dock for patch applied to enable finding tabs by webViewType https://github.com/ticlo/rc-dock/pull/208

After this was first merged (PR #225), we see a number of errors in the browser console:

After this was first merged (PR #225), we see a number of errors in the browser console:

I have seen this recently as well in Paranext and in developing my own application. I think it is possible that the owner of the api added throttling to his api, and we are hitting that throttle limit. We may want to reach out to the owner of the api to discuss the situation with him, just stop using the api (maybe @lyonsil could implement the data provider in C# instead ;) ), or temporarily host our own (seems like overkill). It may be worth discussing what we want to do moving forward. Could we close this issue again and open a new issue about figuring out what to do about bible.api?

It could just be a throttling issue with the site we are hitting. However, the first error is a CORS issue and it would surprise me if throttling caused that (but it might). If we can demonstrate that it's just a throttling error then this issue is done. Do you have any thoughts on how we could do that? Like, do you get those errors when you are completely offline? If you do and you go back to main before this PR was merged do we still see the same errors when offline?

Hmm... as a data point, I just ran up Rolf's PR#245 and didn't see any of those errors at first. However a restart (trivial change to main.ts) produced one set of the 3 errors. A full restart of npm start produces the errors again.

Created #258 for CORS issues.


Update changelog

Updating changlog prior to v1.3rc2 release.
#277 , #278 , #264

Pull Request Test Coverage Report for Build 1487

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 97.851%

Totals

Change from base Build 1486:
0.0%

Covered Lines:
1354

Relevant Lines:
1368

💛  - Coveralls

Pull Request Test Coverage Report for Build 1487

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 97.851%

Totals

Change from base Build 1486:
0.0%

Covered Lines:
1354

Relevant Lines:
1368

💛  - Coveralls

Pull Request Test Coverage Report for Build 1487

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 97.851%

Totals

Change from base Build 1486:
0.0%

Covered Lines:
1354

Relevant Lines:
1368

💛  - Coveralls

Pull Request Test Coverage Report for Build 1487

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 97.851%

Totals

Change from base Build 1486:
0.0%

Covered Lines:
1354

Relevant Lines:
1368

💛  - Coveralls

Pull Request Test Coverage Report for Build 1487

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 97.851%

Totals

Change from base Build 1486:
0.0%

Covered Lines:
1354

Relevant Lines:
1368

💛  - Coveralls


[Feature request] Gradient accumulation with TPUs

I see this is currently not supported. Is this a limitation of TPUs or just not yet implemented? In the latter I might do a PR for it.

Looks like nothing special is needed for this in the end. @ifeherva would you like to try and do this as a PR? Otherwise I'll try and get to this before I go on holiday Friday :) (It's the same as doing it on a single GPU)

I can look into it but cannot promise I will finish it by Friday.

No need to finish by friday @ifeherva, that was my own limit from before I go on holiday :) You have two weeks if you choose to 😉

That's alright as well, we generally have a script that tests gradient accumulation, so it just needs to be ran on TPU. No new tests need to be added actually :)

see accelerate/src/accelerate/test_utils/scripts/test_sync.py


No revenue after clicking on ads

i dont get any revenue after viewing the ad.
please help me

This is a not about this library, but question about admob in general. You probably should reside to Google support if it’s not working as expected.


Website and extension using same model

Per the chrome extension example, you pack the model with the extension. Is there a way for a website and chrome extension to use the same cached model? If my project has both a website and extension, I hope they could use a single model instead of having store 2 on the user's machine.

Unfortunately (or perhaps, fortunately), there is a security protocol put in place by browsers to restrict cross-domain sharing of resources.
I would need to know a little bit more about your intended use-case (i.e., why you need the model to run on both a website and a chrome extension), but if you intend to run the chrome extension on that website, you could design your chrome extension in such a way to trigger the model to be downloaded on the website (and hence, to use browser cache).

I've been working on a small proof-of-concept extension where the model is downloaded separately: https://github.com/xenova/transformers.js/tree/extension/examples/extension
Let me know if that solves your problem!

Thanks for the reply.
So it seems you are putting the model in chrome local storage for the
cache. Isn't local storage reserved by domain and/or extension.
My use case is would be a website that has an integrate extension (same
login, data access). You can use a transformer model to process text while
on the website. But you can use the same model to process text while
browsing the web and save the results to your logged in account. It seems a
this would require two copies of the same model being cached on the user's
computer. An ideal workflow would be:
User signs up
User downloads/caches transformer.js model to process text on the website.
User install extension
User access the already downloaded model to do the same type of text
processing while browsing the web.
I am not sure this is possible because of the security concerns. I didn't
know if there was some permission setting in the extension that could allow
access to a already cached model. It's just that having two copies of the
same 1GB+ model on the user's machine is less than ideal.
On Sun, Jul 16, 2023 at 8:57 AM Joshua Lochner @.***>
wrote:

I've been working on a small proof-of-concept extension where the model is
downloaded separately:
https://github.com/xenova/transformers.js/tree/extension/examples/extension
Let me know if that solves your problem!
—
Reply to this email directly, view it on GitHub
https://github.com/xenova/transformers.js/issues/182#issuecomment-1637126135,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AFZCSEOM7HZ32B7SE67TSJTXQQFOTANCNFSM6AAAAAA2AYH5EQ
.
You are receiving this because you authored the thread.Message ID:
@.***>

Isn't local storage reserved by domain and/or extension.

The naming is a bit confusing (since the localStorage property is - as you said - reserved by domain), but the extensions API calls this the Storage API which is divided into four buckets ("storage areas"), one of which is storage.local. So my proof-of-concept is able to use the same model across different domains (or even across extensions; see here).

But you can use the same model to process text while browsing the web and save the results to your logged in account.

In this case, you could look into the externally_connectable option (https://developer.chrome.com/docs/extensions/mv3/messaging/#external-webpage), which allows you to receive and respond to messages from your website. For more info, see this twitter thread.

It seems a this would require two copies of the same model being cached on the user's computer.

Combining my proof-of-concept with externally_connectable should mean you only need one copy (which is stored/managed by the extension).

Ok, this sounds great.
On Sun, Jul 16, 2023 at 10:10 AM Joshua Lochner @.***>
wrote:

Isn't local storage reserved by domain and/or extension.
The naming is a bit confusing (since the localStorage property is - as
you said - reserved by domain), but the extensions API calls this the
Storage API which is divided into four buckets ("storage areas"), one of
which is storage.local. So my proof-of-concept is able to use the same
model across different domains (or even across extensions; see here
https://developer.chrome.com/docs/extensions/mv3/messaging/#external).
But you can use the same model to process text while browsing the web and
save the results to your logged in account.
In this case, you could look into the externally_connectable option (
https://developer.chrome.com/docs/extensions/mv3/messaging/#external-webpage),
which allows you to receive and respond to messages from your website. For
more info, see this twitter thread
https://twitter.com/clamentjohn/status/1678096766204248067.
It seems a this would require two copies of the same model being cached on
the user's computer.
Combining my proof-of-concept with externally_connectable should mean you
only need one copy (which is stored/managed by the extension).
—
Reply to this email directly, view it on GitHub
https://github.com/xenova/transformers.js/issues/182#issuecomment-1637141913,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AFZCSEKWTUZHWPLEIJTC2QLXQQOABANCNFSM6AAAAAA2AYH5EQ
.
You are receiving this because you authored the thread.Message ID:
@.***>


Onboard access CPF Compliance with Defender/Azure Sentinel security dashboard tool

Describe the issue
Azure has a very well built, mature security dashboard.  Not only are we interested in the security events themselves, but we are also interested in the cross-pollination of ideas and possibly even collapsing other security initiatives into less.
Additional context

We are unsure of what level of monitoring of Azure Sentinel is happening with SecOps at the moment (see second DoD).  We know they've been very busy and would like to know their intended directions/plans for Sentinel.

Definition of done

30 minute meeting with Jon for initial context and conversion, fast demo
Quick heads up/approval from Olena for the form
Nick C, Gary, Max, Julian and Bruce can see the dashboard same as Austin

This came into the ticket somehow but now Jon and I don't understand if it's needed:

Fill out the "Azure Cloud Updated Access Request Form" from ADMS

The main point of the ticket is that our teammates have access to see the Sentinel feed
Will create a new ticket for interacting with SecOps:

Meet with SecOps for current status and questions (Julian S, Chris C, Austin H, Jon M, Gary H, Bruce L)

@ActionAnalytics As per our discussion in MS Team, here is my suggestion to what the scope of this ticket might be, it is up to you as a PO to decide what scope to go with, from my experience I can just say that keeping the ticket scope clearly defined and narrow will increase the possibility that the ticket will be completed within a single Sprint and won't get spilled over multiple Sprints:
Olena's suggestion for the scope of this ticket (please help fill in the gaps that are highlighted in italic).
Title
Document the process for obtaining access (Do you know what level of access is needed?)  for CPF to Azure Sentinel
Why this work is needed?
Azure has a very well built, mature security dashboard.  Not only are we interested in the security events themselves, but we are also interested in the cross-pollination of ideas and possibly even collapsing other security initiatives into less. CPF Team need to have access to Azure Sentinel to monitor security events pertaining to the product team work in ECF and ???.
Additional context
Access to Sentinel is currently controlled by SecOps, a meeting is needed with the SecOps team to find out what the process is for requesting access to Sentinel for the CPF team: what form to use to submit a request for access, how to submit, who should approve it and the timeline for processing the request.
DoD:

Identify and document in this ticket all steps that the CPF team needs to take to request access to Sentinel

This is becoming a higher priority because we have some email threads ongoing between SecOps and Azure platform folks to understand and close potential legacy instances that are getting connection attempts.
If the VM is flagged, they get shut down by Jon (and future CPF Compliance stakeholders/platform Admins)

Needs on the ticket were clarified with PO.  A PIM-based process was set up in cooperation with ADMS group to provide system\dashboard access to 'Defender for Cloud' for our Cloud Security & Compliance team as well as for our PO and for Platform Administration.  The ADMS form that was indicated was found and filled out, but it will be clarified by ADMS during next PIM ticket if actually needed by them for this.
Access to the Azure Defender for Cloud main dashboard was tested and the people were added.  There was an issue during testing with Gary, and his access will be restored once PIM troubleshooting is completed in next PIM ticket (#2162), as there are nuances to PIM that have to be investigated.  Ticket follow up for discussion with SecOps was created (#2154)

Closing


Fixes playground intro text

Description
Fixes #2019: small change of intro text
Type of change

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update
[ ] Code quality improvements

How to test
Playground intro text should now read:
Welcome to the Source Academy playground!
The book...
Checklist

[x] I have tested this code
[ ] I have updated the documentation

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 30.943%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
3470

Relevant Lines:
10454

💛  - Coveralls


have a figure for showing multi mappers vs duplicates

in the filtering BAM lesson

https://www.semanticscholar.org/paper/CLIP-seq-analysis-of-multi-mapped-reads-discovers-Zhang-Xing/b403d8737a9f56397391232d083a351860a8215b
Something like this and then a similar image of stacked reads for duplicates

thank you @Gammerdinger


fix(PE-6443): add api that returns the total token supply

The process computes this value based on its local state

:tada: This PR is included in version 2.1.0-alpha.2 :tada:
The release is available on:

npm package (@alpha dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 2.1.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Not receiving realtime updates to desktop/web session

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number:
Reproducible in staging?: Needs Reproduction
Reproducible in production?: Needs Reproduction
If this was caught on HybridApp, is this reproducible on New Expensify Standalone?:
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Expensify/Expensify Issue URL:
Issue reported by: @quinthar
Slack conversation (hyperlinked to channel name): ts_external_expensify_quality
Action Performed:

Login to staging.new.expensify.com as user A
As user B send messages to user A

Expected Result:
User A receives message in real time
Actual Result:
For user A typing indicator displayed, not receiving realtime updates to desktop/web session, but receiving push notifications in mobile for the same
Workaround:
Can the user still use Expensify without this being fixed? Have you informed them of the workaround?
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android: Standalone
[ ] Android: HybridApp
[ ] Android: mWeb Chrome
[ ] iOS: Standalone
[ ] iOS: HybridApp
[ ] iOS: mWeb Safari
[x] MacOS: Chrome / Safari
[ ] MacOS: Desktop

Screenshots/Videos

Add any screenshot/video evidence

https://github.com/user-attachments/assets/7b474301-da0e-40c3-b26a-188569db9537
View all open jobs on GitHub
Issue OwnerCurrent Issue Owner: @deetergp

This has been labelled "Needs Reproduction". Follow the steps here: https://stackoverflowteams.com/c/expensify/questions/16989

@deetergp I'm assuming notification issues like this need to remain internal, but let me know if you don't think so and we can ask a C+ to get involved as a next step to try and reproduce.
I seemingly can't repro this myself. Question from the thread is: "Why isn't the ping/ping detecting and fixing this?"

@deetergp thoughts on the above, will you be able to look at this today?
CC: @muttmuure I think this one is in the CRITICAL category for #quality, so I've moved it there.

Great!
On Mon, 18 Nov 2024 at 11:35, Tom Rhys Jones @.***>
wrote:

@deetergp https://github.com/deetergp thoughts on the above, will you
be able to look at this today?
CC: @muttmuure https://github.com/muttmuure I think this one is in the
CRITICAL category for #quality, so I've moved it there.
—
Reply to this email directly, view it on GitHub
https://github.com/Expensify/App/issues/52437#issuecomment-2482786721,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ALGRREHAPCVDK6DGO5NCLVT2BHGI7AVCNFSM6AAAAABRVGUUOCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIOBSG44DMNZSGE
.
You are receiving this because you were mentioned.Message ID:
@.***>

@trjExpensify I've spent a bit of time with this today and I also cannot seem to reproduce it. I've been having a protracted conversation between the ExpensiScotts (-fy.com & -fail.com) in splitscreen browser windows and they both come through fine. I'm looking at DM chat between DB & Kadie to see if there's anything "off" about what's in Auth and in the logs.

Gotcha. I'm sure DB would be happy to live debug or something, if you want to take it to the thread: https://expensify.slack.com/archives/C05LX9D6E07/p1731449676200089?thread_ts=1731299637.345689&cid=C05LX9D6E07

Spent a bit of time looking into this today and it interesting. A log search for blob:"PusherError" returns tens of thousands of results for just the last 24 hours. They all have the 1006 error code which Pusher's documentation has this to say about it:

When a WebSocket connection is closed without a "close frame", the pusher-js library emits an error with code 1006. Usually this is caused by WebSocket-incompatible proxies, which can't close the connection in the correct way.

Looking specifically into @quinthar's logs, I see an interesting 1006 log line that pops up: Software caused connection abort. Between my own searching and ChatGPT, it sounds like poor network connectivity can be a culprit, as can "Version or Library Mismatch". I found some GH issues from 2021 that talk about needing to be on the latest (for the time) version of 9.x. Looking in our package.json file, it looks like we are on v 8.3.0. Maybe we need to update the version of the pusher client we are using?
I'm not sure how involved updating to a newer version might be, maybe @mountiny or @AndrewGable might have some insight?

@deetergp I dont know the specifics it would involve to update the pusher, but here is a PR when we did it last time and seems like it was fine without any specific testing and it was fine. So I would check if there are any specific breaking changes that should worry us and try to update it. However, we are already on the latest officially stable version 8.3.0 https://www.npmjs.com/package/pusher-js?activeTab=versions the next version 8.4.0 is still a release candidate.

Hmm… Maybe I'm confusing versions of other things. @quinthar Does this happen when you're using a poor connectivity setting in Dev Tools? Just trying to narrow down possible causes…

More discussion happening here and it sounds like we are leaning toward carving out a mini project to add our own Pusher ping to ensure the channel is open.

More discussion happening here and it sounds like we are leaning toward carving out a mini project to add our own Pusher ping to ensure the channel is open.

That sounds like a good idea! Will you create a new tracking issue for that, or use this one?

That sounds like a good idea! Will you create a new tracking issue for that, or use this one?

I think maybe a new tracking issue might be the right call. I'll make a new one and close this one in favor of that.

Going on hold until we have an application layer PING dedicated to Pusher. When we do, we can either fix actionable connection failures we find, or close this because a consistent application layer PING keeps pusher working well.

@deetergp before I add AutoAssignerNewDotQuality to the issue this is held on, do you want to be assigned to that one too since you've already one done research?

@mallenexpensify @muttmuure Let's put this one out there and see if someone else wants it. I've got Vacation Delegates and Improving System Messages in my immediate future, but if this is still out there when I get those in a happy place, I'll snag it.

I'm going to take this and begin looking into it.

Daily Update
I looked into some of these logs, and I found that the logs for<EMAIL_ADDRESS>are actually quite abnormal when it comes to the 1006 error. I compared them with some other accounts<EMAIL_ADDRESS>logs and also<EMAIL_ADDRESS>logs).
David's logs contain error messages from Pusher like:

Read error: ssl=0xb400007bf6708a18: I/O error during system call, Software caused connection abort
Software caused connection abort
Connection interrupted (undefined)

These errors are virtually non-existent from the other two accounts.
I have opened up a support case with Pusher to see if they can help diagnose and understand these errors better and see if we can find a fix.
Next Steps

@tgolen Work with Pusher support to understand the errors more
@tgolen begin investigating the abnormal errors to see what other users are experiencing them

ETA

TBD

Daily Update

I haven't gotten any response from Pusher
I submitted another support request to them, this time from infra@expensify, which is the email attached to the account (yesterday I had used my own email)

Contents of Email
Hello,
Our Expensify application has users experiencing many connection errors that return with the error code 1006. I have been trying to debug these errors more and I am reaching out for your help and guidance.
I looked at our logs for three users:

<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>
The first two accounts have normal looking logs. When the 1006 error happens, there is no "message" property in the error and their clients are able to reconnect right away.
The last account has abnormal looking logs. The 1006 error has a "message" property with things like:

Read error: ssl=0xb400007bf66e7358: I/O error during system call, Software caused connection abort
Connection interrupted (undefined)
Software caused connection abort

These messages are virtually non-existing in the first two accounts, but it's not the only account they are happening on. When these errors happen, the client is NOT able to reconnect to pusher and they stay disconnected and aren't able to receive any more pusher messages.
I have gathered the logs for the last couple of days and put them into this Google doc which you can see for further analysis: https://docs.google.com/document/d/1TYUsq2IYaKiNTAWE89LH5Cmq2WLbBeRQ-3sCp--goZY/edit?tab=t.0
Can you please help me diagnose these messages further?
Thank you,
Tim

Next Steps

@tgolen Wait for a reply from Pusher and try to work with them to understand the errors

ETA

TBD

Daily Update

I still haven't gotten any response from Pusher
I found a contact form on their site for "Premium Support" and I filled out the contact form to see if that will wake someone up

Next Steps

@tgolen Keep trying to engage with Pusher and contact them

ETA

TBD

Reckon we won't hear back soon cuz of the holidays. I don't see an email in the cell for Relationship Owner (External) on the VML. Cole's the relationship owner, if we're still getting 👻 from Pusher, he can likely help light a 🔥 in the new year.

Daily Update

I still have not gotten a response from Pusher
Today, there was an email in the infra@ inbox that was from our account manager asking about renewing our contract for next year
I responded to the email asking for some support

Next Steps

See if I can finally get some engagement with Pusher to diagnose these errors

ETA

TBD

Daily Update

It sounds like I am finally getting in touch with the right people.
I was also informed that we have a shared slack channel with Bird/Pusher
My email is getting forwarded onto the support team

Next Steps

Wait for a response from the proper tier of support and then figure out next steps

ETA

TBD

Reply from Pusher/Bird:
Hi Tim,

Thanks for your patience. I have reviewed the details provided and escalated the issue to our engineering team. I will keep you posted with any findings they share.

Please let us know if you have any questions in the interim.

Best regards,

Samhita

Sr. Technical Support Engineer | Bird

Working Hours: M-F 7am - 3pm EST


LAB_09a-Implement_Web_Apps.md - recommended updates

In a recent QA the following updates were recommended:
Exercise 1	Task 6	Step 3	Seleccione Escala basada en una métrica y haga clic en Añadir una regla (aparece como hiper vínculo en la categoría reglas)	Una pregunta frecuente es que no encuentran el "botón" de +Agregar una regla, sugiero agregar el comentario que aparece como hiper vínculo

Hello contributor,
Thank you for your contribution! We are processing your suggestions and we will update you shortly.
Kind regards,
Microsoft Worldwide Learning Team

Locfiles

Locfile
Suggestion
Exercise 1 Task 6 Step 3 Select Scale based on a metric and click Add a rule (appears as hyperlink in the rules category) A frequently asked question is that they do not find the "button" of +Add a rule, I suggest adding the comment that appears as hyper link
This is non linked but a suggestion to clarify the steps in en-us - PM followup required


Add allowEmpty

New pull request to work with latest version of master to allow auto merge.
This adds the ability to allow empty values while also obeying allowZero.
This is in response to: https://github.com/plentz/jquery-maskmoney/issues/83

:+1:

@plentz Can you please merge this PR?

:+1:

:+1:

@jpSimkins with the following config I have a bug
If I click in the field and click outside it, it will be filled with 0.00, even if I didn't type anything:
$('#my-field').maskMoney({
    allowZero: true,
    allowNegative: true,
    allowEmpty: true,
    defaultZero: false,
    affixesStay: false,
    precision: 2,
    thousands: '',
    decimal: '.'
});

@alanwillms I'm dealing with the same issue. It appears that allowEmpty leaves the field empty if the default value is removed. allowEmpty works as expected if the field is currently 0. However, if you have anything other than the default value, it will fill in the field with 0 since it's the default.
For now, if you want an empty field, replace whatever field has with 0 then delete it. The field will be left empty after that.

Yes, that was left that way mostly due to my needs. I wanted to allow empty but leave it as a zero mask unless purposely removed. I will work on adding a new option to have either behavior as I actually need the zero mask on blur and only want empty when specified. I understand the need for both ways so I will work on this when I get a chance (next week or two).Thanks for the information.

Ok, this was really easy to fix. Just trying to come up with a decent name for the setting. I was testing with allowEmptyDefault but I'm leaning more towards allowEmptyDefaultBlur since this is really for the default blur event when no input is entered. As soon as you have input you will have to double delete to get back to empty (like it currently is) as this has already applied the mask and the normal action takes place. This patch is really just for the default value blur event.
Any suggestions? I would like to keep it with the allowEmpty prefix as this keeps it in the scope of the setting.

I kept it with allowEmptyDefault as this made the most sense. I also set it to true by default as the empty value seems implied on empty values. I feel it fits better to set this to false to have the logic I wanted for my project, where I want empty defaulted to the mask then manually removed.
The failed check seems to be due to something in the master build, not my patch.

+1

So, why hasn't this been merged yet? :shipit:

:+1:
Thank you so much!

The new core has it's own implementation. This is now obsolete.


Sidebar closing when clicking on input tag while on mobile.

I tryed to copy your sidebar on next.materializecss.com because I think it's beautiful (the css is slighty different), but I found a problem.
When I click on the search input on mobile, it closes the sidebar.
The original doesn't have this behavior, but I don't understand what it's causing it. Can someone help me?
I'm using alpha4, here's the codepen: https://codepen.io/Shinseiten/pen/dmGNZv
Thank you very much in advance.

I'm not seeing the problem in the codepen, any additional steps to reproduce?

I believe this is the same issue as #5677. This has been fixed and will be included in the next release

Yes, I think it's the same. Sorry I didn't find that. I'll wait for the patch.
Thank you with your hard work. You're amazing!


Projects: Unable to load remote git repo in Windows

What are the steps to reproduce?

Set up SSH key in User Settings -> Git config
Add the SSH key in github.com -> Personal settings -> SSH Keys
Create a project
Set remote repository e.g. git@github.com:my-org/my-repo.git
Go to history -> Commit History -> Manage remote branch -> Expand the remote repo to load it
When Authentication required for repository prompt shows up, enter passphrase and click Retry

What happens?
{ Error: Warning: Identity file C:Usersrophy.node-redprojects.sshkeys__default_chc not accessible: No such file or directory.
<EMAIL_ADDRESS>Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.

    at ChildProcess.<anonymous> (D:\Users\rophy\npm\node_modules\node-red\red\runtime\storage\localfilesystem\projects\git\index.js:48:27)
    at emitTwo (events.js:126:13)
    at ChildProcess.emit (events.js:214:7)
    at maybeClose (internal/child_process.js:925:16)
    at Process.ChildProcess._handle.onexit (internal/child_process.js:209:5)
  stdout: '',
  stderr: 'Warning: Identity file C:Usersrophy.node-redprojects.sshkeys__default_chc not accessible: No such file or<EMAIL_ADDRESS>Permission denied (publickey).\r\nfatal: Could not read from remote repository.\n\nPlease make sure you have the correct access rights\nand the repository exists.\n',
  code: 'git_auth_failed',
  remote: 'origin' }

What do you expect to happen?
SSH key should work, instead of complaining "No such file or directory".
Notice in the error message that path separators \  of ssh key are missing, may be this is the cause? (say, ssh key was saved with incorrect handling of slashes in windows)
Please tell us about your environment:

[x] Node-RED version:  v0.18.2
[x] node.js version: v8.9.3
[x] npm version: v5.6.0
[x] Platform/OS: Windows 7
[ ] Browser:

Fixed by e8fd7484b6b19b11d067cf31b612681d4cb42870 and ce5242cfe8efc2c09b4a652578d8f72c894263771 - will be in 0.18.4 released very soon.
Still some issues with HTTPS authentication on Windows 10 - but ssh urls all working now.

Still some issues with HTTPS authentication on Windows 10 - but ssh urls all working now.

@knolleary
trying to connect to remote repo on windows 10, using https, without succes.  No feedback messages, just timing out after some time.    You mentioned there are still some issues.  Is this still the case?  is this documented somewhere?

++ for HTTPS GIT connection on Windows10


Wrong title in readme

GraphCMS starter blog with React Static & graphql-request

Hey @capriosa , thanks for pointing it out, it's now fixed!


Can't modify the solution items as suggested in the documentation.

Step 3 option 1 in the documentation suggest I can modify the connections or update actions however the Edit option is not available.
At the top of the screen I'm getting this message.

You cannot directly edit the components within a managed solution. If the managed properties for solution components are set to allow customization, you can edit them from another unmanaged solution.

I suspect you need to make sure you imported the unmanaged version of the ZIP file.

I realized about a week later I was trying managed solution. I’m sorry for not updating sooner.


Always restart indexer container

Describe the bug
At the moment, the indexer's pod is not restarted if the container exists with a 0 exit code.
In production this causes some issues because while in theory no indexer exits with exit code 0 , in practice it happens and the indexer is not restarted.
To Reproduce
This is hard to reproduce, probably the easiest way is by setting the ENDING_BLOCK environment variable to stop the indexer when it reaches that block.
Expected behavior
The indexer pod should be restarted and the restart count should be incremented.
Additional context
Probably need an extra check in this code

@fracek I would like to work on this

We're rewriting the indexer tool at the moment and this won't be needed anymore.


What is the time drift on the RTC_SLOW_CLK and RC_FAST_CLK? (IDFGH-11664)

Answers checklist.

[X] I have read the documentation ESP-IDF Programming Guide and the issue is not addressed there.
[X] I have updated my IDF branch (master or release) to the latest version and checked that the issue is present there.
[X] I have searched the issue tracker for a similar issue and not found a similar issue.

General issue report
I have been unable to find documentation on the precision of the built-in clock sources

RTC_SLOW_CLK
RC_FAST_CLK

I am specifically looking for the specs on the esp32s3 mini 1, but hopefully we can get some specs for all of the chips?

What is the dependence of the drift to the temperature? Linear, quadratic? How many ppm / C or ppm / C² ?
What is the over-all deviation?

Thank you for your help.

Hi @amrsoll, I would ask you to submit this request using the following form: https://www.espressif.com/en/company/documents/documentation_feedback
We are likely not be able to support this question in ESP-IDF issue tracker since it has to do with hardware more than with ESP-IDF itself.

Thank you :)