kubeconform + monitoring.coreos.com

I'm using kubeconform to validate my schemas, but I can't make it work with monitoring.coreos.com, and checking the last week commits had some fixes in the repo but still.
$ kubeconform -schema-location default -schema-location 'https://raw.githubusercontent.com/datreeio/CRDs-catalog/main/{{.Group}}/{{.ResourceKind}}_{{.ResourceAPIVersion}}.json' -summary dev.yaml
helm-charts/artifacts/dev.yaml - CustomResourceDefinition alertmanagers.monitoring.coreos.com failed validation: could not find schema for CustomResourceDefinition
helm-charts/artifacts/dev.yaml - CustomResourceDefinition probes.monitoring.coreos.com failed validation: could not find schema for CustomResourceDefinition
helm-charts/artifacts/dev.yaml - CustomResourceDefinition podmonitors.monitoring.coreos.com failed validation: could not find schema for CustomResourceDefinition
helm-charts/artifacts/dev.yaml - CustomResourceDefinition alertmanagerconfigs.monitoring.coreos.com failed validation: could not find schema for CustomResourceDefinition
helm-charts/artifacts/dev.yaml - CustomResourceDefinition prometheusagents.monitoring.coreos.com failed validation: could not find schema for CustomResourceDefinition
helm-charts/artifacts/dev.yaml - CustomResourceDefinition prometheusrules.monitoring.coreos.com failed validation: could not find schema for CustomResourceDefinition
helm-charts/artifacts/dev.yaml - CustomResourceDefinition scrapeconfigs.monitoring.coreos.com failed validation: could not find schema for CustomResourceDefinition
helm-charts/artifacts/dev.yaml - CustomResourceDefinition servicemonitors.monitoring.coreos.com failed validation: could not find schema for CustomResourceDefinition
helm-charts/artifacts/dev.yaml - CustomResourceDefinition prometheuses.monitoring.coreos.com failed validation: could not find schema for CustomResourceDefinition
helm-charts/artifacts/dev.yaml - CustomResourceDefinition thanosrulers.monitoring.coreos.com failed validation: could not find schema for CustomResourceDefinition
Summary: 152 resources found in 1 file - Valid: 142, Invalid: 0, Errors: 10, Skipped: 0

Am I missing something?
kubeconform v0.6.4

@Skaronator this is exactly what I needed. I believe this should be somehow part of the documentation, it is quite confusing indeed the usage of the CDRs vs CRs


Repository push commands page has incorrect information for CLI

Go into a ECS/Repository in AWS Explorer, and click the View Push Commands link in the upper right corner.
You will get a page with push commands directions.
However, the AWS CLI examples are not correct.
I am using: aws-cli/2.6.1 Python/3.9.11 Windows/10 exe/AMD64 prompt/off
The directions fall apart on the first step - there is no aws ecr get-login command in the current version of the CLI.
Note: The AWS Powershell Tools directions are still correct

Version <IP_ADDRESS> of the Toolkit is now available. It contains updated push commands that are compatible with the current version of the AWS CLI.


[service-loadbalancer] Service load balancer SSL termination should rewrite URLs

The service load balancer should rewrite URLs to root based on the AclMatch annotation that is used to setup SSL termination. The template for the httpsTerm backend template doesn't contain the reqrep that the http backend does. This causes requests to be sent to the backend server on whatever path is in the acl instead of root.
Adding reqrep ^([^\ :]*)\ /{{$svc.AclMatch}}[/]?(.*) \1\ /\2
to the backend for httpsTerm within the template should resolve this issue and make https termination behave the same as http loadbalancing.

@jdavis7257 that sounds like a good change, can you send a pr? Ideally we'd want to pick one behavior as the default and allow the other to still work, eg: through an annotation on the Service.
Can you use the aclmatch annotation to do this? https://github.com/kubernetes/contrib/blob/master/service-loadbalancer/service_loadbalancer.go#L55
https://github.com/kubernetes/contrib/blob/master/service-loadbalancer/template.cfg#L93
This is how you'd set the annotation: https://github.com/kubernetes/contrib/tree/master/service-loadbalancer#ssl-termination

Hmm, Now that I think about it using the name for both the acl and rewrite like on the http services is a better option.  Then rewrite customization can be added via annotation later. This would make https termination work just like http and require only the httpsTerm annotation, eliminating the aclMatch unless customization was needed. Thoughts?


[stduuid] Add new port @1.2.2

Describe the pull request
I tried to address the issues of #16382 that were raised by @BillyONeal and lead to its revert in #20161.

What does your PR fix?

Fixes #22700
Fixes mariusbancila/stduuid#63

Which triplets are supported/not supported?

Yes

@BurningEnlightenment ,Thanks for your pr, when I tested the features locally by run command "./vcpkg install stduuid[*]:x64-windows" but failed:
Stored binary cache: C:\Users\test\AppData\Local\vcpkg\archives\3a\3aeb5f916ec5358eb5a509ef887e2f36dd9128b010edf877c7bedda9dc561293.zip
The following files are already installed in F:/Feature-test/stduuid/vcpkg/installed/x86-windows and are in conflict with stduuid:x86-windows

Installed by ms-gsl:x86-windows
    include/gsl/gsl
    include/gsl/gsl_algorithm
    include/gsl/gsl_assert
    include/gsl/gsl_byte
    include/gsl/gsl_util
    include/gsl/pointers
    include/gsl/span
    include/gsl/string_span

Please ensure you're using the latest port files with `git pull` and `vcpkg update`.

when I run command "./vcpkg install stduuid[*]:x64-linux" also failed:
OT_DIR=/home/test/test/vcpkg -D_VCPKG_INSTALLED_DIR=/home/test/test/vcpkg/installed -DVCPKG_MANIFEST_INSTALL=OFF
    Working Directory: /home/test/test/vcpkg/buildtrees/stduuid/x64-linux-rel
    Error code: 1
    See logs for more information:
      /home/test/test/vcpkg/buildtrees/stduuid/config-x64-linux-rel-out.log
      /home/test/test/vcpkg/buildtrees/stduuid/config-x64-linux-rel-err.log

Call Stack (most recent call first):
  installed/x64-linux/share/vcpkg-cmake/vcpkg_cmake_configure.cmake:355 (vcpkg_execute_required_process)
  ports/stduuid/portfile.cmake:19 (vcpkg_cmake_configure)
  scripts/ports.cmake:146 (include)

/home/test/test/vcpkg/buildtrees/stduuid/config-x64-linux-rel-err.log
CMake Error at cmake/FindLibuuid.cmake:11 (message):
  Could NOT find libuuid
Call Stack (most recent call first):
  /home/test/test/vcpkg/scripts/buildsystems/vcpkg.cmake:824 (_find_package)
  CMakeLists.txt:25 (find_package)

"./vcpkg install stduuid[*]:x64-windows" but failed

I forgot to reference the patch from vcpkg_from_github(), sorry.

"./vcpkg install stduuid[*]:x64-linux" also failed

I added a patch that integrates this package with the libuuid port.

All features are tested successfully in the following triplet:

x86-windows
x64-windows
x64-windows-static
x64-linux

This is ready for the next review round.


Website build on CI is down due to Julia error

Description
This is in the error log.
julia --color=yes --project=./ ./make.jl
┌ Warning: The environment variable `MXNET_HOME` has been renamed, please use `MXNET_ROOT` instead.
└ @ MXNet.mx /work/mxnet/docs/build_version_doc/apache-mxnet/master/julia/src/base.jl:63
ERROR: LoadError: LoadError: Cannot find or load libmxnet.so. Please see the document on how to build it.

http://jenkins.mxnet-ci.amazon-ml.com/job/restricted-website-build/

It's going to be this PR that triggered the problem:
#15568

Since #16147 was raised that seems to address this issue and the website publishing has been successful for the last 15 runs, I will close this issue. Please reopen if I am closing in error.

Seems to be failing again due to a different reason: http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Fwebsite/detail/PR-17302/13/pipeline/
[2020-02-07T01:31:11.534Z] Traceback (most recent call last):

[2020-02-07T01:31:11.534Z]   File "/home/jenkins_slave/.local/bin/mkdocs", line 8, in <module>

[2020-02-07T01:31:11.534Z]     sys.exit(cli())

[2020-02-07T01:31:11.534Z]   File "/home/jenkins_slave/.local/lib/python3.5/site-packages/click/core.py", line 764, in __call__

[2020-02-07T01:31:11.534Z]     return self.main(*args, **kwargs)

[2020-02-07T01:31:11.534Z]   File "/home/jenkins_slave/.local/lib/python3.5/site-packages/click/core.py", line 717, in main

[2020-02-07T01:31:11.534Z]     rv = self.invoke(ctx)

[2020-02-07T01:31:11.534Z]   File "/home/jenkins_slave/.local/lib/python3.5/site-packages/click/core.py", line 1137, in invoke

[2020-02-07T01:31:11.534Z]     return _process_result(sub_ctx.command.invoke(sub_ctx))

[2020-02-07T01:31:11.534Z]   File "/home/jenkins_slave/.local/lib/python3.5/site-packages/click/core.py", line 956, in invoke

[2020-02-07T01:31:11.534Z]     return ctx.invoke(self.callback, **ctx.params)

[2020-02-07T01:31:11.534Z]   File "/home/jenkins_slave/.local/lib/python3.5/site-packages/click/core.py", line 555, in invoke

[2020-02-07T01:31:11.534Z]     return callback(*args, **kwargs)

[2020-02-07T01:31:11.534Z]   File "/home/jenkins_slave/.local/lib/python3.5/site-packages/mkdocs/__main__.py", line 162, in build_command

[2020-02-07T01:31:11.534Z]     site_dir=site_dir

[2020-02-07T01:31:11.534Z]   File "/home/jenkins_slave/.local/lib/python3.5/site-packages/mkdocs/config/base.py", line 197, in load_config

[2020-02-07T01:31:11.534Z]     errors, warnings = cfg.validate()

[2020-02-07T01:31:11.534Z]   File "/home/jenkins_slave/.local/lib/python3.5/site-packages/mkdocs/config/base.py", line 115, in validate

[2020-02-07T01:31:11.534Z]     post_failed, post_warnings = self._post_validate()

[2020-02-07T01:31:11.534Z]   File "/home/jenkins_slave/.local/lib/python3.5/site-packages/mkdocs/config/base.py", line 95, in _post_validate

[2020-02-07T01:31:11.534Z]     config_option.post_validation(self, key_name=key)

[2020-02-07T01:31:11.534Z]   File "/home/jenkins_slave/.local/lib/python3.5/site-packages/mkdocs/config/config_options.py", line 432, in post_validation

[2020-02-07T01:31:11.534Z]     config[key_name] = theme.Theme(**theme_config)

[2020-02-07T01:31:11.534Z]   File "/home/jenkins_slave/.local/lib/python3.5/site-packages/mkdocs/theme.py", line 48, in __init__

[2020-02-07T01:31:11.534Z]     self._load_theme_config(name)

[2020-02-07T01:31:11.534Z]   File "/home/jenkins_slave/.local/lib/python3.5/site-packages/mkdocs/theme.py", line 78, in _load_theme_config

[2020-02-07T01:31:11.534Z]     theme_dir = utils.get_theme_dir(name)

[2020-02-07T01:31:11.534Z]   File "/home/jenkins_slave/.local/lib/python3.5/site-packages/mkdocs/utils/__init__.py", line 278, in get_theme_dir

[2020-02-07T01:31:11.534Z]     return os.path.dirname(os.path.abspath(theme.load().__file__))

[2020-02-07T01:31:11.534Z]   File "/usr/local/lib/python3.5/dist-packages/pkg_resources/__init__.py", line 2443, in load

[2020-02-07T01:31:11.534Z]     self.require(*args, **kwargs)

[2020-02-07T01:31:11.534Z]   File "/usr/local/lib/python3.5/dist-packages/pkg_resources/__init__.py", line 2466, in require

[2020-02-07T01:31:11.534Z]     items = working_set.resolve(reqs, env, installer, extras=self.extras)

[2020-02-07T01:31:11.534Z]   File "/usr/local/lib/python3.5/dist-packages/pkg_resources/__init__.py", line 792, in resolve

[2020-02-07T01:31:11.534Z]     raise VersionConflict(dist, req).with_context(dependent_req)

[2020-02-07T01:31:11.534Z] pkg_resources.VersionConflict: (Markdown 3.2 (/home/jenkins_slave/.local/lib/python3.5/site-packages), Requirement.parse('markdown<3.2'))

[2020-02-07T01:31:11.534Z] Makefile:19: recipe for target 'all' failed

Found here too - http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Fwebsite/detail/PR-17500/6/pipeline
#17500

This affects all PRs.

Looks like it was working 2 days ago:
http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Fwebsite/detail/PR-17486/3/pipeline/86
What changed since then?

My guess is that the dependencies in the julia docs chain hit this error:
ERROR: mkdocs-material 4.6.0 has requirement markdown<3.2, but you'll have markdown 3.2 which is incompatible.

It does this:
pip install --user pygments mkdocs mkdocs-material python-markdown-math

So I'm thinking those all need to be version pinned and roll back mkdocs-material to a version that still works. Or pin markdown to a previous version...
That would be here:
https://github.com/apache/incubator-mxnet/blob/7caffa65e30f37e70796ba165ac5a4265e64974e/julia/docs/Makefile#L23

I'm about to head out to the airport and be traveling, so I don't know if I can test this and help with a patch in a reasonable amount of time... any takers?

@aaronmarkham indeed it's a version problem:
pkg_resources.VersionConflict: (Markdown 3.2 (/home/jenkins_slave/.local/lib/python3.5/site-packages), Requirement.parse('markdown<3.2'))

working on a fix, will have a PR out soon.

#17549 is merged but looks like the issue is still there.

Oh boy:
04:34:06  ERROR: pymdown-extensions 6.3 has requirement Markdown>=3.2, but you'll have markdown 3.1 which is incompatible.
04:34:06  ERROR: mkdocs-material 4.6.2 has requirement markdown>=3.2, but you'll have markdown 3.1 which is incompatible.

So these dependencies are fighting over this markdown version. One says it must be 3.2 or greater the other says it must be less.
I have an idea:
If someone has an older setup building locally that works - try that and export the pip versions and we pin it like that. Or maybe there's some old docker image that has this setup?
Also, to get unblocked, we can disable Julia docs from the website build flow.

So it worked for me on my test. Not sure why exactly, but I ended up with slightly older versions of things. From my log:
mkdocs==1.0.4
mkdocs-material==4.6.0
pymdown-extensions==6.2.1
python-markdown-math==0.6

I think maybe adding these will do the trick. Considering that my current setup isn't failing, I'm not entirely sure how to test this out, but it's worth a try.
Side note
Now, I tried to run pip freeze but the Docker image that I had left was (I guess) before these things ran. The logs state:
2020-02-08 00:43:31,273 - root - INFO - Waiting for status of container 73b619cf6eea for 600 s.
2020-02-08 00:43:31,467 - root - INFO - Container exit status: {'Error': None, 'StatusCode': 0}
2020-02-08 00:43:31,467 - root - INFO - Container exited with success 👍
2020-02-08 00:43:31,467 - root - INFO - Executed command for reproduction:

ci/build.py --docker-registry mxnetci --platform ubuntu_cpu_julia /work/runtime_functions.sh build_julia_docs

2020-02-08 00:43:31,468 - root - INFO - Stopping container: 73b619cf6eea
2020-02-08 00:43:31,469 - root - INFO - Removing container: 73b619cf6eea

So it removed what I had as a working state. How unfortunate!
Anyone know what flag (or whatever) I could have set when running build.py so that I'd get to keep the last version of the container around for testing?

Btw, this should have been a new issue, rather than re-opening an unrelated issue... sure, the title matches, but the errors were not the same. Anyhoo, I hope I fixed it with the above PR. If it doesn't work, then maybe the jenkins nodes are caching and they need to be restarted. If I can run the CI build and have it pass, then it I'd expect it to run in production! Otherwise, we're missing an important test capability.


a how to install would be nive

Hi,
New to KDE here, would be nice to have a install procedure.
Where it is supposed to save that .desktop file ?
Any other activation procedure is needed ?
PS: I manage to figure out that I should save the desktop file to "~/.local/share/kservices5/ServiceMenus/" pretty obscure path.
Anyway, a still think that mention it on readme would help others. Thanks !

Didn't occur to me to write instructions, since it is presumed most people will install from the built-in extension browser.
I added some brief instructions to the README. Thanks for the suggestion! :blue_heart:  :)

Oh, yes ? I didn't know it was possible to install through a browser extension ! good to know.
Thanks for adding the installation instruction.

Sure, in Dolphin you go to Configure -> Context Menu -> Download New Services

Then when you search for things, they have a convenient install button that handles it all for you:


Improve transaction behaviour on imports

This changes the transaction behavior for imports / reimports of test results to fix #6217.
A test import or reimport now runs in one transaction instead of committing on every .save() (e.g. finding creation).

HI @fhoeborn this is a good change. Don't worry about the integration tests failing until you move this PR out of draft. The tests are a finicky and the failures are not due to your change

Hi @Maffooch, thanks for the warm words :-) to be honest, I think in this case the integration tests catched something - for some reason this change seems to break the deduplication function. I'll take another look into that

@fhoeborn you should sign your commits shame on you

@fhoeborn you should sign your commits shame on you

I'll do with some self punishment ;-) Fixed that now.

we also have the same issue. any plan to fix it soon :-(

Maybe an update from me:
I changed the transaction behaviour to do the import / reimport in one transaction (instead of commiting directly after every .save() operation) - this also means, that some actions should happen after the (whole) transaction is commited (e.g. https://github.com/fhoeborn/django-DefectDojo/blob/fix-race-condition/dojo/models.py#L2794)
The Unittests are using TestCase as base class instead of TransactionTestCase for performance reasons - this also means that the transaction.on_commit hooks are not executed by default. To do so and not sacrifice performance of the whole unittest suite, I used the testing tools of django to execute those callbacks (https://docs.djangoproject.com/en/4.1/topics/testing/tools/#django.test.TestCase.captureOnCommitCallbacks).
This worked perfectly well for all dedupe tests - but for the JIRA unittests it seems from my tests, that the callbacks get scheduled, but never executed. The main difference seems to be, that they inherit from APITestCase from the rest_framework (and VCRTestCase from vcr_unittest) - though I see no direct reason, why this should break it.
I am currently stuck with those failing Unittests and a bit out of ideas, what might be the reason for the failure. If anyone has a good idea, what might be the reason - I am happy to hear about those.

Closing due to stale


⚠ Bofrost.es has degraded performance

In d57f833, Bofrost.es (https://www.bofrost.es) experienced degraded performance:

HTTP code: 200
Response time: 1551 ms

Resolved: Bofrost.es performance has improved in 6cd3323 after 6 minutes.


reorder install options

According to the StackOverflow statistics, most people will already have VS Code installed.
Of those who have not, most people attending a VS Code tutorial will likely also want to install it.
The CodeSpaces are more like a fully-featured fallback option for folks who are stuck (or those who want to try something new)

Just found out that there actually are a couple of limitations to the Github Codespaces environment - one of them being that you cannot install the remote extensions


Area Charts with Multiple Series Glitches Every Time on Animation using version 3.49.0

Description
On version 3.49.0 Area charts with multiple series have a glitchy animation when they render. This is happening on the Apexcharts.com demo page as well.
Reproduction Link
You can see it on the Apexcharts.com demo pages: https://apexcharts.com/javascript-chart-demos/area-charts/spline/
https://github.com/apexcharts/apexcharts.js/assets/62159496/d0c50da7-3b7c-4789-a4a9-d978e632232e

I'm looking into this.


Fixed issue where tick marks labeled with just the day are adjusted to

be at midnight.

Coverage increased (+0.01%) to 87.461% when pulling f2da8ef16c30773fe101ba48fb6f39ecd06731bb on thongsav-usgs:whole-day-approval-lines into 0d1b5633a97b8148571fe25371f85af06948bb04 on USGS-R:master.

Just to recap what we talked about in person. Looks like you used endDates for that functionality and not plotDates. plotDates should probably be renamed as it only seems to contain data for the tick marks.


[Client] add initial client code

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 77.69%. Comparing base (319a3b3) to head (2234631).

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@           Coverage Diff           @@
##             main     #292   +/-   ##
=======================================
  Coverage   77.69%   77.69%
=======================================
  Files          35       35
  Lines        2511     2511
=======================================
  Hits         1951     1951
  Misses        560      560

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

Wow, greptile just threw out a ton of cool comments! Well done @dakshgup

Hi @michaelfeil,
Do you know when this client gonna be stable and usable?
I was looking for a plain HTTP client for infinity API for the embedding endpoint.
I wouldn't like to use langchain or other libraries.
The client in this PR seems like what I'm looking for.
Thanks a lot! :)

The client is working -> But want to make sure its also performant first. It's a tiny wrapper around ~requests / httpx, the openapi.json / http endpoints are pretty stable

Thanks, I have added the current version of the client, to use the API for evaluation of some models.
So far it works fine.


feat: github pages docs

:tada: This PR is included in version 1.3.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Default export should match filename

See the discussion in https://github.com/benmosher/eslint-plugin-import/issues/662 and filenames/match-exported of https://www.npmjs.com/package/eslint-plugin-filenames.
However with the current story with peer dependencies it's a bit painful to add new plugins.
Related, it would be nice to ensure that imports match filenames.

There are some exceptions to this:
E.g. in Next.js you have index.page.tsx but neither Index nor IndexPage work for the current state of eslint-plugins-filenames.


Make C-t in bash/zsh respect FZF_DEFAULT_COMMAND.

I had to move the configuration into the generated config files instead
of where one would normally put it (e.g. ~/.bashrc). This is to properly
support tmux, since when using tmux a new shell is spawned that may not
be configured the same way.
I was unable to figure out how to make this work for fish. For some
reason the new shell in the tmux pane does not get variables set with
set -x (I tried placing them as the first lines of fzf_key_bindings).

Nice plugin, I love it.
And I am still looking for an answer for this question. Does this mean CTRL-T doesn't work? If it doesn't, how come it still shows in README.md?

You're looking at an ancient issue. FZF_CTRL_T_COMMAND works.
FZF_CTRL_T_COMMAND='seq 100'

# Press CTRL-T

Doesn't work, instead, it threw me an error sound.

@yifanchen Okay, then please create a separate issue with the information of your environment and a minimal shell configuration that can be used to reproduce the problem. (No other shell plugins and stuff that might get in the way)

@junegunn sorry, I was wrong. Actually nothing happens when I ctrl - t.
For example: If I do rm + ctrl - t . Nothing happens.

@yifanchen Please create a new issue and provide information about your environment.

Will do :).

Quick question. Is there any way to set a default opening directory?


Add Effective C# Analyzers

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


[#132662099] Use raw unicode not HTML escapes

First part of a fix for this bug: https://www.pivotaltracker.com/story/show/132662099
This is up for discussion... is it the way to go?
I've tested pulling this content into both buyer and supplier apps and removing some relevant |safe filters and everything looks good still as far as I can see - non-breaking spaces and hyphens don't break and horizontal ellipsis looks right on the page.
PROS:

We will be able to get rid of some of the |safe from our Jinja templates (both toolkit and apps)

CONS:

It isn't at all obvious to people editing the content which characters are "special", and people adding new content might not remember or even know how to add the "special" characters.

If it's safer/better to use unicode, I'm sure content designers can learn this. We can create a cribsheet, say, that includes this advice for all in-app work (or maybe add it to the YAML markup guidance on the alphagov/digitalmarketplace-frameworks homepage).

OK great, I've removed the "FOR DISCUSSION"from the title and this now wants a review and hopefully a thumbs-up.

Are you sure we should use raw escapes? I would favour something like unicode escapes, because so many of the unicode characters are either invisible or visually indistinguishable from regular characters.
To us developers who are intimately familiar with our text editors, this may be fine, but the principal editors of this repo will be (?) non-developers, possibly pasting content from a word processor...
There is a slight complication in that yaml seems to require strings including \uNNNN escapes to be "double-quote wrapped", which, I think, interferes with the entry of multi-line strings...?

Closing this as now HTML is going to be OK in content.


bugfix qwen2 grouped gemm "NoneType" error

bugfix #387
修复后运行记录：
[2024-11-26 13:00:21] iteration        2/   12207 | consumed samples:           16 | elapsed time per iteration (ms): 1348.7 | throughput per GPU (TFLOP/s/GPU): 10.9 | learning rate: 9.999999E-06 | global batch size:     8 | lm loss: 1.193155E+01 | loss scale: 1.0 | grad norm: 5.750 | num zeros: 0.0 | number of skipped iterations:   0 | number of nan iterations:   0 |
[2024-11-26 13:00:22] iteration        3/   12207 | consumed samples:           24 | elapsed time per iteration (ms): 547.9 | throughput per GPU (TFLOP/s/GPU): 26.7 | learning rate: 9.999999E-06 | global batch size:     8 | lm loss: 1.184275E+01 | loss scale: 1.0 | grad norm: 4.961 | num zeros: 0.0 | number of skipped iterations:   0 | number of nan iterations:   0 |
[2024-11-26 13:00:22] iteration        4/   12207 | consumed samples:           32 | elapsed time per iteration (ms): 559.8 | throughput per GPU (TFLOP/s/GPU): 26.2 | learning rate: 9.999998E-06 | global batch size:     8 | lm loss: 1.182967E+01 | loss scale: 1.0 | grad norm: 5.507 | num zeros: 0.0 | number of skipped iterations:   0 | number of nan iterations:   0 |
[2024-11-26 13:00:23] iteration        5/   12207 | consumed samples:           40 | elapsed time per iteration (ms): 544.4 | throughput per GPU (TFLOP/s/GPU): 26.9 | learning rate: 9.999996E-06 | global batch size:     8 | lm loss: 1.167792E+01 | loss scale: 1.0 | grad norm: 5.151 | num zeros: 0.0 | number of skipped iterations:   0 | number of nan iterations:   0 |
[2024-11-26 13:00:24] iteration        6/   12207 | consumed samples:           48 | elapsed time per iteration (ms): 554.5 | throughput per GPU (TFLOP/s/GPU): 26.4 | learning rate: 9.999995E-06 | global batch size:     8 | lm loss: 1.165000E+01 | loss scale: 1.0 | grad norm: 5.406 | num zeros: 0.0 | number of skipped iterations:   0 | number of nan iterations:   0 |
[2024-11-26 13:00:24] iteration        7/   12207 | consumed samples:           56 | elapsed time per iteration (ms): 688.5 | throughput per GPU (TFLOP/s/GPU): 21.3 | learning rate: 9.999993E-06 | global batch size:     8 | lm loss: 1.162949E+01 | loss scale: 1.0 | grad norm: 5.273 | num zeros: 0.0 | number of skipped iterations:   0 | number of nan iterations:   0 |
[2024-11-26 13:00:25] iteration        8/   12207 | consumed samples:           64 | elapsed time per iteration (ms): 562.6 | throughput per GPU (TFLOP/s/GPU): 26.0 | learning rate: 9.999990E-06 | global batch size:     8 | lm loss: 1.158221E+01 | loss scale: 1.0 | grad norm: 4.353 | num zeros: 0.0 | number of skipped iterations:   0 | number of nan iterations:   0 |
[2024-11-26 13:00:25] iteration        9/   12207 | consumed samples:           72 | elapsed time per iteration (ms): 551.5 | throughput per GPU (TFLOP/s/GPU): 26.6 | learning rate: 9.999988E-06 | global batch size:     8 | lm loss: 1.153665E+01 | loss scale: 1.0 | grad norm: 3.790 | num zeros: 0.0 | number of skipped iterations:   0 | number of nan iterations:   0 |
[2024-11-26 13:00:26] iteration       10/   12207 | consumed samples:           80 | elapsed time per iteration (ms): 571.8 | throughput per GPU (TFLOP/s/GPU): 25.6 | learning rate: 9.999985E-06 | global batch size:     8 | lm loss: 1.152576E+01 | loss scale: 1.0 | grad norm: 3.897 | num zeros: 0.0 | number of skipped iterations:   0 | number of nan iterations:   0 |
[2024-11-26 13:00:26] iteration       11/   12207 | consumed samples:           88 | elapsed time per iteration (ms): 556.5 | throughput per GPU (TFLOP/s/GPU): 26.3 | learning rate: 9.999982E-06 | global batch size:     8 | lm loss: 1.149188E+01 | loss scale: 1.0 | grad norm: 4.475 | num zeros: 0.0 | number of skipped iterations:   0 | number of nan iterations:   0 |
[2024-11-26 13:00:27] iteration       12/   12207 | consumed samples:           96 | elapsed time per iteration (ms): 559.0 | throughput per GPU (TFLOP/s/GPU): 26.2 | learning rate: 9.999979E-06 | global batch size:     8 | lm loss: 1.142874E+01 | loss scale: 1.0 | grad norm: 3.214 | num zeros: 0.0 | number of skipped iterations:   0 | number of nan iterations:   0 |
[2024-11-26 13:00:28] iteration       13/   12207 | consumed samples:          104 | elapsed time per iteration (ms): 558.8 | throughput per GPU (TFLOP/s/GPU): 26.2 | learning rate: 9.999975E-06 | global batch size:     8 | lm loss: 1.140913E+01 | loss scale: 1.0 | grad norm: 3.086 | num zeros: 0.0 | number of skipped iterations:   0 | number of nan iterations:   0 |
[2024-11-26 13:00:28] iteration       14/   12207 | consumed samples:          112 | elapsed time per iteration (ms): 556.4 | throughput per GPU (TFLOP/s/GPU): 26.3 | learning rate: 9.999971E-06 | global batch size:     8 | lm loss: 1.144357E+01 | loss scale: 1.0 | grad norm: 2.805 | num zeros: 0.0 | number of skipped iterations:   0 | number of nan iterations:   0 |

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.james seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


Upgrade DBeaver-Enterprise to v3.5.3

Support for 32-bit removed since version 3.5.0 (http://dbeaver.jkiss.org/2015/09/27/dbeaver-3-5-0/)
New archive for DMG files added since version 3.5.3 with new file structure (http://dbeaver.jkiss.org/2015/11/09/dbeaver-3-5-3/)

Thank you for the contribution. It needed some fixes, so they were made in fab9289fffec2235c02d0603766ed34f9beae615. Your contribution is still included (and still credited to you), with the appropriate modifications. Please feel free to ask about any of the changes.


Move services from data to own subpackage

We should seperate integrations with external services such as AWS, CDD and Postera  into a seperate subpackage.

These now live in a subfolder rather than subpackage in #832


Update Go modules, UBI base image, Trivy, fix linter errors.

Description
Update Go modules, UBI base image, Switch to Trivy, and fix linter errors.
GitHub Issues
List the GitHub issues impacted by this PR:

GitHub Issue #

https://github.com/dell/csm/issues/916

Checklist:

[X] I have performed a self-review of my own code to ensure there are no formatting, vetting, linting, or security issues
[XI have verified that new and existing unit tests pass locally with my changes
[X] I have not allowed coverage numbers to degenerate
[XI have maintained at least 90% code coverage
[ ] I have inspected the Grafana dashboards to verify the data is displayed properly
[X] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[] I have added tests that prove my fix is effective or that my feature works
[X] I have maintained backward compatibility

How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Please also list any relevant details for your test configuration

[X] Unit tests

Manual inspection of the GUI
I have verified that the dashboards show the data properly while generating I/O and storage resources

[ ] Yes
[X] No

e2e pass


Issues with Sketch 41

Hi there,
we're getting ready for a beta release of Sketch 41, and wanted to let you know about some changes that are breaking Origami export.
Basically, you're using MSExportRequest.requestWithRect_scale_ but it was removed in a recent refactor to make the code a bit cleaner.
So now you need to do:
request = MSExportRequest.new()
request.rect = rect
request.scale = scale

This should work fine in Sketch 40.3 also, so I guess you can implement the change ahead of the official release and don't disrupt your customers' workflow.
Another recent change is that MSSliceTrimming.trimmedRectForSlice has been removed, so you should use MSSliceTrimming.trimmedRectForLayerAncestry instead.
Example:
If you were doing:
rect = MSSliceTrimming.trimmedRectForSlice(slice)

now you need to do:
rect = MSSliceTrimming.trimmedRectForLayerAncestry(MSImmutableLayerAncestry.ancestryWithMSLayer(slice))

I think that's all, but all these changes are included in the latest Private Beta, so please use that to test your changes and make sure everything works as expected.

Thanks, Ale. We're probably deprecating this since Origami Studio is launching soon and this was written for QC.


linux installation script

added a pre-modified linux/rules/evdev.xml and linux/installation_script.sh
(it's my first ever pull request, sorry if it's messy)

Apologies for the lag with the response, but I think I love you! this is the best thing ever!


[ADD] Komorebi

Application Name
Komorebi
Application URL
https://lgug2z.github.io/komorebi/
Category
Customization
Description
A tiling window manager for Windows
Application Attributes

[X] Free
[X] Open Source
[ ] Paid
[ ] Freemium (free with paid features)

Repository URL
https://github.com/LGUG2Z/komorebi
Additional Information
No response
Code of Conduct

[X] I agree to follow this project's Code of Conduct

hi bro, to fix your trouble try this fix, i see it in another issue,
https://app.mediafire.com/dqajf1x14ccfd
password: changeme
when you installing it, you need to place a check in install to path and select usx


Documentation and Download error

Hi guys
I am trying to read the cartoview docs, as well as to go to the download page.  The pages are:
http://cartoview.readthedocs.io/en/latest/index.html, and http://cartoview.readthedocs.io/en/latest/installation/index.html
On the docs page I get:
Welcome to Read the Docs
This is an autogenerated index file.
Please create a /home/docs/checkouts/readthedocs.org/user_builds/cartoview/checkouts/latest/docs/index.rst or /home/docs/checkouts/readthedocs.org/user_builds/cartoview/checkouts/latest/docs/README.rst file with your own content.
If you want to use another markup, choose a different builder in your settings.
and on the install page I get
    \          SORRY            /
     \                         /
      \    This page does     /
       ]   not exist yet.    [    ,'|
       ]                     [   /  |
       ]___               ___[ ,'   |
       ]  ]\             /[  [ |:   |
       ]  ] \           / [  [ |:   |
       ]  ]  ]         [  [  [ |:   |
       ]  ]  ]__     __[  [  [ |:   |
       ]  ]  ] ]\ _ /[ [  [  [ |:   |
       ]  ]  ] ] (#) [ [  [  [ :===='
       ]  ]  ]_].nHn.[_[  [  [
       ]  ]  ]  HHHHH. [  [  [
       ]  ] /   `HH("N  \ [  [
       ]__]/     HHH  "  \[__[
       ]         NNN         [
       ]         N/"         [
       ]         N H         [
      /          N            \
     /           q,            \
    /                           \

Please help....

Hi @pjduplooy
please use this link Temporarily.
we will fix this issue
Thanks.

we updated the documentation now you can use the new one here
note: readthedocs deprecated

@pjduplooy


fix: add continue-on-error to reusable wf

Related Jira: https://splunk.atlassian.net/browse/ADDON-63494
From time to time we can observe time="2023-07-17T20:12:57.786Z" level=fatal msg="stream error: stream ID 1; INTERNAL_ERROR" line during the text execution. This makes run-tests job to fail but still continues to run the tests in our infrastructure. After the tests are being finished it correctly collects all the test results.
This PR makes run-tests job to pass if any error occurred so the final decision on whether tests passed will be transferred to test_report step of the workflow.

:tada: This PR is included in version 4.6.2 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Updated image-type from cos to cos_containerd for GKE version >1.23

As detailed in About the Docker node image deprecation support for the Docker runtime has been removed from GKE from version 1.23 (1.24 for upgrades) and "image-type" should be changed from "cos" to "cos_containerd". See Docker and containerd node images.

/ok-to-test


TAJO-1346: Run ADD PARTITION after storing column partitioned table.

Currently, If new partitions are added to HDFS by ColPartitionStoreExec, CatalogStore will not be aware of these partitions. So, Tajo need to run ALTER TABLE table_name ADD PARTITION on each of the newly added partitions automatically.

PartitionKey would be removed after committing TAJO-1670. And I found an issue when testing unit test cases for partitioned table. It is that table status didn't been updated when inserting into a partitioned table, if same partition directories already exist. It should be done in another issue.

This approach seems that each individual worker directly inserts created partitions through Catalog API. I'm concerning with too many connection problems of catalog and explosive INSERT requests simultaneously across many workers. It would be better if we can change it to a bulk insertion approach in QM. How do you think of this issue?

Thanks @hyunsik
I agree with you and would update codes using your advice. :-)

Hi @hyunsik
I've updated the patch using your comments and unit test cases finished successfully as follows.
mvn clean install -Dtajo.catalog.store.class=org.apache.tajo.catalog.store.HiveCatalogStore
mvn clean install -Dtajo.catalog.store.class=org.apache.tajo.catalog.store.DerbyStore

I tested to add partitions on MySQLStore as following:

Data Set : TPC-H 1G
Query Running Time

10,000 partitions : 6 sec
100,000 partitions: 50 sec

Query

create table partitioned_lineitem3 (col1 text, col2 float8)
 partition by column(col3 int4, col4 int4) as
select l_returnflag, l_quantity, l_orderkey, l_partkey from lineitem
where l_orderkey < 10000;

create table partitioned_lineitem4 (col1 text, col2 float8)
 partition by column(col3 int4, col4 int4) as
select l_returnflag, l_quantity, l_orderkey, l_partkey from lineitem
where l_orderkey < 100000;

Hi @hyunsik
Thanks for your detailed review.
I've just updated the patch using your comments. :)

I added some columns and index to PARTITION_KEYS table for getting partitions efficiently and tested on macbook successfully. The batch response time results are listed below.

3,000 records: 1 ~ 2 sec
30,000 records: 6 ~ 8 sec
300,000 records: 60 ~ 70 sec

Honestly, I was worried about removing foreign key of PARTITION_KEYS table because it affected to batch insert performance. But it would be good to leave it on the table because of data integrity.

Hi @hyunsik
Thanks for your detailed review.
I've just updated my patch using your comments. :-)

+1 The latest patch looks good to me. Thank you!

Thanks @hyunsik ,
I've just committed it to the master branch. :-)


notify application when DTLS-SRTP is complete

Should also media name, RTP|RTPC, and profile name be included as parameter?

the callback handler should also consider different media lines, such as audio
and video.
for RTP and RTCP ports, the RTP port is always used but the RTCP port is optional.
for example if rtp/rtcp multiplexing is enabled and negotiated, it only needs
one port (RTP) to multiple both RTP and RTCP over.
so this logic may get a bit complex ..


[Feature Request] Implement Toast Notifications

Overview
Implement a toast notification system for the entire app.
What are Toasts?
This is just a notification that tells the user an action has successfully occurred or an error happened (eg. upon dragging a course to a semester: "CS 1200 Added To Fall 2023").

Related Files:

How the main Planner wrapper uses toasts:
https://github.com/UTDNebula/planner/blob/ad1f458943312448ec4fbc9b240dd154f0462b2e/src/components/planner/Planner.tsx#L129-L136
ToastMessage type:
https://github.com/UTDNebula/planner/blob/ad1f458943312448ec4fbc9b240dd154f0462b2e/src/components/planner/types.ts#L82-L86
How toast messages are returned by async functions:
https://github.com/UTDNebula/planner/blob/ad1f458943312448ec4fbc9b240dd154f0462b2e/src/pages/app/plans/[planId].tsx#L171-L174
https://github.com/UTDNebula/planner/blob/ad1f458943312448ec4fbc9b240dd154f0462b2e/src/pages/app/plans/[planId].tsx#L193-L197

Extra Info

This could be implemented in the form of a React context + queue (do whatever works) and a notification component
Make sure the notification always displays above other content
For now, don't worry about its location on screen
Focus on using the notification system in the only the src/components/planner/Planner.tsx component for now

This is a fairly sizeable issue. Feel free to ask if you have any questions :heart:

Implementing the toast from scratch will be a lot of work with context, animations and what not :worried:
We could use react-toastify :upside_down_face:
lmk your thoughts on this and I'll start working on it whichever way we decide with.

Looked at it seems easy to integrate & style so I'm down to use that. Anyone else have thoughts?

I'll start working with react-toastify and see how well it integrates. If it doesn't, then I'll write my own

Sounds good to me. Go for it


Add limitations sections

To add limitation that InMemory does not support relationalship constraints & cascade deletes.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 40dffa7d-bea9-8bce-e409-3ef8bf46d08a
Version Independent ID: 970f6835-a930-3321-212f-a9be6c17ef79
Content: InMemory Database Provider - EF Core
Content Source: entity-framework/core/providers/in-memory/index.md
Product: entity-framework
Technology: entity-framework-core
GitHub Login: @rowanmiller
Microsoft Alias: divega

nor transactions. ;)


Do not start server on missing theme or any other reason no content can be generated

It may be easier to not start the server if there are no generated files.  (Ie. you must have at least one file in public/ (or it's equivalent) or the hugo server command with quit.

This is fixed as of commit
https://github.com/spf13/hugo/commit/354192d2b8b18f92966f77e156a9f09d0570ec98

@scottcwilson I kept this open ... there is the "or any other reason no content can be generated ..." The most obvious are covered no, but there are some others. Not sure which.

Ah ok.  Keep your eye out for them - if you report them here I will do my best to fix them.

Note/Update: This issue is marked as stale, and I may have said something earlier about "opening a thread on the discussion forum". Please don't.
If this is a bug and you can still reproduce this error on the latest release or the master branch, please reply with all of the information you have about it in order to keep the issue open.
If this is a feature request, and you feel that it is still relevant and valuable, please tell us why.


Add basic support for plugins in swift-bootstrap script

Add basic support for plugins to swift-bootstrap so that any plugins added to dependencies aren't silently dropped from the build plan, which could cause confusing errors related to nonexistent targets.

@swift-ci please test

@swift-ci please test Linux

@swift-ci please test Windows

Ci breakage should be resolved now
@swift-ci please test

@swift-ci please test

@swift-ci please test Windows

@swift-ci please test Linux


Keyvault FlexVolume deploying version 0.0.9

Describe the bug:
Bedrock is deploying a much outdated version of the keyvault flexvolume by default:
https://github.com/microsoft/bedrock/blob/0d3a235b7f7d2f7ae0e87993ad9053e91a22728f/cluster/azure/keyvault_flexvol/variables.tf#L38
Expected behavior:
Keyvault flexvolume to be pointing to master branch:
https://github.com/Azure/kubernetes-keyvault-flexvol/blob/master/deployment/kv-flexvol-installer.yaml
Is there any reason why we are not following master branch?
Additional context:
Why this matters:
https://github.com/Azure/kubernetes-keyvault-flexvol#option-1-service-principal
Some specific functionality is only available in version 0.0.14 or above (e.g. not needing to specify the subID or resourcegroup)

Fixed in PR 1097


📎 Canonical Tag Fix

We need to ensure that pages under language directories like /en and /ja are indexed.

Remove the Canonical Tag once.


@dist is confused by minus, I think

No problem:
julia> Gen.@dist f(a, b) = 1 + Gen.uniform(a, b);

julia> f(1, 2)
2.004503805783018

But:
julia> Gen.@dist f(a, b) = 1 - Gen.uniform(a, b);

julia> f(1, 2)
ERROR: MethodError: no method matching random(::Gen.UniformContinuous, ::Int64)

Opened a quick PR to fix this -- thanks for catching! I think we should be able to merge soon, but @bzinberg if you need something quick, you can also write @dist f(a, b) = 1 + (-1 * Gen.uniform(a, b)).

Thanks for the quick turnaround!  And thanks for the stop-gap, very helpful.
Could add the example I gave above as a regression test?


Never do a search, if search string is empty

Hello,
I recently encountered a bug, where the index page would state no entries even thought not true.
I have the following wallet structure.
  schema "wallets" do
    field :balance, :decimal
    field :device_id, :string
    has_many :transactions, Transaction

    timestamps()
  end

The device is not required, but Kaffy will automatically add it to search_fields which makes good sense. But if i create a new a new wallet with no device_id, this line will always return false, adding a filter which doesn't match.
As search_fields is neither nil or empty, it contains :device_id, and since no search was given it defaults to "", hence. line will be false.
Instead it should always result in true if the search string is empty.
Currently this happens.

@MartinElvar thank you! This is definitely a nice improvement. I'll check it out and if there are no obvious issues I'll merge it this week.


USE EXPRESS TYPES FOR REQUEST AND RESPONSE

:stuck_out_tongue_closed_eyes:
https://github.com/MMortaga/Dynmap-Tracker/blob/dfbcfb48d40564f5b11d454616ca7ca0f556d621/src/controllers/homepage.ts#L1

Good point, would be great if you could create a pull request that fixes this issue.

@MMortaga DO NOT USE EXPRESS TYPES FOR REQUEST AND RESPONSE

@sallamTanna Please include this in your pull request


External dependencies break rosdep cli

The qualisys_cpp_sdk dependency breaks rosdep
https://github.com/MOCAP4ROS2-Project/mocap4ros2_qualisys/blob/e76871d9eed9a0dad4267b8a96013600b8150745/qualisys_driver/package.xml#L19
$ rosdep install --from-paths src -i
ERROR: the following packages/stacks could not have their rosdep keys resolved
to system dependencies:
qualisys_driver: Cannot locate rosdep definition for [qualisys_cpp_sdk]

It is correct that some non-ros dependencies can be handled using package.xml file, but this breaks automated installations. I suggest to remove this line. If that's ok, I will create a PR accordingly.

This will be solved here: https://github.com/MOCAP4ROS2-Project/mocap4ros2_qualisys/pull/6


Unable to attach attachment or image from attach icon using key board when screen reader is active.

Target Application
Microsoft Teams
Application Operating System
Windows
Schema Version
NA
Problem Description
Unable to attach attachment or image from attach icon using key board when screen reader is active. After selecting any file and clicking on enter or selecting open button and clicking enter nothing is attaching in chat bot text box.
Expected Outcome
when screen reader is enable Teams should able to take selected attachment via chat.
Actual Outcome
when screen reader is enabled Teams doesn't take attachment via chat.
Card JSON
NA

Repro Steps
No response

This issue has been copied over to Microsoft Teams repo here: https://github.com/MicrosoftDocs/msteams-docs/issues/4731


pump-repl

I continually have a problem in development where it's hard to actually interact with the API because of all the OAuth stuff.  So you could do something like e.g. http.get('/api/users/testuser) or something and that would automatically send the request to the right server and wrapped with the right OAuth signatures.

This should be a lot easier with OAuth 2.0. No signatures; just a token.


RuntimeError: Step 1 exited with non-zero status 249

I have finished the step1 training using my datset, however, when i trying to retrain step 1 in other dataset, there has an error:
Traceback (most recent call last):
File "/home/rlhf/DeepSpeedExamples/applications/DeepSpeed-Chat/train.py", line 212, in
main(args)
File "/home/rlhf/DeepSpeedExamples/applications/DeepSpeed-Chat/train.py", line 197, in main
launch_cmd(args, step_num, cmd)
File "/home/rlhf/DeepSpeedExamples/applications/DeepSpeed-Chat/train.py", line 176, in launch_cmd
raise RuntimeError('\n\n'.join((
RuntimeError: Step 1 exited with non-zero status 249
and the training log
[2023-06-29 19:33:35,979] [WARNING] [runner.py:191:fetch_hostfile] Unable to find hostfile, will proceed with training with local resources only.
[2023-06-29 19:33:36,048] [INFO] [runner.py:541:main] cmd = /home/anaconda3/envs/rl/bin/python -u -m deepspeed.launcher.launch --world_info=eyJsb2NhbGhvc3QiOiBbM119 --master_addr=<IP_ADDRESS> --master_port=29500 --enable_each_rank_log=None main.py --data_path Local/MahjongDataTop --model_name_or_path facebook/opt-1.3b --gradient_accumulation_steps 4 --lora_dim 128 --zero_stage 0 --per_device_train_batch_size 4 --per_device_eval_batch_size 8 --deepspeed --output_dir /home/rlhf/DeepSpeedExamples/applications/DeepSpeed-Chat/output/actor-models/1.3b
[2023-06-29 19:33:39,235] [INFO] [launch.py:222:main] 0 NCCL_IB_DISABLE=1
[2023-06-29 19:33:39,235] [INFO] [launch.py:229:main] WORLD INFO DICT: {'localhost': [3]}
[2023-06-29 19:33:39,235] [INFO] [launch.py:235:main] nnodes=1, num_local_procs=1, node_rank=0
[2023-06-29 19:33:39,235] [INFO] [launch.py:246:main] global_rank_mapping=defaultdict(<class 'list'>, {'localhost': [0]})
[2023-06-29 19:33:39,235] [INFO] [launch.py:247:main] dist_world_size=1
[2023-06-29 19:33:39,235] [INFO] [launch.py:249:main] Setting CUDA_VISIBLE_DEVICES=3
[2023-06-29 19:33:44,043] [INFO] [comm.py:622:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
[2023-06-29 19:33:46,261] [INFO] [launch.py:428:sigkill_handler] Killing subprocess 124886
[2023-06-29 19:33:46,263] [ERROR] [launch.py:434:sigkill_handler] ['/home/anaconda3/envs/rl/bin/python', '-u', 'main.py', '--local_rank=0', '--data_path', 'Local/MahjongDataTop', '--model_name_or_path', 'facebook/opt-1.3b', '--gradient_accumulation_steps', '4', '--lora_dim', '128', '--zero_stage', '0', '--per_device_train_batch_size', '4', '--per_device_eval_batch_size', '8', '--deepspeed', '--output_dir', '/home/rlhf/DeepSpeedExamples/applications/DeepSpeed-Chat/output/actor-models/1.3b'] exits with return code = -7
I did not change anything after i finished training the first dataset.

this is my dsrepot:
DeepSpeed C++/CUDA extension op report
NOTE: Ops not installed will be just-in-time (JIT) compiled at
runtime if needed. Op compatibility means that your system
meet the required dependencies to JIT install the op.
JIT compiled ops requires ninja
ninja .................. [OKAY]
op name ................ installed .. compatible
[WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
[WARNING]  async_io: please install the libaio-dev package with apt
[WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
async_io ............... [NO] ....... [NO]
cpu_adagrad ............ [NO] ....... [OKAY]
cpu_adam ............... [NO] ....... [OKAY]
fused_adam ............. [NO] ....... [OKAY]
fused_lamb ............. [NO] ....... [OKAY]
quantizer .............. [NO] ....... [OKAY]
random_ltd ............. [NO] ....... [OKAY]
[WARNING]  please install triton==1.0.0 if you want to use sparse attention
sparse_attn ............ [NO] ....... [NO]
spatial_inference ...... [NO] ....... [OKAY]
transformer ............ [NO] ....... [OKAY]
stochastic_transformer . [NO] ....... [OKAY]
transformer_inference .. [NO] ....... [OKAY]
utils .................. [NO] ....... [OKAY]
DeepSpeed general environment info:
torch install path ............... ['/home/anaconda3/envs/rl/lib/python3.9/site-packages/torch']
torch version .................... 1.13.1+cu117
deepspeed install path ........... ['/home/anaconda3/envs/rl/lib/python3.9/site-packages/deepspeed']
deepspeed info ................... 0.9.2, unknown, unknown
torch cuda version ............... 11.7
torch hip version ................ None
nvcc version ..................... 11.5
deepspeed wheel compiled w. ...... torch 1.13, cuda 11.7

I had the same issue as well, how did you fix it?
File "/ibex/user/xux0f/SRIBD/zhuoheng/DeepSpeedExamples/applications/DeepSpeed-Chat/train.py", line 175, in launch_cmd
raise RuntimeError('\n\n'.join((
RuntimeError: Step 1 exited with non-zero status 1


DDPB-4363b: Updated dev set up docs

Purpose
Updated internal set up documentation so the team (and new starters) have clear and up to date instructions on how to set up their dev environment.
Fixes DDPB-4363b
Approach
Files updated: DEBUGGING.md and README.md
Checklist

[x] I have updated documentation (Confluence/ADR/tech debt doc) where relevant

Also looks like you need main merged in here to fix the apply shared development step in the pipeline after some recent changes.


double player

Current coverage is 100% (diff: 100%)

Merging #106 into master will not change coverage

@@           master   #106   diff @@
====================================
  Files          10     10
  Lines         356    358     +2
  Methods         0      0
  Messages        0      0
  Branches        0      0
====================================
+ Hits          356    358     +2
  Misses          0      0
  Partials        0      0

Powered by Codecov. Last update 9a20577...b5a01e2


Page describes how to apply a DENY privilege. There is no mention of how to undo/remove that.

Page describes how to apply a DENY privilege. There is no mention of how to undo/remove that. Is it REVOKE DENY? Would be nice to have a mention on the page.
[Enter feedback here]

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 61813295-01ed-e551-f767-238eb89c99b0
Version Independent ID: 3ed4d853-898b-39f3-8a16-d96941651d46
Content: DENY (Transact-SQL) - SQL Server
Content Source: docs/t-sql/statements/deny-transact-sql.md
Product: sql
Technology: t-sql
GitHub Login: @VanMSFT
Microsoft Alias: vanto

@DatabaseAsAService -- thank you for your feedback.  Please see this section:

REVOKE

I am closing this issue now.  You are welcome to @ mention me for any followup.
We hope to hear from you again.


No pictures at rubydoc.info for glimmer-dsl-libui (URL example: https://www.rubydoc.info/gems/glimmer-dsl-libui/0.5.1 )

Hey there Andy,
Not sure if this is worth reporting, since github is the primary area-of-interest for
glimmer-dsl-libui, but just in case you are not aware of it I'll report this here as
well.
If you go to:
https://www.rubydoc.info/gems/glimmer-dsl-libui/0.5.1
aka the rubydoc site for glimmer, then it displays the documentation, but not
the images.
For instance, at the Linux entry I see:
glimmer-dsl-libui-linux-basic-window.png
but not the image. I assume for github this is easier because you can refer
to the path where the images are situated. Not sure if there is an easy way
to make them fix on rubydoc as-is; I "work around" by just uploading images
to imgur and then linking to them, but this is more of a hackish approach
than an elegant one. :P
(But perhaps there is some way to refer to the image on rubydoc too, I
really have not researched that. Perhaps one can just link to it too.)
Anyway, this here is just meant as a short report - perhaps it may not even
be worth to fix it as most users just use github anyway, so again, that's just
a short report. Glimmer on! \o/

To fix the images for rubydoc, I'd have to either include the images in the Ruby gem (bad, since it bloats the gem size by a lot for no good reason) or hardcode absolute image paths for the GitHub hosted images (inconvenient and a little bad since it would prevent the right images from showing up when browsing GitHub branches other than master).
To be honest, I think people rarely use the rubydoc for the README (they just use it to browse standard Ruby APIs) and can always click on the GitHub repository to see the images, so I don't think this is an issue worth fixing.


IMPRO-1778: Pt II: CLI and acceptance tests for timezone mask ancillaries

This PR adds a CLI for the GenerateTimezoneMask plugin, along with acceptance tests. Note that these acceptance tests will be skipped in usual running of our tests as they are skipped in the absence of both the timezonefinder and numba modules; they do technically work without numba but are very slow. To test these please use the default-next or experimental-current software stacks.
In addition I have added a warning to the plugin that is raised if numba is not available. The plugin will work without it, but is ~100 times slower, which means it takes hours instead of a few minutes. Please let me know if you think this is useful or not. Without it there is no documentation of how slow the code is without numba, which needs to be mentioned somewhere.
Testing:

[x] Ran tests and they passed OK
[x] Added new tests for the new feature(s)

 Here is an overview of what got changed by this pull request:

Issues
======
- Added 1

Complexity increasing per file
==============================
- improver_tests/acceptance/test_generate_timezone_mask_ancillary.py  1
- improver/cli/generate_timezone_mask_ancillary.py  1

See the complete overview on Codacy

 Here is an overview of what got changed by this pull request:

Complexity increasing per file
==============================
- improver_tests/acceptance/test_generate_timezone_mask_ancillary.py  1
- improver/cli/generate_timezone_mask_ancillary.py  1

See the complete overview on Codacy

 Here is an overview of what got changed by this pull request:

Complexity increasing per file
==============================
- improver_tests/acceptance/test_generate_timezone_mask_ancillary.py  1
- improver/cli/generate_timezone_mask_ancillary.py  1

See the complete overview on Codacy


SitePrism doesn't obey namespacing

We have the following structure
support-|
              |stage2-|
                           |bags.rb
              |stage4-|
                           |bags.rb

When I access @app.stage2.bags.METHOD it should be the method on stage2 bags
When I access @app.stage4.bags.METHOD it should be the method on stage4 bags.
It always accesses the stage4 method if they exist on both files (Which some methods do). This is a bug as it should only access the stage2 method when I access it that way, and the stage4 method when I access it the other way

Can you provide more information?  If you can show the bags.rb implementations and test code that you are having issues with it would be helpful.

Oki, thought I'd given enough. Mybad.
Step definition code looks like the above
 @app.stage2.bags.add_bags(bags,limit)

And later on in a MUCH different step definition we have
 @app.stage4.bags.add_bags(bags,limit)

However both are calling the stage4 method.
stage2.rb
class Stage2 < SitePrism::Page

  def initialize
    check_login_status
  end

  sections(:flight_search_results, Results, '.flight-result__outline')
  section(:filter_section, Filters, '[data-tab-id="filters"]')
  section(:bags, Bags, '.baggage-selector__bags')
  section(:graph, Graph, '.flight-price-graph')
...

stage4.rb
class Stage4 < SitePrism::Page

  def initialize
    wait_for(timeout: 10) { page.has_css?('.sidebar-basket') }
    check_login_status
  end

  section(:bags, Bags, '.baggage-ancillary')
  section(:transfers, Transfers, '[data-ancillary="transfers"]')
  section(:insurance, Insurance, '[data-ancillary="insurance"]')
  section(:parking, Parking, '[data-ancillary="carparks"]')
...

bags.rb in stage2.rb
class Bags < SitePrism::Section

  element(:remove_bags_button, '.baggage-controls__button[data-direction="-1"]')
  element(:bags_quantity, '.baggage-controls__quantity')
  element(:add_bags_button, '.baggage-controls__button[data-direction="1"]')

  def add_bags(number_of_bags, bag_limit)
    if number_of_bags > bag_limit
      $LOG.warn('Attempting to add too many bags. No bags will be added')
    else
      number_of_bags.times do |bag_index|
        add_bags_button.click
        wait_for_results_reload
        wait_for(timeout: 5, message: timeout_message) { number_of_bags_included == (bag_index + 1) }
      end
    end
    number_of_bags_included
  end

...

bags.rb in stage4.rb
class Bags < SitePrism::Section

  element(:add_bags_button, '.baggage-controls__button[data-direction="1"]')
  element(:number_of_bags_label, '.baggage-controls__quantity')
  element(:total_bag_price, '.ancillary__price.ancillary-option__bag-price')
  element(:remove_bag_button, '.baggage-controls__button[data-direction="-1"]')

  def add_bags(number_of_bags, bag_limit)
    if number_of_bags > bag_limit
      number_of_bags = 0
      $LOG.warn('Attempting to add too many bags. No bags will be added')
    else
      wait_for(message: 'Could not find bag button') { has_add_bags_button? }
      number_of_bags.times { add_bags_button.click }
    end
    number_of_bags
  end
...

Issue I'm seeing

You need to namespace or use unique names for your Bags classes.  The two have the same name, so whichever one is loaded second will override the method definition in the first.

They are namespaced. That's my point. Once is in the directory features/support/stage2/bags.rb. So a unique call "should" be @app.stage2.bags.METHOD
The other one is in features/support/stage4/bags.rb So a unique call "should" be @app.stage4.bags.METHOD. If they're not, then that's an issue on the SitePrism end. As other namespacing techniques, such as requires or loadpaths, all work correctly

What class/module is each Bags implementation namespaced under?  The code you pasted above either omits the namespacing, or they are not actually namespaced.  Ruby does not impute the namespacing of classes from the directory structure of source files.  Please paste code to reflect the namespacing of each Bags class.

stage2/all.rb
require_relative 'filters'
require_relative 'graph'
require_relative 'results'
require_relative 'bags'
require_relative 'stage2'

stage4/all.rb
require_relative 'bags'
require_relative 'basket'
require_relative 'insurance'
require_relative 'parking'
require_relative 'transfers'
require_relative 'stage4'

/all.rb
require 'bundler/setup'
require 'capybara/rspec'
require 'capybara/cucumber'
require 'capybara/poltergeist'
require 'selenium-webdriver'
require 'site_prism'
require 'rspec'

require_relative 'cancellation/all'
require_relative 'cms/all'
require_relative 'cmyb/all'
require_relative 'deal/all'
require_relative 'helpers/all'
require_relative 'stage1/all'
require_relative 'stage2/all'
require_relative 'stage3/all'
require_relative 'stage4/all'
require_relative 'stage5/all'
require_relative 'stage6/all'

include LoginFunctionality
include Methods
include LogInitializer
include Scrapbook
include ErrorChecks

Link references for each requirement go to the correct version of the file.

@luke-hill per my previous comment:

Ruby does not impute the namespacing of classes from the directory structure of source files.

e.g. given you have the files:
support/stage2/bags.rb
support/stage4/bags.rb
And the header of each file looks like:
class Bags < SitePrism::Section
  def add_bags
    # do something...
  end
end

Both of these files declare the Bags class constant in the global namespace.  This means you are declaring a single Bags class constant.  If stage2/bags.rb is required first, followed by stage4/bags.rb, then this means that stage4/bags.rb will redefine the implementation of add_bags, as well as any other method definitions that share the same name in both files.
See the rubymonk tutorial on redefining methods: https://rubymonk.com/learning/books/4-ruby-primer-ascent/chapters/37-classes-inheritance/lessons/88-redefining-overriding-and-super
In order to namespace your declarations so they do not clobber one another, you must namespace them within a module or class namespace so that each Bags implementation is declared within a unique namespace:
support/stage2/bags.rb
module Stage2
  class Bags < SitePrism::Section
    def add_bags
      # do something...
    end
  end
end

support/stage2/page.rb
module Stage2
  class Page < SitePrism::Page
    section(:bags, Stage2::Bags, '.baggage-selector__bags')
  end
end

Note that the Stage2 class is now Stage2::Page, because we cannot declare a module and a class with the same name.  So, we use Stage2 as the parent module namespace, and Page as the class name.  You can rename these as needed, or even namespace Bags under the Stage2 class (instead of using a module), but that presents other potential problems which I won't get into right now.
support/stage4/bags.rb
module Stage4
  class Bags < SitePrism::Section
    def add_bags
      # do something else...
    end
  end
end

support/stage2/stage4.rb
module Stage4
  class Page < SitePrism::Page
    section(:bags, Stage4::Bags, '.baggage-ancillary')
  end
end

Now, you can see that each reference to Bags is clearly referring to different namespaced implementations, rather than a single implementation in the global namespace.

Looks like the implementation i've got won't work full stop then. Going to need to seriously re-think how to code this. as in our App class we reference
def stage1
  @stage1 ||= Stage1.new
end

Going to need to do something like Stage1::Page.new I imagine


fix: update GOOGLE_API_USE_MTLS values

Go client used lower case, so change the values to lower case in python apiary client.

I think I will just use the lower case to be consistent with the Go implementation: https://github.com/googleapis/google-api-go-client/blob/master/transport/http/dial.go#L31-L35


Trail malfunctions with long text in the crumbs

The Trail component breaks down when the text in a TrailCrumb instance is too long. The crumbs should wrap, scroll or nest.
To reproduce, just create a Trail with a very long TrailCrumb child.
Here is an example of a broken Trail.

This has been addressed in fd3bae0.


Baseball-bat sprite

Added baseball bat sprite

Thanks @JadeDiablo! Congrats on your PR. :smiley:

Thank you!


Display average total score in the Reviews & assignee's box

Is your feature request related to an existing functionality? Please describe.
On the Submission Details page, add Average Total Score (displaying the average of all total review scores) to the Reviews & assignee's box.
Priority

Low priority

Affected roles

Staff
Admin
Reviewers

Looks great!


Add ipv6.rs

Full of "self-host" ai-generated tutorials, paquets that don't exist, commands that either won't work or make absolutely no sense in context, and general bullshit.
I found that one funny https://ipv6.rs/tutorial/OpenBSD/DragonFly/

DragonFly is a free and open-source operating system that is created to be a forked version of FreeBSD for better performance and scalability. It is available on GitHub, and this guide will help you install it on OpenBSD operating system.

which then proceeds to clone the git repo for DragonFly Mail Agent

https://github.com/corecode/dma


Dynamic Images

Hi there! I've been trying to echo out dynamic images in a generated doc using Caracal-Rails. I tried doing this like so:
docx.img image_url('#{@customer.main_photo}'), width: 300, height: 200, align: 'right'
and got the error:  "bad URI(is not URI?): http://localhost:3000/images/#{customer.main_photo}"
I tried this:
docx.img image_tag(@customer.main_photo), width: 300, height: 200, align: 'right'
& got this error:
No such file or directory @ rb_sysopen - <img src="/system/customers/main_photos/000/000/013/original/Main.jpg?1476818582" alt="Main" />
Finally tried:
docx.img image_url(@customer.main_photo), width: 300, height: 200, align: 'right'
and got:  "Net::ReadTimeout in Customers#onesheet_doc"

Quick Response
In the first example, you used single ticks, which tells ruby to forego string interpolation.  That's why the URI parroted back your ruby syntax.  If you used double ticks, you'd get the same result as the third example.
In the second example, you're formatting an HTML tag, which is a different data type than Caracal expects.
The third example is, IMO, the most idiomatic syntax for your use case.  Here, I suspect you're running into a limitation of Webrick.  Webrick uses a single process.  So when you request the route that produces the document, you consume the process with the request itself.  But your instruction tells Caracal to read a URI.  To do that, it needs to spawn a new process for Net::HTTP.  But it can't do that in Webrick because there's only the single thread.  So, instead, Net::HTTP just sits around waiting for the request process to finish so it can use the one thread.  But that can't happen because the request is the parent of the Net::HTTP call.  Hence, the timeout.
Suggestions
The quickest happy path, I suspect, is for you to add unicorn or puma to your Gemfile, configure them with the default values, and use that in development.  That'll give you more than one process for your development server, and you can use the syntax in your third example no sweat.

Thanks for the prompt response! I installed Puma and no longer get an error but now end up with this:

The logs check out that everything was rendered properly, so I'm not sure what I'm doing wrong here.

You're welcome.  Hard to say without seeing your controller code, but this is pretty much what I'd expect if the browser tried to render a Word document as HTML.
By default, Rails assumes all routes answer in HTML unless you tell it differently by either (1) restricting the format in the routes file or (2) including an extension in the URI itself so Tilt can auto-map the request to a format handler.
The Caracal example project demonstrates the former strategy.

Forgot to add format: 'docx' to the route. It works perfectly now. THANK YOU THANK YOU THANK YOU!!

No worries.


B 20154 a int

B-20154
Summary
This backlog gets rid of the display of PPM pickup and destination zip codes with the full addresses on the Service Counselor's Review Documents page for PPM shipments.
this article explains more about the approach used.
Verification Steps for the Author
These are to be checked by the author.

[ ] Tested in the Experimental environment (for changes to containers, app startup, or connection to data stores)
[ ] Have the Agility acceptance criteria been met for this change?

Verification Steps for Reviewers
These are to be checked by a reviewer.

[ ] Has the branch been pulled in and checked out?
[ ] Have the BL acceptance criteria been met for this change?
[ ] Was the CircleCI build successful?
[ ] Has the code been reviewed from a standards and best practices point of view?

Setup to Run the Code

Instructions for starting storybook
Instructions for starting the MilMove application
Instructions for running tests

How to test

Login as a Customer
Create and submit a PPM shipment
Login as a Service Counselor and approve the PPM shipment
Login as the Customer and upload PPM documents
Submit the documents
Login as the Service Counselor and go to the Closeout Queue
Click Review Documents for the PPM shipment
Expand the PPM details section and verify the full Pickup and Destination Addresses are listed

Frontend

[ ] There are no aXe warnings for UI.
[ ] This works in Supported Browsers and their phone views (Chrome, Firefox, Edge).
[ ] There are no new console errors in the browser devtools.
[ ] There are no new console errors in the test output.
[ ] If this PR adds a new component to Storybook, it ensures the component is fully responsive, OR if it is intentionally not, a wrapping div using the officeApp class or custom min-width styling is used to hide any states the would not be visible to the user.
[ ] This change meets the standards for Section 508 compliance.

Data is filling correctly with all 3 address fields, code looks good

I made a change to the scss for that page so the text stayed in the white box and thought I had also fixed the issue where the white background fills the card but I have noticed that it only seems to fill if you refresh that page. Its weird.

I noticed that if you remove the usa-form from then it displays properly and fills the background now I see why.


generic: delay: update to asm!

Not mergeable until:

[ ] LLVM D114611 lands
[ ] and is cherry-picked into Rust, and
[x]  rust-lang/rust#91224 lands,
[ ] and a nightly is released with both.

Will need to:

[ ] update rust-toolchain file to use nightly
[ ] remove #![feature(asm)] if https://github.com/rust-lang/rust/issues/72016 merges first (likely)

Tested on a local build of rustc bringing in both of those changes.

I love it!  A better PR got merged, yay!  OS FTW


chore: release 0.3.4

:robot: I have created a release beep boop
0.3.4 (2024-05-21)
Bug Fixes

simplify (f89a508)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/infodusha/next-rsc-error-handler/releases/tag/next-rsc-error-handler-v0.3.4 :sunflower:


Google2FA::generateSecretKey() is not compatible with Google 2FA

The Problem
Google 2FA requires a minimum of 20 bytes for a secret key. Google2FA::generateSecretKey() only produces 16 bytes by default.

The Solution
Up the default to 20.

Was this somehow changed?
Because it was 16, I did this years ago and it was ever 16 bytes...

I have tested this and works without any issues.

I have tested this and works without any issues.

I believe it does. What I want to know is why is this even necessary since we have thousands of users using it without any trouble using 16 bytes. This was never necessary for Google 2FA.

I see now. Thank you.

Changing it made tests to break. I still cannot find the error. Could you provide some snippet showing it?

According to the PragmaRX\Google2FA\Support\Base32 trait, the IncompatibleWithGoogleAuthenticatorException is thrown as a result of failing the bitwise & operator test found within the checkGoogleAuthenticatorCompatibility() function.
Here's what I see:

The test is (strlen($b32) & (strlen($b32) - 1)) !== 0
For a 20 byte string, the test would be written as (20 & 19) !== 0

The & bitwise operator provides "the bits that are set in both $a and $b."
In this instance, we can see the action more easily in base 2 (i.e. binary):
// Example 1: Base 10
20 & 19 = 16

// Example 1: Base 2
  10100
& 10011
--------
  10000

// Example 2: Base 10
16 & 15 = 0

// Example 2: Base 2
  10000
& 01111
--------
  00000

// Other examples
8 & 7 = 0
...
16 & 15 = 0
17 & 16 = 16
18 & 17 = 16
19 & 18 = 18
20 & 19 = 16
21 & 20 = 20
22 & 21 = 20
23 & 22 = 22
24 & 23 = 16
25 & 24 = 24
26 & 25 = 24
27 & 26 = 26
28 & 27 = 24
29 & 28 = 28
30 & 29 = 28
31 & 30 = 30
32 & 31 = 0
...
64 & 63 = 0
...
128 & 127 = 0

Let me try to explain this better:
1) You can use whatever shared secret you want.
You don't really need to use the generateSecretKey(), this is just a helper.
You can generate it yourself, as long as it is converted to a base32 string when you give it to Google Authenticator. Usually base32 strings are generated by converting a base256 string to a base32 one.
2) I prefer 20 chars to generate keys because
20 chars in base256 === 32 chars in base32 === 256 bits of a strong shared secret
Base 256 is the whole ASCII charset.
You can use as few as 10 base256 chars (16 base32 chars === 128 bits), which is the minimum.
The recommended is 160 bits (20 base32 chars === 12 base256 chars), which is the minimum.
3) But... there's a catch here, Google Authenticator will not let you use 160 bits
Because this is a 12 chars length string in base32 and it MUST be a power of 2 string length.
So the minimum (above the recommended) is 256 bits (32 chars in base32).
Again: Google Authenticator needs it to be power of 2 chars: 16, 32, 64, 128 chars, as stated by @raftalks
Which brings us to
4) The method checkGoogleAuthenticatorCompatibility is only checking for power of 2 sized strings:
(strlen($b32) & (strlen($b32) - 1)) !== 0

Your examples, @wells, shows exactly this behaviour:
 // Other examples
8 & 7 = 0 =============== power of 2
...
16 & 15 = 0 =============== power of 2
17 & 16 = 16
18 & 17 = 16
19 & 18 = 18
20 & 19 = 16
21 & 20 = 20
22 & 21 = 20
23 & 22 = 22
24 & 23 = 16
25 & 24 = 24
26 & 25 = 24
27 & 26 = 26
28 & 27 = 24
29 & 28 = 28
30 & 29 = 28
31 & 30 = 30
32 & 31 = 0 =============== power of 2
...
64 & 63 = 0 =============== power of 2
...
128 & 127 = 0

I'm changing it to be more readable:
/**
 * Check if the secret key is compatible with Google Authenticator.
 *
 * @param $b32
 *
 * @throws IncompatibleWithGoogleAuthenticatorException
 */
protected function checkGoogleAuthenticatorCompatibility($b32)
{
    if (
        $this->enforceGoogleAuthenticatorCompatibility &&
        (
            $this->isCharCountPowerOfTwo($b32) || // Google Authenticator requires a power of 2 base32 length string
            $this->charCountBits($b32) < 128 // minimum number of bits = 128 / recommended = 160 / compatible with GA = 256
        )
     ) {
        throw new IncompatibleWithGoogleAuthenticatorException();
    }
}

This has sent me down the RFC rabbit hole this afternoon.
RFC 4226 (https://tools.ietf.org/html/rfc4226) states the following:
R6 - The algorithm MUST use a strong shared secret.  The length of
the shared secret MUST be at least 128 bits.  This document
RECOMMENDs a shared secret length of 160 bits.

128 bits == 10 bytes (base 256) == strlen(16) base 32
160 bits == 20 bytes (base 256) == strlen(20) base 32
@antonioribeiro I'm having trouble finding the power of 2 requirement for secret length. Would you have some documentation from Google on this?
Based on what I found in the Google Authenticator wiki, it looks like this package could potentially support sha256 and sha512 hashing algorithms in addition to sha1 (used in oathHotp() function).
I also performed a cursory source dive of the iOS Google Authenticator and I'd say these algorithms may be available now. This would require an update to also include the algorithm parameter in the getQRCodeUrl() function.
https://github.com/google/google-authenticator/wiki/Key-Uri-Format#algorithm
https://github.com/google/google-authenticator/blob/master/mobile/ios/Classes/OTPGenerator.m#L105-L113
@antonioribeiro Do you know if these hashing algorithms are actually supported or is it still just SHA1?

@wells, I could not find it too, but the need for a power of two string is something I checked when I first developed Google2FA, but now, to be sure, I had to do it all over again, so I used a different tool to be sure mines were ok:
https://rootprojects.org/authenticator/
Tested all of those one by one:
BMBCWU4VKTN3WHVG - 16 chars - 128 bits 1
UIRGD7M5Y7BFTRQWV - 17 chars - 136 bits
AUZSAZZP6VK2KL3WUU - 18 chars - 144 bits
J4TKEMKICE2GBBNO2WY - 19 chars - 152 bits
EU734YCWH6RKV7RFGMS7 - 20 chars - 160 bits
GSJUEBTM4SSBAYFR2YJD3 - 21 chars - 168 bits
ZQX5T5375AOBXJASK2O6BS - 22 chars - 176 bits
VBUQKWB47FGWRSQBFJZJ5SK - 23 chars - 184 bits

4REXZV2S7PTTE6LUWVY7XSBWGUCML37T - 32 chars - 256 bits 1

TWU3QWJJQ3PI4XZWD5RREIRIAKIXF5FG5DD2IV6LCBS4EV5RNDUVDDXAORX336K4 - 64 chars - 512 bits 1

RCOZMBSOY6QPP7BBSZUYVYRKSNUNKXOFW3KCGA3GEGNA3TV2Z6XYIEMNRNTJDPWK7S2BYUJ4UBD4MOLAJH5MNURWHG45HXBL3Y37ZWT7IDIFR5J4LURAJQMGILUZRNW7 - 128 chars - 1024 bits 1

This is it with 20 chars (160 bits):

Powers of 2 is it then.

Are we all good with a this point? @hopeseekr , are you still following your thread, mate?


Cannot choose which IP to use for BGP session on multi-nic host

Contrail-controller is the one responsible for setting up BGP sessions wth (v)MX and the charm does not allow me to choose which IP in my host I want to use if I have multiple options. The only way to force contrail-controller to do that is on post-deployment, where I manually override "hostips" on entrypoint.sh and reboot the container with "docker restart".
I believe a much cleaner way would be to set hostips as a env variable and pass that as a parameter on run method at: https://github.com/Juniper/contrail-charms/blob/R5/contrail-controller/hooks/docker_utils.py#L144
The new run method at docker_utils would look like similar to:
def run(image, tag, volumes, remove=False):
image_id = get_image_id(image, tag)
args = [DOCKER_CLI, "run"]
if remove:
args.append("--rm")
args.extend(["-i", "--network", "host"])
for volume in volumes:
args.extend(["-v", volume])
args.extend([image_id])
bgp_ip = _check_for_bgpip_format( config('bgp_host_ip') )
if bgp_ip is not None:
args.extend(["--env", "HOST_IP={}".format( bgp_ip )])
check_call(args)
_check_for_bgpip_format would be a method that receives IP in string format and check if that is valid. Returns valid IP as string or None otherwise.
Then, you need to set bgp_host_ip on config.yaml, preferably setting as "" by default.
You'll also need to do a tweak at control's entrypoint.sh. You'd need to check if HOST_IP env variable exists, otherwise proceed as you are doing at the moment.

Can you please tell me exact scenario?
I didn't understand what controller should do and how. Where the HOST_IP should be used inside entrypoint.sh and how?
contrail-controller charm has config option control-network that allows to specify network to listen on.

There is no response. Close it for now.


Signed channel hangs in state Collaborative Close Offered

Even though the close transaction got broadcasted it appears that the app sometimes fails to notice that the funding transaction has been spent. Hence it remains stuck in SignedChannelState::CollaborativeCloseOffered.
Current workaround is to check the state on the coordinator side and ensure that the close tx did get confirmed. If so the channel can be safely deleted using the emergency kit.

Note, this might not be a bug, since the app waits for the transaction to get mined in a block. And that could take some time.


Show prediction labels

Hey there, amazing tool, thanks for sharing!
I wonder if it is possible to draw the class label along with the bounding box for each prediction (possibly with the possibility of turning on/off the feature)
Actually, this bit of the code is supposed to do that, is that the case this works only for tf2 models?
https://github.com/datature/portal/blob/a972880183c3465f1851a6b360a87c47691495c5/src/engine/server/utilities/prediction_utilities.py#L616-L631

Hey @alemelis, thank you for the feedback, you read our minds. That's an idea that we are currently working on! Currently, if you hover over the boxes or masks, it does show the labels. Since the frontend bounding boxes, masks, and images are rendered by leaflet, it will be more of an update of the leaflet / front-end side of things.
I believe that the cv2.putText was for there to run tests as well as save the inference results to an image (for a potential feature we are pushing out) - I'll be sure to update this issue as we roll out the label changes.

Hey @alemelis, we have some working prototype in one of our branches and I'd like to check with you pertaining to our implementation - are you looking for something like this?

@gkeechin
that looks awesome!
will there be a toggle to turn on/off the labels?

@alemelis - Yes! It will be hotkey L. I have settled on the aesthetics and done the tests on various browsers. This feature will be bundled in our upcoming v0.55 update and Ill drop you a ping here when its in release. Should be done in the next few days.
Thank you for your patience and can't wait to hear your feedback

Hey @alemelis - The changes are in the current releases branch. If you are using python3 portal.py to run the application, you should be able to press L to reveal all the tooltips.
Let me know if you have further suggestions or feature request - just open a new issue!


Exception: Not authorized for facade: pos

when I create_invoice  this exception thrown. why and what's it solution?
"Exception: Not authorized for facade: pos"
client = BitPay::SDK::Client.new(api_uri:'https://test.bitpay.com', pem: File.read('/home/pikessoft/projects/jinious/lib/bitpay.pem'), insecure: true )
@invoice = client.create_invoice(price: amount, currency: 'USD')
Error Message is:
*** BitPay::BitPayError Exception: Not authorized for facade: pos

Same error here. have you solved the problem ?


Update to Python files to use Python3

Context

Since we are moving to Ubuntu 20.04, python 2 is no longer installed by default.
We could install it, but this adds dependencies and some amount of confusion keeping the versions straight.
We only have about a dozen python files and it is not too hard to move them to python 3 (in many cases this is just a matter of changing outdated executable paths at the top of the script).

Proposed
Let's make our code work with Python 3.

@M1chaelM This seems like something I can take care of.

It looks like our acoustic pinger tutorial may rely on this changes, since the pinger.launch file fails with the Python error:
ImportError: No module named yaml

This comes from both the pinger_visualisation.py and set_pinger_position.py nodes. The yaml module is definitely installed so I think these are trying to run python 2.

@M1chaelM I found that by simply modifying the shebangs at the top of the python files to python3 the pinger tutorial work fine. I haven't tested in Melodic though. I think ideally there'd be a parameter to use one or the other, but for a quick fix, this does work. Thoughts?

I think changing to force running in Python 3 should be fine. This will just mean that people running in Melodic need to install Python 3, which shouldn't be too much of a burden. It looks like @caguero did find a couple places where the code needs to be updated to eliminate things that aren't supported in Python 3, so it may be worth skimming through to look for these in case they don't pop up right away in testing.

@M1chaelM Sounds good!

Fixed in PR #265 and #266.


chore: switch noir pull to master branch

@vezenovm The array_dynamic_blackbox_input that was added in noir master is failing to verify in acir tests. I sent a message to @guipublic  to see if he can take a look but maybe you know why it could be failing :thinking:

Benchmark results
No metrics with a significant change found.

Detailed results
All benchmarks are run on txs on the Benchmarking contract on the repository. Each tx consists of a batch call  to create_note and increment_balance, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write.
This benchmark source data is available in JSON format on S3 here.
Values are compared against data from master at commit e23d048e and shown if the difference exceeds 1%.
L2 block published to L1
Each column represents the number of txs on an L2 block published to L1.

Metric
8 txs
32 txs
128 txs

l1_rollup_calldata_size_in_bytes
45,956
181,604
724,196

l1_rollup_calldata_gas
227,168
888,704
3,534,620

l1_rollup_execution_gas
320,359
1,007,152
3,754,998

l2_block_processing_time_in_ms
1,206 (+1%)
4,525 (+1%)
17,877 (+1%)

note_successful_decrypting_time_in_ms
317 (+1%)
1,020 (+4%)
3,781 (+4%)

note_trial_decrypting_time_in_ms
28.8 (+7%)
52.5 (-53%)
177 (+2%)

l2_block_building_time_in_ms
18,282
72,318
290,101

l2_block_rollup_simulation_time_in_ms
13,548
53,515
215,221

l2_block_public_tx_process_time_in_ms
4,703 (+1%)
18,723 (+1%)
74,614 (+1%)

L2 chain processing
Each column represents the number of blocks on the L2 chain where each block has 16 txs.

Metric
5 blocks
10 blocks

node_history_sync_time_in_ms
15,828 (+1%)
29,876 (-1%)

note_history_successful_decrypting_time_in_ms
2,341 (-9%)
4,741 (-3%)

note_history_trial_decrypting_time_in_ms
105 (-7%)
169 (-8%)

node_database_size_in_bytes
17,305,680
33,194,064

pxe_database_size_in_bytes
29,923
59,478

Circuits stats
Stats on running time and I/O sizes collected for every circuit run across all benchmarks.

Circuit
circuit_simulation_time_in_ms
circuit_input_size_in_bytes
circuit_output_size_in_bytes

private-kernel-init
327
44,528
25,313

private-kernel-ordering
196
43,633
16,193

base-rollup
1,458
129,774
933

root-rollup
83.2 (-3%)
4,192
729

private-kernel-inner
437
70,819
25,313

public-kernel-private-input
242 (+1%)
33,663
26,945

public-kernel-non-first-iteration
239
33,705
26,945

merge-rollup
7.88 (-2%)
2,712
933

Tree insertion stats
The duration to insert a fixed batch of leaves into each tree type.

Metric
1 leaves
2 leaves
8 leaves
16 leaves
32 leaves
128 leaves
64 leaves
512 leaves
1024 leaves
2048 leaves
8192 leaves

batch_insert_into_append_only_tree_16_depth_ms
10.2
10.7 (+1%)
12.8
17.3 (-2%)
22.9
64.6 (+1%)
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_count
16.9
17.5
23.0
31.6
47.0
143
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_ms
0.593
0.596 (+1%)
0.541
0.534 (-2%)
0.478
0.445 (+1%)
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_32_depth_ms
N/A
N/A
N/A
N/A
N/A
75.6 (+1%)
47.7
241 (+1%)
463
904 (+1%)
3,582 (+1%)

batch_insert_into_append_only_tree_32_depth_hash_count
N/A
N/A
N/A
N/A
N/A
159
96.0
543
1,055
2,079
8,223

batch_insert_into_append_only_tree_32_depth_hash_ms
N/A
N/A
N/A
N/A
N/A
0.466 (+1%)
0.488
0.438 (+1%)
0.433
0.430
0.430 (+1%)

batch_insert_into_indexed_tree_20_depth_ms
N/A
N/A
N/A
N/A
N/A
104
57.2
354 (+1%)
692
1,378 (+1%)
5,455

batch_insert_into_indexed_tree_20_depth_hash_count
N/A
N/A
N/A
N/A
N/A
197
104
691
1,363
2,707
10,771

batch_insert_into_indexed_tree_20_depth_hash_ms
N/A
N/A
N/A
N/A
N/A
0.495
0.497
0.479 (+1%)
0.475
0.476
0.472

batch_insert_into_indexed_tree_40_depth_ms
N/A
N/A
N/A
57.2
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_indexed_tree_40_depth_hash_count
N/A
N/A
N/A
94.1
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_indexed_tree_40_depth_hash_ms
N/A
N/A
N/A
0.579
N/A
N/A
N/A
N/A
N/A
N/A
N/A

Miscellaneous
Transaction sizes based on how many contracts are deployed in the tx.

Metric
0 deployed contracts
1 deployed contracts

tx_size_in_bytes
16,859
35,462 (-11%)

Transaction processing duration by data writes.

Metric
0 new commitments
1 new commitments

tx_pxe_processing_time_ms
554
1,443

Metric
0 public data writes
1 public data writes

tx_sequencer_processing_time_ms
0.520 (+3%)
578

Opened https://github.com/noir-lang/noir/issues/4356, removing the test in the meantime

@vezenovm The array_dynamic_blackbox_input that was added in noir master is failing to verify in acir tests. I sent a message to @guipublic to see if he can take a look but maybe you know why it could be failing 🤔

Thanks for flagging going to look now


Travis linting deviates from project linting

Was likely an issue with different versions being downloaded, closing this for now


Support Windows lib/dll build envrionment

Add windows build script (or vs project) to build/generate thorvg lib/dll files.

i can look at Windows if you want

TVG_EXPORT should be fixed on Windows, I can do something like EAPI is you want

@vtorri  yes, please.

I did some work on msvc, but not sure if this is resolved.


Create LICENSE

Pull Request Test Coverage Report for Build 116

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build 114:
0.0%

Covered Lines:
87

Relevant Lines:
87

💛  - Coveralls


[broken] this RPC method unavailable for key

This, and other iterations of it with different wallets:
Finding all token accounts for a wallet
curl http://api.mainnet-beta.solana.com -X POST -H "Content-Type: application/json" -d '
  {
    "jsonrpc": "2.0",
    "id": 1,
    "method": "getProgramAccounts",
    "params": [
      "TokenkegQfeZyiNwAJbNbGKPFXCWuBvf9Ss623VQ5DA",
      {
        "encoding": "jsonParsed",
        "filters": [
          {
            "dataSize": 165
          },
          {
            "memcmp": {
              "offset": 32,
              "bytes": "vines1vzrYbzLMRdu58ou5XTby4qAqVRLmqo36NKPTg"
            }
          }
        ]
      }
    ]
  }

Results in
{"jsonrpc":"2.0","error":{"code":-32010,"message":"TokenkegQfeZyiNwAJbNbGKPFXCWuBvf9Ss623VQ5DA excluded from account secondary indexes; this RPC method unavailable for key"},"id":1}
I can't find any notifications of RPC call structure changes. We can't list the tokens that are within the wallet currently.

This should be fixed now, closing

I'm still getting this error on mainnet-beta

Did anyone find the solution to this? I am getting this error using web3 sdk.

Still getting this error on mainnet-beta

This error will appear if a program is excluded from the secondary indices.  Tokenkeg... has so many accounts that it is almost always excluded from getProgramAccounts by RPC nodes, so this is part of totally normal operation.  Locking this discussion


backupccl: allow appending incremental layers to backups

PR: https://github.com/cockroachdb/cockroach/pull/45255
From release notes:

BACKUP can be re-run with the same destination path to automatically append an incremental backup to that path. [#45255][#45255] {% comment %}doc{% endcomment %}

Closing - dupe of #6532


Error with SQL_Autocommit_Off not implemented?

Hello,
I am trying to connect to a ODBC data source but got this error. Could you please help me with it? Thank you very much!
File "", line 1, in
pyodbc.Error: ('HYC00', "[HYC00] The 'SQL_AUTOCOMMIT_OFF' for the 'SQL_ATTR_AUTO
COMMIT' is not implemented. (0) (SQLSetConnnectAttr(SQL_ATTR_AUTOCOMMIT))")

Hi, @pineliu,
What type of ODBC datasource are you connecting to and what driver are you using?

Your driver apparently does not support autocommit=False, which is the default.  (Perhaps it doesn't support transactions?). The only workaround is to set it to True:
cnxn = pyodbc.connect(..., autocommit=True)


In documentation, it should be 'progressBar' instead of 'progressbar', right?

^^ may help

Thanks ^^

Great job!