storage backend issue sqlite3 when added some urls

Hi, first thank you very much on quick response for my last issue [#206] (https://github.com/gocolly/colly/issues/206) it was my fault.
But, now i had the same problem using sqlite3 storage backend. Here is the code below:
package main

import (
	"log"
	"time"

	"github.com/gocolly/colly"
	"github.com/gocolly/colly/extensions"
	"github.com/gocolly/colly/queue"
	"github.com/velebak/colly-sqlite3-storage/colly/sqlite3"
)

func main() {
	// Instantiate collector
	c := colly.NewCollector(
		colly.AllowedDomains("www.nytimes.com"),
	)

	storage := &sqlite3.Storage{
		Filename: "./results.db",
	}

	defer storage.Close()

	err := c.SetStorage(storage)
	if err != nil {
		panic(err)
	}

	extensions.RandomUserAgent(c)
	extensions.Referrer(c)

	q, _ := queue.New(2, storage)
	q.AddURL("https://www.nytimes.com")

	// Find and visit all links
	c.OnHTML("a[href]", func(e *colly.HTMLElement) {
		q.AddURL(e.Request.AbsoluteURL(e.Attr("href")))
	})

	c.OnResponse(func(r *colly.Response) {
		log.Println(r.Request.URL, "\t", r.StatusCode)
	})

	c.OnError(func(r *colly.Response, err error) {
		log.Println(r.Request.URL, "\t", r.StatusCode, "\nError:", err)
	})

	q.Run(c)
	log.Println(c)
}

This is the log output after starting scraper: 2018/08/12 15:53:38 Requests made: 1 (0 responses) | Callbacks: OnRequest: 2, OnHTML: 1, OnResponse: 2, OnError: 1
Other url like digitalocean for example works as expected but this url don't. Maybe i missed something or  didn't properly understand the storage backend documentation.
Thank you in advance.

Do not set custom storage for the collector if you use queues, use the storage only in the queue. If I remove the c.SetStorage(storage) it works as expected - not sure why, perhaps the sqlite module has some locking issues. It needs further investigation.


[windows10 error] accelerate: command not found

Previously I was able to execute the code commands successfully under linux, but when I switched to windows10, I already installed accelerate, but when I executed the code sample below dreambooth, I had the following issues when I executed the bash script in CMD.
error content below
(large-model) J:\Program\lib_diffusers\diffusers\examples\dreambooth>bash run-dog.bash
run-dog.bash: line 5: accelerate: command not found

bash script content below
export MODEL_NAME="runwayml/stable-diffusion-v1-5"
export INSTANCE_DIR="./data/dog"
export OUTPUT_DIR="model_fine-tune-dog"

accelerate launch train_dreambooth.py \
  --pretrained_model_name_or_path=$MODEL_NAME  \
  --instance_data_dir=$INSTANCE_DIR \
  --output_dir=$OUTPUT_DIR \
  --instance_prompt="a photo of sks dog" \
  --resolution=512 \
  --train_batch_size=1 \
  --gradient_accumulation_steps=1 \
  --learning_rate=5e-6 \
  --lr_scheduler="constant" \
  --lr_warmup_steps=0 \
  --max_train_steps=400 \
  --push_to_hub

If I run the following command from the command line, I get the following
(large-model) J:Program\lib_diffusers\diffusers\examples\dreambooth>accelerate
usage: accelerate <command> [<args>]

positional arguments:
  {config,estimate-memory,env,launch,tpu-config,test}
                        accelerate command helpers

optional arguments:
  -h, --help            show this help message and exit

Can anyone give me some advice on this problem?Thanks~

In your bash script you need to activate the conda environment probably

The above result has my conda environment running，so your advise like this:
export MODEL_NAME="runwayml/stable-diffusion-v1-5"
export INSTANCE_DIR="./data/dog"
export OUTPUT_DIR="model_fine-tune-dog"
conda activate large-model # add command
accelerate launch train_dreambooth.py \
  --pretrained_model_name_or_path=$MODEL_NAME  \
  --instance_data_dir=$INSTANCE_DIR \
  --output_dir=$OUTPUT_DIR \
  --instance_prompt="a photo of sks dog" \
  --resolution=512 \
  --train_batch_size=1 \
  --gradient_accumulation_steps=1 \
  --learning_rate=5e-6 \
  --lr_scheduler="constant" \
  --lr_warmup_steps=0 \
  --max_train_steps=400 \
  --push_to_hub

but it still dont't work. And it tells me that I have the following error
(large-model) J:\Program\lib_diffusers\diffusers\examples\dreambooth>bash run-dog.bash
run-dog.bash: line 4: conda command not found
run-dog.bash: line 5: accelerate: command not found

Try source activate. This is the root of your problem that you will need to try and figure out. I don't have much experience with windows sadly to advise other than that :)

Thank you for your answer, I will try to fix it:)


feat: Log full workflows when archiving is disabled

Checklist:

[ ] My organization is added to USERS.md.

I think this can be closed?


Support browsing by Host

URL: /browse/host/<name>
Page: Headers with the month/year combo, all tweets for that month below them. All on single page. Possibly provide page jumps for quick section jumping.

A form of this is being implemented in #88. However, the way it displays everything is less than ideal. This should still be implemented and the Host search redirect back to this to display the results.


Can't handle converting list types

1.9.3p194 :041 > Stuff.diff "

hi<//li><//ul>", "

hi<//li><//ol>"
 => "

hi<//li><//ul><//ol>"

Should probably do something else.

It's been a long time, so closing.


Use programmatically installation of composer

See https://getcomposer.org/doc/faqs/how-to-install-composer-programmatically.md

I'm not sure how Accompli would benefit from this. As this would still allow a man-in-the-middle attack.

I think it allows a man-in-two-middle's :wink: attack.

In the case that the currently implemented method won't work any longer, I'll think about changing it to this method. 😉

This issue is stale


deduplicate dns zones passed to operator

Description
Deduplicates any dns zones passed to the operator. Will need similar logic of some form in RP too.
Type of change
Please delete options that are not relevant.

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

How Has This Been Tested?
Locally, e2e, unit
Checklist:

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my code
[x] I have commented my code, particularly in hard-to-understand areas
[x] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[x] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes
[x] Any dependent changes have been merged and published in downstream modules

/ok-to-test sha=f7aa9a3

Pull Request Test Coverage Report for Build<PHONE_NUMBER>
Details

19 of 19 (100.0%)  changed or added relevant lines in 3 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.9%) to 79.859%

Totals

Change from base Build<PHONE_NUMBER>:
-0.9%

Covered Lines:
2609

Relevant Lines:
3267

💛  - Coveralls

/ok-to-test sha=f7aa9a3

failing test coverage check because I added a unit test to utils which had no coverage before. should add more unit tests to utils later


Doc'd support for assistive technologies in the admin.

See also #17338. I thought it was important to separately acknowledge what the goals and current state are for the Django admin, similarly to the FAQ entry about browser support.
Compared to contributing docs, this is for a very different audience of Django users so I chose to have this completely separate (and much more digestible), though the information is similar.

Like #17338, this is heavily based on:

Wagtail’s Assistive technologies support
The UK Government Digital Services’ guidance on Testing with assistive technologies, itself based on one of the most comprehensive public survey of assistive technology users I’m aware of.

This is ready for another round of review :)

Thank you @felixxm! I believe it’s important we have VoiceOver listed separately for iOS and macOS though. I have opened #17485 to address this.


[Feature] Can you please support Asciidoc?

hello,
is it possible to support Asciidoc and reStructuredText?
thanks in advance

after reading about it in the webstore looks like it already supports those formats, but those do no seem to appear on my menu.

Manifest V3 release will add basic support for AsciiDoc.
For reStructuredText, I don't plan to support it yet, because I can't even open their online editor.


[Android]: Can't build anymore (?)

Steps to Reproduce
Since now I can't build a flutter appbundle for release Android version anymore. It says, that gradle can't resolve:
- google_sign_in_web
- url_launcher_macos
- firebase_core_web
but I am building for Android 😢 ...

run: flutter build appbundle --target-platform android-arm64,android-arm --release
Error underneeth appears directly after 16-17s.

Target Platform: Android
Target OS version/browser: /
Devices: Pixel 2 XL and all other Android (>=21) devices
ERROR
* What went wrong:
Could not determine the dependencies of task ':app:transformClassesAndResourcesWithR8ForRelease'.
> Could not resolve all task dependencies for configuration ':app:releaseRuntimeClasspath'.
   > Could not resolve project :google_sign_in_web.
     Required by:
         project :app > project :google_sign_in
      > Unable to find a matching configuration of project :google_sign_in_web:
          - None of the consumable configurations have attributes.
   > Could not resolve project :url_launcher_macos.
     Required by:
         project :app > project :url_launcher
      > Unable to find a matching configuration of project :url_launcher_macos:
          - None of the consumable configurations have attributes.
   > Could not resolve project :firebase_core_web.
     Required by:
         project :app > project :firebase_core
      > Unable to find a matching configuration of project :firebase_core_web:
          - None of the consumable configurations have attributes.

Logs
[✓] Flutter (Channel stable, v1.12.13+hotfix.5, on Mac OS X 10.15.2 19C57, locale de-DE)
    • Flutter version 1.12.13+hotfix.5 at /Users/rebar/Documents/flutter
    • Framework revision 27321ebbad (4 weeks ago), 2019-12-10 18:15:01 -0800
    • Engine revision 2994f7e1e6
    • Dart version 2.7.0

[✓] Android toolchain - develop for Android devices (Android SDK version 28.0.3)
    • Android SDK at /Users/rebar/Library/Android/sdk
    • Android NDK location not configured (optional; useful for native profiling support)
    • Platform android-29, build-tools 28.0.3
    • Java binary at: /Applications/Android Studio.app/Contents/jre/jdk/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 1.8.0_202-release-1483-b49-5587405)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 11.3)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Xcode 11.3, Build version 11C29
    • CocoaPods version 1.8.3

[✓] Android Studio (version 3.5)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin version 41.1.2
    • Dart plugin version 191.8593
    • Java version OpenJDK Runtime Environment (build 1.8.0_202-release-1483-b49-5587405)

[✓] VS Code (version 1.41.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.7.1

[✓] Connected device (1 available)
    • iPhone 11 Pro Max • 4C3E4855-3033-4F8B-BD55-ED013B547D7B • ios •
      com.apple.CoreSimulator.SimRuntime.iOS-13-3 (simulator)

• No issues found!

ok, after switching to master branch and upgrade the flutter the error is solved. I didn't know that master is the actual stable. sorry for taking your time ✌


...or Is there a way to use SQL Server from the beginning?...

...by changing the project code, such that a migration is not necessary.  LocalDB would be fine.
Thank you!

Closing this as it doesn't sound like an issue. :)


Go Modules is the official Go dependency management tool, and it’s directly implemented into the go toolchain.
We need this in order to:

Automatically detect import statements and then update dependencies graph, lock, download, and install appropriate versions of packages.

Quoting golang official docs:

In Go 1.14, module support is considered ready for production use, and all users are encouraged to migrate to modules from other dependency management systems.

Also quoting the golang official blog, the reason why this does not break compatibility with previous go versions:

(Inside $GOPATH/src, for compatibility, the go command still runs in the old GOPATH mode, even if a go.mod is found. See the go command documentation for details.) Starting in Go 1.13, module mode will be the default for all development.

@filipecosta90 I noticed you pushed not only the go.mod but also the go.sum is that the best practice? in other languages it's usually common for libraries to only push the "package" file and not the "lock" file.


Fix xDS client for multiple watchers

Fixes #28468
Builds on top of #28467
https://github.com/grpc/grpc/pull/28521/commits/755d1e9fb893b8d724983e8bd70711de57c582e4 is the commit to look at
The added test fails before the change.

Does this actually need to depend on #28467?  I would think that we could fix this and add the new test without affecting the other test changes.
Not a big deal either way, though.

This raises the failure rate of the tests fixed by #28468 to be much higher than what it is right now without

This raises the failure rate of the tests fixed by #28468 to be much higher than what it is right now without

Are you saying that this PR without #28467 causes the tests in #28468 to be worse?  If so, it seems like we could just merge #28467 before this PR.

Are you saying that this PR without #28467 causes the tests in #28468 to be worse? If so, it seems like we could just merge #28467 before this PR.

Yup, that's what I plan to do. Doing this just made my local testing simpler.

Looks great! I assume you've verified that the test fails without the fix.

Yes it does


Advance project C++ standard from C++11 to C++17

Tickets addressed: #274
Review: By commit
Merge strategy: Merge (no squash)

Description
The project's C++ standard was advanced from C++11 to C++17. These changes are localized to CMake.
Verification
Test suite is successful in both CI runs and locally (mac os - apple-clang 14, libc++, armv8).
Documentation
Added a release note. No further changes/additions needed.
Future work

@schaubh those are not references to the C++ standard API. They are toggles to to tell the compiler which C++ application binary interface (ABI) to use to generate platform compatible libraries. The ABI is the library that defines how data structures and routines are accessed in machine code in a hardware-dependent format. The specification of which C++ API we are using determines which functions and structures are available (and can be compiled against the specific ABI). For more information

https://en.wikipedia.org/wiki/Application_binary_interface
https://docs.conan.io/1/howtos/manage_gcc_abi.html


Llama.cpp Generator

Summary and motivation
Llama.cpp is an important project in this field and having an integration with it would be great.
@awinml worked on something related.
Checklist
If the request is accepted, ensure the following checklist is complete before closing this issue.

[x] The code was merged in the main branch
[ ] Docs are published at https://docs.haystack.deepset.ai/
[x] There is a Github workflow running the tests for the integration nightly and at every PR
[x] A label named like integration:<your integration name> has been added to this repo
[x] The labeler.yml file has been updated
[x] The package has been released on PyPI
[ ] An integration tile has been added to https://github.com/deepset-ai/haystack-integrations
[x] The integration has been listed in the Inventory section of this repo README
[x] There is an example available to demonstrate the feature
[ ] The feature was announced through social media

@awinml can you also open a PR in https://github.com/deepset-ai/haystack-integrations? 🙏

@anakin87 Yes, I will do that!


[Facebook] Error downloading Facebook videos

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

[X] I understand that I will be blocked if I intentionally remove or skip any mandatory* field

Checklist

[X] I'm reporting a bug unrelated to a specific site
[X] I've verified that I'm running yt-dlp version 2023.07.06 (update instructions) or later (specify commit)
[X] I've checked that all provided URLs are playable in a browser with the same IP and same login details
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched known issues and the bugtracker for similar issues including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue

Provide a description that is worded well enough to be understood
yt-dlp is raising ExtractorError('Cannot parse data') error when trying to download facebook videos.
Provide verbose output that clearly demonstrates the problem

[X] Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
[ ] If using API, add 'verbose': True to YoutubeDL params instead
[X] Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output
[debug] Command-line config: ['-vU', 'https://www.facebook.com/watch?v=508246001379256']
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version<EMAIL_ADDRESS>[b532a3481] (pip)
[debug] Python 3.9.14 (CPython x86_64 64bit) - Linux-5.15.0-1039-aws-x86_64-with-glibc2.31 (OpenSSL 1.1.1n  15 Mar 2022, glibc 2.31)
[debug] exe versions: ffmpeg 4.3.6-0, ffprobe 4.3.6-0
[debug] Optional libraries: Cryptodome-3.18.0, brotli-1.0.9, certifi-2023.07.22, mutagen-1.46.0, sqlite3-2.6.0, websockets-11.0.3
[debug] Proxy map: {}
[debug] Loaded 1855 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Available version<EMAIL_ADDRESS>Current version<EMAIL_ADDRESS>yt-dlp is up to date<EMAIL_ADDRESS>[facebook] Extracting URL: https://www.facebook.com/watch?v=508246001379256
[facebook]<PHONE_NUMBER>79256: Downloading webpage
[facebook]<PHONE_NUMBER>79256: Downloading webpage
ERROR: [facebook]<PHONE_NUMBER>79256: Cannot parse data; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
  File "/usr/src/.venv/lib/python3.9/site-packages/yt_dlp/extractor/common.py", line 710, in extract
    ie_result = self._real_extract(url)
  File "/usr/src/.venv/lib/python3.9/site-packages/yt_dlp/extractor/facebook.py", line 707, in _real_extract
    return self._extract_from_url(real_url, video_id)
  File "/usr/src/.venv/lib/python3.9/site-packages/yt_dlp/extractor/facebook.py", line 654, in _extract_from_url
    raise ExtractorError('Cannot parse data')

Closed in favor of https://github.com/yt-dlp/yt-dlp/issues/7901

same .....
yt-dlp https://fb.watch/mPJ5Ngsz_p/ -vU
[debug] Command-line config: ['https://fb.watch/mPJ5Ngsz_p/', '-vU']
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version<EMAIL_ADDRESS>[b532a3481] (pip)
[debug] Python 3.10.12 (CPython x86_64 64bit) - Linux-<IP_ADDRESS>-microsoft-standard-WSL2-x86_64-with-glibc2.35 (OpenSSL 3.0.2 15 Mar 2022, glibc 2.35)
[debug] exe versions: ffmpeg 4.4.2 (setts), ffprobe 4.4.2, rtmpdump 2.4
[debug] Optional libraries: Cryptodome-3.11.0, brotli-1.0.9, certifi-2020.06.20, mutagen-1.45.1, pyxattr-0.7.2, secretstorage-3.3.1, sqlite3-2.6.0, websockets-10.3
[debug] Proxy map: {}
[debug] Loaded 1855 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Available version<EMAIL_ADDRESS>Current version<EMAIL_ADDRESS>yt-dlp is up to date<EMAIL_ADDRESS>[generic] Extracting URL: https://fb.watch/mPJ5Ngsz_p/
[generic] mPJ5Ngsz_p: Downloading webpage
[redirect] Following redirect to https://www.facebook.com/mlbcts/videos/187864833931070/
[facebook] Extracting URL: https://www.facebook.com/mlbcts/videos/187864833931070/
[facebook]<PHONE_NUMBER>31070: Downloading webpage
[facebook]<PHONE_NUMBER>31070: Downloading webpage
ERROR: [facebook]<PHONE_NUMBER>31070: Cannot parse data; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
File "/usr/local/lib/python3.10/dist-packages/yt_dlp/extractor/common.py", line 710, in extract
ie_result = self._real_extract(url)
File "/usr/local/lib/python3.10/dist-packages/yt_dlp/extractor/facebook.py", line 707, in _real_extract
return self._extract_from_url(real_url, video_id)
File "/usr/local/lib/python3.10/dist-packages/yt_dlp/extractor/facebook.py", line 654, in _extract_from_url
raise ExtractorError('Cannot parse data')


Load Vault token from file

Vaultenv is a fantastic tool and has really helped my organisation simplify our developer workflow. One additional feature that I’d love is the ability to load the Vault token from a file.
We currently use Docker and distribute the token to our swarm nodes via the VAULT_TOKEN environment variable. The problem is that if an unauthorised user gained access to a node they could simple do docker inspect to retrieve the token.
If Vaultenv could load the token from a file, e.g. via a path specified with the VAULTENV_TOKEN_FILE environment variable, we could then use Docker Secrets to distribute the token to the node, which would be more secure.

Glad you're enjoying vaultenv!
We currently do support loading config from files in the dotenv format, as documented here: https://github.com/channable/vaultenv#behavior-configuration
Does that suit your needs? Or would you need more flexibility? E.g. like being able to specify where to search for these files or something else

Ah, of course. I hadn't considered that I could specify the token in the config file. I can then specify a custom path for my docker secret containing the env file. Thanks - problem solved!

Actually, having just tried this it does work but makes the docker-compose file a little messy. So, yes please, to keep things consistent it would be great to be able to specify  VAULTENV_CONFIG_FILE as an environment variable, similar to VAULTENV_SECRETS_FILE.

Could you post a minimal example of the docker compose file so we can get a feel for the problem?

Yes certainly, thanks. I'm putting my VAULT_TOKEN in a .env file and passing it as a Docker secret. Currently I have to specify a target so that Docker will mount the config file in location that vaultenv will read:
services:
  app:
    image: 'my-app'
    secrets:
      - source: vault_config
        target: /etc/vaultenv.conf
      - vault_secrets
    entrypoint:
      - vaultenv
      - docker-entrypoint.sh

secrets:
  vault_config:
    external: true
  vault_secrets:
    external: true

My proposal, above, would mean I could use the default Docker secret mount as the location of the config file by setting the VAULTENV_CONFIG_FILE env var in the Docker image itself. This would avoid having to specify it in every compose file that subsequently uses the image. The compose file would then look like this (which is also easier for newcomers to grok):
services:
  app:
    image: 'my-app'
    secrets:
      - vault_config
      - vault_secrets
    entrypoint:
      - vaultenv
      - docker-entrypoint.sh

secrets:
  vault_config:
    external: true
  vault_secrets:
    external: true

One of the things we currently do is allow cascading behavior of these config files. That fact isn't documented too well in the current README, but vaultenv will look for the config files in this order:

/etc/vaultenv.conf
$HOME/.config/vaultenv/vaultenv.conf
$CWD/.env

vaultenv does not stop once a config file has been found, it will continue looking for the remaining files. If those exist, the config keys overwrite the ones from the top level.
This cascading behavior is very useful for machines which have multiple users/projects.
I don't want to drop that, so we'd need to choose how this extra customization interacts with the current behavior.

Instead of VAULTENV_CONFIG_FILE, I would prefer VAULTENV_CONFIG_FILES (and corresponding CLI option). The format would be a comma separated list of config file paths that vaultenv should load in order.
This means that the defaults would be equivalent to these invocations:
$ VAULTENV_CONFIG_FILES=/etc/vaultenv.conf,$HOME/.config/vaultenv/vaultenv.conf,$CWD/.env vaultenv

$ vaultenv --config-files=/etc/vaultenv.conf,$HOME/.config/vaultenv/vaultenv.conf,$CWD/.env vaultenv

We could keep the current behavior as a default and allow users to override the current behavior by passing in custom VAULTENV_CONFIG_FILES.

Yes, that sounds good, thanks @duijf. It's similar to the docker-compose functionality that cascades docker-compose.yml with docker-compose.override.yml by default, but you can also specify your own cascade with the -f option.

Do you mind if we keep this open for the time being until #75 is revisited? I'm still really keen for this one, thanks so much 🙏

We did a config refactor in https://github.com/channable/vaultenv/pull/76, so we can revisit https://github.com/channable/vaultenv/pull/75 now.
That means this ticket is unblocked.


First set of text changes (now that we're removing AI tab)

🚀 Deployed on https://67256c6524e239db389f87ff--cozy-fox-0defec.netlify.app

NOTE- will come back to update w/ updated demo video and product screenshot later; need to re-record video


Move Source type from package settings to config to avoid import cycle
Small renaming of SourceRuntime to SourceCLI
Add one Viper instances per source, and new SetWithSource method
Remove the Source logic specific to the runtime settings to use the new global logic
Migrate remaining .Set() to .SetForSource()
Fix tests

Motivation
For Fleet Automation, we want to display the configuration of the agent and the source of every setting.

Additional Notes
A lot (~20) file changes are related to the migration of Source settings to another package

Possible Drawbacks / Trade-offs
The new Viper instances will require more computing for the Agent
The inventories payload will be heavier

Describe how to test/QA your changes

Reviewer's Checklist

[ ] If known, an appropriate milestone has been selected; otherwise the Triage milestone is set.
[ ] Use the major_change label if your change either has a major impact on the code base, is impacting multiple teams or is changing important well-established internals of the Agent. This label will be use during QA to make sure each team pay extra attention to the changed behavior. For any customer facing change use a releasenote.
[ ] A release note has been added or the changelog/no-changelog label has been applied.
[ ] Changed code has automated tests for its functionality.
[ ] Adequate QA/testing plan information is provided if the qa/skip-qa label is not applied.
[ ] At least one team/.. label has been applied, indicating the team(s) that should QA this change.
[ ] If applicable, docs team has been notified or an issue has been opened on the documentation repo.
[ ] If applicable, the need-change/operator and need-change/helm labels have been applied.
[ ] If applicable, the k8s/<min-version> label, indicating the lowest Kubernetes version compatible with this feature.
[ ] If applicable, the config template has been updated.

Naming the sources
How do you feel about the current naming:

SourceDefault
SourceUnknown
SourceYaml
SourceEnvVar
SourceSelf
SourceRC
SourceCLI

@hush-hush suggested changing SourceYaml to something else because we might support another file type down the road, maybe SourceFile?
SourceSelf is not very explicit but as it concerns settings set by the agent itself I didn't find better alternatives...

Naming the set methods
Currently, I chose not to rename the .Set() method in the viper wrapper because it is used 750+ times in the agent and changing it would be error prone.
My choice was to create a new .SetForSource() method that's being called by the depreciated .Set() method.
However @hush-hush pointed out that it would be best to rename the old .Set() to .SetWithoutSource() in order to make it clear for future developers that you must use the source concept. The .SetForSource() method would then become the new .Set().


URL in PDF broken

I just clicked the URL in the PDF to get back to this repo, and got a 404 error; it seems you have a "software_community" in the PDF and it should be "software-community". Can you update? :)

Actually, for that matter, I'm not seeing your article here, which is odd...


fix: use absolute path instead of relative path

Description
fixes: Invalid value for "path" parameter: no file exists at "./../../presets/slz-for-powervs/rhel-vpc-pvs.preset.json.tftpl"; this function works only with files that are distributed as
part of the configuration source code, so if this file will be created by a resource in this configuration you must instead obtain this result from an attribute of that resource.
Types of changes in this PR
Changes that affect the core Terraform module or submodules

[x] Bug fix
[ ] New feature
[ ] Dependency update

Changes that don't affect the core Terraform module or submodules

[ ] Examples or tests (addition or updates of examples or tests)
[ ] Documentation update
[x] CI-related update (pipeline, etc.)
[ ] Other

Release required?
Identify the type of release. For information about the changes in a semantic versioning release, see Release versioning.

[ ] No release
[ ] Patch release (x.x.X)
[ ] Minor release (x.X.x)
[x] Major release (X.x.x)

Release notes content
If a release is required, replace this text with information that users need to know about the release. Write the release notes to help users understand the changes, and include information about how to update from the previous version.
Your notes help the merger write the commit message for the PR that is published in the release notes for the module.
Run the pipeline
If the CI pipeline doesn't run when you create the PR, the PR requires a user with GitHub collaborators access to run the pipeline.
Run the CI pipeline when the PR is ready for review and you expect tests to pass. Add a comment to the PR with the following text:
/run pipeline

Checklist for reviewers

[ ] If relevant, a test for the change is included or updated with this PR.
[ ] If relevant, documentation for the change is included or updated with this PR.

Merge actions for mergers

Use a relevant conventional commit message that is based on the PR contents and any release notes provided by the PR author. The commit message determines whether a new version of the module is needed, and if so, which semver increment to use (major, minor, or patch).
Merge by using "Squash and merge".

/run pipeline


add crash to list of projects using prompt-toolkit

Merged in: https://github.com/jonathanslenders/python-prompt-toolkit/commit/852791949b53f5965dfd3680b1ded90c23b07b1c
Thanks!


[PE-D][Tester D] Misleading lines

addproj command requires more than one necessary field to be added, and this line is misleading as it may make people think that the only necessary field is the project name
(Small visual issue that addproj and addProj does not match in this line, even though I understand that both works, maybe pulling the line I have screenshot below to the top would be clearer to the user in the UG)

Labels: severity.VeryLow type.DocumentationBug
original: optionalemon/ped#3

We will change the example used in the user guide to make it less confusing. We will also shift the last point on top to make it clearer.


getBoundingClientRect() bug

after several diffs the graph can not be handled correctly. Bug while getting position of an element

I came from the MOST website through the feedback button

implemented null pointer check


Add lunacy and made the list awesome friendly

Added lunacy.
I used Awesome-lint to adjust the list a bit so the readme is ready to add it to the awesome list. To do that the repo still needs a contributing.md and awesome topics, among other requirements: https://github.com/sindresorhus/awesome/blob/main/pull_request_template.md#requirements-for-your-awesome-list

Added lunacy.
I used Awesome-lint to adjust the list a bit so the readme is ready to add it to the awesome list. To do that the repo still needs a contributing.md and awesome topics, among other requirements: https://github.com/sindresorhus/awesome/blob/main/pull_request_template.md#requirements-for-your-awesome-list

You are right, there are a lot of changes that can be made here. The author of the project initially just did it as a list but is very open to contribution on it.

Thank you for your contribution.

I have been away this weekend, thanks @Jogai for the awesome contribution and thank you @michaeldera for reviewing and merging this.


Develop

Hi everybody,
I found your project really interesting. Having found the paper and the repository I thought it would be great to try an ML path for image alignment. Still had to adapt it a lot, I tried not to break compatibility. The only issue that there may be is the change of notation from "test" to "val" to leave space for an actual test_set, if it is intended to divide dataset in the classical 3 splits (train, val, test). As an added value I introduced:

TensorBoard logging
pep8 formatting of the code
fixed a bug that prevented using MSE loss
some error handling and initialization of folders or paths as well as updated compatibility and fixed
deprecation problems for the new version of torch (1.3.0),
adding a requirements.txt,
learning rate schedulers and some parameters for training optimization.

In addition the repo is now compatible with another type of dataset (which I used) that is described in the updated README.md.
The next steps will be:

fixing an issue which prevents graph logging in TB when using cuda,
log more interesting visualizations of training
improve model exports (not only on each epoch) specifying the number of steps between each model validation and export
adding the possibility of restarting training from a checkpoint.

Anyway the commits should be atomical and have clear messages, so you can cherry pick the ones you find most interesting/useful. Else, if needed, I also may be available for splitting this pull request into separate ones, each with a more specific purpose.
Hope I've been of help and looking forward to your reply!
Cheers

Hi Michele, thanks for contribution!
I've tested the code and it seems to work nicely. I fixed some deprecation warnings and other small errors. There might still be some Variables() around (which are also deprecated) but it's not a big deal. Do you want to do some other fixes before I merge?

Hi Ignacio,
I'm very pleased to hear you so soon and I'm very happy that you like my work.
I'm still working a little bit on the repository, my next steps are pretty much the ones described in the pull request description.
I think it's fine to merge it now, due to the fact that now I am currently working on displaying insights of my model on TensorBoard and for what regards the training pipeline I think that there won't be any other major suggestions on my side.
I have some other minor ideas which we might well discuss on issues I may eventually open (e.g. specifying a number of steps after which validate the model and not only after each epoch).
Best regards

Hi @Armyke, I'm not sure I understand the use case of the CoupledDataset that you introduced. I see that you have pairs of training images, but I don't understand what's the role of theta in this case. Could you say a bit more about this?
Thanks!

Hi Ignacio,
the reason why I needed the possibility of a coupled dataset is to
supervisely train a SIFT-like alignment model.
What it does is that takes a couple of images which share an object where
vertices are annotated and aims to teach the model to warp vertices_a over
vertices_b and that's where theta matrix comes into play: it is in fact the
ground truth of this trasformation.
Of course is vital the sorting of the vertices which MUST be ordered
correctly depending on the orientation of the respective images.
For my purpose I used only affine transformations, which make necessary
only the first three vertices. The reason why all vertices should be
specified is that as preprocessing of image a, to make feature extraction
easier, image_a pixels are set to blank outside the vertices while image b
is served as is.
I can't assure the correct working of this mode when vertices are more than
4 cause wasn't part of my use case but I expect it not to have problems.
I hope it's all clear now, for every other question I'll be at disposition!
If you wish me to update readme I can work on it, just let me know.
Kind regards
Il Ven 20 Dic 2019, 16:24 Ignacio Rocco<EMAIL_ADDRESS>ha
scritto:

Hi @Armyke https://github.com/Armyke, I'm not sure I understand the use
case of the CoupledDataset that you introduced. I see that you have pairs
of training images, but I don't understand what's the role of theta in this
case. Could you say a bit more about this?
Thanks!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/ignacio-rocco/cnngeometric_pytorch/pull/14?email_source=notifications&email_token=AKOSWP77GK3USXGLI2MJY43QZTPSVA5CNFSM4JPUJCD2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEHNGUVI#issuecomment-567962197,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AKOSWP6MO6CXAZTRZ3A73STQZTPSVANCNFSM4JPUJCDQ
.

Hi Michele, I've updated the repo with some extra code from the extended TPAMI version of the paper.
Given that your CoupledDataset seems quite specific for your task, and only works for the affine model,  I've removed it from the repo for now.
Best,
Ignacio

Hi Ignacio,
Sorry for the late response, busy days :)
Hope you still found something useful to held.
I'll definetely checkout the new paper as well as your new commits on the
repo.
Kind regards and happy new year!
Il Sab 21 Dic 2019, 17:51 Ignacio Rocco<EMAIL_ADDRESS>ha
scritto:

Hi Michele, I've updated the repo with some extra code from the extended
TPAMI version of the paper.
Given that your CoupledDataset seems quite specific for your task, and
only works for the affine model, I've removed it from the repo for now.
Best,
Ignacio
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/ignacio-rocco/cnngeometric_pytorch/pull/14?email_source=notifications&email_token=AKOSWPY5TZFYXDR73HODUGDQZZCRBA5CNFSM4JPUJCD2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEHO7RGA#issuecomment-568195224,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AKOSWPZHUWJXNLA3CKD2XN3QZZCRBANCNFSM4JPUJCDQ
.


Text not visible

text in options are not visible when not hovered (bright over bright?)

Oh that's a Windows issue. I'll have to fix this blind I think.


Inclusion of logback.xml in mockserver-netty

Hello,
After doing some research I have come to the conclusion that it is standard practice for libraries to exclude their logback.xml's from .jar's that go in Maven Central (or any repo for that matter). Because mockserver-netty has logback.xml in the .jar, I get the following warnings:
16:28:19,353 |-WARN in ch.qos.logback.classic.LoggerContext[default] - Resource [logback.xml] occurs multiple times on the classpath.
16:28:19,353 |-WARN in ch.qos.logback.classic.LoggerContext[default] - Resource [logback.xml] occurs at [file:/C:/Code/cryptodash/core/target/classes/logback.xml]
16:28:19,353 |-WARN in ch.qos.logback.classic.LoggerContext[default] - Resource [logback.xml] occurs at [jar:file:/C:/Users/brcolow/.m2/repository/org/mock-server/mockserver-netty/3.9.1/mockserver-netty-3.9.1.jar!/logback.xml]
16:28:19,447 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
This wouldn't be so bad but logback has this thing where after a WARNing has occured, no matter what local settings one has, all further logging gets output to the console (as you can see from the one INFO log statement I included after the WARNs).
I am requesting that you exclude logback.xml from the final JAR for mockserver-netty.
(Just want to say as an aside that I really love working with this library so far, it is amazing).
Thanks very much.

:+1: for this, I just experienced some weirdness because of the logback.xml in the classpath

:+1: for this, I just experienced some weirdness because of the logback.xml in the classpath

I will fix (and release) this early in the next week or so once I'm back after Christmas holidays.
Cheers,
James
Sent from my iPhone

On 2 Jan 2015, at 00:24, Francisco A. Lozano<EMAIL_ADDRESS>wrote:
for this, I just experienced some weirdness because of the logback.xml in the classpath
—
Reply to this email directly or view it on GitHub.

I will fix (and release) this early in the next week or so once I'm back after Christmas holidays.
Cheers,
James
Sent from my iPhone

On 2 Jan 2015, at 00:24, Francisco A. Lozano<EMAIL_ADDRESS>wrote:
for this, I just experienced some weirdness because of the logback.xml in the classpath
—
Reply to this email directly or view it on GitHub.

thanks!

thanks!

Sorry for the delay but I've been trying to work on this. The main remaining issue is that the jar-with-dependencies used in a number of other tools that use MockServer requires the logback jars and xml file.
I just need to resolve this then I can remove both the jars and the xml file so that only slf4j will be present and any underlying logging framework can be plugged in.

This fix is in version 3.9.2 which I am releasing right now, but it'll take about 2 hours to appear on maven central.


a index file maybe?

file is autogenerated with a ps script
https://gist.github.com/7dc07c134f56d0e20be50826af67cb55 sry for using
powershell.

Also would love to build an example app.


Improve BaseModel.eq performance

Bug
Output of python -c "import pydantic.utils; print(pydantic.utils.version_info())":
             pydantic version: 1.5.1
            pydantic compiled: True
                 install path: /home/mihai/.local/share/virtualenvs/vmcs-smsc-nYWUkkuU/lib/python3.8/site-packages/pydantic
               python version: 3.8.2 (default, Apr  8 2020, 14:31:25)  [GCC 9.3.0]
                     platform: Linux-5.5.19-1-ck-x86_64-with-glibc2.2.5
     optional deps. installed: ['devtools']

I've been trying out pydantic in one of my projects and came across a serious performance issue that unfortunately I am not able to reproduce in isolation. At this point I'm unsure if I am doing something wrong or if there is an issue in pydantic.
Essentially, I have the following class declared in my project that I was initially using with standard dataclasses:
import pydantic
from pydantic import dataclasses

<EMAIL_ADDRESS>#class ProtocolValue:
class ProtocolValue(pydantic.BaseModel):
    type: str
    value: Any

#    @classmethod
#    def construct(cls, **kwargs):
#        return cls(**kwargs)

This class is used extensively. Instances are created, passed around and destroyed heavily and because of this, I made sure to use construct everywhere.
I have a couple of unit tests that simulate heavy workload which when I run them with the class deriving from pydantic.BaseModel they take around 3 minutes to run. If I use the dataclass form by removing the comment markers and fixing up the code above the the total time drops down to about 44 seconds.
By looking over some profiling data that I captured using pytest-profile the following two entries seem suspicious (they are in 2nd and 3rd place sorted by total time; 1st and 2nd sorted by total number of calls):
 ncalls          tottime    percall cumtime  percall filename:lineno(function)
 54371496   21.687    0.000   42.711    0.000   /usr/lib/python3.8/abc.py:96(__instancecheck__)
 54371496   21.023    0.000   21.024    0.000   {built-in method _abc._abc_instancecheck}

In comparison to pydantic.BaseModel, the dataclass variant has an insignificant number of calls:
      126    0.000    0.000    0.001    0.000 /usr/lib/python3.8/abc.py:96(__instancecheck__)
      126    0.000    0.000    0.000    0.000 {built-in method _abc._abc_instancecheck}

I'm a bit lost right now and unsure what to make out of it. Does anyone have any idea on how to follow up on this?

Upon further investigation I figured out how to reproduce the issue in isolation. In my unit tests I do a lot of x in <very_big_list_of_items> checks and this is where the delay is coming from.
Bellow is a self-contained piece of code that shows the behavior I'm talking about:
import dataclasses
import random
import string
import timeit
from typing import Any

import pydantic

random.seed(1)  # Always generate the same 'random' values

def random_string(length):
    letters = string.ascii_lowercase
    return ''.join(random.choice(letters) for i in range(length))

class PydanticObject(pydantic.BaseModel):
    type: str
    value: Any

@pydantic.dataclasses.dataclass
class PydanticDataclassObject:
    type: str
    value: Any

@dataclasses.dataclass
class StdDataclassObject:
    type: str
    value: Any

pydantic_list = [
    PydanticObject.construct(
        type=random_string(6),
        value=random.randint(1, 1000)
    )
    for i in range(10000)
]
pydantic_dataclass_list = [
    PydanticDataclassObject(type=o.type, value=o.value)
    for o in pydantic_list
]
std_dataclass_list = [
    StdDataclassObject(o.type, o.value)
    for o in pydantic_list
]

std_dataclass_list = 'std_dataclass_list[-1] in std_dataclass_list'
pydatic_dataclass_test = 'pydantic_dataclass_list[-1] in pydantic_dataclass_list'
pydantic_model_test = 'pydantic_list[-1] in pydantic_list'

print(
    'dataclasses.dataclass: ',
    timeit.timeit(std_dataclass_list, number=200, globals=globals())
)
print(
    'pydantic.dataclasses.dataclass: ',
    timeit.timeit(pydatic_dataclass_test, number=200, globals=globals())
)
print(
    'pydantic.BaseModel: ',
    timeit.timeit(pydantic_model_test, number=200, globals=globals())
)

On my machine I get the following results:
dataclasses.dataclass:  3.961700713261962e-05
pydantic.dataclasses.dataclass:  1.3102007849956863
pydantic.BaseModel:  28.17944354697829

pydantic.dataclasses.dataclass is 33071x (!!) slower than dataclasses.dataclass
pydantic.BaseModel is 711296x (!!!) slower than dataclasses.dataclass
pydantic.BaseModel is 21.5x slower than pydantic.dataclasses.dataclass

This difference in performance in my particular case is caused by the generic way in which BaseModel.__eq__ is implemented. At the moment, it works by doing a hidden conversion to dict on both objects being compared and then comparing the resulting dicts for equality.
In contrast, standard dataclasses build the __eq__ function (among other things) for each dataclass to do direct field by field comparisons. For example, in case of:
@dataclass
class TestModel:
    a: int
    b: int

The body of TestModel.__eq__ will literally be implemented as:
def __eq__(self, other):
    if other.__class__ is self.__class__:
        return (self.a, self.b) == (other.a, other.b)
    raise NotImplemented

Would there be any issues if pydantic adopts the same strategy of generating some of the functions instead of relying on generic expensive behavior?

I'd be very happy to see a performance improvement in __eq__, my concerns are:

how do we make it reliable
what do we do about backward compatibility

I think we can drop the conversion to dict and accept a breaking change that 'dict(a=1, b=2) != MyModel(a=1, b2)` in v2, where in v1 I think they were equal.
Obviously pydantic is call eval to generate models, so we can't just synthesise a simple and fast __eq__ method as I guess dataclasses do.
could we do something as simple as:
``py
def eq(self, other: Any) -> bool:
return other.class == self.class and self.dict == other.dict
?

Should we also include `and self.__fields_set__ == other.__fields_set__`?

Hey @samuelcolvin, I haven't forgotten about this issue but I'm somewhat short on time these days and wasn't able to look too much into it.
I worked around my original issue by manually implementing  __eq__ where I had to like this (the main focus being on eliminating as much overhead as possible):
    def __eq__(self, other: Any) -> bool:
        if isinstance(other, MyClass):
            return (self.a, self.b) == (other.a, other.b)
        return super().__eq__(other)

I realise this approach might not hold for the general case given the way pydantic is currently implemented but then again I still have some way to go with familiarizing myself with pydantic's implementation.
Regarding this comment:

Obviously pydantic is call eval to generate models, so we can't just synthesise a simple and fast eq method as I guess dataclasses do.

Dataclasses do synthesise class methods using eval. E.g. take a look at https://github.com/python/cpython/blob/e005ead49b1ee2b1507ceea94e6f89c28ecf1f81/Lib/dataclasses.py#L946, especially the implementation of _cmp_fn and _create_fn .
Do you think we would be able to use this somehow in pydantic to make some functions faster?

I've updated my comment above to make sense and be correct (it had so many typos it made no sense).
The point is that dataclasses uses eval while pydantic does not. Pydantic can't use eval since it's compiled with cython which clearly can't support code generated from eval(). Thus we have to something completely different.

If 'eq' would be refactored it would be also nice to introduce an kwarg in Field in order to add it to compare or not with default true.
I think that in that case for eq we could use the Model.dict(exclude={all field that have compare=false}). As it is also possible in pydantic.dataclasses.field().
At the moment I do not understand why this not possible.

If 'eq' would be refactored it would be also nice to introduce an kwarg in Field in order to add it to compare or not with default true.
I think that in that case for eq we could use the Model.dict(exclude={all field that have compare=false}). As it is also possible in pydantic.dataclasses.field().
At the moment I do not understand why this not possible.

We've changed this in V2 and no longer convert the model to a dict. For the benchmarks in https://github.com/pydantic/pydantic/issues/1494#issuecomment-626303816 I get:
dataclasses.dataclass:  0.2761917499592528
pydantic.dataclasses.dataclass:  0.27540237503126264
pydantic.BaseModel:  0.9767189580015838

Still slower than dataclasses, but still much faster than V1!


Update deps & readme

Pull Request Test Coverage Report for Build 873968752

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 86.667%

Totals

Change from base Build 806091804:
0.0%

Covered Lines:
44

Relevant Lines:
52

💛  - Coveralls


Refactor addClass and removeClass

The existing behavior:

Relied on newer DOM and JS APIs.
Branched for FastBoot, resulting in different behavior in different environments. This is a debugging nightmare.
Did not remove multiple instances of a class name from an element.
Did not ensure that the class name it was removing matched at token boundaries.
Did not have tests.

This also moves the utility's location to the default Ember location. I've included a stub for external API compatibility which can electively be removed.

@nathanhammond did you happen to test your PR with a environment=production build? I am seeing an issue on the latest release, 1.0.1, where classes are not being applied to the body in FastBoot, but only on production builds (this on ember 3.1.2). I tried your PR's branch, but it seemed to exhibit the same issue in my app.

@billdami Can you create a simplified reproduction as a repo I can just npm i && ember serve? If so I'll get a test in place and address the issue.

@nathanhammond sure, I'll give that a try

@nathanhammond so it appears it might be an app/environment related issue..as I'm not able to reproduce it in the test repo I just created. But just for reference, here's the repo:
https://github.com/billdami/ember-body-class-prod-test

@billdami I've gone ahead and forked this project. Try ember-body-class2.


Forms issue on Mac OS X Safari

I am having an issue with displaying a form on safari. For some reason, when you select the fields within the form, the name of the field which is usually contained within the field, does not move. This causes the text that the user inputs to be written under the name of the text, like in the below image.

When a field is selected but no text is entered, the form looks like the following:

I know that this is not like what the form is supposed to look like. When I test the form code in Codepen, however, it seems to work fine. The link to the codepin is below.
http://codepen.io/anon/pen/JYPEVW
Does anyone know why this is happening?

Check your id's and make sure they match in the HTML

I just double checked and all of them match in the HTML.

I figured out the problem. I did not load jQuery before materialize.js, causing the webpage to break.
Thanks for the help!


Ensure we gather devscripts deployment logs

Until now, the devscripts logs were outside of the standard tree,
meaning we couldn't get them in the zuul output.
This patch corrects the situation, and works even in case of deployment
failure, as shown in the snippet bellow. It also ensures we don't get
the whole devscripts failure output in the ansible log, since we now
have access to the various log files.
We also converge the logs destination to the standard logs location, in
~/ci-framework-data/logs/devscripts.
This also ensures we're gathering it in zuul jobs.
The use of block/always ensures the actions nested under the always
block are launched, even in case of failure.
Also, contrary to the block/rescue, a failure will fail the run right
after the last task of the always block:
TASK [devscripts : Check async deploy status] *************************************************************************************************************************************************************************************************
Tuesday 06 August 2024  13:52:40 +0200 (0:00:00.616)       0:03:19.695 ********
FAILED - RETRYING: [builder1]: Check async deploy status (480 retries left).
FAILED - RETRYING: [builder1]: Check async deploy status (479 retries left).
FAILED - RETRYING: [builder1]: Check async deploy status (478 retries left).
FAILED - RETRYING: [builder1]: Check async deploy status (477 retries left).
FAILED - RETRYING: [builder1]: Check async deploy status (476 retries left).
FAILED - RETRYING: [builder1]: Check async deploy status (475 retries left).
FAILED - RETRYING: [builder1]: Check async deploy status (474 retries left).
FAILED - RETRYING: [builder1]: Check async deploy status (473 retries left).
FAILED - RETRYING: [builder1]: Check async deploy status (472 retries left).
FAILED - RETRYING: [builder1]: Check async deploy status (471 retries left).
fatal: [builder1]: FAILED! => changed=false
  attempts: 11
  censored: 'the output has been hidden due to the fact that ''no_log: true'' was specified for this result'

TASK [devscripts : Gather logs paths={{ _log_src }}, patterns=*.log] **************************************************************************************************************************************************************************
Tuesday 06 August 2024  13:57:43 +0200 (0:05:03.132)       0:08:22.828 ********
ok: [builder1]

TASK [devscripts : Copy all generated logs dest={{ cifmw_devscripts_logs_dir }}/{{ item.path | basename }}, remote_src=True, src={{ item.path }}] *********************************************************************************************
Tuesday 06 August 2024  13:57:43 +0200 (0:00:00.236)       0:08:23.065 ********
changed: [builder1] => (item=/home/virtuser/src/github.com/openshift-metal3/dev-scripts/logs/01_install_requirements-2024-08-06-135240.log)
changed: [builder1] => (item=/home/virtuser/src/github.com/openshift-metal3/dev-scripts/logs/02_configure_host-2024-08-06-135404.log)
changed: [builder1] => (item=/home/virtuser/src/github.com/openshift-metal3/dev-scripts/logs/03_build_installer-2024-08-06-135448.log)
changed: [builder1] => (item=/home/virtuser/src/github.com/openshift-metal3/dev-scripts/logs/04_setup_ironic-2024-08-06-135512.log)
changed: [builder1] => (item=/home/virtuser/src/github.com/openshift-metal3/dev-scripts/logs/05_create_install_config-2024-08-06-135558.log)
changed: [builder1] => (item=/home/virtuser/src/github.com/openshift-metal3/dev-scripts/logs/06_create_cluster-2024-08-06-135602.log)

PLAY RECAP ************************************************************************************************************************************************************************************************************************************
builder1                   : ok=372  changed=113  unreachable=0    failed=1    skipped=82   rescued=4    ignored=0

/lgtm


Hue 3.8.0 - Not getting prompted for parameters when a Sqoop design is submitted

When I submit a sqoop design with a parameter, I am not getting a prompt for the parameter value. Job is getting submitted with the $PARAM as it is.

I just noticed that the prompt is coming up only if the parameter is part of the prepare step. If I add the following, it works

Does a workflow from the workflow editor supposed to prompt for the parameters? I have a simple workflow and its not prompting for parameters. Thanks.

Yes it should, cf. oozie examples and http://gethue.com/new-apache-oozie-workflow-coordinator-bundle-editors/
Where did you put the ${parameter}?

From Job Designer: My parameter is part of the sqoop command. In this case, I am only getting the prompt if the parameter is also part of the "Prepare" Step.
From Workflow Editor: My parameter is part of the sqoop command. I couldn't get this working at all.

Example sqoop command I am using:
import --as-avrodatafile --null-string "" --null-non-string "" --fields-terminated-by \001 --escaped-by \\ --compress --num-mappers 1 --connect jdbc:oracle:thin:@xxxxxx:xxxx/xxxx --username xxxxx --password xxxx --table ${Table} --target-dir /user/skk/sqoop/${Table}

I observed the following today:
For the same workflow - If I go to File browser, select the workflow xml and submit it, its prompting for the parameter value. But If I submit it from the workflow editor, it's not asking for parameter.
Thanks.

It works fine for me in the new editor, e.g. https://www.dropbox.com/s/gilgpoo8a0oh9sp/oozie-sqoop-demo.ogv?dl=0

Thanks for the screen cast. I saw your video and I tried the exact step and it didn't prompt me for the parameter. Any suggestions on how to debug this? Thanks.

I am using Hue master, I just tried 3.8 and indeed it is missing 78b8334b305662c88f22170aacce547e425a939a I just put it to 3.8.1 too

Awesome. This works great.


ISO-9 Cyrilic Table1, Table2, Table3

ISO-9 (ru) for Cyrilic languages have at least 3 variants of translitiration.
To resolve this problem we can pass to the translation function argument with standard string, for example ISO-9.Table1.ru or ISO-9.Table1.uk

Hi @iegik, thanks for reporting this. Could you elaborate more? Thanks


luci-app-openvpn: add missing proto param for ipv6

This should fix #3163

Hello,
please port also to  release/18.06 like originally intended by #3163


[BUG] Unescaped trailing backslash when replacing file separators on Windows

Bug Report Checklist

[x] Have you provided a full/minimal spec to reproduce the issue?
[ ] Have you validated the input using an OpenAPI validator (example)?
[x] Have you tested with the latest master to confirm the issue still exists?
[x] Have you searched for related issues/PRs?
[x] What's the actual output vs expected output?
[ ] [Optional] Sponsorship to speed up the bug fix or feature request

Description
To determine ModuleLocation, replaceAll is used on File.separator, which is "" on Windows systems.
mystring.replaceAll(String.valueOf(File.separatorChar), ".")
replaceAll is expecting a regex to replace, but "" is a reserved character in regex. An error is thrown:
java.util.regex.PatternSyntaxException: Unescaped trailing backslash near index 1
If you just replace all occurrences of .replaceAll(String.valueOf(File.separatorChar) with replace(File.separatorChar, '.'), it will work.
openapi-json-schema-generator version
4.5.1
OpenAPI declaration file content or url

Generation Details

Steps to reproduce
Just execute: "test\test1\test2".replaceAll(String.valueOf(File.separatorChar), ".") on Windows
Related issues/PRs

Suggest a fix
Exchange replaceAll with replace

Thanks for report. Would you like to submit a PR fixing this issue?


<EMAIL_ADDRESS>

Thanks for looking to open an issue for this project.
If you are opening an issue to suggest adding a new entry, please consider opening a pull request instead!

Fenku

5

Veerii good


EFRS-620: Make scanner backend selectable during container build

EFRS-620: Make scanner backend selectable during container build


Add feature to disable page

It would be interesting to put a property that allows to disable the background content, so the user could not manipulate the screen controls

.nprogress-busy  {
  cursor: wait;

  body {
    pointer-events: none;
  }
}


[Outlook] Tweak tutorial

Docs Build status updates of commit aca09ca:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/tutorials/outlook-tutorial.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


Don't throw an error if the user provides a non-existent flag

At this moment, if the user runs a command using a non-existent flag (for instance, zos add --all --network local), zos will throw the following error:
foo@bar:~$ zos add --all --network local
error: unknown option `--network'

This could be somewhat annoying. We should be more flexible in these cases and just ignore the flag instead of throwing an error. An approach to fix this could be to use the allowUnknownOption() function provided by commander.js

Disagree, let's fail if a command is incorrect. Also, this is less important having interactive mode running.


i got a suggestion

Maybe you can make a folder where you can put MP3 and/or flac files that u can use?

#168 ?

Planned for 1.9.6.


doc: Fix typo resulting in broken link in manual

Description of changes
I was looking at
https://nixos.org/manual/nixpkgs/stable/#buildpythonpackage-parameters to import a Python package and noticed that the link for the hooks in pyproject option is broken due to a typo (used 0 instead of )).

Thanks!


ValueError in bilinear_upsampling due to mismatch in shape

Hi,
I'm getting error  "
ValueError: Error when checking target: expected bilinear_upsampling_5 to have shape (101, 101, 2) but got array with shape (101, 101, 1)". This happens during xception as well as mobilenetv2.
my train img_size = (101,101)
can someone please tell me what's wrong?

How many classes do you have? Try setting number of classes to 1

Thanks, I get it now. I have  to predict a single class.


Need few changes in Invoice Print.

1. Remove Unique Id column
2. Replace Year with Period

Duplicate Project with same Service will Create confusion without UniqueId

UniqueId is required..... it helps to find out identical projects when we have same service projects with same period .... like
Service like "E-way Bill" we creates multiple duplicate projects in one months i.e. daily invoice wise projects for E-waybill...

@sureshsirvi : please explain how it help you when we already have facility of project title

yes we can also manage from TITLE of project also... we can remove it.

@vinpahilwani recommends-
Removing UniqueId


Use better package manager

I'm thinking straight.el.

Blocks #99.

Blocks #186.

We are now using straight.el on develop.


Busy Man Problem in C++

Have you read the Contributing Guidelines on Pull Requests?
yes
Description
Code added in cp(competitive programming) folder.
Checklist

[x] I've read the contribution guidelines.
[x] I've checked the issue list before deciding what to submit.
[x] I've edited the README.md and link to my code.

Related Issues or Pull Requests
#5072

@HarshCasper @ankitaggarwal23 please review my PR.

@siddharth25pandey please review my PR

@ankitaggarwal23 I have made the changes that were requested. Kindly review my PR.


Allow admins to withdraw from price prediction vyper contract

As Paloma admin, I want to be able to withdraw all unused/available funds from the price prediction contract without using compass.

by the admin - cc @taariq

@verabehr @taariq and please let me know the admin address please for deploying

done. please check @verabehr
https://github.com/VolumeFi/juice-bot-eth-predictor-vyper/commit/23e3e2b560e24c4e758223a7a60373439f1a474b
https://github.com/VolumeFi/interest-rate-prediction-bot-vyper/commit/ed548c8a318b7a5fc02273000d3760d23a6f3647


[SPARK-31687][INFRA] Use GitHub instead of GitBox in release script

What changes were proposed in this pull request?
This PR aims to use GitHub urls instead of GitHub in the release scripts.
Why are the changes needed?
Currently, Spark Packaing jobs are broken due to GitBox issue.
fatal: unable to access 'https://gitbox.apache.org/repos/asf/spark.git/': Failed to connect to gitbox.apache.org port 443: Connection timed out

https://amplab.cs.berkeley.edu/jenkins/view/Spark Packaging/job/spark-master-maven-snapshots/2906/console
https://amplab.cs.berkeley.edu/jenkins/view/Spark Packaging/job/spark-branch-3.0-maven-snapshots/105/console
https://amplab.cs.berkeley.edu/jenkins/view/Spark Packaging/job/spark-branch-2.4-maven-snapshots/439/console

Does this PR introduce any user-facing change?
No. (This is a dev-only script.)
How was this patch tested?
Manual.
$ cat ./test.sh
. dev/create-release/release-util.sh
get_release_info
git clone "$ASF_REPO"

$ sh test.sh
Branch [revert-28307-locality-fix]: master
Current branch version is 3.1.0-SNAPSHOT.
Release [3.1.0]:
RC # [1]:
Full name [Dongjoon Hyun]:
GPG key<EMAIL_ADDRESS>================
Release details:
BRANCH:     master
VERSION:    3.1.0
TAG:        v3.1.0-rc1
NEXT:       3.1.1-SNAPSHOT

ASF USER:   dongjoon
GPG KEY<EMAIL_ADDRESS>FULL NAME:  Dongjoon Hyun
E-MAIL<EMAIL_ADDRESS>================
Is this info correct [y/n]? y
ASF password:
GPG passphrase:
Cloning into 'spark'...
remote: Enumerating objects: 223, done.
remote: Counting objects: 100% (223/223), done.
remote: Compressing objects: 100% (117/117), done.
remote: Total 708324 (delta 70), reused 138 (delta 32), pack-reused 708101
Receiving objects: 100% (708324/708324), 322.08 MiB | 2.94 MiB/s, done.
Resolving deltas: 100% (289268/289268), done.
Updating files: 100% (16287/16287), done.

$ sh test.sh
Branch [revert-28307-locality-fix]: branch-3.0
Current branch version is 3.0.1-SNAPSHOT.
Release [3.0.0]:
RC # [2]:
...

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/27224/
Test PASSed.

Hi, @srowen , @shaneknapp , @dbtsai .
Could you review this PR? I want to merge this into master only and recover Spark packaging Jenkins job.

Test build #122562 has started for PR 28513 at commit 00f3c4b.

BTW, revert-28307-locality-fix seems to be made by @tgravescs .

https://github.com/apache/spark/tree/revert-28307-locality-fix

Do we know if we have a way to remove that branch, @tgravescs ?

Oh, I bet it must have been made when I accidentally pushed the merge button in the PR. I started to revert it by pushing the revert button but then cancelled it. It must have made this branch.
I just deleted it in the GitHub branches UI.

Oh. Nice. Thank you, @tgravescs . I didn't notice that removing branches is allowed here.

I think that's fine, don't see a problem with it for release. For that purpose they should be identical.

Test build #122562 has finished for PR 28513 at commit 00f3c4b.

This patch fails build dependency tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/122562/
Test FAILed.

Thank you, @srowen .
Since this is irrelevant to PRBuilder, I'll merge this to master and trigger Packaing Jenkins job.

Thank you again, @srowen , @tgravescs , @shaneknapp .

FYI, this issue is fixed. Now, we are hitting the next-step error.
In Jenkins farm, the following seems to hang for a long time and fail due to timeout.
exec: curl --silent --show-error -L https://www.apache.org/dyn/closer.lua?action=download&filename=/maven/maven-3/3.6.3/binaries/apache-maven-3.6.3-bin.tar.gz

Unfortunately, the fallback logic makes a corrupted version string.

Late LGTM!

Thank you, @HyukjinKwon .


Using elsewhen produces invalid firrtl file

Added ByteSelector.scala to chiselTests
Running causes firrtl error, each elsewhen clause becomes another else in firrtl.  Should be nested
    when T_9 :
      node T_10 = bits(io.in, 7, 0)
      io.out := T_10
      skip
    else :
      node T_12 = eq(io.offset, UInt<1>("h01"))
      when T_12 :
        node T_13 = bits(io.in, 15, 8)
        io.out := T_13
        skip
      skip
    else :
      node T_15 = eq(io.offset, UInt<2>("h02"))
      when T_15 :
        node T_16 = bits(io.in, 23, 16)
        io.out := T_16
        skip
      skip
    else :
      node T_17 = bits(io.in, 31, 24)
      io.out := T_17
      skip

The original test case emits correct FIRRTL now.


Copy pasted text from 'Pivot' section

The following text appears under the "Unpivot Key" section:
"The Pivot Key is the column that ADF will pivot from row to column. By default, each unique value in the dataset for this field will pivot to a column. However, you can optionally enter the values from the dataset that you wish to pivot to column values."
The following text appears under the "Unpivoted Columns" section:
"Lastly, choose the aggregation that you wish to use for the pivoted values and how you would like the columns to be displayed in the new output projection from the transformation."

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: a529d249-3a84-081a-e339-5acd02c43e38
Version Independent ID: 559c4aa5-28f2-5cf3-5951-b73c9fecc9d6
Content: Azure Data Factory Mapping Data Flow Unpivot Transformation
Content Source: articles/data-factory/data-flow-unpivot.md
Service: data-factory
GitHub Login: @kromerm
Microsoft Alias: makromer

@RajatUC  Thank you for reaching out and bringing this to our notice. At this time we are reviewing the feedback and will provide an update as appropriate

@RajatUC Could you please elaborate the ask?

@RajatUC  We are closing this issue as we have not heard back from you. You can always re-open the issue and tag me in your reply if you think that is appropriate. We will gladly continue the discussion.


fix(profile): added emailPrivate to profile.

Related to https://github.com/fabric8-ui/fabric8-ui/pull/2489

Can one of the admins verify this patch?

[test]


router: implement append_cluster, append_upstream_host, and do_not_forward

Description: Implement three new router behaviors, append_cluster, append_upstream_host and do_not_forward. These are enabled via the new StreamDebugInfo class, although no API is provided to set them.
Risk Level: low/medium (changes to router)
Testing: added unit tests for behaviors separately and combined.
Docs Changes: n/a
Release Notes: n/a (I think...)
Fixes: #6453
Signed-off-by: Dan Rosen<EMAIL_ADDRESS>

@mattklein123 @htuch - ready for a proper review now, and thanks again for the earlier design feedback!

Will defer to @htuch for final review and merge.

/retest


add OSP pruner back as backup to results

see https://redhat-internal.slack.com/archives/C04PZ7H0VA8/p1721742678863629
@enarha @gbenhaim
rh-pre-commit.version: 2.3.0
rh-pre-commit.check-secrets: ENABLED

/lgtm

/retest

static analysis prs cannot get off the ground in prod-rh01
merging and seeing how e2e's look


NIST and FIPS compliant in openssl

I am using a 64 bit arm architecture based soc from NXP (QorIQ LS1046A) which includes cryptography hardware accelerator(NXP CAAM) in build. My requirement is to develop a ssl based application using OpenSSL, currently i am using OpenSSL v1.1.1d. I need to offload all crypto functions into hardware accelerator(NXP CAAM), offload is done now through OpenSSL 1.1.1d.
I was able to generate a random number from the generator using hardware accelerator(NXP CAAM) in QorIQ LS1046 soc.
NXP CAAM provide a complete implementation of SP800-90A using SHA-256 in random number generator.
My question is, if cryptography hardware accelerator provides a FIPS & NIST Compliant means. To achieve FIPS & NIST Compliant is OpenSSL 1.1.1d is enough or need to upgrade for OpenSSL 3.0?

My question is, if cryptography hardware accelerator provides a FIPS & NIST Compliant means. To achieve FIPS & NIST Compliant is OpenSSL 1.1.1d is enough or need to upgrade for OpenSSL 3.0?

It's not clear from your question what you are after. FIPS is a large set of standards covering many different crypto algorithms and primitives.
SP800-90A is one specific standard relating to DRBGs.
Any particular product may be compliant with one or more standards - meaning that its implementation follows the requirements of those standards. Any vendor can claim compliance with the standards. Those claims are not necessarily checked by anyone external to the vendor.
NIST also run a cryptographic module validation program. This validates and provides a certificate from NIST that a module conforms to FIPS 140-2 (or FIPS 140-3). Those standards themselves require that any cryptographic algorithm the module implements conforms to many other FIPS standards in order to be able to claim compliance and achieve validation.
OpenSSL 3.0 provides a FIPS module that is compliant with FIPS 140-2 and is currently undergoing validation. There is no FIPS module available directly from the OpenSSL project for 1.1.1.
I do not know the specifics of the product you are using and whether it has a FIPS 140-2/3 validation.
So you really need to understand what crypto algorithms do you need to use and do they need to be simply compliant with a standard, or do they to be FIPS 140-2 or FIPS 140-3 validated? What algorithms does the module you are already using implement and are they FIPS 140-2 or FIPS 140-3 validated?

Thank you for your reply

You should ask a FIPS labs what your status is.  They are the experts, each situation is different and there are many subtleties involved.
The security policy for the hardware you are using should also be available, it will list all the validated algorithms.  If you use anything outside of those, you won't be compliant.


Remove SqlCall Class

This is a new class that was added in 1.0 development, but we haven't shipped 1.0 yet, so it doesn't make much sense to deprecate it. Instead we should just remove it and move the code back in to iSql.
All current users will be using iSql (unless they're using the alpha). Users would then see two deprecation warnings: "iSql is deprecated, use SqlCall" and then "SqlCall is deprecated and will be removed". This is confusing and would be better changed to just having iSql say that it will be removed and not having SqlCall at all.
Originally posted by @kadler in https://github.com/IBM/nodejs-itoolkit/pull/117#pullrequestreview-362953801

Obsoletes ##98


No http output at /logs in master

Using gliderlabs/logspout:latest, when I run docker run ... gliderlabs/logspout:latest and also docker run learn/ping ping github.com I get entries like this in :8000/logs
[1;37m        logspout|[martini] Started GET /logs for <IP_ADDRESS>:53968
[1;36m    adoring_bell|PING github.com (<IP_ADDRESS>) 56(84) bytes of data.
[1;36m    adoring_bell|64 bytes from github.com (<IP_ADDRESS>): icmp_req=1 ttl=61 time=98.1 ms
[1;36m    adoring_bell|64 bytes from github.com (<IP_ADDRESS>): icmp_req=2 ttl=61 time=102 ms
[1;36m    adoring_bell|64 bytes from github.com (<IP_ADDRESS>): icmp_req=3 ttl=61 time=96.6 ms

However, using master and make dev I get no output from :8080/logs, although it's clear logspout is seeing the docker container lifecycle events (via console)
2015/03/24 13:46:27 loading and persisting routes in /mnt/routes
2015/03/24 13:46:27 logspout dev serving http on :8000
2015/03/24 13:47:03 event: 1203f24832b1 create
2015/03/24 13:47:03 event: 1203f24832b1 start
2015/03/24 13:47:10 event: 1203f24832b1 die

Fixed in master.

:+1: thanks that's much better!


Relax Ruby requirements to allow gem with newer versions of Ruby

Ruby 2.1.X is no longer supported (https://www.ruby-lang.org/en/news/2017/04/01/support-of-ruby-2-1-has-ended/)

Allow any Ruby newer than 2.1.0

Hello, @jasonnoble! This is your first Pull Request that will be reviewed by Ebert, an automatic Code Review service. It will leave comments on this diff with potential issues and style violations found in the code as you push new commits. You can also see all the issues found on this Pull Request on its review page. Please check our documentation for more information.

Ebert has finished reviewing this Pull Request and has found:

18 possible new issues (including those that may have been commented here).
10 fixed issues! 🎉

You can see more details about this review at https://ebertapp.io/github/gamera-team/gamera/pulls/25.

lgtm


fix: Change mode from visual and select to only visual

This prevents interference with snippets.
Context: Currently if you wanted to use a snippet for example expand fn into:
fn name(args) {
  body;
}

and you want to call the function "kelvin" it wouldn't work. Pressing "k" would expand the selected area to the line above and not type the letter k. Setting the mode to "x" instead of "v" ensures that snippets work, but the functionality still exists for visual mode which I think was the intended setting.
I know this is just the config and can be adjusted by everyone themselves but I think this would be a better default setting.

I didn't notice this interference. Thanks for the PR!


Add setting to support a different SSH key associate with one identity

It also adds:
Support for defining an identity that support SSH key and GPG key with one line
Support for printing local settings associated to the identity
Support for updating local repo setting from the current identity

Thanks for your contribution and the nice comment about the code! ;) I'm happy this project is useful for some people.
Those additions look great!


Codegen

This PR adds code generation and compilation using LLVM. Currently, plan execution checks if a given query can be compiled. If so, it goes through the codegen -> JIT -> execution process, otherwise it falls back to interpreted execution.
Some high-level points:

Table scans, projections, order-by's, hash joins, and hash-based aggregations are supported.
The important expressions are supported.
The general ROF framework is enabled (Prefetching is disabled by default, SIMD vectorization is still being ported over)
Integration with transactional components (i.e., tuple visibility checks).
Runtime flag to enable/disable code generation.
Single-threaded execution only. Parallel execution is WIP.
Mostly-complete type system with overflow checks and NULL handling.
Plenty of tests, but not nearly sufficient.
The beginnings of an embedded TPCH benchmark.

Note: This is take 3 of merging in codegen. The previous PR (#612) had corrupted history from a terrible rebase I did.
More Life.

Coverage increased (+1.3%) to 68.359% when pulling df8a39eb1b5f6ec4a3f1f188d2bc8563a52c81ed on pmenon:codegen-v1 into 3eff6957de0683203bf098936f007bc44507d4c9 on cmu-db:master.


Handle IDB Error (from Dexie) - The database connection is closing

Need to handle DB closing error from Dixie

@Chwy5 Having difficulty reproducing. Some questions:

Were multiple tabs open when this happened?
Was there a different error that originally happened or some failure that preceded this?
Had your machine gone into sleep mode preceding this?
Did refreshing fix the issue?

Were multiple tabs open when this happened? - Yes
Was there a different error that originally happened or some failure that preceded this? (401) portis error
Had your machine gone into sleep mode preceding this? - No
Did refreshing fix the issue? - Yes

Looks like this isn't eminently repeatable --- lowering the priority -- thinking we need to promote this one to be the type of uncaught error that tells users to refresh.
@andrewdamelio @bthaile -- would that be relatively easy to implement? A top level error handler hook that pops open a modal and says "Something went wrong! Please refresh"

There's a similar error that happens here with ZeroX browser mesh -- it gets an error saying LevelDB closed. 0x uses a leveldb that is written as a blob into indexeddb.

Closing until we see this particular case again as others like it have been handled via refresh.


Feature/uk nino

Adding the RegEx detector, filth, and unit test for UK National Insurance numbers (named GBNINO in the scrubber).

Coverage increased (+0.1%) to 92.07% when pulling fb7817e8eeb1a779047f9b7c242a8fe0864d6f8a on feature/uk_nino into 02aae91fbcded7fba7b3b189522d7e6716438b1e on master.


Adds titleStyle prop to AppBar

Need to be able to override title element styles in AppBar. In my case I didn't want overflow: hidden so that I could put a drop down menu in the title.

In my case I didn't want overflow: hidden so that I could put a drop down menu in the title.

This will be fixed by https://github.com/callemall/material-ui/pull/2150.
But, yes, I think that we should be able to overide the style. Could you add it to the documentation too?

@oliviertassinari maybe if I was using the one from material-ui, but in my case I am using react-select.
I'm not sure that #2150 would fix this particular issue either. Depends on if the Popover gets appended inside the title element or not.

Popover gets appended inside the title element or not.

Yes, he does.

Then it will not work since the title element has overflow hidden, which will cut off the dropdown.

@rolandpoulter Thanks!


The revert reason-parsing logic throws when a tx simulation reverts

This has been reported here and here.

Screenshot

This snippet should simulate the TX and return the correct revert reason, assuming the tx is expected to revert.
await contract.functions.my_function().simualte()

The error is thrown here: https://github.com/FuelLabs/fuels-ts/blob/f1bb197bbe448ae0e5f75ae7902364e2a7475826/packages/program/src/errors.ts#L17

Another incidence

Likely a duplicate of #1237.

Most likely is the same problem that we have on https://github.com/FuelLabs/fuels-ts/issues/1245

Closing in favor of https://github.com/FuelLabs/fuels-ts/issues/1245


Memory Error when using Lidar

Hi there !
I am having an issue using the lidar :
I can run the west_coast_lidar.py example but the code down below doesn't work
This window appears everytime :

Can you please tell me what am I doing wrong ? I have 24Go of RAM so it feels strange that it's not enough.
import sys

from time import sleep

import numpy as np

from beamngpy import BeamNGpy, Scenario, Vehicle, setup_logging
from beamngpy.sensors import Lidar

def main():
    setup_logging()

    beamng = BeamNGpy('localhost', 64256, home="../beamng-research_unlimited/trunk")

    # Create a scenario in west_coast_usa
    scenario = Scenario('west_coast_usa', 'research_test',
                        description='Random driving for research')

    # Set up first vehicle, with two cameras, gforces sensor, lidar, electrical
    # sensors, and damage sensors
    vehicle = Vehicle('ego_vehicle', model='etk800',
                      licence='AUBIN IA', color='White')

    lidar = Lidar(offset=(0, 0, 1.6), visualized=False)

    # Attach them
    vehicle.attach_sensor('lidar', lidar)

    scenario.add_vehicle(vehicle, pos=(-717.121, 101, 118.675), rot=(0, 0, 45))

    # Compile the scenario and place it in BeamNG's map folder
    scenario.make(beamng)

    # Start BeamNG and enter the main loop
    bng = beamng.open(launch=True)
    try:
        bng.set_steps_per_second(60)  # With 60hz temporal resolution

        # Load and start the scenario
        bng.load_scenario(scenario)
        bng.start_scenario()
        # Put simulator in pause awaiting further inputs
        bng.pause()

        assert vehicle.skt
        # Send random inputs to vehice and advance the simulation 20 steps
        while True:

            bng.step(60)

            # Retrieve sensor data and show the camera data.

            sensors = bng.poll_sensors(vehicle)

            print(sensors['lidar'])
            sleep(1)
    finally:
        bng.close()

if __name__ == '__main__':
    main()```

Hello, unfortunately, neither my colleague or I seem to be able to recreate this issue, but we have seen it before in other users. The only real recommendation I can give is making sure your graphics drivers are fully up to date or doing a clean install of them, maybe reinstalling/upgrading DirectX and so on. If you google that specific error code with "beamng" you'll find various people randomly having it and those things solving it: https://www.beamng.com/threads/d3d11-error-8007000e.54495/

Hi All!
I am facing this issue too. It happens exactly on the second sensor poll, and driver update, cache clearing did not help.

@mihalykorodi Hi there, have you managed to find a fix/workaround for this? I have basically the exact same issue (on an RX590, and unfortunately I don't have an Nvidia Card on hand) and nothing seems to help (downgrading drivers, updating drivers, reinstalling, all to no avail)...


Asking for the scores of many revisions takes too long

I wanted the scores of 50 revisions, but ores took 74 seconds to respond.
See also meta:Research talk:Revision scoring as a service#Notes on ORES performance.

Relatedly see: https://github.com/halfak/Revision-Scoring/pull/97
It gets us about a 50% speedup for batch requests of 50 revisions or more

We've made substantial improvements to performance.


1st para includes 'Project Service Automation' but should be 'Project Operations'

1st para includes 'Project Service Automation' but should be 'Project Operations'
PSA going away?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 9eadb9e2-bc3a-25e6-ec3d-e85e1f404405
Version Independent ID: 5b70c7ac-bce9-36ec-09ce-c9291c1744e0
Content: Administer Power Platform - Power Platform
Content Source: power-platform/admin/admin-documentation.md
Service: power-platform
Sub-service: admin
GitHub Login: @jimholtz
Microsoft Alias: jimholtz

Thanks for your comment, @standswell. This issue has been assigned to the doc author for review.

@standswell
Thanks for the update. This affects many topics and we'll make this terminology change at a later time.


Using a name withe kebab case breaks server and MergeRuntime.

Followed through @jherr 's video
Called my consumer nextjs app next-app-2.
After following instructions and running the consumer app I got a blank screen.
fiddled around with _document.js and next.config.js - commenting out stuff here and there which got it working.
re-added execution of MergeRuntime in config file and recreated blank screen.
Opened source files and main.js... next.js static chunk and saw that the eval got broken by the next-app-2 name:

Changing the name in the config file to a camelCase fixed the issue.
Could be good to add protection from this, or add documentation not to use that sort of app name (at least in the next.config.js)

not a valid variable... works as expected. You can set library type to window, instead of the default var which should make it work with dashed vars


add hardware-exporter

Hi,
I want to add the hardware-exporter so that someone can use it to deploy it . please kind solve it. many thanks!

I want to close this


Another way around having to pass in fn(_) { True } by default

Fixed via: https://github.com/JosephTLyons/persevero/commit/535a098b6499c86baceeae14ef7bc9d8eef5e5a0


OpenGl And Driver Support

Describe the project you are working on
A 3D First Person Horror game.
Describe the problem or limitation you are having in your project
My Pc and probably many others, have old or limited hardware which are mid in performance but lack due to the advanced vulkan renderer in godot which leads to Fps degrade, I got 30 fps on an empty scene in a laptop where I get 60+fps While running Games like Minecraft on high settings.
Describe the feature / enhancement and how it helps to overcome the problem or limitation
Adding a better support for open gl could help. Altough there is support for open gl right now, It lacks alot of performance optimizations and rendering features.
Describe how your proposal will work, with code, pseudo-code, mock-ups, and/or diagrams
My proposal works by making use of open gl renderer and other various optimizations and graphics features. Altough I am not able to provide a detailed way of making this nor do i have any idea about it, its just a proposal :)
If this enhancement will not be used often, can it be worked around with a few lines of script?
Yes
Is there a reason why this should be core and not an add-on in the asset library?
It is a good argument, but I dont think having better functionality should be in the asset library, It should be something the engine should come out of the box.
(extra){I made this post because I want to use redot for my game seeing how it is community driven and similar to godot. Even if this proposal feels unnecessary, at least optimizing the engine would be a enhancement as a lightweight game engine, the games made in it are expected to work in lower hardware.}

This isn't a proposal, proposals should submit some kind of plan, please don't ask to generically fix performance, that's not the point of the issue tracker, if we knew of ways to do so we would.


callback of hydraExpress.init is called 2 times

Hello,
I'm trying this sample, and the callback seems to be called 2 times (it displays 2 😀)
const hydraExpress = require('fwsp-hydra-express');
const config = require('./config.json');

hydraExpress.init(config, () => {
  console.log("😀")
  const express = hydraExpress.getExpress();
  const api = express.Router();

  api.get('/', function(req, res) {
    res.send({
      msg: `hello from ${hydra.getServiceName()} - ${hydra.getInstanceID()}`
    });
  });

  hydraExpress.registerRoutes({
    '': api
  });
});

@k33g thanks for the bug report. This should be fixed in<EMAIL_ADDRESS>

@cjus thx, it works fine 👍


Add support for class-level docstring

Hi! Awesome library.
Currently, stubdoc only supports adding docstring to functions and class methods.
https://github.com/simon-ritchie/stubdoc/blob/0e77e00e537e71482461b36b55983fd6e90c99e7/stubdoc/stubdoc.py#L37-L48
It would be great if it supported class-level docstrings as well as class getters and setters (@property).
Stub file with docstring generated by stubdoc:
class NamedNode:
    @property
    def value(self) -> str: ...
    def __init__(self, value: str) -> None:
        """
        Initialize self.  See help(type(self)) for accurate signature.
        """
    def __str__(self) -> str: ...
    def __repr__(self) -> str: ...
    def __hash__(self) -> int: ...
    def __eq__(self, other: Any) -> bool: ...
    def __ge__(self, other: Any) -> bool: ...
    def __gt__(self, other: Any) -> bool: ...
    def __le__(self, other: Any) -> bool: ...
    def __lt__(self, other: Any) -> bool: ...
    def __ne__(self, other: Any) -> bool: ...

Desired output:
class NamedNode:
    """An RDF `node identified by an IRI <https://www.w3.org/TR/rdf11-concepts/#dfn-iri>`_.

    :param value: the IRI as a string.
    :raises ValueError: if the IRI is not valid according to `RFC 3987 <https://tools.ietf.org/rfc/rfc3987>`_.

    The :py:func:`str` function provides a serialization compatible with N-Triples, Turtle, and SPARQL:

    >>> str(NamedNode('http://example.com'))
    '<http://example.com>'
    """
    @property
    def value(self) -> str:
        """the named node IRI.

        >>> NamedNode("http://example.com").value
        'http://example.com'
        """
    def __init__(self, value: str) -> None:
        """
        Initialize self.  See help(type(self)) for accurate signature.
        """
    def __str__(self) -> str: ...
    def __repr__(self) -> str: ...
    def __hash__(self) -> int: ...
    def __eq__(self, other: Any) -> bool: ...
    def __ge__(self, other: Any) -> bool: ...
    def __gt__(self, other: Any) -> bool: ...
    def __le__(self, other: Any) -> bool: ...
    def __lt__(self, other: Any) -> bool: ...
    def __ne__(self, other: Any) -> bool: ...

Hi @edmondchuc
Thanks for posting the nice proposal
Currently, I'm too busy and probably it takes a long time to support it
Please be patient to support its feature
P.S. If you favorite this project, please leave a star⭐
It motivate me to support this proposal

I've released the v0.1.11 and probably supported these features!
https://github.com/simon-ritchie/stubdoc/releases/tag/0.1.11
$ pip install stubdoc==0.1.11

If you notice this version does not work correctly, please notify me


Is there a way to disable /hide the legend?

i don't see a setting to disble/hide the legend, is there one?  Or is there a work-aroiund?

Thanks for flagging. I'll take time and dig up the solution for this.


python3Packages.discum: init at 1.4.1

Description of changes
Add https://github.com/Merubokkusu/Discord-S.C.U.M
Things done

Built on platform(s)

[ ] x86_64-linux
[x] aarch64-linux
[ ] x86_64-darwin
[x] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true
[x] with --sandbox flag

[x] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

This is a semi-automatic executed nixpkgs-review with nixpkgs-review-checks extension. It is checked by a human on a best effort basis and does not build all packages (e.g. lumo, tensorflow or pytorch).
Result of nixpkgs-review pr 330881 run on x86_64-linux 1

4 packages built:

python311Packages.discum
python311Packages.discum.dist
python312Packages.discum
python312Packages.discum.dist

This is a semi-automatic executed nixpkgs-review with nixpkgs-review-checks extension. It is checked by a human on a best effort basis and does not build all packages (e.g. lumo, tensorflow or pytorch).
Result of nixpkgs-review pr 330881 run on aarch64-darwin 1

4 packages built:

python311Packages.discum
python311Packages.discum.dist
python312Packages.discum
python312Packages.discum.dist


Fix styling of resource list in API Latency Time widget

Description:
In API Latency Time widget if there are a larger number of resources in the API, the resource listing will be too long. We can avoid this by either adding a scroll or an autocomplete.

This is fixed now. Hence closing.


The pregenerated data is not available

I am currently working on my project of stereo matching and find your work quite helpful. Can you share the pregenerated dataset? The original link is not available now.

Hi, I've updated the download link. Sorry about this.

Hi, I've updated the download link. Sorry about this.

Thanks


Add test cases for ignoring properties

The discussion in https://github.com/gregsdennis/json-everything/pull/296 seems to indicate that there should be some tests to ensure that the ignore attributes are read in correct order.

[JsonExclude] will override for schema generation, regardless of other properties present.
[JsonIgnore] will only be used to ignore properties when the condition is Condition= JsonIgnoreCondition.Always, [JsonIgnore(Condition= JsonIgnoreCondition.Never)], will not cause the property to be removed.

Nice.  Thanks for these!


Missing entry point named 'dnn_cuda_cudaDriverGetVersion' in DLL 'DlibDotNetNativeDnn'

I'm trying to run FaceRecognitionDotNet with Cuda, but I think it seems that I miss some dll files.
The following Exception occurs:
Unhandled Exception: System.EntryPointNotFoundException: Unable to find an entry point named 'dnn_cuda_cudaDriverGetVersion' in DLL 'DlibDotNetNativeDnn'.
at DlibDotNet.NativeMethods.dnn_cuda_cudaDriverGetVersion(Int32& version)
at DlibDotNet.Dnn.Cuda.ThrowCudaException(ErrorType error)
at DlibDotNet.Dnn.LossMmod.Operator[T](IEnumerable1 images, UInt64 batchSize)    at FaceRecognitionDotNet.Dlib.Python.CnnFaceDetectionModelV1.Detect(LossMmod net, Image image, Int32 upsampleNumTimes)    at FaceRecognitionDotNet.FaceRecognition.FaceLocations(Image image, Int32 numberOfTimesToUpsample, Model model)+MoveNext()    at FaceRecognitionDotNet.FaceRecognition.FaceEncodings(Image image, IEnumerable1 knownFaceLocation, Int32 numJitters)+MoveNext()
at System.Collections.Generic.List1.AddEnumerable(IEnumerable1 enumerable)
at System.Linq.Enumerable.ToList[TSource](IEnumerable`1 source)
at FaceDetection.GetDetections(String imageFilePath, FileType fileType, DetectionType detectionType)
at UseFaceDetection.Program.Main(String[] args) in C:\Users\Documents\FaceDetection\FaceDetection\Program.cs:line 45
I obtained the following dll files for cuda: cublas64_92.dll, cudnn64_7.dll, curand64_92.dll and cusolver64_92.dll. (Found in requirements at: https://nugetmusthaves.com/Package/DlibDotNet-WithCUDA)
I figure I am missing or using a wrong reference needed for DlibDotNetNativeDnn. Is there a list of needed Cuda libraries or anything else I might be missing?

I think it is looking for the wrong method? The function in my dll is: cuda_cudaDriverGetVersion instead of dnn_cuda_cudaDriverGetVersion

you are right.
but this problem is not what you failed to execute dll.
because what getcudaversion is called is that your apps faced to cuda error rather than dlibdotnet.
I'll fix it and you could get correct error information.