Exporter enters high CPU state and stops processing log lines

Issue observed with 0.26, 0.27 and source build from master on April 25.
I have configured 3 instances of grok_exporter on CentOS.  2 instances run without issue, but 1 will only export metrics for a few minutes before entering a high CPU state.  In high CPU state the exporter still responds to scrape requests.  The backlog is growing at 3-4 rows per second.  While operating normally, the "bad" instance grok_exporter_lines_processing_time_microseconds_total is < 500 µs, and this metric drops to 0 once the instance enters high cpu state.
What debug information can I collect to help investigate this issue?

Config for the instance that enters high CPU state
global:
config_version: 2
input:
type: file
path: /data/all_f5_asm_block.log
readall: false # Read from the beginning of the file? False means we start at the end of the file and read only new lines.
grok:
patterns_dir: /etc/grok/patterns
additional_patterns:
metrics:
- type: counter
name: bigp_asm_block
help: Count of ASM blocks by clientIP and URI
match: '%{SYSLOGTIMESTAMP:LoggedEventTime} %{HOSTNAME:instance} ASM:unit_hostname="%{HOSTNAME}",management_ip_address="%{IP:HostIP1}",management_ip_address_2="",http_class_name="%{PATH}",web_application_name="%{PATH:WebAppName}",policy_name="%{PATH}",policy_apply_date="%{TIMESTAMP_ISO8601}",violations="%{DATA:Violations}",support_id="%{INT}",request_status="%{DATA:Status}",response_code="%{INT}",ip_client="%{IP:ClientIP}",route_domain="%{DATA}",method="%{WORD}",protocol="%{WORD}",query_string="%{DATA}",x_forwarded_for_header_value="%{DATA}",sig_ids="%{DATA}",sig_names="%{DATA}",date_time="%{TIMESTAMP_ISO8601}",severity="%{LOGLEVEL:Severity}",attack_type="%{DATA:AttackType}",geo_location="%{DATA:GeoLocation}",ip_address_intelligence="%{DATA:IP_Intelligence}",username="%{DATA}",sub_violations="%{DATA:SubViolations}",%{DATA},uri="%{URIPATH:Uri}",%{GREEDYDATA}'
labels:
client_ip: '{{.ClientIP}}'
web_app_name: '{{.WebAppName}}'
status: '{{.Status}}'
severity: '{{.Severity}}'
attack_type: '{{.AttackType}}'
violations: '{{.Violations}}'
uri: '{{.Uri}}'
geo_location: '{{.GeoLocation}}'
ip_intelligence: '{{.IP_Intelligence}}'
server:
host: <IP_ADDRESS>
port: 9146

Screenshot of metrics for misbehaving service:

This sounds like a hard-to-find bug. There are two parts in grok_exporter: The first part handles file system events and reads log lines from log files, the second part does the pattern matching.
As a first step we need to find out which of those is the culprit. Could you configure poll_interval_seconds in your input section? This disables file system event processing and just reads the log files every n seconds. It has drawbacks and should not be necessary, but it could give us a hint. If this makes the problem go away, the error is likely in the file system event processing. If the problem is still there with this configuration, the problem is likely in pattern matching.

I'm seeing the same issue so I tried:

But the metric that generally fluctuates around 100-500 new entries per second, the total seems to be getting stalled.

I'd love to reproduce it. Could you post the match and an example line? Maybe if I write a small test that runs the line through the match 500 times/second I can reproduce it.

The logs are pretty large so I've included a subset (can't attach a file. Can upload elsewhere too):
Logs: https://justpaste.it/7i7qo
Patterns with lower than expected matches:
%{TIMESTAMP_ISO8601}\s+%{WORD}\s+xyz-tsdbd\[%{NUMBER}\]:\s+%{DATA}[Rr]eceived\s+new%{DATA}notif%{GREEDYDATA}
%{TIMESTAMP_ISO8601}\s+%{WORD}\s+xyz-tsdbd\[%{NUMBER}\]:\s+%{DATA}(([pP]rocessed%{DATA}notification)|(notification%{DATA}[Pp]rocessed))%{GREEDYDATA}
%{TIMESTAMP_ISO8601}\s+%{WORD}\s+xyz-tsdbd\[%{NUMBER}\]:\s+%{DATA}((dropp%{DATA}notification)|(notification%{DATA}dropp))%{GREEDYDATA}

I still cannot reproduce it. I created a config.yaml file with the matches above as match1, match2, and match3, and stdin as input type. Then I copied the log lines into logfile.log, and ran the following to generate traffic:
(while true ; do cat logfile.log ; sleep 0.001 ; done) | grok_exporter -config ./config.yaml

With the Prometheus query rate(match1[5m]) I can see the number of matches per second. This is around 1.2k for match1, 5.1k for match2, and 2.4k for match3. These values are almost constant, even though the throughput is much higher than the 500 entries / second in your experiment. I don't experience any significant changes or lost matches. Memory consumption of grok_exporter is constant.
Do you have any idea how I could reproduce the error?

I'm using file as input instead of stdin. Would you recommend using stdin?

No, I would not recommend it. It's just an easy way to run a quick test.
It would be interesting to know if the error persists with stdin. If switching to stdin solves the problem, then there must be a bug in the file input with poll_interval_seconds. Could you check that?

Set the input to stdin:

Used the command tail -f /var/log/messages | ./grok_exporter -config ./nae-grok-autogen.yaml >& /dev/null & to run the process and verified the exporter is running on remote device.
After seeing multiple the relevant log messages that should have matched, verified http://grokconstructor.appspot.com/do/match#result detects match on eatch one.
But the counter below still showed 0 count:
- help: count of incoming notifications in tsdbd
  match: '%{TIMESTAMP_ISO8601}\s+%{WORD}\s+xyz-tsdbd\[%{NUMBER}\]:\s+%{DATA}[Rr]eceived\s+new%{DATA}notif%{GREEDYDATA}'
  name: benchmark_tsdbd_incoming_notif_log
  type: counter

I have a fairly high number of counters and use summary metric types frequently as well. Could that have an impact on the matches?

If you see the error with tail -f /var/log/messages | ./grok_exporter... maybe you can find some example log messages, put them into an logfile.log file and reproduce the same error with (while true ; do cat logfile.log ; sleep 0.001 ; done) | grok_exporter....
Then you could attach the logfile.log file and your config.yaml here so I can reproduce the error on my machine.

logfile.log
config.txt
Unable to upload the config with the .yaml extension. Using .yaml during execution.

The log file is very small subset of the actual log

Thanks for the example files. grok_exporter uses the Oniguruma regular expression library for pattern matching. The grok_exporter release is statically linked to Oniguruma version 5.9.6. In your example, the benchmark_tsdbd_incoming_notif_log metric is 0 with the current grok_exporter release, but if I update Oniguruma to the current version 6.9.2 it works.
I will create a new release with an updated Oniguruma version, then you patterns should work. However, it will take two weeks.
In the meantime, you could either build grok_exporter from source using the latest Oniguruma library, or you refactor your patterns so that they work with Oniguruma 5.9.6. However, I cannot tell you exactly what's the breaking change between the two Oniguruma versions.

What are the commands to build the exporter with the latest library version on Ubuntu?

The release.sh script is used to build the official releases. The official releases use oniguruma version 5.9.6. If you want to build your own version from source code, you need to install go and gcc, and build grok_exporter with go install .. This is also described here: https://github.com/fstab/grok_exporter#how-to-build-from-source

The official golang golang:1.12.5 and golang:1.11.10 docker images already have go and gcc installed. From the errors I shared earlier, it appears the issue in related to the static linking even though Oniguruma release 6.9.2 installed correctly. Please see my steps above.

If you want to build with grok_exporter with your own Oniguruma version please run go install . and not ./release.sh.
You could have a look at the commands in .travis.yml for reference. This runs with every commit and builds grok_exporter with different combinations, Oniguruma 5.9.6 and 6.7.0, static and dynamic linking. Resuls are here: https://travis-ci.org/fstab/grok_exporter/
I currently have limited Internet so I cannot check what's in the golang Docker image. But I can make a release with an updated Oniguruma version next week.

Makes sense. It'll be easier for me to wait since I don't have permissions to the /usr/... directories on my machine. Appreciate it!

Sorry that it took so long, but I finally found the time to make rel 0.2.8. It uses Oniguruma 6.9.2.

I have installed 0.28 and am no longer seeing the issue.  Thank you for the fix!


go: add pkg level doc for context use

Adds a package-level comment regarding the use of context in client initialization & method invocation.
Fixes #2612
@jadekler can you give a +1 on the language. I copied it entirely, but tweaked things a tad.

@andreamlin not really sure what the circleci compute-discovery-test failure is. Any ideas? Or can it be ignored?

LGTM from me from the code repo perspective.

Codecov Report

Merging #2614 into master will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master    #2614   +/-   ##
=========================================
  Coverage     86.57%   86.57%
  Complexity     5501     5501
=========================================
  Files           465      465
  Lines         21959    21959
  Branches       2410     2410
=========================================
  Hits          19012    19012
  Misses         2094     2094
  Partials        853      853

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cfb0041...43e1a34. Read the comment docs.

@broady @jadekler FYI this change will be released today in artman 0.16.16


Print description of exit code at the end of test-packages

So humans can review it.

Yes please. What does 8 mean?


node monitoring dashboard

Hi, this official tutorial introduced a method for monitoring one node metrics, but what if I have multi nodes?
The dashboard needs a drop-down menu to select host. Something like

Otherwise, say I have 4 nodes, so I need 4x of those same dashboard:

I'm afraid that is both a complex request, and a niche one. Assumption is that whomever runs multiple nodes also has a DevOps engineers that work on monitoring and can modify our dashboards for their specific setup (our devops runs a whole different monitoring system, for example). And setups may be varied: multiple nodes on a single machine, multiple nodes on different machines, kubernetes, docker... Couple that with different node_exporter and machine metrics complexity for those scenarios and it would quickly get out of hand.
I am not rejecting the idea outright and might pick it up if boredom or necessity arises.
We would welcome someone else submitting the PR for it, as long as it doesn't interfere with or greatly complicates the default use case of one machine, one node setup.

I tried to add each host a tag(ip address) to differentiate them, but I found that it was not easy, each graphic needs to add the tag as a filter so that it can work. Without a deep understanding of those formula, you can't do it. So I raised it to you, who wrote these formulas can do it easier.
Btw, it's common to do so, check this sample grafana node_exporter the first snapshot.

Even for people who just have two node, they do need to duplicate the dashboard, not so friendly right?


Epic: Search if a person has eligible expungeable records

As a user
I would like to enter in a search name and/or date of birth.
so that I can see a list of eligible and non-eligible expungeable records.
Parent of #6, Parent of #7, Parent of #9, Parent of #10

@cameron2018 are you still working on this, or should I unassign it and open it up for someone else to work on?

@maxkwallace This will be complete when issue #9 is complete.


[youtube] Can't fetch video id's from some playlists

[x] I've verified and I assure that I'm running youtube-dl 2016.05.10

Before submitting an issue make sure you have:

[x] At least skimmed through README and most notably FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

[x] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

Working:
$ youtube-dl --yes-playlist --get-id https://www.youtube.com/watch?v=eVTXPUF4Oz4&list=RDeVTXPUF4Oz4
Not Working:
$ youtube-dl --yes-playlist --get-id 'https://www.youtube.com/watch?v=pdoIs1jZbCY&list=RDEMWmnt7jMTTO8Kol5fcLtm-g' --verbose
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'--yes-playlist', u'--get-id', u'https://www.youtube.com/watch?v=pdoIs1jZbCY&list=RDEMWmnt7jMTTO8Kol5fcLtm-g', u'--verbose']
[debug] Encodings: locale ANSI_X3.4-1968, fs ANSI_X3.4-1968, out ANSI_X3.4-1968, pref ANSI_X3.4-1968
[debug] youtube-dl version 2016.05.10
[debug] Python version 2.7.9 - Linux-2.6.32-43-pve-x86_64-with-debian-8.4
[debug] exe versions: ffmpeg N-79898-gaeefe01, ffprobe N-79898-gaeefe01
[debug] Proxy map: {}
ERROR: Kol5fcLtm-g: YouTube said: This video does not exist.
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 676, in extract_info
    ie_result = ie.extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 341, in extract
    return self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/youtube.py", line 1311, in _real_extract
    expected=True, video_id=video_id)
ExtractorError: Kol5fcLtm-g: YouTube said: This video does not exist.

Description of your issue and other information
If you try to fetch video id's from a YouTube playlist via youtube-dl --get-id <playlist> it works for some playlist and for some it doesn't.
Note: that the last 11 signs of working playlists ID's matches to a video inside the playlist, while it doesn't on non working playlists even though the latter playlist works on YouTube.

As seen from the log video Kol5fcLtm-g does not exist thus technically Kol5fcLtm-g is not a valid videos id. Use -i to skip such errors.

Oh, shame on me. I thought there was a problem with the playlist ID itself not just that he stopped because he couldn't get one video.


add crc to file meta store

What do these changes do?

Related issue number

Fixes #1725

Codecov Report

Merging #1726 (1e07bab) into main (85a70b8) will decrease coverage by 3.73%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main    #1726      +/-   ##
==========================================
- Coverage   44.01%   40.28%   -3.74%
==========================================
  Files          89       89
  Lines        9764     9764
==========================================
- Hits         4298     3933     -365
- Misses       5466     5831     +365

Impacted Files
Coverage Δ

python/graphscope/tests/unittest/test_java_app.py
0.00% <0.00%> (-100.00%)
:arrow_down:

python/graphscope/deploy/hosts/cluster.py
31.64% <0.00%> (-55.70%)
:arrow_down:

python/graphscope/analytical/app/java_app.py
24.24% <0.00%> (-44.95%)
:arrow_down:

python/graphscope/framework/utils.py
40.10% <0.00%> (-14.85%)
:arrow_down:

python/graphscope/framework/app.py
69.95% <0.00%> (-10.33%)
:arrow_down:

python/graphscope/framework/graph_schema.py
52.45% <0.00%> (-7.11%)
:arrow_down:

python/graphscope/tests/conftest.py
48.21% <0.00%> (-4.65%)
:arrow_down:

python/graphscope/client/rpc.py
86.11% <0.00%> (-3.71%)
:arrow_down:

python/graphscope/client/session.py
63.75% <0.00%> (-3.22%)
:arrow_down:

python/graphscope/analytical/udf/utils.py
36.17% <0.00%> (-3.20%)
:arrow_down:

... and 2 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 85a70b8...1e07bab. Read the comment docs.


Can we have ARM64 binary support please?

#Environment
Hardware
TuringPi Cluster with Raspberry PI 3+ compute modules.
Software
Ubuntu 18.04 and 20.04
Error
curl -L https://getenvoy.io/cli | sudo bash -s -- -b /usr/local/bin
% Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
Dload  Upload   Total   Spent    Left  Speed
100    93  100    93    0     0    123      0 --:--:-- --:--:-- --:--:--   123
100  9995  100  9995    0     0  11383      0 --:--:-- --:--:-- --:--:-- 11383
tetratelabs/getenvoy crit platform linux/arm64 is not supported.  Make sure this script is up-to-date and file request at https://github.com/tetratelabs/getenvoy/issues/new
Requested feature
Please provide arm64 support for the getenvoy application.

Linking #84 #82
Pretty keen for this too

If anyone knows how to run the pipeline for this project in order to produce an arm64 binary, or knows the barriers to doing so, I would be interested to hear them so that I can look into making it happen.

Actually I was able to check out this repo and build it for arm64, but this is the repo for the getenvoy utility itself.
I think this is the more appropriate repo: https://github.com/tetratelabs/getenvoy-package

Am happy to assist with creating a multi ARCH build script if this is what is needed. I use Consul in my demo's and it uses Envoy and I would like to have the ability to install and use it there if possible.

one thing we'd need to do with this is understand the impact for testing. We are currently using GitHub Actions for testing via e2e, and I'm not sure if it supports linux/arm64 yet (In other projects I had to use travis to test this for real and when can't use emulation which isn't great)

@codefromthecrypt Currently GitHub Actions(GHA) doesn't support linux/arm64 for now. One way is to prepare ARM instances on AWS as GHA self-hosted runner, and now I'm working on it.

cool. some hint is you can still build for other archs with amd64 I've used this before https://github.com/multiarch/qemu-user-static then it reduces the complexity as one docker builder can build everything. you can even fake the arch to test, but it is also nice to use travis or a self-hosted GH action to really test in e2e, so what you are doing sounds good!

@musaprg do we have any build of arm64 to try? the CLI can now support it.

I managed to solve the problem of getting an ARM binary by extracting it from the container that Lyft builds:
docker pull envoyproxy/envoy:v1.16.3
containerid=`docker create envoyproxy/envoy:v1.16.3`
docker cp $containerid:/usr/local/bin/envoy ./
docker rm $containerid

clever!

if someone doesn't mind throwing up an ubuntu+arm64 (and ideally also macos) tar.gz or tar.xz of envoy in a public dir, that would be helpful. I'll pick up tomorrow and integrate the CLI then we'll only be awaiting some long term repo.
The archive needs a base dir, it can be anything, but envoy-1.18.3 or similar would be fine. It needs to contain envoy-1.18.3/bin/envoy with execute bit.

https://github.com/tetratelabs/getenvoy/pull/250 is only awaiting a public tarball

@cetanu thanks for the tips. I can confirm that the latest binary will work on arm64. We still need to get a public URL for a real build, but luckily that can be done independent of binary changes. More details here https://github.com/codefromthecrypt/temprepo and this will stay open until we have a real tarball added to #250

added this issue to ask envoy to retain the binaries they already build https://github.com/envoyproxy/envoy/issues/16830

Thanks everyone I for one appreciate the efforts that are being done here.
Will there be an updated apt repo for the arm binaries?
I checked this morning again and there are only the AMD ones.

@lhaig so we aren't building any new platforms as we are transitioning upstream builds. Can you please thumbsup this? envoyproxy/envoy#16830
Meanwhile, I've verified that recent releases of getenvoy work with the binaries upstream builds (I extracted via docker)
export ENVOY_VERSIONS_URL=https://raw.githubusercontent.com/codefromthecrypt/temprepo/master/envoy-versions.json
getenvoy versions -a

As soon as there's a tarball published, we'll update the main json. I've been checking every day on this, and will definitely post back here immediately.


Disjunctive OR operation for facet & facet Filter

How to add multiple facets and facet Filters with AND/OR relations from android?

@sunit09 I think what you are looking for is the Index.searchDisjunctiveFacetingAsync() method.

Is it applicable for Android?

Well, this is the Android client.

1 more thing, setFacetFilters(List) accepts only List of Strings, then How can I add multiple OR operated filters?

For questions related to using the search engine, may I redirect you to our Support Center? You will find better reactivity there.
Issues in GitHub are primarily intended for bugs and feature requests.
Best regards,


Compatibility with three.js r85

Hi,
thanks for the great work. I'm trying to get react three renderer to work with the latest version of three.js r85 but encouter issues. The thing is, I'm not sure if those issues are due to compatibility with the latest library or if my code is broken.
My question is: Can you confirm the react three renderer works with r85 ? If not, do you plan an update any time soon ?
Thanks so much,
Alexander

#187

This should be fixed with https://github.com/toxicFork/react-three-renderer/releases/tag/v3.2.0 , please give it a go and reopen if it has not been resolved


Optimise table list rendering

Part of #2243

Use React.memo for getRow table method to avoid rerender for all table rows
Clean up DOM from Menus and Tooltips. Create specific html elements only on hover/click
Increase events buffer delay from 1s to 4s, which triggers table render less often

https://user-images.githubusercontent.com/9607060/160387267-52e64720-56d1-4a6b-8d48-4bf264cd3746.mov
CPU consumption is still high, the next step might be bindWatchEventsUpdater method optimisation https://github.com/lensapp/lens/compare/master...fix-big-cluster-table-freeze#diff-ac63bb8652e3d96654d31988d5d2fd31c10d780581a5d3852d19d7260d102c28R379. Currently it triggers bunch of array calculations each 4s. We can:

Convert ItemStore items to Maps instead of Arrays
Skip items manipulations for workloads not visible at current moment
Use separate CPU thread for these using Web Workers https://developer.mozilla.org/en-US/docs/Web/API/Web_Workers_API/Using_web_workers

Renamed PR since it's not fully fixing #2243

Considering to close this PR since it has changes from the different areas. Will create more precise PRs instead of this one. For instance - https://github.com/lensapp/lens/pull/5168


Simplified Publish

Prefer that there be a way a Document Source can publish simply using one DocumentReference. This DocumentReference would use attachment.data holding the data. The Document Recipient is allowed to breakout the .data into a Binary and change to .url (may simply be guidance).

when a SubmissionSet is needed by the recipient, it is derived off of the metadata in the DocumentReference

meaning there is no way to carry elements unique to SubmissionSet, (e.g. intended recipient)
there is no way to have metadata different than DocumentReference (submitter is the author)

no way for this to be a replacement
named option to be visible and hold conditions.

Likely could be supported by RESTful POST of the DocumentReference.

@oliveregger how do you think we should implement this? Should we
a. relax the requirements of ITI-65
b. crate another transaction ITI-??? that is this lesser version?
How would we handle the server capabilityStatement? Would we start adding in something that enables a client to understand the minimal requirements of the server? (This might be useful even today regarding minimal, comprehensive, unconntained, and xds-on-fhir.

make a new transaction

We would encourage consideration of an even more simplified transaction that allows a FHIR Document to be published without the DocumentReference. In our evaluation of MHD for Pan-Canadian Patient Summary - it was unclear if DocumentReference was necessitated for the benefit of XDS systems requiring the submission set metadata. See comment in #123 - if value of having a DocumentReference varies by implementer (and an operation is available to allow implementers the ability to generate the metadata they need after submission) then DocumentReference should be considered optional with avenues to submit FHIR Document alone


Let OKC-Sharp in at Prototek 01-04-2016 @11:15

Can someone with a badge pretty please let us in?

can you call jesse? @the-simian
if he can't, maybe ryan @rhoegg might have a card at the 404.

I'll be there
On Mon, Jan 4, 2016 at 10:15 AM, Amanda Harlin<EMAIL_ADDRESS>wrote:

can you call jesse? @the-simian https://github.com/the-simian
if he can't, maybe ryan @rhoegg https://github.com/rhoegg might have a
card at the 404.
—
Reply to this email directly or view it on GitHub
https://github.com/techlahoma/techlahoma/issues/70#issuecomment-168720832
.

YES!!! thank you ryan. you've been ridiculously accommodating this week
(like usual) :sparkles:
On Mon, Jan 4, 2016 at 10:29 AM, Ryan Hoegg<EMAIL_ADDRESS>wrote:

I'll be there
On Mon, Jan 4, 2016 at 10:15 AM, Amanda Harlin<EMAIL_ADDRESS>wrote:

can you call jesse? @the-simian https://github.com/the-simian
if he can't, maybe ryan @rhoegg https://github.com/rhoegg might have a
card at the 404.
—
Reply to this email directly or view it on GitHub
<
https://github.com/techlahoma/techlahoma/issues/70#issuecomment-168720832>
.

—
Reply to this email directly or view it on GitHub
https://github.com/techlahoma/techlahoma/issues/70#issuecomment-168724624
.


wordpress implementation: option to disable cdn.jsdelivr.net and load from local

Mediaelement is awesome but we should all be attempting to clean up external calls to simplify GDPR compliance, minimize privacy leaks, and reduce external serial dependencies where possible.
I apologize for my  limited understanding of the code, but it appears that only flv.js@latest and hls.js@latest would be loaded from jsdelivr.net, all else being sameDomain.  While I'd gather from the conditionals that this code would only be pulled to play an flv or hls video, not an every time condition, is there any way to add a "privacy paranoid" option to sameDomain these scripts as well?
Thanks!

Awesome!  Thanks!


no feeding Power to grid / charging in Mode 3 and in Mode 2

When going in ESS Mode 3 (EXTERNAL CONTROL)  and Mode ON and setting number.victron_vebus_l1_acpowersetpoint_228 to a positive value e.g. +500W or a negative Value -300W the Multiplus starts inverting/charging for a short time and then stops and is going to passthru.
When set a value +500W/-300W in Mode 2 (KEEP_CHARGED) in number.victron_settings_ess_acpowersetpoint_0 the Multiplus does nothing.
What am i doing wrong? I just want to set a target value to make the Multiplus inverting/charging
Setup:
Intervall is set to 10s, Multiplus is only connected to AC-in and Battery 48V, no energy meter connected, no BMS,
Gateway: v3.41, VE.Bus:  552, Unit-ID: 228, 100

You need to resend number.victron_vebus_l1_acpowersetpoint_228 once In A Minute fore safety reasons


Accept Python 3.6.12

The latest version of the lib is working for me with Python 3.6.12, but I had to install it manually because pip refused to do so.
This is more to start a debate on what the minimum requirement can (and should) be.

Closing because Python 3.6 has reached end-of-life.


[DUOS-374][risk=no] Updates from dacManagement branch

Addresses
https://broadinstitute.atlassian.net/browse/DUOS-374
This PR pulls out the small changes in the dacManagement branch that are unrelated to DAC or Dataset management.
Changes
Icon Changes
Edit vs Add:

User Role Changes
Edit vs Add:

Note: Holding off on this until the DAC Member Management stuff is complete since this will  remove some currently used role management functions.

Will address elements of this in separate PRs.


Remove bad shorteners from default shorteners file

There were 2 shortener domains without extension.
Removed the following domains:

to
tk

This was causing domains like 'www.whale.to' to be matched with the domain regex.

This justifies a bugfix release.

.tk is genuinely a shortener where you can register a top-level domain to redirect to another URL.
I'm not sure about .to though which came from the (currently unavailable) LongURL list.

Is the to the same as https://anon.to/ ?
If it is, then we should add anon.to, rather than to.
I didn't know about the .tk one - sorry about that.

I've also find this: http://bit.do/list-of-url-shorteners.php
And it looks like there's a u.to too.

Let's remove the bare .to and maybe update the list with any missing from http://bit.do/list-of-url-shorteners.php and http://www.hongkiat.com/blog/url-shortening-services-the-ultimate-list/?

sure - on it!

The list is now updated.
I've also changed the commit message, to reflect the change.

@ascastro sorry, could you insert them in alphabetic order?

@jbilbo done.


cargo dependency subcommands

Hi,
I had a few ideas for new cargo commands, I think they're fairly self explanatory:
cargo dependency add nickel --git https://github.com/nickel-org/nickel.rs.git

cargo dependency rm nickel

cargo dependency lint
Checks for unused dependencies, out-of-date dependencies, etc.

Thoughts?

I think https://github.com/killercup/cargo-edit serves this quite well!

https://github.com/rust-lang/cargo/issues/1917
https://github.com/rust-lang/cargo/issues/2179
https://github.com/rust-lang/cargo/issues/4
https://github.com/rust-lang/cargo/issues/5586
https://github.com/rust-lang/cargo/issues/6457
https://github.com/rust-lang/cargo/issues/6488
https://github.com/rust-lang/cargo/issues/651
https://github.com/rust-lang/cargo/pull/5611


Remove storing of original spreadsheet and spreadsheet with updates

Since we now support downloading spreadsheets from data in Ingest, we could remove storing of original and succeeding spreadsheets submitted in ingest.

we need to check with @clairerye if we don't want to store the spreadsheets being uploaded by the user


Reworks acceptance tests

Beaker tests are working now and even return 0 :)
Some of the providers tests are skipped or commented out since they keep failing.

Looks good. You need to rebase then @rwaffen can merge this into master.


BE: REC invalid on iOS but valid on Android

As reported by RKlaus-tsi: recovery statement is not valid yet
https://github.com/mkubicek-dtc/dcc-quality-assurance/blob/2d0c3bd3289b7dfc0b4186a22d9d1b1d2c405fd2/BE/1.0.1/REC.png

Retest on 2021-06-24: Works on Android and iOS


AttributeError: 'list' object has no attribute 'T'

您好！
I came across your excellent paper as submitted and posted in the APS journal （Februrary 2023）.
I am trying to use your code to re-duplicate the results achieved using the 'divide-and-conquer` strategy for a 100-vertex MaxCut problem.
Thus, I have cloned this repository, installed all dependencies, and then typed python qaoa_in_qaqa to run the algorithm.
However, the program fails with the error:
File "C:\Users\robli\projects\python\qaoa_in_qaqa\qaoa_square.py", line 82, in <module>
    value, sols = qaoa_square(data_path=data_path, depth=1, sub_size=10)
  File "C:\Users\robli\projects\python\qaoa_in_qaqa\qaoa_square.py", line 43, in qaoa_square
    ret = qaoa(H_sub,const=const_temp,n_layers=depth,sample_method='max')
  File "C:\Users\robli\projects\python\qaoa_in_qaqa\QAOA.py", line 103, in qaoa
    for x in samples.T:
AttributeError: 'list' object has no attribute 'T'

Can you please help me to understand why this error is being returned? samples appears to be a list of arrays, therefore, what is the attribute T referring to?
Thanks/ 谢谢，
Rob

Actually, I was able to solve this issue by converting the samples list to an array using the np.array(samples) command.
After doing so, the transpose T method worked perfectly and the error went away.
Please let me know if you'd like for me to open a pull request for this. Otherwise, please feel free to close this issue.
Thank you,


Error : The provided query had no properties marked searchable

Hi Chris,
I receive below error message when I try to run "http://<IP_ADDRESS>:8000/odata/Assets?$search=ext"

Any ideas what might be wrong here?
Thanks,
Ozgur

Hiya, this was another area that wasn't well documented, but I have created this page now that should help: https://lodata.io/modelling/search.html
Basically, you have to tell Lodata which properties are suitable for searching using a snippet like this, if you wanted to make Lodata's search look at the "description" property of your "Asset" type. You can make multiple properties searchable if you like.
$assetType = Lodata::getEntityType('Asset');
$assetType->getProperty('description')->setSearchable();

Hiya, this was another area that wasn't well documented, but I have created this page now that should help: https://lodata.io/modelling/search.html
Basically, you have to tell Lodata which properties are suitable for searching using a snippet like this, if you wanted to make Lodata's search look at the "description" property of your "Asset" type. You can make multiple properties searchable if you like.
$assetType = Lodata::getEntityType('Asset');
$assetType->getProperty('description')->setSearchable();


Request: Snap to certain degrees

Hi!
I don't if it is possible to do it with this plugin, if you will implement it or if I have to manually modify the source code, but what I'm looking for is a way to configure a start degrees and an end degrees values to allow rotation from 3º to 356º (for example), but if it arrives to 0º, rotate to 0º.
This could be usefull if you don't want that the user that will rotate the element has to extrictly rotate the element to 0º. E.g.: when 356º is reached, prevent rotation until it arrives to 0º. If 0º is reached, rotate element to 0º and prevent rotation until it goes again to 3º or 356º. Even if you set step: 1 and snap: true it would be a good implementation, so they can't miss to "reset" the rotation.
Thanks in advance.
Regards,
Daglimioux.

This is doable with step: 1 and snap: true (although step: 2 probably works better)


Exported Data is corrupted

I was transferring my offline save to my computer from Android, and when I try to import the data on Windows it says the data is corrupted. Even though it will not let me import the data, if I select import run history it lets me imports my save file's run history. I double checked that I selected "Export Data" on Android but I am still having this issue. My android save is from an older version of pokerogue - I think the update that they did in late August or the one after that- if there are any known issues with importing save data to newer versions from then.

I think I am running into a different issue but with the same cause.
I run the offline version of the game in Windows offline mode, and updated the game after months of not updating it (via the "Download latest files for offline" option). Now the game will not load in offline mode past the "pagefault games" screen.
I fear my game save may just be too old that there is no way to salvage it for the updated versions of the game. I guess that is just the risk of playing the game in offline mode.


Support for tuples

Fixes #68.
This was way easier than I expected, so I guess there must be many things missing 😄 I'll add some inline comments below.
Side note: I find the codebase to be really beautiful ✨  and I'm quite enjoying its discovery. What a delight to see how building on top of recursive types can lead to such a modular architecture!!

Thanks for the review! I have added the TS tests, and removed the unneeded lambda with typ param.

Should tuples be emitted like immutable arrays?

They’re immutable on the Reason side so I’d say yes.

I have done a bit of research, and immutable tuples seem to have very bad support at the moment in both Flow and TypeScript.
In Flow, there is no way to mark a tuple or its inner types as immutable. $ReadOnly can only be used in objects, and adding + decorators only works for object fields. See related: https://github.com/facebook/flow/issues/4509.
In TypeScript, wrapping the tuple with Readonly seems to be valid syntactically, but it has very little effect in the final result:
let tuple: Readonly<[string, number]> = ['text', 3];

tuple[0] = 'new text'; // TS says: "All good!"
tuple.shift(); // Can remove elements from the tuple, even if it's read-only
let a: string = tuple[0]; // Type checks, but it'll be a number at runtime

Playground.
I don't really understand the purpose of Readonly in this case. 😕
Considering this, I wonder if it's more appropriate to just leave tuples as they are, just to make more explicit they are mutable, to reflect better these limitations.

can we just re-use everything done for the array type?

I thought about this. I'm not sure there are many things to reuse.
At the type definition level, TS syntax for tuples ([one, two]) is different than arrays (string[]), where the brackets go at the end. Flow syntax for arrays and tuples with brackets is the same, so in this case it could be reused. But considering how the Flow emitters for arrays are currently using the $ReadOnlyArray<> syntax, then this case would not allow for reusability either.
At the converter levels, arrays and tuples are different, with the first using map and the second being able to expand the array inline.
So in practice there seem to be different constraints for both cases, but I could explore trying to unify them more if you think it's worth it.

TS has to is peculiar about naming types. Worth adding the examples.

I added the Tuple.re tests to the TypeScript example, and I'm actually getting some errors, but I think they are not related to this addition.
The type couple gets converted to an abstract class and this causes a few issues:

tslint warns that a class must be named with pascal case
but more importantly, the functions that return or accept a value of type couple fail to type check because "Property 'opaque' is missing in type '{ name: any; age: any; }[]".

Do you have any pointers? I think in this case couple shouldn't be abstract / opaque 🤔
Thanks again!

Thanks for digging, this is great info! OK so it looks like immutability for tuples falls into the high investment low return category, and can be dropped.
couple sounds like the newly introduced tuple types are considered opaque. There's some pattern matching case analysis to decide what types are opaque, and this is probably a case of tuples missing from there.

Wrong guess. You've handled the code for checking what's opaque.

OK it was not far off. It's this line:
| Ident(_) => !(typ == booleanT || typ == numberT || typ == stringT)

meaning that any other compound of a tuple than those would be considered opaque.
So pre-existing.
Would you comment-out the example that triggers this. We can merge this, and I'll look into that separately.

@cristianoc Done! 🙂

So good. Thank you so much for this.


AOS Modify to allow element to disappear when not in viewport regardless of above or below

We all know once  an aos element is visible in the viewport the aos-animate class is given and the element animates, and when you scroll back up and it leaves the viewport the class is removed. I'd like to also include that if you scroll below, it also disappears so regardless of what direction you scroll in, once the element leaves the viewport the aos-animate class is removed. I can't find any helpful or working solution including a data attribute to make this work. Any ideas?

Have you been able to resolve this issue? I'm having a same problem it animates only when I'm scrolling down however when I scroll up it stays static.

Use the aos 3.0 beta, the feature isn't supported in the latest release version (pretty sure it's 2.3.1). Then just add the attribute data-aos-mirror="true" and it should work perfectly. Obviously using a beta version could cause problems, but I haven't encountered any or other major changes while using it.


Handle 404 responses for txs queue and history

Closes #1906.

I tried creating several safes and checking the Queue and History tabs and it never showed the infinite loading icon
Another way to reproduce it was creating a tx with a safe that only needs 1 owner's signature and cancelling the MM popUp when it showed up. The loading icon didn't show up in the queue tab either.
LGTM


Resolution issue with swift-crypto package

Hello
When I add any of the 5.0.0 versions of the soto-cognito-authenticate-kit package and any 1.0.0 webauthn-swift package to my package manager there is a resolution issue between both packages over the versions of swift-crypto they use.
This is what my package manager package entries look like.
.package(url: "https://github.com/adam-fowler/soto-cognito-authentication-kit.git", from: "5.0.0-beta.1"),
.package(url: "https://github.com/swift-server/webauthn-swift.git", from: "1.0.0-alpha.2"),
If I only have soto-cognito-authentication-kit 5.0.0 alpha or beta in my package manager then swift-crypto resolves in my Package.resolved folder as version: 1.1.7
If I only have webauthn-swift 1.0.0-alpha.1 or 1.0.0-alpha.2 in my package manager then swift-crypto resolves to version: 3.4.0 in my Package.resolved folder. This is the latest version of swift-crypto.
I did a 3rd test where I had omitted soto-cognito-authenticatio-kit from my package manager but kept in webauthn-swift and added other packages from vapor, hummingbird and the base soto package. The resulting swift-crypto version was 2.5.0 in my Package.resolved folder.
It seems like there might be a disconnect between the highest version of the swift-crypto package that soto-cognito-authentication-kit allows and the lowest version of the swift-crypto package that webauthn-swift allows which is at the heart of this resolution issue.
I'm using VSCode and this is the error I get.
error: Dependencies could not be resolved because root depends on 'webauthn-swift' 1.0.0-alpha.2..<2.0.0 and root depends on 'soto-cognito-authentication-kit' 4.1.1..<5.0.0-beta.1.
'soto-cognito-authentication-kit' is incompatible with 'webauthn-swift' because 'webauthn-swift' 1.0.0-alpha.2 depends on 'swift-crypto' 2.0.0..<4.0.0 and no versions of 'webauthn-swift' match the requirement 1.0.0-alpha.2.0..<2.0.0.
'soto-cognito-authentication-kit' 4.1.1..<5.0.0-beta.1 practically depends on 'swift-crypto' 1.0.0..<2.0.0 because 'soto-cognito-authentication-kit' 5.0.0-alpha.1 depends on 'swift-crypto' 1.0.0..<2.0.0.
'soto-cognito-authentication-kit' {4.1.1..<5.0.0-alpha.1, 5.0.0-alpha.1.0..<5.0.0-beta.1} practically depends on 'swift-crypto' 1.0.0..<2.0.0 because no versions of 'soto-cognito-authentication-kit' match the requirement {4.1.2..<5.0.0-alpha.1, 5.0.0-alpha.1.0..<5.0.0-beta.1} and 'soto-cognito-authentication-kit' 4.1.1 depends on 'swift-crypto' 1.0.0..<2.0.0.

The 5.0.0 release candidate I just released should fix this for you


Chores and fixes missing settings on user session

What type of Pull Request is this?

Bug fix
Code style update (formatting, renaming)
Other (please describe):

Documentation updates to install playwright exe's for first timers and not overwrite .env.example.
What is the current behavior?

After setup and launching and signing up for the first time with my Google account, the settings were missing from the user object from the createUser event. I could replicate a few times, but required a DROP DATABASE. I could fix it by explicitly adding the created settings to the session user (perhaps there is a race condition?).
Another thought that might require an issue: what if the Prisma insert fails for the User settings?
Issue Number: N/A
What is the new behavior?

Docs updated
Add user settings to session user explicitly
Add hint to use project TS server (VSCode far ahead and brings new type errors)
Rename test for consistency

Other information
☀

@w3cj I made this a draft PR as I'm not entirely sure if the session fix is an actual fix. The assumption is that Authjs is returning the same user that is being passed to createUser when calling session(). After inspecting docker logs though it seems that it could also be an issue that occurred in the migrate:
listd-db-1     | 2023-04-29 05:05:28.394 UTC [81] ERROR:  insert or update on table "UserSettings" violates foreign key constraint "UserSettings_localeId_fkey"

I think the safest would be to wrap the userSettings create call in a trycatch since there could be database errors and this is required info on the session, breaking the app for the user until a manual create is run again. If the create throws, you could revert the user insert? Or stop the account creation in linkAccount event. 🤔


IOS page-router-outlet issue after modal close

Which platform(s) does your issue occur on?

iOS
simulator and device. In both

Please, provide the following version numbers that your issue occurs with:
Here is code
when we add code with <page-router-outlet></page-router-outlet>
and with using modal after closing modal it make height of  to full rather it shuld be *
<StackLayout> 	<GridLayout [rows]="'*,auto'" columns="*"> 		<StackLayout> 			<page-router-outlet></page-router-outlet> 		</StackLayout> 		<StackLayout row="1" > 			<Tabs></Tabs> 		</StackLayout> 	</GridLayout> </StackLayout>
https://play.nativescript.org/?template=play-ng&id=OjBpET&v=9

The above issue happens only in iOS, when the view container ref is not a root view / a page from root frame.
Passing the view container ref injected via app component resolves the scroll issue for now.
https://play.nativescript.org/?template=play-ng&id=OjBpET&v=10


How to avoid the automatic number convertion for example

Hi,
I noticed that if I give a  number in an ApiModelProperty's example, this one will be automatically converted into a number type in the swagger document ( despite the returned type of the function), which will result as a number in the Swagger ui.
Although this is handy in some case, is there a way to enforce the example type as a String?
For example:
@ApiModelProperty(value = "An id, for ", example = "6789") String getId() {      ... }
This will result in a json document looking like this
    ....    "id": 6789,     ....
Now assuming that I want all of my id to be treated as String ( even if they could be a number ). Is there a way to avoid the automatic conversion and get this Json document :
    ....    "id": "6789",     ....
version: 2.8.0
Many thanks

'api-docs' seems to be misformed.
If I test a example with "numeric example", example of property parsed as number
It may be hard to enforce example types as string.
properties": {
  "key": {
    "type": "string",
    "example": 173,
    "description": "test key",
    "allowEmptyValue": false
  }
}

@thelo-gaultier @nobe0716 I think it needs to be escaped for it to be a string. For e.g. if you intended it to be a string it should be  ... example = "'6789'"

In this case, I get "example": "'1234'" in the swagger file, and "id": "'1234'" in the swagger ui

Let me investigate

I have the similar problem with recent versions. Even though, example value for string property is double quoted integer value, it is parsed into integer value. If I surround first with single quote then double quotes, it works. Here are the cases :
stringIntProperty:
  minLength: 4
  maxLength: 10
  pattern: ^(?!\s*$).+
  type: string
  example: "12345"

--> becomes {..., "stringIntProperty": 12345, ... } on Swagger UI, and @ApiModelProperty(example = "12345", required = true, value = "") in generated Java class.
stringIntProperty:
  minLength: 4
  maxLength: 10
  pattern: ^(?!\s*$).+
  type: string
  example: "'12345'"

--> becomes {..., "stringIntProperty": "12345", ... } on Swagger UI, and   @ApiModelProperty(example = "'12345'", required = true, value = "") in generated Java class.
Springfox v.2.9.2
OpenAPI generator v4.1.0

It would be better if it could recognize the type in the filed definition and convert it according to the type.


Display rewards history

Ok guys we are now at 3.2 and the linux built in autoupdater still not working this is unacceptable. Always failed to download blah blah do it manually please fix this. Since we dealing with a critical financial software here the wallet itself should do the signature verification on each and every update.
Here are some future ideas:
-The number of ADA overall should be copy pastable
-The number of staking rewards (at least the last 10 epochs) should be displayed in a table with the stake pool name so we can track the exact amount of rewards per epoch. Right now it is just an overall reward what you made.

Hi @feraldruid22,
Thank you for the feedback!

Ok guys we are now at 3.2 and the linux built in autoupdater still not working this is unacceptable. Always failed to download blah blah do it manually please fix this. Since we dealing with a critical financial software here the wallet itself should do the signature verification on each and every update.

There is a known issue with the autoupdater which is currently being worked on.
The issue affects users that are more than 1 version behind, while it works 100% on the N -> N+1 case (e.g. updating from 3.1.0 to 3.2.0 works flawlessly). If you regularly update Daedalus you won't even notice the issue.
We are sorry for the inconvenience and we are doing our best to fix this issue ASAP.

-The number of ADA overall should be copy pastable

Can you please expand on this? Which value should be copy/pastable? I would like to understand which ADA values you find not to be copy/pastable as they should all be copy/pastable by default...

-The number of staking rewards (at least the last 10 epochs) should be displayed in a table with the stake pool name so we can track the exact amount of rewards per epoch. Right now it is just an overall reward what you made.

This is indeed a long-missing feature... Unfortunately, it is not something we (Daedalus team) can implement without it first being made available on the cardano-wallet (Adrestia team) component as Daedalus UI depends on the cardano-wallet API. We have the UI already built to support this and we will enable it as soon as we get the API to support it.
To learn more about Daedalus architecture, please refer to the following architecture overview:

@feraldruid22 please expand on this:

-The number of ADA overall should be copy pastable

...I am not sure I understand the issue.

Unfortunately cardano-wallet isn't able to implement this feature either (via https://github.com/input-output-hk/cardano-wallet/issues/2547#issuecomment-789562114).
So could we get this data via cardano explorer RESTful API when the explorer supports the feature?

That is indeed our plan @JasinYip!
We will soon start working on it. Will keep you updated here in the thread!
Thanks for the patience 🙏

I've only just been staking long enough to receive two rewards payouts, and I was pretty shocked to see the rewards received per epoch is not available. I live in Canada and my (very limited) understanding of our tax laws is that each rewards payout is a taxable event (so if I receive 1 ADA as a reward for staking, it would be treated as capital gains based on the value of that 1 ADA at the time I received the staking reward). Perhaps my understanding is incorrect (crypto and taxes still feels like the wild west). But I think this information is absolutely critical, whether or not it's required for tax compliance.

This is required for USA tax purposes as well.  Every reward gained is considered regular income, so I would love to have the following: A history of each reward and associated timestamp as well as the approximate value in fiat (based on user's chosen fiat) at the time of reward.  Then a simple export lets us sum up the fiat column and report it to our favorite folks at the IRS.

Really, more reporting around tax purposes would be really useful. Sending some ada could show approximate value at the time of the transaction, with a statement of the value difference from when that ADA was deposited (using first-in-first-out)

@HartS @Danation Currently we can use some blockchain explorer like adapools.org to see rewards every single epoch for our address. You can search your staking address (starts with stake) to see it, or you can check out the delegator list in the stake pool you staked and find out your address to  see it as well.
This feature requeest issue is more like an user experience improvment.

I mean Daedalus is really just a user experience improvement as well. After all, we can generate our own wallet addresses, manage them, and send all the necessary transactions through https://github.com/input-output-hk/cardano-node/ right?
I only intended that to be half as snarky as it sounds. In reality, not having this functionality makes Cardano inaccessible to the majority of people who live in the jurisdiction of a sophisticated tax authority, or invites issues down the line. Daedalus makes it really easy to stake, and that's amazing! But if it makes it easy to stake and hard to comply with local tax regulations, people are going to get bitten by this, and policy-makers will look less favourably on Cardano as well.

@HartS Totally agree with you

@HartS Daedalus is not omitting this feature nor any other feature for that matter.
This data is not available via cardano-wallet API, which is the single source of truth for us as Daedalus is a full-node wallet. We understand the importance of having this feature and the team is working on it. In order to get this information, one has to use explorer-like deployment (e.g. cardano-db-sync) which is not what cardano-node delivered as a part of Daedalus does. We are now working on a solution which will allow us to fetch the required data which we will then use to populate our already existing UI built for this very purpose.
Thank you for the patience!

@nikolaglumac thank you for your work on Daedalus. I think you've misunderstood me. This is a feature which Daedalus currently does not support. Hence, it is omitted. Any unsupported feature is omitted. I wasn't implying that Daedalus was ignoring or had decided against the feature.

All good @HartS! We are on the same page.
I want you to know that we are fully aware of the importance of this feature.
The team will add it as soon as humanly possible.
Thanks for the support and patience 🙏

Emurgo's Yoroi wallet shows rewards per epoch. How did they implement it?

Yoroi is a light-wallet which consumes external centralized Api which runs connected to a cardano-node which is always online and thus it is able to provide all of the historical data. Daedalus is a full-node wallet and we can not get this data from the cardano-wallet Api. However, we have decided to fetch it from an external source and it is being implemented in the scope of the following task: https://github.com/input-output-hk/daedalus/pull/2572
We should have it released in one of the upcoming Daedalus releases.
Thanks for the patience 🙏

That's a great news

Fantastic! Thank you for your work!

Very exciting! Thank you @nikolaglumac . Does this mean a node has to be always-on in order to  determine rewards payouts? Or is it just that the IPC API between Daedalus and the node is only sufficient to get balances, regular withdrawals/deposits, etc.

@HartS the data isn't getting collected and thus there is nothing to be served via the Api.
In order to get that you would need to use cardano-db-sync service which is what Yoroi does. We have decided to combine it with what Daedalus gets from the cardano-wallet API to offer our users the best of both worlds 🚀

For anyone looking for a simple, clean way to get a per-epoch staking rewards breakdown while we wait for this feature to make it into Daedalus, a web tool that just launched makes this information really accessible; if you enter your staking key you'll get a great breakdown of rewards per epoch:
example with a random stake key chosen:
https://www.cardanoworld.io/stake-key/stake1u9xdm6m88jadl8yuvlm5faea0mdkauf3myfcguh47e39zpgw9h5w4

@HartS
Useless if the authors keep requiring to stake with their pool to get more than 5 items.
Not in the spirit of openness. This sheds really bad light on the casch pool. I’d never stake with them after seeing this business model.
I rather use adapools.org instead.

@LeoniePhiline  I agree, an open source solution is ideal. But I don't believe the authors require you to stake with them... I see the full history of rewards and I don't stake with them

@HartS You see the history of rewards without fiat currency counter value.
If you want that, you have to select a currency (EUR/USD) in the top center. You won’t get a useful CSV, but a useless PDF with a huge diagonal watermark and only five epochs’ rewards unless you stake with them.
Honestly I find that a little appalling.

Use pooltool.io – they have the same feature and you can easily export the data. Also I think no ads as far as I can tell.

@HartS

Does this mean a node has to be always-on in order to determine rewards payouts?

So the ledger does not track the transactions made to the rewards accounts and if no one permanently tracked the blockchain states you couldn't get this data? I guess that somehow was the purpose, otherwise we'd have millions of transactions around the epoch boundary.


imapDisconnected always connection getting disconnected.

after uploading to the firebase , i am getting below error in firebase console
Error: getaddrinfo ENOTFOUND imap.gmail.com imap.gmail.com:993
at errnoException (dns.js:28:10)
at GetAddrInfoReqWrap.onlookup [as oncomplete] (dns.js:76:26)
code: 'ENOTFOUND',
errno: 'ENOTFOUND',
syscall: 'getaddrinfo',
hostname: 'imap.gmail.com',
host: 'imap.gmail.com',
port: 993,
source: 'socket'

+1

I run into the same error and found my host is set to ' imap.gmail.com' with extra space.
maybe you can check the host again


Make Error; unable to compile required .c file

I was able to get around this error by modifying CMakeLists.txt to remove CXX from the project line. Not sure if this is a generic fix, so opening as an issue.
$ diff CMakeLists.txt CMakeLists.bkup
5c5
< project (pizzly)
---
> project (pizzly CXX)

Here is the error from the command line
$ cmake ../
-- The CXX compiler identification is GNU 4.9.2
-- Check for working CXX compiler: /source/gcc/4.9.2/bin/c++
-- Check for working CXX compiler: /source/gcc/4.9.2/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Found ZLIB: /usr/lib64/libz.so (found version "1.2.3")
-- Looking for include file pthread.h
CMake Error at /apps/source/cmake/3.0.2/share/cmake-3.0/Modules/CheckIncludeFiles.cmake:70 (try_compile):
  Unknown extension ".c" for file

    /<dir>/pizzly/build/CMakeFiles/CMakeTmp/CheckIncludeFiles.c

  try_compile() works only for enabled languages.  Currently these are:

    CXX

  See project() command to enable other languages.
Call Stack (most recent call first):
  /apps/source/cmake/3.0.2/share/cmake-3.0/Modules/FindThreads.cmake:51 (CHECK_INCLUDE_FILES)
  CMakeLists.txt:13 (find_package)

-- Looking for include file pthread.h - not found
CMake Error at /apps/source/cmake/3.0.2/share/cmake-3.0/Modules/FindPackageHandleStandardArgs.cmake:136 (message):
  Could NOT find Threads (missing: Threads_FOUND)
Call Stack (most recent call first):
  /apps/source/cmake/3.0.2/share/cmake-3.0/Modules/FindPackageHandleStandardArgs.cmake:343 (_FPHSA_FAILURE_MESSAGE)
  /apps/source/cmake/3.0.2/share/cmake-3.0/Modules/FindThreads.cmake:178 (FIND_PACKAGE_HANDLE_STANDARD_ARGS)
  CMakeLists.txt:13 (find_package)

-- Configuring incomplete, errors occurred!
See also "/data/rivera/sowmya/software/pizzly/build/CMakeFiles/CMakeOutput.log".
See also "/data/rivera/sowmya/software/pizzly/build/CMakeFiles/CMakeError.log".

Thanks for filing this I haven't seen this but seems like a common problem, http://www.grokit.ca/cnt/CMakeProblemsSolutions/


[Angular + Apollo + Tailwind] Convert Redirect Component to Auth Guard

More of a won't do than block because our OAuth solution works as intended for now.

@BrettZeidler confirm this ticket is good and close if it is please

Closing as won't do.


Add handwritten code for process call to template interface.

Also fix the processor interface signature for check and quota templates.
The hand written generated code inside template.gen.go (that now does instance creation and dispatch to adapter process calls) will be consumed from new aspectManagers (To be implemented in the next PRs.)

This change is

Jenkins job mixer/presubmit passed

Jenkins job mixer/pilot-regression passed

Jenkins rebuild mixer/e2e-smoketest

Jenkins job mixer/e2e-smoketest passed


New Player select menu

Players join a round table playing poker

Robots don't understand what they're doing, holds cards upside down and wrong direction

4 empty seats, A player pops into a chair when input is joined


test: pod remove test fixes

Remove test storage class and pending items.
Make test independent of number of nodes.
Reduce number replicas in test 3->2
Remove local-only tests.
Use logf to output progress

Please add AfterEach clauses for each test, move cleanup from AfterSuite to AfterEach clauses and invoke AfterEachCheck ( if appropriate )

Now done.

Please add AfterEach clauses for each test, move cleanup from AfterSuite to AfterEach clauses and invoke AfterEachCheck ( if appropriate )

Now done.

bors merge

bors merge

bors merge

bors merge

bors merge

bors merge


Nested left navigation for tasks menu.

Need to create a nested navigation for the Admin as per the UX design.
https://redhat.invisionapp.com/share/6T900V2ZX#/screens/198651332

The changes are merged in develop branch.


BIDS Governance amendment proposals: Up for vote in autumn 2023

The BIDS maintainers and steering groups propose several amendments to the BIDS governance.
The reasoning and proposed amendments are listed in this Google Document:

https://docs.google.com/document/d/18PpfSgcHckqejTZsRZlEDlJ_yD3JiwSQ8kCjVXorg6U/edit?usp=sharing

Comments and suggestions by the community are welcome.
The current plan is to work on the amendments until the next steering group election in autumn, and then to collectively put them to a vote when a new steering group member is elected as well.
Open questions:

How will this be put to a vote?

Same format as how a new steering group member is elected?

the vote is in progress now.


Input require a property placeholder making some pages return a null error

Closing this issue since it same like  #15


[DOC-56] Import Technology Providers Playbook

Images still reference Confluence locations for now

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.Ecleamus Ricks, Jr seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.

Can we rename the folders to remove "Technology Providers - " from the title, except for the parent level "Technology Providers Implementation Playbook".


[WIP] Enforce ghost/mocha/no-identical-title lint rule

Got some code for us? Awesome 🎊!
Please include a description of your change & check your PR against this list, thanks!

[X] There's a clear use-case for this code change
[X] Commit message has a short title & references relevant issues
[X] The build will pass (run yarn test and yarn lint)

More info can be found by clicking the "guidelines for contributing" link above.
References #11038
Fixed 74 of 76 linting errors. Need help figuring out the last 2,

The 2 errors in question:
https://github.com/TryGhost/Ghost/blob/653cf0396e3f825a4697e281f788216b46cb53ab/core/test/unit/api/shared/http_spec.js#L56-L83
https://github.com/TryGhost/Ghost/blob/653cf0396e3f825a4697e281f788216b46cb53ab/core/test/unit/models/post_spec.js#L960-L1018

I've also removed 2 tests that were duplicates in the second commit. Not sure if its ok to leave it as part of this PR or if prefer to do it separately

Hey, so you never got a response from the repo owners.
I wanted to work with you to get these last two resolved.
The following code passed both grunt lint and grunt test-all
For http_spect.js
it('check options', function () {
        let apiImpl = sinon.stub().resolves();
        shared.http(apiImpl)(req, res, next);

 it('api response is fn', function (done) {
        const response = sinon.stub().callsFake(function (req, res, next) {
            should.exist(req);
            should.exist(res);
            should.exist(next);
            apiImpl.calledOnce.should.be.true();
            res.json.called.should.be.false();
            done();
        });

        let apiImpl = sinon.stub().resolves(response);
        shared.http(apiImpl)(req, res, next);
    });

    it('api response is resolved', function (done) {
        let apiImpl = sinon.stub().resolves('data');

        next.callsFake(done);

        res.json.callsFake(function () {
            shared.headers.get.calledOnce.should.be.true();
            res.status.calledOnce.should.be.true();
            res.send.called.should.be.false();
            done();
        });

        shared.http(apiImpl)(req, res, next);
    });
});

and for post_spec.js
it('rejects if changing authors and authors_id', function (done) {


Doc: Inputs list

Problem
Currently, we cannot see directly all possible inputs with  Javadoc-publisher.yml, and we need to check them manually inside the action.yml file to see inputs.
Solution
To resolve it we can add a section like that:

Inputs

input
description
default

java-version
the java version your project
11

To easily create a Markdown table : stevecat/table-magic.

@MathieuSoysal Hello,I can solve the issue.....can you assign me please?

Actually I m new to open source ,I know reading YAML files and have gone through code in action.yml.
Can u specify a little as how can I creak Markdown table and where we have to input it?(only hints required)
Your time and efforts for a newbie would be definately appreciated

As far as I have understood ,I have nothing to do with the code,but I have to create a section for the repository specifying inputs in a table?

@MathieuSoysal  Please verify my work!


Use of set_only_v6() in example code

In the example code in lib.rs, it has these lines:
socket.bind(&address.into())?;
socket.set_only_v6(false)?;

Isn't it necessary for the call to set_only_v6() to be before the bind()?

Yes. Want to send a pr?


Adding changes listed in pull request #7368

Hi @fsautomata, I'm your friendly neighborhood Azure Pull Request Bot (You can call me AZPRBOT). Thanks for your contribution!

It looks like you're working at Microsoft (elioda). If you're full-time, we DON'T require a contribution license agreement.

If you are a vendor, DO please sign the electronic contribution license agreement. It will take 2 minutes and there's no faxing! https://cla.azure.com.

TTYL, AZPRBOT;

#sign-off

@fsautomata : Thanks for your contribution to the Azure documentation! The author, @fsautomata, has been notified to review your proposed change.

Microsoft authors of articles need to make updates through the private repository so the updates can be staged and validated by the current validation rules. After you review staging and fix all validation issues, you can add the sign-off comment to let the PR reviewers know the updates are ready to be merged.
It�s easy to access the private repo version of your articles in GitHub. Just add �pr to the URL, as follows:
Public repo URL: https://github.com/Azure/azure-content/blob/master/articles/azure-portal-overview.md
Private repo URL: https://github.com/Azure/azure-content-pr/blob/master/articles/azure-portal-overview.md
We've closed this pull request. Please resubmit the updates through the private repo. If you need perms to the private repo, see the contributor guide instructions.


Moved all instances of gDeviceType to imageHelper.cpp

This is the first step in trying to refactor gDeviceType, from comments in this Closed PR: https://github.com/KhronosGroup/OpenCL-CTS/pull/560
gDeviceType is now moved to imageHelper.cpp, and only in imageHelper.cpp/.h are they declared and defined.

Hi kpet,
I'm not sure what you mean. I did a mass search on the entire list of CTS files and the only location I found extern cl_device_type gDeviceType was in imageHelpers.h. Perhaps there's a few I missed? Since I can't seem to find any. This also bring me to the next question: what do you mean by add one to imageHelpers.h? There is already extern cl_device_type gDeviceType in there.
Thanks.

but my second question remains: there's already a extern cl_device_type gDeviceType in imageHelpers.h, what did you mean by add one?

Hadn't spotted that one. No need to add it again if it's already there.


BEWARE: your OS is not officially supported by Playwright; downloading fallback build

I have tried to install it on Debian, inside a venv, but I get these errors:
cd ~/.virtualenvs/bin $
./playwright install chromium
BEWARE: your OS is not officially supported by Playwright; downloading fallback build.
Downloading Chromium 111.0.5563.19 (playwright build v1048) from
https://playwright.azureedge.net/builds/chromium/1048/chromium-linux.zip
Error: connect ETIMEDOUT
at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1494:16) {
errno: -110,
code: 'ETIMEDOUT',
syscall: 'connect',
address:
port: 443
}
:(
and,
./playwright install firefox
gives me the same error...
:(

The error message seems quite clear -- use another distribution.

The error message seems quite clear -- use another distribution.

It is working greatly in Debian now...
No need to change OS:
~ $ chatgpt hello
Hello! How can I assist you today?
-> me@cypher 22:19:34
~ $ which chatgpt
which chatgpt
/home/me/.virtualenvs/bin/chatgpt

Great to hear.


bin/terraform cannot be used on Mac

Bug Report
Expected behavior/code
Mac users should be able to make use of bin/terraform and make commands related to terraform to manage their AWS environment.
Actual Behavior
bin/terraform produces broken terraform commands.
Anecdotally, non-Mac users do not seem to have this issue.
Steps to Reproduce

Use a mac
Attempt to launch any terraform command

Environment

Marsha version: up to date master
Platform: Mac

Possible Solution
We narrowed the regression down to commit https://github.com/openfun/marsha/commit/c0fc0742d878dd4b8d63cdafe0d51d476b2d8ccf.
More specifically, the issue can be mitigated by removing the OPTS block, lines 74-85.

Closed by #925. The fix is to install an additional package on the dev machine, as is now explained in the docs.


Pr/v1.11 backport 2023 01 24

[ ] #22370 -- Bugtool: add flag to exclude object for endpoints (@tbalthazar)
[x] #22726 -- test/helpers: Fix retry condition for CiliumExecContext (@christarazi)
[x] #22654 -- backporting: leave backport/author PRs alone (@bimmlerd)
[ ] #22619 -- fqdn: dnsproxy: fix data race in dns proxy implementation (@aspsk)
[x] #22772 -- test: service: fix formatting of error msg in doFragmentedRequest() (@julianwiedmann)
[ ] #22821 -- Add sphinxcontrib-googleanalytics to doc requirements (@chalin)
[ ] #22600 -- daemon/cmd: improve stale cilium endpoint error handling. (@tommyp1ckles)
[ ] #22807 -- Update Layer 7 Protocol Visibility Document. (@obaranov1)
[ ] #22884 -- Fix crash of CES queue delay metric when CESTracker is nil (@dlapcevic)
[ ] #22962 -- clustermesh: Add missing brackets of etcd option (@YutaroHayakawa)
[x] #23095 -- docs: Improve wording for deny policies limitation (@joestringer)
[ ] #23135 -- docs: Improve IPsec guide (@pchaigno)
[ ] #23140 -- build(deps): update package dependencies (@fengshunli)
[ ] #23134 -- docs: update committer security requirements (@xmulligan)
[x] #23058 -- contrib: Update PR template for backport (@sayboras)
[ ] #23158 -- IPsec: Refactor ipSecReplaceState{In,Out} functions (@pchaigno)
[ ] #23267 -- Update CNI to 1.2.0 (@michi-covalent)
[x] #23220 -- .github: Pin docker buildx version to v0.9.1 (v2) (@joestringer)

Had to drop the first commit.

Drop PRs:

#22620 -- Update Cilium install guide about EKS aws-node DaemonSet potential connectivity problem on uninstall (@NikAleksandrov)

ciliumendpoints.go does not exist in v1.11

#22220 -- Enable Google Analytics 4 (@chalin)

see: https://github.com/cilium/cilium/pull/23301#issuecomment-1402342887

#20619 -- test/k8s: remove l7_demos test (@tklauser)

appears irrelevant for back porting, workfile files do not exist.

Once this PR is merged, you can update the PR labels via:
$ for pr in 22370 22726 22654 22619 22772 22821 22600 22807 22884 22962 23095 23135 23140 23134 23058 23158 23220 23267 23220; do contrib/backporting/set-labels.py $pr done 1.11; done

Manually added image bump: 0c9f929619c9f00fd8c2df2d5510eb75311e7bbb

Failure looks related to the backport commits:
https://github.com/cilium/cilium/actions/runs/4001219389/jobs/6867238521
# Generate the corresponding mock library.
docker container run --rm --workdir /src/mock --volume /home/runner/work/cilium/cilium/bpf/mock/..:/src --user "1000:1000" cilium/bpf-mock ./mock_customized.sh conntrack_stub.h;
Creating mock for conntrack_stub...
make[2]: Leaving directory '/home/runner/work/cilium/cilium/bpf/mock'
docker container run --rm --workdir /src/test/bpf --volume /home/runner/work/cilium/cilium:/src --user "1000:1000" cilium/bpf-mock  clang -I../../bpf/ -I../../bpf/include -I. -D__NR_CPUS__=4 -O2 -I../../bpf/mock -I ./../bpf/ -I../../../CMock/src -I../../../CMock/vendor/unity/src -I../../../hashmap/include  nat-test.c ../../../CMock/vendor/unity/src/unity.c ../../../CMock/src/cmock.c ../../../hashmap/src/hashmap.c ../../bpf/mock/mocks/mock_helpers.c ../../bpf/mock/mocks/mock_helpers_skb.c ../../bpf/mock/mocks/mock_conntrack_stub.c -o nat-test
clang: error: no such file or directory: '../../bpf/mock/mocks/mock_helpers_skb.c'
make[1]: *** [Makefile:49: nat-test] Error 1
make[1]: Leaving directory '/home/runner/work/cilium/cilium/test/bpf'
make: *** [Makefile:23: build] Error 2
make: Leaving directory '/home/runner/work/cilium/cilium/test'
warning: execution failed: make -C test build -j 4
You can fix the problem, and then run

  git rebase --continue

struggle continues

/test-backport-1.11

@tklauser probably easiest to send another PR with backport.

@tklauser probably easiest to send another PR with backport.

https://github.com/cilium/cilium/pull/23348

The entire CI was green so we can merge this PR once the reviews are in.


python310Packages.airthings-ble: 0.5.0 -> 0.5.1

Description of changes
https://github.com/vincegio/airthings-ble/blob/main/CHANGELOG.md#v051-2022-09-10

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.11 Release Notes (or backporting 22.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 191648 run on x86_64-linux 1

2 packages built:

python310Packages.airthings-ble
python39Packages.airthings-ble


Fix an error when git config is called.

Thanks for the analysis and fixing the root cause. Could you squash your commits please? Currently, this pull request contains a commit which makes things worse and I’d prefer to not have that in our git history :).

I'll start over in a branch not named "master"


Add version string to st2api module

It occurred when installing:
Obtaining file:///opt/stack/github/st2/st2api
    Complete output from command python setup.py egg_info:
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/opt/stack/github/st2/st2api/setup.py", line 23, in <module>
        from st2api import __version__
    ImportError: cannot import name __version__

    ----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /opt/stack/github/st2/st2api/

Thank you for your contribution.
We actually automatically populate __version__ for all the st2 components based on the __version__ value in st2common.
This happens as part of our CI / CD release workflow. We don't manually add __version__ string in every component to avoid duplication because all of the components use the same version (we always release all the components at once so they have the same version).
Having said that - I do see an issue with not having __version__ always present - you can't directly install components using pip from git repository. Something which is not officially supported right now anyway, but I agree it would be nice if you could do that.
So in short - thank for your contribution, but to make this a reality we need to decide on the approach and also correctly update / modify our release workflows.

@Kami  Thanks for the response!
I'm curious how I should install every component (e.g. st2api). I have to install every component from my personal repo which is forked from st2 if I rewrite some codes in some components. I would rather not see this issue each time I install using pip or python install.

@apolloliu Right now we officially only distribute st2common and st2client as Python packages.
Other components are distributed as part of our debian / rpm packages. They are also Python packages, but right now they are not meant to be used directly from git.
If you need access to Python packages for all components there are two ways to do it right now:

As you have done - fork the repo or similar and populate __version__ for all the components
Download debian / rpm package, unpack them and you st2 components from there (those have version populated)

Going forward - we could / should update our workflows so version is already populated so people can install it directly from git if they wish so.

@Kami Thank you pointing the two ways! It's really cool if updating the workflow of populating version because some developers want to install directly from git as soon as they modify the codes.


feat: support cacheDir option

Description

Additional context

What is the purpose of this pull request?

[ ] Bug fix
[x] New Feature
[x] Documentation update
[ ] Other

Before submitting the PR, please make sure you do the following

[x] Read the Contributing Guidelines.
[x] Read the Pull Request Guidelines and follow the Commit Convention.
[x] Check that there isn't already a PR that solves the problem the same way to avoid creating a duplicate.
[ ] Provide a description in this PR that addresses what the PR is solving, or reference the issue that it solves (e.g. fixes #123).
[ ] Ideally, include relevant tests that fail without this PR but pass with it.

@Shinigami92
In vuepress v2, the cache directory can be specified by users, can we can just clean the cache directory without knowing the underlaying bundler (webpack or vite):
https://github.com/vuepress/vuepress-next/blob/742f5811032b3a2f0687edf3f966d25517734a8d/packages/%40vuepress/cli/src/commands/dev/dev.ts#L56-L59
Currently, this is not possible with vite, and we have to resolve the bundler first, then determine whether to pass server.force option. This will make the logic coupled with the underlaying bundler.

In addtion, the cacheDirectory option is supported by webpack: https://webpack.js.org/configuration/other-options/#cachecachedirectory

I think that this option should be at the root level, in case we would like to add other things to the cache that are not optimized dependencies. Check for example https://github.com/vitejs/vite/issues/1309

@patak-js If so, I think the optimizeCacheDir of the ResolvedConfig type could be replaced by this new root level option:
https://github.com/vitejs/vite/blob/0dc6e37298e2e3efda74a1042f37bd70e3f5d3a5/packages/vite/src/node/config.ts#L175
What do you think about that?

LGTM, I think we'll need Evan's input on this though

I found that there is extra handling for the default cache directory:
https://github.com/vitejs/vite/blob/0dc6e37298e2e3efda74a1042f37bd70e3f5d3a5/packages/vite/src/node/optimizer/index.ts#L292-L297
https://github.com/vitejs/vite/blob/0dc6e37298e2e3efda74a1042f37bd70e3f5d3a5/packages/vite/src/node/server/middlewares/transform.ts#L153-L155
I have modified those code, which may need your review again @patak-js @Shinigami92

Sorry @meteorlxy, this one is a lot harder than it looked at the beginning. Another thing we should check is if we are going to be missing checks against node_modules being in the path of the cache. For example, this check may be affected. This one may not be hit because it is checking against importer, and it may change after this PR https://github.com/vitejs/vite/pull/2519, but there may be other checks like this in the code base. So we may need a new helper that check if a path belongs to a node_modules or a cached dep. The test suite may have issues catching these issues.

@patak-js Got it. I think I should create a Feature Request for this.

Great, thanks for pushing this change forward @meteorlxy


[SPARK-40802][SQL] Resolve JDBCRelation's schema with preparing the statement

What changes were proposed in this pull request?
This PR changed to resolve the JDBC Relation schema with PreparedStatement.executeQuery() instead of PreparedStatement.getMetaData(). The main changes are:

Add a new function: getQueryOutputSchema() to JdbcDialect. By default, it will use getMetaData() to resolve schema.
For 3 JDBC dialects: H2Dialect, MsSqlServerDialect and MySqlDialect, override this function to use executeQuery() to resolve the schema because they doesn't support getMetaData() well.
Add 2 utility functions to JdbcUtils for the 2 ways to resolving schema.

Why are the changes needed?

getMetaData() is better performance compared with executeQuery() because
getMetaData() only needs to compile the Query, but executeQuery() needs to execute the query.
Move the schema resolution to JdbcDialect, make it possible to resolve schema differently for each database.
In the future, spark can support some non-SELECT query such as CALL PROC, etc.

Does this PR introduce any user-facing change?
No
How was this patch tested?
Tested with existing test cases

Can one of the admins verify this patch?


Fix DCE of begin_borrow with @guaranteed operand

For the lower most begin_borrows with @guaranteed operands, there was no @guaranteed phi computation, restructure the code and fix this case.
Cherry-pick of https://github.com/apple/swift/pull/62881

@swift-ci test


Developer onboarding resources

Description

Closes pyrsia/pyrsia#1336
This PR adds better onboarding documentation. This includes a ready list of libraries that are being used and related resources to have better onboarding experience for developers.
Screenshots (optional)
PR Checklist

[x] I've read the contributing guidelines.
[x] I've read "What is a Good PR?"
[x] I've included a good title and brief description along with how to review them.
[x] I've linked any associated an issue.

Code Contributions

[x] I've built the code cargo build --all-targets successfully.
[x] I've run the unit tests cargo test --workspace and all tests pass.
[x] I've run the integrations tests and all tests passes.

I left some suggestions but overall great start.

great suggestions and make sense. We may need to couple of iterations to make it more solid.

solved.


Suppress redeem not working anymore?

[Enter feedback here]
This text is either wrong or misleadning:
This original method still works. However, there's a small difference in behavior. If you use PowerShell, you'll notice that an invited guest account now has a PendingAcceptance status instead of immediately showing Accepted.
If we follow the steps 1-3 using GUI (not powershell) I would expect that the invited user would show status Accepted. Instead it shows PendingAcceptance. I'm trying to avoid redemption for a partner organization, but it seems it's not possible - or not?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: db30a5c4-452c-02ae-b610-018e2bb042fb
Version Independent ID: 459aa1c1-fd5f-f6e1-3244-6bfbb2abd67f
Content: Add B2B guests without an invitation link or email - Azure AD
Content Source: articles/active-directory/external-identities/add-user-without-invite.md
Service: active-directory
Sub-service: b2b
GitHub Login: @msmimart
Microsoft Alias: mimart

@KWinTie
Thanks for your feedback! We will investigate and update as appropriate.

I have assigned this to the content author @msmimart . It looks like the text may need to be updated to include more than just Powershell.

Thanks @KWinTie for this feedback. I agree this article is unclear, and it's on track for retirement soon. There's a clearer explanation in Azure AD B2B invitation redemption, which explains how the PendingAcceptance value is applied whether you're using PowerShell or GUI. It also describes the direct link method and that even without an invitation, the user is guided through the consent experience if they haven't accepted it already. I hope this helps; I'll go ahead and close this issue for now.  Thanks so much for pointing this out!
#please-close


Update apollo related dependencies

https://github.com/trojanowski/react-apollo-hooks/blob/master/CHANGELOG.md
https://github.com/apollographql/react-apollo/blob/master/Changelog.md
https://github.com/jaydenseric/apollo-upload-client/blob/master/changelog.md
https://github.com/apollographql/apollo-server/blob/master/CHANGELOG.md
https://github.com/apollographql/apollo-client/blob/master/CHANGELOG.md

Tried this, didn't work, will try again some other time.


[Sonarqube] Add support for HTTPS Redirection

Currently, the Sonarqube helm chart does not support adding additional ingresses. Since this is the case, if someone wanted to add support for HTTPS redirect, one would need to edit the live deployment or host their own version of the Sonarqube helm chart. Solving this issue would allow additional inputs of Ingresses.

/assign

Solved by #101


Split codegen into separate build targets

Split codegen into separate build targets

To help with the transition to type-graph based CodeGen, we need to
reduce dependencies on legacy CodeGen from other parts of OI.

Pieces of CodeGen referenced by other files, but which only return
drgn data have been moved into a new "drgn_utils" target, allowing
us to remove CodeGen dependencies for these functions.

The new "symbol_service" build target can be used in the future by
other files only needing access to symbol information and not full
CodeGen.

Codecov Report

Merging #72 (e1cc666) into main (72f9956) will decrease coverage by 0.08%.
The diff coverage is 20.83%.

@@            Coverage Diff             @@
##             main      #72      +/-   ##
==========================================
- Coverage   33.12%   33.04%   -0.08%
==========================================
  Files          38       40       +2
  Lines        6253     6310      +57
  Branches     3438     3456      +18
==========================================
+ Hits         2071     2085      +14
- Misses       2321     2350      +29
- Partials     1861     1875      +14

Impacted Files
Coverage Δ

src/DrgnUtils.h
0.00% <ø> (ø)

src/OICodeGen.h
58.33% <ø> (ø)

src/Serialize.cpp
0.00% <0.00%> (ø)

src/SymbolService.cpp
23.89% <0.00%> (ø)

src/DrgnUtils.cpp
8.98% <20.00%> (ø)

src/OICodeGen.cpp
38.71% <25.00%> (+0.33%)
:arrow_up:

src/TreeBuilder.cpp
47.57% <50.00%> (-0.10%)
:arrow_down:

... and 2 more

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


i18n(zh-cn): Update i18n.mdx

Description (required)
Update i18n.mdx
Related issues & labels (optional)

#8645
Suggested label: i18n

Lunaria Status Overview
🌕 This pull request will trigger status changes.

Learn more
By default, every PR changing files present in the Lunaria configuration's files property will be considered and trigger status changes accordingly.
You can change this by adding one of the keywords present in the ignoreKeywords property in your Lunaria configuration file in the PR's title (ignoring all files) or by including a tracker directive in the merged commit's description.

Tracked Files

Locale
File
Note

zh-cn
recipes/i18n.mdx
Localization changed, will be marked as complete.

Warnings reference

Icon
Description

🔄
The source for this localization has been updated since the creation of this pull request, make sure all changes in the source have been applied.


H7151 Does it work now?

I'm in the market for new dehumidifier and I see this kinda worked before... I really want to see when the bucket is full. Does this work in the plugin?

No


Pants: add python_distribution BUILD metadata for runners

Background
This is another part of introducing pants, as discussed in various TSC meetings.
Related PRs can be found in:

pantsbuild milestone (which includes PRs since #5713)
https://github.com/StackStorm/st2/labels/pantsbuild label (which also includes preparatory PRs that came before adding pantsbuild)

Overview of this PR
This PR adds the st2_runner_python_distribution() macro to the BUILD metadata for all of our runners.
Thanks to the macro, we only have to define 3 (or 4) parameters for each runner: runner_name, description, entry_points, and (for the python runner) zip_safe=False. I copied each of these from the setup.py file, which will become obsolete once pants can generate the setup.py file for us. For the description, I tried to keep the spacing fairly consistent, but there was enough variation in the wording that I did not delegate creating the description to the macro.
Under entry_points, I have "tagged" the st2common.runners.runner and the orquesta.expressions.functions categories as stevedore_namespaces. Once we switch to 2.16 and enable the pants.backend.experimental.python.framework.stevedore plugin, the stevedore plugin will, for tests, use this "tag" to look up which wheels implement a plugin in that stevedore namespace.
To facilitate comparison, I will add a comment to each of the files that shows the current setup.py entry_points.

#5906 should be merged first


Can you give us example for props, except onRead?

#In the Readme you explain about props

onRead
renderTopView
etc...

But you just explain about onRead, can you give example one by one each props?
And what the default value on each props
Thank you.

Hello,
From what I found in the code we have the followings props :
`  static defaultProps = {
onRead: () => {},

renderTopView: () => {},

renderBottomView: () => (

  <View style={{ flex: 1, backgroundColor: "#0000004D" }} />

),

rectHeight: 200,

rectWidth: 200,

flashMode: false,

finderX: 0,

finderY: 0,

zoom: 0.2, // Zoom range 0 - 1

translucent: false,

isRepeatScan: false,

cameraType: "back",

notAuthorizedView: () => (

  <View style={styles.authorizationContainer}>

    <Text style={styles.notAuthorizedText}>Camera not authorized</Text>

  </View>

),

vibrate: true,

};`

Hello, From what I found in the code we have the followings props :
` static defaultProps = {
onRead: () => {},
renderTopView: () => {},
renderBottomView: () => (
  <View style={{ flex: 1, backgroundColor: "#0000004D" }} />
),
rectHeight: 200,
rectWidth: 200,
flashMode: false,
finderX: 0,
finderY: 0,
zoom: 0.2, // Zoom range 0 - 1
translucent: false,
isRepeatScan: false,
cameraType: "back",
notAuthorizedView: () => (
  <View style={styles.authorizationContainer}>
    <Text style={styles.notAuthorizedText}>Camera not authorized</Text>
  </View>
),
vibrate: true,

};`

Noted, thank you sir, I will try it


Previous pane partly selectable in UI

You can now select the preview pane (we disabled this feature), but it doesn’t populate the details into the main pane. This should be disabled. Preview pane is for reference only.

Fixed with commit https://github.com/NHMDenmark/Mass-Digitizer/commit/e8edd0ec6bdf142af14e1594817ee76c0b2ef209 by setting select mode to "none" for previousRecordsTable.


Chinese params doc code error

https://reactnavigation.org/docs/zh-Hans/params.html，this page has a question where in HomeScreen.Location is HomeScreen-->View-->Button,Line 8,arrowFunction didn't bind any event.

I wonder how can I apply this small fix? I don't speak Chinese but that was just a syntax issue so it wouldn't be a problem? @brentvatne

@jarvisluong - you can sign up on https://crwd.in/react-navigation to suggest translations :)


How I can reduce GPU memory usage

my device is 3080 16GB, but with the original code, I can only train with batch_size=1, otherwise, cuda out of memory.
I tried with Mixed Precision, and I can increase batch_size to 2, how can I train with large batch size without dropping accuracy.

Works fine with the KITTI 2015 dataloader but when I try to pass images of my own (281x618) CUDA runs out of memory. I am running 4 GB GPU.

As mentioned in the mail, we used multiple GPUs to enable bigger batch sizes.


Fix parse error in dchmod

When using a+r for instance, dchmod was incorrectly parsing this
as something that specified no letter (i.e +r), which uses umask.
This was causing dchmod to incorrectly assign permissions when
using the "all" attribute.

Here's the old issue just for reference:  https://github.com/hpc/mpifileutils/issues/36


CI using Azure Pipelines from Microsoft

I am a product manager at Microsoft and would like to help you enable continuous integration for the D3 repos using Azure Pipelines.  Azure Pipeline is a CI integration service from Microsoft that is free for open source projects and supports build and test across Linux, macOS, and Windows.
Summary
To get the ball rolling, I created pipelines for 28 of the D3 repos. I chose these repos because they were the most consistent and would be fairly easy to script/automate the handful of necessary updates.
At a high level, the changes were:

Added an .azure-pipelines.yml file that defines the CI jobs for Linux and Windows
Updated package.json with new CI-specific scripts (these scripts call existing scripts but generate XML output). I also had to swap a few commands (like rm -rf) with cross-platform alternatives
Updated README.md with a build status badge

Most of the (28) repos built correctly on Window sand Linux, but a few required some tweaks:

d3-geo-projection and d3-geo rely on node-canvas, which required installing some platform-specific dependencies.
d3-axis had failing tests due to an assumption about the line endings being LF (not CRLF)
d3 doesn’t use eslint (which make sense) so I had to tweak the build configuration to not run lint or publish lint results

A handful of other repos like d3-timer have some legitimate-looking test failures (see test results), but I didn't dig too deep into them -- here's how the test results appear in the Azure Pipelines UI:

Pipeline status
You can access the forks and pipelines here:

Repo
Status

d3

d3-array

d3-axis

d3-chord

d3-color

d3-contour

d3-dispatch

d3-dsv

d3-ease

d3-format

d3-geo

d3-geo-projection

d3-hierarchy

d3-interpolate

d3-path

d3-polygon

d3-quadtree

d3-random

d3-scale

d3-scale-chromatic

d3-selection

d3-shape

d3-time

d3-time-format

d3-timer

d3-transition

d3-voronoi

d3-zoom

package.json script updates
My main goals were to preserve the existing package.json script functionality and to avoid duplicating the test and lint commands. Here's a snippet from d3-array/package.json
{
  "scripts": {
    "lint": "eslint src",
    "lint:ci": "yarn run lint -f junit -o test-results/lint.xml",
    "pretape": "rollup -c",
    "tape": "tape test/**/*-test.js",
    "tape:ci": "yarn run tape | tap-junit -o test-results -n tape.xml",
    "test": "yarn run tape && yarn run lint",
    "prepublishOnly": "rimraf dist && yarn test",
    "postpublish": "..."
  }
}

test still runs both tape and lint, but the actual functionality has been broken out into separate scripts (tape and run) so they can be called by CI-specific scripts
rm -rf was replaced with rimraf
A handful of scripts set environment variables --- these had to be replaced with cross-env

Next steps
If you are interested in moving forward, I can stage PRs for some/all of the other repos. I can also transfer the dev.azure.com/d3 Azure Pipelines org to you to save you the time of setting up the pipelines, wiring them up, etc. You can also "start small" and only use Azure Pipelines for a handful of your repos.
Feel free to reach out to me at wismythe at microsoft.com if you have questions.

It may make sense to disable the Windows builds. It looks like the "failing" suites are only failing on Windows.

Hi @curran,
I dug into why the d3-scale tests are failing. It is caused by differences in how the current timezone is determined on Linux vs. Windows. On Linux, timezone can be controlled via the TZ environment variable, which was already being set prior to running the tests (since some tests were coded to assume a Pacific timezone). This variable is not honored on Windows (see https://github.com/nodejs/node/issues/4230).
To fix d3-scale, I updated the build script to call tzutil (a Windows-specific command):
- script: |
    tzutil /s "Pacific Standard Time"
  displayName: 'Set timezone for tests'

I didn't dig too hard into why the d3-time, d3-timer, and d3-time-format tests are failing (I will), but this is a likely culprit (along with possibly other differences in the way timezone, daylight savings time, etc are dealt with on Linux vs Windows).
I think this problem highlights the value in running tests across multiple platforms.
There could be legitimate problems uncovered (both in the current code and in future code) due to differences in the platform used for development (Linux) and the platforms where these libraries are expected to run.

Thank you for the contribution, but I do not currently want to adopt CI.