How can I add some objects into the Server-sided collection?

simply I wrote code like this
DDPServer = require 'ddp-server-reactive'
server = new DDPServer 3000
console.log "init"
Messages = server.publish 'messages'
server.methods
  addMessage: (msg)->
    console.log Messages
    console.log "collection size: #{Messages.length}"
    Messages.push
      message: msg
      createdAt: Date.now()

but Messages.push doesn't works. because typeof Messages is object. not array.
I want to receive "added" messages from client. any idea?

Messages is not array. Messages is object.
https://github.com/Q42/DDP-Server-Reactive/blob/master/lib.js#L162
https://github.com/Q42/DDP-Server-Reactive/blob/master/lib.js#L212
let id = 0;
server.methods({
  addMessage: msg => {
   Messages[id++] = {message: msg, createdAt: Date.now()};
  }
})

I know as described :)
I just wonder how to get "added" message in client. not "changed"

You should get the "added" message with the code from marcuzy.

I want to receive "added" messages from client.?

or

just wonder how to get "added" message in client

What you want?)
DDP-Server-Reactive can publish collections (send data to client) and receive method calls. (Server side)
ddp.js (or other ddp client) can receive published collections and send method calls. (Client side)

I have some misunderstanding.
Proxy is so fantastic!
DDPServer = require 'ddp-server-reactive'
server = new DDPServer
Messages = server.publish 'messages'
server.methods
  addMessage: (msg)->
    seq=(Object.keys Messages).length
    Messages[seq]=
      message: msg
      createdAt: Date.now()
    seq

I just added some code. works great!
Thanks for your Awesome project 💯 💯 💯 👍


Support x-datadog-test-session-token for parallel tests with the test agent

I've decided to put it into Endpoint, as it has to be used at basically any place Endpoint is used.

Codecov Report
Attention: Patch coverage is 25.00000% with 75 lines in your changes missing coverage. Please review.

Project coverage is 70.27%. Comparing base (a84d949) to head (1bfadaf).
Report is 3 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #578      +/-   ##
==========================================
+ Coverage   70.23%   70.27%   +0.03%
==========================================
  Files         214      214
  Lines       28802    28977     +175
==========================================
+ Hits        20230    20363     +133
- Misses       8572     8614      +42

Components
Coverage Δ

crashtracker
21.15% <ø> (ø)

datadog-alloc
98.73% <ø> (ø)

data-pipeline
50.00% <ø> (ø)

data-pipeline-ffi
0.00% <ø> (ø)

ddcommon
82.78% <50.00%> (-0.30%)
:arrow_down:

ddcommon-ffi
69.72% <44.44%> (-0.49%)
:arrow_down:

ddtelemetry
58.95% <ø> (ø)

ipc
84.18% <ø> (ø)

profiling
84.26% <ø> (ø)

profiling-ffi
77.42% <ø> (ø)

serverless
0.00% <ø> (ø)

sidecar
34.10% <0.00%> (-0.46%)
:arrow_down:

sidecar-ffi
0.00% <0.00%> (ø)

spawn-worker
54.87% <ø> (ø)

trace-mini-agent
70.88% <ø> (ø)

trace-normalization
98.24% <ø> (ø)

trace-obfuscation
95.73% <ø> (ø)

trace-protobuf
77.16% <ø> (ø)

trace-utils
91.82% <94.44%> (+0.92%)
:arrow_up:

scenario:credit_card/is_card_number/37828224631000521389798
🟥 execution_time [+11.565ns; +12.044ns] or [+10.646%; +11.087%]
🟥 throughput [-918917.691op/s; -883968.291op/s] or [-9.982%; -9.602%]

This is benchmark is propably sensing larger binary, or just depends too much memory layout. We should make sure its not that sensitive.


Low accuracy in inference

Hello
How are you?
I've trained a model for detecting 6 keypoints and face bounding box.
I used your project without any modification.
I tested the model on some images but it's accuracy is very poor.

Even for some images, it is impossible to detect the face bounding box.
Please let me know the reason.
Thanks

Hi, we can simply say that your model couldn't generalize very well.
the300w_lp dataset is not enough to train a robust model by self.
I just added it to create an entry point for those who want to work on this subject.
As I said before, I do not intend to share the dataset I use at this stage.
If there is a change in this matter, I will already make the necessary updates in the readme.

Hi
I think that the accuracy of model is very poor although the300w_lp dataset is not enough to train a robust model.

Hi,
Yes, as I explained above, your model does not have a generalization capability.
I mean, the model you train is probably overfitted the300w_lp dataset.


Update Kotlin and dependencies

Hi there!
Please, could you update your dependencies and Kotlin version? Your sample is on our samples page and we'd love it if you could keep it updated.
Thank you so much,
Pamela
Kotlin Developer Advocate @ JetBrains

I just updated it to Kotlin 2.0.20 and Compose 1.6.11.
I also updated the settings.gradle.kts configuration file, matching the one generated by the latest KMP Wizard.

Thank you so much!


feat(Alert): add Alert component which uses @digdir/design-system-react

Description

Added a new Alert component, with options for

severity - sets the style of the alert, and has four valid values "success" | "info" | "danger" | "warning".
title - sets the title via textResourceBindings.
description - sets the description via textResourceBindings.
useAsAlert - A boolean which specifies whether the component should have role="alert" or not. It should not have this for static elements displaying information, but should have it for dynamic elements that appear after a certain user input. I currently implemented the aria-live attribute with polite, but I think maybe this should be configurable. Or maybe it should be based on severity label. if useAsAlert is set, and severity is >= warning, aria-live should be set to assertive.

Screenshot:

Related Issue(s)

closes #1284

Verification/QA

Manual functionality testing

[x] I have tested these changes manually
[ ] Creator of the original issue (or service owner) has been contacted for manual testing (or will be contacted when released in alpha)
[ ] No testing done/necessary

Automated tests

[x] Unit test(s) have been added/updated
[x] Cypress E2E test(s) have been added/updated - I have added some alerts to frontend-tests so that the alert is tested with percy.
[ ] No automatic tests are needed here (no functional changes/additions)
[ ] I want someone to help me make some tests

UU/WCAG (follow these guidelines until we have our own)

[x] I have tested with a screen reader/keyboard navigation/automated wcag validator - Tested with wave and orca screen reader. The screen reader reads alerts twice for some reason, but I think this is an orca issue. Could somebody test with VoiceOver on Mac?
[ ] No testing done/necessary (no DOM/visual changes)
[ ] I want someone to help me perform accessibility testing

User documentation @ altinn-studio-docs

[ ] Has been added/updated

[ ] No functionality has been changed/added, so no documentation is needed
[ ] I will do that later/have created an issue

Changes/additions to component properties

[x] Changes are reflected in both src/layout/layout.d.ts and layout.schema.v1.json, and these are all backwards-compatible
[ ] No changes made

Support in Altinn Studio

[ ] Issue(s) created for support in Studio

[ ] This change/feature does not require any changes to Altinn Studio

Sprint board

[x] The original issue (or this PR itself) has been added to the Team Apps project and to the current sprint board
[ ] I don't have permissions to do that, please help me out

Labels

[x] I have added a kind/* label to this PR for proper release notes grouping
[ ] I don't have permissions to add labels, please help me out

I see that I might need to update this PR and split out the schema for AlertComponent into a separate schema once #1283 is merged.

This has a striking resemblance to the Panel component we already have, although this looks a bit different. Be sure to document what's the difference between these two components, and what's the use-case for each of them.
Also, this reminds me of #1023, which we closed because we wanted to introduce validations using expressions instead via #726. Does this Alert component have to be a component, or the use-case really just the same as soft validations? In that case, I think we should probably consider updating the visuals for the soft validations instead of making a new component.

This has a striking resemblance to the Panel component we already have, although this looks a bit different. Be sure to document what's the difference between these two components, and what's the use-case for each of them.
Also, this reminds me of #1023, which we closed because we wanted to introduce validations using expressions instead via #726. Does this Alert component have to be a component, or the use-case really just the same as soft validations? In that case, I think we should probably consider updating the visuals for the soft validations instead of making a new component.

Thanks for the feedback! Regarding #1023 @Febakke was involved in the startup meeting of this new component, and I think we said that this new component should take over the role of Panel in displaying messages which appear as some sort of user input. Please correct me if I am wrong here @Febakke
This component could also be used to display static messages which do not appear/disappear based on user input. Soft validations seem to me like they only appear as a validation message whenever the user provides some input.
Maybe we should have a chat about this component again @Febakke @olemartinorg @Magnusrm

I see! 🤔

This component could also be used to display static messages which do not appear/disappear based on user input.

The useAsAlert flag contradicts that. It opens up for using this as something that works just like a validation message, but a validation message that circumvents all the other (current and future) functionality in validation messages. I would assume there comes a feature request at some point for "having the option to not let the user proceed to the next page in the form when a certain Alert is displayed" and at that point we're on our way to re-implement validation with new clothes.

Soft validations seem to me like they only appear as a validation message whenever the user provides some input.

Ah, yes - so Alert is, in a sense, permanent soft validations. 🤔 Again, the functionality overlap here makes me feel uneasy. I don't want to be difficult, and I fully understand why you'd want to use a "fully featured component" for these messages, as it's much more flexible than regular validations (and permanent, as you mention!), but I think we should discuss this some more before letting it out in the wild. I would be very confused as an app developer if we promoted 3 different methods that achieve very similar things.
Maybe implementing an 'initial' trigger for validations could be an alternative (worryingly, validation messages disappear right now if you refresh the app, and you won't get them back until you hit a trigger), or reworking the way triggers on validations work could be another option.
Tagging @RonnyB71 as well.

The useAsAlert flag contradicts that. It opens up for using this as something that works just like a validation message, but a validation message that circumvents all the other (current and future) functionality in validation messages.

The thinking is that Alert can be used as both information and an alert that grabs the attention of a screen reader. This does not necessarily have to be a validation message, but can certainly be used as one also :sweat_smile:. It could very well just be additional information that is displayed when making a user action. For instance, in our specific use case in DGM we want to display this piece of extra information to the users when they select "Ja, jeg har informert de andre etterlatte", even though this is not a validation message.

Ah, yes - so Alert is, in a sense, permanent soft validations.

Yes, Alert is both soft validations and permanent soft validations, and just information :sweat_smile:
In any case, it seems we need to discuss this component a little more in detail before we introduce it to the codebase.

@olemartinorg
I agree that this will be confusing for the app-developer and we have a lot of overlap here. I guess I did not think this trough when we had the initial meeting on this. 🐥 We should land on a plan on how to divide between alert and panel in a way that is easy to understand for our app-developers. Anyway, here are my thoughts on this. This is a suggestion on how it could work in an ideall world 😅
Alert
Alert is a defined pattern, and we use the same icons and severity grades as NAV does in their component. Our goal should be to use alert in the same way inn Apps. It should only contain text, preferbly short texts. It should not be used for validating a form. But in the future it might be used for giving the user information about a technical fault that is not related to what the user has filled in. "We could not submit your form because our database is full, sorry"
NB: I see that NAV has changed their documentation to say that you should not give the alert component: role=alert. Im not sure why, if the alert is presented after the page has been loaded it must have this role for screen readers to catch it. (They do say that it should not be presented dynamicly)
Summary:

Should be used for important short messages for the user
Should have different severity levels
Should not have buttons or other components inside them
Can be static or presented based on something that has happened either from the user or something outside of their control

Panel
When we first made our panel component, we had many different use cases and we thought it should handle all of them and we did at that time not think about concistensy across public solutions like NAV. This has been something that we have started to focus more on after starting to work on the design system.
The panel should be a grouping of elements that make it stand out from the rest of the page. It has no limitations on what it can contain. Example of uses, highlight parts of a paragraph you want to stand out or grouping form components with a text that is relevant.
The color should only be a stylistic choice, it should not inform the user of a grade of severity.
If it is presented to the user with dynamics it might need a live-region: polite depending on the content.
I have to 🏃, but there is also some overlap with soft validations that I have to think about in this context.

After a discussion in todays daily meeting, we have decided that we will introduce the new Alert component and at the same time replace the visual design of Soft validations to use the new Alert component from @digdir/design-system-react


Incorrect node type parsing for sizeof(char) call

I'm currently using Joern to build CPGs for the SARD Juliet C/C++ Test Suite and I'm encountering a problem parsing this function:
void CWE121_Stack_Based_Buffer_Overflow__char_type_overrun_memcpy_01_bad()
{
    {
        charVoid structCharVoid;
        structCharVoid.voidSecond = (void *)SRC_STR;
        /* Print the initial block pointed to by structCharVoid.voidSecond */
        printLine((char *)structCharVoid.voidSecond);
        /* FLAW: Use the sizeof(structCharVoid) which will overwrite the pointer voidSecond */
        memcpy(structCharVoid.charFirst, SRC_STR, sizeof(structCharVoid));
        structCharVoid.charFirst[(sizeof(structCharVoid.charFirst)/sizeof(char))-1] = '\0'; /* null terminate the string */
        printLine((char *)structCharVoid.charFirst);
        printLine((char *)structCharVoid.voidSecond);
    }
}

Specifically in the statement sizeof(char), Joern produces an Identifier node for char, when it should be a Type Reference. This also seems to throw off the name saved to the identifier for some reason. The node produced looks like this:
Identifier(
    id -><PHONE_NUMBER>213694068L,
    argumentIndex -> 1,
    argumentName -> None,
    code -> "char",
    columnNumber -> Some(value = 74),
    dynamicTypeHintFullName -> ArraySeq(),
    lineNumber -> Some(value = 10),
    name -> "org.eclipse.cdt.internal.core.dom.parser.c.CASTSimpleDeclSpecifier@748b243d",
    order -> 1,
    typeFullName -> "char"
  )

I don't know how it's getting org.eclipse.cdt.internal.core.dom.parser.c.CASTSimpleDeclSpecifier@748b243d but it's definitely wrong.
cpg.typ.l gives
res2: List[Type] = List(
  Type(id -> 101L, fullName -> "ANY", name -> "ANY", typeDeclFullName -> "ANY"),
  Type(id -> 102L, fullName -> "char", name -> "char", typeDeclFullName -> "char"),
  Type(id -> 103L, fullName -> "charVoid", name -> "charVoid", typeDeclFullName -> "charVoid"),
  Type(id -> 104L, fullName -> "int", name -> "int", typeDeclFullName -> "int"),
  Type(id -> 105L, fullName -> "void", name -> "void", typeDeclFullName -> "void")
)

which seems correct, but clearly it isn't making the connection between the char token in sizeof(char) and the type reference.

This is definitely wrong. Thanks for reporting. I'll have a look later on.


Aero enabled, white background blocking everything, trails when moving graph (video included)

The YouTube video should sum everything up about this bug.
https://youtu.be/Jo1_T0nV4FQ

Hi, thank you for creating an issue. This seems indeed like a hardware acceleration issue. I'm currently working on a solution to disable this without the missing run-without-gpu.bat - also a quick heads up win7 is not fully compatible with this tool.

0.6.5 (2020-03-16)

add hardware acceleration toggle as tray option (#329, #327)
add aero is enabled check


⚠ Bofrost.lu has degraded performance

In 5dc81df, Bofrost.lu (https://www.bofrost.lu) experienced degraded performance:

HTTP code: 200
Response time: 857 ms

Resolved: Bofrost.lu performance has improved in 32702b8.


Support for Meter Pro (CO2-Monitor)

Problem
The device „Meter Pro (CO2-Monitor)“ is currently not supported from the plugin.
The plugin logs:
Device: Meter Pro (CO2-Monitor) with Device Type: MeterPro(CO2), is currently not supported. Submit Feature Requests Here: https://tinyurl.com/SwitchBotFeatureRequest
Solution
Add support for „Meter Pro (CO2-Monitor)“ device.
Alternatives
No response
Additional context
No response

Can you try the latest beta:

Click here to find out how to install Beta

Thanks for the quick reply. I installed 4.1.4-beta.1.
Using device type "Meter" the device is now recogniced. But the values vor temperature, humidity and CO2 do not change. Staying on 30°, 50% and 0ppm.

I will return the sensor. For me it is important that all my devices are well integrated in my HomeKit setup. Potentially some day it will work with this sensor (incl. history data) but this is not the case at the moment. Since the return period is ending, I have to do this.
Thanks anyway for the first reply. Good luck with the Switchbot universe.

I have plugin version 4.1.5 and the CO2 sensor properly displays battery, humidity, and temperature. It says carbon dioxide is "not detected" and displays a value of 0.

Sorry I don't have a device to better integrate.


Autocompletion doesn't work anymore after upgrading git to version 2.20.0

Hello, starting from today autocompletion is not working anymore for basic git commands (e.g. push, checkout, pull, etc.), I'm running the latest stable release of gitsh.
The only possible reason I see for this behaviour is that today I upgraded git from 2.19.2-1 to 2.20.0-1 through regular system updates (Archlinux). Except from that I can't find or remember any other relevant change related to git since yesterday.
Let me know if there is any additional information I can provide
EDIT: I downgraded git back to version 2.19.2 and I can confirm that the autocompletion issue is happening only with git 2.20.0

@cippaciong Thanks for the report.
It looks like the way we're getting a list of Git commands no longer works. We parse git help -a, which is the way the official git-completion.sh script used to handle things before https://github.com/git/git/commit/6bb2dc0b9472a84c7d17ee93bda28a7c1c97d415 introduced a much better approach with git --list-cmds.
The format of git help -a has subsequently changed, so our parsing code no longer works. We should either update the parsing code, or switch to using --list-cmds.
Unfortunately the git(1) manual page says that --list-cmds …

is an internal/experimental option and may change or be removed in the future.

Whatever approach we take here, the Gitsh::GitRepository#commands method will need updating, and will probably need to support multiple Git versions.

Thanks for trying that out. The output I see on 2.20.0 from git help -a has command descriptions, which could be mistaken as other commands if we just change the regexp, e.g.
Main Porcelain Commands
   add                  Add file contents to the index
   am                   Apply a series of patches from a mailbox
   …

I worry this might correctly tab-complete add and am, but also incorrectly tab complete Apply, file, contents, etc.
We already have some version-dependent code in this class (e.g. #available_config_variables tries two techniques depending on the Git version), so I wonder if making this try something like git --list-cmds then fall back to a modern git help -a approach, and finally the older git help -a approach would be the most robust thing.

The output I see on 2.20.0 from git help -a has command descriptions

You're right! I don't know how I failed to notice command descriptions :sweat_smile: and indeed they are incorrectly added to tab-completion.

I don't know how I failed to notice command descriptions

I failed to notice this entire bug, so I think you're still ahead on noticing things 😉

I talked this through with some folk at thoughtbot who had various Git versions installed, and we discovered that git help -a --no-verbose outputs the old help -a format on recent Git versions, but is an error on older Git versions.
Seems like the right approach is:

Try git --list-cmds
Fall back to git help -a --no-verbose expecting the old format
Fall back to git help -a expecting the old format

https://github.com/git/git/commit/26c7d0678324d99b56d3044acfdfab57ee670af4 is where --no-verbose is introduced.
Thanks @edwardloveall, @iwz, @mike-burns, and @sharplet !

I'm now running git 2.20. thanks for prompting me to upgrade, @georgebrock :)

@iwz But now gitsh won't work! 😱

Fix in progress: #337


FIRE: Refuse to flag if the user has more than 10% rejected/retracted spam flags on that site

See https://chat.stackexchange.com/transcript/message/43236347#43236347 for context
I'm suggesting that FIRE, our most used tool should refuse to automatically flag posts if the users declined/retracted spam flag ratio is higher than a safe 10% if the user has more than 10 flags for that site (so about 1 bad flag for every 9 good ones) (could be made more strict, but I think that would be a safe initial limit)
The reason I;m suggesting to do this from FIRE, instead of making moderators send mod messages, is the fact that silently failing to submit a flag, with a notification containing a message to the user that he should flag the post manually is more effective against the robo reviewer flaggers
I'm also suggesting that we put the limit under the settings of FIRE, so if the check starts acting up (or there is someone new who has made a few mistakes in the past, but is good now) it can be bypassed without having said person change the source of the script directly, and effectively locking him out of future updates

The flag ratio is data that's not accessible from Stack Exchange's API, not even when a user is authorized.
The way the global flag summary script obtains the ratio, is by scraping every single site's "flags" page, for that user.
That's something I'm not willing to implement in FIRE.


Broken link in Content > Icons

On the Content page, when I click on the "button classes" link, I see the 404 Github page.
To reproduce:

Go to https://jdrf.github.io/design-system/dist/content.html
Scroll down to Icons
Click "button classes"

Merged and confirmed as fixed.


Kafka-Rest Jmx config is incorrect

Docker image is expecting configuration to be specified as KAFKAREST_JMX_PORT
https://github.com/confluentinc/cp-helm-charts/blob/5dc3317b75812f8268fa2aed26ec332ff02e8a63/charts/cp-kafka-rest/templates/deployment.yaml#L84

It's not loaded into the config file, so it's actually just JMX_PORT
https://github.com/confluentinc/kafka-rest/blob/master/bin/kafka-rest-run-class#L53

CLOSED by #470


Restic unnecessarily rescans files when referring to them with different paths

Output of restic version
restic 0.9.5 compiled with go1.12.9 on linux/arm
How did you run restic exactly?
restic --repo<EMAIL_ADDRESS>backup /data/Music/CDs

What backend/server/service did you use to store the repository?
Restic rest server
Expected behavior
Restic should avoid rescanning the same files when they are referred to with a different path, where possible. For instance the contents are checked when backing up $(pwd) immediately after backing up ..
Actual behavior
Restic rescans these files.
Steps to reproduce the behavior

Create a directory /foo/bar with many large files
Navigate to /foo/bar
Backup this directory using a relative path restic backup .

Observe that this takes a very long time to backup as it has to upload the files

Backup this directory again using a relative path restic backup .

Observe that this is very fast as the files do not even need to be rescanned as their inode number and ctime's are the same as what was just uploaded

Backup this directory using an absolute path restic backup $(pwd)

Observe that this operation is much slower as restic is reading the files (although not uploading them)

Restic also seems to rescan the files in /foo/bar when backup up /foo after the example above.

Do you have any idea what may have caused this?
I suppose that restic is using the non-absolute path to the files as part of the determination of whether to rescan them.
Do you have an idea how to solve the issue?
I suppose restic could canonicalize the paths before deciding whether to recheck. I was surprised that the filename featured here at all actually, I'd have thought that checking the inode would be sufficient.
Did restic help you today? Did it make you happy in any way?
Very happy indeed! What a great bit of software! Thank you!

Here is a verbose log demonstrating that restic believes the files are new and not unchanged
$ restic --repo<EMAIL_ADDRESS>backup $(pwd) -vvvv
open repository
repository d528392f opened successfully, password is correct
lock repository
load index files
using parent snapshot b1964d52
start scan on [/data/music/CDs]
start backup on [/data/music/CDs]
new       /data/music/CDs/1/10cc/10cc (+ 5 Bonustracks)/01 - Johnny Don't Do It - 10cc (+ 5 Bonustracks) - 10cc.mp3, saved in 0.487s (0 B added)
new       /data/music/CDs/1/10cc/10cc (+ 5 Bonustracks)/02 - Sand In My Face - 10cc (+ 5 Bonustracks) - 10cc.mp3, saved in 0.824s (0 B added)
new       /data/music/CDs/1/10cc/10cc (+ 5 Bonustracks)/03 - Donna - 10cc (+ 5 Bonustracks) - 10cc.mp3, saved in 0.987s (0 B added)
new       /data/music/CDs/1/10cc/10cc (+ 5 Bonustracks)/04 - The Dean And I - 10cc (+ 5 Bonustracks) - 10cc.mp3, saved in 1.164s (0 B added)
new       /data/music/CDs/1/10cc/10cc (+ 5 Bonustracks)/05 - Headline Hustler - 10cc (+ 5 Bonustracks) - 10cc.mp3, saved in 0.967s (0 B added)
new       /data/music/CDs/1/10cc/10cc (+ 5 Bonustracks)/06 - Speed Kills - 10cc (+ 5 Bonustracks) - 10cc.mp3, saved in 1.341s (0 B added)
new       /data/music/CDs/1/10cc/10cc (+ 5 Bonustracks)/07 - Rubber Bullets - 10cc (+ 5 Bonustracks) - 10cc.mp3, saved in 0.966s (0 B added)
signal interrupt received, cleaning up

$ restic --repo<EMAIL_ADDRESS>backup . -vvvv
open repository
repository d528392f opened successfully, password is correct
lock repository
load index files
using parent snapshot b1964d52
start scan on [.]
start backup on [.]
unchanged /1/10cc/10cc (+ 5 Bonustracks)/01 - Johnny Don't Do It - 10cc (+ 5 Bonustracks) - 10cc.mp3
unchanged /1/10cc/10cc (+ 5 Bonustracks)/02 - Sand In My Face - 10cc (+ 5 Bonustracks) - 10cc.mp3
unchanged /1/10cc/10cc (+ 5 Bonustracks)/03 - Donna - 10cc (+ 5 Bonustracks) - 10cc.mp3
unchanged /1/10cc/10cc (+ 5 Bonustracks)/04 - The Dean And I - 10cc (+ 5 Bonustracks) - 10cc.mp3
unchanged /1/10cc/10cc (+ 5 Bonustracks)/05 - Headline Hustler - 10cc (+ 5 Bonustracks) - 10cc.mp3
unchanged /1/10cc/10cc (+ 5 Bonustracks)/06 - Speed Kills - 10cc (+ 5 Bonustracks) - 10cc.mp3
unchanged /1/10cc/10cc (+ 5 Bonustracks)/07 - Rubber Bullets - 10cc (+ 5 Bonustracks) - 10cc.mp3

Backup this directory again using a relative path restic backup .

Observe that this is very fast as the files do not even need to be rescanned as their inode number and ctime's are the same as what was just uploaded

Backup this directory using an absolute path restic backup $(pwd)

Observe that this operation is much slower as restic is reading the files (although not uploading them)

If you in the second point specify the snapshot ID of the previous point using the --parent flag, does that change anything?

@rawtaz No difference sadly.

A quick look in the code reveals that fileChanged doesn't look at the file path.
https://github.com/restic/restic/blob/c542a509f08a92fe499932d826c5af07d3977525/internal/archiver/archiver.go#L448-L482
So I guess that it's not identifying the file as the same node because that depends on the filename.

Just a hunch, but does the problem go away if you change fs.fixpath to return filepath.Abs(name)?

@greatroar Unfortunately that doesn't seem to make any difference:
With the patched restic, having already uploaded this with the non-patched version:
I navigate to a directory which is part of a larger backup, i.e. I have never backed up this directory alone but I have backed its parent directory with an absolute path.
I backup .. No new content is added, but the files are marked as new (and their contents are read)
 $ restic --repo<EMAIL_ADDRESS>backup . -vvvv
open repository
repository d528392f opened successfully, password is correct
lock repository
load index files
start scan on [.]
start backup on [.]
scan finished in 25.147s: 12 files, 146.730 MiB
new       /02 - Slewfoot - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 0.541s (0 B added)
new       /01 - Green, Green Grass of Home - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 0.646s (0 B added)
new       /03 - Mountains of the Moon - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 1.796s (0 B added)
new       /04 - Doin' That Rag - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 1.227s (0 B added)
new       /06 - Mama Tried - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 0.409s (0 B added)
new       /05 - China Cat Sunflower - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 2.243s (0 B added)
new       /07 - High Time - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 1.151s (0 B added)
new       /09 - The Other One - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 0.783s (0 B added)
new       /08 - Dark Star - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 2.230s (0 B added)
new       /10 - Saint Stephen - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 1.663s (0 B added)
new       /11 - The Eleven - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 2.953s (0 B added)
new       /12 - Turn On Your Lovelight - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 2.807s (0 B added)

Files:          12 new,     0 changed,     0 unmodified
Dirs:            0 new,     0 changed,     0 unmodified
Data Blobs:      0 new
Tree Blobs:      0 new
Added to the repo: 0 B

processed 12 files, 146.730 MiB in 0:33
snapshot e0a5b883 saved

I backup . again, the files are correctly identified as unchanged.
 $ restic --repo<EMAIL_ADDRESS>backup . -vvvv
open repository
repository d528392f opened successfully, password is correct
lock repository
load index files
using parent snapshot e0a5b883
start scan on [.]
start backup on [.]
scan finished in 25.627s: 12 files, 146.730 MiB
unchanged /01 - Green, Green Grass of Home - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3
unchanged /02 - Slewfoot - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3
unchanged /03 - Mountains of the Moon - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3
unchanged /04 - Doin' That Rag - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3
unchanged /05 - China Cat Sunflower - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3
unchanged /06 - Mama Tried - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3
unchanged /07 - High Time - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3
unchanged /08 - Dark Star - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3
unchanged /09 - The Other One - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3
unchanged /10 - Saint Stephen - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3
unchanged /11 - The Eleven - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3
unchanged /12 - Turn On Your Lovelight - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3

Files:           0 new,     0 changed,    12 unmodified
Dirs:            0 new,     0 changed,     0 unmodified
Data Blobs:      0 new
Tree Blobs:      0 new
Added to the repo: 0 B

processed 12 files, 146.730 MiB in 0:26
snapshot 748c9961 saved

I back up this directory with an absolute path, the files are incorrectly identified as new.
 $ restic --repo<EMAIL_ADDRESS>backup "$(pwd)" -vvvv
open repository
repository d528392f opened successfully, password is correct
lock repository
load index files
using parent snapshot 748c9961
start scan on [/data/music/InternetMP3/Grateful Dead/1969/690712]
start backup on [/data/music/InternetMP3/Grateful Dead/1969/690712]
scan finished in 31.305s: 12 files, 146.730 MiB
new       /data/music/InternetMP3/Grateful Dead/1969/690712/02 - Slewfoot - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 0.372s (0 B added)
new       /data/music/InternetMP3/Grateful Dead/1969/690712/01 - Green, Green Grass of Home - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 0.714s (0 B added)
new       /data/music/InternetMP3/Grateful Dead/1969/690712/04 - Doin' That Rag - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 1.211s (0 B added)
new       /data/music/InternetMP3/Grateful Dead/1969/690712/03 - Mountains of the Moon - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 1.731s (0 B added)
new       /data/music/InternetMP3/Grateful Dead/1969/690712/06 - Mama Tried - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 0.460s (0 B added)
new       /data/music/InternetMP3/Grateful Dead/1969/690712/05 - China Cat Sunflower - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 1.956s (0 B added)
new       /data/music/InternetMP3/Grateful Dead/1969/690712/07 - High Time - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 1.075s (0 B added)
new       /data/music/InternetMP3/Grateful Dead/1969/690712/09 - The Other One - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 0.973s (0 B added)
new       /data/music/InternetMP3/Grateful Dead/1969/690712/08 - Dark Star - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 1.988s (0 B added)
new       /data/music/InternetMP3/Grateful Dead/1969/690712/10 - Saint Stephen - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 1.747s (0 B added)
new       /data/music/InternetMP3/Grateful Dead/1969/690712/11 - The Eleven - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 2.506s (0 B added)
new       /data/music/InternetMP3/Grateful Dead/1969/690712/12 - Turn On Your Lovelight - 1969-07-12 - NY State Pavilion, Flushing Meadow Park - Grateful Dead.mp3, saved in 2.841s (0 B added)
new       /data/music/InternetMP3/Grateful Dead/1969/, saved in 7.031s (0 B added, 356 B metadata)
new       /data/music/InternetMP3/Grateful Dead/, saved in 7.041s (0 B added, 352 B metadata)
new       /data/music/InternetMP3/, saved in 7.045s (0 B added, 363 B metadata)
new       /data/music/, saved in 7.048s (0 B added, 361 B metadata)
new       /data/, saved in 7.051s (0 B added, 352 B metadata)

Files:          12 new,     0 changed,     0 unmodified
Dirs:            5 new,     0 changed,     0 unmodified
Data Blobs:      0 new
Tree Blobs:      6 new
Added to the repo: 2.086 KiB

processed 12 files, 146.730 MiB in 0:40
snapshot bd8773ad saved

Too bad.

A snapshot internally keeps track of the backup target path via which it was reached, which prevents it from being reused. Restic considers the files backed-up using . to reside directly in the root directory, while for /data/... it remembers the full path. You'd have to convert the relative backup target path to an absolute path before restic starts to assemble the backup tree: https://github.com/restic/restic/blob/c542a509f08a92fe499932d826c5af07d3977525/internal/archiver/archiver.go#L735
Not all filesystems provide an inode value or ensure stable inodes. Coupled with multiple filesystems an inode is no longer unique and the device id is not guaranteed to be unique, so inodes probably won't work to reliably identify identical files.
Do you have a specific use-case in mind where you would use different paths to refer to the same backup target?

I don't really have a use case for this, it's more that I bumped into this with a large backup set on a slow machine (armv7l, no hardware encryption support). What would be the downside to doing as you mentioned and converting to absolute paths first when backing up? I suppose one could do this as a user by aliasing restic backup x to restic backup $(readlink -f x) or something.

One downside is that it directly conflicts with other use cases like https://github.com/restic/restic/issues/2564, where the user wants the symlink name in the snapshot. Your readlink solution seems reaonable.

@smlx, yeah, that's true. I think the use case presented in #2564 is more important. I wonder if instead doing the equivalent of restic backup $(pwd)/x when x is a relative path would solve this issue without interfering with #2564.

The conversion from a relative to an absolute path should happen outside restic. There are some use cases like #555, #2010 which would break by automatically converting relative to absolute paths. In addition such a conversion would change the location of directories within a snapshot that were specified using a relative path.

Understood :) thanks. Happy to mark this as resolved now unless you think
this behaviour should be documented somewhere
On Sun, Mar 22, 2020, 6:33 AM MichaelEischer<EMAIL_ADDRESS>wrote:

The conversion from a relative to an absolute path should happen outside
restic. There are some use cases like #555
https://github.com/restic/restic/issues/555, #2010
https://github.com/restic/restic/pull/2010 which would break by
automatically converting relative to absolute paths. In addition such a
conversion would change the location of directories within a snapshot that
were specified using a relative path.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/restic/restic/issues/2641#issuecomment-602114105, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAGRJXH5534VB35PZNOSWP3RIU6FBANCNFSM4LFL7IPQ
.

Currently the documentation says the following:

Please be aware that when you backup different directories (or the directories to be saved have a variable name component like a time/date), restic always needs to read all files and only afterwards can compute which parts of the files need to be saved.

So at least the documentation is not particularly precise in that regard. Right now I don't have a good idea on how to word this more precisely without causing more confusion than it's worth.
I've just noticed that the snapshot object itself always stores absolute paths of the backup directories, whereas the the backup tree uses a relative/absolute path just as specified. This might lead to some surprising behavior when switching back and forth between a relative and an absolute path. But it's probably a good idea not to confuse different directories but with the same relative path with each other.


Odin raceswap

Creates the Raceswap Variants for missions Engine of Destruction and Media Blitz, along with reworking a function used with raceswap and applying it to previous raceswap maps.
Changes to all raceswap maps
Added an extra parameter to a raceswap function, that allows a boolean toggle for the lair to be upgraded to a hive or not. If new parameter equals false, a lair is created for zerg raceswap, but if it equals true then a hive is created instead. Created for ease of use in future raceswap maps that require a hive.
Engine of Destruction.
Added extra stats/regeneration to Tychus during the starting section for both races.
After starting section, made following changes:
Zerg
Wraiths at the start are replaced by Corruptors. The Odin now also has the biological tag, for Swarm Queen healing, and now has innate health regeneration.
Protoss
Wraiths at the start are replaced by Void Rays. The Odin now has 1000 life and 1500 shields, and has innate shield regeneration.
Media Blitz
Similar stats changes to Odin made here, although not as drastic. Odin still has biological as zerg, but slightly less health regeneration. Odin still has shields as protoss, but only 500 shields and 2000 life now.

Made fixes recommended by Ziktofel

Add Shield upgrades for Ordin/Tychus if they have their armor upgrades (their armor upgrades are handled in ArchipelagoPlayerWoL mod) for consistency with other Terran units that have shields

Made fixes to Odin/Tychus shields on protoss variants


user-guide: add "Define remote through another remote"

From https://github.com/iterative/dvc/issues/1614
Related https://github.com/iterative/dvc.org/issues/108

No worries, thanks for the follow up. I read https://github.com/iterative/dvc/issues/1614#issue-410750987 and I think probably this would be a relatively short note or section so not sure its worth a full new guide. Maybe just another section of dvc remote add

This is too complicated, I haven't seen a need for this tbh. Let's not document this for now.

Well, users are using this and this is the only appropriate method available right now. Reopening.

Closing in favor of https://github.com/iterative/dvc.org/issues/4804


Support all ScratchOrgInfo keys when generating a scratch org

MetaDeploy now supports all keys on the ScratchOrgInfo object when generating a scratch org.
Note that objectSettings is not currently supported because of a weakness in the underlying CumulusCI OrgSettings task. A separate PR will cure that with no further changes to MetaDeploy.

Pending E2E test

E2E tests pass on local. Also fixes a previously unknown bug: failing to poll for scratch org completion that takes more than an unspecified very short time.


replace axios link to local source, some Some countries cannot access unpkg.com

Good catch, thank you!


enhance p2p, basic cli support added to raag

P2P suppport using multicastDNS added, replacing kademlia DHT added.
Basic cli support via Cobra added (this can be changed to bubbletea later)
Graceful shutdown, basic logging, config flags added.

please resolve the merge conflicts @kraytos17


Update to go 1.19

What type of PR is this?

/kind cleanup
What this PR does / why we need it:
Update to go 1.19
Which issue(s) this PR fixes:

Fixes #
Special notes for your reviewer:

Please bump tag in Makefile.
Is it possible to bump directly to go1.19.6?

Please bump tag in Makefile.
Is it possible to bump directly to go1.19.6?

Updated the tag.
I am following https://go.dev/ref/mod#go-mod-file-go, and it looks like we only use minor version in the mod file.

@jprzychodzen @wojtek-t gentle ping on the review

Please bump tag in Makefile.
Is it possible to bump directly to go1.19.6?

Updated the tag.
I am following https://go.dev/ref/mod#go-mod-file-go, and it looks like we only use minor version in the mod file.

Right, I've mixed it up with a Bazel.
/lgtm
/approve
/assign @marseel
@marseel , could you approve?


No gas consumption

Before this integration I used the MultiMATIC Integration, which showed Gas consumption for heating and hot water.
These entities are empty in this myVAILLANT-Imtegration but are still shown in the myVAILLANT-App.
I‘m using Vaillant ecotherm with VRC900

It is working here..

@ZaphodB72 has it started working for you?

Yes, it’s working now! Thank you!


Add php 8.4 to the list of runtimes

With PHP 8.4's release around the corner, developers might want to start testing it. I added PHP 8.4 to the list of runtimes.
While creating this pull request, I discovered two issues:

The imagick PHP extension cannot load due to a removed function. (a fix is currently being developed, https://github.com/Imagick/imagick/pull/690)
The Swoole extension for PHP 8.4 still needs to be released. (so I commented this out in the Dockerfile)

Can you add PHP 8.4 to the Docker Compose Tests Matrix?

Thanks!


Create Character.txt

Not a code, doesn't even achieve some objective. Improve yourself.

hello sir, i was unaware of the prs then but i got labeled as invalid can u please remove the label as i want to participate in hacktober fest, i need to get those labels removed there are three of them. please kindly help i would definately improve on this. and promise not to do such things again..

@harmeetsinghjsr Thank you for your acknowledgement. Have a good day.


TOC Depth

Hi, I was wondering if the TOC depth is a parameter that could be exposed ?
I tried looking through the theme config files and partials, but couldn't figure a way to enable H4 and H5 headings...
Any thoughts on how this could be achieved?
(and thanks for the nice an clean theme!)

This can be configured through the markup settings. Refer to hugo's doc.


Build Bot comments on failed builds

So before I get working on the site plan, I wanted to throw this idea out. I wrote a bot that will comment on a pull request if the build fails, giving the user a notification/email that their submission failed, instead of having to wait for a poor maintainer to come along and review. You can see an example on my fork here.

The Build Bot program can be referenced here

Could we setup a user for Comments?

Well I did a bit more digging and I'm thinking to actually scrap all this work in favor of just enabling emails to be sent by Travis to the contributor in the event of a failure.
If that doesn't work out, yes we could easily set up a bot user to manage comments.

Let’s try that option first :)

Will enable emails as a first line of defense 🤺


Fix reporting PM2.5 value in IKEA Starkvind quirk

Proposed change
An IKEA Starkvind device was not showing a PM2.5 sensor in Home Assistant. Upon investigation, Python was throwing a TypeError: 'set' object is not subscriptable in read_attributes. This appears to be because code in starkvind.py was calling read_attributes with a set for the attributes arg, but the type signature says that argument should be a list. So I made that very simple change.
Additional information
I'm brand new to this project and unfamiliar with the code. But the way the code is structured here (a call to one attribute in the PM2.5 cluster is redirected to another attribute in a custom manufacturer cluster) feels a little odd -- is there a different best practice to do this? In particular, with the current code, it looks like if PM25Cluster.read_attributes is called with multiple attributes at once, one of which is measured_value, it will quietly return only one attribute in its response and ignore any others.
Checklist

[x] The changes are tested and work correctly
[x] pre-commit checks pass / the code has been formatted using Black
[x] Tests have been added to verify that the new code works

Nice catch!
(Note: Attribute reporting also works without this change, as that doesn't use the read_attributes method, but only update_attribute.
However, the sensor entity in HA is missing up until restarting (under the requirement that you have received at least one attribute report prior to the restart).)

it looks like if PM25Cluster.read_attributes is called with multiple attributes at once, one of which is measured_value, it will quietly return only one attribute in its response and ignore any others.

Yes.
Although the following approach also isn't ideal IMO, see the changes in this PR (they should properly deal with multiple attributes in one read call): https://github.com/zigpy/zha-device-handlers/pull/2238/files


Add data gapminder and scientist for basic exploratory case

files :

gapminder.tsv
scientist.csv

issue has been solved


This does not exist anymore, but there is "az webapp ssh"

This does not exist anymore, but there is "az webapp ssh"

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 04a67a6a-b2b8-ed24-bb78-e9773fef6d86
Version Independent ID: beeae428-5c77-4501-0ab5-a7301971f058
Content: az webapp remote-connection
Content Source: latest/docs-ref-autogen/ext/webapp/webapp/remote-connection.yml
Service: app-service
GitHub Login: @rloutlaw
Microsoft Alias: routlaw

why there is no response to this issue - obviously the article is old and cli complains with the error

@panchagnula for comment

@amitmawkin this does exist in the extension & az webapp ssh exists on the core, & the new one works on Mac or Linux only & is recommended to be used in that scenario.
@rramachand21 & @patricklee2 & @yiliaomsft comment on the future of the command on extensions

@patricklee2 please move the remote connection to core as well. We should support this for remote debugging scenarios.

fixed in https://github.com/Azure/azure-cli/pull/9207


make fails with rust nightly (2016-09-15)

Hello there!
First of all, thanks for the amazing talk at RustFest!
I'm assuming this is the repo which contains source to the demo that you've done.
And I'm trying to run it on my debian unstable, which has gcc 6.2.0 and rustc 1.13.0-nightly (1265cbf4e 2016-09-15)
Although libmy_os.a is built without errors, ld fails to link it.
please ignore the warning
I reshaped lines  for easier reading
   Compiling rlibc v0.1.4
   Compiling my_os v1.0.0 (file:///home/cengiz/Code/rust/x86-kernel)
warning: this feature has been stable since 1.6.0. Attribute no longer needed, #[warn(stable_features)] on by default
 --> src/lib.rs:1:12
  |
1 | #![feature(no_std)]
  |            ^^^^^^

    Finished debug [unoptimized + debuginfo] target(s) in 0.21 secs

target/x86_64-unknown-linux-gnu/debug/libmy_os.a(my_os.0.o):

In function `core::option::{{impl}}::map<&u8,(usize, &u8),closure>':
/buildslave/rust-buildbot/slave/nightly-dist-rustc-linux/build/obj/../src/libcore/option.rs:383:
undefined reference to `_Unwind_Resume'

target/x86_64-unknown-linux-gnu/debug/libmy_os.a(my_os.0.o):
In function `core::iter::{{impl}}::next<core::slice::Iter<u8>>':
/buildslave/rust-buildbot/slave/nightly-dist-rustc-linux/build/obj/../src/libcore/iter/mod.rs:1107:
undefined reference to `_Unwind_Resume'

Makefile:33: recipe for target 'build/kernel-x86_64.bin' failed
make: *** [build/kernel-x86_64.bin] Error 1

Maybe we should pass libc to ld also.
I'm out of ideas.

2 additions to my submission:

-Z no-landing-pads seems to be deprecated
This issue seems relevant: https://github.com/rust-lang/rust/issues/34409

hi @cengizIO ! thanks for this. this repo is actually a bit old. the demos in my talk live here: https://github.com/intermezzOS/rustfest2016/tree/gh-pages/demos
that being said- i should probably fix this one too. i'll check it out today! thanks for such a detailed issue :)


Remove Superfluous Check for Zero-Length List

Checking for zero-length is not necessary here as iterating over a zero-length list is perfectly valid, and produces exactly zero iterations, matching the intended behaviour without an extra check.

@ankitpati nice!  Merging.


Category 'Others'

I propose we introduce a new category named 'Others'. This would include all classes that are not picked up by any of the classifiers and therefore display statistics for the custom stuff as well.
I have an implementation in mind. What do you think?

Yeah that could be useful. With the new "Others" category you would actually see how many classes and LoC your application has.
In it's current state you would only see the "Basic" Laravel components and you would have to use the phploc command yourself to get a useful number.
I'm open for PRs 👍


Result of tf.reshape() with dynamic shape does not work with tf.train.shuffle_batch()

I wrote the images into TensorFlow format file, but when I read it like this:
features = tf.parse_single_example(
            serialized_example,
            features = {
                'height': tf.FixedLenFeature([], tf.int64),
                'width': tf.FixedLenFeature([], tf.int64),
                'channel': tf.FixedLenFeature([], tf.int64),
                'image': tf.FixedLenFeature([], tf.string),
                'gt': tf.FixedLenFeature([], tf.string),
            })

first, the data has no shape infomation, only the batch size, so I reshape it, but parameter shape of tf.reshape() only support list of integers, not a tensor, I don't know why?
second, the data of gt is list, maybe length(gt) > 2, because no shape information, so I can't unpack it
so, why is not shape information available

The tf.reshape() op supports a tf.Tensor or a list of integers for the shape argument. How are you invoking it and what error are you seeing?

@mrry ， yes, I do it like this:
image = tf.reshape(image, tf.pack([height, width, channel]))

where height, width and channel are tensors, but it turns out that:
All shapes must be fully defined: [TensorShape([Dimension(None), Dimension(None), Dimension(None)]), TensorShape([Dimension(512), Dimension(512)]), TensorShape([Dimension(3)])]
in the line of tf.train.shuffle_batch() call
I have no idea about it.

Ah, so the tf.reshape() works as intended, but you then use the result in a call to tf.train.shuffle_batch() and that fails? I'm afraid that this is expected behavior.
As the docs for tf.train.shuffle_batch() say, you must either have fully-defined (i.e. static) shapes for all of the tensors you pass in the tensor_list argument (or you must specify explicit shapes for them). For TensorFlow to batch your images (or other tensors) together, they must all have the same shape. You cannot pass the result of a dynamic tf.reshape(), because each element might have a different shape, and TensorFlow cannot batch them.
Your best option is to resize, crop, or pad the input images to a static shape before passing them to tf.train.shuffle_batch(). For example, the Inception input pipeline uses  tf.image.resize_images() to resize images to a standard size, so that they can be batched (using tf.train.batch_join() in this case).

sorry than it's my faulst. I think I know how to read tensorflow records
codes below:
def read_and_decode(filename_queue, image_shape):
        reader = tf.TFRecordReader()
        _, serialized_example = reader.read(filename_queue)

        features = tf.parse_single_example(
            serialized_example,
            features = {
                'height': tf.FixedLenFeature([], tf.int64),
                'width': tf.FixedLenFeature([], tf.int64),
                'channel': tf.FixedLenFeature([], tf.int64),
                'image': tf.FixedLenFeature([], tf.string)
            })

        # Convert from a scalar string tensor
        image = tf.decode_raw(features['image'],  tf.uint8)

        #set static shape, or you can't reshape a image to [h, w, c]
        image.set_shape(reduce(lambda x, y : x * y,  image_shape))

       #reshape to [h, w, c]
        image = tf.reshape(image,  image_shape)

although I write shape [height, width, channel] into records file, but it has nothing to do.

If you know that image has a static shape [h, w, c], where h, w, and c are Python int values, you can simply call:
image.set_shape([h, w, c])

...and you don't need the tf.reshape() because it should be a no-op. Then your code will work with tf.train.shuffle_batch().

Closing this, as there's no bug. Feel free to ask on Stack Overflow if you have questions about how to build input pipelines, however.

@mrry
I have a question, since when writing the TFRecords file, the height, width and channels information have already been written into the file, how can I use the information from the file(not explicit specify from outside) to set shape of the flatten image data?

same question as @wangchuan
Did you find a way to tackle this problem? @mrry

Look here @wangchuan http://stackoverflow.com/questions/35620157/how-can-i-use-values-read-from-tfrecords-as-arguments-to-tf-reshape
@mrry already answered this question.

In fact, height or width read from tfrecords is a tensor,  so we don't know its value until sess.run(height). the problem is that when the feature of image is used in fc layer,  we can't initialize a weight of fc layer, because the shape of the feature is None.
so when reading images with different shape, and keep the shape of image in training, I am not sure how to it. if using tf.placeholder(), maybe I/O is the problem, of course I can use multi-thread and a queue

@mrry Hi, I use image.set_shape([64, 256, 3]).But it have a new ValueError: Shapes (?,) and (64, 256, 3) are not compatible.I don't know how to fix it.

@JcmeLs It sounds like you want to change the shape of the tensor rather than updating its static information, so you should use tf.reshape(image) instead.

@mrry I want to get image from tfrecord and put it in the batch.The code is:
        image=tf.decode_raw(features['image'],tf.uint8)
        image=tf.reshape(image,tf.stack([64,256,3]))
        label=tf.decode_raw(features['label'],tf.uint8)
        image_batch,label_batch=tf.train.batch([image,label],batch_size=64,num_threads=64,capacity=2000)

But,when I run this code.It will hava ValueError: All shapes must be fully defined: [TensorShape([Dimension(64), Dimension(256), Dimension(3)]), TensorShape(None)].So I try image.set_shape([64, 256, 3]) .But I get the new ValueError: Shapes (?,) and (64, 256, 3) are not compatible

@JcmeLs That error message indicates that label is a rank-1 tensor (vector) of unknown length. You'll need to either set its shape or reshape it as well. I'm guessing that the following will work, but it's not entirely clear without more context:
label = tf.reshape(label, [])  # Reshape to a scalar.

@mrry Thanks,It can work now.But when I take data from the batch many times, it will be error.OutOfRangeError (see above for traceback): FIFOQueue '_1_batch/fifo_queue' is closed and has insufficient elements (requested 64, current size 0) 	 [[Node: batch = QueueDequeueManyV2[component_types=[DT_UINT8, DT_UINT8], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"](batch/fifo_queue, batch/n)]]My queue code:
    coord=tf.train.Coordinator()
    threads=tf.train.start_queue_runners(sess=sess,coord=coord)

batch code:
    image_batch, label_batch = tf.train.batch([distorted_image, label],
                                              batch_size=batch_size,
                                              num_threads=4,
                                              capacity=2000)

Is this queue not looping? Due to the small amount of data, I would like to increase my data through data augmentation. But it have OutOfRangeError.

I fix it.Thanks again.

@JcmeLs  Hi JcmeLs. My code worked well in tf v0.8.0. I updated the tf.pack in tf v0.8.2 to tf.stack in tf v1.2.0. It reported the same error: '''OutOfRangeError (see above for traceback): FIFOQueue '_1_batch/fifo_queue' is closed and has insufficient elements (requested 1, current size 0) [[Node: batch = QueueDequeueManyV2[component_types=[DT_UINT8, DT_UINT8], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"](batch/fifo_queue, batch/n)]]'''
The following are all of my changes.
original code in tf v0.8.2:
'''
'''

@JcmeLs  Hi JcmeLs. My code worked well in tf v0.8.0. I updated the tf.pack in tf v0.8.2 to tf.stack in tf v1.2.0. It reported the same error:
OutOfRangeError (see above for traceback): FIFOQueue '_1_batch/fifo_queue' is closed and has insufficient elements (requested 1, current size 0) [[Node: batch = QueueDequeueManyV2[component_types=[DT_UINT8, DT_UINT8], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"](batch/fifo_queue, batch/n)]]
The following are all of my changes.
original code in tf v0.8.2:
new_shape = tf.pack([scale,scale])
img = tf.image.resize_images(img, new_shape[0], new_shape[1])

changed code in tf v1.2.0
new_shape = tf.stack([scale,scale])
img = tf.image.resize_images(img, [new_shape[0], new_shape[1]])

So how did you solve the  '_1_batch/fifo_queue' is closed and has insufficient elements' error?
thanks.


can not connect to opensearch as of application .env openhost connection env var auto created but not apply to .env file

for example:
OPENSEARCH_SECRETS_URL_HOST=opensearch-host-url-e58525
OPENSEARCH_SECRETS_USERNAME_PASSWORD=opensearch-master-user-e58525
const OSMasterUserSecretNamePrefix = 'opensearch-master-user'; // Add the secret name here
const guid = crypto.randomBytes(3).toString('hex');
this.OSMasterUserSecretName = ${OSMasterUserSecretNamePrefix}-${guid};
OSMasterUserSecretName are different , so need to manual rebuild docker file , can not use cdk to apply changes

the OPENSEARCH_SECRETS_URL_HOST and OPENSEARCH_SECRETS_USERNAME_PASSWORD will be generated dynamically during each time of cdk deploy

generate open search stack
copy dynamically generated OPENSEARCH_SECRETS_URL_HOST OPENSEARCH_SECRETS_USERNAME_PASSWORD to .env file
deploy ecs stack, at this time point the opensearch stack will be update and generated a new host url and secrets username, which resulting in a loop th update .env file under application folder

my workaround solution like this :
const OSMasterUserSecretNamePrefix = 'opensearch-master-user'; // Add the secret name here
//const guid = crypto.randomBytes(3).toString('hex');
const guid = 'capgemini-chatbi'

streamlit app still got below error:
File "/usr/local/lib/python3.10/site-packages/streamlit/runtime/scriptrunner/script_runner.py", line 584, in _run_script
exec(code, module.dict)
File "/app/pages/mainpage.py", line 36, in
VectorStore.add_entity_sample(current_profile, entity, comment)
File "/app/nlq/business/vector_store.py", line 95, in add_entity_sample
has_same_sample = cls.search_same_query(profile_name, 5, opensearch_info['ner_index'], embedding)
File "/app/nlq/business/vector_store.py", line 203, in search_same_query
search_res = cls.search_sample_with_embedding(profile_name, top_k, index_name, embedding)
File "/app/nlq/business/vector_store.py", line 198, in search_sample_with_embedding
sample_list = cls.opensearch_dao.search_sample_with_embedding(profile_name, top_k, index_name, query_embedding)
File "/app/nlq/data_access/opensearch.py", line 241, in search_sample_with_embedding
response = self.opensearch_client.search(
File "/usr/local/lib/python3.10/site-packages/opensearchpy/client/utils.py", line 181, in _wrapped
return func(*args, params=params, headers=headers, **kwargs)
File "/usr/local/lib/python3.10/site-packages/opensearchpy/client/init.py", line 1742, in search
return self.transport.perform_request(
File "/usr/local/lib/python3.10/site-packages/opensearchpy/transport.py", line 448, in perform_request
raise e
File "/usr/local/lib/python3.10/site-packages/opensearchpy/transport.py", line 409, in perform_request
status, headers_response, data = connection.perform_request(
File "/usr/local/lib/python3.10/site-packages/opensearchpy/connection/http_urllib3.py", line 290, in perform_request
self._raise_error(
File "/usr/local/lib/python3.10/site-packages/opensearchpy/connection/base.py", line 316, in _raise_error
raise HTTP_EXCEPTIONS.get(status_code, TransportError)(

Hello，Thank you for raising the issue.
This issue will be fixed in version 1.8 by changing the guid to VPC ID. Thank you.

In the branch v.1.7.0 and v.1.8.0， in the file:source/resources/lib/aos/aos-stack.ts
The code has been modified to the following format
    const vpcIdSuffix = props.vpc.vpcId
    console.log(`VPC ID Suffix: ${vpcIdSuffix}`);
    this.OSMasterUserSecretName = `${OSMasterUserSecretNamePrefix}-${vpcIdSuffix}`;

Thank you.


Fix Metric Port Conflict

In some cases where QSSE is used in a HTTP server may have due to serving and listening on the same port.

Solution
QSSE server can return a http.Handler for handling metric. this handler can be registered by the consumer service if required.


Better transporter connection handling

reconnect after 5  sec if the first connect failed
resend DISCOVER after the transporter reconnected

Coverage increased (+0.001%) to 99.917% when pulling ecf6b646457377a0803b88109ac4a98383044d67 on transporter-errors into 8166493f45f2cce116e86f07ee58c6b7b1e5cb61 on master.


Using Google Authentication with other Google services

I'm writing a small webapp in .NET Core 2 focused around displaying custom reports out of a users Google Analytics account. I have added Microsoft.AspNetCore.Authentication.Google as the primary way to register and log into the website.
I'd now like to use the Google.Apis.AnalyticsReporting.v4 package to pull in data from that users connected Analytics accounts.
Is this possible?

In additional to this I've been trying to simply access the tokens required to do a straight REST/POST call maybe:
// In Startup
services.AddAuthentication().AddGoogle(googleOptions =>
            {
                googleOptions.ClientId = Configuration["Authentication:Google:ClientId"];
                googleOptions.ClientSecret = Configuration["Authentication:Google:ClientSecret"];
                googleOptions.SaveTokens = true;
                googleOptions.Scope.Add("https://www.googleapis.com/auth/analytics");
            });

//Elsewhere:
var accessToken = await HttpContext.GetTokenAsync("Google", "access_token");
var refreshToken = await HttpContext.GetTokenAsync("Google", "refresh_token");

These aren't returning anything either. Am I doing something wrong?

Hi, please check out this sample that shows how to store the access tokens so that you can later call APIs with that token: https://github.com/aspnet/AuthSamples/tree/dev/samples/Identity.ExternalClaims

What does googleOptions.SaveTokens = true; do, if anything? Seems to me it doesn't do anything at all?

The claims are being retrieved from the wrong identity. The code you show above is trying to get Google's claims (and tokens) from the local ASP.NET identity. Please review the sample we linked to in order to see some of the differences.
cc @Tratcher @HaoK

I downloaded a setup the ExternalClaims sample project and can see the access_token being displayed. However I don't see the refresh_token after setting accessType to "offline" in the auth options. Are there additional steps required?

@Tratcher / @HaoK / @javiercn - any idea on the refresh token?

Did you set the prompt?
o.AuthorizationEndpoint += "?prompt=consent"; // Hack so we always get a refresh token, it only comes on the first authorization response

That just forces the consent every time they login? I'm trying this against new users so shouldn't be relevant right?

@strich Yeah, that forces consent, if the underlying protocol is Open ID Connect, explicit consent might be required for the server to send you back a refresh token. See http://openid.net/specs/openid-connect-core-1_0.html#OfflineAccess

Hrm okay. But we're talking about first party auth here - Google, etc.


Many Grants do not have a PI

This may be because they need to be retransformed/loaded now that the entity resolver has been updated.

Is this still the case, @jcoyne?

Looks good now.


Query many paths at once

@tidwall hello, thanks for a nice library.
I have a question - in my case I need to query several keys from JSON payload, all on top level. As far as I understand it's only possible to do in several calls to Get method. It could be much more efficient to have something like GetMany which accepts a list of paths and returns several Result objects making only one scan over JSON payload. Something like EachKey method from jsonparser lib.
I looked into gjson internals and it seems to me that it's not an easy task to add such a feature. But I just decided to ask - what do you think about this?

Hi @FZambia,
I totally agree that this would be a great feature. I started working on a solution a few months ago but I got side-tracked and have yet to complete it.
I think I'll start the project up again and hammer it out.


Stick only after offset

Hi :)
Sometimes need to stick panel after scroll offset top.
In my case first wheel scrolls down to bottom automatically, and stick panel covers info: http://joxi.ru/eAO4PzGtllbQro => http://joxi.ru/12MQPzlfQQQV2J
Will be nice improve stickit, adding option like stickIfOffset
In my case i want to start stick only after scroll offset top = $(window).height() + 200
Thanks :)

I will think about it.

Oh, sry, its not need. I should be calculate scroll 200 - heightOfnav.


[ADD ME TO THE ORGANIZATION]

Name: Sanjyot Panure
Location: Pune Maharashtra
Interest: Web Technology, Data Science
Discord username(optional):-
Why do you want to join?

I want to join because I want to gain some interesting knowledge around and improve my skills.

You can also join our Discord community here
Feel free to check out other cool repositories of the Open Source Community here.

@sanjyotpanure Thanks for your interest. Invitation have been sent to you. Kindly accept it and make your membership public.


Updated SK locale strings [skip ci]

Q
A

Is bugfix?
❌

New feature?
❌

Breaks BC?
❌

Tests pass?
✔

Fixed issues
comma-separated list of tickets # fixed by the PR, if any

Merged. Thank you!


Support PHP 7.4 in v1.1.x

Looks like for PHP 7.4 we need to patch PHPUnit 😑

Yes, patching PHPUnit is mandatory for this, it is no escape 😔.
It is a good thing, on the other hand, I was planning to start checking that after the latest updates you did but as you already started here will follow this PR and see :).
Good job @tillkruss 👍

@AhmedRaafat14: PHP 7.4 looks good. Are you up for a PHP 8 attempt for the v1.1 branch?
I'm getting this error:

Travis PHP 8 log
travis_fold:start:worker_info
Worker information
hostname<EMAIL_ADDRESS>version: v6.2.17 https://github.com/travis-ci/worker/tree/bc420764f334fe0d096a417c80426f672f1b7d18
instance: travis-job-1f994c84-38c5-4624-8320-a5a70aed1eb7 travis-ci-sardonyx-xenial-1593004276-4d46c6b3 (via amqp)
startup: 6.247473542s
travis_fold:end:worker_info
travis_time:start:016ceb15
travis_time:end:016ceb15:start=1597163840014267331,finish=1597163840200513581,duration=186246250,event=no_world_writable_dirs
travis_time:start:140d2930
travis_time:end:140d2930:start=1597163840204935309,finish=1597163840214601411,duration=9666102,event=agent
travis_time:start:19d47862
travis_time:end:19d47862:start=1597163840219249884,finish=1597163840222108505,duration=2858621,event=check_unsupported
travis_time:start:1d5959d0
travis_fold:start:system_info
Build system information
Build language: php
Build dist: xenial
Build id: 716982084
Job id: 716982094
Runtime kernel version: 4.15.0-1077-gcp
travis-build version: ab037d6b
Build image provisioning date and time
Wed Jun 24 13:36:52 UTC 2020
Operating System Details
Distributor ID:	Ubuntu
Description:	Ubuntu 16.04.6 LTS
Release:	16.04
Codename:	xenial
Systemd Version
systemd 229
Cookbooks Version
3f92a99 https://github.com/travis-ci/travis-cookbooks/tree/3f92a99
git version
git version 2.27.0
bash version
GNU bash, version 4.3.48(1)-release (x86_64-pc-linux-gnu)
gcc version
gcc (Ubuntu 5.4.0-6ubuntu1~16.04.12) 5.4.0 20160609
docker version
Client:
 Version:           18.06.0-ce
 API version:       1.38
 Go version:        go1.10.3
 Git commit:        0ffa825
 Built:             Wed Jul 18 19:11:02 2018
 OS/Arch:           linux/amd64
 Experimental:      false
Server:
Engine:
Version:          18.06.0-ce
API version:      1.38 (minimum version 1.12)
Go version:       go1.10.3
Git commit:       0ffa825
Built:            Wed Jul 18 19:09:05 2018
OS/Arch:          linux/amd64
Experimental:     false
clang version
clang version 7.0.0 (tags/RELEASE_700/final)
jq version
jq-1.5
bats version
Bats 0.4.0
shellcheck version
0.7.0
shfmt version
v2.6.3
ccache version
3.2.4
cmake version
cmake version 3.12.4
heroku version
heroku/7.42.1 linux-x64 node-v12.16.2
imagemagick version
Version: ImageMagick 6.8.9-9 Q16 x86_64 2019-11-12 http://www.imagemagick.org
md5deep version
4.4
mercurial version
version 4.8
mysql version
mysql  Ver 14.14 Distrib 5.7.30, for Linux (x86_64) using  EditLine wrapper
openssl version
OpenSSL 1.0.2g  1 Mar 2016
packer version
1.3.3
postgresql client version
psql (PostgreSQL) 10.13 (Ubuntu 10.13-1.pgdg16.04+1)
ragel version
Ragel State Machine Compiler version 6.8 Feb 2013
sudo version
1.8.16
gzip version
gzip 1.6
zip version
Zip 3.0
vim version
VIM - Vi IMproved 7.4 (2013 Aug 10, compiled Mar 18 2020 14:06:17)
iptables version
iptables v1.6.0
curl version
curl 7.47.0 (x86_64-pc-linux-gnu) libcurl/7.47.0 GnuTLS/3.4.10 zlib/1.2.8 libidn/1.32 librtmp/2.3
wget version
GNU Wget 1.17.1 built on linux-gnu.
rsync version
rsync  version 3.1.1  protocol version 31
gimme version
v1.5.4
nvm version
0.35.3
perlbrew version
/home/travis/perl5/perlbrew/bin/perlbrew  - App::perlbrew/0.88
phpenv version
rbenv 1.1.2-30-gc879cb0
rvm version
rvm 1.29.10 (latest) by Michal Papis, Piotr Kuczynski, Wayne E. Seguin [https://rvm.io]
default ruby version
ruby 2.5.3p105 (2018-10-18 revision 65156) [x86_64-linux]
CouchDB version
couchdb 1.6.1
ElasticSearch version
5.5.0
Installed Firefox version
firefox 63.0.1
MongoDB version
MongoDB 4.0.19
PhantomJS version
2.1.1
Pre-installed PostgreSQL versions
9.4.26
9.5.22
9.6.18
Redis version
redis-server 6.0.5
Pre-installed Go versions
1.11.1
ant version
Apache Ant(TM) version 1.9.6 compiled on July 20 2018
mvn version
Apache Maven 3.6.3 (cecedd343002696d0abb50b32b541b8a6ba2883f)
gradle version
Gradle 5.1.1!
lein version
Leiningen 2.9.3 on Java 11.0.2 OpenJDK 64-Bit Server VM
Pre-installed Node.js versions
v10.21.0
v11.0.0
v12.18.1
v4.9.1
v6.17.1
v8.12.0
v8.17.0
v8.9
phpenv versions
system
5.6
5.6.40
7.1
7.1.27
7.2

7.2.15 (set by /home/travis/.phpenv/version)
hhvm
hhvm-stable
composer --version
Composer version 1.8.4 2019-02-11 10:52:10
Pre-installed Ruby versions
ruby-2.3.8
ruby-2.4.5
ruby-2.5.3
travis_fold:end:system_info

travis_time:end:1d5959d0:start=1597163840226313067,finish=1597163840236455119,duration=10142052,event=show_system_info
travis_time:start:12524dfc
travis_time:end:12524dfc:start=1597163840240288759,finish=1597163840257165972,duration=16877213,event=rm_riak_source
travis_time:start:221e5730
travis_time:end:221e5730:start=1597163840261738698,finish=1597163840269608269,duration=7869571,event=fix_rwky_redis
travis_time:start:0403b9cf
travis_time:end:0403b9cf:start=1597163840274429284,finish=1597163840713352018,duration=438922734,event=wait_for_network
travis_time:start:139779a8
travis_time:end:139779a8:start=1597163840717117002,finish=1597163840959999743,duration=242882741,event=update_apt_keys
travis_time:start:0150f754
travis_time:end:0150f754:start=1597163840963500969,finish=1597163841019633586,duration=56132617,event=fix_hhvm_source
travis_time:start:1998f695
travis_time:end:1998f695:start=1597163841023549268,finish=1597163841026503247,duration=2953979,event=update_mongo_arch
travis_time:start:16312d0a
travis_time:end:16312d0a:start=1597163841029760400,finish=1597163841073867894,duration=44107494,event=fix_sudo_enabled_trusty
travis_time:start:2d9b2d82
travis_time:end:2d9b2d82:start=1597163841077391500,finish=1597163841080340473,duration=2948973,event=update_glibc
travis_time:start:0aa29ec4
travis_time:end:0aa29ec4:start=1597163841083666528,finish=1597163841092588342,duration=8921814,event=clean_up_path
travis_time:start:02866131
travis_time:end:02866131:start=1597163841095992255,finish=1597163841105056174,duration=9063919,event=fix_resolv_conf
travis_time:start:028d22f8
travis_time:end:028d22f8:start=1597163841108557421,finish=1597163841118758149,duration=10200728,event=fix_etc_hosts
travis_time:start:08ef04f0
travis_time:end:08ef04f0:start=1597163841122507330,finish=1597163841135072686,duration=12565356,event=fix_mvn_settings_xml
travis_time:start:0ec9a02c
travis_time:end:0ec9a02c:start=1597163841138771868,finish=1597163841149403397,duration=10631529,event=no_ipv6_localhost
travis_time:start:141eb477
travis_time:end:141eb477:start=1597163841153000968,finish=1597163841156052118,duration=3051150,event=fix_etc_mavenrc
travis_time:start:02d55d8e
travis_time:end:02d55d8e:start=1597163841159768961,finish=1597163841163568339,duration=3799378,event=fix_wwdr_certificate
travis_time:start:26ecf143
travis_time:end:26ecf143:start=1597163841166914289,finish=1597163841194079128,duration=27164839,event=put_localhost_first
travis_time:start:1ec56734
travis_time:end:1ec56734:start=1597163841197641302,finish=1597163841200978605,duration=3337303,event=home_paths
travis_time:start:22a1c240
travis_time:end:22a1c240:start=1597163841204225476,finish=1597163841218189713,duration=13964237,event=disable_initramfs
travis_time:start:0390aaf4
travis_time:end:0390aaf4:start=1597163841221664322,finish=1597163841549919976,duration=328255654,event=disable_ssh_roaming
travis_time:start:020927a0
travis_time:end:020927a0:start=1597163841553519891,finish=1597163841556147840,duration=2627949,event=debug_tools
travis_time:start:0b678556
travis_time:end:0b678556:start=1597163841559386275,finish=1597163841562693268,duration=3306993,event=uninstall_oclint
travis_time:start:00bd4b54
travis_time:end:00bd4b54:start=1597163841566092978,finish=1597163841569792421,duration=3699443,event=rvm_use
travis_time:start:00fe1684
travis_time:end:00fe1684:start=1597163841573200443,finish=1597163841582696072,duration=9495629,event=rm_etc_boto_cfg
travis_time:start:029452c2
travis_time:end:029452c2:start=1597163841586363838,finish=1597163841592670667,duration=6306829,event=rm_oraclejdk8_symlink
travis_time:start:036d387a
travis_time:end:036d387a:start=1597163841596665542,finish=1597163841703238447,duration=106572905,event=enable_i386
travis_time:start:21931060
travis_time:end:21931060:start=1597163841707555520,finish=1597163841714181707,duration=6626187,event=update_rubygems
travis_time:start:098adea8
travis_time:end:098adea8:start=1597163841717849317,finish=1597163842626008125,duration=908158808,event=ensure_path_components
travis_time:start:0016f4ea
travis_time:end:0016f4ea:start=1597163842629641004,finish=1597163842632088689,duration=2447685,event=redefine_curl
travis_time:start:1646f25c
travis_time:end:1646f25c:start=1597163842635259258,finish=1597163842637816675,duration=2557417,event=nonblock_pipe
travis_time:start:0c23fe08
travis_time:end:0c23fe08:start=1597163842641248010,finish=1597163848683019461,duration=6041771451,event=apt_get_update
travis_time:start:0031f76a
travis_time:end:0031f76a:start=1597163848687133914,finish=1597163848689750299,duration=2616385,event=deprecate_xcode_64
travis_time:start:0000dfca
travis_time:end:0000dfca:start=1597163848693105223,finish=1597163851434591464,duration=2741486241,event=update_heroku
travis_time:start:101447a8
travis_time:end:101447a8:start=1597163851438014186,finish=1597163851440383385,duration=2369199,event=shell_session_update
travis_time:start:0d7e01f5
travis_fold:start:docker_mtu
travis_fold:end:docker_mtu
travis_time:end:0d7e01f5:start=1597163851443740415,finish=1597163853831331905,duration=2387591490,event=set_docker_mtu
travis_time:start:1d2a87b8
travis_fold:start:resolvconf
travis_fold:end:resolvconf
travis_time:end:1d2a87b8:start=1597163853835050289,finish=1597163853904241590,duration=69191301,event=resolvconf
travis_time:start:0e288247
travis_time:end:0e288247:start=1597163853912315104,finish=1597163854074896219,duration=162581115,event=maven_central_mirror
travis_time:start:02ec8fa9
travis_time:end:02ec8fa9:start=1597163854078400080,finish=1597163854180916956,duration=102516876,event=maven_https
travis_time:start:15505f54
travis_time:end:15505f54:start=1597163854184882424,finish=1597163854187484859,duration=2602435,event=fix_ps4
travis_time:start:161defb4

travis_fold:start:git.checkout
travis_time:start:22582da0
$ git clone --depth=50 https://github.com/nrk/predis.git nrk/predis
Cloning into 'nrk/predis'...
remote: Enumerating objects: 1176, done.

remote: Compressing objects:   8% (1/12)
remote: Compressing objects:  16% (2/12)
remote: Compressing objects:  25% (3/12)
remote: Compressing objects:  33% (4/12)
remote: Compressing objects:  41% (5/12)
remote: Compressing objects:  50% (6/12)
remote: Compressing objects:  58% (7/12)
remote: Compressing objects:  66% (8/12)
remote: Compressing objects:  75% (9/12)
remote: Compressing objects:  83% (10/12)
remote: Compressing objects:  91% (11/12)
remote: Compressing objects: 100% (12/12)
remote: Compressing objects: 100% (12/12), done.
From https://github.com/nrk/predis
branch            refs/pull/616/merge -> FETCH_HEAD
travis_time:end:12b779fd:start=1597163855019218527,finish=1597163855425946413,duration=406727886,event=checkout
$ git checkout -qf FETCH_HEAD
travis_fold:end:git.checkout

travis_time:end:12b779fd:start=1597163855019218527,finish=1597163855452738084,duration=433519557,event=checkout
travis_time:start:1505dc40
travis_time:end:1505dc40:start=1597163855456846384,finish=1597163855463701487,duration=6855103,event=env
travis_time:start:15a0a73e
$ phpenv global 8.0 2>/dev/null
travis_time:end:15a0a73e:start=1597163855467904596,finish=1597163855488903589,duration=20998993,event=setup
8.0 is not pre-installed; installing
Downloading archive: https://storage.googleapis.com/travis-ci-language-archives/php/binaries/ubuntu/16.04/x86_64/php-8.0.tar.bz2
travis_time:start:062fadc0
$ curl -sSf --retry 5 -o archive.tar.bz2 $archive_url && tar xjf archive.tar.bz2 --directory /
curl: (22) The requested URL returned error: 404 Not Found
travis_time:end:062fadc0:start=1597163855582484368,finish=1597163855682737138,duration=100252770,event=setup
travis_time:start:251df2e8
travis_time:end:251df2e8:start=1597163855687208186,finish=1597163855691145562,duration=3937376,event=setup
travis_time:start:0994b543
$ phpenv global 8.0
rbenv: version `8.0' not installed
travis_time:end:0994b543:start=1597163855695174150,finish=1597163855711655309,duration=16481159,event=setup
The command "phpenv global 8.0" failed and exited with 1 during .

Your build has been stopped.
</details>

Shouldn't we be allowing failures for PHP 5.3 to 5.5 and hhvm on TravisCI?

@srmklive: I'm happy to fully support them for v1.1 branch. Feel free to PR, tho 👍🏻

Thanks @b1rdex, that patch worked like a charm! ❤

Looks like for PHP 7.4 we need to patch PHPUnit

omg!

@tillkruss Yes sure will look into it tonight or tomorrow, and see what needs to be fixed for PHP 8.

@AhmedRaafat14 Even just getting Travis going with PHP 8 would be a huge help 🙏🏻

@tillkruss Yup, that was my plan 😉


ORACLE: Added owner constraint for auto increment related queries

Related issue/comment: #2428
This is a very rough fix, I'm not even sure whether it would be fit to be merged or not really, but at least it gives an idea. To fix the problem described in my comment, I simply take the the username from the config and pass it to the functions that generate SQLs.
There's a couple of things that I didn't really take care of, so if you decide to merge, pay attention to them:

I tried to look for usages of the functions in trigger.js file and found a few, but I feel like I still missed one or two
I forgot to capitalize the owner in the query, but as well did not consider whether the user wants names capitalized or not in the config

These are the 2 points that better be double-checked, but the general idea works (I tested it in my project).

Also I'm not sure yet if this is wanted functionality.

Well, I described in the referenced issue the use case. It is indeed very specific, but I could fix the technicalities in this PR and it will stay in the code just as a nice little nod to people who face the same error as me. And it could check for the value being available in the config and only reference it if it is.
On the other hand, if that functionality isn't in place, I doubt you would lose users because this is the only library out there that works well with Oracle, so you kinda have the monopoly.
I'll fix the problems and you decide whether you want it or not.

@JaffParker Are you still interested in finishing PR?

Yeah, totally. I kinda got busy with work and eventually forgot the active PRs that I was making 😳 sorry about that. I'll finish it soon

I run into the same problem with a multi-user schema database on Oracle.
The migrate command fails when there is already a table with another user in the same schema.
The problem is the same explained here https://github.com/knex/knex/issues/3145
I think that this merge request could resolve the issue.
Let me know if I can contribute in some way.

Four years later I'd like to ask that this be re-looked at, please. We are running into this issue as well in a multi-user schema database.


Fix coding style on the jump plugin

Use two spaces instead of one tab as said on the coding style guide.

The conflicts should now be fixed. Not sure why the checks failed...

@mcornella any chance we can have this merged before more conflicts arise? 👼

Coding style is for now inconsistent throughout the repository. There are places where tabs are more suitable, so I don't really agree with the coding style wiki. Let's just leave it like that for now, and in the future we'll migrate to using editorconfig like the installer and uninstaller already use.


Fix the issue about the generation of docker image

Summary

Revert "CI: Free space on worker building container", see:
https://github.com/apache/nuttx/pull/11343
ci/docker: Revert the change about gn to unblock ci, reported here:
https://github.com/apache/nuttx/actions/runs/7155266012/job/19483732190?pr=11360)

Impact
docker image
Testing
ci

let me merge the pr to unblock ci.


How to modify the css?

Hi,
I'm trying to modify the css of your input.
I can't overwrite your class.
Is it possible for you to make an external link?
To separate your css into :
./node_modules/ng4-autocomplete/styles/ng4-autocomplete.min.css..
or
https://unpkg.com/ng4-autocomplete/styles/ng4-autocomplete.min.css..
Have a great day.
Mickael

Hi, You can modify the CSS by adding global style on class 'custom-autocomplete'.
To enable global style use encapsulation: ViewEncapsulation.None in your parent component which is using the custom-autocomplete component.
Thanks


Handle spaces in config options

There's a bunch of different ways of handling spaces in comma_separated_list to fix --trio200-blocking-calls. Pending on what happens with https://github.com/PyCQA/flake8/issues/1771

handle ['a', '->', 'b'] as well as ['a->b'] with fancy logic
don't use comma_separated_list and write a custom action (more attractive if https://github.com/PyCQA/flake8/issues/1770 is fixed)
Require users to wrap values in quotes or something. Though some quick testing looks like this doesn't help.
Wait for it to be fixed upstream

Since 1771 was closed as invalid, this should likely be ignored for --startable-in-context-manager (since spaces aren't valid identifiers anyway), but --trio200-blocking-calls will need a custom type that handles this.

Closed by #93.  (you need a keyword per issue #, annoyingly)


TypeError: history.listen is not a function

Uncaught TypeError: history.listen is not a function
    at Object../src/index.js (app.e72e671….js:1)
    at n (vendor.e72e671….js:1)
    at window.webpackJsonp (vendor.e72e671….js:1)
    at app.e72e671….js:1

Is this because of my setup? I used yarn instead of npm

Oh whoops! No, this is a remnant from my port of inferno-starter. Fix this in a sec

Fixed; thanks for catching!


(BKR-1155) Allow configurable ssh connection preference

This patch adds a new API method for hypervisors called connections_preference.
Hypervisor authors can overwrite this method to return an array of SSH
connection method preference of their choice when that hypervisor is used. This
option is then added to host_hash.
In host.rb file, we are sending ssh_connection.rb file an object of
:ssh_connection_pereference as an option. And we loop through each of the
element of the array in connect method of ssh_connection file.
The overall idea here is to create an API endpoint for hypervisor authors to set
their connection preference. As of now we dont want end user to set this in
their hosts config as there are no use case for it.

discuss this on jira

@puppetlabs-jenkins test this please

@puppetlabs-jenkins retest this please

@puppetlabs-jenkins retest this please

Refer to this link for build results (access rights to CI server needed):
http://jenkins-beaker.delivery.puppetlabs.net//job/qe_beaker_btc-intn/4028/

Refer to this link for build results (access rights to CI server needed):
http://jenkins-beaker.delivery.puppetlabs.net//job/qe_beaker_btc-intn/4029/

@puppetlabs-jenkins retest this please

Refer to this link for build results (access rights to CI server needed):
http://jenkins-beaker.delivery.puppetlabs.net//job/qe_beaker_btc-intn/4032/


Update SignalR sample

Issue describing the changes in this PR
Pull request checklist

[x] My changes do not require documentation changes

[ ] Otherwise: Documentation issue linked to PR

[x] My changes should not be added to the release notes for the next release

[ ] Otherwise: I've added my notes to release_notes.md

[x] My changes do not need to be backported to a previous version

[ ] Otherwise: Backport tracked by issue/PR #issue_or_pr

[ ] I have added all required tests (Unit tests, E2E tests)

Hi @kshyju, I have added some SignalR samples to demonstrate the usage of new POJO classes added in #774, also to fix the doc. Could you please take a look at it?

/check-enforcer evaluate

Hi @kshyju , the check-enforcer seems to be stuck. Do you know how to fix it or find the right person?

/check-enforcer override


'Status' object has no attribute 'Cursor'

Hello, I am trying to read out 10 tweets with the Cursor using search api. But I'm getting an error as - Status object has no attribute 'Cursor':
Here's my code snapshot :

What is tw?

tw is just a importing name for tweepy.

According to your traceback, it's a Status object instead.

So is there some wrong coding here on my part?

tw is a Status object, so yes. Somewhere along the way you must have set it to a Status object, likely through the result of an API method call. Without seeing all your code, it's impossible to determine what or where exactly.

ohh ok , thank you i needed to understand the error atleast. Its probably from some trials ive been doing that i might have reset it. Will check it thank you.


Glimpse.ADO not working with Oracle Data Provider

Hi,
I'm trying to use Glimpse.ADO with Oracle Data Provider and I'm getting a conversion error:

Unable to cast object of type 'Glimpse.Ado.AlternateType.GlimpseDbConnection' to type 'Oracle.DataAccess.Client.OracleConnection'.

I'm using Entity Framework and this error happens in the following code:
        public string GetParameter(string parameter, long lineId)
        {
            var entityConnection = (System.Data.EntityClient.EntityConnection)this.Connection;
            OracleConnection conn = (OracleConnection)entityConnection.StoreConnection; // Error thrown in this line

            ConnectionState initialState = conn.State;

            try
            {
                if (initialState != ConnectionState.Open)
                    conn.Open();  // open connection if not already open
                using (OracleCommand cmd = conn.CreateCommand())
                {
                    cmd.CommandText = "PARAMETERS.GET";
                    cmd.CommandType = CommandType.StoredProcedure;

                    OracleParameter retVal = new OracleParameter("vRetVal", OracleDbType.Varchar2, 512);
                    retVal.Direction = ParameterDirection.ReturnValue;

                    cmd.Parameters.Add(retVal);
                    cmd.Parameters.Add("pCode", parameter);
                    cmd.Parameters.Add("pLine", lineId);

                    cmd.ExecuteNonQuery();

                    return ((INullable)retVal.Value).IsNull ? "" : retVal.Value.ToString();
                }
            }
            finally
            {
                if (initialState != ConnectionState.Open)
                    conn.Close(); // only close connection if not initially open
            }
        }

I've installed the following Nuget packages:

Glimpse - Version: 1.8.6
Glimpse.AspNet - Version: 1.9.2
Glimpse.Ado - Version: 1.7.3
Glimpse.EF43 - Version: 1.6.5

Please, can you help me solve this issue?

Hi again,
I've managed to make it work changing a little bit the code:
        public string GetParameter(string parameter, long lineId)
        {
            var entityConnection = (System.Data.EntityClient.EntityConnection)this.Connection;
            DbConnection conn = entityConnection.StoreConnection; // Error thrown in this line

            ConnectionState initialState = conn.State;

            try
            {
                if (initialState != ConnectionState.Open)
                    conn.Open();  // open connection if not already open
                using (DbCommand cmd = conn.CreateCommand())
                {
                    cmd.CommandText = "PARAMETERS.GET";
                    cmd.CommandType = CommandType.StoredProcedure;

                    OracleParameter retVal = new OracleParameter("vRetVal", OracleDbType.Varchar2, 512);
                    retVal.Direction = ParameterDirection.ReturnValue;

                    cmd.Parameters.Add(retVal);
                    cmd.Parameters.Add(new OracleParameter("pCode", parameter));
                    cmd.Parameters.Add(new OracleParameter("pLine", lineId));

                    cmd.ExecuteNonQuery();

                    return ((INullable)retVal.Value).IsNull ? "" : retVal.Value.ToString();
                }
            }
            finally
            {
                if (initialState != ConnectionState.Open)
                    conn.Close(); // only close connection if not initially open
            }
        }

After that I realized that I could simply do:
        public string GetParameter(string parameter, long? lineId = null)
        {
            string sql = "SELECT PARAMETER.GET(:pCode, :pLine) FROM DUAL";
            return ExecuteStoreQuery<string>(sql, parameter, (lineId.HasValue ? lineId : null)).FirstOrDefault();
        }

Everything is working fine now, but it would be good to have this fixed.
Thank you.

@corte I'm a little perplexed. The code above doesn't look like code in Glimpse. Any chance you can link me to the code?

@avanderhoorn Sorry, actually it's not a code in Glimpse.
This is only the call using oracle data provider. I don't know how Glimpse works, but I started having this issue right after installing Glimpse through Nugget.
I think the real problem is that I was using the Entity Framework connection to do this. I've tried with a simple code using only ODP.net and it worked.

Hmm..
Now I see what the problem really is.
Glimpse in someway converts my EntityFramework connection to an object of GlimpseDbConnection. When getting the entity framework connection with
((System.Data.EntityClient.EntityConnection)this.Connection).StoreConnection

I had an GlimpseDbConnection object and then I was trying to convert it to an OracleConnection in order to use it to call stored procedures in my database.
I guess it was my mistake then. :)

@corte now I understand :) The Glimpse ADO insights works by wrapping the various DbProviderFactories. This means that when Glimpse is running and you get a result from anything using the DbProviderFactories (like this.Connection or conn.CreateCommand()) the results are going to be Glimpse types.
In theory this is fine as DbProviderFactories only says that it is going to return you types that inherit from DbConnection, DbCommand, etc, but in practice there are times (like this one) where you might need to do some casting to access specific features. That said, under normal circumstances you shouldn't have to do any castings - again unless there is a really good reason why; which this might be.
I would encourage you to look at your code and see if there is a way you can do what you are doing without casting. If not, then you might introduce an as check to verify the type first (so you know if Glimpse is a play or not). Otherwise, there are other work arounds, they are just more work. Let me know if the current/suggested work arounds work for you or if you want something different. Hope this makes sense and helps.


[INFRA] Configure dependabot

At least for GitHub Actions.
For dependency, try to use groups. If not done as part of this issue, create a new issue.

Duplicates  #28


Fix/change the user schema's column names for records and certificate

In User, the column for records is currently named subdomians, and we have decided to use the term record over subdomain. It should be changed to record for consistency, and it also has typo. See #79
Secondly, Certificates shouldn't be plural since there's only one certificate we are tracking for each user.
I'm thinking we can stick to singular names to keep things easier, especially if we ever decide to change relationship types later.

The privkey column in certificate model can be changed to privateKey to be clearer.


Preserve binary API compatibility until version 2.0

http://upstream-tracker.org/compat_reports/cppformat/1.1.0_to_current/abi_compat_report.html

The next version will have to be 2.0 because of the changes in #173, so this is no longer needed.


Typo in description.

In the description there is a typo "*As of 1.15.5, most packs should load properly." there is no "1.15.5" I assume you meant 1.16.5 just letting you know.

This probably isn't a typo - it's probably referring to the modpack version 1.15.5

^^^ yeah, i was referring to the modpack version since 1.15.5 contained Iris 1.6 improving compatibility a ton

Oh sorry I thought it meant Minecraft 1.15.5 not the modpack version