uuid for obstacle message

don't really like the solution of the tracking of those Rviz markers ids like that, but can't think of a better way to do it for now

i haven't tested it yet on real data, i'll ping you after I do that

Those changes make 3 options to ~11 options. Definitely an improvement, but not really randomly distributed.
I did some playing uuid.uuid1().int % 100 will give you 25 evenly distributed numbers between 0 and 100 (so divide by 100). From 100 iterations:
{81: 40,
 17: 40,
 53: 40,
 89: 40,
 25: 40,
 61: 40,
 97: 40,
 33: 40,
 69: 40,
 5: 40,
 41: 40,
 77: 40,
 13: 40,
 49: 40,
 85: 40,
 21: 40,
 57: 40,
 93: 40,
 29: 40,
 65: 40,
 1: 40,
 37: 40,
 73: 40,
 9: 40,
 45: 40}

Each of those values appears exactly 40 times. Still not random, but closer.

uuid.uuid4().int % 100 gives all 100 distributed like this:
31: 12
57: 13
18: 11
1: 9
98: 7
96: 5
6: 18
44: 13
81: 9
3: 9
10: 13
11: 11
93: 12
68: 13
55: 8
91: 13
67: 14
26: 15
41: 11
8: 12
94: 8
61: 16
25: 7
99: 14
43: 9
37: 10
23: 17
73: 15
63: 9
85: 9
20: 7
75: 11
35: 15
33: 8
84: 13
58: 11
74: 7
32: 4
72: 5
70: 9
59: 10
80: 14
64: 7
83: 11
34: 10
60: 13
21: 8
90: 7
28: 11
65: 7
54: 8
50: 12
92: 10
4: 11
56: 11
53: 6
86: 11
89: 8
16: 18
78: 7
87: 12
48: 8
97: 10
95: 6
39: 9
27: 7
69: 11
66: 8
51: 11
79: 4
71: 9
49: 7
47: 8
9: 12
46: 8
42: 10
29: 12
62: 12
12: 12
45: 8
88: 15
13: 5
30: 15
15: 12
77: 7
22: 15
14: 10
38: 10
76: 11
2: 5
52: 5
82: 5
7: 9
40: 7
19: 12
36: 9
0: 8
24: 7
17: 11
5: 6

Looks much better. I've thought that uuid1 will be more random because of the time component. Should I use this?

Use uuid4, googling around makes me think this is a good tradeoff.

I've found some major bugs while testing, so there still will be quite some changes

Now it's tested and working properly. The first implementation was too naive. Assigning python UUID object directly to ROS msg was not a good idea :). Script below should explain those changes better:
import uuid
from unique_identifier_msgs.msg import UUID

if __name__ == '__main__':
    raw_uuid = uuid.uuid4()
    print(raw_uuid)

    uuid_msg = UUID()
    print(raw_uuid.bytes)

    uuid_msg.uuid = list(raw_uuid.bytes)
    print(uuid_msg.uuid)
    print(bytes(uuid_msg.uuid))

    a = uuid.UUID(bytes=bytes(uuid_msg.uuid))
    print(a)

Output:
b9db0cd7-68a4-4079-9228-2b8991f57def
b'\xb9\xdb\x0c\xd7h\xa4@y\x92(+\x89\x91\xf5}\xef'
[185 219  12 215 104 164  64 121 146  40  43 137 145 245 125 239]
b'\xb9\xdb\x0c\xd7h\xa4@y\x92(+\x89\x91\xf5}\xef'
b9db0cd7-68a4-4079-9228-2b8991f57def

It looks good to me.

@simutisernestas any other changes before I can merge?

GTG already


add api hat

Thanks for the submission. API Hat seems to be super young, and its documentation is lacking. For this list, we select resources that are production-ready. So I'm going to close this PR. Fee free to open a new one when your product is more mature.

Yes, but it is oriented on the Node.js and it works perfectly.


Update postgresql to 42.2.15

Updates org.postgresql:postgresql from 42.2.14 to 42.2.15.
Changelog
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.postgresql", artifactId = "postgresql" } ]

labels: library-update, semver-patch

Closing since a newer version is available.


Database Disk Image Malformed

I wasn't able to reproduce this. Problem should be fixed by #1474

leftover WAL file?!


Unable to clone repo with a deploy key

We're unable to clone this repo when using the deploy key that's set up in our CircleCI. The key is correctly set up in github as a deploy key and we've been using it since 2021 with no issues (yes, we should probably rotate it). Here's the error message that git returns when trying to clone from within the CircleCI container:
root@408047b2bc79:~# git clone git@github.com:nvm-sh/nvm.git
Cloning into 'nvm'...
ERROR: Permission to nvm-sh/nvm.git denied to deploy key
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.

Using that same key to clone another public repo (ex: node) works fine so I'm assuming the issue is with this repo's settings rather than a global change.
Can you please look into any recent changes to this repo's settings?

We're experiencing the same issue, with a deploy key setup through CircleCI.

Experiencing the same issue on circleci
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 13527  100 13527    0     0   218k      0 --:--:-- --:--:-- --:--:--  220k
=> Downloading nvm from git to '/home/circleci/.nvm'
=> Cloning into '/home/circleci/.nvm'...
ERROR: Permission to nvm-sh/nvm.git denied to deploy key
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
Failed to clone nvm repo. Please report this!

Exited with code exit status 2

We just started to face this issue in CircleCI pipeline. Here is the script and error detail:
Script:
#!/bin/bash -eo pipefail
wget -qO- https://raw.githubusercontent.com/nvm-sh/nvm/v0.39.3/install.sh | bash
export NVM_DIR="$HOME/.nvm"
[ -s "$NVM_DIR/nvm.sh" ] && \. "$NVM_DIR/nvm.sh"
[ -s "$NVM_DIR/bash_completion" ] && \. "$NVM_DIR/bash_completion"
nvm install v16
nvm install 16.13.1
nvm alias default 16.13.1
echo 'export NVM_DIR="$HOME/.nvm"' >> $BASH_ENV
echo '[ -s "$NVM_DIR/nvm.sh" ] && \. "$NVM_DIR/nvm.sh"' >> $BASH_ENV

Error:
=> Downloading nvm from git to '/home/circleci/.nvm'
=> Cloning into '/home/circleci/.nvm'...
ERROR: Permission to nvm-sh/nvm.git denied to deploy key
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
Failed to clone nvm repo. Please report this!

Exited with code exit status 2

CircleCI received exit code 2

This seems to happen because CircleCI sets git to change all GitHub HTTPS URLs to SSH URLs.
$ git config --list
# ...
url.ssh://git@github.com.insteadof=https://github.com
gc.auto=0

Is it possible that a deploy key was recently added to this repo?

An ugly (TEMPORARY!) workaround for people that need this working now: use a user key in CircleCI instead of deploy.
We saw only our repos using deploy keys failing like this, and the few that make use of user keys for various reasons were not failing.
Be sure to make note of any projects you switch to user keys so you can go back and revert them to deploy keys!

Running this command in a step before installing Node fixes the issue:
git config --global --remove-section<EMAIL_ADDRESS>
Not sure about the repercussions though—nor why this config would be needed in the first place.

I am curious what changed here. We ran into the same issue described here with "stock" CircleCI pipelines that have deploy keys and use Circle's official node orb.
It feels like this would have a pretty wide blast radius?

I too am here because my CircleCI builds are failing, but I can reproduce the issue locally by generating a new SSH key and adding it to my SSH agent with no other keys, so it doesn't seem to be an issue with CircleCI specifically. I was also able to clone other public repos with the same key and configuration.

Same here. At the same time we started receiving the error described in this issue, we also started seeing the same error with a different repo. This leads me to believe CircleCi made a change that affects multiple packages. I will post both errors below, as they both started at the same time. Only the second error is related to this repo, but I think reporting both will help debug this issue.
Download ruby-advisory-db ...
Cloning into '/home/circleci/.local/share/ruby-advisory-db'...
ERROR: Permission to rubysec/ruby-advisory-db.git denied to deploy key
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
failed to download https://github.com/rubysec/ruby-advisory-db.git to "/home/circleci/.local/share/ruby-advisory-db"
Please see https://kazoohr.atlassian.net/wiki/spaces/EN/pages/34374164/Code+Scanning+CVE for details on correcting these warnings.

Exited with code exit status 1

and
=> Downloading nvm from git to '/home/circleci/.nvm'
=> Cloning into '/home/circleci/.nvm'...
ERROR: Permission to nvm-sh/nvm.git denied to deploy key
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
Failed to clone nvm repo. Please report this!

Exited with code exit status 2

Experiencing the same from CircleCI pipelines

cross-posting here just to amplify:
I think this is just an issue across the board with public github repos, we are also seeing:
Cloning into 'bats-core'...
ERROR: Permission to bats-core/bats-core.git denied to deploy key
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.

my guess is that either circleci made a change to inject the insteadOf directive into the gitconfig:
~$ cat ~/.gitconfig
[safe]
	directory = *
[url<EMAIL_ADDRESS>	insteadOf = https://github.com
[gc]
	auto = 0

or github changed the ability for deploy keys to clone public repos.

@acookin I think your gitconfig theory is correct. I can still clone public repos with a deploy key, and that may be dependent on whether the repo being cloned has any deploy keys or not. Considering everyone here is from CircleCI and it's affecting multiple repos, I highly doubt GitHub made any change or it'd have a much larger effect.

I've opened a support ticket with CircleCI and I suggest everyone that can do the same so they get eyes on this.

Running this command in a step before installing Node fixes the issue:
git config --global --remove-section<EMAIL_ADDRESS>Not completely sure about the repercussions though—nor why this config would be needed in the first place.

It works for me, thanks. I added following step before curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.38.0/install.sh | bash:
      - run:
          name: "Temporary fix for ERROR: Permission to nvm-sh/nvm.git denied to deploy key"
          command: |
            git config --global --remove-section<EMAIL_ADDRESS>

Seems to be working now
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 15916  100 15916    0     0   295k      0 --:--:-- --:--:-- --:--:--  298k
=> Downloading nvm from git to '/home/circleci/.nvm'
=> Cloning into '/home/circleci/.nvm'...
remote: Enumerating objects: 378, done.
remote: Counting objects: 100% (378/378), done.
remote: Compressing objects: 100% (326/326), done.
remote: Total 378 (delta 43), reused 163 (delta 25), pack-reused 0 (from 0)
Receiving objects: 100% (378/378), 375.87 KiB | 34.17 MiB/s, done.
Resolving deltas: 100% (43/43), done.
* (HEAD detached at FETCH_HEAD)
  master

Confirmed, the issue seems resolved. I checked the .gitconfig files between the failed and successful builds (has SSH sessions open to both containers) and there are no differences. So far it's looking like this was a github issue rather than CircleCI or the settings of a specific repo but that's just guessing from limited info.
I'll keep the issue open for another hour or so just while we confirm the fix is stable and close it out after. Thanks for the group debugging and workarounds everyone!

@nkvojvodic you are correct - I was pretty certain it was CircleCI, but I was able to reproduce the issue locally and now I can't, so this was an issue with Github not allowing deploy-keys to clone repositories. Interesting.

RESOLVED! It is working Again!!!

Either way, it's got nothing to do with nvm.


stack ghci integration

Maybe this relates to the development of a stack backend separate from cabal backend, but anyway, an integrated repl based on stack ghci would be ideal for Stack-based projects.

You can configure this package to use stack ghci.
31 окт. 2015 г. 5:29 пользователь "Aaron Wolf"<EMAIL_ADDRESS>написал:

Maybe this relates to the development of a stack backend separate from
cabal backend, but anyway, an integrated repl based on stack ghci would
be ideal for Stack-based projects.
—
Reply to this email directly or view it on GitHub
https://github.com/atom-haskell/ide-haskell-repl/issues/3.

okay cool. The way that is done seems a little clunky (setting ghci first and then stack later), but I understand this is a work in progress. I hope it will support tab-completion eventually. Nice work overall. I'll be patient to see this evolve.


Couldn't be decompiled - Java 11

Vineflower version
vineflower-1.10.1.jar
Describe the bug
Decompiling a jar, all classes except this gave an error.
Additional information
// $VF: Couldn't be decompiled
// Please report this to the Vineflower issue tracker, at https://github.com/Vineflower/vineflower/issues with a copy of the class file (if you have the rights to distribute it!)
// java.lang.RuntimeException: java.lang.NullPointerException: Cannot invoke "org.jetbrains.java.decompiler.struct.StructMethod.isSynthetic()" because "mt" is null
//   at org.jetbrains.java.decompiler.main.ClassesProcessor.processClass(ClassesProcessor.java:439)
//   at org.jetbrains.java.decompiler.main.Fernflower.processClass(Fernflower.java:183)
//   at org.jetbrains.java.decompiler.struct.ContextUnit.lambda$save$2(ContextUnit.java:164)
// Caused by: java.lang.NullPointerException: Cannot invoke "org.jetbrains.java.decompiler.struct.StructMethod.isSynthetic()" because "mt" is null
//   at org.jetbrains.java.decompiler.main.ClassesProcessor$ClassNode.(ClassesProcessor.java:623)
//   at org.jetbrains.java.decompiler.main.rels.LambdaProcessor.processClass(LambdaProcessor.java:89)
//   at org.jetbrains.java.decompiler.main.ClassesProcessor.processClass(ClassesProcessor.java:419)
//   at org.jetbrains.java.decompiler.main.Fernflower.processClass(Fernflower.java:183)
//   at org.jetbrains.java.decompiler.struct.ContextUnit.lambda$save$2(ContextUnit.java:164)
Zipped class file with error above. CFR managed to decompile it to some degree - likely invalid byte code causing this.
client.zip

(Are you sure you have permission to distribute the given zip file?)

This looks highly obfuscated and no source was provided, so it doesn't look like you can share this file. This issue will be deleted, but feel free to open another one with a link to the source code attached.


Implement Bevy Plugin

Since the parser and potentially other functionality of this crate could be useful for applications outside of the Bevy ecosystem, it probably makes sense to either

Move the Bevy functionality to a Cargo feature to only compile it when needed
Move the Bevy functionality to a separate crate (can still be in this repository) with the standard bevy_* or bevy_mod_* naming scheme.

I remember reading @alice-i-cecile writing somewhere that she prefers crates to not be bevy_ prefixed since that makes them seem official, but I might be misremembering. What's your input here, Alice?

According to the plugin guidelines, using bevy_* prefixes for crates is allowed, as long as it is not a generic name that Bevy might plan to use in the future (which I don't think is the case here).
To avoid confusion with official crates, the bevy_mod_* prefix seems to be the most common, which is used for a fair amount of assets.
This is what I have been doing for my own crates so far.

Yep, that's an accurate summary of my position. Personally I like creating little brands like leafwing_foo, but it's a matter of style.

Closing in favor of fine-grained subissues + milestone :)


Added Sort Functionality

Fixes: #135
I have added the sorting functionality which will sort the Task list according to Due Date in increasing order.
https://github.com/Kritika30032002/To-Do-List-Application/assets/104732343/51135fe4-144c-45f0-aa0e-bffd59de048c

take pull of updated repo and make sure of your changes


Gem file structure

According to http://guides.rubygems.org/name-your-gem/
asciidoctor-pdf require statement should be
require 'asciidoctor/pdf'

Then the file structure should be
|-- lib
|   `-- asciidotor
|       |-- pdf
|       |   `-- version.rb
|       `-- pdf.rb

And I think module name should be Asciidoctor::PDF (current is Asciidoctor::Pdf)
I'm going to create some CJK extension(patch and theme) for asciidoctor-pdf, I'm confuse which rule should I follow.

Current I use this struct, follow both rubygems and asciidotcor convention:
|-- asciidoctor
|   `-- pdf
|       |-- cjk
|       |   `-- version.rb
|       `-- cjk.rb
`-- asciidoctor-pdf-cjk.rb # <- require 'asciidcotor/pdf/cjk'

In general I try to follow the RubyGems conventions, but there are places where I don't agree with the recommendations. These are the two main examples.
In both places, I have found some precedent for my choice, so I wouldn't say it's just the Asciidoctor way. It's just another popular view. I'll provide some reasoning behind my choices.
Regarding the require path, I find asciidoctor/pdf non-ideal for several reasons. First, it's more awkward looking on the commandline:
asciidoctor -r asciidoctor/pdf file.adoc

But the stronger reason is that it gives the impression that it is part of Asciidoctor core, and potentially conflicts with that namespace, whereas asciidoctor-pdf makes it clear that it's a separate gem.
But above all, the problem is that it's confusing for novices because the require path doesn't match the gem name. So it's very non obvious why they have to use asciidoctor-pdf to install the gem but asciidoctor/pdf to require it. And I think that's what really clinched it for me.
Having said all that, I'm 100% in support of doing what Asciidoctor LaTeX did, and what you are proposing, which is to add a require alias at the path asciidoctor/pdf so that you can type it either way. However, I still believe that the implementation files should be under the asciidoctor-pdf directory. It avoids a namespace collision and it isn't so deeply nested.
Regarding the class naming convention, years of Java development has taught me that acronyms should not be in all uppercase as it's a) harder to type and b) makes it harder to implement "bean conventions" because if you lowercase the first letter and the rest of the letters are uppercase, it just looks strange (e.g., "hTML"). There are cases of this convention in some of the top gems like multi_json and sass. I'm willing to reconsider, but it does have a ripple effect into Asciidoctor core.

I'll add the require path alias.

OK. So I will keep alias too.
And I'm using Asciidoctor::Pdf::CJK module name, should I change it to Asciidoctor::Pdf::Cjk? If it will have a ripple effect into Asciidoctor core.

I think it's good to be consistent within our own ecosystem, so I recommend Asciidoctor::Pdf::Cjk.

I studied a lot of the gems in the ecosystem as well as Ruby core. I've determined that it's most common for acronyms to remain in uppercase, so I decided to adhere to that. I've also decided to add asciidoctor/pdf and asciidoctor/pdf/version as require aliases. We may decide to move the files in the future, but at least now to the consumer it appears like the files have that structure.

I have an idea that I'd like to float. What if we use all uppercase for an acronym that stands alone (e.g., PDF), but sentence capitalization when combined with another word (e.g., PdfObject)? That way, we kind of get the best of both worlds.
For reference, I polled Twitter about the casing issue. See https://twitter.com/mojavelinux/status/782878580871049216. That led to a few references regarding style:

https://google.github.io/styleguide/javaguide.html#s5.3-camel-case
http://cr.openjdk.java.net/~alundblad/styleguide/index-v6.html#toc-class-interface-and-enum-names
http://stackoverflow.com/questions/2236807/java-naming-convention-with-acronyms/7366332#7366332

The recommendations in (2) support by idea. "Format an abbreviation as a word if it is part of a longer class name." Therefore, I'm inclined to adopt it.

https://github.com/bbatsov/ruby-style-guide#naming
This guide recommend PDFObject.

Yes, that is true. We are discussing challenging that convention. It appears that the Ruby convention is at odds with much of the industry.

Both style are valid syntax, and will not bring real problems, it's OK to formulate a gem specific style. The best part of a convention is avoid spending time on formulate style.
If choose a style, it's better to choose a Ruby style but not Java, because it's Ruby gem. (and same with other language)

If choose a style, it's better to choose a Ruby style but not Java, because it's Ruby gem. (and same with other language)

While you have a good point, what we decide here is going to affect the whole Asciidoctor ecosystem, which spans numerous languages (Ruby, JavaScript, Asciidoctor). We don't want to have different rules for different language platforms within the ecosystem or else it gets really confusing for polyglot users. In particular, the AsciidoctorJ API mirrors the Ruby API, so we'd end up violating Java's style.
I really think that the PDF / PdfObject split is a great compromise that is forward thinking. Ruby is definitely stuck in the past here.

To confuse matters, JRuby seems to use both conventions :/
http://www.javadoc.io/doc/org.jruby/jruby-complete/<IP_ADDRESS>

what we decide here is going to affect the whole Asciidoctor ecosystem

Fine, I have not considered that.
Best way is follow style in each language, but it need a lot of work.
For cross language style, it does not need to be consistent with Ruby style, Pdf is OK, be consistent in the ecosystem. I confuse with PDF and PdfObject.


UPSERT doesn't properly when call it twice in parallel

OrientDB Version: 3.1.0 from develop branch (yesterday)
Java Version: docker openjdk:8-jdk-alpine
OS: docker openjdk:8-jdk-alpine
Expected behavior
Number of clusters doesn't matter.
I thought to set cluster to 1 is fixing this problem.
The records have the same cluster id, but it still inserts twice
Actual behavior
Sometimes (nearly 30%) it creates two records with the same data but different @rid.
Steps to reproduce
CREATE PROPERTY `TForm`.`timestamp` DATETIME
ALTER PROPERTY `TForm`.`timestamp` DEFAULT sysdate("yyyy-MM-dd HH:mm:ss")
CREATE PROPERTY `TForm`.`answer` EMBEDDEDMAP STRING
CREATE PROPERTY `TForm`.`document` STRING
CREATE PROPERTY `TForm`.`type` STRING

Call this sql twice via REST API in parallel with the same variables
UPDATE TForm
SET
    answer.test = :test
UPSERT
RETURN AFTER
    $current.@rid, $current.answer
WHERE
    type = :type AND
    document = :owner

Hi @freeart
The UPSERT relies on a simple query to retrieve the existing record, if you do it concurrently there is a chance of a race condition.
To avoid it, you should define a unique index on the UPSERT condition.
BTW, you should also set the WHERE condition explicitly, ie.
SET
    answer.test = :test,
    type = :type,
    document = :owner
UPSERT
RETURN AFTER
    $current.@rid, $current.answer
WHERE
    type = :type AND
    document = :owner

@luigidellaquila Thanks for advice about WHERE.
Can I use transactions to prevent it?

Hi @freeart
Transactions guarantee isolation, but not uniqueness of application level keys, so it won't help much
Thanks
Luigi

@luigidellaquila Thanks! So, I should change the logic little bit because in my case document and type is not unique for some cases.


drivers: can: validate the use of CAN IDs and CAN ID masks before passing them to the drivers

Validate the CAN ID used in the can_frame struct before passing it to the drivers.
Validate the CAN ID and CAN ID mask used in the can_filter struct before passing it to the drivers.
Remove the use of bitfields in the can_frame struct.
Remove the use of bitfields in the can_filter struct.
Add tests for sending CAN frames with invalid CAN IDs.
Add tests for adding CAN RX filters with invalid CAN IDs and CAN ID masks.

The above changes in validation revealed an issue with the CAN ISO-TP protocol implementation, which was using 29-bit CAN ID masks regardless of the type of CAN RX filter.

@str4t0m, @alexanderwachter, @martinjaeger I could use some help in reviewing this.

Generally looks good. However, I was wondering what the advantage of the new approach is. With bitfields one would get some of the checks at compile-time instead of runtime.

Generally looks good. However, I was wondering what the advantage of the new approach is. With bitfields one would get some of the checks at compile-time instead of runtime.

The bitfields only allow for checking against 29-bit CAN IDs, so they're only half the solution. One would still have to check the flags and check 11-bit CAN IDs.
Furthermore, it is possible to assign a larger value to the bitfield in code. This will result in a compiler warning and a wrap-around, but again - it only does this for 29-bit CAN IDs.
As you can tell from the PR description, these changes actually caught a few issues in the ISO-TP implementation.


pointer is dereferenced for output message

Testing source of an embedded system i get a segfault for displaying the error message, because it want to dereference pointers.
A short example:
// flash.h
void flash_write(int *adr);

// save.h
void save_data();

// save.c
#include "flash.h"

void save_data()
{
        flash_write((int *)1);
}

// test_save.c
#include "unity.h"     // compile/link in Unity test framework
#include "save.h"
#include "mock_flash.h"  // baz.h will be found and mocked as mock_baz.c + compiled/linked in

void setUp(void) {}

void tearDown(void) {}

// another test case function
void test_save_pointer(void)
{
    flash_write_Expect((int *)2);
    save_data();
}

Pointers to 1,2, .. may be correct for the embedded system and the flash functions are mocked, this should be ok for testing.
But I get
Test 'test_save.c'
------------------
Generating runner for test_save.c...
Compiling test_save_runner.c...
Compiling test_save.c...
Linking test_save.out...
Running test_save.out...

ERROR: Test executable "test_save.out" failed.
> Produced no final test result counts in $stdout:
Segmentation fault
> And exited with status: [0] (count of failed tests).
> This is often a symptom of a bad memory access in source or test code.

debugger shows the problem:
(lldb) target create "build/test/out/test_save.out"
Current executable set to '...testpointer_ceedling/build/test/out/test_save.out' (x86_64).
(lldb) run
Process 658409 launched: '.../testpointer_ceedling/build/test/out/test_save.out' (x86_64)
Process 658409 stopped
* thread #1, name = 'test_save.out', stop reason = signal SIGSEGV: invalid address (fault address: 0x2)
    frame #0: 0x00005555555568cc test_save.out`UnityAssertEqualIntArray(expected=0x0000000000000002, actual=0x0000000000000001, num_elements=1, msg="Function called with unexpected argument value.", lineNumber=12, style=UNITY_DISPLAY_STYLE_INT, flags=UNITY_ARRAY_TO_ARRAY) at unity.c:833:30
   830
   831              default: /* default is length 4 bytes */
   832              case 4:
-> 833                  expect_val = *(UNITY_PTR_ATTRIBUTE const UNITY_INT32*)expected;
   834                  actual_val = *(UNITY_PTR_ATTRIBUTE const UNITY_INT32*)actual;
   835                  increment  = sizeof(UNITY_INT32);
   836                  length = 4;

Why is the pointer dereferenced? I want t test the pointer, not the data the pointer points to. Dereferencing for the error message is useless. How can I solve the segfault when a test fails?

There are a few ways to fix this, two of which are easy.
First, if you universally want to test pointers instead of the thing being pointed to, just switch cmock to that mode in the project.yml file:
:cmock:
  :when_ptr: :compare_ptr

Second, if you don't want to change the overall behavior, but you want pointers to int to be compared as pointers, you can instead add a row to your :treat_as configuration in the project.yml file:
:cmock:
  :treat_as:
    'int*' : 'PTR'

thanks!


Reduce the spacing between the banner and the first 3 images of the grid

Reduce the spacing between the banner and the first 3 images of the grid

can i take this?


FormulaInstaller: rescue already attempted install

[X] Have you followed the guidelines in our Contributing document?
[X] Have you checked to ensure there aren't other open Pull Requests for the same change?
[X] Have you added an explanation of what your changes do and why you'd like us to include them?
[ ] Have you written new tests for your changes? Here's an example.

We use brew install --only-dependencies in our CI jobs before building a package from source. Recently I noticed that some jobs were failing to install the needed dependencies, with brew silently stopping before all the dependencies were installed. I had to add some print statements, but I tracked it down to a rescue Exception in FormulaInstaller that was catching a FormulaInstallationAlreadyAttemptedError and raising. There are several other places where we catch this error and allow it to continue:

https://github.com/Homebrew/brew/blob/ae08b15cbe40a2022f6618e66863baafc2532e79/Library/Homebrew/reinstall.rb#L42-L43
https://github.com/Homebrew/brew/blob/b80defdd3323b52836e7e7ef3ed88b9f60eac2a5/Library/Homebrew/cmd/upgrade.rb#L191-L194
https://github.com/Homebrew/brew/blob/84c5f4079347fb7bc7844d594f5735347abf5607/Library/Homebrew/cmd/install.rb#L331-L334

So I've added the same rescue to FormulaInstaller.

I didn't do quite enough testing here. I confirmed that all the expected packages show up in brew list after brew install --only-dependencies, but the formula that had already attempted installation isn't linked and seems to have a tmp-keg in the Cellar: /usr/local/Cellar/libyaml/0.2.2.tmp
I think I'll need to change this a bit in a follow-up PR


Reactor upgrade

big refactor in reactivesocket-java requires some changes to this project also.

cc @lexs


Screenshot comparison via OpenCV

Integrate the image overlay algorithm into the screenshot comparison overlay.

Simple implementation in place using an asynchronous process to launch the python comparison script. This should be moved to it's own server because it's so computation heavy, but this is good for now.

Complete https://github.com/austinsand/doc-roba/commit/6140afaad7d130ae8ffa5586befc0a9b25db8bb3


Timer keeps moving across the screen

When a study session is on, the timer goes vertically up or down the screen every few minutes.

Disable the screensaver mode to disable this feature.

Thanks. I did not notice that the option was checked. Love using the app.


raise TypeError( TypeError: object of type <class 'numpy.float64'> cannot be safely interpreted as an integer.

[https://github.com/clwainwright/CosmoTransitions/blob/ba3339784f1a91fb23d374467cf83a948509aaa3/cosmoTransitions/pathDeformation.py#L761-L762](float instead of int)
[https://github.com/numpy/numpy/issues/15345#issuecomment-575917093](cosmoTransition issue)
After updating the numpy to the latest version I am facing this problem

@DarkKnight6777  will downgrade to older version actually make it work?


Sample NamedPipeClient code results in Exception

Issue description
<Unhandled Exception:Unhandled Exception: Unhandled Exception: Unhandled Exception:  System.IO.FileNotFoundException: Could not load file or assembly 'System.Runtime, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. The system cannot find the file specified.>
Target framework: .NET Core 2.2.401

.NET Core SDK (reflecting any global.json):
 Version:   2.2.401
 Commit:    729b316c13
Runtime Environment:
OS Name:     Windows
OS Version:  10.0.18362
OS Platform: Windows
RID:         win10-x64
Base Path:   C:\Program Files\dotnet\sdk\2.2.401\
Host (useful for support):
Version: 2.2.6
Commit:  7dac9b1b51

Thanks for your comment @AndrasHorinka. Can you let us know where you're seeing this sample?

@mairaw
started: here
Referred to
here - and changed from framework to core2.2
Running it on .NET Framework 4.7 results in an System.OverflowException - because the file referred (c:\textfile.txt) does not exists. Probably would worth to do a check if the file exists and if not create it.
Altering the file reference seems to fix it.
BR,

I believe this was fixed and the article has been updated.


snakemake >8.0.0 does not respect custom logging config

With Snakemake 7.32.4, I could have a SnakeFile like this where I reconfigured the log format of snakemake to be consistent with the log format used by the rest of my python code :

import logging.config

log_dict_config = {
        "version": 1,
        "disable_existing_loggers": False,
        'formatters': {
            'standard': {
                'format': '%(asctime)s [%(levelname)s] %(name)s: %(message)s'
            },
        },
        "handlers": {
            "console": {
                'level': 'INFO',
                'formatter': 'standard',
                'class': 'logging.StreamHandler',
                'stream': 'ext://sys.stdout',  # Default is stderr
            },
        },
        "loggers": {
            "snakemake": {
                "level": "DEBUG",
                "handlers": ["console"],
                "propagate": False,
            },
        },
    }

logging.config.dictConfig(log_dict_config)

This worked as expected:
$ snakemake --cores 1
2024-08-23 19:43:38,047 [WARNING] snakemake.logging: Building DAG of jobs...
2024-08-23 19:43:38,049 [WARNING] snakemake.logging: Nothing to be done (all requested files are present and up to date).
2024-08-23 19:43:38,049 [WARNING] snakemake.logging: Complete log: .snakemake/log/2024-08-23T194337.961575.snakemake.log

With Snakemake 8.0.0 and higher, the custom formatted logs still print, but snakemake itself seems to be printing its own lines in yellow as well, so every log message is repeated:
$ snakemake --cores 1
Building DAG of jobs...
2024-08-23 19:47:35,891 [WARNING] snakemake.logging: Building DAG of jobs...
Retrieving input from storage.
2024-08-23 19:47:35,893 [WARNING] snakemake.logging: Retrieving input from storage.
Nothing to be done (all requested files are present and up to date).
2024-08-23 19:47:35,893 [WARNING] snakemake.logging: Nothing to be done (all requested files are present and up to date).

How do I get the previous behavior back?

Seems to be related to #2809


Call to GenAdditionalCode(code_after_children) sometimes made before children are added

Description:

The logic for working with a node that has children is not correct. Currently, if the node's parent is a sizer, then the call to the node's code_after_children handler is made before the children are created. The only exception is type_aui_toolbar. That means if you put a regular toolbar underneath a normal sizer, then the call to Realize() gets generated before the tools are added, breaking the toolbar.

The problem with the sizer code has been resolved. Other generators may need this, but since it's not currently causing any known problems, I think it's best to revisit this after the release. I've removed it from the milestone.


chore: reexport toml_edit::Document

I think we should re-export:

all of toml
all of toml-edit
all of serde_json

(when the appropriate features are enabled)
cargo-dist pretty heavily uses toml-edit itself, and trying to be minimalist doesn't really accomplish much while making it so any changes to usage will require further changes to this API.

OK, updated to reexport all three. The downstream axoproject PR makes use of both of them now.


Changes to dictionary throws "Collection was modified; enumeration operation may not execute." on unmodified dictionary.

I had this code block:
foreach(string providerName in info.ExternalProfileVisibility.Keys)
{
    if (model.ExternalProfileVisibility.ContainsKey(providerName))
    {
        model.ExternalProfileVisibility[providerName] = info.ExternalProfileVisibility[providerName];
    }
}

model and info are instances of completely different class objects. Both define ExternalProfileVisibility as a Dictionary<string, CustomEnumType> where CustomEnumType is an enum.
After the loop runs exactly once, it throws the below error:

The relevant stack trace is as below:
Error message: Collection was modified; enumeration operation may not execute.
Source: System.Private.CoreLib

at System.ThrowHelper.ThrowInvalidOperationException_InvalidOperation_EnumFailedVersion()
   at System.Collections.Generic.Dictionary`2.KeyCollection.Enumerator.MoveNext()
   at WebApplication1.AccountController.ContactInfo() in D:\Src\Example\WebApplication1\Controllers\AccountController.cs:line 131
   at Microsoft.Extensions.Internal.ObjectMethodExecutor.Execute(Object target, Object[] parameters)
   at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.SyncActionResultExecutor.Execute(IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments)
   at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeActionMethodAsync()
   at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
   at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeNextActionFilterAsync()

When the loop variable collection is info and the collection being modified is model, both of which are completely different classes, why is the error thrown ?

Would suggest they both are the same dictionary so the data is already the same (as you are updating the dictionary with itself)?
Add a check to test this beforehand and see if it still errors
if (!ReferenceEquals(info.ExternalProfileVisibility, model.ExternalProfileVisibility))
{
    foreach(string providerName in info.ExternalProfileVisibility.Keys)
    {
        if (model.ExternalProfileVisibility.ContainsKey(providerName))
        {
            model.ExternalProfileVisibility[providerName] = info.ExternalProfileVisibility[providerName];
        }
    }
}

@benaadams As I already said in my original post, they are completely different class declarations.
info - is a business class in a different DLL
model - is a Model used in a View (a View Model)
The application is an ASP.NET Core MVC application.

[Sorry, I deleted the previous comment]
Thank you @benaadams  for pointing me in the right direction! Apparently, I had this line before the loop:
model.ExternalProfileVisibility = info.ExternalProfileVisibility;

This was causing a reference equality that would have been the reason for the exception.
Closing the issue.


introduce configmap for kubeless-controller

So far kubeless-controller did not have any specific configuration for it's functioning or customization.
As we add functionality and support more use-cases in Kubeless we need to preserve the seperation of concerns of the function user and cluster/kubeless opertator.
We need to have a ConfigMap for the Kubeless controller. Options like below can all go into configmap for the controller.

which ingress controller to use
should services backing the function be exposed or not
Garbage collector interval

I agree that we should introduce a configmap for storing the Kubeless configuration but I think that things related to how to expose a function should be in the function definition first (then we can have a global configuration in case is needed. That way you can have for example functions that are exposed to outside of the cluster and others that are internal for example.
In any case I think we should add to the config map the list of runtimes supported and its images (currently hardcoded in the langruntime package).


Simplify acp

Remove unnecessary configuration and convention
Move most configuration to extension
Provide support to get android dependencies from any 'provided' like plugin
When depending on project dependencies in apt configuration, also need to add a dependency on the acp configuration. This is not required once the compiler jar is packaged

So to confirm, only the annotation processing library itself needs to specify the config but consumers of that processor later don't?

So to confirm, only the annotation processing library itself needs to specify the config but consumers of that processor later don't?

Correct. Consumers do not even know that acp was used. This approach is api-invisible

Ignoring CI for now because I'll fix that later

Thanks!


sys-kernel/coreos-modules: Enable TPM TIS drivers for arm64

The arm64 kernel didn't have TPM support for the qemu TPM2 TIS software TPM.
This moves the TPM TIS kernel module enablement to the common config of both architectures. In addition it enables the SPI and I2C drivers.
How to use
This should make the clevis test work on arm64 as it does on amd64.
Note that there is still a service error message on first boot which causes kola to mark the test failed.
Testing done
TODO: When the build succeeds we could try the (fixed) kola test or do a manual test

@pothos I've pushed an amended commit that drops the I2C/SPI enablement.

On arm64 the tpm is now correctly detected:
[    1.694668] tpm_tis MSFT0101:00: 2.0 TPM (device-id 0x1, rev-id 1)

Should we merge this PR to fix the arm64 CI failures?

Cherry-picked for 3913


[SFML] update to <2.6.2>

Library name
SFML
New version number
2.6.2
Other information that may be useful (release notes, etc...)
Library name
SFML
Library description
2.6.2
Source repository URL
https://github.com/SFML/SFML
Project homepage (if different from the source repository)
No response
Anything else that is useful to know when adding (such as optional features the library may have that should be included)
Current highest version is 2.6.1, please update to 2.6.2

Fixed by #42118.


Fix float accuracy in ControlMathTest

The test was testing the result of 3D float vector operations with binary equality of the floating point numbers, which is not a valid assumption to make for floating point math. This change switches to proper comparisons with float accuracy and compares vectors using the norm of their difference.
@dagar Fixes Mac OS testing flakiness.

Why is it always on mac that the float checks are inconsistent. Could it be it doesn't point to the exact same definition of pi? I've seen that before. Anyways it's better like this.

I believe the difference is with clang.

I believe the difference is with clang.

Ah could be...
Btw I double checked and EXPECT_EQ() calls the operator==() and hence matrix::isEqual() otherwise I would have needed to fix a lot of my unit tests. But the float scalars need to be checked with the float comparison. I'll follow up if the other tests are not doing that.

Here's the follow-up: https://github.com/PX4/Firmware/pull/13790


Fix: State pattern

This pull request makes the following changes:

Fix issue #494

Checklist:

[x] I've renamed the classes to match the UML diagram
[x] I've added the return types for each method
[x] I've updated the relevant README file

Hi @BorislavSabev , this PR is ready for review, thanks for your work.

Hello @mth-bou. It looks very good.
Thanks for your submission.


Bump istio version to 1.21

Please provide a description of this PR:

@hanxiaop: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name
Commit
Details
Required
Rerun command

integ-telemetry-istiodremote_istio
4ae90e14a8451f68cbf1c2693374f3410c3ef98d
link
true
/test integ-telemetry-istiodremote

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@hanxiaop: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name
Commit
Details
Required
Rerun command

integ-telemetry-istiodremote_istio
4ae90e14a8451f68cbf1c2693374f3410c3ef98d
link
true
/test integ-telemetry-istiodremote

integ-telemetry_istio
4ae90e14a8451f68cbf1c2693374f3410c3ef98d
link
true
/test integ-telemetry

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/test integ-security-multicluster


[#97] Remove outdated code

[Closes #97] Remove outdated code

Codecov Report

Merging #100 (0457feb) into master (5da7097) will increase coverage by 0.21%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master     #100      +/-   ##
==========================================
+ Coverage   86.63%   86.84%   +0.21%
==========================================
  Files          15       15
  Lines         576      570       -6
  Branches      124      119       -5
==========================================
- Hits          499      495       -4
+ Misses         68       66       -2
  Partials        9        9

Impacted Files
Coverage Δ

src/components/Picker.vue
78.46% <100.00%> (+0.99%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5da7097...0457feb. Read the comment docs.

Codecov Report

Merging #100 (0457feb) into master (5da7097) will increase coverage by 0.21%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master     #100      +/-   ##
==========================================
+ Coverage   86.63%   86.84%   +0.21%
==========================================
  Files          15       15
  Lines         576      570       -6
  Branches      124      119       -5
==========================================
- Hits          499      495       -4
+ Misses         68       66       -2
  Partials        9        9

Impacted Files
Coverage Δ

src/components/Picker.vue
78.46% <100.00%> (+0.99%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5da7097...0457feb. Read the comment docs.


Unable to Start Embedded MI when something else is running in 8280

When starting the embedded Micro Integrator, dis regard of the offset defined in embedded one, it always checks for the availability of 8280 port and complains if its not available.
Hence its not possible to start the embedded server when another server ( like APIM ) is running outside with default configs.

This is observed only for MI_1.2.0 server


refactoring - pipelinerunstate

Changes
(restructuring only - no updates to any of the functions)
Creating a new file with all attributes of pipelinerunstate along with the test file (moved unit tests from pipelinerunresolution_test.go to pipelinerunstate_test.go)
Refactored following functions as an attributes of pipelunerunstate:

getTaskRunsStatus
getSkippedTasks
GetPipelineConditionStatus

I have left all of the functions under the same package resources for simplicity. We can create a new package and move it under that package in a separate PR.
/kind cleanup
/cc @bobcatfish @jerop
Submitter Checklist
These are the criteria that every PR should meet, please check them off as you
review them:

[x] Includes tests (if functionality changed/added)
[x] Includes docs (if user facing)
[x] Commit messages follow commit message best practices
[x] Release notes block has been filled in or deleted (only if no user facing changes)

See the contribution guide for more details.
Double check this list of stuff that's easy to miss:

If you are adding a new binary/image to the cmd dir, please update
the release Task to build and release this image.

Reviewer Notes
If API changes are included, additive changes must be approved by at least two OWNERS and backwards incompatible changes must be approved by more than 50% of the OWNERS, and they must first be added in a backwards compatible way.
Release Notes
NONE

/lgtm


Adds strain exercise

Hi, this PR is to add a new exercise for strain, here is a link to the problem-specifications
I'm still learning Crystal, so feel free to point out anything that needs to be change or improved.
Thanks!

No generator?

@mhelmetag strain doesn't have a canonical-data.json file to base a generator off of, you can see this from the problem-specifications folder.


git tfs clone throws System.OutOfMemoryException for a huge project

I'm trying to clone a huge project from our tfs repository. It is a huge project (over 10GB). Several weeks ago, I did successfully cloned one branch (not the Trunk), we normally working in that branch.
Now since I need to work on a different branch, I tried to clone the Trunk, which is suggested last time when I clone the branch. However, tried many times, and cannot success. The first two times, I got "Object reference not set to an instance of an object." error, then stopped. See from the below output. The third time, I added the -d to print more debug information. It gave me the OutOfMemoryException error.
I also noticed that after "the initialized empty Git repository in C:..."is printed, it took 3-4 hours to start the real clone, I mean, It took 3-4 hours for me to see the second print out "C13593 = ...". During that period of time, I did not see anything else printed and did not know what was going on. That's a little bit not so nice.
Thanks for your help. The following is the output of all my operations:
C:\Prj>cd git
C:\Prj\git>set PATH=C:\UserApps\vs2012\Common7\IDE\CommonExtensions\Microsoft\TestWindow;...;C:\UserApps\Git\bin;C:\UserApps\GitTfs-0.19.2
C:\Prj\git>git tfs clone https://subdomain.mycomp.com/tfs/depart $/BigProjs/Trunk .
Initialized empty Git repository in C:/Prj/git/.git/
C13593 = ad0dc903beb84627662d809959f622c9bd8b0302
C13594 = 3bb6c8ed8620b7702556d939da06e1a8090dcea2
Object reference not set to an instance of an object.
C:\Prj\git>git tfs clone https://subdomain.mycomp.com/tfs/depart $/BigProjs/Trunk .
Initialized empty Git repository in C:/Prj/git/.git/
C13593 = ad0dc903beb84627662d809959f622c9bd8b0302
C13594 = 3bb6c8ed8620b7702556d939da06e1a8090dcea2
Object reference not set to an instance of an object.
C:\Prj\git>git tfs -version
git-tfs version <IP_ADDRESS> (TFS client library <IP_ADDRESS> (MS)) (32-bit)
C:\Prj\git>git tfs clone https://subdomain.mycomp.com/tfs/depart $/BigProjs/Trunk . -d
Command run:git tfs clone https://subdomain.mycomp.com/tfs/depart $/BigProjs/Trunk . -d
No authors file used.
git-tfs version <IP_ADDRESS> (TFS client library <IP_ADDRESS> (MS)) (32-bit)
git command: Starting process: git init
Initialized empty Git repository in C:/Prj/git/.git/
git command time: [00:00:00.1600144] init
Fetching from TFS remote default
git command: Starting process: git log --no-color --pretty=medium refs/remotes/tfs/default --
git stderr: fatal: bad revision 'refs/remotes/tfs/default'
git command time: [00:00:00.2700243] log --no-color --pretty=medium refs/remotes/tfs/default --
An error occurred while loading head refs/remotes/tfs/default (maybe it doesn't exist?): Sep.Git.Tfs.Core.GitCommandException: Command exited with error code: 128
at Sep.Git.Tfs.Core.GitHelpers.Close(Process process)
at Sep.Git.Tfs.Core.GitHelpers.<>c__DisplayClass8.b__7()
at Sep.Git.Tfs.Core.GitHelpers.Time(String[] command, Action action)
at Sep.Git.Tfs.Core.GitHelpers.CommandOutputPipe(Action1 handleOutput, String[] command)    at Sep.Git.Tfs.Core.GitRepository.GetParentTfsCommits(String head, Boolean includeStubRemotes) git command: Starting process: git log --no-color --pretty=medium refs/remotes/tfs/default..HEAD -- git stderr: fatal: bad revision 'refs/remotes/tfs/default..HEAD' git command time: [00:00:00.2000180] log --no-color --pretty=medium refs/remotes/tfs/default..HEAD -- An error occurred while loading head refs/remotes/tfs/default..HEAD (maybe it doesn't exist?): Sep.Git.Tfs.Core.GitCommandException: Command exited with error code: 128    at Sep.Git.Tfs.Core.GitHelpers.Close(Process process)    at Sep.Git.Tfs.Core.GitHelpers.<>c__DisplayClass8.<CommandOutputPipe>b__7()    at Sep.Git.Tfs.Core.GitHelpers.Time(String[] command, Action action)    at Sep.Git.Tfs.Core.GitHelpers.CommandOutputPipe(Action1 handleOutput, String[] command)
at Sep.Git.Tfs.Core.GitRepository.GetParentTfsCommits(String head, Boolean includeStubRemotes)
info: refs/remotes/tfs/default: Getting changesets from 1 to current ...

Can't cleanup files because of UnauthorizedAccessException:
at Sep.Git.Tfs.Commands.Clone.Run(String tfsUrl, String tfsRepositoryPath, String gitRepositoryPath))wOnTopLevelDirectoryNotFound)
System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.OutOfMemoryException: Exception of type 'System.OutOfMemoryExcept
ion' was thrown.
at System.Net.ScatterGatherBuffers.AllocateMemoryChunk(Int32 newSize)
at System.Net.ScatterGatherBuffers..ctor(Int64 totalSize)
at System.Net.ConnectStream.EnableWriteBuffering()
at System.Net.HttpWebRequest.SetRequestSubmitDone(ConnectStream submitStream)
at System.Net.Connection.CompleteStartRequest(Boolean onSubmitThread, HttpWebRequest request, TriState needReConnect)
at System.Net.Connection.SubmitRequest(HttpWebRequest request, Boolean forcedsubmit)
at System.Net.ServicePoint.SubmitRequest(HttpWebRequest request, String connName)
at System.Net.HttpWebRequest.SubmitRequest(ServicePoint servicePoint)
at System.Net.HttpWebRequest.GetResponse()
at Microsoft.TeamFoundation.Client.Channels.TfsHttpWebRequest.SendRequestAndGetResponse(HttpWebRequest webRequest, WebException& webException)
at Microsoft.TeamFoundation.Client.Channels.TfsHttpWebRequest.SendRequest()
at Microsoft.TeamFoundation.Client.Channels.TfsHttpRequestChannel.Request(TfsMessage message, TimeSpan timeout)
at Microsoft.TeamFoundation.Client.Channels.TfsHttpClientBase.Invoke(TfsClientOperation operation, Object[] parameters, TimeSpan timeout, Object[]& outputs)
at Microsoft.TeamFoundation.VersionControl.Client.Repository5.Get(String workspaceName, String ownerName, GetRequest[] requests, Int32 maxResults, Int32 options, String[] itemPr
opertyFilters, String[] itemAttributeFilters, Int32 maxClientPathLength)
at Microsoft.TeamFoundation.VersionControl.Client.WebServiceLayer.Get(String workspaceName, String ownerName, GetRequest[] requests, Int32 maxResults, Int32 options, String[] it
emAttributeFilters, String[] itemPropertyFilters, Boolean noGet)
at Microsoft.TeamFoundation.VersionControl.Client.WebServiceLayerLocalWorkspaces.Get(String workspaceName, String ownerName, GetRequest[] requests, Int32 maxResults, Int32 optio
ns, String[] itemAttributeFilters, String[] itemPropertyFilters, Boolean noGet)
at Microsoft.TeamFoundation.VersionControl.Client.Client.Get(Workspace workspace, GetRequest[] requests, GetOptions options, GetFilterCallback filterCallback, Object userData, S
tring[] itemAttributeFilters, String[] itemPropertyFilters, Boolean alwaysQueryConflicts, Conflict[]& conflicts, Int32 operationId)
at Microsoft.TeamFoundation.VersionControl.Client.Workspace.Get(GetRequest[] requests, GetOptions options, GetFilterCallback filterCallback, Object userData, String[] itemAttrib
uteFilters, String[] itemPropertyFilters, Boolean alwaysQueryConflicts, Conflict[]& conflicts)
at Sep.Git.Tfs.VsCommon.WrapperForWorkspace.GetSpecificVersion(IChangeset changeset)
at Sep.Git.Tfs.VsCommon.WrapperForChangeset.Get(IWorkspace workspace)
at Sep.Git.Tfs.Core.TfsWorkspace.Get(IChangeset changeset)
at Sep.Git.Tfs.Core.TfsChangeset.Apply(String lastCommit, GitIndexInfo index, ITfsWorkspace workspace)
at Sep.Git.Tfs.Core.GitTfsRemote.<>c__DisplayClass22.<>c__DisplayClass24.b__21(GitIndexInfo index)
at Sep.Git.Tfs.Core.GitIndexInfo.Do(TextWriter stdin, IGitRepository repository, Action1 action)    at Sep.Git.Tfs.Core.GitIndexInfo.<>c__DisplayClass1.<Do>b__0(TextWriter stdin)    at Sep.Git.Tfs.Core.GitHelpers.<>c__DisplayClassb.<CommandInputPipe>b__a()    at Sep.Git.Tfs.Core.GitHelpers.Time(String[] command, Action action)    at Sep.Git.Tfs.Core.GitHelpers.CommandInputPipe(Action1 action, String[] command)
at Sep.Git.Tfs.Core.GitIndexInfo.Do(IGitRepository repository, Action1 indexAction)    at Sep.Git.Tfs.Core.GitTfsRemote.<>c__DisplayClass22.<Apply>b__20(ITfsWorkspace workspace)    at Sep.Git.Tfs.VsCommon.TfsHelperBase.WithWorkspace(String localDirectory, IGitTfsRemote remote, TfsChangesetInfo versionToFetch, Action1 action)
at Sep.Git.Tfs.Core.GitTfsRemote.WithWorkspace(TfsChangesetInfo parentChangeset, Action1 action)    at Sep.Git.Tfs.Core.GitTfsRemote.<>c__DisplayClass22.<Apply>b__1f()    at Sep.Git.Tfs.Core.GitTfsRemote.<>c__DisplayClass3a.<WithTemporaryIndex>b__39()    at Sep.Git.Tfs.Core.GitTfsRemote.WithTemporaryEnvironment(Action action, IDictionary2 newEnvironment)
at Sep.Git.Tfs.Core.GitTfsRemote.WithTemporaryIndex(Action action)
at Sep.Git.Tfs.Core.GitTfsRemote.Apply(String parent, ITfsChangeset changeset)
at Sep.Git.Tfs.Core.GitTfsRemote.FetchWithMerge(Int64 mergeChangesetId, Boolean stopOnFailMergeCommit, String[] parentCommitsHashes)
at Sep.Git.Tfs.Core.GitTfsRemote.Fetch(Boolean stopOnFailMergeCommit)
at Sep.Git.Tfs.Commands.Fetch.DoFetch(IGitTfsRemote remote, Boolean stopOnFailMergeCommit)
at Sep.Git.Tfs.Commands.Fetch.FetchRemote(Boolean stopOnFailMergeCommit, IGitTfsRemote remote)
at Sep.Git.Tfs.Commands.Fetch.Run(Boolean stopOnFailMergeCommit, String[] args)
at Sep.Git.Tfs.Commands.Fetch.Run(Boolean stopOnFailMergeCommit)
at Sep.Git.Tfs.Commands.Clone.Run(String tfsUrl, String tfsRepositoryPath, String gitRepositoryPath)
--- End of inner exception stack trace ---
at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
at Sep.Git.Tfs.Util.GitTfsCommandRunner.Run(GitTfsCommand command, IList1 args)    at Sep.Git.Tfs.GitTfs.Main(GitTfsCommand command, IList1 unparsedArgs)
at Sep.Git.Tfs.GitTfs.Run(IList`1 args)
at Sep.Git.Tfs.Program.MainCore(String[] args)
at Sep.Git.Tfs.Program.Main(String[] args)
Exception of type 'System.OutOfMemoryException' was thrown.
C:\Prj\git>
C:\Prj\git>

We are trying to clean up old/stale issues. As this issue hasn't seen any updates (or progress with pull requests) in quite a while, the issue will be closed. In case further information is provided, we can revisit that and reopen the issue again.


Run before/after for static files

Should it?

I don't have a use case for that but if anyone has please share !

I am compiling LESS files to CSS. It worked well in Spark 2.2 (and I think 2.3 too), but no longer in 2.5.
Also Stylesheets (.css files) are sent with Content-Type header of "text/html" which is wrong.

I am compiling LESS files to CSS. It worked well in Spark 2.2 (and I think 2.3 too), but no longer in 2.5.

Why would Spark have anything to do with LESS? When Spark tries to access them they're just normal CSS files?

Also Stylesheets (.css files) are sent with Content-Type header of "text/html" which is wrong.

This has been fixed on master.

Thank you very much :)
Spark itself has nothing to do with LESS, but I have been using a before filter to recompile them using https://github.com/i-net-software/jlessc if necessary

Spark itself has nothing to do with LESS, but I have been using a before filter to recompile them using https://github.com/i-net-software/jlessc if necessary

Never thought about doing that, interesting approach!

@tipsy Personally I don't see this as an issue with Spark. This isn't the intended way of Spark nor is it best practice for compiling LESS to css. (Although a very imaginative way to do so hat's of to you @TuxGamer ).

@tipsy Personally I don't see this as an issue with Spark

I agree, I'm just keeping the issue open in case anyone comes up with an actual use-case for before/after filters for static routes.

We have static files (Documents) which should only be downloaded by persons with proper authorization (stored in session). A before filter for the static file route would be useful for us.

Any work in progress for this issue?

Static web pages should be also displayed after security verification. We are using Google Polymer for frontend (http://polymer-project.org/) which at the end generates only static web pages. All GUI magic is done in HTML / Javascript. In such a model there is no way to implement security on user interface - only pulling data from server and actions implemented on server can be secured.
In  our case we will have to resolve to dirty workarounds to secure displaying some of the web pages.

Is there any workaround to do access restrictions for static files or is there a chance that before-filters will affect static files in the future?

Use Case:
Vary cache control for static files.
Static files with cache busting filenames can be served with very aggressive cache control headers,
whilst other static assets could be served with more with more moderate cache control.
For example:
A static terms of service page "toc.html" could be served out of the static assets with a cache expiry of 1 hour, but "8924398243934.js" could be set to expire after 1 year

Any update on this? I have index.html and want to protect it with a form authentication based on pac4j but cannot apply the security filter on it.

This issue led me to change my approach: I now use jetty webserver in embedded mode without spark framework. It's a bit more complicated but gives me a very high degree of flexibility.

Can you please give an example? I'm interested too :)

I wrote a brief description with code snippets:
http://www.pabst-software.de/doku.php?id=programmieren:java:webserver:jetty:start
Hope this is helpful to you.
BTW: If you look at this vast amount of initialization code you clearly see the benefits of the spark framework. I certyainly will continue using it in my smaller projects.

Please correct me if I am off point.
My current use case would be redirecting users from HTTP to HTTPS in order to facilitate HSTS for my static files.
A bit of background, I am using Spark in a Google App Engine Project and currently there doesn't seem to be a way to force users to go to HTTPS for static files, while all other API's are fine.
I have been searching for a way around this for a couple weeks now and I am unable to find anything that would work.

My use case for this is also authentication/authorization in before filters. Unfortunately I filled a similar issue  here: https://github.com/perwendel/spark-kotlin/issues/23
(using spark 2.6.0)

If you are comfortable forking and patching Spark yourself, look up the class MatcherFilter here: https://github.com/perwendel/spark/blob/2.6.0/src/main/java/spark/http/matching/MatcherFilter.java
More precisely lines 94 and 129. Haven't tested this yet, though.
Also Spark 2.2 runs filters on static files. I think there are no known vulnerabilities in 2.2, but I don't recommend using outdated software

Ok, I came up with this (attached), based on 2.6.0. But it needs further testing and reviewing.
MatcherFilter.zip

Just confirmed - it works fine, even in version 2.5.2. Placing the source file in my own project was sufficient.
Thank you very much :)

I would be happy if Per could have a look at it.

@perwendel Hi, I just wanted to point out that this issue is still opened and the change @StefanHub did wasn't implemented as of version 2.8.0.
Is there a reason for that? I mean, sure, there was no pull request, but ...

I'd like to add my voice to promoting this issue.  This would be an incredibly useful feature.


Update datasets-adding.md

updated broken links

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.


NOT WORKING FIX THIS PLS CAN U UPDATE THE BOT

it won't work at all it just says BOT ENABLED but doesn't do anything and when you type your answer in the bot doesnt let u type more then one number in please fixxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx

it work just it only does enter


Apply plan file + -chdir option

closes #17
related to #37 (for the chdir)
also related to #33
Happy to contribute!
I initially needed for the orb to handle using the saved plan from plan command as input in the apply command.
I saw that the parameter conflicted with the path parameter.
Path is now handled in Terraform (since 0.14.x) with a -chdir option in commands and changes the cwd before running terraform commands so I removed module_path from all file options interpolation passed to the different commands.
I additionally took the liberty to treat #17 on the way.
This code is currently published in my forked orb so that I can already use these functionalities and running in my pipelines.
Let me know if this PR needs to be split for your review.

Hey all, thank you for bringing this to our attention. We are going to close this PR in favor of #46. We are currently working on a new major version change and including multiple changes including this one.
We'd appreciate your comments and reviews over on the new PR as we continue to work on it.


wrap the tinkerpop to gaffer

we want to use gaffer in our project and I have to wrap the tinkerpop to gaffer,  we know you are doing it, could you give us a development schedule ? Thank you very much!

Hi @dongxinghua,
We have created a lightweight Gaffer implementation of TinkerPop in issue gh-110. This is due to be released within the next couple of weeks. It is included in 0.3.5-RC1 (release candidate 1), as soon as this has been tested it would be released as part of version 0.3.5.
There is a README for the TinkerPop implementation, that explains how to use it. Please note it is still experimental and should be used with caution.
As it is very early days with this TinkerPop implementation we would appreciate any feedback you have on it.


What is the correct process of enabling a new  region

Hi,
Anyone can help on how to activate a new region (ca-west-1) in global-config.yaml ?
My LZA in running version v1.6.4
I have added this line in global-config.yaml:
enabledRegions:

"ca-west-1"

And i got the following error :

I don't have a replacements-config.yaml file
Please , any suggestion on how to achieve this ?

Hello @ateguia2019, thank you for filing an issue with the Landing Zone Accelerator team!
This is the result of ca-west-1 not yet existing as a valid region within the LZA source code. Ca-west-1 will be included in the next release of the LZA. We are tracking this in a separate issue here: [#430] (https://github.com/awslabs/landing-zone-accelerator-on-aws/issues/430).
Closing this issue as regional support is tracked in the linked ticket, please feel free to follow up if you have any outstanding questions and thank you again for supporting the Landing Zone Accelerator.


set Jinja2 option to keep new line char at EOF

Relevant Jinja2 docs here
fixes #25

Can you update the branch?


Update README.md

What is this?
Add sub-headings.
Why?
Because it's easy to miss. I was looking for a way to delete breakpoints, but completely missed it - it was lost in all the noise.
https://github.com/ruby/debug/discussions/967
Thanks for your Pull Request 🎉
Please follow these instructions to help us review it more efficiently:

Add references of related issues/PRs in the description if available.
If you're updating the readme file, make sure you followed the instruction here.

Description
Describe your changes:

sorry, I made the mistake of directly updating the readme file.


Better way of determining the distribution codename

On my test system (Debian Squeeze) there is no /etc/lsb-release.
The lsb_release tool seems to be a standard, reliable way to get this
information.

Thanks, using the lsb_release command looks like the best way to identify the distribution.


Run this code in tensorflow, how do I fix it (I already have the Torch environment installed)I'm new

import torch
from torch.autograd import Variable
x_data = Variable(torch.Tensor([[1.0],[2.0],[3.0]]))
y_data = Variable(torch.Tensor([[2.0],[4.0],[6.0]]))
class Model(torch.nn.Module):
...     def init(self):
...         super(Model,self).init()
...         self.linear = torch.nn.Linear(1,1)  #线性神经网络，一个输入一个输出
...     def forward(self,x):    #前向传播网络
...         y_pred = self.linear(x)
...         return y_pred
... model = Model()
File "", line 8
model = Model()
^
SyntaxError: invalid syntax
criterion = torch.nn.MSELoss(size_average=False)    #定义损失函数
optimizer = torch.optim.SGD(model.parameters(),lr=0.01) #定义优化器
Traceback (most recent call last):
File "", line 1, in
NameError: name 'model' is not defined
for epoch in range(50):
...     y_pred = model(x_data)  #前向传递
...     loss = criterion(y_pred, y_data)    #计算损失函数
...     # print(epoch, loss.data[0])
...     print(epoch, loss.data.item())
...     optimizer.zero_grad()   #0 梯度
...     loss.backward() #后向传递
...     optimizer.step()    #更新权重
...
Traceback (most recent call last):
File "", line 2, in
NameError: name 'model' is not defined
#50次迭代训练后，神经网络模型训练完成
hour_var = Variable(torch.Tensor([[4.0]]))  #输入4.0
print("predict (after training)", 4, model.forward(hour_var).data[0][0])
Traceback (most recent call last):
File "", line 1, in
NameError: name 'model' is not defined
#输出模型预测结果

@Runchan140440,
Here we can see that you are trying to use the pytorch code which is not related to Keras/tensorflow and moreover the error stated that the model which you are using was not defined in your code. Kindly check with pytorch team for more assitance. Thank you!

@Runchan140440,
I was able to execute the mentioned code without any issues on tensorflow v2.12.  Kindly find the gist of it here.Thank you!


load_checkpoint_and_dispatch OOMs

System Info
- `Accelerate` version: 0.18.0
- Platform: Linux-5.15.0-1015-aws-x86_64-with-glibc2.31
- Python version: 3.9.16
- Numpy version: 1.24.1
- PyTorch version (GPU?): 2.0.0.dev20230202+cu116 (False)
- `Accelerate` default config:
        - compute_environment: LOCAL_MACHINE
        - distributed_type: DEEPSPEED
        - use_cpu: False
        - num_processes: 8
        - machine_rank: 0
        - num_machines: 1
        - rdzv_backend: static
        - same_network: True
        - main_training_function: main
        - deepspeed_config: {'deepspeed_config_file': 'deepspeed_z3.json', 'zero3_init_flag': True}
        - downcast_bf16: no
        - tpu_use_cluster: False
        - tpu_use_sudo: False
        - tpu_env: []

Information

[ ] The official example scripts
[X] My own modified scripts

Tasks

[ ] One of the scripts in the examples/ folder of Accelerate or an officially supported no_trainer script in the examples folder of the transformers repo (such as run_no_trainer_glue.py)
[X] My own task or dataset (give details below)

Reproduction
import sys
import torch
from transformers import LlamaForCausalLM
from accelerate import Accelerator
import deepspeed
from accelerate import load_checkpoint_and_dispatch

def main():
    accelerator = Accelerator()
    sft_model = LlamaForCausalLM.from_pretrained('llama-7b/')
    sft_model = load_checkpoint_and_dispatch(sft_model, 'models/best/pytorch_model.bin', device_map="auto")

    opt = torch.optim.Adam(sft_model.parameters(), lr=1e-5)
    (sft_model, opt, ) = accelerator.prepare(sft_model, opt,)

    sft_model.train()
    accelerator.train()

if __name__ == "__main__":
    sys.exit(main())

Expected behavior
This OOMs on a node with 8 80GB A100, and it should not. Also tried device_map = balanced and balanced_low_0, and I get the same OOM.

You cannot send your model to accelerator.prepare if using device_map="auto" (as the model will be split across GPUs already).

You cannot send your model to accelerator.prepare if using device_map="auto" (as the model will be split across GPUs already).

Looks like load_state_dict is trying to put the entire model on GPU 0. I have also tried balanced and balanced_low_0. I have also tried infer_auto_device_map, which also decides to put the whole model on gpu-0 coz the GPU is large enough to hold it. Putting aside the fact that it's not splitting the model across GPUs, a single GPU should be more than enough to hold this state_dict, so why does it OOM? I can torch.load() this onto a single 80GB gpu very easily.

@sgugger The from_pretrained works fine, so if I had saved my checkpoint using save_pretrained, everything is great. Unfortunately, I saved the state_dict, so when I load the state_dict, it OOMs with accelerate, even though there is plenty memory for the model to fit 3 times on 1 gpu.

The snippet of code above does not match what you are telling me. Could you please share something I can reproduce?


streamProvider : seeking does not put focus onto the needed piece it seems

version 37
when using the streamProvider I tested that when I seek to<PHONE_NUMBER> for example (total file size:<PHONE_NUMBER>), it does not actualy move the focus onto that piece. Eithe rI am not seeking correctly or the focus is not shifted to the wanted piece.
I seek like this:
        if (torrentStream != null)
        {
            torrentStream.Dispose();
        }

        if (torrentStreamProvider != null)
        {
            torrentStream = await torrentStreamProvider.CreateStreamAsync(torrentStreamProvider.Files[findex], false, new CancellationToken());
        }

torrentStream.Seek(offset, SeekOrigin.Begin);

What exactly is the issue you're seeing? When you seek - what makes you think focus is not shifting?

I see it is not downloading the bytes at the seeked position because I am not receiving the "piece received" event for that piece that holds the bytes for that byte position in the file.

It looks like it should, at least, be approximately correct.
You could look at TorrentManager.Files[$index].BitField as a way to see which pieces are available. It might be a good cross-check.
When you say you're not receiving the event for the piece you want to download, what pieces are you receiving events for and how long are you waiting?
Also, if you're not on rev37 then please try that first.

I use rev 37.  The event trigger I use to check the piece is "PieceHashed" ( torrentStreamProvider.Manager.PieceHashed += ...)

done some move testing. The seek does move to the correct piece number. Also the calcs seem to match ok. Makes me wonder why some seek requests simply take 3 minutes while at 2 mb/s download speed. Test results:
Summary:
moving cursor to 925794174. Received piece start bytes 935329792 = piece 446 as first after seek. should be 441.
2(441) : 924843903 -> 926941054 : received after few more seconds after seek.
piece length = 2097152
start piece = 0
end piece = 1560
total length =<PHONE_NUMBER>
RARBG.txt Idle 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
0(0) : 0 -> 30
1(0) : 0 -> 99
2(0) : 0 -> 2097022
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
2(1) : 2097023 -> 4194174
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
moving cursor...652a2429-933b-459b-8150-2a749292b189 to 925794174
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
2(2) : 4194175 -> 6291326
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
2(3) : 6291327 -> 8388478
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
2(4) : 8388479 -> 10485630
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
2(5) : 10485631 -> 12582782
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
Unsupported standard style: WS
RARBG.txt Completed 1% done =  False isMedia = False 0% done
RARBG_DO_NOT_MIRROR.exe Completed 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.mkv Downloading 1% done =  False isMedia = True 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb.nfo Idle 1% done =  False isMedia = False 0% done
the.mandalorian.s02e08.1080p.web.h264-dryb_tvm.jpg Idle 1% done =  False isMedia = False 0% done
2(446) : 935329663 -> 937426814
2(445) : 933232511 -> 935329662
Piece 441 followed next which is exactly the right one as requested.

Can you share a testcase which I can compile and run? It might help me figure out what's going on. At the moment I'm just taking shots in the dark to try and figure out what's going on :)

done some move testing. The seek does move to the correct piece number. Also the calcs seem to match ok. Makes me wonder why some seek requests simply take 3 minutes while at 2 mb/s download speed. Test results:

The stream picker prioritizes the required pieces and focuses on those first, but if a slow peer happens to get assigned to the piece, it can take a while before the piece is completed. It fluctuates enormously depending on the quality of the assigned peer, and there's no prioritization of 'fast' peers or cancellation when a prioritized peer takes too long. This is probably why it varies so much for you?

Perhaps!
I've decided to give this a much more thorough review to improve some of these aspects.
https://github.com/alanmcgovern/monotorrent/tree/tweak-picking
I've added prioritisation based on who is uploading fastest. Faster peers are assigned blocks from the high priority set first.
https://github.com/alanmcgovern/monotorrent/compare/tweak-picking#diff-2e05c0dd4662ce4f95cc996d74d62d095fe2d37cbe50f89ef503d1dec49f2cf1R173-R200
There's a stricter timeout on re-requesting pieces: https://github.com/alanmcgovern/monotorrent/compare/tweak-picking#diff-44e0b6ef75278a0411e80c6ea89f5080db563f56eaab467c90bae9a0df025faeR205
If we request the same block more than once, we're a little more lenient about accepting older requests. https://github.com/alanmcgovern/monotorrent/compare/tweak-picking#diff-44e0b6ef75278a0411e80c6ea89f5080db563f56eaab467c90bae9a0df025faeR168
I'll keep tapping away at this over the next few days. I suspect the recent changes to picking weren't quite good enough and made the streaming situation a bit worse. These need to be refactored/tested thoroughly before landing them, though if you're comfortable testing pre-release code please do compile the branch and let me know if it works better, or worse, for you.

@borrelnoten there's an issue with the latest release where the same blocks could be requested multiple times when a piece is considered "abandoned". This is the desired behaviour when in endgame mode (downloading the last few pieces) but was unintentionally activating during normal downloading due to the recent tweaks in how pieces are assigned.
The simplest thing for now is to go back a few revisions in the alpha releases to avoid the issue. A future alpha release will contain further tweaks to ensure this doesn't happen, and lay a simpler foundation for future piecepicking changes

I believe this is fixed in master now, but i haven't released a new update.
I'll close this for now! Thanks for reporting this!

I believe this is fixed in master now, but i haven't released a new update.
I'll close this for now! Thanks for reporting this!


Add proxy endpoint for e-items

At CERN, e-items can contain link that are not freely accessible, for example for ebooks that have been purchased by the library. The librarian will always mark such ebooks as open_access: False.
There are 2 types of closed access e-items:

the URL is accessible as anonymous, but then the provider/vendor will require login in their website
the URL requires a reverse proxy before (while will require CERN login). The link to the e-book should be prefixed withg the EzProxy URL. The URL will be marked as login_required: True

Implementation

[x] REST APIs: on login_required: True, when serializing back the response, a new field login_required_url should contain the final URL with EzProxy
[x] UI: change every UI cmp where the link with login_required is shown to use the new field login_required_url as value instead of the original.
[x] Adapt the migration script to set the right open_access and login_required fields for URLs.

Example
Record metadata
url: {
    value: "https://myprotectedurl.com?id=...",
    login_required: True
}

REST API response
url: {
    value: "https://myprotectedurl.com?id=...",
    login_required: True,
    login_required_url: "https://ezproxy.cern.ch?url=<encoded https://myprotectedurl.com?id=..."
}

Link
<a href="https://ezproxy.cern.ch?url=<encoded https://myprotectedurl.com?id=...">https://myprotectedurl.com?id=...

See wip: https://github.com/CERNDocumentServer/cds-ils/pull/169

Implements https://github.com/CERNDocumentServer/cds-ils/issues/31

Migration
This table determines when a link should be migrated as restricted or not.

rules \ links
EBL
Safari
Local files
rest of links(e-items)

"Open Access" in 8564_y
Restricted (by default)
Restricted (by default)
not taken into account(files restriction)
Not restricted

"Open Access" in 0247_q
Restricted (by default)
Restricted (by default)
not taken into account(files restriction)
Not restricted

"Open Access" in 536__r*
Restricted (by default)
Restricted (by default)
not taken into account(files restriction)
Not restricted

536__r*: This one is globally it means that applies to all e-items (except for EBL, Safari and local files) present in the record, while 8564_y and 0247_q only apply to one concrete e-item.
*
Note: EzProxy links should always be restricted otherwise we raise an exception.


Performable steps

Hi Everyone,
Can I get some guidance on how to create performable lab steps as well as a course outline for it? Which will cover all topics for this course.
Any help regarding this will be appreciated
Thank you.

hi @Kiyani1
my 2 cents:
This is an Architecture exam, so you won't find many questions focused on configuring a specific tool. On the contrary, you will find questions about the best solution for a given situation. See the Case Studies (/Instructions/CaseStudy/) and check the Microsoft Cybersecurity Reference Architectures (MCRA - https://learn.microsoft.com/en-us/security/cybersecurity-reference-architecture/mcra) for the best solutions for solving the problem.

@Kiyani1 We have recently added resources in a few of the MS Learn modules which include links to labs written and maintained by the product groups.

LP1 Mod 2 – Microsoft Sentinel Labs
LP2 Mod 2/LP3 Mod 2 – Defender for Cloud – Improve security posture
LP3 Mod 3 - Defender for Cloud Module 6 - Workload Protections
LP2 Mod 1 - Defender for Cloud Module 4 - Regulatory Compliance


Is enabling virtual displays supported?

https://cloud.google.com/compute/docs/instances/enable-instance-virtual-display

I never tried myself but it is art of the compute-v1 API so type: gcp-types/compute-v1:instances should support the property:
properties:
    displayDevice:
      enableDisplay: true

I never tried it myself, but it is part of the compute-v1 API so type: gcp-types/compute-v1:instances should support the property:
properties:
    displayDevice:
      enableDisplay: true

Woud you mind to try to add this property to a standard windows instance deployment?

I tried editing vm.yaml in the single-vm example as below.
Deployment succeeded but the virtual display is NOT enabled for the VM.  Please help.
===
imports:

path: vm_template.jinja

resources:

name: vm_template
type: vm_template.jinja
properties:
zone: us-west1-a
displayDevice:
enableDisplay: true

It works!  Thanks.

Hi Adam, if I want to use python, how should I modify the vm_template.py to enable virtual display?  Thanks.


[aws.ses] Support SES v2 ConfigurationSet fields

Affected feature

SES v2 has new ConfigurationSet fields, see https://docs.aws.amazon.com/ses/latest/APIReference-V2/API_CreateConfigurationSet.html .
Specifically:

DeliveryOptions.SendingPoolName
ReputationOptions.LastFreshStart
SuppressionOptions.*
Tags
TrackingOptions.*

Upstream: https://github.com/hashicorp/terraform-provider-aws/issues/14320

The upstream issue https://github.com/hashicorp/terraform-provider-aws/issues/14320 has been resolved as fixed, so I'll close this issue too. Please report a new issue if the problem occurs again.


WFLY-5687 max-active-sessions doesn't work with enabled statistics

It would probably be wise to expose expireOldestUnusedSessionOnMax as configuration option.
For now just make work again properly.

Linux Build 1658 outcome was FAILURE using a merge of fcaabe981292ae580bf5a7476ab20affc281b70b
Summary: Tests failed: 1 (1 new), passed: 2740, ignored: 322 Build time: 00:13:18
Failed tests
io.undertow.websockets.jsr.test.suspendresume.SuspendResumeTestCase.testConnectionClosedOnPause: 	at io.undertow.websockets.jsr.test.suspendresume.SuspendResumeTestCase.testConnectionClosedOnPause(SuspendResumeTestCase.java:168)

Windows Build 1356 outcome was FAILURE using a merge of fcaabe981292ae580bf5a7476ab20affc281b70b
Summary: Exit code 1 (new) Build time: 00:20:19


How to get blur_resolution_256.npz ? Thanks a lot.

I can not find this file  "'/mnt/lustre/feiben/DDPM_Beat_GAN/scripts/imagenet_dataloader/blur_resolution_256.npz'".

similarly, I can not find /nvme/feiben/DDPM_Beat_GAN/scripts/imagenet_dataloader/gray_resolution_256.npz. Is there any script to generate this base_file?


Unable to import documents at the rate I should be able to

I am trying to import documents from an external source.  The collection that is being used to import into has performance level S3 - therefore 2500 request units.   The documents I am importing (which are in the main of very similar size - 1150 bytes) report a charge of 3.5 RU's on average when inserted.
Therefore I should be able to import at a rate of about 700 documents/sec.
The maximum rate I can seem to achieve is around 150 documents/sec.
I read in the documents to import from storage and when the document insert is commented out it flies so the issue appears to be with the insert into documentdb.  The code uses threads heavily but no matter how many threads I create the rate will not exceed this amount.
I also have tried the bulk import stored procedure found on this site but that has no effect , the rate is still about the same.
Note that this is all running from within a deployed Azure application.
Any suggestions why this might be?
(I know there is a documentdb import tool available on github but it doesn't satisfy my specific requirements)

Please use either stackoverflow  or MSDN support forums to ask these sort of questions. The forums have a much bigger community following, plus the answer becomes useful to others. Thanks.


Some alternative variant links are broken

On https://hub.meltano.com/loaders/target-bigquery if you click the transferwise alternative variant it brings you to https://hub.meltano.com/loaders/bigquery--transferwise and shows page not found. The correct path is https://hub.meltano.com/loaders/target-bigquery--transferwise with "target" included in the extractor name.
Without looking at the code I wonder if this is related to us faking the name "target-bigquery" when the underlying package is "pipelinewise-target-bigquery".
Another example is https://hub.meltano.com/extractors/tap-postgres which links to https://hub.meltano.com/extractors/postgres--singer-io.

I think the issue will be solved by my PR #595 for bigquery
The issue is the same for postgres
https://github.com/meltano/hub/blob/main/_data/meltano/extractors/tap-postgres/singer-io.yml#L1
Line one has the wrong target name. If it goes from postgres -> tap-postgres I think the link will resolve itself.


docs(ledger-plugin): Create README file

Description.
As a potential user of Cactus I want to have documentation of what and how this package is used.
Describe the solution you'd like.
Add a README.md file in the packages/ledger-plugin folder with this package usage information.
Acceptance criteria.
The README file exists and contains the package information.

Package removed


Add build and publish tasks for EF6 package.

Actions to be taken:

Separate build task for EF6 projects (package and test). Since the projects target .NET Framework v4.7.2, probably we won't be able to use Ubuntu host and we'll need MSBuild here.
Task for publishing to Nuget. Right now, no package is generated on build. I can't remember what was the process in .NET Framework and in the old .csproj for this (I just know it was not easy :grinning:). Also have to add the package information (packageid, name, author, etc.)

It's fixed. Also, added build and test task for EF6 package. Pushed to Nuget.


Update Telegraf Collection Architecture documentation

Purpose of this pull request
Update Telegraf Collection Architecture documentation, Changes related to Helm Chart v3
Issue number: https://jira.kumoroku.com/jira/browse/SUMO-206934

Select the type of change:

[ ] Minor Changes - Typos, formatting, slight revisions
[x] Update Content - Revisions and updating sections
[ ] New Content - New features, sections, pages, tutorials
[ ] Site and Tools - Updates, maintenance, and new packages for the site, Gatsby, React, etc

@kimsauce please take another look