modify elf

Attempting to get a kickstart from the examples, I tried to write a tool that adjusts some debugging symbols (mostly compileunit paths), but the exact requirement on what to pass to read::Dwarf::load and write::Dwarf::write is not clear (I consulted the manual and the source, but that did not help much either).
Can somebody shed some light on how to approach modifying a loaded DebugAbbrev and DebugInfo writing a fully valid elf out with the modified changes? I'd much appreciate that.

The dwarfdump example contains a use of read::Dwarf::load. Probably what isn't clear is that the section and sup parameters need to return instances of Reader.
For write::Dwarf::write, you simply need to pass an instance of Sections which contains Writers. The convert_self test has an example usage.
If you're looking to write out a fully valid elf, then you'll need a Reader implementation that preserves relocations, and a Writer implementation that writes relocations. This is not an easy thing to do, particularly on the read side, because it wasn't designed for this use case. There's some code at https://github.com/philipc/rewrite that attempts to load and write an ELF file, but it is very much a work in progress. #409 is an example of something I want to do to make this better.

Also, if you only need this to work for executables and dynamic libraries (and not .o files), then the debuginfo won't have relocations. In that case, you can use EndianSlice or EndianReader for the Reader and EndianVec for the Writer.

I only need it to work for execute from flash embedded devices without any relocations and also only modifying the debug information which is dwarf 3 / dwarf 4.
API wise I need to load every section indipendently put into read::Dwarf (so not use it's load?) followed by the conversion with from - but where do I apply my modifications, in the read or in the write tree? The read tree has far more convenience/rustic methods than write, but none which mutate the tree (or I missed them).

API wise I need to load every section indipendently put into read::Dwarf (so not use it's load?)

Why not use load? All you need to do is provide load with a function that accepts a SectionId and returns the corresponding EndianSlice.

but where do I apply my modifications, in the read or in the write tree?

In the write tree, but note that write support is still under development. You're right that it has less convenience methods currently, but PRs to add them are welcome.

If I use load,the conversion to write::Dwarf fails with MissingCompilationDirectory

That's a bug then. Can you give me the info required to reproduce it?

I created this repo https://github.com/drahnr/dwarfhammer
interestingly the issue only appears when using armcc (not by choice, obtainable here with a trial license https://developer.arm.com/tools-and-software/embedded/arm-compiler/downloads/version-5 ).
I also tried with gnu-arm-eabi-none generated, but that fails differently.
Thanks for having a look into it, I'll try to create an example elf that shows the error.

@philipc added a sample via a downloadable url to the repo with the commit called tmp

The download link has expired.

Mea culpa, updated, I made the repo private and added you as contributor, link is in the same file as before.

Ok got that. It's missing a DW_AT_comp_dir attribute, so probably what we should do is change this to use an empty string instead of returning an error. e.g.
                let comp_dir = match from_header.directory(0) {
                    Some(comp_dir) => LineString::from(comp_dir, dwarf, line_strings, strings)?,
                    None => LineString::String(Vec::new()),
                };

Works for me, though I am not sure what the dwarf3/4/5 has to say about requirement of DW_AT_comp_dir being present or not?

It doesn't seem to say it is required.

Missing DW_AT_comp_dir fix is in #430.


[stable/jenkins] Added support for NodePort service type for jenkens agent svc

What this PR does / why we need it:
It configures the NodePort binding to be the same as the SlaveListenerPort binding when SlaveListenerServiceType=NodePort. This is done to support JNLP agents external to the Kubernetes cluster.
Which issue this PR fixes:
fixes #6506

/ok-to-test

/lgtm

/lgtm


Requesting a sensor for rotational velocity

The IMU sensor contains 2 size 3 vectors. The first has linear acceleration XYZ, and the second has angular velocity XYZ. I think that should be what you are looking for.


Salesforce to Snowflake Extract broken

Migrated from GitLab: https://gitlab.com/meltano/meltano/-/issues/200
Originally created by @tayloramurphy on 2018-12-06 15:14:31

Seems like a permission error?
https://gitlab.com/meltano/analytics/-/jobs/130525090

View 3 previous comments from the original issue on GitLab


Doesn't uninstall properly on Windows

When uninstalled, SyncTrayzor:

Does not stop the synctrayzor.exe and syncthing.exe processes
Leaves all the configuration data for both synctrayzor and syncthing in appdata
Leaves a bunch of files in Program Files\SyncTrayzor
Does not remove startup entry from Windows registry

Does not stop the synctrayzor.exe and syncthing.exe processes

I've done many upgrades and many installations myself in testing, and have never seen this. Do you have multiple users running SyncTrayzor perhaps? Anything else which you can think of which might affect this?

Leaves all the configuration data for both synctrayzor and syncthing in appdata

That's fairly standard practice for uninstallers, but having an option to remove it is a fair request. The complexity comes from the fact that the location of Syncthing's data can be customized, so it's hard for the uninstaller to find it.

Leaves a bunch of files in Program Files\SyncTrayzor

That will be because it couldn't stop the processes, for some reason.

Does not remove startup entry from Windows registry

Again, fairly standard practice (Run entries for applications which don't exist have a negligible cost). It's also a bit tricky to do from the uninstaller, as there may be multiple portable installations which all have entries, and picking the right entry gets a little bit fiddly. This is a solvable problem though.

No, it's just a single user, but it was started automatically at boot so maybe it uses a different user and that's why it couldn't kill the process? (If you use HKCU instead of HKLM for the run entry, it will be started as the current user) How do you stop the process in the uninstaller? Taskkill?
Leaving config data is understandable, it's common especially on windows, but it's annoying because it's not just a few kb so an option to remove it would be nice. Could be complicated to implement it though if you have to find syncthing's data. If you're using Inno Setup, you could write a script to find it relatively easily.
As for the registry entry, that should be pretty easy, it's the same as adding it. If you're using Inno Setup it can do it automatically.

(If you use HKCU instead of HKLM for the run entry, it will be started as the current user)

I do use HKCU.

How do you stop the process in the uninstaller? Taskkill?

Reading further, it looks like Inno Setup doesn't use the Restart Manager during uninstallation. We already have a general IPC mechanism for controlling a running SyncTrayzor process by running the exe again with various command-line flags, so the cleanest solution is probably to extend that.

If you're using Inno Setup, you could write a script to find it relatively easily.

I do use Inno Setup. It means parsing one of SyncTrayzor's XML configuration files, and substituting some placeholders. It's logic that I'd rather not duplicate between C# and Pascal, so it might make more sense to call into SyncTrayzor itself to do this. It's a few hours' work.

As for the registry entry, that should be pretty easy, it's the same as adding it. If you're using Inno Setup it can do it automatically.

As I explained in my previous post, there may be multiple Run registry entries for SyncTrayzor (given names with sequential numbers), and we need to do some work to find the one corresponding to the instance of SyncTrayzor which we're uninstalling.

The uninstaller does try and remove registry keys these days, although it's only best-effort as it can't remove other users' keys.

I am not able to uninstall Syncthing Trayzor on WIndows.  It leaves the exe file and I am not able to delete them.  I am getting a an error. No matter what I do I cannot remove Syncthing to reinstall. I have ended the process, Killed the process and nothing works.  I thought if I uninstalled and reinstalled, I would be able to run Syncthing again.
Any thoughts?

I am getting a an error.

What does the error say?

Any thoughts?

That screenshot says to read the log (which is the big block of text underneath Syncthing's UI). What does the log say?

09:12:41 INFO: syncthing v1.14.0 "Fermium Flea" (go1.16 windows-amd64<EMAIL_ADDRESS>2021-02-26 12:21:13 UTC
09:12:41 WARNING: Error opening database: The process cannot access the file because it is being used by another process. (is another instance of Syncthing running?)

OK, that's why Syncthing can't start. It's saying that another process has the database open, probably another Syncthing process. Check in Task Manager, see whether you can find it?
What's the error you get when trying to uninstall?

I did. I ended all processes and tried to uninstall, but I still get this message after the uninstall attempt.

You said you got an error when trying to uninstall, but haven't yet said what that error was, despite me asking twice. I'm afraid I can't help unless I know what's wrong.
I'm afraid I can't tell what process has Syncthing's database open: the only person who can figure that out is the person who has access to your computer, which is you. Process Explorer has a tool to see which process has a file open, or restarting might help. Either way, that's an issue with Syncthing: I'm afraid it's not something SyncTrayzor can help with.

Actually, you did help.  I knew there were several process that needed closed, but there were more than I thought when I started poking around in the Task Manager. Once they were all closed I was able to uninstall and reinstall.  Impressive I didn't have to do anything else.

Glad you got it sorted! The next version does a better job at stopping everything when uninstalling, but that won't have affected your original issue of Syncthing not being able to start


Keep terminal usable after "code ."

Issue Type: Feature Request

Run code . in some folder from terminal
Terminal is now actively running Code:

$ code .
[main 11:42:15 AM] update#setState idle

... and terminating the process closes Code, hence rendering that terminal window/tab unusuable.
What I would prefer is the way Sublime handles this. Running subl . opens Sublime in the current folder, without actively using up the terminal window. This allows you to continue using that terminal window, and you don't have to keep a terminal instance running just to keep Code open.
VS Code version: Code 1.21.1 (79b44aa704ce542d8ca4a3cc44cfca566e7720f1, 2018-03-14T14:46:47.128Z)
OS version: Windows_NT x64 10.0.16299

System Info

Item
Value

CPUs
Intel(R) Core(TM) i5-2500K CPU @ 3.30GHz (4 x 3300)

Memory (System)
7.97GB (4.31GB free)

Process Argv
C:\Program Files\Microsoft VS Code\Code.exe

Screen Reader
no

VM
0%

Extensions (18)

Extension
Author (truncated)
Version

line-jumper
ale
0.1.0

vscode-custom-css
be5
2.7.0

vscode-eslint
dba
1.4.7

tslint
eg2
1.0.28

scaffold
fir
1.0.0

vs-color-picker
lih
0.7.0

theme-monokai-pro-vscode
mon
1.1.5

csharp
ms-
1.14.0

debugger-for-chrome
msj
4.2.1

vetur
oct
0.11.7

sass-indented
rob
1.4.8

vscode-paste-and-indent
Rub
0.0.8

code-settings-sync
Sha
2.9.0

vscode-fileutils
sle
2.8.1

react-beautify
tai
0.3.0

ayu
tea
0.14.0

sensitive-replace
vil
0.1.1

markdown-all-in-one
yzh
1.1.1

(1 theme extensions excluded)

Reproduces without extensions

What does which code return?

My PATH includes the folder in which I have VS Code installed (C:\Program Files\Microsoft VS Code).
Is the behavior I explained not the intended one?

You should add C:\Program Files\Microsoft VS Code\bin instead, where there's a launcher script which will do the right thing.

Thank you, much appreciated. Is this documented somewhere, and I just missed it?

Thanks a lot joaomoreno !!!

I am having this same issue and I have C:\Program Files\Microsoft VS Code\bin in my $PATH. Any help on this would be wonderful. It's very annoying to have to open vscode manually and find files/folders when I'm used to just opening them from a terminal since I'm working in a terminal more often than not.
Thanks!


Generated .vtk craches in paraview when trying to slice.

Hello Alex,
I have a .rst file that I save as .vtk using pyansys.
Here is my code snippet:
metrics = 'EMS ENF ENS ENG EGR EEL EPL ECR ETH EUL EFX ELF EMN ECD ENL EHC EPT ESF EDI ETB ECT EXY EBA ESV MNL'.split()
rstFile.save_as_vtk(filename='customOutput(' + getDateAndTime() + ').vtu', result_types=metrics, rsets=[1, 2])
It works very well, but when I open it in paraview, as soon as I try to slice it, it crashes and I can't find any logs from paraview. We have 2 methods of converting .rst to .vtk, and the other one works well in paraview. So it makes us think that it comes from pyansys.
I will provide a .rst sample as soon as I have one.
Thanks for looking at this,
Alexandre Ouimet

I bet there's some problem with the way I'm storing the mesh.  Once you have that result file I'll be able to take a look at it.

Great,
I'm sorry that it takes so long, I'm not the one producing the .rst so I have to wait until the guy at my office produces another one :/

Hello again!
I have the result file but it is 300Mo, I will put it in a drive and share it to you with your email address.
If I'm correct, it is<EMAIL_ADDRESS>Thank you for your great work in this project!

Email address is correct.  Thanks!

Closing due to inactivity.  Ping me if you still have an issue.


Some Characters are not displayed as it was when pasted

Describe the bug
Some characters like the >= and the != are displayed in some other format.
When I share these pastes to other people, they find it difficult to decipher these characters.

To Reproduce

paste the code below
submit in easypastes

 while(start < end){
            if(str[start++] != str[end--]){
                return false;
            }
        }
        return true;
    }

    void backtrack(vector<string> &curr, const int start){
        if(start >= str.length()){
            ans.push_back(curr);
        }

Expected behavior
The != character should be displayed just like the != character.
Screenshots
If applicable, add screenshots to help explain your problem.

https://www.easypastes.tk/pastes/2z4pV5
Desktop (please complete the following information):

OS: [e.g. iOS]
Browser [e.g. chrome, safari]
Version [e.g. 22]

Smartphone (please complete the following information):

Device: [e.g. iPhone6]
OS: [e.g. iOS8.1]
Browser [e.g. stock browser, safari] any
Version [e.g. 22]

Additional context
Add any other context about the problem here.

This is intended behaviour. We use Fira code font for the ligatures. If you're not sure about what ligatures are, Check this out.
It will be copied as normal text, for example if you copy not equal to symbol, It is copied as != regardless of the unicode ligature display.

The problem is some people misunderstand the character as some other literal in the language.
Thanks.

We'll look into this issue, once we get the time! Since this is more of a feature addition.

Yes we'll add an option for disabling font ligatures. Thanks for creating the issue @aditya-mitra

@max-programming We could add a toggle button to enable or disable ligatures, Connected to DB. Just like how we have for other options. More about that later, Adding this PR to the TODO list, will be worked on when we are done with the list, as we are going through each feature one by one.

@max-programming We could add a toggle button to enable or disable ligatures, Connected to DB. Just like how we have for other options. More about that later, Adding this PR to the TODO list, will be worked on when we are done with the list, as we are going through each feature one by one.
Making it a toggle button based config on a paste basis, could enable user to customize each paste how they want. It would make it easier in my opinion too. We will work on this once we tackle the other features one by one. Hope you understand! 😁

Yes. Or we could create a modal for additional settings where we could add this and many other settings


[GSSOC'21] Navgation bar not work in mobile view or reponsive view

Describe the bug
when I goto the mobile view than the navbar toggle not work.
So can you assign me? I can work on this issue.

Hey, I'm gssoc'21 participant, I would like to give my hand in this project. Please assign this issue to me.

Fixed


Could not find suitable src file for header.h, using all compiler flags

I keep on seeing this message. Don't know if it is a warning or not.
cmake-ide [Mon Jun 27 19:19:27 2016]: Could not find suitable src file for /path/to/header.h, using all compiler flags
Not exactly sure what it means. It suggests every header file opened tries to look for a similarly named src file. I have the cmake-ide-header-search-other-file set to nil but not sure if related.
               (setq cmake-ide-header-search-other-file nil
                     cmake-ide-header-search-first-including nil
                     cmake-ide-try-unique-compiler-flags-for-headers nil)

Should I worry about the message above? Opening files with rtags is not very fast on my 4MB compile_commands.json file so I am trying to find as much time as possible,

Nothing to worry about, it just means it couldn't find a suitable set of flags for that header file so it defaults to using all of them. I could delete the message if it's confusing.

ok. thanks.


Curious about Why compute cycles do not change when all of IfmapSramSzkB/FilterSramSzkB/OfmapSramSzkB increase

@AnandS09 @jmjos @boukhary123 @ritikraj7
Okay, I am sorry to trouble you! When I use the following memory options,

IfmapSramSzkB = 16
FilterSramSzkB = 16
OfmapSramSzkB = 16
<other options remain default>

IfmapSramSzkB = 32
FilterSramSzkB = 32
OfmapSramSzkB = 32
<other options remain default>

IfmapSramSzkB = 64
FilterSramSzkB = 64
OfmapSramSzkB = 64
<other options remain default>

IfmapSramSzkB = 128
FilterSramSzkB = 128
OfmapSramSzkB = 128
<other options remain default>

I find no change in compute cycles!
In DETAILED_ACCESS_REPORT.csv, I find compute cycles could be regarded as the runtime of each layer!
Then I guess that the problem may attribute to the scale of systolic array! When I use 32 x 32 systolic array, the 16/32/64/128 KiByte sram is enough to support the calculation of systolic array with no stalls. In this thought, if I use a large systolic array, the calculation process may meet stalls and
Then I try a large systolic array (4096 x 4096) and use the following sram schemes:

IfmapSramSzkB = 1
FilterSramSzkB = 1
OfmapSramSzkB = 1
<other options remain default except array>

IfmapSramSzkB = 2
FilterSramSzkB = 2
OfmapSramSzkB = 2
<other options remain default except array>

IfmapSramSzkB = 3
FilterSramSzkB = 3
OfmapSramSzkB = 3
<other options remain default except array>

Unluckliy, the compute cycles  of all of these three schemes are no difference, that is they are share the same values.
Please spare your precious time, thanks very much!

I have the same question. Would you please help me with this question?


DefaultUriTemplateHandler.insertBaseUrl adds extra / to URL

I have built a SDK using Spring-Vault 1.0.0.M2. It works fine until I switched to 1.0.0.RELEASE. Stepping into the code, I have found the URL sent to Vault has extra / -- http://<IP_ADDRESS>:8200/v1//sys/auth/cert. Further looking into the code, there is a line (#121) in
DefaultUrlTemplateHandler.insertBaseUrl(UriComponents uriComponents)
String url = getBaseUrl() + uriComponents.toUriString();
I think to be defensive, the code should first check if there is any leading/trailing / before concatenates the string to avoid the extra / in the URL. Currently, the issue basically blocks me from using GA version in the SDK.

Which Spring Framework version are you using? Spring Vault requires at least Spring Framework 4.3.0.

Here is a snippet from my SDK pom.xml. Spring Framework version should be fine.
           <dependency>                 <groupId>org.springframework.vault</groupId>                 <artifactId>spring-vault-core</artifactId>                 <version>1.0.0.RELEASE</version>             </dependency> 			<dependency> 				<groupId>org.springframework</groupId> 				<artifactId>spring-context</artifactId> 				<version>4.3.4.RELEASE</version> 			</dependency>             			<dependency> 				<groupId>org.springframework</groupId> 				<artifactId>spring-expression</artifactId> 				<version>4.3.4.RELEASE</version> 			</dependency>            			 			<dependency> 			    <groupId>org.springframework</groupId> 			    <artifactId>spring-core</artifactId> 			    <version>4.3.4.RELEASE</version> 			</dependency>                         <dependency>                 <groupId>org.springframework</groupId>                 <artifactId>spring-beans</artifactId>                 <version>4.3.4.RELEASE</version>             </dependency>             <dependency>                 <groupId>org.springframework</groupId>                 <artifactId>spring-aop</artifactId>                 <version>4.3.4.RELEASE</version>             </dependency> 			<dependency> 			   	<groupId>org.springframework</groupId>     			<artifactId>spring-test</artifactId>     			<version>4.3.4.RELEASE</version> 			</dependency>

Please learn how to properly format code and logs.

We're using a custom DefaultUriTemplateHandler(PrefixAwareUriTemplateHandler) to build the appropriate URL and strip/add slashes as needed.
In particular, it's the spring-web dependency that is required to be 4.3. Earlier versions will skip prefix/slash sanitization. I wasn't able to reproduce the issue using Spring Framework 4.3.4.RELEASE.
Can you provide us a minimal reproducible test case? A Github repo or Gist containing the code should be sufficient.

Thanks for the reply. I will try to provide a reproducible test case.


Export *Input flow types

This should address issue #320.

Seems like I messed up the git history for my branch while trying to fix my commit.
Will open another PR.


CI Enhancement: All routers under test should have a consistent API for accessing the management interface

https://github.com/skupperproject/skupper-router/pull/743#discussion_r984679281
There is a hardcoded "convention" where the CI router class uses 'router.addresses[0]' as the network address for the AMQP listener used for management requests.  This convention is not enforced, and where it is used the tests hardcode router.addresses[0] in line.
This makes it difficult to implement generic management operations in the router class, with the above link as an example.
Proposal:

remove hardcoded use of router.addresses[0] in tests by converting these to using the router.management property.
Update all test router configurations to ensure the first listener is a "normal" AMQP listener, or force this behavior by default in the Qdrouterd constructor (better).
If there are tests that MUST instantiate some other listener for management provide an optional "management address override index" to allow tests to specify which listener should be used for the router.management property
For any test that MUST not instantiate an AMQP listener due to test constraints then router.management should return None and the test is responsible for dealing with router cleanup, etc.

@ganeshmurthy Just FYI

@kgiusti router.addresses[0] returns a string while the router.management property seems to be an instance of the Node object. So, all uses of  router.addresses[0] cannot be immediately converted to use router.management property. Most of the tests that use router.addresses[0] make a connection on that address, that connection object could be replaced with router.management.connection


Dependency report configuration (size)

Hi!
In the dependency check report I read:
Dependencies Scanned: 1470 (1153 unique)
Because of this I guess, the size of the dependency-check-report.html file size is around 108 megabytes.
I really need to reduce the size of this, and I tried the following so for example, only the vulnerable dependencies are shown in the report:
dependencyCheck {
        analyzers {
            retirejs {
                filterNonVulnerable = true
            }
        }
}

However this isn't working, as it's still showing all the dependencies, and there's no different between using the filterNonVulnerable or not.

Depending on your use case - there are several report formats. HTML is the most verbose and likely the largest, but the XML, JSON, SARIF, and even CSV formats are smaller. Note that the CSV format is not very useful to determine if there are false positives.

You can even make a copy of the report velocity templates and create your own report.


Consider using horned-owl's IRI type instead of strings for entity identifiers

All the entity types in whelk have an ID that is represented by a string: https://github.com/INCATools/whelk-rs/blob/74e76cf4ddf35617b12d48389d3963445781bd3c/src/whelk/model.rs#L69-L77
In OWL this ID is an IRI. We should think about making this more explicit and directly using IRIs for the IDs. Would this save any memory? (When we translate from OWL to the Whelk model we could pass the IRI directly). Some recent IRI discussion in horned-owl: https://github.com/phillord/horned-owl/issues/56
We should probably wait for any IRI changes in horned-owl to be resolved before taking any action.

Nice idea. I think it confirms to me that we should not be validating IRIs by default, but only on demand.
It might save some memory but it should also simplify your code a bit -- I think you could ditch all the Rc's that you have currently in model.rs, as IRI already takes care of that (generically). You also gain multi-thread with Arc.
I guess this raises the question of code organisation. For whelk, it makes no difference, but I wonder whether IRI belongs in it's own crate.

Slightly different question, but I'd quite like to have whelk-rs as a dependency of horned-bin, so I can add a horned-reason command in. Currently that would give us a circular dependency, though. We should have a talk at some point about how to organise this!

We're depending on horned-bin so that we can use the parsers (in tests and also in our minimal CLI, which could be a separate product).

Just the convenience parse_path method as far as I can see. I think there is something to be reworked here, but guess I can leave it will we come to right a horned-reason command.

Just the convenience parse_path method as far as I can see. I think there is something to be reworked here, but guess I can leave it will we come to right a horned-reason command.

Oh I see, for our simple CLI we can probably just use the parsers directly if that lets us drop the horned-bin dependency.


[FLINK-19606][table-runtime-blink] Implement streaming window join operator

What is the purpose of the change
The pull request aims to implement streaming window join operator
Brief change log

Introduce WindowJoinOperator and WindowJoinOperatorBuilder
Refactor JoinConditionWithFullFilters  from  an inner class in AbstractStreamingJoinOperator to a common utility class, which could be used by AbstractStreamingJoinOperator and WindowJoinOperator.
Introduce StreamExecWindowJoin which is exec node for WindowJoin
Update  StreamPhysicalWindowJoin #translateToExecNode method
Introduce WindowListState, it is a wrapper of ListState which is easier to update based on window namespace

Verifying this change

*Added WindowJoinITCase which contains integration tests for windowJoin
*Added  WindowJoinOperatorTest which validates WindowJoinOperator behavior

Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (no)
The public API, i.e., is any changed class annotated with @Public(Evolving): (no)
The serializers: (no)
The runtime per-record code paths (performance sensitive): (no)
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn/Mesos, ZooKeeper: (no)
The S3 file system connector: (no)

Documentation

Does this pull request introduce a new feature? (no)
If yes, how is the feature documented? (not applicable)

cc @JingsongLi

We can just keep one JIRA to track these three PRs.

@JingsongLi Thanks for nice suggestions. The first pull is: https://github.com/apache/flink/pull/15752, please have a look at it.

@JingsongLi Thanks for nice suggestions. The first pull is: #15752, please have a look at it.

Thanks! You can create second PR too. You can rebase after first PR merged.

@JingsongLi Thanks for suggestion, the second PR is https://github.com/apache/flink/pull/15760. please have a look, thanks.

@flinkbot run azure

@JingsongLi I've update the pr, hope to address all your comments. please take a look, thanks alot.


Analytical Line Speed Improvements

Description
The analytical line algorithm had reduced performance from version 2 to 3:
v2 - Analytical line inversions complete.  1141.06s total, 1393.2274 spectra/s, 34.8307 spectra/s/core
v3 - Analytical line inversions complete.  1889.64s total, 841.3036 spectra/s, 21.0326 spectra/s/core

Current working theory is that the Geometry object is the fault due to reloading the same ESD file in a for loop:
Version 2

Version 3

Notice the large block on the bottom right of the v3 profiling. That is entirely a np.loadtxt operation:

Version 2 does not load an existing ESD file so does not have this overhead. It appears the analytical line algorithm repeatedly initializes the Geometry object which reloads this file:
for r in range(start_line, stop_line):
    for c in range(output_state.shape[1]):
        ...
        geom = Geometry(obs=obs[r, c, :], loc=loc[r, c, :])

This may explain why core utilization is less than 100% like version 2 experiences.
Changes

Cache the loaded ESD via a global variable within the Geometry module. This improved the performance to:

Analytical line inversions complete.  1196.91s total, 1328.219 spectra/s, 33.2055 spectra/s/core

Aha!  Excellent find.
Do we need the ray import in this module?

Removed the import. I was exploring putting the ESD into ray shared memory initially but decided to just go with a global variable instead.

Closing, migrated to #531 as a slightly different implementation, with the same speed improvements (from the same core issue) as noted above.


Swift program for printing all prime numbers in given range #1305

@gpt-anurag
Please link the issue. And next time, please follow the PR template and provide necessary information.
Example:
Closes #1
Thank you!


Jw/changing how jwt is passed around

Standardized on a structure to pass around auth data instead of expecting downstream code to parse headers
pub struct UserAuthContext {     pub scheme: Option<String>,     pub token: Option<String>, }
an immediate follow up cleanup should address the following challenges:

duplication between code in http/user/mod.rs and http/user/extract.rs
optionality of UserAuthContext fields - when context is required, its fields should not be optional
tie userauthcontext to the auth strategy. make the strategy define whether certain edge cases (e.g. lack of token) should be interpreted as errors or dismissed

@shopifyski looks like some checks CI failures that need to be addressed! I just ran ci.


fix: 修复 datepicker 圆角椭圆问题

=>

fix https://github.com/Tencent/tdesign-vue/issues/588 、https://github.com/Tencent/tdesign-react/issues/489


Initial attempt at CONTRIBUTING.md

Copied from cookiecutter:
https://raw.githubusercontent.com/MozillaSecurity/cookiecutter-python-project/master/{{cookiecutter.repo_name}}/CONTRIBUTING.md
Fixes #209

👍


V0.1.1 Adding pytest for bigquery

Name: pytest for bigquery
About: Implement a test for class source bigquery
title: ''
labels: ''
assignees: ''

Is your pull request related to a issue? Please tag.
Describe the solution you have implemented
Describe the solution you have implemented
I implemented a test for the source_bigquery class using pytest. This includes covering various scenarios to ensure the class behaves as expected with different inputs and configurations.
Describe why alternatives you considered are not optimal
Using unittest was considered, but pytest was chosen for its concise and readable syntax, making the tests easier to maintain and understand.
Additional context
The tests were conducted against a mock BigQuery setup to ensure they can be executed in a local environment without needing access to an actual BigQuery instance.
Here's a screenshot of the test results:

@tusharchou  Please resolve this conflict.
Run the following commands :

git fetch origin
git switch main
git pull
git switch <branch_with_conflict>
git merge main
Resolve conflicts and commit


Conjur version should default to 5

If the service broker is configured so that the CONJUR_VERSION environment variable is set to an empty string, then the health check will fail because Conjur will return an error like uninitialized constant Conjur::API::Router::V0
The ConjurClient.version value should default to 5 if it's not set to a valid value (i.e., 4 or 5).

@BradleyBoutcher I'm going to reopen because this isn't yet released


Real-Sign package

What feature would you like to be added?
As titled
Why is this needed?
requirement for publishing Microsoft.AutoGen.* on nuget

any updates on this one? @lokitoth @LittleLittleCloud


Feature: Use lMeta$config_param for any specified parameters in Make_Snapshot().

Feature Details

lMeta$config_param should overwrite default values and always be used in Make_Snapshot().

Possible Implementation

Possible implementation similar to this.

@mattroumaya @samussiah Can we just remove lMeta$config_param from the data model? Seems like we're using custom YAML workflows instead of a table of parameter customizations.

I think we should lean in to specification using YAML workflows. Seems like {gsm} already runs fine without config_param/config_workflow assuming all needed customizations are provided as part of a folder of YAML files.
I'm honestly also considering removing meta_param and meta_workflow from the model as well. meta_param is currently barely used (if it's used at all). I think moving the content from meta_workflow in to the workflow YAML would work well, and allow a much simpler path for study-level customization.
I think all you'd really need to configure a study would be a folder of mappings and a folder of workflow yamls.

lMeta$config_param should overwrite default values and always be used in Make_Snapshot().

Back to this issue - Seems like this is already happening, but maybe needs QC? https://github.com/Gilead-BioStats/gsm/blob/f4b0e8ec9b7a71cd74a7a54e1f63dfe211c49d9d/R/util-MakeWorkflowList.R#L113-L120

I like the idea of ditching config_param and config_workflow and letting the workflows house the metadata. Just want to make sure we can identify invalid parameters and workflows.

Confirming that we're moving towards specifying configs directly in workflows.


chore: Update reth

Description
Updates reth commit.

📚 $\text{Stack Overview}$
Pulls submitted in this stack:

#137 👈
main

This comment was automatically generated by st.

Codecov Report
Attention: Patch coverage is 0% with 35 lines in your changes missing coverage. Please review.

Project coverage is 23.1%. Comparing base (c01acf6) to head (c08d140).

:white_check_mark: All tests successful. No failed tests found.

Files with missing lines
Patch %
Lines

crates/providers-local/src/chain_provider.rs
0.0%
32 Missing :warning:

crates/engine/src/validator.rs
0.0%
2 Missing :warning:

crates/driver/src/context/types.rs
0.0%
1 Missing :warning:

Additional details and impacted files

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Never mind. All is well

[Enter feedback here]

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: edb1fa6c-8433-882f-8b97-4d381f885b1d
Version Independent ID: aad3ec71-363f-3500-8bcd-dc040f71821e
Content: Quickstart to learn how to use Azure SignalR Service
Content Source: articles/azure-signalr/signalr-quickstart-dotnet-core.md
Service: signalr
GitHub Login: @vicancy
Microsoft Alias: lianwei

Never mind. It's 6.0.
Apologies - My Bad!

@robvet
It looks like your issue is resolved since you closed this thread.
If there are further questions regarding this matter, please tag me in a comment. I will reopen it and we will gladly continue the discussion.


REST service returns Content-Type: text/html

This prevents some REST client tools from parsing the response intelligently.
I will submit a PR containing the (trivial) fix.

PR #5
@JoshuaAGoldman any chance of a quick merge?

Will do it as soon as I can check it on my laptop
Sent from my iPhone
On Sep 2, 2019, at 8:34 AM, John Murray <notifications<EMAIL_ADDRESS>wrote:
PR #5https://github.com/intersystems/FirstLook-REST/pull/5
@JoshuaAGoldmanhttps://github.com/JoshuaAGoldman any chance of a quick merge?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/intersystems/FirstLook-REST/issues/4?email_source=notifications&email_token=AHZL5C3UL3USLRMLMBO5RDTQHUB4VA5CNFSM4IS46YA2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD5VWIDI#issuecomment-527131661, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AHZL5C6LZ53LNNYQHRJIX33QHUB4VANCNFSM4IS46YAQ.

Done.
Thanks for the fix.
From: John Murray<EMAIL_ADDRESS>Sent: Monday, September 2, 2019 8:34 AM
To: intersystems/FirstLook-REST<EMAIL_ADDRESS>Cc: Joshua Goldman<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [intersystems/FirstLook-REST] REST service returns Content-Type: text/html (#4)
PR #5https://github.com/intersystems/FirstLook-REST/pull/5
@JoshuaAGoldmanhttps://github.com/JoshuaAGoldman any chance of a quick merge?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/intersystems/FirstLook-REST/issues/4?email_source=notifications&email_token=AHZL5C3UL3USLRMLMBO5RDTQHUB4VA5CNFSM4IS46YA2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD5VWIDI#issuecomment-527131661, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AHZL5C6LZ53LNNYQHRJIX33QHUB4VANCNFSM4IS46YAQ.


Handle 409 error from IO Events - when multiple journals with name "Asset Compute Journal"

Description
Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context.
This fix handles the 409 Conflict error from IO events when we try to create a journal that has the same name as an existing journal.
Will fetch the existing journal and return it.
Fixes # (issue)
Types of changes

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[x] I have signed the Adobe Open Source CLA.
[x] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[x] I have read the CONTRIBUTING document.
[x] I have added tests to cover my changes.
[x] All new and existing tests passed.

I think ITs would continue failing for this PR due to the issue that it's supposed to fix

I think ITs would continue failing for this PR due to the issue that it's supposed to fix

will be fixed as part of https://jira.corp.adobe.com/browse/ASSETS-30645


Not working with third party libraries like django_tables2?

I have a component with a django_tables2 table in it:
components/table.html
{% load django_tables2 %}
{% render_table table %}

But this is not working as i'm having the error:
raise ImproperlyConfigured(context_processor_error_msg % "querystring")
django.core.exceptions.ImproperlyConfigured: Tag {% querystring %} requires django.template.context_processors.request to be in the template configuration in settings.TEMPLATES[]OPTIONS.context_processors) in order for the included template tags to function correctly

It seems that some context processors are not passed, or not yet passed?
Any idea how to fix this?

How are you calling/using this component?

products.html
{% extends "base.html" %}

{% load slippers %}

{% #table_components %}
{% /table_components %}

components/table.html
{% load django_tables2 %}
{% render_table table %}

views.py
class InventoryListView(
    LoginRequiredMixin,
    SingleTableMixin,
):
    paginate_by = 25
    template_name = "products.html"
    model = Product
    table_class = ProductsTable

This gives this error -> Expected table or queryset, not str

Also tried this:
products.html
{% extends "base.html" %}

{% load slippers %}

{% #table_components with table=table %}
{% /table_components %}

components/table.html
{% load django_tables2 %}
{% render_table table %}

views.py
class InventoryListView(
    LoginRequiredMixin,
    SingleTableMixin,
):
    paginate_by = 25
    template_name = "products.html"
    model = Product
    table_class = ProductsTable

This gives this error -> raise ImproperlyConfigured(context_processor_error_msg % "querystring")
django.core.exceptions.ImproperlyConfigured: Tag {% querystring %} requires django.template.context_processors.request to be in the template configuration in settings.TEMPLATES[]OPTIONS.context_processors) in order for the included template tags to function correctly

Like this it works, but we use the children, which is not ideal:
products.html
{% extends "base.html" %}
{% load django_tables2 %}

{% load slippers %}

{% #table_components %}
{% render_table table %}
{% /table_components %}

components/table.html
{{ children }}

views.py
class InventoryListView(
    LoginRequiredMixin,
    SingleTableMixin,
):
    paginate_by = 25
    template_name = "products.html"
    model = Product
    table_class = ProductsTable

It might be that the table template requires the request. Try passing it in:
{% #table_components table=table request=request %}
{% /table_components %}

// or use short format

{% table_components table=table request=request %}

I see, I don't agree with the readability part, I think it makes the code more fragile and redundant and less django-like.
I can understand the rationale for the side-effects, but what side-effects are you thinking about? I probably don't know the codebase enough to see what could go wrong. Maybe it can be foreseen in the future to add current context to child components?

I decided not to pass the context by default because I didn't want components to rely on external state. Just like how you wouldn't rely on global variables when you write your methods/functions in Python.
However, I think exemptions could be made for variables that devs expect to be present, like request. I'll open an issue for this.


Chapter 5 Adding 'use client' to navlinks.tsx causes webpack loader issue

As soon as I use 'use client' in chapter 5 I'm running into a problem. Here's my code:
'use client'
import {
  UserGroupIcon,
  HomeIcon,
  DocumentDuplicateIcon,
} from '@heroicons/react/24/outline';

import Link from 'next/link';
import { usePathname } from 'next/navigation';
import clsx from 'clsx';

// Map of links to display in the side navigation.
// Depending on the size of the application, this would be stored in a database.
const links = [
  { name: 'Home', href: '/dashboard', icon: HomeIcon },
  {
    name: 'Invoices',
    href: '/dashboard/invoices',
    icon: DocumentDuplicateIcon,
  },
  { name: 'Customers', href: '/dashboard/customers', icon: UserGroupIcon },
];

export default function NavLinks() {
  const pathname = usePathname()
  return (
    <>
      {links.map((link) => {
        const LinkIcon = link.icon;
        return (
          <Link
            key={link.name}
            href={link.href}
            className={clsx(
              'flex h-[48px] grow items-center justify-center gap-2 rounded-md bg-gray-50 p-3 text-sm font-medium hover:bg-sky-100 hover:text-blue-600 md:flex-none md:justify-start md:p-2 md:px-3',
              {
                'bg-sky-100 text-blue-600': pathname === link.href,
              },
            )}          >
            <LinkIcon className="w-6" />

{link.name}

          </Link>
        );
      })}
    </>
  );
}

And here's the error:

Any advice?

I'm getting the same issue

Try removing yarn.lock and running yarn again.

if anyone having issue after adding the 'use client', you can try restarting the server and see if that helps

if anyone having issue after adding the 'use client' in this chapter, you can try restarting the server and see if that helps

this worked for me thank you! (1. "crtl + c" to stop server 2, "pnpm dev" to restart)


merge package template from Kronos-Tools/npm-package-template

package.json

chore(scripts): update cover@nyc --temp-directory build/nyc npm test from template
chore(devDependencies): update<EMAIL_ADDRESS>from template

Coverage remained the same at 91.667% when pulling d9c4aa9f8e08428ec3120366974c0dbf6863bbfb on template-sync-1 into 86289632e2bbee64237d47036db7fc850f7f5fb2 on master.


[FEATURE] DlTypography - Markdown Support

Is your feature request related to a problem? Please describe.
For the prompt studio, we have the need to display rich text
Describe the solution you'd like
We need to add md support to the basic typography component
Describe alternatives you've considered
I've considered custom styling, but going with a universal standard is much better

Created new component callled DlMarkdown


Fixed potential security vulnerability

Pull Request Test Coverage Report for Build 70

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.2%) to 90.242%

Totals

Change from base Build 44:
-0.2%

Covered Lines:
2034

Relevant Lines:
2235

💛  - Coveralls


Editor crashes if trying to highlight part of a really long line of text.

Godot version
4.1
System information
Windows 10
Issue description
I have this config file and thought I'd try and edit it. The editor opens the .cfg file with no issue but highlighting the text crashes the editor.
Also adding and deleting text is very delayed.
This is probably a performance issue, I'm not sure if the editor would unfreeze if I waited a while.
Note:
The text highlights fine but crashes when I let go of the mouse.
Steps to reproduce
Try highlighting some of the text from this file, I dare you!
AStar Data.zip
Minimal reproduction project
N/A

I tested it with Godot v4.2.dev (0511f9d9a) - Windows 10.0.22621 - Vulkan (Forward+) - dedicated NVIDIA GeForce RTX 3060 Ti (NVIDIA; <IP_ADDRESS>99) - 12th Gen Intel(R) Core(TM) i7-12700F (20 Threads)
Same here, adding and deleting text is very delayed and double click (hightlighting) will crash the editor. I can help to check what's going wrong first.


Support Identifier shorthand entries in dict AST nodes; preserve on formatting

Fixes #2132.
Note: this breaks again #1336, which was partially fixed by accident with my compiler changes in 0.8.0 release.
I've added a (skipped) test for it and will fix it properly later.

To test, try formatting this: https://squiggle-website-git-prettier-dic-0217a3-quantified-uncertainty.vercel.app/playground#code=eNqrVkpJTUsszSlxzk9JVbJSSsvPV7BVMI3JS0osAjLMQIwqIMM8Ji8FSFUrABXoKAAlrUAEiFWlUBuTp1QLAF7SFwg%3D


Dev server: Initial call to backend to get cookies

Clear and concise description of the problem
I'm missing cookies (for example JSESSIONID, X-XRSF-TOKEN) when I use the dev server (localhost:3000). This makes the first POST request fail since there is no xsrf-token. Having no session can also cause problems in application logic.
Suggested solution
Vite should, at the beginning of accessing the website, make a call to the backend server and proxy the cookies to the browser.
The backend server URL is specified by server.proxy.init.
Optional: Values in mappings can now be replaced with ^ to use the value of server.proxy.init.
vite.conf.js
{
	server: {
		proxy: {
			init: "http://localhost:8081",
			mappings: {
				"/api": "^"
			}
		}
	}
}

Alternative
Currently I am using this workaround:
I created a dummy GET endpoint that doesn't return anything, just to call it and get the cookies.
export default {
	name: "App",

	components: {
		//...
	},
	setup() {
		//...

		if (window.location.href === 'http://localhost:3000/') {
			axios.get("/api/xsrf")
		}

		return {
			//...
		}
	}
}

Additional context
No response
Validations

[x] Follow our Code of Conduct
[X] Read the Contributing Guidelines.
[X] Read the docs.
[X] Check that there isn't already an issue that request the same feature to avoid creating a duplicate.

I think that workaround is the way to go. I guess you can also do it by adding a middleware that sends a request to the backend and sets Set-Cookie header. If you want the HTML to be served by servers other than Vite, we recommend using the backend integration feature.
https://vitejs.dev/guide/backend-integration.html


NPM Install googleapis: Missing child_process

npm install googleapis --save does not install all dependencies.
I get the following when installing:
Silver-Sliver:people-is dchaddportwine$ npm install googleapis --save

><EMAIL_ADDRESS>install /Users/dchaddportwine/Sites/people-is/node_modules/unix-dgram
> node-gyp rebuild

xcode-select: error: tool 'xcodebuild' requires Xcode, but active developer directory '/Library/Developer/CommandLineTools' is a command line tools instance

xcode-select: error: tool 'xcodebuild' requires Xcode, but active developer directory '/Library/Developer/CommandLineTools' is a command line tools instance

  CXX(target) Release/obj.target/unix_dgram/src/unix_dgram.o
In file included from ../src/unix_dgram.cc:5:
In file included from ../node_modules/nan/nan.h:182:
../node_modules/nan/nan_maybe_43_inl.h:221:17: warning: 'CloneElementAt' is deprecated [-Wdeprecated-declarations]
  return array->CloneElementAt(GetCurrentContext(), index);
                ^
/Users/dchaddportwine/.node-gyp/6.10.2/include/node/v8.h:3031:3: note: 'CloneElementAt' has been explicitly marked deprecated here
  V8_DEPRECATED("Cloning is not supported.",
  ^
/Users/dchaddportwine/.node-gyp/6.10.2/include/node/v8config.h:336:29: note: expanded from macro 'V8_DEPRECATED'
  declarator __attribute__((deprecated))
                            ^
In file included from ../src/unix_dgram.cc:5:
In file included from ../node_modules/nan/nan.h:188:
In file included from ../node_modules/nan/nan_new.h:189:
../node_modules/nan/nan_implementation_12_inl.h:40:29: warning: 'New' is deprecated [-Wdeprecated-declarations]
  return v8::BooleanObject::New(value).As<v8::BooleanObject>();
                            ^
/Users/dchaddportwine/.node-gyp/6.10.2/include/node/v8.h:4008:3: note: 'New' has been explicitly marked deprecated here
  V8_DEPRECATED("Pass an isolate", static Local<Value> New(bool value));
  ^
/Users/dchaddportwine/.node-gyp/6.10.2/include/node/v8config.h:336:29: note: expanded from macro 'V8_DEPRECATED'
  declarator __attribute__((deprecated))
                            ^
In file included from ../src/unix_dgram.cc:5:
../node_modules/nan/nan.h:590:20: error: no type named 'GCEpilogueCallback' in 'v8::Isolate'
      v8::Isolate::GCEpilogueCallback callback
      ~~~~~~~~~~~~~^
../node_modules/nan/nan.h:596:20: error: no type named 'GCEpilogueCallback' in 'v8::Isolate'
      v8::Isolate::GCEpilogueCallback callback) {
      ~~~~~~~~~~~~~^
../node_modules/nan/nan.h:601:20: error: no type named 'GCPrologueCallback' in 'v8::Isolate'
      v8::Isolate::GCPrologueCallback callback
      ~~~~~~~~~~~~~^
../node_modules/nan/nan.h:607:20: error: no type named 'GCPrologueCallback' in 'v8::Isolate'
      v8::Isolate::GCPrologueCallback callback) {
      ~~~~~~~~~~~~~^
../node_modules/nan/nan.h:1927:15: warning: 'SetAccessor' is deprecated [-Wdeprecated-declarations]
  return obj->SetAccessor(
              ^
/Users/dchaddportwine/.node-gyp/6.10.2/include/node/v8.h:2750:3: note: 'SetAccessor' has been explicitly marked deprecated here
  V8_DEPRECATED("Use maybe version",
  ^
/Users/dchaddportwine/.node-gyp/6.10.2/include/node/v8config.h:336:29: note: expanded from macro 'V8_DEPRECATED'
  declarator __attribute__((deprecated))
                            ^
3 warnings and 4 errors generated.
make: *** [Release/obj.target/unix_dgram/src/unix_dgram.o] Error 1
gyp ERR! build error
gyp ERR! stack Error: `make` failed with exit code: 2
gyp ERR! stack     at ChildProcess.onExit (/usr/local/lib/node_modules/npm/node_modules/node-gyp/lib/build.js:276:23)
gyp ERR! stack     at emitTwo (events.js:106:13)
gyp ERR! stack     at ChildProcess.emit (events.js:191:7)
gyp ERR! stack     at Process.ChildProcess._handle.onexit (internal/child_process.js:215:12)
gyp ERR! System Darwin 16.7.0
gyp ERR! command "/usr/local/bin/node" "/usr/local/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild"
gyp ERR! cwd /Users/dchaddportwine/Sites/people-is/node_modules/unix-dgram
gyp ERR! node -v v6.10.2
gyp ERR! node-gyp -v v3.5.0
gyp ERR! not ok
<EMAIL_ADDRESS>/Users/dchaddportwine/Sites/people-is
└──<EMAIL_ADDRESS>
npm WARN optional SKIPPING OPTIONAL DEPENDENCY<EMAIL_ADDRESS>(node_modules/unix-dgram):
npm WARN optional SKIPPING OPTIONAL DEPENDENCY<EMAIL_ADDRESS>install: `node-gyp rebuild`
npm WARN optional SKIPPING OPTIONAL DEPENDENCY: Exit status 1

I get the following when running npm run dev with this code, var googleapis = require('googleapis'); , included:
Silver-Sliver:people-is dchaddportwine$ npm run dev

><EMAIL_ADDRESS>dev /Users/dchaddportwine/Sites/people-is
> node build/dev-server.js

> Starting dev server...

 ERROR  Failed to compile with 8 errors                                                                                4:30:26 PM

These dependencies were not found:

* fs in ./~/googleapis/lib/googleapis.js, ./~/googleapis/lib/discovery.js and 5 others
* child_process in ./~/google-auth-library/lib/auth/googleauth.js

To install them, you can run: npm install --save fs child_process
> Listening at http://localhost:8080

Seems like a bug. npm install then npm dev run shouldn't require extra installation steps, right?

This became an issue after I updated macOS Sierra 10.12.6, which updated Command Line Tools  for Xcode - Version 9.0.

@ChaddPortwine What is your node and npm versions?

@bantini here is what I see:
Silver-Sliver:people-is dchaddportwine$ npm --version
4.2.0
Silver-Sliver:people-is dchaddportwine$ node --version
v6.10.2

@ChaddPortwine I have exactly the same configuration (after installing your version of node and npm using nvm), and I was able to install googleapis in one step. I suspect this might be a one-off issue on how command-line-tools is set-up. However, I will keep this issue open for sometime in case someone else faces it.

I tried working with brew. Spoiler, this didn't help. Going to try fixing .node-gyp next.
Homebrew
I ran brew update which updated the node formula.
I ran brew doctor and got this message:
Leaving kegs unlinked can lead to build-trouble and cause brews that depend on
those kegs to fail to run properly once built. Run `brew link` on these:
  node

I ran brew link node and got:
Error: Could not symlink bin/node
Target /usr/local/bin/node
already exists. You may want to remove it:
  rm '/usr/local/bin/node'

To force the link and overwrite all conflicting files:
  brew link --overwrite node

I removed /usr/local/bin/node and tried brew link node again and got:
Linking /usr/local/Cellar/node/7.9.0...
Error: Could not symlink include/node/android-ifaddrs.h
Target /usr/local/include/node/android-ifaddrs.h
already exists. You may want to remove it:
  rm '/usr/local/include/node/android-ifaddrs.h'

To force the link and overwrite all conflicting files:
  brew link --overwrite node

To list all files that would be deleted:
  brew link --overwrite --dry-run node

I ran brew link --overwrite --dry-run node and a lot of files where listed.
I ran brew link --overwrite node and got:
Linking /usr/local/Cellar/node/7.9.0... 144 symlinks created

I ran brew doctor again and got:
Warning: Some installed formula are missing dependencies.
You should `brew install` the missing dependencies:
  brew install<EMAIL_ADDRESS>
I ran brew install<EMAIL_ADDRESS>Now, brew is happy, but the node-gyp error persists when I try npm install googleapis --save
Moving on to try fixing node-gyp....

I'm assuming something is broken in my environment. I used brew to uninstall/install node, deleted
the node_modules folder in the project, and ran npm install for a fresh set. But no change.
I submitted a bug to node-gyp. The response was:

The xcodebuild lines in the log lines are red herrings, you can ignore them. It says 'error' but they're really just informational from node-gyp's perspective.

The issue is that you're trying to install an old version of unix-dgram, v0.2.2. Update to the latest - v2.0.1 - and all should be well.

I uninstalled and then ran npm install unix-dgram but<EMAIL_ADDRESS>install in the first line looks wrong.
The unix-dgram devs, after seeing my output below suggested,

It's because the package you're trying to install, ain2, depends on an old version of unix-dgram. You'll have to take that up with them.

<EMAIL_ADDRESS>install /Users/dchaddportwine/Sites/people-is/node_modules/ain2/node_modules/unix-dgram
> node-gyp rebuild

xcode-select: error: tool 'xcodebuild' requires Xcode, but active developer directory '/Library/Developer/CommandLineTools' is a command line tools instance

xcode-select: error: tool 'xcodebuild' requires Xcode, but active developer directory '/Library/Developer/CommandLineTools' is a command line tools instance

  CXX(target) Release/obj.target/unix_dgram/src/unix_dgram.o
In file included from ../src/unix_dgram.cc:5:
In file included from ../../nan/nan.h:182:
../../nan/nan_maybe_43_inl.h:221:17: warning: 'CloneElementAt' is deprecated [-Wdeprecated-declarations]
  return array->CloneElementAt(GetCurrentContext(), index);
                ^
/Users/dchaddportwine/.node-gyp/7.9.0/include/node/v8.h:3346:3: note: 'CloneElementAt' has been explicitly marked deprecated here
  V8_DEPRECATED("Cloning is not supported.",
  ^
/Users/dchaddportwine/.node-gyp/7.9.0/include/node/v8config.h:332:29: note: expanded from macro 'V8_DEPRECATED'
  declarator __attribute__((deprecated))
                            ^
In file included from ../src/unix_dgram.cc:5:
In file included from ../../nan/nan.h:188:
In file included from ../../nan/nan_new.h:189:
../../nan/nan_implementation_12_inl.h:40:29: warning: 'New' is deprecated [-Wdeprecated-declarations]
  return v8::BooleanObject::New(value).As<v8::BooleanObject>();
                            ^
/Users/dchaddportwine/.node-gyp/7.9.0/include/node/v8.h:4490:3: note: 'New' has been explicitly marked deprecated here
  V8_DEPRECATED("Pass an isolate", static Local<Value> New(bool value));
  ^
/Users/dchaddportwine/.node-gyp/7.9.0/include/node/v8config.h:332:29: note: expanded from macro 'V8_DEPRECATED'
  declarator __attribute__((deprecated))
                            ^
In file included from ../src/unix_dgram.cc:5:
../../nan/nan.h:590:20: error: no type named 'GCEpilogueCallback' in 'v8::Isolate'
      v8::Isolate::GCEpilogueCallback callback
      ~~~~~~~~~~~~~^
../../nan/nan.h:596:20: error: no type named 'GCEpilogueCallback' in 'v8::Isolate'
      v8::Isolate::GCEpilogueCallback callback) {
      ~~~~~~~~~~~~~^
../../nan/nan.h:601:20: error: no type named 'GCPrologueCallback' in 'v8::Isolate'
      v8::Isolate::GCPrologueCallback callback
      ~~~~~~~~~~~~~^
../../nan/nan.h:607:20: error: no type named 'GCPrologueCallback' in 'v8::Isolate'
      v8::Isolate::GCPrologueCallback callback) {
      ~~~~~~~~~~~~~^
../../nan/nan.h:1927:15: warning: 'SetAccessor' is deprecated [-Wdeprecated-declarations]
  return obj->SetAccessor(
              ^
/Users/dchaddportwine/.node-gyp/7.9.0/include/node/v8.h:3026:3: note: 'SetAccessor' has been explicitly marked deprecated here
  V8_DEPRECATED("Use maybe version",
  ^
/Users/dchaddportwine/.node-gyp/7.9.0/include/node/v8config.h:332:29: note: expanded from macro 'V8_DEPRECATED'
  declarator __attribute__((deprecated))
                            ^
3 warnings and 4 errors generated.
make: *** [Release/obj.target/unix_dgram/src/unix_dgram.o] Error 1
gyp ERR! build error
gyp ERR! stack Error: `make` failed with exit code: 2
gyp ERR! stack     at ChildProcess.onExit (/usr/local/lib/node_modules/npm/node_modules/node-gyp/lib/build.js:276:23)
gyp ERR! stack     at emitTwo (events.js:106:13)
gyp ERR! stack     at ChildProcess.emit (events.js:194:7)
gyp ERR! stack     at Process.ChildProcess._handle.onexit (internal/child_process.js:215:12)
gyp ERR! System Darwin 16.7.0
gyp ERR! command "/usr/local/Cellar/node/7.9.0/bin/node" "/usr/local/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild"
gyp ERR! cwd /Users/dchaddportwine/Sites/people-is/node_modules/ain2/node_modules/unix-dgram
gyp ERR! node -v v7.9.0
gyp ERR! node-gyp -v v3.5.0
gyp ERR! not ok

><EMAIL_ADDRESS>install /Users/dchaddportwine/Sites/people-is/node_modules/unix-dgram
> node-gyp rebuild

xcode-select: error: tool 'xcodebuild' requires Xcode, but active developer directory '/Library/Developer/CommandLineTools' is a command line tools instance

xcode-select: error: tool 'xcodebuild' requires Xcode, but active developer directory '/Library/Developer/CommandLineTools' is a command line tools instance

  CXX(target) Release/obj.target/unix_dgram/src/unix_dgram.o
  SOLINK_MODULE(target) Release/unix_dgram.node
<EMAIL_ADDRESS>/Users/dchaddportwine/Sites/people-is
└─┬<EMAIL_ADDRESS>  ├──<EMAIL_ADDRESS>  └──<EMAIL_ADDRESS>
npm WARN optional SKIPPING OPTIONAL DEPENDENCY<EMAIL_ADDRESS>(node_modules/ain2/node_modules/unix-dgram):
npm WARN optional SKIPPING OPTIONAL DEPENDENCY<EMAIL_ADDRESS>install: `node-gyp rebuild`
npm WARN optional SKIPPING OPTIONAL DEPENDENCY: Exit status 1

Doesn't it look like node-gyp is still the issue?

@ChaddPortwine Do you have Xcode installed? Because if you don't, that might be the only difference between your settings and mine.

@bantini, no I do not have XCode installed. I only have the xcode command line tools.
Reinstalled Node/NPM
Something in my project setup must be very broken, and I'm probably on my own. I followed these instructions for a "clean install" of node and npm.
I was able to install googleapis
Into a new folder: npm init, npm install npm install googleapis --save
Silver-Sliver:test-googleapis dchaddportwine$ npm install googleapis --save
+<EMAIL_ADDRESS>added 54 packages in 12.334s

Thank you for looking at this, @bantini.

Again, this is probably my issue, but...
npm install googleapis --save worked with no errors.
However, npm run dev suffers from child_process issues.
Silver-Sliver:test-googleapis dchaddportwine$ npm run dev

><EMAIL_ADDRESS>dev /Users/dchaddportwine/Startup/test-googleapis
> node build/dev-server.js

> Starting dev server...

 DONE  Compiled successfully in 3751ms                                                         9:28:53 AM

> Listening at http://localhost:8080

 WAIT  Compiling...                                                                            9:30:47 AM

 ERROR  Failed to compile with 13 errors                                                       9:30:54 AM

These dependencies were not found:

* child_process in ./node_modules/google-auth-library/lib/auth/googleauth.js
* fs in ./node_modules/google-auth-library/lib/auth/googleauth.js, ./node_modules/google-p12-pem/index.js
 and 5 others
* net in ./node_modules/forever-agent/index.js, ./node_modules/tough-cookie/lib/cookie.js and 1 other
* tls in ./node_modules/forever-agent/index.js, ./node_modules/tunnel-agent/index.js

To install them, you can run: npm install --save child_process fs net tls

 WAIT  Compiling...                                                                            9:52:12 AM

 ERROR  Failed to compile with 13 errors                                                       9:52:13 AM

These dependencies were not found:

* child_process in ./node_modules/google-auth-library/lib/auth/googleauth.js
* fs in ./node_modules/google-auth-library/lib/auth/googleauth.js, ./node_modules/google-p12-pem/index.js
 and 5 others
* net in ./node_modules/forever-agent/index.js, ./node_modules/tough-cookie/lib/cookie.js and 1 other
* tls in ./node_modules/forever-agent/index.js, ./node_modules/tunnel-agent/index.js

To install them, you can run: npm install --save child_process fs net tls

Pull and build my test project from git:
https://github.com/ChaddPortwine/test-googleapis
This is a very simple Vue project to demonstrate my googleapis issues.

Any updates on this? I got the same issue, also working with Vue but that does not have anything to do with the problem I think. Installing googleapis does work fine but running npm run dev also returns me a pretty similar output to yours @ChaddPortwine
ERROR  Failed to compile with 8 errors                                                                                15:33:28

These dependencies were not found:

* fs in ./~/googleapis/lib/googleapis.js, ./~/googleapis/lib/discovery.js and 5 others
* child_process in ./~/google-auth-library/lib/auth/googleauth.js

To install them, you can run: npm install --save fs child_process
> Listening at http://localhost:8080


Calendar first day of week changed to Saturday without provocation

NOTE : I've discoverd the reason but leaving the ticket as is - see both edits at the bottom - I do think its a bug in the Calendar code.
My Calendar is loaded with an "en-GB" locale. Globalize is used as the localizer. Everything was working fine until today I noticed the calendar has switched from starting the week on Monday as it should for this locale, to starting it on Saturday (as no locale I can think of does).
I've been trying to figure out what has changed (it was fine yesterday). I've tried upgrading Globalize/CLDR to the latest versions, as well as ensuring the "en-GB" culture is provided and changing my localization of the calendar from
BigCalendar.globalizeLocalizer(locale)

to
localizer(Globalize)

(as I see now in the examples), but nothing seems to revert it back to start the week on Monday.

What could cause this all of the sudden?
Edit: I've confirmed via a screenshot I sent last night that it was indeed fine and started the week on monday. Today when I opened my laptop and reloaded the page it flipped to Saturday.
Edit 2:
At first I thought it was too far fetched to mention, but I've just tried to move my clock a day forward and it fixed it! There is something either on "Sunday" or today's date that causes the calendar to start on Saturday. I cannot replicate this on the Demo site.
Thanks!

And at the stroke of midnight, the calendar "righted" itself and reverted back to Monday as first day of the week.

that is a very weird issue... honestly I have idea what might have caused it.

This was tested on multiple computers/OSes by the way and by myself in the UK and my partner in the West Coast (PST). Both of us saw the calendar in the same way during yesterday. I've never seen anything like it

I can confirm that every Sunday, the calendar flips to having Saturday as the starting day of the week in my calendar. This is a calendar initialised to the en-UK locale, using Globalize. Its fine all week, except on Sundays where it goes crazy.

This could very well be a problem in Globalize.
When userlocale is a Globalize object loaded with 'en-UK' locale:
// On any non sunday day:
userlocale.formatDate(new Date(), {raw:'e'});
> "2"

// On a sunday :
userlocale.formatDate(new Date(), {raw:'e'});
> "7"

Opened a ticket with Globalize as well: https://github.com/jquery/globalize/issues/608

@jquense I've found the problem is coming out of the firstOfWeek function here: https://github.com/intljusticemission/react-big-calendar/blob/master/src/localizers/globalize.js#L40.
For the en-GB (didn't check other locales) it returns the correct value of 1 unless 'today' is sunday where it returns '6'.
// on any day of the week except sunday:
firstOfWeek('en-GB');
> 1

However
// on any given Sunday
firstOfWeek('en-GB');
> 6

Something in the calculations done there based on the current date is breaking up...

@jquense , why not use something like
> locale.cldr.supplemental.weekData.firstDay()
> "mon"

to get the first day of the week for the given locale?

mostly because I couldn't figure out how to do that :P PR?

I'll be happy to. Coming right up!

@jquense I hope you can help with one detail, as I've never done it this way before:
I've done my fix on a fork. I'm not trying to install the package into my project from github. It all seems ok, but when the npm install finishes, my node_moduels/react-big-calendar directory contains just the README/LICENSE files, package.json and node_moduels of its own with just react-overlays package in it.  Am I missing something? Is there another step because i'm installing from github?

@jquense turns out the whole project cannot be installed via github because of an issue in packages.json file. I update that as well in the PR, which also resolves the issue of first week day.


Fix image inferrer provision issues

Resolves https://github.com/wellcomecollection/platform/issues/5292

Note: I incorporated and applied this as part of https://github.com/wellcomecollection/catalogue-pipeline/pull/1863, and it seems to work.
I did have to tweak one bit: there's a name that has to be ≤64 chars long which I ended up trimming.

@alexwlchan shall I close this PR then? it can be merged in yours


Is there any way to create a private task (run it without publishing it so other people can see it)?

I want to create a private task to do things that are specific to my business, so I don't want to have to publish it for other people to see. Is there any way to do this?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 44581f4a-93df-7507-3844-eadedf9a6cc4
Version Independent ID: 33c7bcf0-1512-975f-5ef8-9f2a192a84ad
Content: Add a Build or Release Task
Content Source: docs/extend/develop/add-build-task.md
Product: devops
Technology: devops-ecosystem
GitHub Login: @elbatk
Microsoft Alias: elbatk

Thanks for your question. It looks like you're working through an issue with your scenario or implementation, rather than an issue with the documentation. Here are a few options where you might consider asking your question:

Azure DevOps on Stack Overflow
Azure DevOps Support Bot


SCMOD-7800: Initial commit

JIRA: https://portal.digitalsafe.net/browse/SCMOD-7800

@michael-bryson Please submit another PR for the SCMOD-7800 branch.  Unfortunately this one was automatically closed when I updated master to include the history and I can't get it re-opened again.


Feature Request : Whiteboard in Group similar to splitwise

Needed Whiteboard to display important information, like address or emergency contact info.   whiteboard will visible to anyone who join group

Hi, when you mean whiteboard here do you mean something like a notes section or an actual whiteboard where you can scribble freely?

Yes , something like notes where user can mention some important details

could this be something like group description?


SI5351 with 25 MHz Xtal

Hi Alex,
Because I have use SI5351 https://learn.adafruit.com/adafruit-si5351-clock-generator-breakout/overview with 25 MHz Xtal  I found in your source definition of XTAL in  si5351-beacon/src/utils/jt_band_params.cpp #define XTAL_FREQUENCY_IN_KHZ (27000)
after correct this value to 25000. But found other file  si5351-beacon/src/si5351/radio/register_map.h and I am not sure that I need have other values for 25 Mhz Xtal SI5351 ???

Hello,
None of them defines output frequency. Only XTAL (Hz) parameter from online configurator defines it actually. link to online configurator.
Parameter in jt_band_params.cpp (XTAL_FREQUENCY_IN_KHZ ) - is using in band reconstruction algorithm. It selects proper LPF from given parameters. It is not very critical.
register_map.h - autogenerated file from Silabs software. It is possible to configure all three outputs of si5351 to produce some frequencies from the beginning . It is not critical at all. I've never tried that.


Feature create preference

Board:

Ticket #NUMBER_OF_THE_TICKET

Description:

Preference requirements

Notes:

Tasks:

[x] Add each element in this format

Risk:

Preview:

Awesome! 🚀


Please make a new release which user language server v5.3.2

With the latest release v2.2.1 of the extension which uses php language server v5.3.1 the server keeps crashing. It seems the issue has been fixed in v5.3.2 of the language server so could you please make a new release for the extension.
Thank you and Merry Christmas.

Merry Christmas to you too!


Are we using Generics only because we can use string,Int or Bool in Array?

i mean can some one please elaborate it in some more details
logic is okay but how come this is the best way of linear search
T stand for generic item in Argument (may i know what does it mean when we use it by function name)
Thanks

"Are we using generics only because we can use string, Int, or Bool in Array?"

Yes

The biggest reason you'd want to use generics is to promote code reusability. In the case of Linear Search, using or not using generics doesn't really affect performance for the most part.


Python chokes on simulated memories of depth greater than ~3k

With Python 3.7.3 (shipped with Debian stable) and 3.8.2 (via pyenv), I encountered the following error when simulating a design with a couple of memory banks:
  File "/path/to/nmigen/back/pysim.py", line 765, in __call__
    exec(emitter.flush(), exec_locals)
RecursionError: maximum recursion depth exceeded during compilation

Here's a minimal reproduction:
import unittest

from nmigen import *
from nmigen.back.pysim import *

class MemTest(unittest.TestCase):

    def test_mem(self):
        m = Module()
        mem = Memory(width=1, depth=0xC00)
        m.submodules.rport = mem.read_port()
        m.submodules.wport = mem.write_port()
        sim = Simulator(m)
        sim.run()

Reducing the depth of the memory (width doesn't seem to matter) makes the failure go away. For the time being that workaround works for me, but it would be nice to use the same design parameters for simulation and synthesis.

Yep, this is a known pysim issue that requires reworking the way memories are translated.

Interesting, I thought this would work on 3.7 (https://bugs.python.org/issue31113) but it doesn't.

Observed the same problem. Can workaround for now by calling sys.setrecursionlimit(x).

Just to add a few notes to this to help with people finding it from google:
On a Core i9 MBP (2019) this makes simulations of memory with a depth of 2**13 (just a lookup table) take about 1 minute if the recursion limit is set high enough. Python version is 3.9.5 (v3.9.5:0a7dcbdb13, May  3 2021, 13:05:53) \n[Clang 12.0.5 (clang-1<IP_ADDRESS>)].
You can expect to see an exception which looks something like this:
Traceback (most recent call last):
  File "/Users/jeremy/Seafile/misc_projects/amaranth_playing/sine_lookup.py", line 96, in <module>
    sim = Simulator(m)
  File "/Users/jeremy/Seafile/misc_projects/amaranth_playing/venv/lib/python3.9/site-packages/amaranth/sim/core.py", line 68, in __init__
    self._engine   = engine(self._fragment)
  File "/Users/jeremy/Seafile/misc_projects/amaranth_playing/venv/lib/python3.9/site-packages/amaranth/sim/pysim.py", line 282, in __init__
    self._processes = _FragmentCompiler(self._state)(self._fragment)
  File "/Users/jeremy/Seafile/misc_projects/amaranth_playing/venv/lib/python3.9/site-packages/amaranth/sim/_pyrtl.py", line 463, in __call__
    processes.update(self(subfragment))
  File "/Users/jeremy/Seafile/misc_projects/amaranth_playing/venv/lib/python3.9/site-packages/amaranth/sim/_pyrtl.py", line 463, in __call__
    processes.update(self(subfragment))
  File "/Users/jeremy/Seafile/misc_projects/amaranth_playing/venv/lib/python3.9/site-packages/amaranth/sim/_pyrtl.py", line 463, in __call__
    processes.update(self(subfragment))
  File "/Users/jeremy/Seafile/misc_projects/amaranth_playing/venv/lib/python3.9/site-packages/amaranth/sim/_pyrtl.py", line 455, in __call__
    exec(compile(code, filename, "exec"), exec_locals)
RecursionError: maximum recursion depth exceeded during compilation


Add to index.handlebars general page layout.

-Logo
-Nav bar
-Search bar
-Mini bar : )
-Anything else that the general page layout
needs.

Scrapped index.hbrs file, members page holds this information.  Logo - in.  Nav bar - replaced with modal in header.  Search bar implemented in hbrs, but not yet functional.  Song list with link to each pages unique song info working.  Closing this issues as resolved.

Scrapped index.hbrs file, members page holds this information.  Logo - in.  Nav bar - replaced with modal in header.  Search bar implemented in hbrs, but not yet functional.  Song list with link to each pages unique song info working.  Closing this issues as resolved.


Fix workflows

Previously no docker containers were published
@argerus - I had some time to play around a little, maybe you have already addressed some of the iterms here

Welcome to Codecov :tada:
Once you merge this PR into your default branch, you're all set! Codecov will compare coverage reports and display results in all future pull requests.
Thanks for integrating Codecov - We've got you covered :open_umbrella:


update() on query builder not mapping fields

I'm on the latest version of the ODM and am trying to perform a simple update using Builder::update() -- however, it doesn't seem to be mapping document property names to collection field names. The update only works if I pass in collection field names into the field method.

Did this work previously for you and is broken now or did you just now encounter it?

Just encountered it.

Also, regular reads using the query builder seem to working as expected -- i.e. they are performing the required mapping.

This should be fixed now.


Possible duplicates between validation and training data in NUS-WIDE splits

Dear authors, I was looking at the json file ids under the NUSWIDESeq directory and noticed some duplicates between the training and validation sets.
More specifically, by creating two sets that collect validation and training ids, and computing their intersection, I noticed 717 (~30.3%) images shared between the training and validation sets.
I checked some of the ids I found with my code directly in this repo, and the problem seems to be there too.
This is the code I used (in the outputs I printed ten duplicates):
import json
import os

def check_duplicates(data):
    val_data = [img for key, val in data.items() for img in val if 'val' in key]
    train_data = [img for key, val in data.items() for img in val if 'train' in key]

    stats = {
        "val": len(val_data),
        "val_set": len(set(val_data)),
        "train": len(train_data),
        "train_set": len(set(train_data)),
        "intersection": len(set(val_data).intersection(set(train_data))),
        "first_ten": list(set(val_data).intersection(set(train_data)))[:10],
    }

    return stats

def main():
    root = 'couple/continual_datasets/'

    # I collected all data inside two json files to be easier to handle.
    filenames = ['nus_wide_data.json', 'coco_data.json']

    for filename in filenames:
        with open(os.path.join(root, filename), 'r') as f:
            data = json.load(f)

        stats = check_duplicates(data)
        print(filename, stats)

if __name__ == "__main__":
    main()

Output
>>> nus_wide_data.json {'val': 2366, 'val_set': 2366, 'train': 48748, 'train_set': 48748, 'intersection': 717, 'first_ten': [0, 1, 40960, 3, 4, 40963, 65542, 43009, 73729, 32777]}
>>> coco_data.json {'val': 6366, 'val_set': 6366, 'train': 35072, 'train_set': 35072, 'intersection': 0, 'first_ten': []}

Are these jsons used to split the data between training and validation? In that case, shouldn't they contain different data?

Hi, Thomas
In response to your inquiry, they do contain different data! The train JSON corresponds to the line indices contained within the TrainImageList.txt file, which are derived from the original NUS-WIDE dataset. Likewise, the test JSON aligns with the line indices that are located within the TestImageList.txt file, also from the original NUS-WIDE dataset.
Kind regards,
Chris


I could not make the pycuda work

Tried the combinations of the images but they did not turn on
here is the dockerfile
https://github.com/rifaterdemsahin/workstation/blob/master/docker/gpudockerfile
Error
Error

       static const error_category &  errno_ecat     = generic_category();
                                      ^
  bpl-subset/bpl_subset/boost/system/error_code.hpp:216:36: warning: ‘pycudaboost::system::native_ecat’ defined but not used [-Wunused-variable]
       static const error_category &  native_ecat    = system_category();
                                      ^
  error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
  ----------------------------------------
  ERROR: Failed building wheel for pycuda
  Building wheel for pytools (setup.py) ... done
  Created wheel for pytools: filename=pytools-2021.2.9-py2.py3-none-any.whl size=62370 sha256=62d91fddfd0af6b3899cf0cbf13152b46c6900f08a22a950aa0ff583cf60c8c2
  Stored in directory: /root/.cache/pip/wheels/41/b9/6e/94bb014f6484b15ec77e7877f3a227609481ffd98db364504d
Successfully built pytools
Failed to build pycuda
ERROR: Could not build wheels for pycuda, which is required to install pyproject.toml-based projects
root@1c434b2dc8b6:/notebooks#
root@1c434b2dc8b6:/notebooks#

Also opened a support request here
<EMAIL_ADDRESS>

Thanks for leveraging Azure docs feedback channel to raise this question. Could you please share the Azure documentation for which this feedback is applicable to?
This channel is reserved for ‘Azure docs’ feedback- for sharing doc feedback and suggesting content improvements.

Here is the master document i am following up
https://docs.microsoft.com/en-us/azure/container-instances/container-instances-gpu

Hello @rifaterdemsahin
I had a quick check at the support ticket you had mentioned. From the backend logs, it appears like you've reached your Quota limit.
Reference : https://docs.microsoft.com/en-us/azure/container-instances/container-instances-quotas
As suggest by the engineer, you could increase your Quota limit. You'll have to provide further information that has been requested on the Support ticket.

Having said that, this channel is reserved for ‘Azure docs’ feedback- for sharing doc feedback and suggesting content improvements.I'll have this GitHub thread referenced internally as well.


Bot closing itself

Woke up this morning and checked the bot at 10am and found it has closed itself in the night.  I run many bots at the same time and I find this every morning, it closed 3 of the bots last night with the same error.
[Master HamsterKombat Bot][INFO] 2024-09-17 04:34:31 [Account 10]: 🌌 Starting account.
[Master HamsterKombat Bot][INFO] 2024-09-17 04:34:31 [Account 10]: 📡 Getting account IP.
[Master HamsterKombat Bot][INFO] 2024-09-17 04:34:32 [Account 10]: ├─ IP: xxx.xxx.xxx.xxx
[Master HamsterKombat Bot][INFO] 2024-09-17 04:34:32 [Account 10]: ├─ Company: xxx
[Master HamsterKombat Bot][INFO] 2024-09-17 04:34:32 [Account 10]: └─ Country: xxx
[Master HamsterKombat Bot][INFO] 2024-09-17 04:34:32 [Account 10]: 🛸 Getting basic account data.
[Master HamsterKombat Bot][INFO] 2024-09-17 04:34:34 [Account 10]: ├─ Account ID: xxxxxxxxx
[Master HamsterKombat Bot][INFO] 2024-09-17 04:34:34 [Account 10]: └─ Account Name: x
[Master HamsterKombat Bot][INFO] 2024-09-17 04:34:34 [Account 10]: 🛸 Getting account data.
[Master HamsterKombat Bot][INFO] 2024-09-17 04:34:35 [Account 10]: 💰 Account Balance Coins: 58.24m
[Master HamsterKombat Bot][INFO] 2024-09-17 04:34:35 [Account 10]: ├─ Available Taps: 4878 | Max Taps: 5000
[Master HamsterKombat Bot][INFO] 2024-09-17 04:34:35 [Account 10]: └─ Total Keys: 1218 | Balance Keys: 1218
[Master HamsterKombat Bot][INFO] 2024-09-17 04:34:35 [Account 10]: 📝 Getting account config data.
[Master HamsterKombat Bot][ERROR] 2024-09-17 04:35:06 [Account 10]: ✖ Error: HTTPSConnectionPool(host='api.hamsterkombatgame.io', port=443): Read timed out. (read timeout=30)

Before creating an issue for a bot, first check how the original application feels. it is currently dead

Before creating an issue for a bot, first check how the original application feels. it is currently dead

Not dead for everyone, I fear it may be a ban.

Even if it was a ban, you would get a correct response from the server, but since the connection time is out or you get an incorrect response, it's a problem with the application.

some new season update, just managed to enter the app once and there was a picture with some new season, didn't realize to take a screenshot.

This issue is happening for me every evening so its not related to the current downtime at least directly but the bot should be able to handle these loss of connection issues and just keep retrying until it connects again, it should never close itself under these circumstances.

this is new update which broke application again

This issue is happening for me every evening so its not related to the current downtime at least directly but the bot should be able to handle these loss of connection issues and just keep retrying until it connects again, it should never close itself under these circumstances.

this is already some of your problems, I have bots working 24/7 on both windows and linux and do not encounter the problems that you have

This issue is happening for me every evening so its not related to the current downtime at least directly but the bot should be able to handle these loss of connection issues and just keep retrying until it connects again, it should never close itself under these circumstances.

this is already some of your problems, I have bots working 24/7 on both windows and linux and do not encounter the problems that you have

Its probably not my connection to the internet as its only some of them closing, it could be the connection to the proxy dropping out but I’m using paid ones from the suggested service so there’s not much I can do about that, the bot just needs to be able to deal with connection failures better then it currently does.

the bot does not stop in case of a connection failure, but continues its execution. there is no message in the log you provided about the bot stopping working due to any problem

Hmm even though it doesn’t say anything in the logs it seems more than a coincidence that it closes after this error, could it be a malformed response from the server is making it close somehow?

Here is an example of a bot closing due to an unhandled error.
https://github.com/masterking32/MasterHamsterKombatBot/issues/456#issuecomment-2354852464
Most likely the problem is in your own modification

hello sir, is the bot still safe to use? thanks


vector: add functions for lines

I am attempting to generate lines with the vector package in ebiten. My implementation in ebiten results in a rasterized image (top:canvas, bottom:ebiten).
I am generating the lines using
LineTo(bottomLeft)
LineTo(bottomRight)
LineTo(topRight)
LineTo(topLeft)
LineTo(bottomLeft)
Fill(color)

since there is no line width option afaik.
From looking through past issues it seems that the vector package is still in an early state. Is this an issue with my implementation or is this package still a WIP?

I'm still considering APIs to render strokes.

since there is no line width option afaik.

Not only a width, we have to consider these attributes

A join
A cap
A miter limit

So this is not an easy task, and I'm still not sure what is the nice line APIs for Ebiten.

Here is the example (examples/lines):
https://user-images.githubusercontent.com/16950/195886728-15b3efad-4479-40f7-9ee4-f3049893b38b.mp4


Test example for unit data type CB

@jliangTT,
here is the test example for the uint data type CB you asked for in #4624.
This example simply copies a single tile from the input CB to the output CB and prints out the data from the output CB.
How to run the example
cd tt-metal
make build
make tests
cd build/test/tt_metal
./test_uint_data_type_cb --cb_data_format <0: Float16_b, 1: UInt16>

CB data format is UInt16

For reference, the data is a random value, and the output data format is bfloat16.


Add a staging environment

Is your feature request related to a problem? Please describe.
Currently, the only way to truly test Twilio response changes, is to publish the changes to master. This inevitably leads to a broken production product
Describe the solution you'd like

[x] Set up a test phone number
[ ] Add a separate staging app in Heroku
[x] Setup a deploy pipeline in Heroku

Review apps were used instead of a separate staging app.

Tested and working.
I order to utilize this feature right now you need access to the Twilio account in order to set the new URL of the Review app you want to test.


[build] Consolidate some targets in the Makefile

Makefiles are bad.

Oh, so that's how make wildcards work. Thanks.


ionic serve fails on 1.4.1 with TypeError: Object 1.4.1 has no method 'contains'

From @ilkkanisula on May 15, 2015 9:12
I updated to 1.4.1 (npm update -g ionic) and got following error:
/Users/ilkkanisula/.nvm/v0.10.33/lib/node_modules/ionic/lib/cli.js:22
  if (settings.version.contains('dev') || settings.version.contains('beta') ||
                       ^
TypeError: Object 1.4.1 has no method 'contains'
    at Object.dev (/Users/ilkkanisula/.nvm/v0.10.33/lib/node_modules/ionic/lib/cli.js:22:24)
    at reportExtras [as prerequestMethod] (/Users/ilkkanisula/.nvm/v0.10.33/lib/node_modules/ionic/lib/cli.js:442:11)
    at process._uncaughtExceptionListener (/Users/ilkkanisula/.nvm/v0.10.33/lib/node_modules/ionic/node_modules/opbeat-ionic/index.js:124:22)
    at process.emit (events.js:95:17)
    at process._fatalException (node.js:272:26)

I patched cli.js with following change:
Cli.dev = function dev() {
  if (typeof settings.version === 'string' ) { return true; }
  if (settings.version.contains('dev') || settings.version.contains('beta') || settings.version.contains('alpha')) {
    return true;
  }

  return false;
};

This resulted in exception:
An error occured and was reported to Opbeat undefined

/Users/ilkkanisula/.nvm/v0.10.33/lib/node_modules/ionic/lib/cli.js:449
    console.log(err.stack);
                   ^
TypeError: Cannot read property 'stack' of undefined
    at reportExtras [as prerequestMethod] (/Users/ilkkanisula/.nvm/v0.10.33/lib/node_modules/ionic/lib/cli.js:449:20)
    at process._uncaughtExceptionListener (/Users/ilkkanisula/.nvm/v0.10.33/lib/node_modules/ionic/node_modules/opbeat-ionic/index.js:124:22)
    at process.emit (events.js:95:17)
    at process._fatalException (node.js:272:26)

My environment:
$ ionic info

Your system information:

Cordova CLI: 4.3.0
Gulp version:  CLI version 3.8.10
Gulp local:
Ionic Version: 1.0.0
Ionic CLI Version: 1.4.1
Ionic App Lib Version: 0.0.18
ios-deploy version: Not installed
ios-sim version: Not installed
OS: Mac OS X Lion
Node Version: v0.10.33
Xcode version: Xcode 4.6.3 Build version 4H1503

Copied from original issue: driftyco/ionic#3741

From @Ionitron on May 15, 2015 9:12
Greetings @ilkkanisula!
My sensors indicate that you need to update your issue through our custom issue form. We are now requiring all issues to be submitted this way, to ensure that we have all of the information necessary to fix them as quickly as possible.
Click Here To Update Your Issue
I will have no choice but to close this issue if it is not resubmitted through the form. Please fill out the rest of the form, so that I may use my friendly robot powers to assist you.
Thank you!

This has been quick-fixed in 1.4.2. Thanks for reporting.


JIT: Allow users to register external device code?

Description
During the past course of exposing CUDA C++ APIs to CuPy JIT I've gradually realized a big missing piece, which is to allow users to "bring in" their device kernels to CuPy JIT with ease. Currently it requires to go through the entire JIT stack to

provide the calling signature in Python

the signature could deviate from C++'s, as it's hard to deal with raw pointers in Python

make the types recognized by JIT
special-case the treatment in the Python AST -> CUDA C++ translation

I feel the already-endless chase of CUDA built-in C++ APIs alone is tough enough, not to mention if users have device kernels that they'd like to interact with from Python, which is impossible in the current situation as modifying the JIT codebase is required.
Such examples (that would interest multiple parties) include

Exposing NVSHMEM device-side communication APIs (cc: @dalcinl)
Exposing CUDA math lib device APIs (ex: cuFFTDx) (cc: @mnicely)

It'd be nice -- in the future -- to add a registration system for users to register external device code and include the needed headers in CuPy JIT kernels, though I do not have good advices for implementation 😅
A point of reference is Numba which will add similar support, but there they already allow users to register foreign C/C++ types (through ctypes if I am not mistaken), so I am not sure if it's something we could learn from...
Additional Information
No response

@leofang Would the following interface be enough to call external device code?
code = '''
__device__ float device_func(float* x) { ... }
'''

@cupyx.jit.rawkernel(preamble=[code])
def kern(array):
    ...
    f = cupyx.jit.get_function_from_preamble('device_func', return_type=numpy.float32)
    y = f(array.data.ptr)  # No typecheck for arguments
    ...

Thanks, @asi1024. I will do a case survey and get back to you. My current concerns would be

Don't we need to at least declare the number of inputs?
Without type-checking input parameters, do we know how to generate the right code?

I am considering the following implementation.
class ExternalFunc(BuiltinFunc):
    def __init__(self, name, return_type='void'):
        self.name = name
        self.return_type = to_ctype(return_type)  # to_ctype is not implemented currently

    def call(self, env, *args):
        params = ', '.join([str(Data.init(x)) for x in args])
        return Data(f'{self.name}({params})', self.return_type)

def get_function_from_preamble(name, return_type):
    return ExternalFunc(name, return_type)

The types of input parameters are not checked unless explicitly checked in BuiltinFunc.call.

Maybe we should also allow users to specify options to be passed to NVRTC (c.f. #6670)

Maybe we should also allow users to specify options to be passed to NVRTC (c.f. #6670)

Yes, I think it was listed as a TODO in #5280 (CuPy JIT specific interface), also https://github.com/cupy/cupy/issues/4290#issuecomment-812317043 has similar asks. Probably a good time to design the interface for jit.rawkernel() 🙂

The types of input parameters are not checked unless explicitly checked in BuiltinFunc.call.

I am still not sure I follow, sorry! For example, if I call an external kernel with f(arr.data.ptr), how does JIT know if arr.data.ptr should be cast to void* or void** or any other pointer types?

I will do a case survey and get back to you.

I did a quick survey. It should work for NVSHMEM because the device functions have C-like APIs. However, cuFFTDx is more challenging because it does not have clean separation of device/host APIs. I will submit feedbacks to the team but it should not be a blocker of this discussion, as in any case we need either spaghetti code or some new design to help JIT cuFFTDx code.

Adding a quick note here for future reference.
A recent offline discussion with the team suggests that ctypes based type declaration would be favored. Using the cuFFT new callback (#8242) as example:
from ctypes import *

class cb_params(Structure):
    _fields_ = [("window_N", c_uint),
                ("signal_size", c_uint)]

class cufftComplex(Structure):
    _fields_ = [("x", c_float),
                ("y", c_float)]

@cupyx.jit.rawkernel(
    device=True,
    name='cufftJITCallbackLoadComplex',
    args=[POINTER(cufftComplex), c_size_t, POINTER(cb_params), POINTER(c_void_p)],
    returns=cufftComplex
)
def my_callback_func(input, index, info, sharedmem):
    if (index % info.signal_size) < info.window_N:
        return input[index]
    else:
        return cufftComplex(0, 0)

which can be converted to/from NumPy (structured) dtypes, taking the cb_params type above as example:
>>> import numpy as np
>>> cb_params_dtype = np.dtype([("window", np.uint), ("size", np.uint)], align=True)
>>> cb_params_dtype
dtype([('window', '<u8'), ('size', '<u8')], align=True)
>>> cb_params = np.ctypeslib.as_ctypes_type(cb_params_dtype)

then once CuPy supports NumPy structured dtypes (https://github.com/cupy/cupy/issues/2031) it’d work seamlessly on both host and device.

I would rather say that once #2031 gets implemented, you could just use NumPy dtypes for expressing kernel args and returns, and forget about ctypes. I'm biased here, I do not like cytpes.

@dalcinl We still need some ctypes machinery such as annotating pointers, so that we can e.g. register foreign C function signatures. What would be the alternative if we do not use ctypes?

Oh, ok, now I see what you mean, NumPy datatypes do not support typed pointers. I'm wondering whether you want to develop your own solution or DSL, perhaps based on simple strings with typecodes and the extension from the buffer interface for structs (T{...}) and a way to express pointers (e.g. a * suffix after a typecode). One thing I do not like about ctypes is that you cannot express ABIs and fixed-size types, that is, if you do ctypes.c_int64, that is an alias for ctypes.c_long or ctypes.c_longlog depending on the platform. Maybe this point is not really that important to CuPy.  But I still have the feeling that ctypes should not be at the core of the thing, at some point you may run short. Just my two cents...