Option for requirements.txt and config to be in subdirectory

I'd like my jupyter extension to use mybinder, however it has its own requirements.txt
It would be great if mybinder could check for requirements.txt environment.yml etc in a .mybinder directory before checking the root folder.

You can place your files in a binder/ subfolder, once this exists files in the top level directory will be ignored.

just opened https://github.com/jupyterhub/binder/pull/56 to try and make this clearer in the binder docs

Great, the using page is the one I ended up from by starting at mybinder clicking docs and then requirements.

Gonna close this as we now have language about this here:
https://mybinder.readthedocs.io/en/latest/using.html#config-files
and in the faq:
https://mybinder.readthedocs.io/en/latest/faq.html#can-i-put-my-configuration-files-outside-the-root-of-my-repository
Thanks for reporting @stuaxo , it's very helpful in improving the documentation!

This issue has been mentioned on Jupyter Community Forum. There might be relevant details there:
https://discourse.jupyter.org/t/project-toml-in-binder-subdirectory-not-installing-packages/6265/6

This issue has been mentioned on Jupyter Community Forum. There might be relevant details there:
https://discourse.jupyter.org/t/project-toml-in-binder-subdirectory-not-installing-packages/6265/6

This issue has been mentioned on Jupyter Community Forum. There might be relevant details there:
https://discourse.jupyter.org/t/project-toml-in-binder-subdirectory-not-installing-packages/6265/8

This issue has been mentioned on Jupyter Community Forum. There might be relevant details there:
https://discourse.jupyter.org/t/project-toml-in-binder-subdirectory-not-installing-packages/6265/8


The attention mask and the pad token id were not set

user：Who are you?
The attention mask and the pad token id were not set. As a consequence, you may observe unexpected behavior. Please pass your input's attention_mask to obtain reliable results.
Setting pad_token_id to eos_token_id:151643 for open-end generation.
A decoder-only architecture is being used, but right-padding was detected! For correct generation results, please set padding_side='left' when initializing the tokenizer.
assistant：A．
A<|im_end|>

same issue


update deps

depends on https://github.com/purescript/purescript-record/pull/51

eventually should come back to this, but maybe doesn't matter


Read plugins from S3 to add from versions toml. Fixes #43

Will do.
On Fri, Oct 9, 2020, 19:05 Timothy Corbett-Clark<EMAIL_ADDRESS>wrote:

@tcorbettclark requested changes on this pull request.
Any chance you could change the walkthrough test to cover this case too
please?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/tcorbettclark/encapsia-cli/pull/44#pullrequestreview-505808797,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AASSIVG2ZSYMAR2RDCT4QKTSJ4YFXANCNFSM4SKHIREA
.

Added walkthrough test.


feat (sync-service): add OTEL_DEBUG environment variable

This PR fixes https://github.com/electric-sql/electric/issues/1714 by introducing a separate OTEL_DEBUG env var to enable printing the spans to stdout while also being able to export the spans using OTEL_EXPORT.

@kevin-dp I've made some changes to make OTEL_DEBUG and OTLP export compatible with each other. Tested my changes against both an OpenTelemetry Collector and Honeycomb, ensuring that batch export works together with debug output.
In a follow-up PR, we should also remove the OTEL_EXPORT env var from the docs and explain that setting OTLP_ENDPOINT alone is enough to enable OT export.

In a follow-up PR, we should also remove the OTEL_EXPORT env var from the docs and explain that setting OTLP_ENDPOINT alone is enough to enable OT export.

We should change docs accordingly in this PR

In a follow-up PR, we should also remove the OTEL_EXPORT env var from the docs and explain that setting OTLP_ENDPOINT alone is enough to enable OT export.

We should change docs accordingly in this PR

But we still have the same lag between doc changes and code changes that we had with old Electric, where the new code only becomes available to users after a release is published.

right, then we should have the other PR ready before code changes are merged :)

@balegas https://github.com/electric-sql/electric/pull/1795

@alco can i merge this?

I'm just gonna go ahead and merge this 👍


Show CPU usage for each package

I'm stuck with an Atom that constantly hangs (CPU at 100%) and I suspect the cause being an installed package.
I'd like to see the CPU usage of the each package's Atom Helper.
My suggestion would be, in Settings/Installed Packages, for each installed and enabled package show the correspondent Atom Helper CPU usage.
It would be ok to have these numbers updated only when I first open Settings/Installed Packages, no need to have them update in real time.
Another viable option would be to assign names to Atom Helpers, so that I can see the offending package name by inspecting the Activity Monitor.
For example:

-> what package is associated with the hanging Atom Helper?

There is already a profiling tool built in to Atom:
https://atom.io/docs/latest/hacking-atom-debugging#diagnose-performance-problems-with-the-dev-tools-cpu-profiler
While it won't specifically finger individual packages or summarize based on package name, the stack traces it provides can give lots of clues.
As far as the stuck Atom Helper process goes, I have a few suggestions:

Clear out the ~/.atom/storage directory

Completely exit all instances of Atom
Move or rename the `~/.atom/storage
Launch Atom again

Disable the spell-check package (it sometimes gets into a weird state and causes the stuck Atom Helper thing you're seeing)

Clearing out the ~/.atom/storage directory seems to help: I've got an Atom Helper at 70% of the CPUO all the time, thanks for the advice! I'll keep testing and will report back on the issue mentioned above.
I still think being able to see CPU usage per package would be a killer feature to inspect this kind of problems, so please don't close this issue :)

No, Atom still hanging at 100% of the CPU :/
(it could be something that corrupts the storage)

I still think being able to see CPU usage per package would be a killer feature

At this time this is not possible because all packages are run on the main process.

I have multiple issues with CPU usage of Atom Helper, while i also suspect installed packages, I noticed the every action that involves using the network (ex: packages)  makes Atom Helper crazy !

I met this problem occasionally when I open many files and switch and edit them.

We do occasionally revisit better ways to track down packages that consume too much CPU and visualize it in ways accessible to the typical Atom user. Since it isn't something that we're actively working on however, we're going to close this for now.


[Impeller] Vulkan Advanced blends render incorrectly on S10 in wonderous app

Seem to work fine on Pixel:

RenderDoc is having trouble capturing a frame here, complaining about a GLFunction - which I assume is due to a platform view issue:
glEGLImageTargetTexture2DOES

Nevermind, this is a bug caused by the unsupported platform views. removing the platform view fixes this


Fix bug with spawnShards not spawning shards when using workers

Not sure how my other commits also came along with this when they're already merged into this repo 🤔

Create a branch with the fixes by ferching the upstream discordeno:main

Hey, thanks for the PR, but all of this is already fixed in the gateway rewrite from me which will be merged in soon. I will close this for now for the god sake of merge conflicts.


Systems cannot be dispatched at fixed intervals

Right now, Specs is capable of efficiently scheduling many systems that all run once on every frame. However, some systems in reality should run on a fixed interval instead. For example, a physics system must run on a fixed delta time in order to keep the simulation stable, and this is currently impossible to achieve in Specs.
Interestingly enough, LazyBox ECS allowed users to specify an UpdateType for each Processor at initialization time, and the Scheduler had both an update() method and a fixed_update() method that would each get called in the proper areas of the game loop.
If we were to implement the same functionality into Specs, I could imagine the System trait looking roughly like this:
pub trait System<'a> {
    type SystemData<'a>;

    fn update(&mut self, _data: Self::SystemData) {}

    fn fixed_update(&mut self, _data: Self::SystemData) {}

    fn running_time(&self) -> RunningTime {
        RunningTime::Average
    }
}

Also, the Dispatcher would have to be updated to include a dispatch_fixed() method as well.

I think what @ebkalderon is writing here makes sense.
How to solve this:

Add this method (probably named fixed_run) with a default (no-op) to shred's system module
Add a minimal example showing the usage (trivial)
Add _fixed variants for Dispatcher's dispatch, dispatch_par, dispatch_seq and dispatch_thread_local respectively (oh, and to AsyncDispatcher and RunNow). This seems like much duplication - maybe we can find a better way? Oh well, we could also just use something like RunType instead, I'll leave it up to the PRer to experiment what's better.

How is the fixed_update going to work with Systemdependencies? With locking storages? What guarantees we can give on fixedness of the update?

How is the fixed_update going to work with System dependencies?

We just assume both methods need the same dependencies; if this isn't the case, one can always create two systems.

What guarantees we can give on fixedness of the update?

None, we just provide a separate method. It's users responsibility to call them in the right interval.

Maybe when registering the system?

That's just too much for the builder; additionally, we need to extra check it / have separate lists which I don't like because of performance / maintenance reasons.

Shred locks the storages before it calls update, right? If so then having either empty fixed_update or update methods would be unfortunate.

So..is there any update on this?

You can also just do it yourself during update: Accumulate the delta frame times in each physics update call and once it reaches a certain threshold (e.g 50ms) update the physics system and decrease the counter again.
This doesn't require an additional function and gives a bit more control (e.g handling large timesteps)

I think one could also just have two dispatchers.

Don't know how possible this is given the current design, but could Specs potentially utilize @msiglreith's solution internally? The user would be able to specify a fixed update interval (default could be 16 ms) and each system added to the DispatcherBuilder would be marked as either UpdateKind::Fixed or UpdateKind::Variable. Fixed and variable systems are stored separately inside the Dispatcher. On every dispatch call, an internal counter accumulates the delta frame times, and when it reaches the correct threshold, it executes all the fixed stages
I don't know how we could manage dependencies between fixed and variable systems, though, nor if we should handle that case at all.

I don't know how we could manage dependencies between fixed and variable systems, though, nor if we should handle that case at all.

I don't think this is possible.

Fixed and variable systems are stored separately inside the Dispatcher.

This is an additional complexity and not useful to everybody. Why not go with two dispatchers, one for variable stuff and the other one updated in a fixed interval?

For note, in my C++ ECS I had a 'FixedUpdate' thing that was just a normal update except it either skipped processing or processed once or multiple times to keep things in sync, I called physics from it, I ran things that only needed to run once a second in it, etc...  It was configurable with an interval time on creation.  They were not stored or handled any differently from just normal system updates (although things like physics would be decorated as 'taking up more time' than average so things would schedule 'around' it differently).

Closing due to inactivity. The best solution here seems to be to create two dispatchers, since systems dispatched in different intervals cannot depend on each other anyways.


how to display svg files?

if I have an svg file inside /var/www/nginx-image-server/images with this example content http://pastebin.com/Zs8tbqmX
if I try to open it in a browser via nginx-image-server
http://<IP_ADDRESS>:3005/local/small_light(dw=200)/images/my_image.svg
then I see a blank page  - I should see the image
other image file types (jpegs, pngs) work.

Now ngx_small_light does not support SVG.
https://github.com/cubicdaiya/ngx_small_light#supported-formats

thank you for quick response.

Additionnally, SVG is stored as text regardless of its rendered size, so there are no real benefits to using a resizing module. Any decent modern browser will handle the format fine and render it to whatever size you specify in your webpage.


ja: Make docs/concepts/containers/container-lifecycle-hooks.md follow v1.18 of the original text

This is a Feature Request

What would you like to be added
Update docs/concepts/containers/container-lifecycle-hooks.md to follow v1.18 of the original (English) text.
Why is this needed
content/ja/docs/concepts/containers/container-lifecycle-hooks.md is outdated.
Comments
/language ja
/good-first-issue
File to update
https://github.com/kubernetes/website/blob/dev-1.18-ja.1/content/ja/docs/concepts/containers/container-lifecycle-hooks.md
Original
https://github.com/kubernetes/website/blob/fb6364d/content/en/docs/concepts/containers/container-lifecycle-hooks.md
diff between translated and v1.18
https://gist.github.com/cb8130f11db134d87d4cbd82164582c5
Note
Currently, we use dev-1.18-ja.1 branch. Please open a PR targeting the branch.
ref
https://kubernetes.io/ja/docs/contribute/localization/
If you have a question, feel free to ask us at slack.k8s.io #kubernetes-docs-ja channel.

/assign

/close


fix: support packages not initializing provider

Remove not needed throw

closes #68

Turns out we were already defining default values for the context, so nothing besides removing a not needed throw was done ;)


chore: modify trigger condition of windows e2e pipeline

What type of PR is this?
/kind modification

What this PR does / why we need it:
Modify trigger condition of windows e2e pipeline to keep it the same as that of trigger settings in pipeline.

"trigger: none" is used to disable CI trigger.
Add additional path for pr trigger.

Which issue(s) this PR fixes:

Fixes #
Requirements:

[x] uses conventional commit messages

[ ] includes documentation
[ ] adds unit tests
[ ] tested upgrade from previous version

Special notes for your reviewer:
Release note:
none

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall First build on junjiezhang/modify-windows-e2e-pr-trigger at 60.655%

Totals

Change from base Build<PHONE_NUMBER>:
60.7%

Covered Lines:
2576

Relevant Lines:
4247

💛  - Coveralls


Write a C++ program to find second smallest number in an array

Description
Write a C++ program to find second smallest number in an array
Input  : [1, 2, 3, 4, 5]
Output : 2

How to contribute

Save the solution in program/FindSecondSmallestNumberInAnArray.cpp file
Add FindSecondSmallestNumberInAnArray.cpp file in find-second-smallest-number-in-an-array folder

!assign


)HERE’S! WAY TO WATCH Aston Villa vs Tottenham Hotspur Live STREAMS FREE Premier League ON TV Channel 3 NOV 2024

Tottenham vs Aston Villa LIVE: Premier League team news and line-ups as Son Heung-min a doubt
Tottenham Hotspur look to bounce back from a shock defeat to Crystal Palace when they take on Aston Villa in the Premier League this afternoon.
CLICK HERE TO WATCH LIVE STREAM NOW
CLICK HERE TO WATCH LIVE STREAM NOW
CLICK HERE TO WATCH LIVE STREAM NOW
Spurs lost 1-0 at Selhurst Park a week ago but responded with a 2-1 win over Manchester City in the Carabao Cup. Ange Postecoglou will hope that victory brings some momentum to his team as they seek to progress further up the league table and challenge for the top four spot.
Villa already occupy one of those places. They come into the weekend fourth in the table, level on points with Arsenal. Though it is too soon to call the title challengers a win over top six opposition like Tottenham will take them one step closer to the trophy. Unai Emery’s men have not lost in the league since a 2-0 defeat to Arsenal in August, a run of seven matches which has kept them in touch with the top of the table.
Tottenham Hotspur host Aston Villa on Sunday, with both teams aiming for Champions League football next term - but the visitors faring decidedly better once again this season so far.
Spurs have been wildly unpredictable, looking impressive in attack and diabolical at the back, sometimes half-to-half rather than even game to game. They sit eighth, as many wins as defeats so far in the Premier League, and the five-point gap to Villa in fourth shows they are already off the pace.
However, a midweek win over Man City will bolster confidence, even if that came in the League Cup, while Villa themselves are sitting pretty top of the Champions League table itself with three wins from three as well as holding their own domestically once more.
However, they were beaten 2-1 at home by Crystal Palace in the Carabao Cup meaning it’s just two wins from the last five in all competitions.
Good afternoon and welcome to The Independent’s live coverage of today’s 2pm kick-off between Tottenham and Aston Villa.
The home side are looking to recover from a surprise defeat to Crystal Palace last time out, while Villa are hoping to continue their slid start to the season.
And we’ll have all the latest build-up, team news and updates here.

dsfvsdfvds

cvcv

ALL Spo

ALL Spo

ALL Spo

ALL Spo

ALL Spo

ALL Spo

ALL Spo

Watch Tottenham Hotspur vs Aston Villa live streams Online For Free Anywher
Phone📱/TV📺👇
1⃣https://bit.ly/4dFFWvv
2⃣https://bit.ly/4dFFWvv
Iphone📲/PC💻👇
1⃣https://bit.ly/4dFFWvv
2⃣https://bit.ly/4dFFWvv

Watch Tottenham Hotspur vs Aston Villa live streams Online For Free Anywher
Phone📱/TV📺👇
1⃣https://bit.ly/4dFFWvv
2⃣https://bit.ly/4dFFWvv
Iphone📲/PC💻👇
1⃣https://bit.ly/4dFFWvv
2⃣https://bit.ly/4dFFWvv

Watch Tottenham Hotspur vs Aston Villa live streams Online For Free Anywher
Phone📱/TV📺👇
1⃣https://bit.ly/4dFFWvv
2⃣https://bit.ly/4dFFWvv
Iphone📲/PC💻👇
1⃣https://bit.ly/4dFFWvv
2⃣https://bit.ly/4dFFWvv

Watch Tottenham Hotspur vs Aston Villa live streams Online For Free Anywher
Phone📱/TV📺👇
1⃣https://bit.ly/4dFFWvv
2⃣https://bit.ly/4dFFWvv
Iphone📲/PC💻👇
1⃣https://bit.ly/4dFFWvv
2⃣https://bit.ly/4dFFWvv

Watch Tottenham Hotspur vs Aston Villa live streams Online For Free Anywher
Phone📱/TV📺👇
1⃣https://bit.ly/4dFFWvv
2⃣https://bit.ly/4dFFWvv
Iphone📲/PC💻👇
1⃣https://bit.ly/4dFFWvv
2⃣https://bit.ly/4dFFWvv

Watch Tottenham Hotspur vs Aston Villa live streams Online For Free Anywher
Phone📱/TV📺👇
1⃣https://bit.ly/4dFFWvv
2⃣https://bit.ly/4dFFWvv
Iphone📲/PC💻👇
1⃣https://bit.ly/4dFFWvv
2⃣https://bit.ly/4dFFWvv

Watch Tottenham Hotspur vs Aston Villa live streams Online For Free Anywher
Phone📱/TV📺👇
1⃣https://bit.ly/4dFFWvv
2⃣https://bit.ly/4dFFWvv
Iphone📲/PC💻👇
1⃣https://bit.ly/4dFFWvv
2⃣https://bit.ly/4dFFWvv

This is best option to Live Stream This Event, Follow Given Link for Free!👇👇👇
⭕📺📱💻👉CLICK HERE TO LIVE STREAM for Free
⭕📺📱💻👉CLICK HERE TO LIVE STREAM for Free


Idiomatic way of creating external data

I develop script, which find all external references for raw binaries in automatic mode. When developing I was guided by a ELF loader: I create additional uninitialized memory blocks and thunked external functions:
ExternalLocation externalLocation = currentProgram.getExternalManager()
        .addExtFunction(symbolLibrary.getProgram().getDomainFile().getName(),
                symbolLibrary.getName(),
                addressLibrary,
                SourceType.IMPORTED);
functionTarget.setThunkedFunction(externalLocation.getFunction());

I can create function in uninitialized memory only with API.
As a result I get external function with one reference (from original function) and original function with many true references (see the picture and table to understand what I mean):

Name
Reference Count
Symbol Type
Source
Location

memset
1
External Function
IMPORTED
External[0000103d]

memset
176
Thunk Function
IMPORTED
0000103d

But I can't do this for data (I didn't find needed API method for creating link between original data and external):

Name
Reference Count
Symbol Type
Source
Location

g_EXTERNAL_VAR
0
External Data
IMPORTED
External[0000100c]

g_EXTERNAL_VAR
501
Data Label
IMPORTED
0000100c

Temporary solution for quick jump to external file and viewing value of data: create comments with annotation (0x0:{@program "/version_0/ROM@0000100c"}).
Questions

How can I create external data in idiomatic way?
How can I create function in uninitialized memory block using GUI?

The ELF importer creates the uninitialized memory blocks because the relocation handler needs a real number to use for relocations that need to be fixed up in memory or instructions.  For example a call instruction or a reference created by multiple instructions needs a real address to call or else the instructions address calculation may not work.  If you don't need an interim location with a real address, I would skip creating the uninitialized memory block.
Normally if you want to create a reference to an external location you create the external address and create a reference to it either from code or from data.
In your data case you would create an external reference and optionally provide a program path and a label/address that should be associated with the reference.
I may not be entirely understanding your case, so I didn't want to point you in a direction not knowing if you really need an actual memory address for your reference.

An uninitialized memory block is the default type of block created when creating new blocks in the memory map.  There is an option on the create memory block dialog to make it initialized.

Thank you. Now I understand why ELF importer creates the additional memory blocks.

It is not my case. I don't need an actual memory address for calculating. But if I will create the external address (external location) and a reference I won't get correct name of function (see #148), I can't make a quick jump to external program (I should open Symbol Tree → Imports → External Program → Needed Function/Data, on the other hand with the memory blocks Ghidra open external program after double clicking on thunked external function, for data as I already wrote I use comments with annotation).

I understand it. I rephrase the question: why I can create function in uninitialized memory only with API?

I think I understand the issue now.  What is the instruction that is used for the actual call/jump to the external?  If it is a CALLIND x, or JUMPIND x, then the reference override directly on the instruction won't work currently (coming in 9.1), The decompiler is using the actual calculated address for the indirection.  So the value the decompiler is using would be the place you would need to place a dummy function that would become a thunk to the external program.  So I see what you were attempting and you were on the right track. I'll have to play with it a bit more to give you better guidance.  But you should be able to:
Create the fake EXTERNAL memory block, uninitialized for the external program locations.
(you might not have to create the memory block if you use the API, not sure)
Create a function of one byte at the appropriate location in the fake EXTERNAL memory block
Create an external function with the correct name (not in the EXTERNAL memory block)
Thunk the function in the fake EXTERNAL memory block to it

In 9.1, you will be able override the indirect call directly to the external location.  You will still have to provide the name within the one program as an external program reference.  We'll have to think about this to make sure it is done correctly.

When you create a function the GUI tries to figure out the functions body (address set) from the instructions found there.  If it can't, the function creation fails.  If you were to select a single byte, even without any defined instructions, I believe you could create the function from the GUI.

Thanks for detailed instruction. I developed a script (not in public yet), that does everything, what you wrote. The solution has rough edges (additional fake memory blocks, fake functions for example), but I'm satisfied with the decision (and wait 9.1 version). I want to return to the original question: how can I create linked external global data (structures, strings, constants, etc)? I'm currently using fake memory blocks and comments with annotation now (as I already wrote, see the figure).

Where g_COOKIE is fake global variable in uninitialized memory block, 0xdeadbeef is value of global variable, /ver_0/EXTERNAL_PROGRAM_0@000100c is path to external program and address of the variable. I can quick open external location after double clicking on the comment.

Wow! Thank you! I'm surprised I hadn't realized that.

Are you hoping to get the value at the other end of the link and have the value used by the decompiler and other analysis, or just navigate to the location directly from the reference?

A little hidden.  Basic concept is functions need a body, if it can't be figured out, it needs to be provided.

If all the files are raw bytes and at non-overlapping addresses, have you considered importing them into the same program with add to program on import?  The only real drawback is if the processing of the other file has a file format like ELF, it can get tricky as the program can't be imported with add to program, and the program will be larger.  If that is the case, the files could be processed then the information applied.  I suppose the ELF file could be processed and applied with add to the current program as well, but that isn't supported currently.
The other program could be opened and the information retrieved as an option.  We've just never done that as it could be slow and use memory.  Although in reality, it would probably work at least for visual display.  Iterating through references or back references in multiple programs would be much more difficult to support.  There could be issues mixing objects from different programs.  There was an idea called a super program that pulled all these concepts together.

Do you have the option Edit->ToolOptions...->Navigation->ExternalNavigation set to NavigateToExternalProgram?
For data you can just create the external reference.  There currently isn't support for placing data at the external address as is supported for functions.  Also as mentioned in the previous post, the data items won't display from the external program, nor will the label change if the label in the external program changes.  We have thought about allow data definitions to be placed at the external address.  The decompiler likely won't pay attention to the data reference label.

Are you hoping to get the value at the other end of the link and have the value used by the decompiler and other analysis, or just navigate to the location directly from the reference?

Of course, the first is preferable, but I think, that it is not trivial task currently, so second will be enough to begin.

If all the files are raw bytes and at non-overlapping addresses, have you considered importing them into the same program with add to program on import?

Sadly I have some shared libraries (it is raw bytes, not ELF/PE/Mach-O) and many files with overlapping addresses, that uses the libraries. Early (when Ghidra was not release) I used r2/IDA: I created project and imported the libraries for each file, then I imported already resolved information. It was painful, because I had to synchronize the results of reverse engineering. External programs in Ghidra is killer feature for me.

There was an idea called a super program that pulled all these concepts together.

Can I see commented/dead code in repository or was the idea just an idea on paper?

Do you have the option Edit->ToolOptions...->Navigation->ExternalNavigation set to NavigateToExternalProgram?

Cool! It works as I expected, thank you. I synchronize information about label changes and the data items using the script (should be run every time, when shared libraries was changed).

Getting the value at the other end of an external link at certain times isn't trivial and has many implications.  Getting the value from the other program wouldn't be too hard, but managing the programs for access at the right spots without a performance penalty would be tricky, and possibly expensive depending on the analysis.
Currently there isn't any code in the repository that implements the idea of a super program.
Glad it worked for you.  The option shouldn't be so hidden.  When you select on an external link, a dialog to navigate and/or turn on the navigation option should be shown so you know that you can navigate to the external program if you want.


Error calling the generated function: name 'torch' is not defined

Keep getting this, no matter which model to use in Ollama
Write the Code
LLM COMMENTS:
Imports in code: ['import torchvision.transforms as transforms']
Stored script:
def generated_function(input_data_1=None, input_data_2=None):
def apply_transforms(image):
# Apply all three tweaks to image
hue = torch.randint(0, 360, (1,))
saturation = torch.randint(-100, 100, (1,))
lightness = torch.randint(-50, 50, (1,))
transforms_list = [transforms.ColorJitter(hue=hue),
transforms.ColorJitter(saturation=saturation),
transforms.ColorJitter(brightness=lightness)]
for transform in transforms_list:
image = transform(image)
return image
if input_data_2 is not None:
    # If input_data_2 is provided, apply the transforms to it
    output_data = apply_transforms(input_data_2)
else:
    # Otherwise, apply the transforms to input_data_1
    output_data = apply_transforms(input_data_1)

return output_data

Error calling the generated function: name 'torch' is not defined
Traceback (most recent call last):
File "D:\ComfyUI\custom_nodes\anynode\nodes\any.py", line 391, in go
result = locals_dict[function_name](any, input_data_2=any2)
File "", line 19, in generated_function_21900ac62c88401fa67acabf7dee08c6
File "", line 4, in apply_transforms
NameError: name 'torch' is not defined
!!! Exception during processing!!! name 'torch' is not defined
Traceback (most recent call last):
File "D:\ComfyUI\execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "D:\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "D:\ComfyUI\execution.py", line 74, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
File "D:\ComfyUI\custom_nodes\anynode\nodes\any.py", line 398, in go
raise e
File "D:\ComfyUI\custom_nodes\anynode\nodes\any.py", line 391, in go
result = locals_dict[function_name](any, input_data_2=any2)
File "", line 19, in generated_function_21900ac62c88401fa67acabf7dee08c6
File "", line 4, in apply_transforms
NameError: name 'torch' is not defined
Prompt executed in 15.60 seconds

Tell it specifically in the prompt on it's own line remember to import torch ... sometimes smaller LLMs don't really follow the initial instruction or understand what to do with that error, so you can try to reinforce it.

https://github.com/lks-ai/anynode/wiki/Debugging-AnyNode-through-Prompting See here.


docs: update slider with range variant

Closes
#3730
#3788

Updates the Slider component docs with the new range variant.
Updates the Slider component docs with Usage and Style template changes.

New

Added the range slider variant

Changed

Updated the documentation on the usage and style tabs with our new content templates.

Removed

Unused images

I need help from a dev to get the Range slider in react into the Live demos on the Usage and Codes tabs. Thank you!

@laurenmrice I just wanted to check that the discussion we had recently is captured -- in regard to the fact the range slider lacks any persistent decent contrast indicator of an end point if a variant without inputs exists.
The existing slider always indicates how much space exists between the 0 value and the visual point it represents. It lacks a persistent good contrast indicator at the max value end, but one can extrapolate the distance at the other end and infer what it is likely to be. So if the numeric input disappears, it's not that critical.
For the range slider, if neither point starts at an extreme, a user who cannot see well cannot actually infer how much of the slider is selected in the range. Obviously when the big numeric inputs are on each end, even users with fairly poor vision can immediately see the range values, so it is not an issue there, but if the inputs are removed, it's quite difficult -- and arguably more mental effort -- to figure out how much of the slider range is selected.
If you've captured this elsewhere, feel free to delete this comment.

@mbgower Yes, we will be tracking this in a separate issue. It needs to go through a design iteration before it goes to development. Once it is in code, then we can update the website documentation and the figma kit with those changes.

Hey @mbgower wanted to point you to where we noted that suggestion down for a future enhancement. 🎉
Thanks for the work on this everyone!
https://github.com/carbon-design-system/carbon/issues/14549#issuecomment-1804762148


add skip mysqldump config

CI failed @miniframework

No update, I will close it now.
May re-open later.


Custom versioning fixes #2896

Fixes microsoft/coe-starter-kit#2896

Reviewers Note: In order to pass the PR Loop I had to include the updates for git longpaths here from the portal PR


pipeline @param.output usage

This is a little strangeness. I'm not sure if this is anticipated behavior. If so, then it should be documented.
this works (passes the anticipated owi_obj):
@param.output(owi_obj=winds.OWI)
def output(self):
        return self.execute()

This doesn't work (passes owi_obj as None):
@param.output(owi_obj=winds.OWI)
def owi_obj(self):
        return self.execute()

And this doesn't work (passes owi_obj as None):
@param.output()
def owi_obj(self):
        return self.execute()

This doesn't work (passes owi_obj as None):

@param.output(owi_obj=winds.OWI)
def owi_obj(self):
        return self.execute()

Shouldn't this be the same as the following, and if so, does that work?
@param.output(winds.OWI)
def owi_obj(self):
        return self.execute()

@kcpevey Can you summarize what changes we should include in the docs?  Thank you!


Bump Connect to version 2023.10.0

This PR was created automatically by the Posit Connect release scripts.
This PR should not be merged until the new 2023.10.0 Docker images are available in our public container registry.
The images will be built and pushed by GHA after the rstudio/rstudio-docker-products PR is merged into main.
Docker image PR: https://github.com/rstudio/rstudio-docker-products/pull/654

Can we merge this in now that the docker images are available?


Bower compatibility

Thanks for creating this nifty module! It would be great if people can also use it in the client-side.
Cheers!

You're right. Thanks!


 You seem to be missing AllProtocol in the database's views. You can add it by setting it at @Database.views. Does this fix your problem?

Hi! You seem to be missing AllProtocol in the database's views. You can add it by setting it at @Database.views. Does this fix your problem?

Hi! You seem to be missing AllProtocol in the database's views. You can add it by setting it at @Database.views. Does this fix your problem?

please change the documentation there is little information

Hi! You seem to be missing AllProtocol in the database's views. You can add it by setting it at @Database.views. Does this fix your problem?

please change the documentation there is little information

Feel free to open a PR with your suggestion from here https://vitusortner.github.io/floor/database-views/

Feel free to open a PR with your suggestion from here https://vitusortner.github.io/floor/database-views/


Fix attachments list in edit comment (#13036)

Backport #13036
#11141 broke the appearance of dropzone attachments when editting
comments causing poorly updating lists.
This PR fixes this.
Fix #12583
Signed-off-by: Andrew Thornton<EMAIL_ADDRESS>

🚀


Re-implement projects/:id/stats to use elasticsearch

e.g. http://www.inaturalist.org/projects/dfw-urban-wildlife/stats give 'Service Unavailable'

It's currently hitting the database with a pretty hard query. I'm guessing this could be better done with ES.

Fixed in #1441


added getchar and putchar

Not sure why they were not in the repo until now, but they are both part of POSIX.1-2008: getchar, putchar

r? @alexcrichton
(rust_highfive has picked a reviewer for you, use r? to override)

@bors: r+
Thanks!

:pushpin: Commit db27b72 has been approved by alexcrichton

:hourglass: Testing commit db27b72 with merge 955aa6d...

:sunny: Test successful - status-appveyor, travis
Approved by: alexcrichton
Pushing 955aa6d7ab71f732109bf58c87891e95ae39a090 to master...


Add documentation for smp and smi-conformance github actions

Notes for Reviewers
This PR fixes #6611
Signed commits

[x] Yes, I signed my commits.

🚀 Preview for commit 1bc64634de6353c26b60f463b975273021c268b6 at: https://63efcaced891f6153d0987be--meshery-docs-preview.netlify.app

It'd be nice to reduce the size of the logos (the images other than the screenshots).


rfc: require programmer to implement network failure handling

This is second attempt to this PR.

@kcrimson i havent had a chance to look at the changes in this yet. can you amend your commit comment and force push? the amended commit comment would reference the RFC by number for future reference (#23) and ideally, include the motivation:
Prevent Pony users from creating "silent failure" scenarios with their network code. TCPConnectionNotify, UDPNotify and TCPListenNotify will all, by default, silently eat connection failures.

@SeanTAllen comments updated

thanks @kcrimson


Introduce attr-name-style-ignore-regex

Introduce attr-name-style-ignore-regex

Looks good. I'll change it to attr-name-ignore-regex to match id-class-style -> id-class-ignore-regex and merge.

Awesome. Thanks. Could you please release this version to npm?


'primaryKey' no longer volatile; defined during init.

Currently, properties that are dependent on 'primaryKey' must be flagged as volatile, otherwise they are incorrectly cached. Namely, 'isNew' and 'isPersisted' are being inappropriately cached (I've added a test for this). One solution would be to mark those as 'volatile' as well, but that would force client implementations that were dependent on any of those properties to also be flagged as 'volatile'.
I think the more appropriate solution is what you have listed in your TODO comments: define the 'primaryKey' and set it's dependencies during initialization. That's what this does.

:clap:


Keep the POD in non-running state for a period of time

There is a Fault scenario that can keep the POD in non-running state for a period of time, but the fault of POD kill can`t keep the POD in non-running state for a period of time.

Hi @zhufanqin, did you try "pod-failure"? I think "pod-failure" could works on this scenario.

I did，but the actual failure time is much smaller than the set, which is not ideal

I think the expected behavior of "pod-failure" is extremely the same as what you say. How about opening a bug report issue on chaos-mesh/chaos-mesh?

@STRRL I though that what @zhufanqin needs is to not to use pause image, as the pause image will actually run (though, not the original image). He needs the pod to stop in a not running condition. (Please correct me if I was wrong)
As I remembered, we have discussed about this issue with @WangXiangUSTC in the weekly meetings several weeks ago 🤔

I am going to close this issue because https://github.com/chaos-mesh/chaos-mesh/issues/2776 was created. :)
Feel free to reopen it if anybody has anything to append


Marten Command Failure: CREATE OR REPLACE FUNCTION public.mt_immutable_timestamp(value text)

"Marten Command Failure:\nCREATE OR REPLACE FUNCTION public.mt_immutable_timestamp(value text) RETURNS timestamp with time zone LANGUAGE sql IMMUTABLE AS $function$\n    select value::timestamptz\n$function$;\r\n\r\n\n\n3F000: schema «public» does not exists"
When i configure marten with custom schema and in the database there is no "public" schema throws that error, I found that https://github.com/JasperFx/marten/issues/837 was closed after posting, sorry, but, in any case, its not the exact same problem, is related, tho.
It should never look for it in public schema, why we assume there is always one? It's just a convention, my Postgre databases almost never have a public schema i keep droping it after creating database 99% of the times, and, in any case, it would be better to fix the Add of SystemFunctions to take DabaseSchemaName into account, or is there any reason that i'm missing to have all in public schmea and make all marten user to have a default schema by martens convention?

@stvoidmain You're the very, very first person to have an issue with this. Marten is good enough to auto-create schemas on the fly in its development mode. I believe that the fix for #837 made it honor the StoreOptions.DatabaseSchemaName, or have you found some pathway in the code where that's not true?

First of all, marten is great, i love it, amazing work ;)
I found one, if you configure your store like this:
    store = DocumentStore.For(_ =>
    {
        _.DatabaseSchemaName = "documents";
        var connStr = Configuration.GetConnectionString("DefaultConnection");
        _.Connection(connStr);
    });

and you have no 'public' schema in your db, fails with the error in the first post.
"schema «public» does not exist"...

The patch for https://github.com/JasperFx/marten/issues/837 did exactly the opposite, it changed the use of DatabaseSchemaName for a hard coded call to "public."...

Ugh, yeah, I see what you mean. I missed it reviewing the PR. Interested in fixing this again, but buy putting that function in your main Marten database scheme instead?

Sure thing, want me to do a PR?

@stvoidmain and @jeremydmiller the function always gets created in public immaterial of database scheme and hence had fixed the logic to use public.
I am looking into it and found a deeper underlying issue which I will discuss with @jeremydmiller  and will get this going, I am on it.

As a first step, I have reverted the incorrect fix and sent a PR #865.
The underlying problem is with the StoreOptions class constructor as below:
public StoreOptions()
 {
     Events = new EventGraph(this);
     Schema = new MartenRegistry();
     Transforms = new Transforms.Transforms(this);
     Storage = new StorageFeatures(this);
}

During the constructor call, database schema name value is still public and the constructor logic will always instanciate with SystemFunctions etc under public schema. Hence immaterial of where we set a schema name or not, the functions are getting created under public schema.
The only way I see a fix is to pass the database schema name as a parameter to the StoreOptions constructor rather than via the Action. And also disallow, the setter for DatabaseSchemeName (this would be a breaking change).

Fixed by https://github.com/JasperFx/marten/pull/866


Benchmarks please

the performance is comparative to that of httprouter and gin
Do you have benchmarks that show this?

Here you are: https://github.com/go-ozzo/ozzo-routing/blob/master/README.md#benchmarks
Thanks.


Support markdown for description

At least for the basic ones.. bold, italic, link

what do you think of this library? https://github.com/andrerpena/react-mde

I think this is out of scope for now.


Doesn't work with Lambda

Please note
If you are reporting an installation or module import issue, please note that
this project only accepts reports about problems with packages downloaded from
the Python Package Index. Conda users should take issues to one of the
following trackers:

https://github.com/ContinuumIO/anaconda-issues/issues
https://github.com/conda-forge/shapely-feedstock

Expected behavior and actual behavior.
I created a layer for lambda by installing it locally and zipped and uploaded it to Lambda.
The same method worked with pymysql.
When I add it as a layer it errors:
 No module named 'shapely.lib'
It's coming from the __init__.py which imports shapely.lib but that package is nowhere, I don't understand how it is supposed to work at all.
(For example: the area of my geometry is 1.417 when it should be 1.414.)
Steps to reproduce the problem.
Create a custom lambda layer
Import  shapely: from shapely import Point, LineString
Run the Lambda function
(For example, a script with required data)
Operating system
(For example, Mac OS X 10.12.3)
Lambda
Shapely version and provenance
newest
(For example, 1.6b4 installed from PyPI using pip)

A few things:

Not sure what you mean by "work with Lambda". Is this Amazon AWS i.e. this?
Unsure what "pymysql" has to do with anything here.
Shapely 1.6b4 was a pre-release from Feb 16, 2017. Update your package to re-assess the issue.
The shapely.lib module is a C extension for shapely 2.x, which never existed for shapely 1.
Details for the "area of my geometry" calculation are not provided.

@mwtoews Thank you and I really appreciate your fast answer!

Yes, AWS Lambda. Your link is current but the NodeJs runtime, not the Python
pymsql is just an example for the AWS Lambda Layer (not really important just to avoid extra questions)
I don't understand how should I update. I just pip install it, so I guess all is updated.
I don't know this part, the only thing I know, if I install shapely with pip and want to use, it throws the error that misses the lib, like it never installed.
not relevant, it was just part of the issue template I think :)

While I'm unfamiliar with AWS Lambda, possibly the best attempt is to try and upgrade your package and verify the new version. So if pip was used to install the old version, you can upgrade it with:
python3 -m pip install --upgrade shapely
python3 -c "import shapely; print(shapely.__version__)"

Shapely by default installs numpy 2. AWS lambda doesn't seem to work with numpy 2. Have you tried downgrading numpy?

I am sorry I couldn't follow up, but finally, I chosen a different solution and abandoned this thread, I had no time to deal with it, but indeed there's an issue with it on Lambda

Just wanted to add a +1 to this issue that I am also seeing shapely incompatibilities with AWS Lambda

What might be the most helpful, without getting into the weeds of cloud computing, would be to understand how to use the command pip install -t to make sure all the relevant C dependencies are also installed.

This helps, slightly. At least we know you're trying to use the latest version installed via pip on arm64 architecture to a set folder. Which of these cause the breakage, I am not sure. Locally, installing to a target directory seems to work fine but I am not running arm64 linux.
This can be a tricky debugging process... Have you even encountered the same behaviour with other Python packages that contain C dependencies? Like pyogrio, fiona (which depend on GDAL) or rtree (depending on libspatialindex)?
I am also not familiar with lambda, so I am guessing a bit blind.

Hello,
I believe this is actually an issue of how I compiled the requirements for Lambda, and not an issue with shapely itself. Documenting the issue here:
Many Python libraries have what are called "native extensions", and are modules written in a compiled language like C, C++, or more recently Rust. These libraries are usually tied to specific platforms and architectures, so you can't use a binary downloaded on Mac with a Lambda running on Amazon Linux 2.
What you should do really depends on your scale:

You could add extra flags to your pip command to download binaries compatible with the target platform (i.e. AL1 for Python <= 3.7, AL2 for Python >= 3.8), and package with these.

You could set up an AL2 EC2 VM or local Docker and use it to build your .zip file for you.

AWS CDK has added some specific tools for working with language specific Lambdas, and the new Python one includes support for building Layers using requirements.txt, Pipfile, or my personal preference poetry`

I had the same issue and this is how it was solved. After a lot of try/error and research, there were two possible options:

create a docker image and deploy that docker image using it as a layer in lambda
use Heroku Dyno (their lambda version) which naturally support python and any other lib that needs importing

I opted for Heroku. Solved my issue within less than an hour and only needed minor adjustments to the lambda so it could work as it would in AWS.

Same issue. It works fine in a container image but not when packaged in a layer.

Run Amazon Linux Docker Image

docker pull amazonlinux:2023
docker run -it --rm amazonlinux:2023 bash

Continue inside the container

yum update -y
yum install -y python3.11 python3.11-devel gcc
python3.11 -m ensurepip --upgrade
python3.11 -m pip install --upgrade pip
yum install -y aws-cli
aws configure
export pythonRuntime=python3.11
python3.11 -m pip install shapely==2.0.6 --upgrade --target "python/lib/$pythonRuntime/site-packages/"
zip -r "$name.zip" python > /dev/null
aws s3 cp "$name.zip" "s3://$bucket_name/layers/$name/$name.zip"
rm -rf "$name.zip" python
aws lambda publish-layer-version \
    --layer-name "$layer_name" \
    --description "$name library" \
    --content "S3Bucket=$bucket_name,S3Key=layers/$name/$name.zip" \
    --compatible-runtimes "$pythonRuntime"

Then I added the layer to a lambda function,  import shapely, and got the error.
{
  "errorMessage": "Unable to import module 'lambda_function': No module named 'shapely.lib'",
  "errorType": "Runtime.ImportModuleError",
  "requestId": "",
  "stackTrace": []
}

I will go back to using a container deployment for now. I wanted something more lightweight as I was running into initialization timeout.


Fix material color attribute clamping

Currently material values > 1 are not working correctly. Eg. CGA code with
set(material.color.r, 1.5)
set(material.emissive.g, 50)

don't work properly.
Tasks:

Make sure that the color attributes are clamped properly
Support values > 1 for other color attributes (eg. emissive > 50)

Move to internal issue tracking.


Is there a way to group Navigations in sidebar? : i.e. Parent/Parent/Resources in sidebar

Read docs and codes on ResourceOptions and SidebarResourceSections but couldn't find the way to do it.
Can we group Resource Navigations in sidebar? : like Companies/Products/Cars
Currently it looks like only single grouping is possible, like in Tutorials and Examples using Options in Resource.

Built in navigation allows only for depth of one. You can customize resources sidebar component with your custom component that will group everything your way. You can achieve it by doing AdminBro.bundle('_path to your custom component_', 'SidebarResourceSection');

Built in navigation allows only for depth of one. You can customize resources sidebar component with your custom component that will group everything your way. You can achieve it by doing AdminBro.bundle('_path to your custom component_', 'SidebarResourceSection');


RF: remove neurodebian

Changes proposed in this pull request
Docker image base updated to Ubuntu Focal LTS (20.04) (as in nipreps/fmriprep#2409)
Neurodebian dropped
Also specifying the platform helps to avoid docker image building issues with arm64 devices (like M1 Macs)...

Documentation that should be reviewed

build is failing because of a dependency on svgutils versions. This is fixed by #36 so will try again once that's merged

I believe this one is not necessary anymore, is that correct?


Deploybackwards

This PR addresses: https://github.com/ergs/d3ploy/issues/142, https://github.com/ergs/d3ploy/issues/116.
In this PR:

A supply_driven_deployment_inst.py is introduced. It is similar to timeseries_inst.py. But instead of a notion of demand and supply, it has a notion of supply and capacity. And it tries to ensure that capacity never falls below supply.
A algorithm_performance_tests_backdeployment.py is introduced. It tests supply_driven_deployment_inst.py to see if it works for a simplest case of back deployment.

This PR should be merged with https://github.com/cyclus/cycamore/pull/494.

Could you remove some of the new print statements in the new file? Thanks!

can you delete the unnecessary input parameters? Also, can you update the README to reflect the additional institution archetype?


Add support for Vault

If vault integration is true, this tool should support fetching tokens from Vault and adding to the config directly. Then
./nomctx --set-cluster=bangalore should get the token.
NOTE: Need to add some kind of helper method so that if the existing token is already valid, don't regenerate a token from Vault unnecessary.

Adding support for Nomad SSO first.


Rate Limit blocking multiple IPs even if the limit is not reached

Do you want to request a feature or report a bug?
Bug
What did you do?
This is just a report of the question which I posted on the forum and didn't get any possible solution. I think it can be a potential issue in the traefik that's why I am creating this bug report.
Forum: https://community.containo.us/t/rate-limit-blocking-multiple-ips-even-if-the-limit-is-not-reached/7144
So, I was playing with the Rate Limit middleware to figure the best values for it. And, I configured the middleware to look for IP in the X-Forwarded-For header. I just bombarded the server with thousands of requests via BlazeMeter, which has, let say, IP1. And then I was trying to reach the server with my local machine which has IP2. But I was getting 429 most of the time on my local machine. I don't know what I did wrong or if this is the expected behavior.
Server Setup
ALB --> Traefik --> Nodejs

Note: Traefik does receive the user's IP in the X-Forwarded-For header. I pasted the log below.

This thing bugging me for a few days. Any help would be appreciated.
What did you expect to see?
Traefik shouldn't be rate-limiting my local machine as its IP is different from what BlazeMeter has.
What did you see instead?
Traefik rate limit my local machine even if the limit is not reached.
Output of traefik version: (What version of Traefik are you using?)
v2.2.8

What is your environment & configuration (arguments, toml, provider, platform, ...)?
        request-limit:
            rateLimit:
                average: 100
                burst: 50
                period: 1s
                sourceCriterion:
                    requestHost: true
                    ipStrategy:
                        depth: 1

If applicable, please paste the log output in DEBUG level (--log.level=DEBUG switch)
{
    "ClientAddr": "ALB_IP:29864",
    "ClientHost": "CLIENT_IP",
    "ClientPort": "29864",
    "ClientUsername": "-",
    "DownstreamContentSize": 19,
    "DownstreamStatus": 404,
    "Duration": 129795,
    "OriginContentSize": 19,
    "OriginDuration": 15792,
    "OriginStatus": 404,
    "Overhead": 114003,
    "RequestAddr": "example.com",
    "RequestContentSize": 0,
    "RequestCount": 113,
    "RequestHost": "example.com",
    "RequestMethod": "GET",
    "RequestPath": "/api/home",
    "RequestPort": "-",
    "RequestProtocol": "HTTP/1.1",
    "RequestScheme": "https",
    "RetryAttempts": 0,
    "StartLocal": "2020-07-29T13:09:46.926495358Z",
    "StartUTC": "2020-07-29T13:09:46.926495358Z",
    "downstream_Content-Type": "text/plain; charset=utf-8",
    "downstream_X-Content-Type-Options": "nosniff",
    "entryPointName": "websecure",
    "level": "info",
    "msg": "",
    "origin_Content-Type": "text/plain; charset=utf-8",
    "origin_X-Content-Type-Options": "nosniff",
    "request_Accept-Encoding": "gzip",
    "request_Content-Type": "application/json",
    "request_User-Agent": "okhttp/3.8.0",
    "request_X-Forwarded-For": "CLIENT_IP",
    "request_X-Forwarded-Host": "example.com",
    "request_X-Forwarded-Port": "443",
    "request_X-Forwarded-Proto": "https",
    "request_X-Forwarded-Server": "proxy",
    "request_X-Real-Ip": "ALB_IP",
    "time": "2020-07-29T13:09:46Z"
}

Hello @numToStr,
Thanks for your interest in Traefik!
The sourceCriterion strategy could be either the ip or the request host.
If the two strategies are applied in the configuration the middleware is not created.
If you choose to use the ipStrategy, then, in your case, the #1 ip will the client one, your local machine or BlazeMeter IP.
Then, have you checked that both client IPs are different? (for instance if both are behind a NAT, then they have the same IP)

If the two strategies are applied in the configuration the middleware is not created.

I think , in this case, traefik should throw an error or some kind of warning.

If you choose to use the ipStrategy, then, in your case, the #1 ip will the client one, your local machine or BlazeMeter IP.

Later after posting this issue, I also tried with only ipStrategy, but the issue was still there. And yes, both my local machine and Blazemeter had different IPs.

Hello @numToStr,
Have you allowed the ALB IP to the trusted IPs (see the trusted ips section of the documentation) ?
If not, the X-Forwarded-For header would not be accepted by Traefik and therefore the computed key for the source bucket in the rate limit middleware is always empty. That would explain that the identified source is always the same.
WDYT ?

Hi @rtribotte, I have insecure: true in the entrypoints config. I guess this shouldn't be a problem.

I can confirm that i have the following error log when activating both strategies:
ERRO[2020-08-31T13:45:03+02:00] iPStrategy and RequestHost are mutually exclusive  routerName=router@file entryPointName=websecure
Can you provide a full dump of your configuration (dynamic and static) ?

Yeah Sure.
traefik.yml
global:
    checkNewVersion: false
    sendAnonymousUsage: false

accessLog:
    bufferingSize: 100

log:
    format: json

providers:
    docker:
        endpoint: unix:///var/run/docker.sock
        exposedByDefault: false
    file:
        directory: /etc/traefik/providers
entrypoints:
    web:
        http:
            redirections:
                entryPoint:
                    to: websecure
                    scheme: https
                    permanent: true
    websecure:
        address: ":443"
        proxyProtocol:
            insecure: true
        forwardedHeaders:
            insecure: true

tls:
    stores:
        default: {}

file.provider.yml
http:
    middlewares:
        for-container:
            chain:
                middlewares:
                    - compress-it
                    - custom-headers
                    - security-headers
                    - cache-headers
                    - cors-headers
                    - request-limit

        https-only:
            redirectScheme:
                scheme: https
                permanent: true

        compress-it:
            compress: {}

        custom-headers:
            headers:
                customResponseHeaders:
                    Server: milkyway

        security-headers:
            headers:
                frameDeny: true
                contentTypeNosniff: true
                referrerPolicy: no-referrer
                browserXssFilter: true
                stsSeconds: 15552000
                forceSTSHeader: true

        cors-headers:
            headers:
                accessControlAllowCredentials: true
                accessControlAllowHeaders:
                    - Origin
                    - Authorization
                    - Content-Type
                accessControlAllowMethods:
                    - OPTION
                    - GET
                    - POST
                    - PUT
                    - PATCH
                accessControlAllowOriginList:
                    - cricuru.com
                accessControlMaxAge: 100
                addVaryHeader: true

        cache-headers:
            headers:
                customResponseHeaders:
                    Cache-Control: "no-cache, max-age=0"

        request-limit:
            rateLimit:
                average: 1000
                burst: 500
                period: 1m
                sourceCriterion:
                    ipStrategy:
                        depth: 1

        replace-with-api:
            replacePathRegex:
                regex: "^/"
                replacement: "/api"

I am using for-container middleware on my nodejs server.

Hi @numToStr,
I cannot find the error in your configuration, and also after testing it, it works for me.
Can you paste the output of the rawdata endpoint (/api/rawdata) by activating the api --api.insecure  ?

Hi @rtribotte,
Currently, I don't have access to the production server. But I have a similar docker-compose on my local machine. So, here is the output for the same.
{
    "routers": {
        "api@internal": {
            "entryPoints": ["traefik"],
            "service": "api@internal",
            "rule": "PathPrefix(`/api`)",
            "priority":<PHONE_NUMBER>,
            "status": "enabled",
            "using": ["traefik"]
        },
        "backend@docker": {
            "entryPoints": ["web", "websecure"],
            "middlewares": ["for-container@file"],
            "service": "backend-example",
            "rule": "PathPrefix(`/backend`)",
            "status": "enabled",
            "using": ["web", "websecure"]
        },
        "dashboard@internal": {
            "entryPoints": ["traefik"],
            "middlewares": [
                "dashboard_redirect@internal",
                "dashboard_stripprefix@internal"
            ],
            "service": "dashboard@internal",
            "rule": "PathPrefix(`/`)",
            "priority":<PHONE_NUMBER>,
            "status": "enabled",
            "using": ["traefik"]
        },
        "web-to-websecure@internal": {
            "entryPoints": ["web"],
            "middlewares": ["redirect-web-to-websecure@internal"],
            "service": "noop@internal",
            "rule": "HostRegexp(`{host:.+}`)",
            "priority":<PHONE_NUMBER>,
            "status": "enabled",
            "using": ["web"]
        }
    },
    "middlewares": {
        "cache-headers@file": {
            "headers": {
                "customResponseHeaders": {
                    "Cache-Control": "no-cache, max-age=0"
                }
            },
            "status": "enabled"
        },
        "compress-it@file": { "compress": {}, "status": "enabled" },
        "cors-headers@file": {
            "headers": {
                "accessControlAllowCredentials": true,
                "accessControlAllowHeaders": [
                    "Origin",
                    "Authorization",
                    "Content-Type"
                ],
                "accessControlAllowMethods": [
                    "OPTION",
                    "GET",
                    "POST",
                    "PUT",
                    "PATCH"
                ],
                "accessControlAllowOriginList": ["example.com"],
                "accessControlMaxAge": 100,
                "addVaryHeader": true
            },
            "status": "enabled"
        },
        "custom-headers@file": {
            "headers": {
                "customResponseHeaders": {
                    "Server": "milkyway"
                }
            },
            "status": "enabled"
        },
        "dashboard_redirect@internal": {
            "redirectRegex": {
                "regex": "^(http:\\/\\/(\\[[\\w:.]+\\]|[\\w\\._-]+)(:\\d+)?)\\/$",
                "replacement": "${1}/dashboard/",
                "permanent": true
            },
            "status": "enabled",
            "usedBy": ["dashboard@internal"]
        },
        "dashboard_stripprefix@internal": {
            "stripPrefix": { "prefixes": ["/dashboard/", "/dashboard"] },
            "status": "enabled",
            "usedBy": ["dashboard@internal"]
        },
        "for-container@file": {
            "chain": {
                "middlewares": [
                    "compress-it@file",
                    "custom-headers@file",
                    "security-headers@file",
                    "cache-headers@file",
                    "cors-headers@file",
                    "request-limit@file"
                ]
            },
            "status": "enabled",
            "usedBy": ["backend@docker"]
        },
        "https-only@file": {
            "redirectScheme": { "scheme": "https", "permanent": true },
            "status": "enabled"
        },
        "redirect-web-to-websecure@internal": {
            "redirectScheme": {
                "scheme": "https",
                "port": "443",
                "permanent": true
            },
            "status": "enabled",
            "usedBy": ["web-to-websecure@internal"]
        },
        "replace-with-api@file": {
            "replacePathRegex": { "regex": "^/", "replacement": "/api" },
            "status": "enabled"
        },
        "request-limit@file": {
            "rateLimit": {
                "average": 1000,
                "period":<PHONE_NUMBER>0,
                "burst": 500,
                "sourceCriterion": { "ipStrategy": null }
            },
            "status": "enabled"
        },
        "security-headers@file": {
            "headers": {
                "stsSeconds": 15552000,
                "forceSTSHeader": true,
                "frameDeny": true,
                "contentTypeNosniff": true,
                "browserXssFilter": true,
                "referrerPolicy": "no-referrer"
            },
            "status": "enabled"
        }
    },
    "services": {
        "api@internal": { "status": "enabled", "usedBy": ["api@internal"] },
        "backend-example@docker": {
            "loadBalancer": {
                "servers": [{ "url": "http://<IP_ADDRESS>:5000" }],
                "passHostHeader": true
            },
            "status": "enabled",
            "usedBy": ["backend@docker"],
            "serverStatus": { "http://<IP_ADDRESS>:5000": "UP" }
        },
        "dashboard@internal": {
            "status": "enabled",
            "usedBy": ["dashboard@internal"]
        },
        "noop@internal": {
            "status": "enabled",
            "usedBy": ["web-to-websecure@internal"]
        }
    }
}

Hello @numToStr,
We found the problem and can confirm the bug, it's due to a configuration parsing issue that happen with yaml only.
As you can see, the ipStrategy is null in the rawdata you pasted ("sourceCriterion": { "ipStrategy": null }).
We are going to make a fix.
Thanks for your time and contribution to Traefik !

Hi @rtribotte, Thanks for the investigating the issue. Waiting for the new release.
BTW, Traefik is awesome ❤.

@numToStr  Just to let you know, in the mean time, a workaround is to use ipStrategy in lowercase ipstrategy in the yaml.

@rtribotte Thanks for letting me know.

Closed by #7233.


Add workflow support for execution from backend

Updated the code to support workflows in this PR - https://github.com/appsmithorg/appsmith/pull/37063


Making this thing work

So far this library has a pretty good PoC built, but there are a few unsolved problems which will hinder it's functionality in the future.
These are:

Handling the implementation of serial comms with various HALs/platforms.
Asynchronous AT commands that may return responses out of order.

And these are closely tied since the traits we rely on to solve these problems have a big effect on what we end up building.
At this stage I think we should look at what other projects are using to do asynchrony based on the embedded_hal traits. From my brief analysis it looks like we will need to implement some kind of future that can also handle out of order responses from a shared fixed-size buffer under the hood.

Looks like atat is the solution here. It may have some issues relying on embassy_time currently, however we could fork and fix this so it supports rtic_monotonics.


Docker compose to use internal link name

With newest docker-compose it does not create environment variables.
Using name which is mentioned in links option, works.

/close
Seems like this variant is too much used.


Selectors do not select the correct auxiliary fields

Bug report
System info: InfluxDB 1.1.1
Steps to reproduce:
> CREATE DATABASE db0
> use db0
> INSERT cpu a=1,b=1
> INSERT cpu a=2,b=2
> SELECT min(a), b FROM cpu

Expected behavior:
name: cpu
time                    min     b
----                    ---     -
1481688999179364046     1       1

Actual behavior:
name: cpu
time                    min     b
----                    ---     -
1481688999179364046     1       2

Additional info: This is due to the auxiliary fields being reused in the underlying iterator and being overwritten by a later point. We likely need to clone the auxiliary fields when running aggregates.

This will be fixed in 1.2. It was fixed by a combination of merging subqueries in #7646 (which included the fix) and an additional fix that was included in #7854.


v4 upgrade to core-mgmt beta.3, add context to getLroResult

failed test caused by https://github.com/Azure/autorest.testserver/pull/214


[Q] Logging model weights in every epoch

I use artifacts to log model weights. Some of my runs crush (e.g. because they run out of time in SLURM), and I still want to log the last model weights as artifacts. I don't want to have an artifact version per epoch though, as this seems wasteful and some of my runs are really large (>1000 epochs). Is there anyway I can overwrite the model weights after every epoch, and guarantee they get logged to wandb even if my training loop does not finish?
Here are a few things I tried:

Modifying the artifact directly:

# error: cannot modify a logged artifact
with wand.init() as run:
    for e in range(epochs):
        train(model)
        torch.save(model.state_dict(), 'model_latest.pt')
        artifact = wandb.Artifact('model_latest', type='model')
        artifact.add_file(filename, name=filename)
        run.log_artifact(artifact, aliases=['latest-model'])
        if e>0:
             artifact.remove_file(filename, name=filename)
             artifact.add_file(filename, name=filename)
             run.log_artifact(artifact, aliases=['latest-model'])

Using upsert:

# error: upsert requires distributed runs
with wand.init() as run:
    for e in range(epochs):
        train(model)
        torch.save(model.state_dict(), 'model_latest.pt')
        artifact = wandb.Artifact('model_latest', type='model')
        artifact.add_file(filename, name=filename)
        run.upsert_artifact(artifact, aliases=['latest-model'])

Using the API to change the artifact version from a previous version:

# error: artifact does not have attribute 'new_draft()'
with wand.init() as run:
    for e in range(epochs):
        train(model)
        torch.save(model.state_dict(), 'model_latest.pt')
        artifact = wandb.Artifact('model_latest', type='model')
        artifact.add_file(filename, name=filename)
        run.upsert_artifact(artifact, aliases=['latest-model'])
        if e>0:
            client = wandb.Api(project='myproject')
            saved_artifact = client.artifact("my_artifact:latest")
            draft_artifact = saved_artifact.new_draft()
            draft_artifact.remove("modified_file.txt")
            draft_artifact.add_file("modified_file.txt")

Hi @najwalb, thank you for writing in!
To double check: you are interested in being able to override your artifact every single epoch you are logging, instead of creating a new artifact version every single artifact.log?
Alongside, with that, you would like to upload your last artifact to wandb even after your run crashes?

Hi @ArtsiomWB
Yes, this is exactly it. The last point is optional as long as I am able to overwrite the artifacts logged in epochs.

Hey @najwalb - Taking over for Artsiom here. If you're using a specific integration, for example PyTorch/PTL, you can automatically save the best k models within the ModelCheckpoint() callback via the save_top_k argument and modify that callback to include saving this model as an artifact.
Without an integration, you'd like to save a model every time the best one improves, I would recommend introducing some logic like the following into your workflow after each epoch:
Let's say the 'best' model is determined by the highest accuracy for a given epoch, we would have the following steps:

Save your accuracy for each epoch and check to see if the current epoch has the best accuracy (or whichever condition suits your workflow)
If that model has the best accuracy, delete the existing version of the 'best model' saved to wandb
If the current epoch has the best accuracy, save that model as an artifact
Continue iterating until training is finished

In order to delete artifacts programmatically within your workflow, you will need to utilize our API, and you will need the run_id of the current training run, project name, and entity. Here's sample code for how to delete all artifacts of type 'model' - but you can adjust this to your workflow:
api = wandb.Api()
run = api.run("<entity>/<project>/<run_id_of_current_run>")

for artifact in run.logged_artifacts():
    if artifact.type == "dataset":
        artifact.delete(delete_aliases=True)

Please let me know if this helps or if you have other questions!

Hi @najwalb, since we have not heard back from you we are going to close this request. If you would like to re-open the conversation, please let us know!

We are closing this issue due to inactivity. If you feel that it merits additional review, please provide a reproduction and add a comment explaining why. Thank you.


ihop+MPI

Applied a global send receive call, GLOBAL_VEC_SUM_R8 via a temporary array in S/R ExtractSSP.
Restricted ihop to only run on a single processor, which leads to PRTFile and STDERR to only have sensical info on the process used, which is numberOfProcs-1.
Can now run on a single processor with MPI enabled on MITgcm, and checked that it works in an intel compiled serial run.

Credit to @jm-c


NodeJs sample

I am not able to save file using Nodejs sample.
Looking around seems like the sample is not working and require so many fixes.
Is that true? By the way, I am using Windows for now.

I am closing this because I get it work by using this ticket
https://github.com/flowjs/flow.js/pull/235


onDataChanged callback

Discussed in https://github.com/tannerlinsley/react-query/discussions/2911

Originally posted by phatmann November 11, 2021
Calling QueryClient.setQueryData method triggers the onSuccess callback. For many users, including me, this is unexpected behavior, and can be the source of recursion issues, since the onSuccess handler might make calls to setQueryData.
I propose we create a new onDataChanged callback. This would be trigged when cache data is changed via setQueryData or via a fetch.  The onSuccess callback would only be called after a successful fetch.
For completeness, the same onDataChanged callback would be added to QueryCache.

@phatmann let me know if you want to work on this, too :)

talked with @tannerlinsley about this today, and we settled on the following:

onSuccess should only be called when a fetch is made, basically tying it to the promise. This is what most people expect and why this change is breaking.
we're not going to introduce another callback. The observers will be informed anyways when data changes, and it would very likely have to be a side-effect during render in the observer in cases where we never even fire request because we read from the cache, which means we would need to implement it with useEffect in useBaseQuery anyhow. We're going to communicate that the best way to trigger a side-effect is, in fact, a useEffect in user-land. Since data returned from useQuery is stable and structurally shared, you'd just need:

const { data } = useQuery({ queryKey, queryFn })
useEffect(() => mySideEffectHere(data), [data])

This 100% makes sense. Great call.


[Feature] Make API accept multiple domains and ASNs

I'd like to analyze a country, but restrict to a fixed set of domains, and only for some ASes (the top ones).
Existing options are bad:

num_domains queries, fetching all ASes for each domain
num_ases queries, fetching all domains for each AS
num_domains * num_ases queries, fetching each (domain, AS) pair.

The domain SQL filter can be easily changes to a IN operator here:
https://github.com/ooni/api/blob/8aa24669cc0e5aae3b31bd35a2b371ef11a97f77/newapi/ooniapi/measurements.py#L825
Same for the probe_asn filter at https://github.com/ooni/api/blob/8aa24669cc0e5aae3b31bd35a2b371ef11a97f77/newapi/ooniapi/measurements.py#L777

Thanks for requesting this, it is indeed a much needed feature!
Closing this in favour of the existing issue: https://github.com/ooni/backend/issues/584


MockExec (plugin class) => ExecHandleBuilder (internal Gradle class)

Logging of workingDir in projectExec

Even though this uses an internal Gradle class, I think it is a better trade off than the time and risks of re-implementing the class within the plugin.

@confile, @advayDev1 - PTAL

LGTM

lgtm


Column layouts formalization affecting certain pages

We formalized which pages should use a specific column layout and should be adjusted on the current designs.
4 Column Layout: Authentication
(Additionally, these pages have all their content (including title and text) centered in the page.

Sign-in
Register
Forgot Password
Reset Password

6 Column Layout: Singular Action Forms (Forms without a "Cancel" Button)

Report Abuse
Contact Support
Contact Owners
Manage Owners
-Package Listing

8 Column Layout: Forms with Multiple Actions (e.g. Submit + Cancel Buttons)

Upload Package
Edit Package
Account Info

Mock-ups on InVision have been updated to reflect the new column layouts.


Error module on startup QGIS

Hello, I have installed version 0.7 of the RVT plug.
Both in windows 10 and in ubuntu 20.10., Same version of QGIS 3.18.3.
But, while in ubuntu I don't have any error, in windows 10 when loading QGIS a python module error appears and it does not load the plug.
Capture Annex
Couldn't load plugin 'rvt-qgis' due to an error when calling its classFactory() method
ModuleNotFoundError: No module named 'processing_provider.provider'
Traceback (most recent call last):
File "C:/OSGeo4W/apps/qgis/./python\qgis\utils.py", line 335, in startPlugin
plugins[packageName] = package.classFactory(iface)
File "C:/Users/Luca/AppData/Roaming/QGIS/QGIS3\profiles\ULTIMO 3.16/python/plugins\rvt-qgis_init.py", line 35, in classFactory
from .qrvt import QRVT
File "C:/OSGeo4W/apps/qgis/./python\qgis\utils.py", line 799, in _import
mod = _builtin_import(name, globals, locals, fromlist, level)
File "C:/Users/Luca/AppData/Roaming/QGIS/QGIS3\profiles\ULTIMO 3.16/python/plugins\rvt-qgis\qrvt.py", line 65, in
from processing_provider.provider import Provider
File "C:/OSGeo4W/apps/qgis/./python\qgis\utils.py", line 799, in _import
mod = _builtin_import(name, globals, locals, fromlist, level)
ModuleNotFoundError: No module named 'processing_provider.provider'
Python version: 3.9.0 (tags/v3.9.0:9cf6752, Oct  5 2020, 15:34:40) [MSC v.1927 64 bit (AMD64)]
QGIS version: 3.18.3-Zürich Zürich, 735cc85be9
Python Path:
C:/Users/Luca/AppData/Roaming/QGIS/QGIS3\profiles\ULTIMO 3.16/python/plugins\road_slope_calculator
C:/Users/Luca/AppData/Roaming/QGIS/QGIS3\profiles\ULTIMO 3.16/python/plugins\open_lidar_tools
C:/Users/Luca/AppData/Roaming/QGIS/QGIS3\profiles\ULTIMO 3.16/python/plugins\MultiMaps
C:/Users/Luca/AppData/Roaming/QGIS/QGIS3\profiles\ULTIMO 3.16/python/plugins\lftools
C:/Users/Luca/AppData/Roaming/QGIS/QGIS3\profiles\ULTIMO 3.16/python/plugins\LAStools
C:/Users/Luca/AppData/Roaming/QGIS/QGIS3\profiles\ULTIMO 3.16/python/plugins\HTML_Generator-main
C:/Users/Luca/AppData/Roaming/QGIS/QGIS3\profiles\ULTIMO 3.16/python/plugins\clusterpoints
C:/Users/Luca/AppData/Roaming/QGIS/QGIS3\profiles\ULTIMO 3.16/python/plugins\Cadastral_Divisions-main
C:/OSGeo4W/apps/qgis/./python
C:/Users/Luca/AppData/Roaming/QGIS/QGIS3\profiles\ULTIMO 3.16/python
C:/Users/Luca/AppData/Roaming/QGIS/QGIS3\profiles\ULTIMO 3.16/python/plugins
C:/OSGeo4W/apps/qgis/./python/plugins
C:\OSGeo4W\bin\python39.zip

Hi, I can't recreate your bug. To me it seems like there is a missing path to RVT plugin directory (under Python Path). You have 2 installation of QGIS 3.16 and 3.18 as I can see QGIS 3.18 is calling profile paths from QGIS 3.16. There is missing a path like "C:/Users/Luca/AppData/Roaming/QGIS/QGIS3\profiles\ULTIMO 3.16/python/plugins\rvt-qgis" or presumably "C:/OSGeo4W/apps/qgis/./python/plugins\rvt-qgis". Try adding one of the paths to enviroment variables (Oprions, System, Enviroment, Use custom variables, Add Variable "PATH" and under Value one of the paths) or try resinstalling QGIS.

Very thank`s! y chek this!


[Feature][UX study] Add overloads for accepting file input

As per https://github.com/Azure/azure-sdk-for-net/issues/10644#issuecomment-611262968 we won't be doing this.


[Looking for info] Confused about cmgen usage/outputs

Hi !
I'm looking at cmgen provided with Filament, but I'm a bit confused about it usage.
(To clarify the intended use is not for Filament but for another software.)
I was hoping to be able to use cmgen to pre-filter my cubemaps for IBL lighting (radiance notably).
So far I can only output the mip level as individual files using the extract command, I cannot find a way to get a single dds file with all the mips together.
Using:
cmgen -f dds -x ./out cubemap.exr
Is there a way to output a single dds file in cube format that contains all the mip levels ?
Or are we supposed to build that final cubemap file ourselves via another tool ? If so which one ?
The documentation inside BUILDING.md via the section Running the native samples doesn't explain followup steps. Also I saw that the example uses the ktx format, which produce files I cannot inspect (or I don't know tools that allow it). Ideally I would prefer to use DDS in my other software.
Thanks in advance. :)

cmgen doesn't output DDS files, only individual files or combined as KTX. KTX is an open format supported by Khronos: https://www.khronos.org/ktx/

Do you know by any chance a tool that allow to go from KTX to DDS ?
I have tried to find one for a while without any luck.

No idea, we live in a world of GL/Vulkan/Metal, so DDS is not really something we ever worried about/looked into. KTX is easy to handle btw (esp. KTX1, it's essentially a direct memory mapping from GL constants to bytes on disk).

Yeah, after looking around it seems I will have to write something on my own.
Thx for the inputs ! :)


Performance issue

Hi,
I know this is not new, but I would like to know if there are some plans to boost a bit the performance.
On a huge Ram machine, we can have one reasonable engine, but once we put 2 or more, performance degrades a lot.
Don't you think it would be possible to prune massively the sapt to reduce the memory footprint ?
Also, at a given time, how many java process should be running per engine ?
thanks.

Hi @vince62s
A way to reduce both memory space and the translation time is to reduce the search space, by modifying some parameters in the moses.ini file:
$MMT_HOME//engines/$ENGINE/models/decoder/moses.ini
Namely you can halve the default value of
[cube-pruning-pop-limit]
setting it to 500 instead of 1000
and of sample-limit in
SAPT name=Sapt path=${DECODER_PATH}sapt input-factor=0 output-factor=0 sample-limit=1000 lr-func=DM0
setting to 500 instead of 1000
Typically the loss in quality is low (~ 0.1 BLEU point).

I knew about the first one, I always use 400 (does no degradation)
however the second one is new to me: is this at training time or loading / translation time ?

Hi @vince62s
The translation time.
So it could also improve the tuning phase.

I'll try that, thanks.

Hi @vince62s
I would also add another tip: if you're running two engines on the same machine, they are basically competing for the same resources: CPU and RAM - this could lead to performance degradation.
In order to change the number or cores assigned to an engine you can edit the engine.xconf file like so:
<node xsi:schemaLocation="...">
          <engine source-language="..." target-language="...">
                    <decoder threads="6" />
          </engine>
</node>

This way you're saying to the engine that it should use only 8 translation threads. For example if you have a 16 CPU machine, and two engines you could set 6 threads each (why not 8? the process is also doing other stuff beside translating, use all CPU for such task could result in lower translation speed).
As of the RAM, unfortunately we don't have easy solution for that at the moment. We are investigating into pruning techniques, but I am not able to give you any forecasts at the moment.

I think it's more a memory issue than a cpu one. just the fact that all engines are loaded at the same time creates an issue.
Am I right saying that there are 3 java processes per engine , plus one java overall process ?
ie if I run 3 engines , I see 10 java processes ?

Hi @vince62s,
In MMT 0.15 version and above, each engine runs 4 java processes (assuming you are not using your nodes in MMT Clusters):

the MMT itself process
a Zookeeper process
a Kafka process
a Cassandra process

Otherwise, if your nodes are connected in MMT Clusters, you will have as many MMT processes as the number of your nodes, but one single Zookeeper process, one single Kafka process and one single Cassandra process per cluster.

I would like to add another tip before closing this issue. Another speed problem could be the cold start: MMT uses a lot of mmap, this means that the engine is slow just after launch, and it gets faster as soon as it starts translating.
You can "pre-load" the models file in the OS filesystem cache just before starting MMT with this command:
find engines/{engine_name}/models/ -type f -exec dd if={} of=/dev/null bs=1024000 \;

With this expedient, the MMT engine will be at its maximum speed from the very beginning, and also model loading will be lot faster.
I'm closing this issue right now but, as always, if you have any other question please don't hesitate to re-open it!


add Publisher.Settings

This class is used to configure Publisher.
User-visible options are made public.
Options that should be automatically populated,
like user credentials,
are left package-private for now.
Tests for input validation for BundlingSettings
and FlowController are removed.
They should be moved to gax instead.
https://github.com/googleapis/gax-java/issues/168

Changes Unknown when pulling 2beb34efab4e5a45dca90b4d5755bf10000aeccb on pongad:publisher-settings into ** on GoogleCloudPlatform:pubsub-hp**.

Changes Unknown when pulling 95c9d400b21e51c31faf268b7c983e1868e2dd95 on pongad:publisher-settings into ** on GoogleCloudPlatform:pubsub-hp**.

Changes Unknown when pulling 73074a50ae5a521b0f0e6014563f1bf5b3a32243 on pongad:publisher-settings into ** on GoogleCloudPlatform:pubsub-hp**.

Is this obsolete or does it need to be rewritten?

@garrettjonesgoogle Thanks for pointing this out. This is superseded by us deleting all the hand written parts.


revert back to right commit in spirv-cross

reverting commit to the right one rcomended by KhronosGroup

@rafaga it's nice to have CI ;)

@rafaga do you have some conversation with upstream except our ticket that I had filled?

@yurikoles It is good to have CI, and I don't what exactly did you mean with conversation with upstream, can you explain further ?

I mean Khronos Group's MoltrnVK project. Is someone contacted you except public conversation in ticket?
Do you know that Valve (rumors say that they bought MoltrnVK and donated it to Khronos) hired main DXVK developer/author and a lot of mesa3D.contributors.

Nope, nobody has made contact. It is just what is on the ticket.

Do you know that Valve (rumors say that they bought MoltrnVK and donated it to Khronos) hired main DXVK developer/author and a lot of Mesa3D contributors.

I didn't know it, but it makes a lot of sense, Valve has invested a LOT on Vulkan it will be good having a company like Valve pushing resources into projects like this.


fixed footer cuts of bottom row of index page

I can't recreate this. Maybe it's been fixed in a PR?

yep. can't reproduce any more.


Fix reloading of mock-token-metadata-server

Issue Number
ADP-688
Overview
This brings back reloading per request in the mock-token-metadata-server command.

(Tried it.)
bors r+


Modify featured items

This PR removes the redundant :description attribute for home and work page featured items.

Specs are now passing so I'm going to go ahead and merge this.


Cannot work with QT

I run the server in a separate thread,  (uWS::APP* server) this->server->run() will return immediately
When I call (uWS::APP* server) this->server->run() in the main thread of QT,uWebSockets works normally, but QT's GUI is stuck
int listenPort = ui->serverListenPort->value();
std::async(std::launch::async, [this, listenPort]() {

    emit signalServerStarted();

    this->server->listen(listenPort,
        [this, listenPort](us_listen_socket_t* socket) {
            if (socket) {
                socketToken = socket;
                emit signalTextLogOnGui(QString(_T("start listen:%1 ...")).arg(listenPort));
            }
            else {
                emit signalTextLogOnGui(_T("listen erro..."));
            }
        });

        this->server->run();

        return 0;
    });

QT or not is irrelevant. Does it work with multiple threads? Yes, use Loop::defer.
How your particular app is going to implement this, I don't know or care and cannot possibly spend time on.


Https in original link not working, https does

When typing on phone the original url starts with Https. Is it possible to allow a capitalized H in https?

Well, protocols usually are case insensitive, i can edit the https check to include cases in next releases?

building 0.8.8 rn

fixed


Make sure to open Options tab instead of popup

Thanks for the PR @yfdyh000.
Opening the options page in the popup is intentional, as you can make a quick change to your options without losing the current context. The warning to use the Options page on Firefox no longer applies now that some bugs in Firefox have been fixed. The warning should actually be removed. Any chance you can update the PR to only include the change in src/options/General/config.json?

New PR posted.


Fixes

Molten powder recipe
Legendary Turtle perk
obfuscated trophy fish missing things in lore

very pog, please approve


Question: -g missing from -map

Why in the code below is -map '[8out].... the only one with out a -g value? All other ffmpeg commands in the file, following a similar structure, have a -g value for each -map entry.
...

Just a bug :). I'll fix it.
On Fri, Nov 23, 2018, 11:48 AM Aaron Vaage<EMAIL_ADDRESS>wrote:

Why in the code below is -map '[8out].... the only one with out a -g
value? All other ffmpeg commands in the file, following a similar
structure, have a -g value for each -map entry.
...
If the input is 4k then encode with 4k encoding settings
elif [ "${res}" == "2160" ] || [ "${roundedfps}" == "25" ]
then
ffmpeg
-hide_banner
-queue_size<PHONE_NUMBER>
-f decklink
-i "$device"
-filter_complex
"[0:v]format=yuv420p,split=8[1][2][3][4][5][6][7][8];
[1]hwupload_cuda,scale_npp=-1:288:interp_algo=super,hwdownload[1out];
[2]hwupload_cuda,scale_npp=-1:360:interp_algo=super,hwdownload[2out];
[3]hwupload_cuda,scale_npp=-1:432:interp_algo=super,hwdownload[3out];
[4]hwupload_cuda,scale_npp=-1:540:interp_algo=super,hwdownload[4out];
[5]hwupload_cuda,scale_npp=-1:720:interp_algo=super[5out];
[6]hwupload_cuda,scale_npp=-1:1080:interp_algo=super[6out];
[7]hwupload_cuda,scale_npp=-1:1440:interp_algo=super[7out];
[8]null[8out]"
-map '[1out]' -c:v:0 ${x264enc} -g 50 -b:v:0 400k
-map '[2out]' -c:v:1 ${x264enc} -g 50 -b:v:1 800k
-map '[3out]' -c:v:2 ${x264enc} -g 50 -b:v:2 1100k
-map '[4out]' -c:v:3 ${x264enc} -g 50 -b:v:3 2200k
-map '[5out]' -c:v:4 ${nvenc} -g 50 -b:v:4 3300k
-map '[6out]' -c:v:5 ${nvenc} -g 50 -b:v:5 6000k
-map '[7out]' -c:v:6 ${nvenc} -g 50 -b:v:6 12000k
-map '[8out]' -c:v:7 ${nvenc} -b:v:7 20000k
-c:a:0 aac -b:a 128k -map 0:a
${hlsargs}
-var_stream_map "a:0,agroup:teh_audio
v:0,agroup:teh_audio
v:1,agroup:teh_audio
v:2,agroup:teh_audio
v:3,agroup:teh_audio
v:4,agroup:teh_audio
v:5,agroup:teh_audio
v:6,agroup:teh_audio
v:7,agroup:teh_audio"
http://${1}/${vid}_%v.m3u8 >/dev/null 2>~/streamline/logs/encode.log &
...
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/streamlinevideo/streamline/issues/15, or mute the
thread
https://github.com/notifications/unsubscribe-auth/ACdZabW2buMN4PW77eFXr_xwD6S69NMoks5uyFEJgaJpZM4YxEmx
.

Since most of these ffmpeg commands follow the same structure, could I suggest that it be converted to a function so that small issues like this can be avoided? Something like:
descriptive_name() {
    local what_ever_g_really_means=${1}
    // other params....

  ffmpeg -hide_banner ...
}

Doing something like this will make it easier for new readers to understand what all is happening since the high-level descriptions will give us a better idea of "what is happening" without needing to understand the "how it's happpening".

I'm open to changing it however people think it will be the most readable
for people trying to learn. :)
On Fri, Nov 23, 2018, 11:55 AM Aaron Vaage<EMAIL_ADDRESS>wrote:

Since most of these ffmpeg commands follow the same structure, could I
suggest that it be converted to a function so that small issues like this
can be avoided? Something like:
descriptive_name() {
local what_ever_g_really_means=${1}
// other params....
ffmpeg -hide_banner ...
}
Doing something like this will make it easier for new readers to
understand what all is happening since the high-level descriptions will
give us a better idea of "what is happening" without needing to understand
the "how it's happpening".
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/streamlinevideo/streamline/issues/15#issuecomment-441310489,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ACdZaaZ8X2Dd0c6KfXT3w2lCOtLi9JZTks5uyFLLgaJpZM4YxEmx
.

@vaage  I added in the extra -g


⚠ GitLab Server has degraded performance

In 42c2c80, GitLab Server (https://gitlab01.its-telekom.eu) experienced degraded performance:

HTTP code: 200
Response time: 11724 ms

Resolved: GitLab Server performance has improved in ea4d2eb.


Changed version output message to align with style guidelines

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

@salahalsaleh Please review and merge when you get a chance. Thanks!


Add the "annotate file" functionality

[x] Add an additional arg to the cli, --annotate
[x] This option should return the same input file, except that it has annotations at every slice
[ ] For audio inputs, either ignore or figure out something

Implemented for symbolic.

[x] Symbolic annotations
[ ] MIDI annotations
[ ] Audio annotations


proofreading background in korean

Hi.
I just finished proofreading background in Korean version.
Thanks in advance.

Thank you


Patch blobID to ByteBuf for resource leaking purpose

Use touch method to patch blob id to a bytebuf, so when printing out stack trace in resource leak detector, we can see which blob id causes this problem.

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@fa1e27c). Click here to learn what that means.
The diff coverage is 100%.

@@            Coverage Diff            @@
##             master    #1353   +/-   ##
=========================================
  Coverage          ?   72.07%
  Complexity        ?     6616
=========================================
  Files             ?      480
  Lines             ?    37605
  Branches          ?     4755
=========================================
  Hits              ?    27103
  Misses            ?     9228
  Partials          ?     1274

Impacted Files
Coverage Δ
Complexity Δ

...in/java/com.github.ambry/network/ResponseInfo.java
86.36% <100%> (ø)
11 <2> (?)

...java/com.github.ambry.router/GetBlobOperation.java
91.79% <100%> (ø)
39 <2> (?)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update fa1e27c...236cf79. Read the comment docs.


Implement Averages/Mode

Better version of pull request #532, agreed to merge this version over the other.
Closing pull request #532 in favor of this one.


CBZ import doesn't work

Description
Trying to import .cbz file does nothing. It shows a progress bar but actually does nothing.
There is no server log regarding this. Browser log attached.
Version
0.8.2
Steps to Reproduce

Go to search.
Import from file
Browse file
Hit import

Screenshots

Logs
http://x:8080/api/v1/upload
[HTTP/1.1 413 Request Entity Too Large 122ms]

Uncaught (in promise)
Object { stack: "gn@http://x:8080/assets/index-xx6qdHxA.js:9:49037\nOR@http://x:8080/assets/index-xx6qdHxA.js:11:1050\nM@http://x:8080/assets/index-xx6qdHxA.js:11:4249\nEventHandlerNonNull*UR</<@http://x:8080/assets/index-xx6qdHxA.js:11:4321\nUR<@http://x:8080/assets/index-xx6qdHxA.js:11:3225\nEk@http://x:8080/assets/index-xx6qdHxA.js:13:512\nrequest@http://x:8080/assets/index-xx6qdHxA.js:13:4189\nn/<@http://x8080/assets/index-xx6qdHxA.js:13:4646\nHM/<@http://x8080/assets/index-xx6qdHxA.js:9:43770\nuploadCBx@http://x8080/assets/index-xx6qdHxA.js:13:21158\nV@http://x:8080/assets/index-xx6qdHxA.js:67:7478\nxi@http://x:8080/assets/index-xx6qdHxA.js:1:17672\nS1@http://x:8080/assets/index-xx6qdHxA.js:1:17753\nn@http://x:8080/assets/index-xx6qdHxA.js:1:81830\n", message: "Request failed with status code 413", name: "AxiosError", code: "ERR_BAD_REQUEST", config: {…}, request: XMLHttpRequest, response: {…} }

Platform
desktop
Device
PC
Operating System
Windows 10
Browser
Firefox
Additional Context
No response
Code of Conduct

[X] I agree to follow Teemii's Code of Conduct

Hello,
You file is too big to upload; what is the size of it?

About 7MB

I'm going to increase this limit a lot. until now these were default values, which explains the low limit.
I'll certainly push the fix on the develop branch by tomorrow.
Thank you for bringing this to my attention.

fix available in develop branch.