[questions] Recommended way to delete huge number of documents.

What is the most desirable way to delete a huge number of documents?
For example, let's say I want to delete 500K ~ 1000K documents.
Since there are too many documents, I cannot query/delete them using one request.(request is timed out.)
So what I am trying is, first query the number of documents, and send bulk deletion request multiple times with limit parameter.
e.g) If counts are 500K, then calculate the required number of requests, first.
500k / 2000(limit value) = 250   // So I need to send 250 requests to delete documents.

But with this approach, my count query also hung and timed out.
(If _count reduce function has never been called)
So what is the recommended way to delete huge number of documents?

In a case of “this isn’t really what you’re asking for”, I’d recommend to re-think the need for this.

if you want to clean up a database that has lots of docs you want to get rid of, but do it only once, I’d recommend doing a filtered replication of the docs that you want to keep and then delete the old database.
if you want to keep a “current” set of documents in the db, say delete everything older than 30/60/90 days, I’d recommend using a database per $interval.
if you do need to do this regularly, preparing for CouchDB performance getting asymptotically worse. In this scenario, deleting in batches is the way to go.


Add operator anchoring feature

Pull Request Test Coverage Report for Build 541

324 of 324 (100.0%)  changed or added relevant lines in 15 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.01%) to 99.739%

Totals

Change from base Build 531:
0.01%

Covered Lines:
5726

Relevant Lines:
5741

💛  - Coveralls


Remove redundant Equatable conformances in code generation

Motivation
Fixes https://github.com/apple/swift-openapi-generator/issues/210.
Modifications
With this PR. we are removing the explicit Equatable conformance when a type already conforms to Hashable
in generated code.
Result
Generated types now conforms explicitly to Hashable  but not to Equatable.
- public struct Generated: Equatable, Hashable {
  }
+ public sutrct Generated: Hashable {
 }

Test Plan
I have updated the reference ressources used by tests to check generated code.

This looks great, @arthurcro . Could you also audit the runtime library please? 🙏

@swift-server-bot add to allowlist

@czechboy0 Yes, definitely! I actually have the changes ready for the runtime library on a local branch! I'll open a pull request for it today! 🙂


Scheduling cog blocking main thread

The scheduling cog is blocking the main thread, resulting in the bot responding too slow to all interactions. This is also the reason the verification system did not work properly.
I still have to find out what exactly is blocking the main thread.

Instead of refetching the calendar every time we want to update the embed, we should cache a temporary ICS file. And update that file every few hours.
This will significantly reduce the time the update ask takes.
WARNING:asyncio:Executing <Task pending name='discord-ext-tasks: ScheduleModule.check_ical' coro=<Loop._loop() running at /home/mohamed/PycharmProjects/medicus/.venv/lib/python3.13/site-packages/discord/ext/tasks/__init__.py:241> wait_for=<Future pending cb=[Task.task_wakeup()] created at /usr/lib64/python3.13/asyncio/base_events.py:460> created at /usr/lib64/python3.13/asyncio/tasks.py:410> took 0.437 seconds


Improve documentation on writing a custom channel

Inspired by this issue: https://github.com/RasaHQ/rasa/issues/6519
We should improve the custom connector page to make it clearer what your custom channel needs to implement and how to reference it from other things, e.g. channel-specific response variations, the ?output_channel query parameter, etc.

HI any update,regarding the documentation? I am having trouble as a beginner to understand the custom connectors.

FYI ... this has not been resolved - the documentation remains the same, which has caused us to also spend quite some time.
https://rasa.com/docs/rasa/connectors/custom-connectors#the-name-method

@stefanvantchev you can see the diff here: https://github.com/RasaHQ/rasa/pull/7647/files
This is reflected on the current docs.
Not sure what you mean by

the documentation remains the same
?

Well, since this ticket is related (inspired - I like that word) by https://github.com/RasaHQ/rasa/issues/6519 ....
And 6519 specifically talks about: https://github.com/RasaHQ/rasa/issues/6519#issuecomment-689716808
And if you look at the content of the page https://rasa.com/docs/rasa/connectors/custom-connectors/
you will see the python scripts aren't quite updated:
`
from rasa.core.channels.channel import InputChannel
class MyIO(InputChannel):
def name() -> Text:
"""Name of your custom channel."""
return "myio"
`

Ah I see, good catch  - would you like to open a PR to fix it?

It's up to you guys - all I wanted to do is bring it your attention :)


Technology Porting Instructions

Are there directions for adding a new technology to the flow ?

Hey Leo,
With the merging of #104, we've enabled this.
The general idea is, you'd want to replicate the file structure in platforms/sky130A for your PDK.
We only have two hard requirements:

There must be a 1:1 mapping for the cells
The instance names for the cells must be the same as in https://github.com/Cloud-V/DFFRAM/blob/main/platforms/sky130A/sky130_fd_sc_hd/_building_blocks/ram/model.v .

Everything else is either configurable or of no consequence: we don't care about the ports of the cells, for example, and the names of the modules can be defined in https://github.com/Cloud-V/DFFRAM/blob/main/platforms/sky130A/sky130_fd_sc_hd/_building_blocks/ram/config.yml.
If you want to use dffram.py, your PDK must be supported by Open_PDKs, otherwise, you'd have to do some steps manually.
This info should be enough to start but we're planning to provide more thorough documentation in the very near future, god-willing.

Thanks I will look into these instructions and give it a try.

I was wondering if you have any experience with porting to a technology without 1:1 logic mapping. I'm in the process of doing so, and it's mostly just things like not having a particular AND gate with the exact amount of inverted inputs. It's simple enough to manually add in an inverter and write extra code for placeram, but I'm encountering a bigger issue in that yosys is deciding to optimize logic away, resulting in things like entire decoders going away.
For my case, I'm running the 32x32 regfile_2R1W and am only seeing a single DEC5x32 in my synthesized netlist:
UDBLVT20_BUF_S_2 \DEC2.D1.ABUF[0]  (
UDBLVT20_BUF_S_2 \DEC2.D1.ABUF[1]  (
UDBLVT20_BUF_S_2 \DEC2.D1.ABUF[2]  (
UDBLVT20_NR4B_2 \DEC2.D1.AND0  (

So no DEC1 or DEC0 instances. This causes problems later with the d2a function and also placeram accesses the returned array with hardcoded index elements since it expects an array of [2:0].
Do you have any experience with Yosys optimizing logic out? I've tried expanding out the synth command in the yosys script as shown in the documentation:
http://www.clifford.at/yosys/cmd_synth.html
and removing all the opt_* steps, but am running into an issue when it tries to use proc because that's a namespace collision with a tcl command.


Fix README for how to configure the library

The approach used in the readme - with :system- to set the configuration variables doesn't work, it works by removing the tuple and use just strings

I don't think this is correct. I think this would have to be System.get_env("VAR_NAME").


Adding check that a module was defined on the command line before trying to import it

The following commands (from the command line) are broken:
luigi
luigi --help

Entering either of them results in an import error. This patch checks to make sure that a module was specified on the command line before trying to import it. This allows expected behavior to work, and people can use the "--help" option to see the command line.

LGTM

would be nice with a unit test btw

Local tests are passing, and the new unit tests have been added. Passing it upstream to be integrated when you're ready.

Can you just squash the 4 commits into 1?

commits have been squashed

Great! Awesome, thanks! :)


Fix autofocusing for long-lived dialog components

Closes #2397
✅ Pull Request Checklist:

[x] Included link to corresponding React Spectrum GitHub Issue.
[x] Added/updated unit tests and storybook for this change (for new code or code which already has tests).
[x] Filled out test instructions.
[ ] Updated documentation (if it already exists for this component).
[x] Looked at the Accessibility Practices for this feature - Aria Practices

📝 Test Instructions:
The scenario for should focus the overlay on open will fail without this change. For proof, revert
<EMAIL_ADDRESS>and run
$ yarn test packages/@react-aria/dialog

🧢 Your Project:
N/A

I took a look at the regression caused by this, and I'm doubting that the iOS workaround actually does what it's intended - it seems totally at odds with shouldCloseOnBlur. The failing test basically asserts that the tray should close immediately after it's opened!
<EMAIL_ADDRESS>This test seems to be saying "after waiting for the tray to open, it should automatically close due to the iOS workaround". I have a real component implementation resembling ControlledExample, and when I enable shouldCloseOnBlur without defining an autofocusable element, my dialog does indeed close as soon as I open it.

Thanks for opening an issue and suggesting a fix 👍🏻 , we'll have to check on all the versions we support to make sure this isn't needed anymore.

Closing for same reason https://github.com/adobe/react-spectrum/issues/2397#issuecomment-1613951081


Mystery Text Discussion: web.txt

Post your screenshots and discuss your findings about web.txt here!

What ngram sizes give you frequency counts above 5?
When I search for ngrams at a size of 5 and lower I start to get frequencies that are above 5.
What ngram sizes give you frequency counts in the double digits?
I get my first frequency count in the double digits at a size of 4 and it is for one single phrase being "i don t like".
What phrases get repeated a lot in this text?
I think it is super intriguing that the more unique phrases that get repeated a lot in this text pertain to having the word "not" in it one way or another. In order to see this I used an ngram size of 3 to get rid of obvious grams such as "of the" and so on.

It becomes more apparent when I move my size up to a size of 4 ngram. The word or use of "not" is apparent in the top 5 of size 4 ngram as well. My first thought after all this with regards to the text is that the author has a good chunk of negative thoughts to understanding of ideas or situations. It also shows that there seems to be a ton of disagreements or rejections within the text.

I decided to move into KWIC for the 3 size ngram of "i don t" to see how the author is using the ngram throughout the text and these are the results I have found. It is apparent that the phrase "I don't like" is here which was the most frequent ngram for a size of 4 but now we can see more. Phrases like "I don't think", "I don't care", "I don't want" are apparent frequently which seems to support the justification of the negative monotone that is being represented through the text by the author with this frequent phrase use.

The last tool I used was voyant and I was just curious what the word map was gonna show me for results within this text. Main characters like "heathcliff" and "catherine" were the most commonly used words which let me know these are likely the two people the story may revolve around. I then did some digging on the internet and I believe I found that this text is from Wuthering Heights which is a novel from 1847. Overall, this conclusion really intrigued me as my guess is that back then, negative tones were more apparent in those time periods compared to now when it comes to writing.

What ngram sizes give you frequency counts above 5?
N-grams from 1 to 5 yield results

What ngram sizes give you frequency counts in the double digits?
Sizes 1-4

What phrases get repeated a lot in this text?
“I don’t”
“I can’t”
“I could not”
“Of the”
Whether they are contractions or fully written forms, they tend to have “not” in them, which I was surprised about how often they come up.

Choose some ngram clusters of interest and explore them in their KWIC (Keyword in Context) view to scope the words before and after.
After “I could not,” the most common thing to come ofter was the word “help.” So commonly it would show up at “I could not help.”

Voyant word map


[EventRequest] Report 99001020 "Carry Out Action Msg. - Plan."

Please transfer global variables from option to extensible enum:

ProdOrderChoice
PurchOrderChoice
TransOrderChoice

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. Please do not reply to this, as we do not monitor closed issues. If you have follow-up questions or requests, please create a new issue where you reference this one.


PHPORM-186 GridFS adapter for Filesystem

Fix PHPORM-186
Integration of Flysystem GridFS Adapter for Laravel File Storage.
The configuration is similar to the Symfony Flysystem Bundle as it provides various way to configure the bucket:

using the database connection (default connection by default)
setting a service name for the bucket instance
setting a factory function for the bucket instance

Unlike the Symfony Bundle, I do not provide instantiation of a new MongoDB\Client from the configuration as we always have a database connection with Eloquent.
Checklist

[x] Add tests and ensure they pass
[x] Add an entry to the CHANGELOG.md file
[x] Update documentation for new features

LGTM with some comments!

I applied your suggested changes in a new PR: https://github.com/mongodb/laravel-mongodb/pull/2993


Bazel test flake: "No address added out of total 1 resolved" from different tests under TSAN

exec ${PAGER:-/usr/bin/less} "$0" || exit 1

export GRPC_POLL_STRATEGY=poll-cv
shift
test/cpp/end2end/grpclb_end2end_test
[==========] Running 15 tests from 4 test cases.
[----------] Global test environment set-up.
[----------] 8 tests from SingleBalancerTest
[ RUN      ] SingleBalancerTest.Vanilla
[       OK ] SingleBalancerTest.Vanilla (110 ms)
[ RUN      ] SingleBalancerTest.InitiallyEmptyServerlist
[       OK ] SingleBalancerTest.InitiallyEmptyServerlist (2508 ms)
[ RUN      ] SingleBalancerTest.Fallback
[       OK ] SingleBalancerTest.Fallback (2511 ms)
[ RUN      ] SingleBalancerTest.FallbackUpdate
[       OK ] SingleBalancerTest.FallbackUpdate (2510 ms)
[ RUN      ] SingleBalancerTest.BackendsRestart
[       OK ] SingleBalancerTest.BackendsRestart (101 ms)
[ RUN      ] SingleBalancerTest.Drop
[       OK ] SingleBalancerTest.Drop (108 ms)
[ RUN      ] SingleBalancerTest.DropAllFirst
[       OK ] SingleBalancerTest.DropAllFirst (5 ms)
[ RUN      ] SingleBalancerTest.DropAll
[       OK ] SingleBalancerTest.DropAll (1006 ms)
[----------] 8 tests from SingleBalancerTest (8860 ms total)

[----------] 4 tests from UpdatesTest
[ RUN      ] UpdatesTest.UpdateBalancers
[       OK ] UpdatesTest.UpdateBalancers (1033 ms)
[ RUN      ] UpdatesTest.UpdateBalancersRepeated
[       OK ] UpdatesTest.UpdateBalancersRepeated (20010 ms)
[ RUN      ] UpdatesTest.UpdateBalancersDeadUpdate
[       OK ] UpdatesTest.UpdateBalancersDeadUpdate (19 ms)
[ RUN      ] UpdatesTest.ReresolveDeadBackend
E0223 17:51:44.780329540     537 server_chttp2.cc:38]        {"created":"@1519408304.780288830","description":"No address added out of total 1 resolved","file":"src/core/ext/transport/chttp2/server/chttp2_server.cc","file_line":305,"referenced_errors":[{"created":"@1519408304.780267300","description":"Unable to configure socket","fd":7,"file":"src/core/lib/iomgr/tcp_server_utils_posix_common.cc","file_line":202,"referenced_errors":[{"created":"@1519408304.780257312","description":"OS Error","errno":98,"file":"src/core/lib/iomgr/tcp_server_utils_posix_common.cc","file_line":175,"os_error":"Address already in use","syscall":"bind"}]}]}
https://source.cloud.google.com/results/invocations/cba16487-ec5e-4c8b-b07d-d9074f21f518/targets/%2F%2Ftest%2Fcpp%2Fend2end:grpclb_end2end_test@poller%3Dpoll-cv/log

Another failure from a different test with the same error:
https://source.cloud.google.com/results/invocations/45571f80-62f2-4e33-a601-03975b652456/targets/%2F%2Ftest%2Fcore%2Fend2end:h2_proxy_test@invoke_large_request@poller%3Depoll1/log

Hi David, I'm assigning it to you for triage. Feel free to reassign when you identify a proper owner.

A similar flake in dbg build with end2end_test:
https://source.cloud.google.com/results/invocations/583ce710-21f9-487e-aef1-55540d47dd9d/targets/%2F%2Ftest%2Fcpp%2Fend2end:end2end_test@poller%3Depoll1/log

Similar: https://source.cloud.google.com/results/invocations/74c64bc2-8983-4e21-b450-c3b261729ba9/targets/%2F%2Ftest%2Fcore%2Fbad_ssl:bad_ssl_alpn_test@poller%3Depollex/log


Fix misprint in smart wait log message

Fix misprint in smart wait log message -
[SmartWait] Locating //*['test'] in undefined

Thanks.
Btw, how do you find smart waits?

@DavertMik I use my fork as dependency in my tests in order to get bugfixes earlier. So I read git log after update my fork to get know what is new :)


Implement WcfWebHttpServiceToSwaggerGenerator: Swagger generator for WCF WEB HTTP Service

Hi Gus,
i have a REST API developed in c# WCF service and working good. I would like to use Nswag to generate yaml files. But using NSwag Studio or AssemblyTypeToSwaggerGenerator, i got no operations.
How can i get them?
Am i using wrong approach?
Regards
Daniele

Only Web API web services are supported. I think you cannot describe a SOAP web service with the Swagger spec...

I'm not speaking about a soap service. i'm speaking about a REST API implemented with WCF technology.. i think stupid to have to migrate to web api only for doc same methods :-(

Are you talking about this service model: https://msdn.microsoft.com/en-us/library/bb412172(v=vs.110).aspx ?
The rules and attributes are completely different than Web APIs and thus a new Swagger generator has to be implemented...
Therefore it is not supported and the feature is not planned at the moment... You can implement this yourself but it will be not that simple.

Yes, i moved project to WebAPi

Ok, i think we should close this issue... I think the user base for this feature is too small...

@RSuter I'm looking into implementing WcfRestWebServiceToSwaggerGenerator. Please let me know if there are any updates since your last comments.

@pouladpld Still the same, I do not plan to support it. Is it really worth the effort considering the user base?

Any progress on this? I have a WCF net48 site, that's using swaggerwcf to produce a swagger ui, but I'd like to automate a TypeScript client build process using Roslyn during build


Wham emits DEL/DUP calls with SVLEN=0

These appear to be misclassified insertions, and at least some of them are called as INS by manta. Evaluations need to be done on some different solutions:

Upgrading wham (currently 1.7.0)
Converting these calls to INS
Filtering these calls

In addition, these sites are not clustered properly in Module 01.

Addressed in #346


FFIG could use a developers guide

Feature Request
Add a developers guide
Summary
Good documentation makes a system easier to pick up for users.  I proposed a developers guide to FFIG would be a useful starting point.
Requirements
This should tell users what FFIG is, how it works, how to use FFIG and how to extend FFIG.
Non-requirements
Additional information

This is an awesome idea. I'm far too deep into FFIG to know where to start writing this now.
Would you, @Twon, be willing to take a shot?

Branch code (.md) looks great.
High level documentation like this is pure gold and we need more of it. I’m really bad at doing it but am glad I left breadcrumbs enough in place for you to piece things together.


I would reccomend simplifying the buy.js code

There is a method of doing this that avoids a massive string of if statements. Will look for it and post it here

Sure, take your time! Don't forget to test everything please! :smile:


Add RISCV support to GetProgramCounter()

Identify PC register from signal context
Signed-off-by: Khem Raj<EMAIL_ADDRESS>

Thanks


Catch any unknown errors.

:tada: Thank you for contributing to ShnooTalk! :tada:
Can you change the error message from "An unknown error has occurred" to "An unknown error or an internal compiler error has occurred"?

You bet :)


[Feature] Descriptions for Visualizer

Bug or feature request?
Feature Request
Description:
In GraphQL you can add comments to your nodes.
"""
A wonderful, sugary, delicious treat. Can be eaten like an ice cream cone, if you're brave.
"""
type CupCake {
  flavor: String!
  hasFrosting: Boolean!
}

This makes the automatically generated documentation incredibly useful. I'd like to be able to do this with the visualizer. I have a case where I need to represent a setting on a UI component where, sometimes, the evaluation of some set of criteria is important, and other times, the only the criteria themselves are important.
Currently, I'm trying to do this with such fabulous state node names as:
subtractMadeSelectionsFromSelectableOptions
uniqueWhatsInSelections
[others far worse which never made it into git and I forgot]

This is kind of nuanced, and by the time you need to care about it, you'll know what it is. But being able to add a simple description would be fantastic, especially when sharing with non-technical stakeholders/new devs. So being able to specify a description would let people "oh yeah, that's what  that is" to a shorter name. (Say,  "uniqueEvaluatedWhats")
(Feature) Potential implementation:

What the API would look like
When declaring a state node, you can optionally attach a description property

public description?: string;

Which, when present, will cause some kind of affordance to appear inside the visualizer where people can get more info.
Not prescribing this as the actual ux, but solely as an example of what I'm talking about, a blue i icon in a bubble shows up on the state node name. then, when we hover over it, a small popover with the specified description appears.

If that could happen, the discoverability/understand-ability of increases a large amount.

If this is a breaking change
Additive, so probably not?

If this is part of the existing SCXML specification
I don't think it's in there. This is quite possibly going outside the spec.

Longer term, I'd like to be able to use the visualizer as a part of our documentation. That'd be sweet! 🤗

So funny enough, instead of ~description~, there already exists a property exactly for this: the .meta property 📖, and I think it'd be pretty easy to surface this in the visualizer.


Effective ways on running Ruby code from within C without leaking Proc objects?

Short summary
mrb_load_string, related functions and the typical run mruby code from C patterns create an RProc object on every call which is never marked for GC. There's an easy reproduction case with a simple C program
#include "stdio.h"
#include "ext/mruby.h"
#include "ext/mruby/compile.h"
#include "ext/mruby/gc.h"

int main() {
    mrb_state *mrb = mrb_open();
    for(int i = 0; i < 100000; ++i) {
        mrb_load_string(mrb, "nil");
        if(i % 100 == 0) {
            printf("%zi\n", mrb->gc.live);
        }
    }

    return 0;
}

Longer explanation
I'm working on embedding mruby in a GUI. The C portion of program sets up all the initial rendering, then passes control to the mruby VM, then renders the frame after the VM finishes. I call the ruby VM exactly once each frame from C with one entry point. My main program loop looks roughly like
while(!done) {
  setup_frame();
  mrb_load_string(mrb, "World.render");
  render_frame();
}

And this works wonderfully! The fast C code path does the intensive graphics calculations and rendering, and I have one entry point which kicks off processing the VM every 'tick' with World.render Leaving out a lot of unnecessary surrounding context here to get at the heart of the matter.
After being so happy for a couple days on how easy this was going I left my program overnight, coming back the program taking up multiple gigabytes of memory where it usually only takes a few hundred kb. Tell tale memory leak of some kind. I did a lot of digging within my own C code as that's the most likely answer and came up with nothing.
Looking at the live object count every frame I noticed the live object count never decreases. I started digging in the Ruby code thinking I created object islands and came up with nothing. Finally I changed my loop to do  mrb_load_string(mrb, "nil"); and much to my surprise the object count increased linearly infinitely just as before when the mruby VM shouldn't do anything at all!
Digging some more into ObjectSpace while simply calling nil every frame I found that T_PROC objects grow indefinitely. After a few minutes of running
{:TOTAL=>73728,
:FREE=>206,
:T_OBJECT=>2,
:T_CLASS=>59,
:T_MODULE=>10,
:T_ICLASS=>14,
:T_SCLASS=>75,
:T_PROC=>73285,
:T_ARRAY=>2,
:T_HASH=>2,
:T_STRING=>23,
:T_EXCEPTION=>2,
:T_ENV=>44,
:T_DATA=>3, 23=>1}

Looking at the definition of mrb_load_string and others related it it's usually the same sequence of function calls: creating a new parser context, parsing the string, generating a proc object, run the code in the vm, free the parser and context. I replicated this replacing mrb_load_string in my loop
mrbc_context* ctx = mrbc_context_new(state->ruby_state);
mrb_parser_state *parser = mrb_parse_string(state->ruby_state, "World.render", ctx);
RProc *proc = mrb_generate_code(state->ruby_state, parser);
mrb_value retval = mrb_vm_run(state->ruby_state, proc, mrb_top_self(state->ruby_state), 0);

mrb_pool_close(parser->pool);
mrbc_context_free(state->ruby_state, ctx);

And realized there are the infinitely growing Proc objects created. Digging through old issues I had the idea of calling mrb_gc_arena_save/mrb_gc_arena_restore before and after the loop... and this works! The object count stabilizes over time. Hurray, problem solved!
However I'm not completely satisfied. Going back to the old 'principle of least surprise' I found it highly surprising that the typical patterns used in functions like mrb_load_string leak objects.
Some questions

It feels like a mistake that functions like mrb_load_string and it's relatives leak Proc objects on every call. Should we do a gc save/restore within these functions?
Is there a better way to invoke a Ruby method from C without creating a new RProc object?
Alternately, is there a way we could mark the RProc used for execution as black immediately after running it in the VM so it becomes GC'd next cycle? This feels like it's crossing too many boundaries however.

It should be GCed. I will investigate.

Wrap your mrb_load_string() by mrb_gc_arena_save() and mrb_gc_arena_restore),  i.e.
        mrb_int ai = mrb_gc_arena_save(mrb);
        mrb_load_string(mrb, "nil");
        mrb_gc_arena_restore(mrb, ai);

By doing this, you can clear the GC protection from the internally generated proc object.
First I thought this arena manipulation should be done in mrb_load_string() but it could cause another GC bug. So please add the arena save/restore to your code. Thank you.

Thank you! Do you feel it's helpful adding comments in the header file explaining the object leak behavior when using related functions?

Yes! PR will be very helpful.


Dark mode toggle is not reachable with keyboard navigation

Description

The toggle button in the header is unreachable with the tab key when navigating by keyboard. It should be possible to reach it and activate it just by tabbing through the site.
Screenshots
No response
Additional information
No response

Hey, @EmmaDawsonDev I want to work on this issue

Hey, @EmmaDawsonDev PR done take a look at that.

The new version of LinkFree is out, I will close this issue, feel free to create a new issue for the new version if still relevant


⚠ Bofrost.es has degraded performance

In 6dac8a5, Bofrost.es (https://www.bofrost.es) experienced degraded performance:

HTTP code: 200
Response time: 1490 ms

Resolved: Bofrost.es performance has improved in 50fe1b9 after 10 minutes.


About reproducing MAE with ViT-S

I notice that you reproduce the result of MAE with ViT-S by using official codes, but there is no decoder design in the official codes.
I wonder that how many layers you use in decoder of ViT-S, also decoder_dim and num_head?

We're using patch_size=16, embed_dim=384, depth=12, num_heads=6, decoder_embed_dim=256, decoder_depth=8, decoder_num_heads=8, mlp_ratio=4.

clearly, thx.

What's about the pre-train script and fine-tune script?
and I guess that the result of ViT-S is produced by the original code, just changed training scripts. Am I right?
Can I use your scripts to reproduce the result of ViT-S?

@LinB203 Yes you should use mae's official code.

Yes, we just modify the architecture.


Fix issue for pandera allowing generic Series to work

[x] Closes #471
[x] Tests added:

test_series.py:test_pandera_generic()

Fix here is to expand the Series[IntervalT].__new__() into each individual part.  Seems like a double TypeVar causes issues for mypy.  Had to do a similar fix for Interval.__contains__()
Either @twoertwein or @bashtage can approve or merge (both not required)

Thanks @Dr-Irv !


Add feature: Automated scale changes

Eg. automatic change each hour

See https://codepen.io/jakealbaugh/full/qNrZyw/


Feature Request: make a specific replication job unstoppable by the scheduler

As a companion to Feature Request #1714 , another very useful toggle would be a property in the Replication DOC to force a specific replication job to avoid being paused by replication scheduler.
In our scenario we have a "main" replication Job that keeps a central machine aligned with the server with all the users db, what we'd like to obtain is defining the main replication job as "unstoppable" while having N-replication jobs for users DBs handled by the replication scheduler.
I think that could be implemented in a fairly easy way by setting a property that would instruct the  rotate_jobs() + longest_running function to ignore a replication task.
(I see there already are a few ideas close to this one: #1412, #1257...)

(note: obviously I can setup the main replication as a push replication from the central server to the users db one to work around current behaviour, I know that, but the basic feature request remain...)

Another way to set this up is to make the replication a normal (non-continuous) replication. Normal replications have priority and unless an operator explicitly dials down max_jobs parameter or restarts a replication node (server).
The reason for this behavior is that traditionally (before the scheduling replicator was created) a normal replication replicates a snapshot of the database at particular time. So say you replicate from source S to target T. Then after the replication starts, you add a document do S. That document won't appear in T if replication is normal. If replication is continuous then it will.
So basically if you have a bunch of continuous replications but want to make one replication unstoppable, have your user code periodically create normal replications from source to target. Monitor when the replication finishes and re-create it.
In some cases it might even be helpful to use the _replicate endpoint which doesn't involve creating a replication document, which is ok if you create it and monitor it programmatically.

You're right but when you start a new full replication the whole db has to be scanned for already present and updated docs, when a DB has many documents that would be an huge overkill. The proposal work-around this issue by keeping the sequence number at hand.
Furthermore the whole point is to keep the "master" replication flowing in a near-realtime-fashion, if I have to restart it every, let's say, 10 minutes then the currently stop-and-start by the scheduler it's already enough.

@nickva I think the new Fair Share replicator feature allows for this capability?

Create an always-running/_replicator DB
Load replication docs for high priority jobs into this DB instead of the main one
Ensure [replicator.shares] allocates enough shares to prioritize the always-running jobs

The last step is probably not required if the number of jobs in that priority DB is small, as the algorithm will default to sharing resources fairly at the level of the replicator DBs.
I suppose it's not a hard guarantee that the priority jobs will always be running, but does it effectively deliver the same outcome?

@kocolosk that would work, yeah. Can set a high number of shares (1000 max) for _replicator/always-running and those jobs should get a high priority to always run in front of jobs from say _replicator or _replicator/user-jobs. To lower the chance even more for other dbs running, can explicitly grant them the minimum  - 1 share
We could also add a small enhancement to completely disable some replication db (assign them 0 shares, I think now 1 is the minimum) that would guarantee that they never get picked.
I am inclined to close this for now as fixed and if after evaluating the new Fair Share is not adequate, to re-open it.


feat: support create table from select api

This PR adds api support for create table from select.
for instance
cursor.query("CREATE TABLE transcript AS SELECT SpeechRecognizer(audio) FROM video").execute()
can be written as
select_rel = cursor.table("video").select("SpeechRecognizer(audio)")
cursor.create_table("transcript", query=select_rel).execute()

This was resolved in #1125


Create Forum functionality on secondary pages

As a User
I want to Be able to post my insights on plants
So that other peoples plants survive
Acceptance criteria:

Implement forum functionality on the 2 secondary pages that link to the main page
Users should be able to make posts to the page
Other users should be able to view those posts

Switched to forum modeled storage of local data as posts


Rendering bug in API doc

The docstrings in the API docs, e.g.
https://empymod.readthedocs.io/en/stable/modeller.html#empymod.model.bipole
are erroneously rendered, probably due to some sphinx (or sphinxcontrib) upgrade so that the type is merged to the variable names:

Thanks @halbmy for reporting, indeed!
I'll have to figure out what the reason is. v2.0.2 seems still to be fine (https://empymod.readthedocs.io/en/v2.0.2), after that it has this error.
It was a long-standing issue with the numpydoc theme and sphinx versions, but I thought it was resolved... oh well.

Thanks @halbmy for reporting, indeed!
I'll have to figure out what the reason is. v2.0.2 seems still to be fine (https://empymod.readthedocs.io/en/v2.0.2), after that it has this error.
It was a long-standing issue with the numpydoc theme and sphinx versions, but I thought it was resolved... oh well.

Hm. Locally I don't have it, and on emg3d.readthedocs.io it isn't an issue either, strange.

Hm. Locally I don't have it, and on emg3d.readthedocs.io it isn't an issue either, strange.

https://github.com/numpy/numpydoc/issues/215

https://github.com/numpy/numpydoc/issues/215

This will be fixed by #116
I have to force RTD to install sphinx_rtd_theme>=0.5.0. I don't know why RTD uses such outdated versions by default (e.g., sphinx<2.
I should probably move to create the docs with CI and host on the own website instead of RTD... One day in the future.
Thanks again @halbmy !

This will be fixed by #116
I have to force RTD to install sphinx_rtd_theme>=0.5.0. I don't know why RTD uses such outdated versions by default (e.g., sphinx<2.
I should probably move to create the docs with CI and host on the own website instead of RTD... One day in the future.
Thanks again @halbmy !

It will not fix stable, as this is a release, but latest (and the next stable, whenever that will happen...):
https://empymod.readthedocs.io/en/latest/modeller.html#empymod.model.bipole

It will not fix stable, as this is a release, but latest (and the next stable, whenever that will happen...):
https://empymod.readthedocs.io/en/latest/modeller.html#empymod.model.bipole


Sysnc Forked Repo #2

Update-2

Noetic ?

Hi, why did you create this PR?

Hi
I tried to update my forked repo. I guess I did it by mistake.
Vojtech Spurny @.***>, 23 Nis 2021 Cum, 17:44 tarihinde
şunu yazdı:

Hi, why did you create this PR?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/ctu-mrs/mrs_uav_system/pull/59#issuecomment-825707559,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AB3LBQS6ADDC6E5S5BUYTO3TKGBUBANCNFSM43IOSU3A
.

--
Saygılarımla
Regards
Mehmet Yıldız
*Y. Mekatronik MühendisiMSc. Mechatronics *Engineer

Ok, no worries. :) In that case, I will close the PR.


Classification weak learners should allow more than one input feature

Hi team,
I decided to give Refinery a try with a classification problem where there are more than one input features, and the idea is to classify their combination into a few categories.
To give an example of a similar problem, imagine an oxymoron classification task with 2 input features: word_a and word_b, and a binary class output: is_oxymoron and not_oxymoron.
The problem I have is that the two features or their embeddings are useless in isolation, it's their interaction that counts. But in all weak learner possibilities, I apparently must choose feature a or feature b, I can't use both. Am I misunderstanding something? This could be something I don't understand in the UI.
Also, I would expect to be able to transform the input data with my own functions and use that as input as well; although not ideal, this could be used to work around the limitation of one input feature per learner.
Otherwise, it looks good and the UI is rather well-organised.

Hi @agravier,
thank you for reaching out to us and your feedback. You are right, both options (1. multi-attribute embeddings & 2. "calculated" columns) aren't part of our current UI. Calculated columns are on our roadmap for 2022.

Hi! That point is 100% valid, and we thought about it too. We're thinking about the following, and I'd be curious what you think about it:

currently, you have one programming interface, i.e. in the heuristics sections
in the near future (Q4), you'll be able to have a programming interface similar to that to write computed attributes, e.g.

def word_a_cat_word_b(record):
    return str(record["word_a"]) + str(record["word_b"])

also, we're continuing our work on our embedder library. Here, again we want to provide a programmatic interface that provides similar to the active learning templates, but with which you can compute your very own customized (and finetuned) embeddings, e.g.

from embedders.classification.contextual import TransformerSentenceEmbedder
def classification_word_a_cat_word_b_distilbert(record):
    embedder = TransformerSentenceEmbedder("distilbert-base-cased")
    return embedder.fit_transform(record["word_a_cat_word_b"], record["is_oxymoron"])

of course, not 100% sure about the exact interface here, but that is the general idea.
And thanks for trying out refinery, means a lot! :)

Thanks for getting back to me @JWittmeyer and @jhoetter. Sound good, as long as the UX is there to make all this clear. Another couple of things that you may want to consider, from my trial: tabular data export (not that JSON is horrible, but the thing lends itself to a tabular format) and "partially annotated input reconciliation", when one of the columns of the imported data already contains some labels. Obviously this raises some more questions that could be presented to the user about what to do with this data, like assign it to which annotator, etc.

I'll revisit in a few months, all the best, cheers!

Thanks for the input @agravier. We already have a format to upload existing data (https://docs.kern.ai/docs/project-creation-and-data-upload#uploading-existing-labeled-data), but I agree that this requires UX improvement. We'll work on this, and I'd be happy to have your feedback again when that's implemented :)

This will be first solves by implementing #40. You'll be able to modify any attributes, in that case have e.g. a concatenation of word_a and word_b (similar to this):
def word_a_cat_word_b(record):
    return str(record["word_a"]) + str(record["word_b"])

Afterward, you can apply encoding to this attribute.
We'll ultimately provide an extensive interface to program embeddings, but that is a bit further down the road :)

@agravier This is solved with the release of version 1.3.0. You can now do attribute modifications, which allow you to then create exactly the embeddings you like. Let us know what you think :)

Thanks for the heads up @jhoetter , I'll give it a try at the next occasion. Cheers


Composite partition key

For my table I wanted to have a composite partition key (hashkey+rangekey).
I saw that in the documentation with a composite partition key, we could have multiple documents with the same hashkey but the value of the sortkey had to be different, so that the combination of the 2 values make a unique identifier.
However, it is not working in my table, because the documents are replacing each others when I save them even though my rangeKey values are differents.
Does someone has an idea of how this can be achieve, or I am missing something ?
This is the code for my schema :
const roomSchema = new dynamoose.Schema({
  roomId: {
    type: String,
    hashKey: true,
  },
  userId: {
    type: String,
    rangeKey: true,
  },
  targetUserId: {
    type: String,
    required: true,
  }})

So I am instantiating a simple table with a haskey and rangekey attributes. Then to insert the new room document I am using this code :

const room = new Room({
  roomId,
  userId,
  targetUserId,
  lastMessage,
});
const roomTarget = new Room({
  roomId,
  userId: targetUserId,
  targetUserId: userId,
  lastMessage,
});
const resRoom = await room.save();
const resTarget = await roomTarget.save();

Thanks,

The error was resolved. The table wasn't instantiated correctly from the start so the rangeKey was not declared. Consequently, it behaves as if there was only a partition key.
I deleted the table and recreated it, now it is working


Mapping with reference fails when using ore than one db (>= 0.110)

If you fetch one and the same object from your DB with Morphia (e.g. an user), but fetch a user from a different DB (different dbName, different Datastore) meanwhile, the mapping of references fails. Assume that all need objects do exist in the db(s).
The error goes like:
ERROR [2015-04-22 11:45:28,244] io.dropwizard.jersey.errors.LoggingExceptionMapper: Error handling a request: {id}}
! org.mongodb.morphia.mapping.MappingException: The reference({ "$ref" : "commAddresses", "$id" : "{valid id}" }) could not be fetched for com.greylogix.smartgy.essentials.entities.User.commAddresses
! at org.mongodb.morphia.mapping.ReferenceMapper.resolveObject(ReferenceMapper.java:332) ~[{our-service}-1.33.1.jar:1.33.1]
! at org.mongodb.morphia.mapping.ReferenceMapper$1.eval(ReferenceMapper.java:260) ~[{our-service}-1.33.1.jar:1.33.1]
! at org.mongodb.morphia.utils.IterHelper.loopOrSingle(IterHelper.java:70) ~[{our-service}-1.33.1.jar:1.33.1]
! at org.mongodb.morphia.mapping.ReferenceMapper.readCollection(ReferenceMapper.java:257) ~[{our-service}-1.33.1.jar:1.33.1]
! at org.mongodb.morphia.mapping.ReferenceMapper.fromDBObject(ReferenceMapper.java:174) ~[{our-service}-1.33.1.jar:1.33.1]
! at org.mongodb.morphia.mapping.Mapper.readMappedField(Mapper.java:608) ~[{our-service}-1.33.1.jar:1.33.1]
! at org.mongodb.morphia.mapping.Mapper.fromDb(Mapper.java:585) ~[{our-service}-1.33.1.jar:1.33.1]
! ... 70 common frames omitted
!

I just can guess: is might be a caching issue in resolveObject or in a connected method. This works with Morphia 0.109 but not with 0.110 or higher.
Java code snippet:
/*
 * We have a config db and customer dbs. Therefore we use different datastores.
 * First we look for a user in the config db, then we try to fetch the user object from our
 * customer db. The name of the customer db is stored in the user object of the config db.
 * This construction might not be ideally, but it usually works. But when you try to fetch users from
 * different customer dbs, the mapping of some references in this very user object fails.
 */
Datastore datastoreConfig = morphiaDatastoreManager.getDatastoreConfig();
Query<PortalUserIdentifier> identifyQuery = datastoreConfig.createQuery(PortalUserIdentifier.class);
identifyQuery.filter(PortalUserIdentifier.FIELD_EMAIL, user.getEmail());
PortalUserIdentifier storedIdentifier = identifyQuery.get();

    if (storedIdentifier != null) {
        User storedUser;
        String tenantId = storedIdentifier.getTenant(); //name of the customer db
        Datastore dsTenant = morphiaDatastoreManager.getDatastore(tenantId);

       storedUser = dsTenant.find(User.class, PortalUserIdentifier.FIELD_EMAIL, user.getEmail()).get(); //here it breaks!
      // and so on ...

This was fixed with #230.  You can try with a -SNAPSHOT dependency or build morphia locally if you'd like to try it out.

Wow, this is interesting. Thanks for the fix!
I did not understand this: This problem has been reported two years ago, Morphia worked in a similar scenario with 0.109, but not with 0.108 and >=0.110?
Thanks again.

I don't know that it ever really worked.  It's not a scenario we test though I suppose it might be time to add some testing in this area since it seems it's increasingly common.

I think this bug still exists. We are getting a MappingException, when we are querying two databases.
It can easily be seen that the datastore instance in ReferenceMapper has the wrong database name when you debug your application.

I see I let that PR through without an explicit test. That was my failure. I'll add one now to confirm.

Can you take a look at (very) simple test I added and see if it matches your usage?  The test passes so i'm curious how your usage is different such that it doesnt work for you.
https://github.com/mongodb/morphia/blob/master/morphia/src/test/java/org/mongodb/morphia/TestDatastore.java#L476-476

I think test is ok.
Is this fix is in rc0? or in rc1?

this works for rc0.  I didn't make any changes to make this test work.

I just figured out the difference, the FacebookUser does not have @Reference field.
Can you please try something like below:
public class FacebookUser {

  @Reference
  private ArrayList<MyPojo>  references;

}

Got it.  I'm looking in to how extensive a fix this will be.  If it's too much it'll have to wait for post 1.0 but I think I can do this fairly cleanly.

Please do it, half of our application does not work now :)
Thanks.

Take a look at the test now.  This uses references, threads, and ThreadLocalDatastoreProvider to manage the different databases.
On a given thread, however, cross-database references still are not possible because the Java driver's DBRef type does not support the $db field.

It might help to know what your use case is so we can see what possible solutions there might be.

In our use case, the application is running in a servlet container so the test with ThreadLocal is not exactly the same scenario. Can you try to implement something like:
In a single thread,

read from db1
read from db2
read from db1 again (this is where the mapping error happens)

somehow datastore instance keeps the db2 as its db instance for the second read operation on db1

Could you attach a test case recreating this?  Unless you're doing something with the DatastoreProvider, Morphia's only ever going to load from the one database.  Datastore.save() is an explicit call to a Datastore where a load eventually makes its way in to a Mapper which gets the Datastore to use from Mapper.getDatastore() which just delegates to the DatastoreProvider.

Can you try to run this test please? You can paste it inside TestDatastore.java
 @Entity(noClassnameStored = true)
    public static class Foo {
        @Id
        private long id;

        private String fooField;

        @Reference
        private List<Bar> barReferences;

        public Foo() {

        }

        public Foo(String fooField) {
            this.fooField = fooField;
        }

        public Foo(long id, String fooField) {
            this.id = id;
            this.fooField = fooField;
        }

        public long getId() {
            return id;
        }

        public void setId(long id) {
            this.id = id;
        }

        public String getFooField() {
            return fooField;
        }

        public void setFooField(String fooField) {
            this.fooField = fooField;
        }

        public List<Bar> getBarReferences() {
            return barReferences;
        }

        public void setBarReferences(List<Bar> barReferences) {
            this.barReferences = barReferences;
        }
    }

    @Entity(noClassnameStored = true)
    public static class Bar {
        @Id
        private long id;

        private String barField;

        public Bar() {

        }

        public Bar(long id, String barField) {
            this.id = id;
            this.barField = barField;
        }

        public Bar(String barField) {
            this.barField = barField;
        }

        public long getId() {
            return id;
        }

        public void setId(long id) {
            this.id = id;
        }

        public String getBarField() {
            return barField;
        }

        public void setBarField(String barField) {
            this.barField = barField;
        }
    }

    private void saveDataFor_testMultipleDatabases2() {
      Datastore db1 = getMorphia().createDatastore(getMongoClient(), "db1");
      Datastore db2 = getMorphia().createDatastore(getMongoClient(), "db2");

      final FacebookUser db1FacebookUser = new FacebookUser(4, "DB1 FaceBook Friend");
      db1.save(db1FacebookUser);

      Bar bar1 = new Bar(1, "bar 1");
      db2.save(bar1);
      Bar bar2 = new Bar(2, "bar 2");
      db2.save(bar2);

      ArrayList<Bar> bars = new ArrayList<Bar>();
      bars.add(bar1);
      bars.add(bar2);

      Foo foo1 = new Foo(3, "Foo 1");
      foo1.setBarReferences(bars);

      db2.save(foo1);
    }

    @Test
    public void testMultipleDatabases2() throws InterruptedException, TimeoutException, ExecutionException {

      Datastore db1 = null;
      Datastore db2 = null;

      try {
          saveDataFor_testMultipleDatabases2();

          // below is almost the same use case we are trying.
          // the order is important

          db2 = getMorphia().createDatastore(getMongoClient(), "db2");

          List<Foo> foos = db2.find(Foo.class).asList();
          Assert.assertEquals(1, foos.size());

          Foo foo = foos.get(0);
          Assert.assertEquals(2, foo.getBarReferences().size());

          db1 = getMorphia().createDatastore(getMongoClient(), "db1");
          List<FacebookUser> facebookUsers = db1.find(FacebookUser.class).asList();
          Assert.assertEquals(1, facebookUsers.size());

          List<Foo> foos2 = db2.find(Foo.class).asList();
          Assert.assertEquals(1, foos2.size());

          Foo foo2 = foos2.get(0);
          Assert.assertEquals(2, foo2.getBarReferences().size());

      } finally {
          if(db1 != null){
            db1.getDB().dropDatabase();
          }

          if(db2 != null) {
            db2.getDB().dropDatabase();
          }
        }
    }

Datastore and Mapper are bound in some awkward ways at the moment.  The difference between my test case and yours is that with the ThreadLocalDatastore, I could provide a contextual distinction between which db I was needing to use.  In your test, you simply bounce between DBs.  Everything is fine up until you try to find foos2.  Up to that point, you'd create a new Datastore each time would register that Datastore with the DatastoreProvider in Mapper.  When you try to fetch foos2, you don't do that so the Mapper uses the Datastore that was last registered which is the one that points at db1.  If you want to switch dbs like that, you'll have to explicitly call mapper.getDatastoreProvider().register(db2).
Admittedly this is a bit of a wart in Morphia's architecture but one that can't change this close to 1.0.

:+1: Referencing from one datastore to another is vital in large environments and applications; since Mongo DBRefs support the $db field, it would be awesome to have Morphia behave seamlessly with them.

I'm not 100% sure this will make it to 1.1 but we'll see.  The Java driver doesn't support the $db field in DBRef so i'll have to munge it in Morphia.  This may or may not work but I'll give it my best shot.

I agree it should be handled natively by the Java driver and let Morphia act just as interface. Here's the Java driver issue: https://jira.mongodb.org/browse/JAVA-855

We're running up against this issue inside an OSGI container. As @ozguraydinli mentioned, ThreadLocal is not workable for us because we can't guarantee which thread we're on.
We've worked around this issue for now:
public final class MorphiaSupport {

    private MorphiaSupport() {}

    public static Datastore createDatastore(MongoClient mongoClient, String dbName, Class... classesToMap) {
        return createDatastore(new Morphia(), mongoClient, dbName, classesToMap);
    }

    public static Datastore createDatastore(Morphia morphia, MongoClient mongoClient, String dbName, Class... classesToMap) {
        Datastore ds = morphia.map(classesToMap).createDatastore(mongoClient, dbName);

        DatastoreProvider provider = new SingleDatastoreProvider();
        provider.register(ds);

        morphia.getMapper().getOptions().setDatastoreProvider(provider);

        return ds;
    }
}

}

The fix I have in mind should obviate the whole concept of a DatastoreProvider and should be much more friendly in such scenarios.

This may be a bit of a "me too", but please keep in mind that this bug is not just about references from one database to another, but can can also break (and does, in our case) references in the same db, as long as you query multiple databases in your application. I can confirm what @ozguraydinli spotted: ReferenceMapper.resolveObject will use a Datastore with a wrong database name in that case.

Yeah, the problem is the DatastoreProvider which seems to be a vestigial component in Morphia.  The best fix would be to remove it as it's not really necessary but I'm afraid it'd break the few who have explicitly relied on it.  I'm attempting to prototype a solution that fixes this while not breaking any uses of the interface.

It seems that this topic is closed, but I could not found how to make this work anywhere. Is this functionality really available? Thanks in advance!


move exec.reshape to backend

Description
move exec.reshape to backend
cc @reminisce @eric-haibin-lin @piiswrong
Checklist
Essentials
Please feel free to remove inapplicable items for your PR.

[ ] The PR title starts with [MXNET-$JIRA_ID], where $JIRA_ID refers to the relevant JIRA issue created (except PRs with tiny changes)
[ ] Changes are complete (i.e. I finished coding on this PR)
[ ] All changes have test coverage:
Unit tests are added for small changes to verify correctness (e.g. adding a new operator)
Nightly tests are added for complicated/long-running ones (e.g. changing distributed kvstore)
Build tests will be added for build configuration changes (e.g. adding a new build option with NCCL)
[ ] Code is well-documented:
For user-facing API changes, API doc string has been updated.
For new C++ functions in header files, their functionalities and arguments are documented.
For new examples, README.md is added to explain the what the example does, the source of the dataset, expected performance on test set and reference to the original paper if applicable
Check the API doc at http://mxnet-ci-doc.s3-accelerate.dualstack.amazonaws.com/PR-$PR_ID/$BUILD_ID/index.html
[ ] To the my best knowledge, examples are either not affected by this change, or have been fixed to be compatible with this change

Changes

[ ] Feature1, tests, (and when applicable, API doc)
[ ] Feature2, tests, (and when applicable, API doc)

Comments

If this change is a backward incompatible change, why must this change be made.
Interesting edge cases to note here

Thanks for your comments.
For the unit tests part, I found the existing tests cover both up sizing and down sizing, https://github.com/apache/incubator-mxnet/blob/master/tests/python/unittest/test_module.py#L703, https://github.com/apache/incubator-mxnet/blob/master/tests/python/unittest/test_module.py#L205, https://github.com/apache/incubator-mxnet/blob/master/tests/python/unittest/test_executor.py#L144.
Will address other parts tomorrow.

Could you please review again? I realized that Reshape is more appropriate to be a member function of Executor so that it can access the internal arguments of the executor. Also I think ReshapeAndAlloc should not be used, since the original executor should work fine after reshape.

unittest for checking

whether the reshaped executor and the original executor share NDArrays depending on the new shape sizes

is added in test_executor.py @reminisce

ping @reminisce @piiswrong

ping @piiswrong

LGTM. Any concerns? @reminisce @eric-haibin-lin


Some Problems in ol.source.WMTS when requesting GeoServer

I have checked wmtssource.js , and found the TODO line: "add support for TileMatrixLimits". Then how could I load a WMTS source which is defined using _TileMatrixLimits _? I confused when I tried to load WMTS published by GeoServer / GeoWebCache. I discovered that the demo of GeoWebCache is still using OpenLayer 2.x.
So I wonder if there is a way to use ol3 loading GeoWebCache WMTS, or add the support for TileMatrixLimits in the next version. Thank you~

TileMatrixLimits support added in #5589


apps: uvc-app: Fix SEG_FAULT on stream stop

Fix for SEGMENTATION FAULT when UVC stream is stopped. The events list was still processed but events pointers are null.
Also add mechanism for graceful closing and cleaning on SIGINT (CTRL + C).
Signed-off-by: Bogdan Togorean<EMAIL_ADDRESS>

Changes in V2:

run clang to fix formatting errors


(Android) Stop using WifiManager.getConnectionInfo(), deprecated in Android 12.

See doc at https://developer.android.com/reference/android/net/wifi/WifiManager#getConnectionInfo() (formatting/links lost, sorry):

This method was deprecated in API level 31.
Starting with Build.VERSION_CODES#S, WifiInfo retrieval is moved to ConnectivityManager API surface. WifiInfo is attached in NetworkCapabilities#getTransportInfo() which is available via callback in NetworkCallback#onCapabilitiesChanged(Network, NetworkCapabilities) or on-demand from ConnectivityManager#getNetworkCapabilities(Network).

It looks like we use it in just one place? See https://github.com/react-native-netinfo/react-native-netinfo/blob/v7.1.6/android/src/main/java/com/reactnativecommunity/netinfo/ConnectivityReceiver.java#L165

I do like handling deprecation where possible and when possible but I would like to see all of the issue(s) surrounding stale network connectivity information brought on by trying to use those ConnectivityManager APIs settle down before touching this area again.
Luckily it was only deprecated (not removed!) in an API level that isn't even mandatory for another 11 months, and thus won't even be removed for a minimum 11months, probably 23 or 35 (one or two API levels more).
So there's time for this one. Definitely worth leaving open and handling (in a backwards compatible way), but once the serious stale info issues are nailed I hope
That said, PRs are basically always welcome :-)

So there's time for this one.

Oh, absolutely! I should have included those details to show that this isn't urgent, and I'm not asking anyone to do anything. Chances are I'll be available in several months to make a PR. I'm happy to wait until those stale-information issues settle down.
Since this will have to be done eventually (even if the real deadline is years from now), I'm hoping this issue can stay open, and people can post any useful, on-topic bits of info they find. I think I can't choose labels for the issue; feel free to update them if there's a better way for them to represent the issue's purpose. 🙂

I'm getting the following build error when explicitly trying to remove the permission WIFI_ACCESS_STATE despite not having any usage of it in our app but it sneaking in to our final AndroidManifest.xml. Please advise if it is related to the above conversation.

If you use this module, you use that permission I think


Update Authentication Strategy

@derekendres Could you take a look at this when you get a chance?

Also, I have added new steps to the other samples so this specific example is behind,(complex keys, secondary indicies, etc...), are you planning on adding that?  If not I can work on adding those next week.

can you include steps for running this in the readme?
I think it is just ng serve, but we should have that in the running the example section
Are you able to add a test to show that this works sample works? Basically just a test that runs and shows that it compiles and works from start to end. If not I can work on adding that, but not an Angular testing expert. I can wire up the changes to azure-pipelines.yml for it for automated test.
I am on my laptop, so I am installing angular and updatings node so I can actually run the sample, but it looks good from what I have seen.

There's now instructions in Running the example that include, npm install, npm start, and logging in.
I currently lack the expertise to implement start to end testing for this unfortunately.
I didn't add complex keys and secondary indices as there are some concerns about having the necessary resources to maintain samples in many different languages. Here's a quote from DMoler as of April 4th.

We want basic samples in: Java, Python, Node, Angular, .NET
Basic samples should include authenticating, listing namespaces, reading & writing data.
Advanced samples are okay to only include in C#

We might be decreasing the complexity of non C# samples in the near future to ensure we can maintain them with quicker turn-around. This particular sample has been broken for nearly 4 months now sadly.


CAMEL-20785: split responsibilities from the test support class

This change moves the management of the CamelContext lifecycle to a separate class with a more well-defined responsibility scope.
It also splits the test configuration and the context configuration from the test class itself.
It also includes a few cleanups and fixes for tests. And, also, mark some methods as deprecated.

I'm sending this as an early preview of the changes. There's still some cleanups to be done on this code, missing javadoc and documentation notes. Nonetheless, it should give everyone an idea of the changes.
There's still a lot more to fix on this one, and for now I am aiming for a being highly compatible with the existing code.


Please tag new release

Current release (0.1.1) is missing composer autoload info.  Master is working.

Done


GPU support missing for some features

I noticed the following features are currently only supported on host:

(Par)GridFunction::ProjectCoefficient
(Par)GridFunction::ProjectGridFunction
(Par)TransferMap::Transfer

Is there anything in the works to support these on device? I'm using them within a time-stepping loop and they currently are the bottleneck (forcing DtoH / HtoD copies with Host execution in between).

Hi @stefanhenneking,
For ProjectGridFunction and Transfer, I don't know if there is anything currently in the works, but it would be a great addition, and not too difficult (in the case of meshes with only tensor-product elements, no variable $p$).
For ProjectCoefficient, this will depend very much on what type of Coefficient you have. For the most general coefficients, we are not set up for GPU acceleration (Coefficient::Eval is a host member function). What kind of Coefficient are you using?

For Transfer I found a simple workaround that performs well in the particular case I currently use where point-wise nodal values are transferred only -- then the mappings are injections or transposed injections which I can pre-compute on host and then transfer once on device (instead of using the TransferMap class).
In terms of coefficients, I am using FunctionCoefficient and VectorFunctionCoefficient.
If I'll only make ProjectGridFunction work, then that is fine, too (I only use FunctionCoefficient and VectorFunctionCoefficient for test cases). For device-computation with pa in mfem, I currently need tensor-product and uniform $p$ anyway.

For FunctionCoefficient and VectorFunctionCoefficient, the classes can't really set up for GPU evaluation (the functions would need to be __host__ __device__, etc.
You can do something like the following to evaluate functions on device:
using RHSFunctionType = double(*)(const double *xyz);

template <RHSFunctionType F>
void ProjectRHS_(QuadratureFunction &qf)
{
   QuadratureSpaceBase &qs = *qf.GetSpace();
   Mesh &mesh = *qs.GetMesh();
   const IntegrationRule &ir = qs.GetIntRule(0);

   auto *geom = mesh.GetGeometricFactors(ir, GeometricFactors::COORDINATES);

   const int dim = qs.GetMesh()->Dimension();
   const int nq = ir.Size();
   const int N = qf.Size();

   const double *d_x = geom->X.Read();
   double *d_q = qf.Write();

   mfem::forall(N, [=] MFEM_HOST_DEVICE (int ii)
   {
      const int i = ii / nq;
      const int j = ii % nq;
      double xvec[3];
      for (int d = 0; d < dim; ++d)
      {
         xvec[d] = d_x[j + d*nq + i*dim*nq];
      }
      d_q[ii] = F(xvec);
   });
}

This projects the function onto a QuadratureFunction, but you could do the same with a GridFunction, using the IntegrationRule from FiniteElement::GetNodes.

Thanks, I'll try that out!
Closing this issue for now but will reference it if I start working on device support for ProjectGridFunction or Transfer.


UI improvement needed in ruby Jekyll framework blog website

UI improvement needed in ruby Jekyll framework blog website needed

Hi, I would like to work on this issue. Could you please assign to me and share detailed requirements? Thanks!


Kubernetes Cloud Native configuration

Hi,
I'm trying to deploy my application into a Kubernetes cluster and I need to run an application which has the same container for different environments.  (https://github.com/dbgjerez/workshop-cdc/issues/11)
https://github.com/dbgjerez/workshop-cdc/blob/61764e287f4272a70c660c55f8564f8548daa250/apps/front-users/src/config/app.user.config.json#L2
An excellent solution could be to use environment variables that I can override from a ConfigMap. The problem is that all the variables are overridden in build time, so I can't do it.
Can somebody say to me, how can I do that? I'm using nginx to serve the static files.
Thanks a lot.

Resolved!
https://github.com/dbgjerez/workshop-cdc/issues/11#issuecomment-1795200229


Embed operator version and authorino image version

TODO

Closing this for now until we can revisit it with a solution to get the Authorino version to default the operand image to injected into the binary, when building the operator image in CI (automated workflows). A possible approach can be fetching from the Authorino repo the latest available release.
cc @didierofrivia


Update learn more domain from trailblazerb.org to trailblazer.to

Update link domain in lib/representable/deprecations.rb.
Old link: http://trailblazerb.org/gems/representable/upgrading-guide.html
New link: http://trailblazer.to/gems/representable/upgrading-guide.html

There should be a redirect from the old to the new domain....?!?!

Don't know.
http://trailblazerb.org/ returns ERR_NAME_NOT_RESOLVED.

You have to send PRs against the hermosa branch!

Excuse me. Where is the hermosa branch? I can't find it…… :sweat:


Manipulating Complex Objects Javascript Challenge Alternative Solution(not good for learning)

Describe your problem and how to reproduce it:
I know going for something like this defeats the whole purpose of learning, I just couldn’t help but try this and it passed. since I had some hard challenges so far that really engaged me by putting so many limits on. I thought maybe I should report this so that a new limit to prevent such action makes it more engaging.
i’m sorry if this is not the place to post or its not important at all.
Thank you for this great site, its helping me learn quite fast, and its pretty fun and engaging.
Description:
What I did was that I saw the challenge requires the 1 object of the array to have certain criteria and no other limitations
putting a {}, at the start instead of typing an entire 2nd object made the challenge pass.
Add a Link to the page with the problem:
https://www.freecodecamp.org/learn/javascript-algorithms-and-data-structures/basic-javascript/manipulating-complex-objects
If possible, add a screenshot here (you can drag and drop, png, jpg, gif, etc. in this box):

Hi @cyneptic
Can you please report this on our forum first and see if this is a bug with the challenge or your code so far, the awesome folk there will help you with the challenge.
If there is a reason to believe this is a bug, we can reopen this for investigation.
Thanks, and happy coding.

I had opened a ticket on the forum, they told me to report it here.

Thanks for getting back to us. Can you point me to the forum post (it's the URL of the post in your browser)?

https://forum.freecodecamp.org/t/found-a-solution-that-might-not-be-ideal-for-learning/453661

Thanks for sharing a link to the post, when we first read thru the issue report it did not make much sense and now that I have given the forum post a read it makes more sense now. I have edited your original report here for better readability.
Thanks for reporting this.

Hey,
Send it my way i'll take a look!

Oh, @LaurentLabine  I am also taking a look already

No problem i'll find something else! Cheers!


about the problem of accessing OpenAI website

Example URL(s)
when I tried to access OpenAI, I encountered a page that said I was banned from accessing.
Actual Behavior
I don’t know why this is, I didn’t do anything that violates your rules or laws.
Expected Behavior
I really hope to be able to use your website and services, to learn and experience the charm of artificial intelligence. I admire and support your work very much, and I appreciate your time and help.
Looking forward to your reply.
Sincerely yours,
my cloudflare ray ID:8245c75d399f2d44
Additional information
No response

Hi @lyh648, unfortunately this isn't something the Cloudflare developer documentation team can assist with. You may have better luck reaching out to the site you're trying to access.


Past streamlit script runs remain in the query scope

Using streamlit's features to change state and re-run a script, or editing script files and letting streamlit re-run, causes new variables to be created in the deephaven scope (in the __main__.__dict__ object). Later runs do not clean out old values, resulting in a long list of variables:

In theory specifying object_id= would let the user keep replacing the same name with new values, but it seems to not actually force the iframes to refresh (though the new object is available in scope, confirmed by checking the http://localhost:10000/ide/ panels list).

Need to make sure the main dict that we add the object_id to is the same on each streamlit re-run. Also need to clear the old objects from a previous run.


Fix webpack license warning

#19999 introduced a indirect dependency with a license that was not on our allowlist yet which produced this warning during webpack:
WARNING in License<EMAIL_ADDRESS>has disallowed license CPAL-1.0 OR AGPL-1.0

I've added both licenses to the allowed list and made it so webpack will now abort on such license errors so that we don't miss those next time.

With AGPL being included what are the implications of that?

I think maybe we have to revert because the two licenses are not compatible. And we need to have a tool to check the licenses problem in CI.

The package repo in question is https://github.com/juris-m/citeproc-js. As the package is dual-licensed, I think we may also just allow CPAL only and still satisfy the license check.
I think the main problem with the GPL family is "any derivative work must be distributed under the same or equivalent license terms", but I'm no expert on this.

According to https://github.com/Juris-M/citeproc-js/issues/79#issuecomment-406815993, the author just wants attribution, and we give them that via license.txt already.

I've reduced the SPDX expression to accept just CPAL-1.0, which is the less-restrictive of the two and the validation still passes.

🎺 🤖


% inside core.async go blocks doesn't work

(tests
 (def c (chan))
 (go
   (! 1)
   % := 1
   (<! c)))

For background, here's a test without the problem:
(tests
  "core.async"
  (def c (chan))
  (go-loop [x (<! c)]
    (when x
      (<! (timeout 10))
      (! x)
      (recur (<! c))))
  (go (>! c :hello) (>! c :world))
  % := :hello
  % := :world
  (close! c))

Now imagine the assertions were inside the go block - we can't rewrite it for the same problem as go blocks not rewriting lambda. Like async/await, % is await.
We don't have a good test for this case; We think this is nonsense and may not need to handle this case.

(tests
  ((fn []
     (! 1)
     % := 1)))

(tests
  (if true
    1
    (do (! 2) % := 2)))

This is workable, the expression becomes asynchronous and analyzed into thunks for the "await" to work. However we don't need to support this.

(tests
 (! 1)
 (loop []
   % := 1
   (recur)))

Well defined; recur is sequenced after the assertion (the recur is inside the continuation). The recur is no longer in the tail-call position however in the compiler loop/recur is a syntax unit, recur does not exist in emitted code.
(tests
 (loop []
   (! 1)
   % := 1
   (recur)))

Leo says this can be done and can point to examples, not a risk


是一个从头配置的教程， 不是直接拿来使用的东东

So， why not just sth that download then  work . We need a tool, not how to build a tool.

'how' is more important than 'what'. if U need all-in-one-for-lord, touch IDE.


Documentation: Provide instructions for android development in CONTRIBUTING.md

Update Documentation
The CONTRIBUTING.md is missing instructions for the building and running of android application with capacitor and android studio.

@rizwan2000rm @Abhishek-kumar09 I'll take care of this !

@karankv26 Sure go ahead.


Support epiCRealism XL

Would it be possible to support v1 of: https://civitai.com/models/277058?modelVersionId=312202
You already support epicrealism_naturalSinRC1VAE.safetensors but it would be good to support the new SDXL version.
Thanks!

Sure! I've just added in https://github.com/fofr/cog-comfyui/commit/b000abc3be73a9ab258270ca4ff94300394f2c01


Browse view does not respect sequenceIndex values

The COLDP model allows for child taxa to be sequenced using natural integer order for values specified in the sequenceIndex property of the Taxon or NameUsage records.
ChecklistBank currently does not respect these values and continued to display children in alphabetical order.
An example - children of Amniota here have been given sequenceIndex values that should sort them as [ Sphenodontia, Testudines, Crocodylia, Squamata, Mammalia, Aves ] but they still appear in alphabetical order.
https://www.checklistbank.org/dataset/58312/classification?taxonKey=e07b1ca0-7f74-4423-a9e1-b388312843e2
Ability to sequence child taxa has been requested by members of the Taxonomy Group for this and similar cases.

I have finally taken the time to work on the implementation (as well as other ColDP 1.1 related tasks, e.g. remarks all over and a TaxonProperty table). Here are the bird orders in a custom ordering:
https://www.dev.checklistbank.org/dataset/270357/classification
Not that I also adapted importing of TextTrees to preserve the ordering they come in, so this aves.txtree file defines all ordinals implicitly for the birds.

will be deployed to prod on monday or tuesday


librepcb-unstable: 2017-12-29 -> 2018-06-28

Motivation for this change
A newer version.
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[x] Fits CONTRIBUTING.md.

@GrahamcOfBorg  build librepcb

No attempt on x86_64-darwin (full log)
The following builds were skipped because they don't evaluate on x86_64-darwin: librepcb
Partial log (click to expand)

a) For `nixos-rebuild` you can set
  { nixpkgs.config.allowUnsupportedSystem = true; }
in configuration.nix to override this.

b) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
  { allowUnsupportedSystem = true; }
to ~/.config/nixpkgs/config.nix.

Success on x86_64-linux (full log)
Attempted: librepcb
Partial log (click to expand)
post-installation fixup
shrinking RPATHs of ELF executables and libraries in /nix/store/9r9zg7f8r5zwzh7rnff5hzljsz8l9z8v-librepcb-20180628
shrinking /nix/store/9r9zg7f8r5zwzh7rnff5hzljsz8l9z8v-librepcb-20180628/bin/librepcb
strip is /nix/store/4qvrxzxa535y8304mk195x50b6p9607d-binutils-2.30/bin/strip
stripping (with command strip and flags -S) in /nix/store/9r9zg7f8r5zwzh7rnff5hzljsz8l9z8v-librepcb-20180628/bin
patching script interpreter paths in /nix/store/9r9zg7f8r5zwzh7rnff5hzljsz8l9z8v-librepcb-20180628
checking for references to /build in /nix/store/9r9zg7f8r5zwzh7rnff5hzljsz8l9z8v-librepcb-20180628...
postPatchMkspecs
postPatchMkspecs
/nix/store/9r9zg7f8r5zwzh7rnff5hzljsz8l9z8v-librepcb-20180628

Success on aarch64-linux (full log)
Attempted: librepcb
Partial log (click to expand)
post-installation fixup
shrinking RPATHs of ELF executables and libraries in /nix/store/drma9m3ynl2027wj410f3cbz2sacxjcj-librepcb-20180628
shrinking /nix/store/drma9m3ynl2027wj410f3cbz2sacxjcj-librepcb-20180628/bin/librepcb
strip is /nix/store/0pjsgkxz0rp5baycq5sp2s72lrr5q9sg-binutils-2.30/bin/strip
stripping (with command strip and flags -S) in /nix/store/drma9m3ynl2027wj410f3cbz2sacxjcj-librepcb-20180628/bin
patching script interpreter paths in /nix/store/drma9m3ynl2027wj410f3cbz2sacxjcj-librepcb-20180628
checking for references to /build in /nix/store/drma9m3ynl2027wj410f3cbz2sacxjcj-librepcb-20180628...
postPatchMkspecs
postPatchMkspecs
/nix/store/drma9m3ynl2027wj410f3cbz2sacxjcj-librepcb-20180628


CITE-seq-Count run gets stuck

Hello,
I am currently attempting to run CITE-seq-Count on my data, however, it appears to get stuck and not continue at a certain point during the run. Do you have any idea what could cause this?
Additional info: I am running this using a WSL, and the tags_KH33.csv file consists of 4 tags.
CITE-seq-Count -R1 /home/layla-r/CITE-seq/KH33/KH33_S1_R1_001.fastq.gz -R2 /home/layla-r/CITE-seq/KH33/KH33_S1_R2_001.fastq.gz -t /home/layla-r/CITE-seq/KH33/tags_KH33.csv -cbf 1 -cbl 16 -umif 17 -umil 28 -cells 3745 -wl /home/layla-r/CITE-seq/KH33/barcodes.tsv -o /home/layla-r/CITE-seq/KH33/

Loading whitelist
Loading whitelist
Counting number of reads
Started mapping
Processing 47,026,147 reads
CITE-seq-Count is running with 24 cores.
Processed 1,000,000 reads in 11.72 seconds. Total reads: 1,000,000 in child 549
Processed 1,000,000 reads in 17.77 seconds. Total reads: 1,000,000 in child 550
Mapping done for process 549. Processed 1,959,422 reads
Processed 1,000,000 reads in 23.83 seconds. Total reads: 1,000,000 in child 551
Mapping done for process 550. Processed 1,959,422 reads
Processed 1,000,000 reads in 29.73 seconds. Total reads: 1,000,000 in child 552
Mapping done for process 551. Processed 1,959,422 reads
Processed 1,000,000 reads in 36.01 seconds. Total reads: 1,000,000 in child 553
Mapping done for process 552. Processed 1,959,422 reads
Processed 1,000,000 reads in 42.18 seconds. Total reads: 1,000,000 in child 554
Mapping done for process 553. Processed 1,959,422 reads
Processed 1,000,000 reads in 48.52 seconds. Total reads: 1,000,000 in child 555
Mapping done for process 554. Processed 1,959,422 reads
Processed 1,000,000 reads in 54.22 seconds. Total reads: 1,000,000 in child 556
Mapping done for process 555. Processed 1,959,422 reads
Processed 1,000,000 reads in 1.0 minute, 1.701 seconds. Total reads: 1,000,000 in child 557
Mapping done for process 556. Processed 1,959,422 reads
Processed 1,000,000 reads in 1.0 minute, 7.854 seconds. Total reads: 1,000,000 in child 558
Mapping done for process 557. Processed 1,959,422 reads
Processed 1,000,000 reads in 1.0 minute, 14.77 seconds. Total reads: 1,000,000 in child 559
Mapping done for process 558. Processed 1,959,422 reads
Processed 1,000,000 reads in 1.0 minute, 22.07 seconds. Total reads: 1,000,000 in child 560
Mapping done for process 559. Processed 1,959,422 reads
Processed 1,000,000 reads in 1.0 minute, 36.4 seconds. Total reads: 1,000,000 in child 561
Mapping done for process 560. Processed 1,959,422 reads
Processed 1,000,000 reads in 1.0 minute, 46.89 seconds. Total reads: 1,000,000 in child 562
Mapping done for process 561. Processed 1,959,422 reads
Processed 1,000,000 reads in 2.0 minutes, 2.612 seconds. Total reads: 1,000,000 in child 563
Mapping done for process 562. Processed 1,959,422 reads
Processed 1,000,000 reads in 2.0 minutes, 11.76 seconds. Total reads: 1,000,000 in child 564
Processed 1,000,000 reads in 2.0 minutes, 27.29 seconds. Total reads: 1,000,000 in child 565
Processed 1,000,000 reads in 2.0 minutes, 43.36 seconds. Total reads: 1,000,000 in child 566
Mapping done for process 565. Processed 1,959,422 reads
Mapping done for process 563. Processed 1,959,422 reads
Mapping done for process 564. Processed 1,959,422 reads
Processed 1,000,000 reads in 2.0 minutes, 56.62 seconds. Total reads: 1,000,000 in child 567
Mapping done for process 566. Processed 1,959,422 reads
Processed 1,000,000 reads in 3.0 minutes, 4.829 seconds. Total reads: 1,000,000 in child 568
Processed 1,000,000 reads in 3.0 minutes, 13.85 seconds. Total reads: 1,000,000 in child 569
Mapping done for process 567. Processed 1,959,422 reads
Mapping done for process 568. Processed 1,959,422 reads
Mapping done for process 569. Processed 1,959,422 reads
Processed 1,000,000 reads in 3.0 minutes, 32.62 seconds. Total reads: 1,000,000 in child 570
Processed 1,000,000 reads in 3.0 minutes, 54.14 seconds. Total reads: 1,000,000 in child 571
Mapping done for process 570. Processed 1,959,422 reads
Processed 1,000,000 reads in 4.0 minutes, 3.777 seconds. Total reads: 1,000,000 in child 572
Mapping done for process 571. Processed 1,959,422 reads
Mapping done for process 572. Processed 1,959,441 reads

Thanks.

Hi i have same issue, did you issue resolved

@Rimanpreet1 Hi, this issue has not been resolved.

Hello @Layla-R
For how long does it get stuck?
Can you try restricting the number of threads to 8?


issue/6023-unmanaged-resources-storage-fixes

Description

Make sure duplicate entries are overridden instead of raising an (implicit) exception
Add a timestamp column to indicate when a resource was discovered
Rename methods according to the design

closes #6023
Self Check:
Strike through any lines that are not applicable (~~line~~) then check the box

[x] Attached issue to pull request
[x] Changelog entry
[x] Type annotations are present
[x] Code is clear and sufficiently documented
[x] No (preventable) type errors (check using make mypy or make mypy-diff)
[x] Sufficient test cases (reproduces the bug/tests the requested feature)
[x] Correct, in line with design
[ ] End user documentation is included or an issue is created for end-user documentation (add ref to issue here: )
[ ] If this PR fixes a race condition in the test suite, also push the fix to the relevant stable branche(s) (see test-fixes for more info)

Processing #6106.


More work around excessive error messages

E.g.
storage {
    x: int,
}

predicate Test {
    state x = storage::x;
    var len = __state_len(x, 0);

    constraint len == 0;
}

we get
Error: this intrinsic takes 1 argument but 2 arguments were supplied
   ╭─[test.pnt:7:15]
   │
 7 │     var len = __state_len(x, 0);
   │               ────────┬────────
   │                       ╰────────── unexpected number of arguments here
───╯
Error: binary operator type error
   ╭─[test.pnt:9:23]
   │
 9 │     constraint len == 0;
   │                ─┬─    ┬
   │                 ╰──────── expecting type `Error`
   │                       │
   │                       ╰── operator `==` argument has unexpected type `int`
───╯
Error: constraint expression type error
   ╭─[test.pnt:7:5]
   │
 7 │     var len = __state_len(x, 0);
   │     ─────────────┬─────────────
   │                  ╰─────────────── constraint expression has unknown type
   │                  │
   │                  ╰─────────────── expecting type `bool`
───╯
Error: constraint expression type error
   ╭─[test.pnt:9:5]
   │
 9 │     constraint len == 0;
   │     ─────────┬─────────
   │              ╰─────────── constraint expression has unknown type
   │              │
   │              ╰─────────── expecting type `bool`
───╯
Error: could not compile `test.pnt` due to 4 previous errors

There are few issues:

expecting type Error`` in the second error is weird.
Ideally, if an error refers to "Unknown" or "Error" such as the other one, we shouldn't emit it. It's not very useful and is not actionable.

(2) is a desirable fix.  I just came across a illegal cast from a 'Error'.

Note to self:
Error: constraint expression type error
   ╭─[test.pnt:7:5]
   │
 7 │     var len = __state_len(x, 0);
   │     ─────────────┬─────────────
   │                  ╰─────────────── constraint expression has unknown type
   │                  │
   │                  ╰─────────────── expecting type `bool`
───╯

is because we didn't infer the type for

Error: this intrinsic takes 1 argument but 2 arguments were supplied
   ╭─[test.pnt:7:15]
   │
 7 │     var len = __state_len(x, 0);
   │               ────────┬────────
   │                       ╰────────── unexpected number of arguments here
───╯

When in reality we know the type of the intrinsic. We got an error with the number of arguments and that shouldn't then report it as unknown.


Missing /

You are missing a / between monitoring.azure.com and .  The addition of an example could help catch these errors.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: e3284cd7-9477-14ac-7f6e-9fcfa31f8de1
Version Independent ID: 73812858-f1c5-f8a0-bdc5-7de0ec9541e5
Content: Send metrics to the Azure Monitor metric database by using a REST API - Azure Monitor
Content Source: articles/azure-monitor/essentials/metrics-store-custom-rest-api.md
Service: azure-monitor
Sub-service: essentials
GitHub Login: @EdB-MSFT
Microsoft Alias: edbaynash

@MadDenker
Thanks for your feedback! We will investigate and update as appropriate.

@MadDenker We have verified and updated the document as required. The update will go live in less than 24 hours. Thanks again!


Added capability to enable vector search functionality on live CI

Added capability to enable vector search functionality on live CI

/azp run python - cosmos - tests

API change check
API changes are not detected in this pull request.

Closing out this PR as the changes have been included in this one - https://github.com/Azure/azure-sdk-for-python/pull/35468


GPU sync problem

When was working on MDEC (#15), there was an issue when testing with the mdec test from JaCzekanski_tests.
The issue is that the gpu DMA (2), would hang in the middle, because it would set the CPUtoVRAM blit command, and then the flag READY_FOR_CMD_RECV should be cleared, but because we are doing it in another thread, there seems to be a delay after the command is written to the GPU and the flag being cleared.
Not sure why, but the test rom will hang (maybe bug in the library that handles GPU DMA), but the GPU sync should be fixed anyway this will help make the GPU more accurate and hopefully fixes more bugs (#7 ?)

After fixing the issue, the main issue was with the flag DMA_DIRECTION being out of sync