Compatibility with Python multiprocessing

We have a custom Python script that is used to perform some calculations on elements on an index. During course of calculations, it is necessary to fetch list of timestamps for a search criteria from a backing index. This is done using the helpers.scan() paradigm.
Since search can take long time (we are searching among millions of documents), our idea was to create a multiprocessing.Pool and then use a map to perform the search so that parallel searches can  be performed (We use 3 workers).
The scheme worked till Elasticsearch-7.17. After upgrade to Elasticsearch-8.1.0, we updated the script dependency (elasticsearch-py to 8.1.0) and noticed that random searches began failing with a unable to deserialize error.
Unable to deserialize as JSON: b'{"_scroll_id":"FGluY2x1ZGVfY29udGV4dF91dWlkDnF1ZXJ5VGhlbkZldGNoAxZjLW9VV25EMVJEQ09WVzRUbDRjSDVBAAAAAAAAHpsWQ3JRSHo1eEFTbC0zYVM1aXFhUnFldxY1dUhYV1FXeVN1LVZEWVM3TUN3ZmRnAAAAAAAAIWgWZ0lhNDIycXRSeW1DMnlDZ1VYMEJSZxZLdktJUVNlSVFoLWNxaGdzbXZnMFlRAAAAAAAAKToWX3QzaVBjRzBUQW1aMWdJZTI3MzVVdw==","took":4245,"timed_out":false,"_shards":{"total":15,"successful":15,"skipped":12,"failed":0},"hits":{"total":{"value":1609,"relation":"eq"},"max_score":null,"hits":[LONG HIT]}}HTTP/1.1 200 OK\r\nX-elastic-product: Elasticsearch\r\ncontent-type: application/vnd.elasticsearch+json;compatible-with=8\r\ncontent-length: 140256\r\n\r\n{"_scroll_id":"FGluY2x1ZGVfY29udGV4dF91dWlkDnF1ZXJ5VGhlbkZldGNoAxZjLW9VV25EMVJEQ09WVzRUbDRjSDVBAAAAAAAAHp0WQ3JRSHo1eEFTbC0zYVM1aXFhUnFldxZSWjBnV0haWFJ5U2Q5Tm5wd3BBbzhBAAAAAAAAFHsWN1Z5clJ3WTdSc2FOc0c5S3VfNG1IQRZLdktJUVNlSVFoLWNxaGdzbXZnMFlRAAAAAAAAKTsWX3QzaVBjRzBUQW1aMWdJZTI3MzVVdw==","took":4434,"timed_out":false,"_shards":{"total":15,"successful":15,"skipped":12,"failed":0},"hits":{"total":{"value":3243,"relation":"eq"},"max_score":null,"hits":[{"_index":"conn-2022.03.12","_id":"MXv3en8BEUCwvNkwmp_B","_score":null,"_source":{"@timestamp":"2022-03-11T21:51:54.599Z"},"sort":[562]},{"_index":"conn-2022.03.12","_id":"K2r8en8Bn-M7Q9BPMNt3","_score":null,"_source":{"@timestamp":"2022-03-11T21:56:54.730Z"},"sort":[732]},{"_index":"conn-2022.03.12","_id":"f3Ipe38Bn-M7Q

Notice that it seems like the response has body of another response tacked to it (which is probably what is causing the error).
There is no error if we set number of workers to 1 which makes me suspect that transport is not playing well with multiple workers spawned using multiprocessing.
We initialize the elasticsearch instance once globally and then each "worker" uses that instance to perform the search. Any ideas hw we can make this scheme play well with transport library?
UPDATE
We modified the script so that each worker creates its own ElasticSearch() instance at spawn time (in addtion to one created by script). The workers only ever use their own instance and now the script is working correctly.

This library is thread-safe but isn't safe to fork/access from multiple different processes so your approach of creating a separate instance per forked process is correct.
What configuration were you using in 7.17 that was working but now isn't in 8.0+?

@sethmlarson The earlier approach was to have a single global ElasticSearch() instance and then fork workers all of which accessed the same global ElasticSearch instance. This worked well till 7.17 but broke after upgrade to 8.1. To fix this, we changed to one instance per worker (in addtion to global instance).
Would it be possible to add information regarding thread/process safety to the manual?

@redbaron4 I understand. Could you copy and paste the code you were using in 7.17 so I can see how the client was configured and try to reproduce the problem?

Sorry I misunderstod your earlier comment.
Here's how I configure the client
ES.Elasticsearch(
            connection_string, sniff_on_connection_fail=True,
            sniff_on_start=True, sniffer_timeout=5 * timeout,
            timeout=timeout, sniff_timeout=timeout // 2,
            max_retries=retries, retry_on_timeout=True)

where timeout and connection_string are user supplied options. The configuration line is same for both versions of elasticsearch.


Update Azure_70-534_Objective_1.1.htm

Clarify question about Read Access Geo-Redundant Storage (RA-GRS)
Proof: "Read-access geo-redundant storage (RA-GRS) maximizes availability for your storage account, by providing read-only access to the data in the secondary location, in addition to the replication across two regions provided by GRS." https://azure.microsoft.com/en-us/documentation/articles/storage-redundancy/#read-access-geo-redundant-storage
Another possible option is to leave question intact but set both answers -
Maintains 6 copies of your data. Three copies are replicated within the primary region, with three additional copies being replicated within a secondary region hundreds of miles away.
and  Replicates your data to a secondary geographic location, while providing read access to the data in the secondary location. Replicates your data to a secondary geographic location, while providing read access to the data in the secondary location.
as correct.

@crpietschmann, any updates about this PR?


[PORT] update adaptive inputs to set inputHint = expectingInput

Port this change from botbuilder-dotnet/master branch:
https://github.com/microsoft/botbuilder-dotnet/pull/3427

ref to this issue: #3344
At first, LG ActivityFactory use MessageFactory.Text() to generate message activity result from LG output, but MessageFactory.Text() would inject inputhint = expectingInput  into activity, and the prompt of input relies on this feature.
Then we found there is no reason to add inputhint into pure text activity, so we removed it in this pr: #3382.
At the same time, we should update adaptive inputs to set inputHint = expectingInput whenever we are issuing a prompt or reprompt (unrecognized/ invalid prompt).
Changed projects

Microsoft.Bot.Builder.Dialogs.Adaptive

[P0]

adaptive issue

Hi, when using direct line speech channel and the user uses the microphone, the bot speaks and automatically activates the microphone when reaching an inputDialog action. I think the mic wouldn't activate if I changed the inputHint from 'expecting' to 'ignoring' in the prompt's activity, but I cannot change the 'expecting' value. Is there another way to prevent the mic from being activated? Thanks

@Danieladu or @luhan2017 could you take a look at what @edwgj is asking?

@Danieladu the value of inputHint cannot be changed using the LG template within an inputDialog prompt:
new TextInput() {   Property = 'turn.user_input',   Prompt = new ActivityTemplate("${myTemplate()}") }
I think this is due to the update mencioned by @tomlm : "At the same time, we should update adaptive inputs to set inputHint = expectingInput whenever we are issuing a prompt or reprompt (unrecognized/ invalid prompt)."
I know we expect a user input after issuing an inputDialog prompt, but what if I don´t want the microphone to be automatically activated when using voice with direct line speech?

Oh. I find it. The inputHint would be overridden with ExpectingInput in the prompt property.
You mean the customer just wants the bot accept "text" content, but disable "speak" content?
@tomlm  @Stevenic any idea about this one?

To better explain this, let's say a bot using adaptive dialogs and direct line speech channel on web chat do the following:

User click on mic and speech something
The bot ask for user name with the TextInput dialog, so it speaks 'what's your name' and the mic is automatically activated due to the expectingInput
The user has to speak his/her name

How could I prevent the mic to be activated, so the user can choose to write the name or click on mic again?

@edwgj
I have filed an issue to enable the customer to customize the inputhint value.
https://github.com/microsoft/botbuilder-js/issues/3195
So that value of inputHint can be changed using the LG template within an inputDialog prompt.
Close this one and track it in the new issue.

@edwgj
I have filed an issue to enable the customer to customize the inputhint value.
https://github.com/microsoft/botbuilder-js/issues/3195
So that value of inputHint can be changed using the LG template within an inputDialog prompt.
Close this one and track it in the new issue.

@Danieladu  I can see the update, thanks a lot

@Danieladu  I can see the update, thanks a lot


FIX: base model as key not allowed

We could still have a dict, but with player names as keys. What do you think?

We could still have a dict, but with player names as keys. What do you think?

Yes tried that first and it is messy, because you still need the players object somewhere. You will end with a deep nested dict. I think an entry object ist much cleaner

We could still have a dict, but with player names as keys. What do you think?

Yes tried that first and it is messy, because you still need the players object somewhere. You will end with a deep nested dict. I think an entry object ist much cleaner

Keep the Entry Object and do a Dict of Name[String] -> Entry.
you can still use values() to iterate over all entries.

We could still have a dict, but with player names as keys. What do you think?

Yes tried that first and it is messy, because you still need the players object somewhere. You will end with a deep nested dict. I think an entry object ist much cleaner

Keep the Entry Object and do a Dict of Name[String] -> Entry.
you can still use values() to iterate over all entries.

Sounds good

We could still have a dict, but with player names as keys. What do you think?

Yes tried that first and it is messy, because you still need the players object somewhere. You will end with a deep nested dict. I think an entry object ist much cleaner

Keep the Entry Object and do a Dict of Name[String] -> Entry. you can still use values() to iterate over all entries.

I updated it to use dict again. Can you review it again?


Game not found despite being in the manifest

One of my games, Ys VIII: Lacrimosa of DANA, was not caught by the backup preview despite the game being on my disk. I added it as a custom game, but I am worried if other games might be missed as well:

I did notice something, though I am not sure if is pertinent. The install dir listed in manifest.yaml is Ys VIII Lacrimosa of Dana, but my game is installed in C:\Program Files (x86)\GOG Galaxy\Games\Ys VIII - Lacrimosa of DANA.
I am not going to presume too much, but I wonder if it is trying to find an exact match for Ys VIII Lacrimosa of Dana, and not finding it?

Same issue with the GOG version of Prince of Persia The Sands of Time. It seems that where Steam removes colons from game names GOG replaces them with hyphens. So if the name of the game is Prince of Persia: The Sands of Time, the steam folder name is Prince of Persia The Sands of Time and the GOG folder name is Prince of Persia - The Sands of Time.

This should be fixed by the same change that I made for #89, which will be included in the upcoming v0.11.0 release.


Loading GraphQL schema object, text, ast, or introspection json from JavaScript ES6 export

const schema = makeExecutableSchema({
  typeDefs,
  resolvers,
})

export default schema

gql-gen --schema ./**/schema.js --project ./server/models/

I'm using tsc to compile TS to JS, and loading the compiled schema.js
The schema created should be the right type, cause it's generated using makeExecutableSchema().

@webberwang do you get an error? I didn't understand what's the issue...
BTW, you don't have to compile TS before running the generator, you can use the TS file: https://github.com/dotansimha/graphql-code-generator#typescript-support

@dotansimha thanks, it was some issue with tsconfig.json I believe, ended up working later


separate label for defang/system related log messages

Build and CD logs are currently separated out by having separate labels (decker-app-image and cd) but some other system messages (e.g., the status=TASK_PENDING) have the same label as my app's logs, so it's impossible to filter them out.
2024-04-05T22:32:17.463023Z ey15dt80q9g4 decker-app-image INFO[0051] ENTRYPOINT ["/run"]
2024-04-05T22:32:17.463090Z ey15dt80q9g4 decker-app-image INFO[0051] No files changed in this command, skipping snapshotting.
2024-04-05T22:32:20.920167Z ey15dt80q9g4 decker-app-image INFO[0054] Pushing image to<PHONE_NUMBER>15.dkr.ecr.us-west-2.amazonaws.com/kaniko-build:decker-app-image-94697038-x86_64
2024-04-05T22:32:23.802650Z ey15dt80q9g4 decker-app-image INFO[0057] Pushed<PHONE_NUMBER>15.dkr.ecr.us-west-2.amazonaws.com/kaniko-build@sha256:f05fe086d68500be1ab9a7c9c828c41cff86b5677d7a82bcd1b1c08ed4404e9e
2024-04-05T22:32:42.262065Z ey15dt80q9g4 cd Update completed in 1m45.003793669s ; provisioning...
2024-04-05T22:32:43.008622Z tn9qf51j0533 decker-app url="/" requesting
2024-04-05T22:32:54.948907Z ey15dt80q9g4 decker-app status=TASK_PROVISIONING
2024-04-05T22:33:04.697789Z ey15dt80q9g4 decker-app status=TASK_PENDING
2024-04-05T22:33:11.790731Z ey15dt80q9g4 decker-app status=TASK_PENDING
2024-04-05T22:33:12.952001Z tn9qf51j0533 decker-app [DEBUGGER] IN –> Awareness/Update

If you add --verbose there's an additional column "source" which would be an IP address for your service logs, but fabric for the status updates. It's not consistent with our image builder, which shows decker-app-image (but also shows kaniko for the source column)

Related to #69 , partly fixed by #275

Closing in favor of #426


[Bug]: Enable formatter tests from query group by and collect

Description
$sujbect.
These cases should be enabled
"query_expr_source_120.bal","query_expr_source_121.bal","query_expr_source_122.bal","query_expr_source_123.bal", "query_expr_source_124.bal","query_expr_source_126.bal","keyword_source_01.bal", "keyword_source_02.bal"
Steps to Reproduce
No response
Affected Version(s)
No response
OS, DB, other environment details and versions
No response
Related area
-> Compilation
Related issue(s) (optional)
No response
Suggested label(s) (optional)
No response
Suggested assignee(s) (optional)
No response

Done with #40495


Move asset compilation to sprockets

We want babel.js like nobodies business.

Fixed with release of v0.4.3


Automatically update entries with tweet links

Now handled by https://github.com/molly/w3igg-crossposter


Add skip_missing keyword to populate!

In some cases you may want to fill a pre-allocated KeyedArray with table data and have it ignore key values that aren't in your pre-allocated array. This might be a nice way to gracefully avoid erroring here when the key indices aren't present?

Sounds good. It already takes on keyword force=false to disable over-writing, so maybe skip=false is the default too (all the data must end up in the container) while true keeps a subset.
(I guess subset and intersect are other words which could make some sense, but perhaps avoiding the suggestion that ::Missing is involved is good.)


Added Liamdev631 to MEMBERS

Hello! I'm a Masters student in CS from the USA, currently attending UESTC!
Welcome to UESTC Open Source Commnunity 👏

Add a issue link after Fix:, if you have created a issue

welcome


Add RenderRoot::request_render_all method

Add a method which brute-force resets the paint and accessibility flags for all widgets.

It's about rescaling, not resizing, for which layout works fine.
And yeah, it's also mean to support  frankvgompel's use case. Since they're working on a fork, the method doesn't need to be public.
I added a commit message, but I'm mostly of the opinion that a commit title alone is enough for self-explanatory changes like this?

Oops, yes, rescale vs resize ... I was wondering in my head that resize sounded wrong (why needed here).
For the commit message, I'd meant something that just stated why it was there, so in this case, that it forces a repaint of everything when layout and other stuff hasn't changed to otherwise cause a repaint, and that changing the DPI scale is the current usage.
But no matter ... this one is pretty clear.

We need to be careful to make sure people don't over-use this function.


Add an If function

Similar to the If predicate, but it conditionally applies a function.

Merged into develop.


Extention 'Prettier - Code Formatter' cannot format 'path/to/file.svelte'

I've installed v0.9.1, and set language-server.runtime too.
I cannot get any svelte file to format though, I always get a Extention 'Prettier - Code Formatter' cannot format 'path/to/file.svelte' in the code status bar.
the console for svelte only contains:
Using Svelte v3.4.3 from /Users/alexsanders/Dev/my-app/node_modules/svelte/compiler
Using Svelte v3.4.3 from /Users/alexsanders/Dev/my-app/node_modules/svelte/compiler
Using Svelte v3.4.3 from /Users/alexsanders/Dev/my-app/node_modules/svelte/compiler
Using Svelte v3.4.3 from /Users/alexsanders/Dev/my-app/node_modules/svelte/compiler
Using Svelte v3.4.3 from /Users/alexsanders/Dev/my-app/node_modules/svelte/compiler
Using Svelte v3.4.3 from /Users/alexsanders/Dev/my-app/node_modules/svelte/compiler
Using Svelte v3.4.3 from /Users/alexsanders/Dev/my-app/node_modules/svelte/compiler

so looks ok. am i doing something stupid?

i am! sorrty :)

I'm facing the same issue, what were you doing wrong? How did you fix it?

Nvm, I figured it out. Make sure to set the default formatter for svelte files as this extension, not prettier.


Add queue jobs check

This PR is adding the possibility to monitor queue jobs. It is working almost the same as the scheduled check. The only difference is that this check will just dispatch a job, and detects if the queue job is run within five minutes. If not, the check will fail.
This is how it can be registered.
use Spatie\Health\Facades\Health;
use Spatie\Health\Checks\Checks\QueueCheck;

Health::checks([
    QueueCheck::new(),
]);

And you can change the heartbeat check as you can do with the schedule check.
QueueCheck::new()->heartbeatMaxAgeInMinutes(10),

Also, one additional cron job needs to be registered in order to dispatch the heartbeat queue job.
// in app/Console/Kernel.php
use \Spatie\Health\Commands\QueueCheckHeartbeatCommand;

public function schedule(Schedule $schedule) {
    // your other commands

    $schedule->command(QueueCheckHeartbeatCommand::class)->everyMinute();
}

Not sure if 5 minutes would work for everyone, but let's discuss it only if this PR is acceptable to you. 🙂

I like the functionality 👍 Could you also add an example on how to track different queues?
The introduction of an HeartbeatCheck interface seems a bit overkill to me. Let's remove that and keep the different checks that rely on a heartbeat be independent of each other.

Hey @freekmurze, glad to hear that you like the functionality!
I have just two questions. By tracking different queues, do you mean something like this?
Health::checks([
    QueueCheck::new()->onQueue('email'),
]);

Or do you want the possibility to track many different queues? Something like this.
Health::checks([
    QueueCheck::new()->onQueues(['email', 'payment']),
]);

And the second question is, do you want to remove just the HeartbeatCheck interface and keep the HasHeartbeatCheck trait and abstract class HeartbeatCommand, or do you want to remove them as well?

Ideally, both of your code examples would work 🙂
I would remove both the abstract class and the trait. I like to keep all the check independent from each other.

Thanks for the clarification Freek.
Both abstract class and trait have been removed. Examples of tracking different queues are part of the docs file.
How it's working now? If you specify more than one queue that you want to track and if any of them fail, the result will be failed and in meta will be explained which queue failed and why. If all queues are fine, the result will be a success.
Let me know if anything else should be changed, or improved.

Thank you, I'll polish this a bit an release it 👍


purge the documents by filter

From doc :
http://developer.couchbase.com/documentation/mobile/1.1.0/develop/references/couchbase-lite/rest-api/database/post-purge/index.html
the purge operation effect database, but some times user only want to purge the Specific document, such as message document.

If  you are using native library, you can use Document.purge() method.
http://developer.couchbase.com/documentation/mobile/1.1.0/develop/references/couchbase-lite/couchbase-lite/document/document/index.html#void-purge
For rest API, you can refer CouchDB doc, 10.3.11. /db/_purge
http://docs.couchdb.org/en/latest/api/database/misc.html


Move to rebar

It will be great if chronos moves to rebar as build tool, since using erlang.mk has some issues when compiling mixed packages which uses the REBAR_DEPS_DIR env variable.
I'm not an erlang expert (just learing elixir now), otherwise will be more than happy to submit a PR for that.
(for reference: https://elixirforum.com/t/help-with-erlang-module-not-available-when-testing-in-travis/2338/10 )

I rewrote the entire library in Elixir, just to make it easier to include into my project.
I also used and adapted some of your descriptions, while giving all the references to this as the original project.
The library is here: https://github.com/xadhoom/etimer , if you have some comments on it, it will be more than welcome :)

I have talked to Essen and there should not be any problems using erlang.mk with Elixir.
But if you have  set REBAR_DEPS_DIR=$TRAVIS_BUILD_DIR/deps the you also need to do DEPS_DIR=$TRAVIS_BUILD_DIR/deps - otherwise it barfs on you.
Forking is fine, but I don't think it does anything good for the community. Basic features such as chronos should be done in Erlang for now. Right now it is a little too painful to include Elixir libraries in Erlang.

well I rewrote it just for easier inclusion in elixir projects, not for using it the pure erlang ecosystem, which makes no sense at all.

It should actually just work out of the box in Elixir.
Could you provide me with a minimal example of where it fails?
Then I will try to make it work.
My point is that core functionality such as Chronos, if started in Erlang should stay in Erlang because it will benefit both Erlang and Elixir.
Exceptions would be things that started in Elixir and grew, then the friction of calling them from Erlang would be worth it. Or things that are easier to do in Elixir, e.g., an inference rules engine or prime number generation would probably be easier to do in Elixir because you can choose to have mutable variables. The are more examples, but those where two that I ran into on the Erlang side once and now that we have Elixir I would not do them in Erlang anymore.

well, I'm really lost now.
I spent the last 3 hours trying to reproduce the issue here https://travis-ci.org/xadhoom/detectino-core/builds/174918404 but without any luck.
at this point, I really do not know what I was doing....

I notice another thing (that was already there and is still there): I have to add the :gproc dep in my mix.exs otherwise is not found during execution.
Also I need to start the gproc application from my stack, shouldn't it be started by :chronos app?

Ok, I have a sample scenario where is happens. But only on travis :/
Travis: https://travis-ci.org/xadhoom/chronos_test
Repo: https://github.com/xadhoom/chronos_test
Seems that it a travis issue? but really cannot understand where/why.
With other pure erlang libraries this is not happening.

Thanks for the info - I will look into it and see what I can do.
The gproc application thing might be an oversight on my part, but I think it ought to start when you start the chronos application - I will double check that.

When I start chronos using application:start(chronos) in the Erlang shell gproc is automatically started, so this might be an Elixir thing.
In my mix.exs experiment I tried this:
  defp deps do
    [{:chronos, git: "https://github.com/lehoff/chronos.git", tag: "0.1.3", manager: :make}]
  end

That does not fetch the gproc dependency, so either mix has an issue with erlang.mk or I don't know how to use it.
Anyway, I have read the erlang.mk manual and I can generate an rebar.config file from my erlang.mk file without any hassle. So I have done that in 0.1.4 and when you use that in mix.exs it will fetch the gproc dependency of chronos just fine.

Confirmed, using the 0.1.4 release makes it work correctly.
thanks!

I have received a PR which switches to rebar3, so this is now fully resolved.


Update to 1.18

Added en_gb language
updated fabric.mod.json to match 1.18 requirements and updated loader version to cover log4j exploit.
added a new icon
removed vanguard dep as its dead

Eagerly awaiting the day this update comes to be :D
(Also, vanguard caused problems for me a while ago--on the user end, anyway. Perhaps look into a different auto-update library?)

Eagerly awaiting the day this update comes to be :D
(Also, vanguard caused problems for me a while ago--on the user end, anyway. Perhaps look into a different auto-update library?)

Nah, Auto-update for mods is kind of a horrible idea for modpacks anyway.

Sadly my pr was the extent of my knowledge.
I don't know about updating gradle so unfortunately please decline this pr and someone else will have to take over

Don't mind the compiler failure, it failed because the java compiler is outdated. I can update this myself. But if you want to do it yourself, you can change this
To 17. However I still need to check if there isn't any other compilation issues that are present (hopefully there isn't any). I'll get back to you if theirs anything else that needs to he changed.

alrighty, the compiler is compiling it properly and this PR ready to merge! Ready when you are.

good to go!


Date text needs to be bigger for dates when editing form row

Also consider changing button text if date is set

Done in https://github.com/StAResComp/sifids/commit/cd06706316123340ccb30eff58caa75460e38d31


[fr] French translation of 1-4-single-board-computer-commands.md

[fr] French translation of 1-4-single-board-computer-commands.md file

Hello Mr @jimbobbennett , hope you're doing well. Here is a french translation suggestion for 1-4-single-board-computer-commands.md file

@ManuSquall - I'm no longer at Microsoft, so not sure who is managing this repo from now on.

Hello Mr Bennet, thank you for letting me know, wishing you success for your next adventures. Thanks also for the mainaining job done here 🙂 @jimbobbennett


Minor typo on KSPROPERTY_JACK_SINK_INFO page

KSJACK_SINK_INFORMATION is misspelled as "KSJACK_SINK_INFORMAITON" ('I' and 'T' swapped in "information") in the Usage Summary Table section, right after the table.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: b5e8652c-cce8-332b-ea54-907395e9a7d7
Version Independent ID: 784d72a2-2a30-9d62-60ac-9fc5c31cab85
Content: KSPROPERTY_JACK_SINK_INFO - Windows drivers
Content Source: windows-driver-docs-pr/audio/ksproperty-jack-sink-info.md
Product: windows-hardware
Technology: windows-devices
GitHub Login: @DOMARS
Microsoft Alias: domars

@rhymu8354 . thanks for pointing out. Error will be fixed Within a week

@rhymu8354 - We do like to have structure names properly spelled. So thanks for calling this out. And thanks to @RAJU2529 for creating a PR to fix it.


[WIP] Automate documentation build

any news? :p

Sadly no. Next week, I'll be back on track for Watson.


Deprecating -b BIN_DIR

Right now we have an almost hidden feature that

~/.sos/bin would be before anything
-b PATH would be preprended to $PATH.

This was designed to specify which command to use when there are multiple versions, but it would be a lot less flexible and useful to do
sos run workflow -b /path/to/R3.3

than
sos run -r host_p1

when host_r3.3 is defined with
module load R/3.3
sos run ....

since module load can do a lot more than setting $PATH.

Wel ... i use -b for many of my pipelines on my desktop where I keep the particular executable in a particularly analysis separately, instead of using more formal approaches such as conda env (or your example, module load). I think it still have its appeals. However I do also agree that users can always do export PATH=BIN_DIR:$PATH. So i dont have a very strong opinion on this matter.

The extended -r host feature that is being implemented in the 1319 branch allows you to predefine a number of "running environments" for your pipeline, which includes but not limited to conda activate, export PATH, module load, and allows for the more ambitious plan for https://github.com/vatlab/sos-notebook/issues/262 where a sandbox could be created before sos run, and do something following the execution of sos run. It is a much more flexible option than -b so I tend to deprecate -b.

This is nice -- sure I've got no issue to get rid of -b .
While we are on it, shall we also allow for step specific running environments, or we have this mechanism already? For example using some templates we configure a step to run something like conda activate, export PATH and module load ... This is also something I experience in benchmark applications where for example I have different git commits of the same software to compare performance against each other, from different conda environments. Dockerizing them would not work for cluster ...

There are several flavors of this

A multi-kernel online notebook (myjournal.com?) allows beyond the specification of "kernels" for each cell, to "environments", which are seemingly docker images. it is a nice extension to SoS Notebook's multi-kernel approach (which I do not know how to achieve under the current sos notebook framework).

However, even if we cannot do 1 under sos notebook, we could possibly do it under SoS, with something like

[step: env=refer_to_host_template]

A "wrapper" script for actions, conceptually like

[step]
sh:
    module load ... R3.3
   R:
      script

that let R  executed inside the environment created by sh is not possible, but we could allow
R: env=conf_template

where conf_template has the same syntax of job_template etc.

For a similar issue we have options such as

task: prepend_path

which I really do not like but sometimes need it. It could be unified to task: env=conf.
The bottom line is that what you are proposing is something I had in mind for a while but have not figured out the best approach yet, and it all these could be unified under a template approach that is being implemented for -r host.

R: env=conf_template
task: env=conf

I think this is good enough. And a different template should trigger reruns. But for really short environment specifically can we simply eg env="conda activate ..."?
Also I think env is already a task/action option. We need something else.

Also I think env is already a task/action option. We need something else.

env will be deprecated if we have the new feature. We do not need multiple features for (almost) the same purpose, even if one is a simplified version of another.
conf is possible but we are using a template, not a configuration.
template is a bit long but acceptable, the problem is that it does not say what a template does here.
So over all env seems like a good name for such an option.


Github relative links break in Hub

https://hub.kubeapps.com/charts/stable/kong

Tip: You can use the default values.yaml

values.yaml is a 404

should this be fixed in the app readme?

@andresmgot I don't think so, it's correct for Github. Maybe our markdown processor could find relative links and make them absolute to the source?

@andresmgot I don't think so, it's correct for Github. Maybe our markdown processor could find relative links and make them absolute to the source?

The problem is that not always the chart information contains a git source of the chart, and when it does it may refer to a different repository or not contain the full path to the chart so we have no way to construct the full path.

Yeah, unfortunately this is tricky, but chartsvc does extract the values.yaml file, and so maybe we can specifically look for values.yaml links and update them to the chartsvc location? We discussed surfacing values.yaml in some way in the brainstorm but I think this wasn't seen as a high priority.

Well in that case we can extract the root URL from the values.yaml and use it for any relative link in the README, isn't it?
We will still have broken links if the source repository gets modified (i.e. deleting a file) and the entry in the chartsvc is not but that would be corner cases.

Well in that case we can extract the root URL from the values.yaml and use it for any relative link in the README, isn't it?

Hmm, I'm not sure what you mean? Actually, I made a mistake in my earlier comment, chart-repo extracts values.yaml files, stores them in MongoDB and allows chartsvc to serve them https://github.com/helm/monocular/blob/master/cmd/chartsvc/handler.go#L189. We'd have to extend chart-repo to extract and store all files if we wanted chartsvc to serve any file from the chart package: https://github.com/helm/monocular/blob/master/cmd/chart-repo/utils.go#L365. Even then, we wouldn't be able to pick up relative links outside of chart directory (e.g. if the chart README in chart/kubeapps/README.md pointed to some documentation in docs/README.md).

Hmm, I'm not sure what you mean?

Never mind, I thought that the full URL of the values.yaml file was stored somehow.


Add missing docstrings

Very important to add missing documentation to docstrings that are empty at the moment.

#10 closes this issue. Now work on documentation should be carried on.


Loading features at low zoom level is slow.

At low zoom levels geoserver tries to display lots of features.  This bogs down the server.  Instead, filter which features get displayed based on their apparent size.  For example, when zoomed way out, buildings just look like dots; no need to load these.  Write a test to compare the feature area (F) to the corresponding pixel area (P) at that zoom level. For linestrings, compare feature length to pixel width.  Maybe something like:
feature_list = []
var threshold = pixelAreaAtZoomLevel * s
for (var i = 0; i < featureCandidates.length; i++) {
    if (featureCandidates[i].area > threshold) {
        feature_list.append(feature)
    }
}

We'll need to play around to find a reasonable value for "s"
This should only be done for polygons and linestrings. If rendering massive amounts of points ever becomes an issue, we can deal with that later.

Temp fix in 285a662.  Use Tile loading instead of bbox.  Still slow at low zoom, but at least browser isn't blocked.
Also added a cutoff.  features won't display at zoom levels lower than 10.
Closing until a better solution presents itself.


DESCRIPTION: remotes bioc::BiocParallel

hopefully resolves #29
remotes::install_*() knows where to find BiocParallel
tested with
docker run -it rocker/tidyverse Rscript -e 'remotes::install_github("WillForan/ComBatHarmonization/R/neuroCombat@patch-1")'

Thanks!


Incorrect type for icons property in manifest

The type definitions for "icons" in the manifest might be incorrect.
I am receiving the following type warning:

The correct usage for the "icons" can be found at Google's Web.dev, or at MDN  (and as seen in my screenshot).
I am a newbie at this, but this might be coming from the type definitions file (/dist/index.d.ts), the type of icons are mentioned as icons: Record<string, any>[];

Add the type entry with image/png, check any vite config on the examples directory

I apologize.
Even with the "type" it looks the same. What am I doing wrong?


REVEL data needs from LDH for the VCI

For the REVEL data, the VCI needs:

To request REVEL data via the LDH API using a variant ID
Get a response that includes:

The CAR variant ID
The REVEL score(s)
An explicit mapping of score to their related Ensembl Transcript(s)
An explicit mapping of the transcripts and their MANE status (MANE select, or MANE clinical plus or None)

This related to the following tickets: #350, #348

Hi @ldh-admin, can we assign this to you?

Yeah :)


Pagination not working correctly

I have the following response from API:
{
  "data": {
    "links": {
      "pagination": {
        "total": 2,
        "num_results": 2,
        "per_page": 10,
        "num_pages": 1,
        "current_page": 1,
        "skip": 0,
        "from": 1,
        "to": 10
      }
    },
    "orders": [\\This array has 2 items]
  }
}

This is HTML code to bind the table
<vuetable api-url="/api/orders"
          :fields="columns"
          :http-data="httpOptions"
          data-path="data.orders"
          pagination-path="data.links"
          :query-params="{ sort: 'sortorder', page: 'pageNo', perPage: 'limit'}"
          :item-actions="itemActions"
          :pagination-component="paginationComponent"
          :per-page="perPage"></vuetable>

The table is bound correctly, but the pagination displays
Displaying 0 to 0 of 0 items
What am I missing?

@abishekrsrikaanth What paginationComponent you are using?  The bundled one or your own?

@ratiw The one that is bundled. I tried removing the attribute :pagination-component too to make sure that it uses the default's. Still no luck.

@abishekrsrikaanth Looks like you're missing last_page in your pagination data structure.

No luck adding that to the pagination structure. This is the new structure
{
  "data": {
    "links": {
      "pagination": {
        "total": 2,
        "num_results": 2,
        "per_page": 10,
        "num_pages": 1,
        "current_page": 1,
        "skip": 0,
        "from": 1,
        "to": 10,
        "last_page": 1
      }
    },
    "orders": [

    ]
  }
}

@abishekrsrikaanth OK. Looks like your pagination-path reference is incorrect. From you data structure, it should be pagination-path="data.links.pagination".

ok, that helps. Now I see the pagination. But with the above result set, the pagination now shows
Displaying 1 to 10 of 2 items

@abishekrsrikaanth I think that's because your data.links.pagination.to is 10, not 2

OK, thank you. Is there a doc explaining what each property on the pagination structure is. I understand this is pretty basic stuff, but it would help a lot of confusion. Not just for me, but others too.

Have you looked at the wiki? https://github.com/ratiw/vue-table/wiki/Pagination-Component

@abishekrsrikaanth Not really. The pagination data structure is derived from Laravel's Pagination. I'm trying to make the documentation (wiki) as good as I can but, in my opinion, it is a lot harder than coding. :) And I may have unintentionally left something out.


Reading a StructArray column with an ExtensionType causes segfault

We can make nested columns in a Parquet file by putting a pa.StructArray in a pa.Table and writing that Table to Parquet. We can selectively read back that nested column by specifying it with dot syntax:
pq.ParquetFile("f.parquet").read_row_groups([0], ["table_column.struct_field"])
But if the Arrow types are ExtensionTypes, then the above causes a segfault. The segfault depends both on the nested struct field and the ExtensionTypes.
Here is a minimally reproducing example of reading a nested struct field without extension types, which does not raise a segfault. (I'm building the pa.StructArray manually with from_buffers because I'll have to add the ExtensionTypes in the next example.)

import numpy as np
import pyarrow as pa
import pyarrow.parquet as pq

one = pa.Array.from_buffers(
    pa.int64(),
    3,
    [None, pa.py_buffer(np.array([10, 20, 30], dtype=np.int64))],
)
two = pa.Array.from_buffers(
    pa.float64(),
    3,
    [None, pa.py_buffer(np.array([1.1, 2.2, 3.3], dtype=np.float64))],
)
record = pa.Array.from_buffers(
    pa.struct([
        pa.field("one", one.type, False),
        pa.field("two", two.type, False),
    ]),
    3,
    [None],
    children=[one, two],
)
assert record.to_pylist() == [
    {"one": 10, "two": 1.1},
    {"one": 20, "two": 2.2},
    {"one": 30, "two": 3.3},
]

table = pa.Table.from_arrays([record], names=["column"])
pq.write_table(table, "record.parquet")
table2 = pq.ParquetFile("record.parquet").read_row_groups([0], ["column.one"])
assert table2.to_pylist() == [
    {"column": {"one": 10}},
    {"column": {"one": 20}},
    {"column": {"one": 30}},
]

So far, so good; no segfault. Next, we define and register an ExtensionType,

import json

class AnnotatedType(pa.ExtensionType):
    def __init__(self, storage_type, annotation):
        self.annotation = annotation
        super().__init__(storage_type, "my:app")
    def __arrow_ext_serialize__(self):
        return json.dumps(self.annotation).encode()
    @classmethod
    def __arrow_ext_deserialize__(cls, storage_type, serialized):
        annotation = json.loads(serialized.decode())
        print(storage_type, annotation)
        return cls(storage_type, annotation)
    @property
    def num_buffers(self):
        return self.storage_type.num_buffers
    @property
    def num_fields(self):
        return self.storage_type.num_fields

pa.register_extension_type(AnnotatedType(pa.null(), None))

build the pa.StructArray again,

one = pa.Array.from_buffers(
    AnnotatedType(pa.int64(), {"annotated": "one"}),
    3,
    [None, pa.py_buffer(np.array([10, 20, 30], dtype=np.int64))],
)
two = pa.Array.from_buffers(
    AnnotatedType(pa.float64(), {"annotated": "two"}),
    3,
    [None, pa.py_buffer(np.array([1.1, 2.2, 3.3], dtype=np.float64))],
)
record = pa.Array.from_buffers(
    AnnotatedType(
        pa.struct([
            pa.field("one", one.type, False),
            pa.field("two", two.type, False),
        ]),
        {"annotated": "record"},
    ),
    3,
    [None],
    children=[one, two],
)
assert record.to_pylist() == [
    {"one": 10, "two": 1.1},
    {"one": 20, "two": 2.2},
    {"one": 30, "two": 3.3},
]

Now when we write and read this back, there's a segfault:

table = pa.Table.from_arrays([record], names=["column"])
pq.write_table(table, "record_annotated.parquet")

print("before segfault")

table2 = pq.ParquetFile("record_annotated.parquet").read_row_groups([0], ["column.one"])

print("after segfault")

The output, which prints each annotation as the ExtensionType is deserialized, is

before segfault
int64 {'annotated': 'one'}
double {'annotated': 'two'}
int64 {'annotated': 'one'}
double {'annotated': 'two'}
struct<one: extension<my:app<AnnotatedType>> not null, two: extension<my:app<AnnotatedType>> not null> {'annotated': 'record'}
Segmentation fault (core dumped)

Note that if we read back that file, {}record_annotated.parquet{}, without the ExtensionType, everything is fine:

Python 3.9.13 | packaged by conda-forge | (main, May 27 2022, 16:56:21)
[GCC 10.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import pyarrow as pa
>>> import pyarrow.parquet as pq
>>> table2 = pq.ParquetFile("record_annotated.parquet").read_row_groups([0], ["column.one"])
>>> assert table2.to_pylist() == [
...     {"column": {"one": 10}},
...     {"column": {"one": 20}},
...     {"column": {"one": 30}},
... ]

and if we register the ExtensionType but don't select a column, everything is fine:

Python 3.9.13 | packaged by conda-forge | (main, May 27 2022, 16:56:21)
[GCC 10.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import pyarrow as pa
>>> import pyarrow.parquet as pq
>>> import json
>>>
>>> class AnnotatedType(pa.ExtensionType):
...     def __init__(self, storage_type, annotation):
...         self.annotation = annotation
...         super().__init__(storage_type, "my:app")
...     def __arrow_ext_serialize__(self):
...         return json.dumps(self.annotation).encode()
...     @classmethod
...     def __arrow_ext_deserialize__(cls, storage_type, serialized):
...         annotation = json.loads(serialized.decode())
...         print(storage_type, annotation)
...         return cls(storage_type, annotation)
...     @property
...     def num_buffers(self):
...         return self.storage_type.num_buffers
...     @property
...     def num_fields(self):
...         return self.storage_type.num_fields
...
>>> pa.register_extension_type(AnnotatedType(pa.null(), None))
>>>
>>> table2 = pq.ParquetFile("record_annotated.parquet").read_row_groups([0])
int64 {'annotated': 'one'}
double {'annotated': 'two'}
int64 {'annotated': 'one'}
double {'annotated': 'two'}
struct<one: extension<my:app<AnnotatedType>> not null, two: extension<my:app<AnnotatedType>> not null> {'annotated': 'record'}
>>> assert table2.to_pylist() == [
...     {"column": {"one": 10, "two": 1.1}},
...     {"column": {"one": 20, "two": 2.2}},
...     {"column": {"one": 30, "two": 3.3}},
... ]
int64 {'annotated': 'one'}
double {'annotated': 'two'}
struct<one: extension<my:app<AnnotatedType>> not null, two: extension<my:app<AnnotatedType>> not null> {'annotated': 'record'}
int64 {'annotated': 'one'}
double {'annotated': 'two'}
struct<one: extension<my:app<AnnotatedType>> not null, two: extension<my:app<AnnotatedType>> not null> {'annotated': 'record'}
int64 {'annotated': 'one'}
double {'annotated': 'two'}
struct<one: extension<my:app<AnnotatedType>> not null, two: extension<my:app<AnnotatedType>> not null> {'annotated': 'record'}
int64 {'annotated': 'one'}
double {'annotated': 'two'}
struct<one: extension<my:app<AnnotatedType>> not null, two: extension<my:app<AnnotatedType>> not null> {'annotated': 'record'}
int64 {'annotated': 'one'}
double {'annotated': 'two'}
struct<one: extension<my:app<AnnotatedType>> not null, two: extension<my:app<AnnotatedType>> not null> {'annotated': 'record'}
int64 {'annotated': 'one'}
double {'annotated': 'two'}
int64 {'annotated': 'one'}
double {'annotated': 'two'}
struct<one: extension<my:app<AnnotatedType>> not null, two: extension<my:app<AnnotatedType>> not null> {'annotated': 'record'}
int64 {'annotated': 'one'}
double {'annotated': 'two'}
int64 {'annotated': 'one'}
double {'annotated': 'two'}
struct<one: extension<my:app<AnnotatedType>> not null, two: extension<my:app<AnnotatedType>> not null> {'annotated': 'record'}
int64 {'annotated': 'one'}
double {'annotated': 'two'}

It's just the case of doing both that causes the segfault.
Reporter: Jim Pivarski / @jpivarski
Watchers: Rok Mihevc / @rok
Note: This issue was originally created as ARROW-17539. Please see the migration documentation for further details.

Update on this issue: we encountered it "in the wild" in dask-contrib/dask-awkward#140. (As a work-around, the user has turned off ExtensionArray/ExtensionType, but that's not a long-term solution because it drops metadata in the Awkward ←→ Arrow conversion.)

So I've found the problem but haven't yet worked out the solution.  The segmentation fault occurs in reader.cc in GetReader.  The handling for extension type is:
  if (type_id == ::arrow::Type::EXTENSION) {
    auto storage_field = arrow_field->WithType(
        checked_cast<const ExtensionType&>(*arrow_field->type()).storage_type());
    RETURN_NOT_OK(GetReader(field, storage_field, ctx, out));
    *out = std::make_unique<ExtensionReader>(arrow_field, std::move(*out));
    return Status::OK();
  }

However, if the nested field is not loaded, then the recursive GetReader call sets out to nullptr and this code creates an ExtensionReader with a null storage reader.  This later crashes.
The fix is, unfortunately, not as simple as returning null.  The problem is that the Parquet reader is trying to maintain the nested structure.  As you see in your example that works, column.one yields a partial struct:
assert table2.to_pylist() == [
    {"column": {"one": 10}},
    {"column": {"one": 20}},
    {"column": {"one": 30}},
]

However, it is not clear that a partial "extension type" is a valid thing.  For example, imagine your extension type was a 2DPoint with "x" and "y".  What should be returned if the user loads points.x?  We can't maintain structure in that case.
I'm a little new to parquet and nested references so I don't know if there is a syntax we can use to ask for the nested columns without structure.  In this case you would get:
assert table2.to_pylist() == [
  { "one": 10 },
  { "one": 20 },
  { "one": 30 }
]

I will put together a PR that at least returns an invalid status in this case instead of a segmentation fault.


ImportError: cannot import name ServerSideRequestThrottlingException

Expected Behavior
Bot should start without crashing.
Actual Behavior
Latest dev version crashes upon starting bot.
Steps to Reproduce
Installed latest dev version using the following steps:
git clone --recursive -b dev https://github.com/PokemonGoF/PokemonGo-Bot
cd PokemonGo-Bot
virtualenv .
source bin/activate
pip install -r requirements.txt
cp ./configs/config.json.example ./configs/config.json

Then I edited only the following in configs/config.json:
auth_service
username
password
location
gmapkey
# ./run.sh
Traceback (most recent call last):
  File "pokecli.py", line 38, in <module>
    from pgoapi.exceptions import NotLoggedInException, ServerSideRequestThrottlingException, ServerBusyOrOfflineException
ImportError: cannot import name ServerSideRequestThrottlingException

Other Information
OS: Centos 7
Git Commit: (run 'git log -n 1 --pretty=format:"%H"' and paste it here)
361c0fa11783085ea201a71a99f6c43859e8c239
Python Version: (run 'python -V' and paste it here)
Python 2.7.5

Same problem here.
It was working perfectly until I ran a
git pull
I am using the configuration from the file configs/config.json.example

try pip2 install -r requirements.txt --upgrade

Running the following command after installing, resolved the issue:
# pip install -r requirements.txt

For some reason pgoapi wasn't installed the first time. I've have installed this multiple times with the same results.

C:\pk\PokemonGo-DEV>pip2 install -r requirements.txt --upgrade
Requirement already up-to-date: numpy==1.11.0 in c:\python27\lib\site-packages (from -r requirements.txt (line 1))
Requirement already up-to-date: networkx==1.11 in c:\python27\lib\site-packages (from -r requirements.txt (line 2))
Obtaining pgoapi from git+https://github.com/tejado/pgoapi.git@0811db23d639039f968a82e06c7aa15a0a5016b6#egg=pgoapi (from -r requirements.txt (line 3))
Skipping because already up-to-date.
Requirement already up-to-date: geopy==1.11.0 in c:\python27\lib\site-packages (from -r requirements.txt (line 4))
Requirement already up-to-date: protobuf==3.0.0b4 in c:\python27\lib\site-packages (from -r requirements.txt (line 5))
Requirement already up-to-date: requests==2.10.0 in c:\python27\lib\site-packages (from -r requirements.txt (line 6))
Requirement already up-to-date: s2sphere==0.2.4 in c:\python27\lib\site-packages (from -r requirements.txt (line 7))
Requirement already up-to-date: gpsoauth==0.3.0 in c:\python27\lib\site-packages (from -r requirements.txt (line 8))
Requirement already up-to-date: protobuf-to-dict==0.1.0 in c:\python27\lib\site-packages (from -r requirements.txt (line 9))
Requirement already up-to-date: googlemaps==2.4.4 in c:\python27\lib\site-packages (from -r requirements.txt (line 10))
Requirement already up-to-date: colorama==0.3.7 in c:\python27\lib\site-packages (from -r requirements.txt (line 11))
Requirement already up-to-date: enum34==1.1.6 in c:\python27\lib\site-packages (from -r requirements.txt (line 12))
Requirement already up-to-date: pyyaml==3.11 in c:\python27\lib\site-packages (from -r requirements.txt (line 13))
Requirement already up-to-date: haversine==0.4.5 in c:\python27\lib\site-packages (from -r requirements.txt (line 14))
Requirement already up-to-date: polyline==1.3.1 in c:\python27\lib\site-packages (from -r requirements.txt (line 15))
Requirement already up-to-date: python-socketio==1.4.2 in c:\python27\lib\site-packages (from -r requirements.txt (line 16))
Requirement already up-to-date: flask==0.11.1 in c:\python27\lib\site-packages (from -r requirements.txt (line 17))
Requirement already up-to-date: socketIO_client==0.7.0 in c:\python27\lib\site-packages (from -r requirements.txt (line 18))
Requirement already up-to-date: eventlet==0.19.0 in c:\python27\lib\site-packages (from -r requirements.txt (line 19))
Requirement already up-to-date: universal-analytics-python==0.2.4 in c:\python27\lib\site-packages (from -r requirements.txt (line 20))
Requirement already up-to-date: gpxpy==1.1.1 in c:\python27\lib\site-packages (from -r requirements.txt (line 21))
Requirement already up-to-date: mock==2.0.0 in c:\python27\lib\site-packages (from -r requirements.txt (line 22))
Requirement already up-to-date: timeout-decorator==0.3.2 in c:\python27\lib\site-packages (from -r requirements.txt (line 23))
Requirement already up-to-date: decorator>=3.4.0 in c:\python27\lib\site-packages (from networkx==1.11->-r requirements.txt (line 2))
Requirement already up-to-date: six in c:\python27\lib\site-packages (from pgoapi->-r requirements.txt (line 3))
Requirement already up-to-date: setuptools in c:\python27\lib\site-packages (from protobuf==3.0.0b4->-r requirements.txt (line 5))
Requirement already up-to-date: future in c:\python27\lib\site-packages (from s2sphere==0.2.4->-r requirements.txt (line 7))
Requirement already up-to-date: pycryptodomex>=3.0 in c:\python27\lib\site-packages (from gpsoauth==0.3.0->-r requirements.txt (line 8))
Requirement already up-to-date: python-engineio>=0.8.0 in c:\python27\lib\site-packages (from python-socketio==1.4.2->-r requirements.txt (line 16))
Requirement already up-to-date: click>=2.0 in c:\python27\lib\site-packages (from flask==0.11.1->-r requirements.txt (line 17))
Requirement already up-to-date: Werkzeug>=0.7 in c:\python27\lib\site-packages (from flask==0.11.1->-r requirements.txt (line 17))
Requirement already up-to-date: Jinja2>=2.4 in c:\python27\lib\site-packages (from flask==0.11.1->-r requirements.txt (line 17))
Requirement already up-to-date: itsdangerous>=0.21 in c:\python27\lib\site-packages (from flask==0.11.1->-r requirements.txt (line 17))
Requirement already up-to-date: websocket-client in c:\python27\lib\site-packages (from socketIO_client==0.7.0->-r requirements.txt (line 18))
Requirement already up-to-date: greenlet>=0.3 in c:\python27\lib\site-packages (from eventlet==0.19.0->-r requirements.txt (line 19))
Requirement already up-to-date: funcsigs>=1; python_version < "3.3" in c:\python27\lib\site-packages (from mock==2.0.0->-r requirements.txt (line 22))
Requirement already up-to-date: pbr>=0.11 in c:\python27\lib\site-packages (from mock==2.0.0->-r requirements.txt (line 22))
Requirement already up-to-date: MarkupSafe in c:\python27\lib\site-packages (from Jinja2>=2.4->flask==0.11.1->-r requirements.txt (line 17))
Requirement already up-to-date: backports.ssl-match-hostname in c:\python27\lib\site-packages (from websocket-client->socketIO_client==0.7.0->-r requiremen
ts.txt (line 18))
Installing collected packages: pgoapi
Running setup.py develop for pgoapi
Successfully installed pgoapi-1.1.0
C:\pk\PokemonGo-DEV>up
C:\pk\PokemonGo-DEV>git reset --hard
HEAD is now at 2f91fd0 Fix to display stats on iterm2 terminal (#2440)
C:\pk\PokemonGo-DEV>git pull -f
Already up-to-date.
C:\pk\PokemonGo-DEV>python pokecli.py
Traceback (most recent call last):
File "pokecli.py", line 38, in
from pgoapi.exceptions import NotLoggedInException, ServerSideRequestThrottlingException, ServerBusyOrOfflineException
ImportError: cannot import name ServerSideRequestThrottlingException
C:\pk\PokemonGo-DEV>

@paulohdc start it with python2?

Run pip install -r requirements.txt several times should fix this issue.
But I still don't know why it install pgoapi all the time, shouldn't it be already up-to-date?

@sgitkene Python 2.7.8 (default, Jun 30 2014, 16:03:49) [MSC v.1500 32 bit (Intel)] on win32
Type "help", "copyright", "credits" or "license" for more information.

@sgitkene Now i know what is wrong
have to do scripts\activate then python pokecli.py -cf ./configs/config.json
the pronpt look like this (PokemonGo-Bot) C:\PokemonGo-Bot>
if i close the pronpt you have to type again scripts\activate to work !!

Hi guys, i have same problem and i have executed the command line "pip install -r requirements.txt" , 5 - 6 times.
I don't know where is the problem, i have no error when i install all package from requirements.txt...
When i run pokecli i have this error :  cannot import name ServerSideRequestThrottlingException... Help me pls...

@AnthonyBSDE @lnedry
i resolved this with the help description: http://stackoverflow.com/questions/26053982/error-setup-script-exited-with-error-command-x86-64-linux-gnu-gcc-failed-wit because when i install the requirements file, the terminal prints me a error of this, you can try this ! and re-install the requirements file with 'sudo' permission:
$ sudo pip2 install -r requirements.txt --upgrade
Elementary OS Freya
3.19.0-66-generic
64 bit
Python 2.7


Update sbt-converter to 1.0.0-beta40

Updates org.scalablytyped.converter:sbt-converter from 1.0.0-beta37+33-45b800b3-SNAPSHOT to 1.0.0-beta40.
GitHub Release Notes
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Adjust future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.scalablytyped.converter", artifactId = "sbt-converter" } ]

Or, add this to slow down future updates of this dependency:
dependencyOverrides = [{
  pullRequests = { frequency = "@monthly" },
  dependency = { groupId = "org.scalablytyped.converter", artifactId = "sbt-converter" }
}]

labels: sbt-plugin-update, early-semver-pre-release, semver-spec-pre-release, commit-count:1

Superseded by #161.


Behavior of build.sh --clean

Our build script has two types of cleaning the source tree:

--clean: removes the DAPHNE build directories and the dependencies
--cleanAll: everything that --clean does plus downloaded packages and extracted 3rd party sources

Imho this would be more practical:

--clean: remove bin, build, lib from DAPHNE source tree
--cleanAll: all from --clean plus compiled 3rd party deps
--cleanDownloadCache: (name is just a suggestion) remove the downloaded packages and extracted sources

The idea originated from how often I needed one of these three in the past.

Hi @corepointer, I think this is a very good idea, especially since it allows removing the DAPHNE-specific artifacts without removing anything from the third-party dependencies.
I also agree with what these three steps should remove. Regarding the wording, I suggest:
--clean: removes bin, build, lib
--cleanDeps: removes thirdparty/build, thirdparty/installed, thirdparty/*.install.success, thirdparty/llvm-last-built-commit.txt
--cleanCache (or --cleanDownloads): removes thirdparty/download-cache, thirdparty/sources, thirdparty/*.download.success, and thirdparty/llvm-project (except for thirdparty/llvm-project/.git)
--cleanAll: combines --clean, --cleanDeps, and --cleanCache
The first three options remove disjoint sets of directories/files. Then, to my mind, --cleanAll should really remove all of them.

Thx for your comments @pdamme  I'll make it so ;-)


Aditional options

Great gem. I was thinking that would be good to allow:

sort gems by date
output in json/yaml/whatever format
hide the "Unknown" gems... or adding them in another json/yaml key, in case that those formats are supported

Yes, sorting by date is by far the most useful way to sort the output.  The current sorting creates an impediment to using the information since we must scan the whole column and try to remember which gems are oldest and most in need of looking for updates.


x/tools/gopls: add tests for configuration options

We recently had a regression in the configuration options.
We should add tests to ensure that these options are applied correctly.

Hi @stamblerre , I would like to work on this. Can you be more specific? What should be tested?

The options are configured in https://github.com/golang/tools/blob/master/internal/lsp/source/options.go, and I think the way to test them would be by testing the different settings for features like "HoverKind" and "ExperimentalDisabledAnalyses". The options are modified through the tests (see here and here), but they could also be modified in the internal/lsp/cmd tests.

Hi @stamblerre , I created some tests for configuration options, but the current documentation of contributing seems to be incomplete, and I would like to know if I can just send a PR on this repository on Github. Could you help me?

Awesome, thanks for doing that, @msAlcantara! You can absolutely send a PR--take a look at the instructions here: https://golang.org/doc/contribute.html, specifically https://golang.org/doc/contribute.html#sending_a_change_github.


HTTP POST fails with content larger than 1MB when using 'forge run web'

To Reproduce

Create an app that allows you to upload files.
Attempt to execute a HTTP POST with content > 1MB.

Expected behaviour
The app should run.
Related information:
Current workaround is to increase the post size of express by manually editing the generated node sources as follows:
var app = express();
app.use(express.json({limit: ‘5mb’}));
app.use(express.urlencoded({limit: ‘5mb’}));

Forum topic:
https://community.trigger.io/t/update-forge-web-build-to-current-node-express/1075/2

Fixed in: v2.9.1beta-3


Add Russ Perry

Hello! I added my name to the data.json file. Let me know if there are any issues!

Looks good Russ, just 1 small change request - I made it inline, hopefully it is clear, any questions let me know 🤓

Oops, my bad! I am used to putting the hanging commas in my code! I think I submitted the change? 😂

We do the trailing comma in typescript too, we all do it, silly json 🤓


How to generate *.lstm file from *.trainneddata file

I was trying to fine tune the ara.traineddata model. I was wondering how I could generate the ara.lstm file from ara.traineddata file. @Shreeshrii Can you please help me out?

echo -e "\n***** Extract LSTM model from best traineddata for $STARTMODEL. \n"
combine_tessdata -u ../tessdata/best/$STARTMODEL.traineddata ../training/$TRAINDIR/$STARTMODEL.

Please change the paths as needed.

https://github.com/tesseract-ocr/tesseract/blob/master/doc/combine_tessdata.1.asc
Specify option -e if you would like to extract individual components from a combined traineddata file. For example, to extract language config file and the unicharset from tessdata/eng.traineddata run:
combine_tessdata -e tessdata/eng.traineddata
/home/$USER/temp/eng.config /home/$USER/temp/eng.unicharset

So I had tried extracting the unicharset  from tessdata_best/ara.traineddata . But I'm not able to extract the ara.unicharset file from it . I'm getting the following error as shown in the image.

The ara.traineddata file is present in the same directory . Can you please help me out? @Shreeshrii

ara.unicharset is for legacy engine.
you can extract ara.lstm-unicharset
Alternately just unpack whole traineddata for all files.
combine_tessdata -u ara.traineddata ara.
On Thu, Jun 18, 2020 at 5:31 PM Talha Chafekar<EMAIL_ADDRESS>wrote:

So I had tried extracting the unicharset from
tessdata_best/ara.traineddata . But I'm not able to extract the
ara.unicharset file from it . I'm getting the following error as shown in
the image.
[image: Screenshot from 2020-06-18 17-30-11]
https://user-images.githubusercontent.com/42352729/85017654-72a0d400-b189-11ea-86a7-a26dccba4a46.png
The ara.traineddata file is present in the same directory . Can you please
help me out? @Shreeshrii https://github.com/Shreeshrii
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/tesseract-ocr/tesstrain/issues/169#issuecomment-645971091,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABG37IZVMZOXEAV5GMOD3ALRXH63FANCNFSM4OBO5XEA
.

--

भजन - कीर्तन - आरती @ http://bhajans.ramparivar.com

Got the config and lstm and unicharset from ara.traineddata (tessdata_best) . But I am having trouble in fine-tuning the ara.traineddata from 'tessdata_best' .
I am getting the following error :

Can you please help @Shreeshrii
I am using the following code for fine tuning :
finetune: lists 	mkdir -p data/checkpoints 	lstmtraining \ 	--continue_from ara.lstm \ 	--traineddata ara.traineddata \ 	--train_listfile data/ara/list.train \ 	--eval_listfile data/ara/list.eval \ 	--model_output ./data/checkpoints/ara \ 	--max_iterations 10000
All the list.train and list.eval files are properly generated  which consists of *.lstmf files from my data.
But still , I am getting the encoding train

Does your training data have characters which are not there in ara.lstm-unicharset?
If so, you will need to do different kind of training.

Nope. My training data just  consists of numbers along with '('  and  ',' . Even for ground truth consisting of only numbers , it is giving the error for encoding missing .

Looked at the unicharset file. It did not have any arabic numerals. Is there any way in which I can add any required characters in the lstm unicharset file? @Shreeshrii

@Shreeshrii My training data has characters which are not there in the extracted lstm-unicharset file.So any way in which I can update the lstm-unicharset file?

RTL training needs special considerations. Please see
https://github.com/tesseract-ocr/tesstrain/wiki/Arabic-Handwriting
Also see this pending PR.
https://github.com/tesseract-ocr/tesstrain/pull/159
On Fri, Jun 19, 2020, 23:24 Talha Chafekar<EMAIL_ADDRESS>wrote:

@Shreeshrii https://github.com/Shreeshrii My training data has
characters which are not there in the extracted lstm-unicharset file.So any
way in which I can update the lstm-unicharset file?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/tesseract-ocr/tesstrain/issues/169#issuecomment-646792055,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABG37I7365JD3HFIJW3A7YTRXOQ6PANCNFSM4OBO5XEA
.

Hi @Shreeshrii  , I had another doubt . When I am putting the ground truth of my Arabic image in English, I am not getting any error , but when my ground truth is in Arabic numerals , I am getting the encoding error.  These English numerals are also present in the ara.lstm-unicharset file. Does this mean that my unicharset  maps to the gound truth of my training data?  Can you please help me out?

There 4 different ways of lstmtraining depending on your need, starting
with 'impact' which can be used for adding  a new font to existing
traineddata to 'scratch' which is for a totally new one.
The commands and requirements are different for each.
If you are adding the Arabic numerals then you cannot do impact style
training.
The unicharset in your starter traineddata needs to be based on your
training text.
On Mon, Jun 22, 2020, 18:26 Talha Chafekar<EMAIL_ADDRESS>wrote:

Hi @Shreeshrii https://github.com/Shreeshrii , I had another doubt .
When I am putting the ground truth of my Arabic image in English, I am not
getting any error , but when my ground truth is in Arabic numerals , I am
getting the encoding error. These English numerals are also present in the
ara.lstm-unicharset file. Does this mean that my unicharset maps to the
gound truth of my training data? Can you please help me out?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/tesseract-ocr/tesstrain/issues/169#issuecomment-647501506,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABG37IZTVX52EZ65B53ZYCTRX5IGRANCNFSM4OBO5XEA
.

Oh! So does it mean that the unicharset depends on the text in the ground truth?
For example : This is my image

And this is my corresponding ground truth

Also , will it be the right way to do it?

@Shreeshrii I am able to fine tune the model . Thanks a lot for your help :) . However , I am facing one problem . My digits are getting reversed , but my text is getting detected properly ( both for Arabic ) . Can you please tell how I should go about solving this problem?

@theraysmith I was trying to fine tune Arabic , but my digits are getting reversed , but my text is getting detected properly ( both for Arabic ) . Can you please tell how I should go about solving this problem?

Please see this earlier message
Also see this pending PR.
https://github.com/tesseract-ocr/tesstrain/pull/159
The bidi algorithm needs to be used to reverse the Arabic text. The
numerals are not treated as RTL.
@stweil Did you do any further training for Arabic? Any suggestions.
On Wed, Jun 24, 2020, 19:30 Talha Chafekar<EMAIL_ADDRESS>wrote:

@theraysmith https://github.com/theraysmith I was trying to fine tune
Arabic , but my digits are getting reversed , but my text is getting
detected properly ( both for Arabic ) . Can you please tell how I should go
about solving this problem?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/tesseract-ocr/tesstrain/issues/169#issuecomment-648838949,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABG37I6OSB6BZHJPYPSSSQDRYIBJPANCNFSM4OBO5XEA
.

Oh! @Shreeshrii . I had one more doubt. What does target error mean in the makefile? Is it validation error or training error?

see https://tesseract-ocr.github.io/tessdoc/TrainingTesseract-4.00.html
get_error_rate double 0.01 Stop training if the mean percent error rate
gets below this value.
On Fri, Jun 26, 2020 at 5:11 PM Talha Chafekar<EMAIL_ADDRESS>wrote:

Oh! @Shreeshrii https://github.com/Shreeshrii . I had one more doubt.
What does target error mean in the makefile? Is it validation error or
training error?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/tesseract-ocr/tesstrain/issues/169#issuecomment-650134804,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABG37I6JZZAQUKWCQJHFCODRYSCQNANCNFSM4OBO5XEA
.

--

भजन - कीर्तन - आरती @ http://bhajans.ramparivar.com


UXPROD-3903: Upgrade MDEW to version 4.0.0

UXPROD-3903: This PR will merge team @folio-org/bama's changes in MDEW to support the new bursar export configuration feature. It includes changes to the old batch job with additional filters and formatting tokens, and also an additional batch job for aggregating data by patron. This PR must be merged as the same time as mod-data-export-spring and ui-plugin-bursar-export.

[!IMPORTANT]
https://github.com/folio-org/folio-export-common/pull/64 must be merged and folio-export-common pointed back to master before this PR is merged.

General remark - please, use project codestyle.

Here is the two screenshots of the Karate that these changes are related to tests passing. I will try to upload the e2e tests tommorow.

@danetsao , karate test should be executed also for bulk-operations because it uses worker/spring functionality.

not only bulk-edit, but all other jobs like EDIFACT, authorities export etc

Here is a compressed folder with screenshots of all relevant karate tests passing. It was run with the following areas common,testrail-integration,acquisitions,mod-audit,mod-bulk-operations,mod-bulk-edit.
UXPROD3903_Karate_Tests.zip

@danetsao , are there any blockers to merge it? If not, please, go ahead.


Inconsistency in ContractRequestMessage

In the procotol, we define that a ContractRequestMessage contains either a dspace:offer or dspace:offerId. This is not reflected in the schema.

@juliapampus where exactly? I can't find the text that allows dspace:offerId

@matgnt Oh sry, wrong link.. here is the section: https://github.com/International-Data-Spaces-Association/ids-specification/blob/main/negotiation/contract.negotiation.binding.https.md#261-post

could be a leftover?

While we review this file, there are broken json examples, that are missing comma at the end
{
"@context": "https://w3id.org/dspace/v0.8/context.json",
"@type": "dspace:ContractRequest"    <----- here missing comma
"dspace:consumerPid": "urn:uuid:32541fe6-c580-409e-85a8-8a9a32fbe833",
and also in next json example and
3.2.1 POST
"@context": "https://w3id.org/dspace/v0.8/context.json",
"@type": "dspace:ContractOfferMessage"    <--- here
"dspace:providerPid": "urn:uuid:dcbf434c-eacf-4582-9a02-f8dd50120fd3",
and its response example

should be fixed with #184

will check again before closing the issue

I can't find any more inconsistencies.


how to disable Latest Articles?

Thank you very much

Hey @husani925 ! Please have a look at my updated Portfolio Minimal starter project. There you can choose easily which sections should be included on your page (see example).
Hope this helps 😊

Thank you very much you are the best, if I just discovered it, I like the minimalist template, I will use it for my portfolio humbersanchez.com

Looks awesome 😁 I will close this issue here, have fun exploring the theme!


[Wait for #2663][Mixed Precision] Fix gradient clipping logic

[Mixed Precision] Fix gradient clipping logic
update mixed precision - gradient clipping logic

when gradient clipping, gradient should unscale before calc l2norm

Resolves:

#2746

Self evaluation:

Build test:   [X]Passed [ ]Failed [ ]Skipped
Run test:     [X]Passed [ ]Failed [ ]Skipped

Signed-off-by: Donghak PARK<EMAIL_ADDRESS>

:memo: TAOS-CI Version: 1.5.20200925. Thank you for submitting PR #2749. Please a submit 1commit/1PR (one commit per one PR) policy to get comments quickly from reviewers. Your PR must pass all verificiation processes of cibot before starting a review process from reviewers. If you are new member to join this project, please read manuals in documentation folder and wiki page. In order to monitor a progress status of your PR in more detail, visit http://ci.nnstreamer.ai/.

:octocat: cibot: @DonghakPark, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2749-202410081648530.3276469707489-2d4e34793f8bee4d6bcada6961a4d3345e7e8d56/.

:octocat: cibot: @DonghakPark, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2749-202411251023080.00036811828613281-2a4167753060e51f0e04d20b8a66a6611ada5977/.

Is this about gradient "clipping"..? or just loss scaling

This PR about "loss scaling" at gradient clipping logic in case Mixed Precision


Remove duplicate binaries during install

What does this PR try to resolve?
close https://github.com/rust-lang/cargo/issues/12866
Deduped the binaries by name.
How should we test and review this PR?
See the unit test changes.
Additional information
Should we pick up a bigger version here? For example: cargo install foo@1 foo@2 Should we pick the last one here?

@bors r+
Thanks!

:pushpin: Commit 731ae05ae364db7c0df8ad319162cfcd7bd59919 has been approved by weihanglo
It is now in the queue for this repository.

:hourglass: Testing commit 731ae05ae364db7c0df8ad319162cfcd7bd59919 with merge fcc3786d731efe9020a43018ce4664398eb1120a...

:sunny: Test successful - checks-actions
Approved by: weihanglo
Pushing fcc3786d731efe9020a43018ce4664398eb1120a to master...

Thanks for your review!  💚 💙 💜 💛 ❤


Don't run init during validate command

If users want to run init, they can do it explicitly themselves. Running
init unnecessarily slows down command execution.

Actually, I looked closer and it seems like every command re-runs init. Why is that?

Hi @alexjurkiewicz! Thank you for bringing this up. The intention here is that every command can function as an isolated abstraction which exercises terraform's core functionality. One of the benefit of Orbs is users have the ability to include bits and pieces as they see fit in their own configuration. The intention is that should someone quickly wish to validate a module or run plan against their infrastructure, they don't have to explicitly run init. You make a good point however. We could update the Orb to make init a boolean parameter. What are your thoughts?

Personally, I am most interested in an orb that installs a specified
Terraform version and does nothing else. Like this GitHub action:
https://github.com/hashicorp/setup-terraform
Hashicorp originally published an action similar to what is built here,
with high level pre defined commands. But it was awkward and difficult to
use.
Terraform workflows are so widely different that there is little cross
company common ground, as seen by this issue.
More importantly, "lifting up" a command line tool into a CI "step" is more
of an impedance mismatch than productivity boost. Using Terraform anywhere
else is as a shell script. But in circleci the canonical way is as yaml
directives? Weird.
So at the moment I personally don't see much value added by this orb
(lifting up Terraform commands to circleci steps). But it's adjacent to
something extremely useful (install a specified version of Terraform rather
than relying on the image default).
I hope this is helpful 🙏. Appreciate your work on this always.
On Wed, 14 Oct 2020, 6:22 am Christopher Black<EMAIL_ADDRESS>wrote:

Hi @alexjurkiewicz https://github.com/alexjurkiewicz! Thank you for
bringing this up. The intention here is that every command can function as
an isolated abstraction which exercises terraform's core functionality. One
of the benefit of Orbs is users have the ability to include bits and pieces
as they see fit in their own configuration. The intention is that should
someone quickly wish to validate a module or run plan against their
infrastructure, they don't have to explicitly run init. You make a good
point however. We could update the Orb to make init a boolean parameter.
What are your thoughts?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/CircleCI-Public/terraform-orb/pull/7#issuecomment-707956403,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAC4U5LVVU2LDXSAQI6F5T3SKSSGDANCNFSM4RWS2ATQ
.

Just adding (as a non-terraform user) init could also be a boolean type parameter if that makes sense, to optionally run. It could be on by default as well if that makes sense.

@alexjurkiewicz thank you for such a thoughtful explanation. We've been thinking about adding additional functionality that addresses the scenario you described, i.e. installing a specific & configuring terraform version. We might prioritize this as we continue to iterate on the orb. Additionally, it seems valuable to parameterize the init command to @KyleTryon's point. Definitely keep your eyes out for an update very soon!


weird blue texture when using facewarp

https://github.com/cubiq/ComfyUI_IPAdapter_plus/issues/574
So, i have tried using basic workflow, the texture still appeared.
Here is my workflow
workflow (1)-issue.json

picture used :

*i seek a way to solve this using vae decode and encode after facewarp nodes and before entering face bounding box nodes. this can fix the issue at the moment.

seems to be a problem with insightface, I applied a patch that should solve this issue

Thank you very much!


Snapraid-runner error after updating conf file

have been using Snapraid (using the Snapraid-Runner scripts) for a few months and everything works fine. My wife has been moving lots of files around and today I noticed that it is not deleting because the script has a delete threshold of 80. I updated the snapriad-runner.conf file to deletethreshold = 6000 and it died when i tried to run it. This is the message I get
2022-03-10 15:18:01,140 [INFO ] ============================================================
2022-03-10 15:18:01,141 [INFO ] Run started
2022-03-10 15:18:01,141 [INFO ] ============================================================
2022-03-10 15:18:01,142 [INFO ] Running diff...
2022-03-10 15:18:01,161 [OUTERR] Invalid command '{\rtf1\ansi\deff0\nouicompat{\fonttbl{\f0\fnil\fcharset0' in 'C:/Snapraid/snapraid.conf' at line 1
2022-03-10 15:18:01,462 [ERROR ] Run failed due to unexpected exception:
Traceback (most recent call last:)
File "c:\Snapraid\snapraid-runner-0.5-daily\snapraid-runner.py", line 233, in main
run()
File "c:\Snapraid\snapraid-runner-0.5-daily\snapraid-runner.py", line 260, in run
diff_out = snapraid_command("diff", allow_statuscodes=[2])
File "c:\Snapraid\snapraid-runner-0.5-daily\snapraid-runner.py", line 72, in snapraid_command
raise subprocess.CalledProcessError(ret, "snapraid " + command)
subprocess.CalledProcessError: Command 'snapraid diff' returned non-zero exit status 1.
I have tried changing the threshold to -1 which should turn it off completely but I get the same message. I am pretty sure I am saving the file wrong but not sure what I am doing (I can tell in notepad that it is saving as UTF-8), if that matters.

It looks like you edited the file in Wordpad? What editor are you using exactly?

The first time it didn’t work was after I used Wordpad. I then went into the example Conf file and used Notepad and still had the issue.  Maybe the hidden codes were there but since they are hidden I don't know how to get rid of them.

This has been fixed.  I downloaded and got new conf example files and updated them.  The opening of the file in Wordpad corrupted them (obviously) and that was causing the issue.


Update migrate-third-party-resource.md

The code highlight is unnecessary here.

This change is

This change is a matter of opinion. Given how relatively new CRDs are, I'm disinclined to undo emphasis that seems to have been added by the original author in an effort to make sure that folks didn't break things moving from the older model to the newer one.


Raven doesn't work in Chrome App

Chrome blocked the image requesting in Chrome App for improving security. So the function makeRequest doesn't work in Chrome App.
I patched raven-js for using it in Chrome App here
But there are two problems with my patch:

HTTP GET requesting doesn't have an Origin or a Referer header. So I have to use client secret here to pass the authorization check.

Sentry doesn't allow to set Allowed domain into Chrome App URL like chrome-extension://*/. So I have to use a single wildcard here.

Any better solutions? Thanks!

Hi everyone, I can't quite follow what is expected/not expected to currently work, but I just wanted to report my findings from including raven-js 1.1.16 in a Chrome extension:

I did not have to patch Raven at all i.e. I didn't run into the transport issues initially described by @fanzeyi.

I was able to use the public DSN seemingly despite the comments above from @mattrobenolt et al. about having to include the private/secret keys.

I reproduced @fanzeyi's initial report that Sentry doesn't allow you to add an 'Allowed domain' of chrome-extension://*/ or even chrome-extension://{{ your id }}. So, I had to allow all origin URLs using *. :(

Despite the above, I was able to whitelist and include Chrome extension URLs. My extension modifies Gmail, so I configured Raven like this:
Raven.config(clientDSN, {
  whitelistUrls: [/^chrome-extension:\/\//, /mail.google.com/],
  includePaths: [/^chrome-extension:\/\//, /mail.google.com/]
});

That is, the first match pattern of each array whitelists/includes the background scripts, the second the content scripts.
So, from my perspective it looks like the the only bug is that we can't restrict the origin URLs (#2 above). Any chance you could help with that @mattrobenolt? :)


remove libmagic

This PR:

removes dependency on libmagic (calculates mime types)
adds test to verify mime-type automatically added

LGTM


Line 31: Unexpected token <

var React = require('react');
var ReactBootstrap = require('../../assets/js/react-bootstrap.min.js');
var Input = ReactBootstrap.Input;
var Button = ReactBootstrap.Button;
var ProxyInput = React.createClass({
getInitialState: function(){
    return {
        urlValue: this.props.urlValue
    }
},

_handleClearUrlValue: function(e){
    e.stopPropagation();
    e.preventDefault();
    this.setState({
        urlValue: ''
    })
},

_handleChangeUrlValue: function(e){
    this.setState({
        urlValue: this.refs.inputElement.getValue()
    })
},

render: function() {
    return (
        <Input
            ref='inputElement'
            value={this.state.urlValue}
            type={ 'text'}
            label={ this.props.label}
            placeholder={ 'Enter value'}
            addonBefore={ 'URL:'}
            onChange={this._handleChangeUrlValue}
            buttonAfter={ <Button
                            onClick={this._handleClearUrlValue}
                            bsStyle={ 'default'}>

                          </Button>
            }>
            <Grid>
                <Row>
                    <Col/>
                </Row>
            </Grid>
        </Input>
    );
}

});
module.exports = ProxyInput;

Hi @ipselon, can you try your code here?
http://requirebin.com/embed?gist=0d67452e01754269660f
If you paste your code you will see it is formatted properly can you post your configuration for esformatter and the version of esformatter you are using?
Regards

I got the same problem using it with https://github.com/ionutvmi/sublime-jsfmt in Sublime Text 3
Steps to reproduce

install https://github.com/ionutvmi/sublime-jsfmt in sublime
add esformatter-jsx in the user-config of that package
add jsx to supported formats in the user-config of that package
npm install esformatter-jsx in sublime-jsfmt root-folder
format a .jsx file with pointy brackets (xml)
Error returned

Error:

... Unexpected token <

Maybe this is rather related to the esformatter but I thought I'd post it here since Google led me here.
Cheers

@pixelass check your version of esformatter (do npm ls esformatter) in the folder of sublime-jsfmt root, if it is less that 0.7.0 then you might want to install<EMAIL_ADDRESS>doing npm i<EMAIL_ADDRESS>Basically the issue is that esformatter lesser than 0.7.0 won't understand jsx, and it required the old trick of replacing the jsx constructs to make it pass thru the parser. esformatter greater or equal than 0.7.0 do understand jsx so need for that trick.

@royriojas it tells me there is no version 1.0.9

version not found<EMAIL_ADDRESS>
I tried 1.0.8 but the formatting is just overly wrong
example:
first let starts one level too deep
handleKeyup(e) {
  if (this.props.listen) {
      let charCode = e.which;
      if (charCode === 37 || charCode === 38) {
        this.props.prev();
      } else if (charCode === 39 || charCode === 40) {
        this.props.next();
      }
    }
  }

btw... jsfmt uses "esformatter": "^0.5.1"

try upgrading esformatter to 0.7.0 in the jsfmt folder
Also do you see the same behavior here?
http://requirebin.com/embed?gist=0d67452e01754269660f
Paste you code above and see if you can see the same issue you're mentioning

O so I just test this:
class someClass {
handleKeyup(e) {
  if (this.props.listen) {
      let charCode = e.which;
      if (charCode === 37 || charCode === 38) {
        this.props.prev();
      } else if (charCode === 39 || charCode === 40) {
        this.props.next();
      }
    }
  }
}

And get this
class someClass {
  handleKeyup(e) {
    if (this.props.listen) {
      let charCode = e.which;
      if (charCode === 37 || charCode === 38) {
        this.props.prev();
      } else if (charCode === 39 || charCode === 40) {
        this.props.next();
      }
    }
  }
}

So basically if you want to format es6 code, I suggest try upgrading to<EMAIL_ADDRESS>can you verify this working on the test page?

@royriojas thanks a lot.
version 0.7.1 of esformatter + version 1.3.0 of esformatter-jsx work perfectly.
Could you provide options for beautifier in case when there is JSX tag inside of attribute of another JSX tag ?
See example of Button in buttonAfter attribute below:
Before:
            <Input
                ref='inputElement'
                value={this.state.urlValue}
                type={ 'text'}
                label={ this.props.label}
                placeholder={ 'Enter value'}
                addonBefore={ 'URL:'}
                onChange={this._handleChangeUrlValue}
                buttonAfter={ <Button
                                onClick={this._handleClearUrlValue}
                                bsStyle={ 'default'}>

                              </Button> }>
                <Grid>
                    <Row>
                        <Col/>
                    </Row>
                </Grid>
            </Input>

After
            <Input ref='inputElement'
                   value={this.state.urlValue}
                   type={ 'text'}
                   label={ this.props.label}
                   placeholder={ 'Enter value'}
                   addonBefore={ 'URL:'}
                   onChange={this._handleChangeUrlValue}
                   buttonAfter={ <Button onClick={this._handleClearUrlValue} bsStyle={
            'default'}>

            </Button> }>
            <Grid>
                <Row>
                    <Col/>
                </Row>
            </Grid>
            </Input>

I updated to esformatter 0.7.1 with esformatter.jsx 1.0.3
now it's working fine..
There are other issues.. but not related to this topic.

@ipselon I have faced that issue before, so far is a known bug, and the only solution for now is to extract that block to its own variable. Can you file that under a different bug? I might get some time to try that today.

Thanks.

@pixelass thanks for your help to debug this issue. So basically<EMAIL_ADDRESS>and<EMAIL_ADDRESS>is what is recommended if you want to beautify code with ES6 syntax


test: Validate return of Arrow Table and/or RecordBatches from the Cursor

Updated: I didn't initially spot the __getitem__ that redirects to the underlying raw connection, so started adding two entirely unnecessary pass-through methods (now removed) to the Cursor object to get the Arrow data, heh (though having explicit methods might be helpful for discoverability? 🤔)
This PR now just adds some extra tests to validate Arrow-return from the Cursor.

Thanks!


[Bug] [Alarm Instance Manage] Does not change with language switching

Search before asking

[X] I had searched in the issues and found no similar issues.

What happened

In Chinese and English modes, the prompts are the same
I see that the code is curing during registration, so I feel like it needs to be fixed
What you expected to happen
Normal display
How to reproduce
as shown above
Anything else
No response
Version
dev
Are you willing to submit PR?

[X] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Duplicated with #16517


docs: add --via-ir flag for forge verify-contract

documenting changes added by https://github.com/foundry-rs/foundry/pull/6781

@mattsse some newline issue because of a missing space at the end of the line? not sure


feat: add labels to gitea release PR

Add labels Gitea Enhancement.
Reference #1881

Fixed Typo in Struct Name:

Renamed the struct GiteaRelase to GiteaRelease to correct a spelling error.

Pull Request Labels Management:

New Structs and Fields:

Introduced a Label struct with name and ID fields.
Added a labels field to existing structs like GitPr and GitLabMr to accommodate label information.

Label Validation:

Implemented validation to ensure label names are non-empty and do not exceed 50 characters, providing appropriate error messages for invalid inputs.

Gitea Integration:

Introduced a GiteaLabelResponseStruct to handle responses from Gitea's label API.
Enhanced label management for Gitea backends by:

Fetching existing labels.
Creating new labels if they don't exist.
Mapping labels to their respective IDs.
Assigning labels to PRs using these IDs.

Token Scope Enhancement:

Updated token creation to include read:issue and write:issue permissions, facilitating the new label management functionalities.

Testing:
Added test cases to verify label functionalities:
release_plz_add_labels_to_release_pull_request: Assesses the addition of labels to a release PR.
release_plz_add_invalid_labels_to_release_pr: Evaluates the validation process for invalid labels.

[ ] update the config docs to say that labels are also available on gitea

Reminder for myself too 👍


Allow for custom runtimes inside functions since GO will be deprecated in lambda

Is this feature request related to a new or existing Amplify category?
No response
Is this related to another service?
Lambda
Describe the feature you'd like to request
I would like a method to have custom runtime languages inside the functions. This is in response to LAMBDA announcing that as of the end of Dec 2023, the Go 1.x runtime will no longer be supported in favor of using the provided.al2 base image. This is more in line with other compiled languages like rust and C++
https://aws.amazon.com/blogs/compute/migrating-aws-lambda-functions-from-the-go1-x-runtime-to-the-custom-runtime-on-amazon-linux-2/
Describe the solution you'd like
when creating a function, you would specify the type of the runtime, and the option would be "custom",
then there would be an additional file, similar to the amplify.yml file that will allow the user to add the required script commands in order to compile and package the code so that the amplify framework can take it and upload it.
Describe alternatives you've considered
One alternative would be to take my existing GO functions off of amplify before the end of the year. This would be a pain since the amplify framework is wonderful for deploying the lambda code
Additional context
No response
Is this something that you'd be interested in working on?

[ ] 👋 I may be able to implement this feature request

Would this feature include a breaking change?

[X] ⚠ This feature might incur a breaking change

Any update on this?

Hi, do you have any update on this? We would like to migrate our go functions too. Thank you.

hope update 😢

How is this not a p1? Our pipeline is now failing because Go 1.x is no longer supported.
Has anyone come up with a fix for this?

Personally, I do some development in Rust because the DX, packaging, and stability are great. it would be nice to write some of the lambda functions in Rust for specific tasks.

@Bryson14 I think you can support Rust too with the method I described, but if you're looking for official support, hope it is added soon!

Also, to get the approach I described above working in Amplify Hosting, the commands in Plugin Installation should be added in amplify.yml.

I created #13659 for this, we need this ASAP


Buffer pooling

Included 2 classes from Microsoft.IO.RecyclableMemoryStream under MIT, left copyright headers in files and added a notice file with the copyright information.
All requests in the write queue are written to a single stream.
On the read path, the body from all frames received in the incoming buffer are stored in a single stream and then read in order. Instead of using 1 task to invoke each callback, 1 task is used to invoke all complete messages received.
Other changes

Introduced a big endian converter BeConverter
Renamed BEBinaryWriter and BEBinaryWriter into FrameWriter and FrameReader.
Removed ListBackedStream.
Introduced a thread-local reusable buffer for parsing row values (where allowed).

It's chained with #151.
There other improvements that can be made, but I think it is out of scope for now (we can create tickets for it):

Improve the IFrameCompressor interface to support a count/length parameter to avoid extra copies.
Improve TypeCodec to reuse buffers and support count/length parameter on decoding methods (see DecodeVarchar() for example).

Calling @ocoanet @alprema @LukeTillman for review!

I've implemented the TcpSocket.Write() method using array segments (to the pooled blocks) to avoid block copies for the SocketAsyncEventArgs interface.
Moved the logic to invoke read callbacks out of ReadParse() to a new InvokeReadCallbacks() method.

Hi,
First thank you for taking care of this, I can't wait to see how fast it can go :)
To be able to put numbers on those improvements I just created a repo with a benchmark tool for read and writes inspired from a real life time-series application and ran it against the CSHARP-270 branch.
At the current version (31ce7146a95f6c3aaa7ac7c7374936bde3d507e0) the read benchmark is similar to the 2.7.2, so no regression but no improvement yet (did not test writes yet).
The benchmark is easy to run but don't hesitate to ask if you want me to run it against our cluster.

I'm getting around twice the amount of ops per second, in an insert-based scenario: ~70% more throughput with just CSHARP-244 and an extra ~30% with CSHARP-270.
I will continue cover insert+select scenario and share my benchmarks tomorrow.


Remove deployment scripts

Signed-off-by: Artyom Bakhtin<EMAIL_ADDRESS>

Description of the Change

Remove deploy/ directory since we moved it out to the separate repo (hyperledger/iroha-deploy).
Benefits
Unused code removed

Possible Drawbacks
None

Corrected the docs