Download function app project through API

How can i download function app project through API

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 4581be64-415a-804a-0a45-25b6976095c3
Version Independent ID: 0cae0e82-c263-e2cf-ea54-a783291f5746
Content: Zip push deployment for Azure Functions
Content Source: articles/azure-functions/deployment-zip-push.md
Service: functions
Product: unspecified
GitHub Login: @ggailey777
Microsoft Alias: glenga

@vinaykumar-rm Thanks for the feedback! We are currently investigating and will update you shortly.

i just want to down full function app.
On Fri, May 25, 2018 at 1:30 AM, Micah<EMAIL_ADDRESS>wrote:

@vinaykumar-rm https://github.com/vinaykumar-rm Just to confirm, you
are looking to take a function app you are running in Azure and download it
to your local machine to run there instead. Correct?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/MicrosoftDocs/azure-docs/issues/9119#issuecomment-391840498,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ATuAxEt52hDNAJY576sUwcB39-jozo73ks5t1xFXgaJpZM4UMNMj
.

@vinaykumar-rm if you just want to download the function the doc you referenced shows you how:
https://docs.microsoft.com/en-us/azure/azure-functions/deployment-zip-push#download-your-function-app-project
Then you could spin it up in a local function environment.

this is manual download. What i wanted to know is if there is any way we
can download using script.
On Tue, May 29, 2018 at 8:47 AM, Micah<EMAIL_ADDRESS>wrote:

@vinaykumar-rm https://github.com/vinaykumar-rm if you just want to
download the function the doc you referenced shows you how:
https://docs.microsoft.com/en-us/azure/azure-functions/
deployment-zip-push#download-your-function-app-project
Then you could spin it up in a local function environment.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/MicrosoftDocs/azure-docs/issues/9119#issuecomment-392641541,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ATuAxIsDArNlfwFc3bJOmmZSRx3xk-oiks5t3L3KgaJpZM4UMNMj
.


Fix for passthrough requests with empty responseText

There's a somewhat edge case issue we encountered where blank strings returned from the passthrough request weren't being copied on to the fake xhr's responseText property, eg:
// server
app.get('/foo', function() {
  return '';
});

// client
xhr.open('GET', '/foo');
xhr.onload = function() {
  assert(xhr.responseText === ''); // Error (xhr.responseText === null)
}
xhr.send();

fixup + merge #201 here, thanks!


[3.0] override volume plugin dir (bsc#1084766)

kubernetes 1.10 uses /usr/libexec by default which doesnt exist,
and we want to stick with /usr/lib
Signed-off-by: Maximilian Meister<EMAIL_ADDRESS>(cherry picked from commit de8bd66cebf33dc1e06e4204e8b8211feef2709a)
Backport of #578

oops, duplicate of https://github.com/kubic-project/salt/pull/605
i didnt remember i had it opened already :laughing:


Data Controller Terraform plan - EKS Perms need adding

Describe the bug
Following the instructions verbatim, terraform plan fails when executing the providers.tf file, stating that the necessary permissions to list available regions (line 6) are missing, this is rectified by adding an inline policy to the EKS user in the AWS console such that the arcdemo user has explicit permissions to perform actions on EKS objects.
To Reproduce
Run commands as detailed in repo.
Expected behavior
terraform apply to complete without any errors.

Thank you @chrisadkin. Do you mind sharing your plan error output and screenshots?
The providers.tf files will be used by the terraform init command so not sure what are you trying to run and what is failing.

Closing this, may be related to the fact that I was running terraform apply from the wrong directory, thanks for your help.


[HOLD for payment 2024-05-09] [QBO] Create a new custom hook for fetching the connections data

Create a custom hook to get the policy object given a policy ID while ensuring that the policy object's connections field is fetched if it hasn't been fetched.
Issue OwnerCurrent Issue Owner: @kevinksullivan

[@hayata-suenaga] The PR that introduced the bug has been identified. Link to the PR:
[@hayata-suenaga] The offending PR has been commented on, pointing out the bug it caused and why, so the author and reviewers can learn from the mistake. Link to comment:
[@hayata-suenaga] A discussion in #expensify-bugs has been started about whether any other steps should be taken (e.g. updating the PR review checklist) in order to catch this type of bug sooner. Link to discussion:
[@hayata-suenaga] Determine if we should create a regression test for this bug.
[@hayata-suenaga] If we decide to create a regression test for the bug, please propose the regression test steps to ensure the same bug will not reach production again.

this is a new feature, not a bug 🙇

Both PR were deployed to production. Closing the issue 😄


[BEAM-6102] Fix several packages that were being bundled without relocation within the Dataflow worker.

This change:

Parameterizes the shadow jar validation to allow for excludes to be on a per project basis instead.
Cuts down the Dataflow worker jar by ~20mbs of non-relocated classes that are provided by the SDK during job submission.
Fixes building the job management and fn execution model jars which were including the model pipeline classes.
Adds several comments on how one is meant to shade the legacy worker jar correctly and enforces validation so classes don't leak out unexpectedly.
Adds two follow-up TODOs to relocate DataflowRunnerHarness which requires fixing boot.go code and also relocating conscrypt.

Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

It will help us expedite review of your Pull Request if you tag someone (e.g. @username) to look at it.
 Thanks.

Run Website PreCommit

Just a note on this one. I would like to cherrypick just the shadowJarValidationExcludes functionality in the plugin and perhaps one module's excludes. But since it was an uber-commit this is not easy. I recommend for PRs like this to produce a series of commits so they can be re-used more easily.


Images lock problem

Possibly related to PR #224
Aug  1 04:51:20 sau-3f41e-or instance(54963a87-54e7-412c-b8cd Finish fetch image, duration 2.57 seconds
Aug  1 04:51:20 sau-3f41e-or instance(54963a87-54e7-412c-b8cd Finish instance creation, duration 12.66 seconds
Aug  1 04:51:20 sau-3f41e-or Returning API error: 500, server error
    Traceback (most recent call last):
      File "/usr/local/lib/python3.6/dist-packages/shakenfist/external_api/app.py", line 108, in wrapper
        return func(*args, **kwargs)
      File "/usr/local/lib/python3.6/dist-packages/flask_jwt_extended/view_decorators.py", line 108, in wrapper
        return fn(*args, **kwargs)
      File "/usr/local/lib/python3.6/dist-packages/shakenfist/external_api/app.py", line 683, in post
        return self._instance_start(instance_uuid, instance, network, namespace, placed_on)
      File "/usr/local/lib/python3.6/dist-packages/shakenfist/external_api/app.py", line 728, in _instance_start
        return self._instance_start_local(instance_uuid, instance, network, namespace)
      File "/usr/local/lib/python3.6/dist-packages/shakenfist/external_api/app.py", line 831, in _instance_start_local
        instance.create(lock=lock)
      File "/usr/local/lib/python3.6/dist-packages/shakenfist/virt.py", line 172, in create
        info, resp, locks=[lock, image_lock])
      File "/usr/local/lib/python3.6/dist-packages/shakenfist/images.py", line 116, in fetch
        bump_locks(locks)
      File "/usr/local/lib/python3.6/dist-packages/shakenfist/images.py", line 102, in bump_locks
        lock.refresh()
      File "/usr/local/lib/python3.6/dist-packages/etcd3/locks.py", line 123, in refresh
        raise ValueError('No lease associated with this lock - have you '
    ValueError: No lease associated with this lock - have you acquired the lock yet?
Aug  1 04:51:20 sau-cca68-or Returning proxied request: 500, {"error": "server error", "status": 500, "traceback": "Traceback (most recent call last):
\n  File \"/usr/local/lib/python3.6/dist-packages/shakenfist/external_api/app.py\", line 108, in wrapper\n    return func(*args, **kwargs)\n  File \"/
usr/local/lib/python3.6/dist-packages/flask_jwt_extended/view_decorators.py\", line 108, in wrapper\n    return fn(*args, **kwargs)\n  File \"/usr/loc
al/lib/python3.6/dist-packages/shakenfist/external_api/app.py\", line 683, in post\n    return self._instance_start(instance_uuid, instance, network,
namespace, placed_on)\n  File \"/usr/local/lib/python3.6/dist-packages/shakenfist/external_api/app.py\", line 728, in _instance_start\n    return self
._instance_start_local(instance_uuid, instance, network, namespace)\n  File \"/usr/local/lib/python3.6/dist-packages/shakenfist/external_api/app.py\",
 line 831, in _instance_start_local\n    instance.create(lock=lock)\n  File \"/usr/local/lib/python3.6/dist-packages/shakenfist/virt.py\", line 172, i
n create\n    info, resp, locks=[lock, image_lock])\n  File \"/usr/local/lib/python3.6/dist-packages/shakenfist/images.py\", line 116, in fetch\n    b
ump_locks(locks)\n  File \"/usr/local/lib/python3.6/dist-packages/shakenfist/images.py\", line 102, in bump_locks\n    lock.refresh()\n  File \"/usr/l
ocal/lib/python3.6/dist-packages/etcd3/locks.py\", line 123, in refresh\n    raise ValueError('No lease associated with this lock - have you '\nValueE
rror: No lease associated with this lock - have you acquired the lock yet?\n"}

I think this is happening when an image fetch takes too long, and the gunicorn worker is killed mid fetch. The lock then hangs around until it times out two minutes later. It seems to be happening a lot for Ubuntu downloads today, their servers are slow for some reason.

Oh, I have a re-write in mind for this for v0.3, but am avoiding doing a disruptive thing right now.


Fix typo in updaters

is_new_poch -> is_new_epoch

Jenkins, test this please.

Jenkins CI test (for commit b0c277c50bec2e50af9be9da02b90bd1480ab583, target branch master) succeeded!

@toslunar This pull-request is marked as to-be-backported, but the corresponding backport PR could not be found. Could you check?


email in and out

So I can connect to my exchange server to receive emails and create tickets.  But, with the IMAP credentials that I am using to read emails, I am not succeeding to connect back to the server with the default EMAIL_BACKEND.  Is there a different EMAIL_BACKEND I should be using to reconnect to my email server and send from there?  Or should I just send through an SMTP server instead?

IMAP isn't used for sending email - django-helpdesk will use Django's default outgoing email handler. if you modify EMAIL_BACKEND that'll be used automatically; typically this would be an SMTP server (you can probably run Exchange in SMTP mode if it isn't already)
Double-check also that you can send e-mail from your Django install before getting django-helpdesk running. The first code example in the Django email docs should help: https://docs.djangoproject.com/en/1.7/topics/email/

Close this #worksforme ?

Agreed, this is a local configuration issue and doesn't need to be open here.


Support skipping profile.ps1 loading in PowerShell Hooks by passing -NoProfile

Fix issue https://github.com/Azure/azure-dev/issues/4592. This pr determines whether to load profile.ps1 by checking whether the first sentence of the PowerShell hook command is pwsh -NoProfile.
If the profile.ps1 file exists in the current environment, but the user does not want to load the file when executing PowerShell hook scripts, the user can configure hooks like this:

If it is a script file, add pwsh -NoProfile before command.

If it is a command, add pwsh -NoProfile -Command before command.

@rajeshkamal5050 for notification.

@rajeshkamal5050  Who should we reach out to for reviewing this PR?

@hemarina @vhvb1989 can you help review?


MobileNet v2 vs MobileNet v1 - bug with retrain.py and label_image.py examples from Tensorflow for Poets v2 transfer learning example!

System information
We have reproduced this on Mac OSX, a windows box running a Linux VM, and on a Canadian research cluster all with the same result.

mac was v1.7 recompiled to take advantage of CPU: ('v1.7.0-1321-gd82b2f71b6', '1.7.0')
stock tensorflow code and examples

Description
We are using Tensorflow v1.7.  We train MobileNet v2 (from tfHub - feature/1 version) by running the code Tensorflow provided in retrain.py (from examples). When training is done the validation set is run (for us about 700 images) and it reports say 80% validation accuracy.   Then it saves the model.  We load the saved model using label_image.py (also from tensorflow examples) and see how it's doing on a small validation set that we've withheld.  Instead of seeing the validation of 80% roughly confirmed, we instead see a validation accuracy of about 35%.  The clincher is that when use the same code and data and instead use MobileNet v1 we do see that training validation is confirmed by validation reported using label_image.py .
When calling label_image we change the input_layer from "input" for MobileNet v1 to "Placeholder" for MobileNet v2
Can you confirm this? What is going on?
Logs:
From retrain.py:
...
INFO:tensorflow:Initialize variable module/MobilenetV2/expanded_conv_9/project/weights:0 from checkpoint /var/folders/x8/f10sgc052q75r1thg5hlw4dm0000gn/T/tfhub_modules/33f8428fe83945b8b3d46d79168a0e2818e65e8a/variables/variables with MobilenetV2/expanded_conv_9/project/weights
INFO:tensorflow:Restoring parameters from /tmp/_retrain_checkpoint
INFO:tensorflow:Final test accuracy = 74.0% (N=696)
...
then from using label_image.py:
it gets 35% is correct
Have I written custom code: no
OS Platform and Distribution: macosx latest
TensorFlow installed from: pip
TensorFlow version: 1.7
Bazel version: Build label: 0.11.1-homebrew
Build target: bazel-out/darwin-
opt/bin/src/main/java/com/google/devtools/build/lib/bazel/BazelServer_deploy.jar
Build time: Sun May 31 16:57:39 +50150<PHONE_NUMBER>659)
Build timestamp:<PHONE_NUMBER>659
Build timestamp as int:<PHONE_NUMBER>659
CUDA/cuDNN version: N/A
GPU model and memory: N/A
Exact command to reproduce: see above

Thank you for your post. We noticed you have not filled out the following field in the issue template. Could you update them if they are relevant in your case, or leave them as N/A? Thanks.
Have I written custom code
OS Platform and Distribution
TensorFlow installed from
TensorFlow version
Bazel version
CUDA/cuDNN version
GPU model and memory
Exact command to reproduce

I've added it... But in fact all that information was there when I
originally posted, to the extent that it is relevant in this case.
Thanks
On Fri, May 4, 2018 at 5:42 AM, Alfred Sorten Wolf<EMAIL_ADDRESS>
wrote:

Thank you for your post. We noticed you have not filled out the following
field in the issue template. Could you update them if they are relevant in
your case, or leave them as N/A? Thanks.
Have I written custom code
OS Platform and Distribution
TensorFlow installed from
TensorFlow version
Bazel version
CUDA/cuDNN version
GPU model and memory
Exact command to reproduce
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/tensorflow/tensorflow/issues/19071#issuecomment-386588724,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAQh9iDGbCwJK4d23BB5bnEL6ljpPzVaks5tvEysgaJpZM4Tx_WA
.

I've been able to replicate this issue with TensorFlow 1.7 on a CentOS distribution running a 12 GB Tesla P100, CUDA version 8.0. Namely,  downloaded MobileNet V1 and V2 from their respective tfhub modules and retrained on roughly 7000 images using the retrain.py script, default parameters. Final test accuracy for both the v1 and v2 models is roughly 74%. When then going back and using label_image.py to validate on a separate set of roughly 20 images with the same properties as the original training set, the v1 model gives comparable performance (~75%), but the v2 model inexplicably drops to 33%.

Any news from the front?

Hi, It has been 21 days with no activity and the awaiting response label was assigned. Is this still an issue?

Nagging Assignee @tatatodd: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @tatatodd: It has been 29 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

I too was wondering if how to adapt this to mobilenet v2, or even mobilenet v2-SSD

Nagging Assignee @tatatodd: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

@jgberg Is this still an open issue?

yes
On Wed, Aug 1, 2018 at 1:07 PM achowdhery<EMAIL_ADDRESS>wrote:

@jgberg https://github.com/jgberg Is this still an open issue?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/tensorflow/tensorflow/issues/19071#issuecomment-409703666,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAQh9sdI7Mr7jMqG0L3pCmOxoG25n_aSks5uMgp_gaJpZM4Tx_WA
.

Nagging Assignees @petewarden, @achowdhery, @tatatodd: It has been 15 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @petewarden, @achowdhery, @tatatodd: It has been 31 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Can confirm this is still an issue. Even validating on the very set of images the stock MobileNetV2 model is trained on leads to inexplicably lower accuracy. Is the problem in the validation scripts provided or the way the models are loaded?

Nagging Assignees @petewarden, @achowdhery, @tatatodd: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @petewarden, @achowdhery, @tatatodd: It has been 29 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Same problem here

Nagging Assignees @petewarden, @achowdhery, @tatatodd: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @petewarden, @achowdhery, @tatatodd: It has been 29 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

My guess is that there's something wrong with the input image preprocessing in this case, in particular the input_mean and input_std values (though if it's working for v1, it should be similar for v2). Since this is now a bit old, closing, but please reopen with details on the exact command lines if you're still hitting the problem.


Release new version to NPM

Can we get a new NPM release that includes the recent fixes?

You may install it directly from git with
npm install moritzmhmk/homebridge-camera-rpi#master

Yep, but that’s not convenient or clear to the vast majority of users of the package. Given the updates we’re done months ago, npm should have an update.

I agree, especially when you let the config-ui-x do the work

v0.0.4 is released but I cant test it right now - please report any issues here!

Just an FYI.
For me an npm update -g homebridge-camera-rpi  didn't update it, so I had to do an nom I -g homebridge-camera-rpi.
I'm new to npm, but know apt/yum, so I was expecting that to work.

Going to mark this closed as well it's out.


Replace "banana nation" with an example spacecraft

abercrom
https://jira.jpl.nasa.gov/browse/AERIEQS-315
Moderate
Aerie documentation would be much more useful if it was based on an example spacecraft (could be a simple made-up mission) instead of "banana nation". Customers and stakeholders on Europa Clipper do not see how growing a banana relates to spacecraft planning. Having docs based on an example mission would allow us to share the info with our users and stakeholders without having to rewrite to put the information in mission context.

Closing this since we have future plans in our external mission model effort to provide multiple example mission models for many different types of spacecraft


[FLINK-30083] Bump maven-shade-plugin version

What is the purpose of the change
FLINK-24273 proposes to relocate the io.fabric8 dependencies of flink-kubernetes.
This is not possible because of a problem with the maven shade plugin ("mvn install" doesn't work, it needs to be "mvn clean install").
MSHADE-425 solves this issue, and has been released with maven-shade-plugin 3.4.0.
Upgrading the shade plugin will solve the problem, unblocking the K8s relocation.
Brief change log

bump the version.

Verifying this change
Covered by CI
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (yes / no)
The public API, i.e., is any changed class annotated with @Public(Evolving): (yes / no)
The serializers: (yes / no / don't know)
The runtime per-record code paths (performance sensitive): (yes / no / don't know)
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (yes / no / don't know)
The S3 file system connector: (yes / no / don't know)

FYI, we already have a relocation for io.fabric8: https://github.com/apache/flink/blob/master/flink-kubernetes/pom.xml#L171

Thanks a lot for the careful review! I addressed your comments.

What the...

3 Unknown Licenses

*****************************************************

Files with unapproved licenses:

  /__w/1/s/target/checkstyle-result.xml
  /__w/1/s/target/rat.txt
  /__w/1/s/target/checkstyle-cachefile

Wow this even happens locally. mvn clean verify -N

I’m also confused. Updating rat doesn’t help.
On Thu 24. Nov 2022 at 18:01 Chesnay Schepler @.***>
wrote:

Wow this even happens locally. mvn clean verify -N
—
Reply to this email directly, view it on GitHub
https://github.com/apache/flink/pull/21344#issuecomment-1326686909, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAAVXWJCPZ5XVHJTJINS45LWJ6NQDANCNFSM6AAAAAASEHKRSM
.
You are receiving this because you were mentioned.Message ID:
@.***>

--
Robert Metzger, Kontakt: @.***, Mobil: 0171/7424461

This seems to happen with every version since 3.3.0.
For some reason the files in the root target directory are now included by the rat plugin. (-X shows the included/excluded files).
@jnh5y This is a good example of why I'm so hesitant about plugin upgrades :weary:

This seems to happen with every version since 3.3.0.
For some reason the files in the root target directory are now included by the rat plugin. (-X shows the included/excluded files).
@jnh5y This is a good example of why I'm so hesitant about plugin upgrades 😩

Wow... that's a really, really strange thing for a Maven Shade plugin change to impact...  Looks like some rat configuration may need to be updated?

The rat plugin already has an exclusion for **/target/** though. Changing it to target/** had no effect, but explicitly listing **/rat.txt did.
Still, I'd like to know what is going on here before changing anything.
I'll file a ticket; maybe the shade folks have some idea.

We can fix the rat issue by just running it in the validate phase; but not sure yet what to do about checkstyle Suppressions could be moved into each module, but what about the config file? We could consider moving it into a separate module/project and loading the rules from the classpath. This could also be useful for the connector projects since we'd be able to share the rule set easily.

Update: We'll merge this after #21477.


Bug/hamburger links corrected

Changed the hamburger menu link to the correct leaderboard. Now properly redirects the user to '/leaderboard' instead of '/child/leaderboard'. Also changed the hamburger menu link for home. Was redirected to '/child/dashboard' corrected it to link to '/dashboard'.
File changed:
src/components/common/Header.js
Trello cards: https://trello.com/c/JsxTtgt9/703-child-dashboard-home-is-broken
https://trello.com/c/hboBbhtY/706-leaderboard-link-broken-in-hamburger-menu-needs-to-be-leaderboard

 Leaderboard - Link Broken In Hamburger Menu - Needs to be /leaderboard

 Child Dashboard - Home is Broken


hash-ref: contract violation on event-guild-member-update

First of all, thanks for this very comprehensive Discord lib thanks to which I can improve my knowledge of Racket implementing a useful Discord bot. I should also say that it works flawlessly and I'm only posting this because I saw the contract violation warning messages and thought you might be interested. So here it is with user info removed from the output (it happens during event-guild-member-update):
hash-ref: contract violation
expected: hash?
given: (list (member (user "...
argument position: 1st
other arguments...:
"908329..."
context...:
/home/gluon/.racket/7.1/pkgs/racket-cord/events.rkt:174:0: event-guild-member-update
/home/gluon/.racket/7.1/pkgs/racket-cord/utils.rkt:25:2: for-loop
/home/gluon/.racket/7.1/pkgs/racket-cord/utils.rkt:24:0: each

Thanks, 54dcbf3d3b07b4630fb70b1ac43660cfbcc0b582 should have fixed this issue


Can't override $navbar-brand-width

I need $navbar-brand-width to be 200px
Changing the variable in /scss/core/_variables.scss doesn't seem to do anything:
$navbar-brand-width:                  200px !default;
I tried overriding this in /scss/_core-variables but it never changes.
What might I be doing wrong?

Weird.. it might be working now....
Does doing a yarn start rebuild the scss?  Cause it looked like I had to do a yarn run build followed by a yarn start before the changes to scss took place?
How can I compile the scss?


NLTK punkt sentence tokenizer for multiple languages

Hi,
My corpus contains text from multiple languages such as Arabic, Persian, Urdu, Armenian, etc... is it possible to train a single tokenizer pickle file for all the above languages. if so, can someone pls suggest the steps to train the single custom sentence tokenizer which works well for all these languages?

can't you simply write your own code that deals with that scenario? It would first call a language detector in the text fragment, and later, based on the result of the language detector, it calls the sentence tokenizer with the appropriate Punkt model.

I appreciate your help. Instead of having many Punkt models, is it possible to have one model which works well for the group of languages?

I don’t think so. Punkt is actually best used for a given corpus not for a “language”. Punkt is almost based on the idea of recognize abbreviations, very domain/corpus specific.

okay.Thanks a lot @arademaker


Alternative to requester pays for AWS sentinel-2 dataset

Browsing through docs and tutorials, it seems downloading Sentinel-2 data requires account on AWS with payment structure setup because the data is in requester pays bucket. Are there alternatives to get sentinel-2 data for free - say for example google cloud. In case of Google, what catalog should I use? I will appreciate any pertinent info with regards to Sentine-2 and sat-search.

Hi @bidhya ,
In the latest Earth-search: https://earth-search.aws.element84.com/v0
There are two collections that are in requester pays buckets: sentinel-s2-l1c and sentinel-s2-l2a. These are indexes of the original JP2K scenes and are located in the eu-central-1 region.
The collection sentinel-s2-l2a-cogs is located in us-west-2, is not requester pays, and the data is in Cloud-Optimized GeoTIFF format. So that's the collection you want.
The last released version of sat-search I think points to an older URL, you can install the latest version of sat-search:
$ pip install sat-search==0.3.0-rc1
I'm currently working on getting a final released version this week, might have an rc2 out later today.  In the new version there will not be a default STAC API endpoint, you'll need to provide one at the command line or setting an environment variable.  I'll provide a few endpoint URLs in the README.

@matthewhanson This is great!
Can you change this to the default collection in the tutorial? I couldn't figure out how to get the .jp2 files to actually download from the requester pays buckets from the tutorial. COGs worked great.


Sources relative paths rewritten incorrectly

Expected behavior:
Sources file paths in compiled .js.map files should be have correct relative paths for files in subfolders.
Directory structure:
.
+-- src
|   +-- main.ts
|   +-- subfolder
|   |   +-- MyFile.ts
+-- dist
|   +-- main.js
|   +-- main.js.map
|   +-- subfolder
|   |   +-- MyFile.js
|   |   +-- MyFile.js.map

MyFile.js.map should begin with
{"version":3,"sources":["../../src/subfolder/MyFile.ts"] ...

Actual behavior:
MyFile.js.map and begins with
{"version":3,"sources":["../src/subfolder/MyFile.ts"] ...

Your gulpfile:
const gulp = require('gulp');
const ts = require('gulp-typescript');
var sourcemaps = require('gulp-sourcemaps');

// pull in the project TypeScript config
const tsProject = ts.createProject('tsconfig.json');

gulp.task('scripts', () => {
  var tsResult = tsProject.src()
    .pipe(sourcemaps.init()) // This means sourcemaps will be generated
    .pipe(tsProject());

  return tsResult.js
    .pipe(
      sourcemaps.write('.')
    )
    .pipe(gulp.dest(tsProject.options.outDir));
});

tsconfig.json
Include your tsconfig, if related to this issue.
{
  "compilerOptions": {
    "target": "es6",
    "module": "commonjs",
    "outDir": "dist"
  },
  "compileOnSave": true,
  "include": [
    "src/**/*.ts"
  ],
  "exclude": [
    "node_modules"
  ]
}

Running the debugger it looks like the output from the typescript compiler actually has the correct relative path but gets rewritten when it hits this line (46) of release/output.js
map.sources = map.sources.map(relativeToOutput);

When looking at the docs of gulp-sourcemaps this seems to be correct. Quote:

Important: Make sure the paths in the generated source map (file and sources) are relative to file.base

As an example, consider /src/subfolder/MyFile.ts, which is compiled to /dist/subfolder/MyFile.ts. It's base path is /dist, and the paths in its sourcemap should be relative to this directory.
So I think that this behavior is correct, but not always desired. I'd suggest you to take a look at the docs of gulp-sourcemaps, I think that setting the sourceRoot option of sourcemaps.write to src or ../src would help, but I'm not that familiar with their API.

Thanks for the reply ivogabe.
They do actually have documentation for adding relative paths that looks like this:
sourcemaps.write('.', {includeContent: false, sourceRoot: '../src'})

If you set the sourceRoot path it will override whatever sourceRoot is set in the compiler and replace it with this static path. This is the code from gulp-sourcemaps (you can tell if sourceRoot is set in the options it sets the root the same for all files regardless of how they are nested):
  function setSourceRoot(file) {
    var debug = rootDebug.spawn('setSourceRoot');

    var sourceMap = file.sourceMap;
    if (typeof options.sourceRoot === 'function') {
      debug(function() { return 'is function'; });
      sourceMap.sourceRoot = options.sourceRoot(file);
    } else {
      debug(function() { return 'from options'; });
      sourceMap.sourceRoot = options.sourceRoot;
    }
    if (sourceMap.sourceRoot === null) {
      debug(function() { return 'undefined'; });
      sourceMap.sourceRoot = undefined;
    }
  }

My reason for submitting this bug though is that if you leave off the sourceRoot option it uses the sourceRoot set by the compiler. The typescript compiler actually returns a proper relative path but this module seems to overwrite it in the relativeToOutput function I modified in output.ts.
I was thinking gulp-typescript could either A) not modify the sourceRoot and assume the compiler output would be correct or B) re-write the path with proper relative sourceRoots.
It would make gulp-typescript more reliable for other modules that may use the sourceRoot path and expect it to be a proper relative path.

Thanks for the clarification, I agree that we should do something about it. Option A wouldn't match the description of gulp-sourcemaps, but option B sounds like a good idea. This can break some users so this will be something for the next major release.

Cool. I believe my PR should be a good start when the next release rolls around. Thanks for this project, super useful.

I've taken another look at it, and compared the output of gulp-typescript with gulp-sourcemaps' identityMap. The paths are generated the same way, so I believe that the paths of gulp-typescript are correct. The sourceRoot property is not present in the source maps generated by identityMap, which is also the current behavior of gulp-typescript.
I found that setting a relative path as sourceRoot will actually work. gulp-sourcemaps will automatically modify the sourceRoot for files in subdirectories (i.e. add ../ for each subdirectory). However, the correct value for sourceRoot depends on your TypeScript configuration. See ivogabe/gulp-typescript-sourcemaps-demo for some examples. The basic rule that I found:

If you don't provide the outDir option to TypeScript, the sourceRoot option of gulp-sourcemaps should be the relative path from the gulp.dest path to the source directory (from gulp.src)
If you set the outDir option to the same value as the directory in gulp.dest, you should set the sourceRoot to ./.
If you set the outDir option to a different value, there is no easy rule to configure gulp-sourcemaps. I'd advise to change the value of outDir if possible.

I've updated the readme and its examples with this information.

Awesome, thanks ivogabe!

@Tiberriver256 Have you tried in on your own project?

Sorry not yet. I'll give it a shot tonight with the fake repo given at the start of this issue..

That worked. As you suggested removing outDir from tsconfig and just using gulp.dest seems to have done the trick.
Final adjusted working files (using the same structure):
tsconfig.json
{
  "compilerOptions": {
    "target": "es6",
    "module": "commonjs",
    "sourceMap": true
  },
  "compileOnSave": true,
  "include": [
    "src/**/*.ts"
  ],
  "exclude": [
    "node_modules"
  ]
}

gulpfile.js
const gulp = require('gulp');
const ts = require('gulp-typescript');
var sourcemaps = require('gulp-sourcemaps');

// pull in the project TypeScript config
const tsProject = ts.createProject('tsconfig.json');

gulp.task('scripts', () => {
  var tsResult = tsProject.src()
    .pipe(sourcemaps.init()) // This means sourcemaps will be generated
    .pipe(tsProject());

  return tsResult.js
    .pipe(
      sourcemaps.write({sourceRoot: '../src'})
    )
    .pipe(gulp.dest("./dist"));
});


v2: Don't install CUDA by default (and upgrade to latest Cog)

Resolves #31
cc @luismavs and @nateraw who originally had the bright idea to make CUDA optional: #13

Smoke testing this here: https://github.com/zeke/hello-world-cog/actions/runs/9120284202
If it succeeds I'm going to do this:
git checkout main
git fetch --all --tags
git tag v2.0.0
git tag v2 --force
git push --tags --force

Smoke test passed!


Component Box - Fixes

Description
With this minor fix I solved some prolems with the header element disposition. Until now when a user tried to insert only one element on the left o right  without other content it was rendered on center. Now it's possible to also use only "left" and "right" properties of object "header" and fix respectively the content. Moreover i removed all that div blocks and their rigorous Style Classes that constrain content disposition (i.e. vertical and horizonal alignment), so now the Component is more customizable. Latest, i add the faculty to add a predefined min height for header or footer when the user doesn't intert "header" and "footer" content. This is usefull when a dynamic content (with scrollbar) or any other element hides rounded corner.
Fixes # (issue)

Header content disposition
Removed rigorous disposition Style Classes
Added innerHeader and innerFooter properties

/rebase

/deploy-staging

I fear I didn't understand what the inner* props of the box serve to...

/rebase

/deploy-staging

/rebase

/deploy-staging

/rebase

/deploy-staging

/rebase

/deploy-staging

/rebase

/merge


Metastrategy Custom-01

Origin identified issue:
maxWithdrawalSlippage in BaseConvexMetaStrategy had its value initialised on contract creation. That poses a problem with proxy contracts since the value is set in the storage slot space of the implementation contract instead of the proxy contract:

Meaning that all generalized metastrategy would have maxWithdrawalSlippage set to 0 instead of 1e16.
This PR moves setting of the value to initialise function which is always called in the storage slot space of the proxy contract.

@shahthepro yup I see that. You are right, we could do it all inside one call. The end effect would be the same (since the deployer is already the owner of the contract and no one else can call initialize) and either of the 2 ways are OK I think.

One thing I'm concerned with here is that the existing fork tests did not catch this issue. I think we should make sure that beyond just testing that this value is set, we should have a test that would have failed given that withdrawAll() was not working.

One thing I'm concerned with here is that the existing fork tests did not catch this issue. I think we should make sure that beyond just testing that this value is set, we should have a test that would have failed given that withdrawAll() was not working.

That is a good point. Also adding that test in

The test that has failed is not a big issue since the fix for that one is in this PR: https://github.com/OriginProtocol/origin-dollar/pull/1152


External tokenizer

why we need an external tokenizer;  you have to give me an example of a tokenizer you want to use
the main purpose of this package is to utilize our tokenization algorithm to preprocess text. If you need to use other tokenizers, just re-implement accordingly.

Hi bugface,
The idea of this PR is to avoid instantiate SentenceBoundaryDetection every time we call pre_processing since one of these files
[cid:ae56dabd-8b73-4c81-98fa-8e2223f75b6e]
is very large (according to yonghui) and instantiation is expensive (~1 sec)
Thanks,
James

From: bugface @.>
Sent: Wednesday, August 24, 2022 8:59 AM
To: uf-hobi-informatics-lab/NLPreprocessing @.>
Cc: Huang,James @.>; Author @.>
Subject: Re: [uf-hobi-informatics-lab/NLPreprocessing] External tokenizer (PR #5)
[External Email]

why we need an external tokenizer; you have to give me an example of a tokenizer you want to use
the main purpose of this package is to utilize our tokenization algorithm to preprocess text. If you need to use other tokenizers, just re-implement accordingly.

—
Reply to this email directly, view it on GitHubhttps://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fuf-hobi-informatics-lab%2FNLPreprocessing%2Fpull%2F5%23issuecomment-1225844633&data=05|01|jameshuang%40cop.ufl.edu|09038163da7d418459e908da85e16071|0d4da0f84a314d76ace60a62331e1b84|0|0|637969500319875242|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=lu4ZarIEy8ZrDQ5D7yhfb%2Fnx56SIRBxjIbp4JdpLlH0%3D&reserved=0, or unsubscribehttps://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FALHNHSIGAV6AIIDQRCNIFXLV2Y2F5ANCNFSM57LVJOZA&data=05|01|jameshuang%40cop.ufl.edu|09038163da7d418459e908da85e16071|0d4da0f84a314d76ace60a62331e1b84|0|0|637969500319875242|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=RzXGxZutofRNHYvDLyU%2FYOK71g43JiyKq5BcQbb0FRE%3D&reserved=0.
You are receiving this because you authored the thread.Message ID: @.***>


Autolinking of proposal IDs

A proposal ID such as SE-0387 is currently autolinked to
https://apple.github.io/swift-evolution/#?proposal=SE-0387
which is a "404: Not Found" error page (because the repository has been transferred).

Settings → Integrations → Autolink references
The old autolink could be removed (unless it can be edited).
The new autolink could have:

a Numeric format (to disallow SE-ABCD).

an SE- reference prefix.

a target URL of
https://www.swift.org/swift-evolution/#?proposal=SE-<num>

Should be fixed. Thanks, Mishal!

@shahmishal Are we deliberately linking to swiftlang.github.io, and not swift.org?


path is undefined in new Router on all pages of client in production

EDIT: Seems like pinning the next package version fixed this. No idea why.
We have ^7.0.0. I tried pinning to 7.0.0, worked. Then 7.0.1 also worked. And now at 7.0.2 and it still works. I have no clue what's up there.
Sorry for the bug report - maybe it'll still be useful for someone else, or maybe the Next team will understand something relevant 👍
Bug report
Describe the bug
When loading our next.js app in production (on elastic beanstalk) we are getting a client-side error of TypeError: Cannot read property 'replace' of undefined.
This error comes from toRoute(path) when the Router is getting initialised on the client side at createRouter.
Looking at the code, the page argument to createRouter is coming from window.__NEXT_DATA__, which seems to properly be storing the value as expected.
I'm able to log window.__NEXT_DATA__ before the error occurs and see that the page is there (see screenshot below).
Interestingly, this error does not happen if we run the production build locally, only on elastic beanstalk, on which we upload a pre-built build. The only thing happening during deployment is EBS is running npm install.
We use

custom server.js with express
custom _app.js, wrapped in a with-redux-app

Screenshots

System information

OS: aws EC2 t2.small
Browser: chrome, safari tested
Version of Next.js: 7

Additional context
Some source code:
server/server.js
const express = require('express')
const nextjs = require('next')

const port = parseInt(process.env.PORT, 10) || 3000
const dev = process.env.NODE_ENV !== 'production'
const app = nextjs({ dev })
const handle = app.getRequestHandler()

app.prepare()
  .then(() => {
    const server = express()

    server.get('/', (req, res) => {
      return app.render(req, res, '/shop')
    })

    server.get('/products/:id-:itemTitle?', (req, res) => {
      const params = Object.assign(req.params, req.query)
      return app.render(req, res, '/product', params)
    })

    server.get('/@:username', (req, res) => {
      return app.render(req, res, '/user', {username: req.params.username})
    })

    server.get('*', (req, res) => {
      return handle(req, res)
    })

    server.listen(port, (err) => {
      if (err) throw err
      /* eslint-disable-next-line no-console */
      console.log(` > Ready on http://localhost:${port}`)
    })
  })

pages/_app.js
import App, {Container} from 'next/app'
import Head from 'next/head'
import React from 'react'
import withReduxStore from '../src/lib/with-redux-store'
import { Provider } from 'react-redux'

import * as Sentry from '@sentry/browser'
import getConfig from 'next/config'

import IntercomHead from '../src/components/head/_intercom-head'

class MyApp extends App {
  constructor (props) {
    super(props)

    if (getConfig().publicRuntimeConfig.prod) {
      Sentry.init({
        dsn: '<hidden>',
      })
    }
  }

  componentDidCatch (error, errorInfo) {
    if (getConfig().publicRuntimeConfig.prod) {
      Sentry.configureScope(scope => {
        Object.keys(errorInfo).forEach(key => {
          scope.setExtra(key, errorInfo[key])
        })
      })
      Sentry.captureException(error)
    }
  }

  render () {
    const {Component, pageProps, reduxStore} = this.props
    return (
      <Container>
        <Head>
          <IntercomHead />
        </Head>
        <Provider store={reduxStore}>
          <Component {...pageProps} />
        </Provider>
      </Container>
    )
  }
}

export default withReduxStore(MyApp)

src/lib/with-redux-store.js
import React from 'react'
import {initializeStore} from '../store/store'
import {makeInitialState} from '../reducers/initialState'
import {getNavItemIndexFromURL} from '../utils/utils'

const isServer = typeof window === 'undefined'
const __NEXT_REDUX_STORE__ = '__NEXT_REDUX_STORE__'

function getOrCreateStore (initialState) {
  // Always make a new store if server, otherwise state is shared between requests
  if (isServer) {
    return initializeStore(initialState)
  }

  // Create store if unavailable on the client and set it on the window object
  if (!window[__NEXT_REDUX_STORE__]) {
    window[__NEXT_REDUX_STORE__] = initializeStore(initialState)
  }
  return window[__NEXT_REDUX_STORE__]
}

export default (App) => {
  return class AppWithRedux extends React.Component {
    static async getInitialProps (appContext) {
      // Get or Create the store with `undefined` as initialState
      // This allows you to set a custom default initialState
      const navIndex = getNavItemIndexFromURL(appContext.ctx.pathname)
      const state = makeInitialState({navIndex})
      const reduxStore = getOrCreateStore(state)

      // Provide the store to getInitialProps of pages
      appContext.ctx.reduxStore = reduxStore

      let appProps = {}
      if (typeof App.getInitialProps === 'function') {
        appProps = await App.getInitialProps(appContext)
      }

      return {
        ...appProps,
        initialReduxState: reduxStore.getState(),
      }
    }

    constructor (props) {
      super(props)
      this.reduxStore = getOrCreateStore(props.initialReduxState)
    }

    render () {
      return <App {...this.props} reduxStore={this.reduxStore} />
    }
  }
}

I had the same issue, and it seemed to be happening when I was building using one version<EMAIL_ADDRESS>but actually running app with<EMAIL_ADDRESS>

Thanks! That would explain why the issue got fixed when I pinned the
versions then.
On Mon, Oct 22, 2018 at 3:21 PM Lisa Övermyr<EMAIL_ADDRESS>wrote:

I had the same issue, and it seemed to be happening when I was building
using one version<EMAIL_ADDRESS>but actually running app with<EMAIL_ADDRESS>—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/zeit/next.js/issues/5468#issuecomment-431833611, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABo9ADZQ1C15C4gZ5WD3_yx8X1vurcSwks5uncZEgaJpZM4XjQ5x
.

That explains, in 7.0.2 we no longer send pathname from the server to the client side as part of the XSS patch. There's not much we can change on the Next.js side now, so let's close this issue.


[Actions] Remove greet.yml action

Summary:
This (greet.yml) action requires some changes to "repo" settings which are out of maintainers' controls.
So, instead of wasting compute; let's just delete this action :(
🤗🌏
Changelog:
[GENERAL] [REMOVED] - [Actions] Remove greet.yml action
Test Plan:

Not needed.

Note: I'll be taking a break, since finished with exams and haven't taken one in a while 😅.
I've "Allowed edits by maintainers". So, please feel free to suggest and commit changes as you feel right.
Thanks for reviewing and providing feedback; in advance.


runtime error: invalid memory address or nil pointer dereference

View details in Rollbar: https://app.rollbar.com/a/magneticstain/fix/item/IP-2-CloudResource/11
Traceback (most recent call last):
  File<EMAIL_ADDRESS>line 422, in rollbar-go.(*Client).ErrorWithStackSkipWithExtras
  File<EMAIL_ADDRESS>line 415, in rollbar-go.(*Client).ErrorWithStackSkip
  File<EMAIL_ADDRESS>line 537, in rollbar-go.(*Client).LogPanic
  File<EMAIL_ADDRESS>line 576, in rollbar-go.(*Client).WrapWithArgs.func1.1
  File "/usr/local/go/src/runtime/panic.go", line 920, in runtime.gopanic
  File "/usr/local/go/src/runtime/panic.go", line 261, in runtime.panicmem
  File "/usr/local/go/src/runtime/signal_unix.go", line 861, in runtime.sigpanic
  File "/usr/local/go/src/net/http/client.go", line 194, in http.(*Client).deadline
  File "/usr/local/go/src/net/http/client.go", line 608, in http.(*Client).do
  File "/usr/local/go/src/net/http/client.go", line 590, in http.(*Client).Do
  File<EMAIL_ADDRESS>line 1940, in apiv1.(*instancesRESTClient).List.func1.1
  File<EMAIL_ADDRESS>line 82, in v2.invoke
  File<EMAIL_ADDRESS>line 50, in v2.Invoke
  File<EMAIL_ADDRESS>line 1930, in apiv1.(*instancesRESTClient).List.func1
  File<EMAIL_ADDRESS>line 1969, in apiv1.(*instancesRESTClient).List.func2
  File<EMAIL_ADDRESS>line 139, in iterator.(*PageInfo).fill
  File<EMAIL_ADDRESS>line 118, in iterator.(*PageInfo).next
  File<EMAIL_ADDRESS>line 1482, in apiv1.(*InstanceIterator).Next
  File "/home/josh/Code/ip-2-cloudresource/gcp/plugin/compute/compute.go", line 45, in compute.SearchResources
  File "/home/josh/Code/ip-2-cloudresource/gcp/gcp.go", line 29, in gcp.GCPController.SearchGCPSvc
  File "/home/josh/Code/ip-2-cloudresource/search/search.go", line 117, in search.Search.doAccountLevelSearch
  File "/home/josh/Code/ip-2-cloudresource/search/search.go", line 151, in search.Search.runSearchWorker
  File "/usr/local/go/src/reflect/value.go", line 596, in reflect.Value.call
  File "/usr/local/go/src/reflect/value.go", line 380, in reflect.Value.Call
  File<EMAIL_ADDRESS>line 579, in rollbar-go.(*Client).WrapWithArgs.func1
  File<EMAIL_ADDRESS>line 582, in rollbar-go.(*Client).WrapWithArgs
  File<EMAIL_ADDRESS>line 649, in rollbar-go.WrapAndWait
  File "/usr/local/go/src/runtime/asm_amd64.s", line 1650, in runtime.goexit
runtime.errorString: runtime error: invalid memory address or nil pointer dereference

Fixed as part of #393


Updated ixmp.jar

source diff https://github.com/iiasa/ixmp_source/compare/0cd6eb355af454e3c7d214d0e5612ea455aff9c0...10742197121eaf83c6f222f969d7e2842d0bbdde

@danielhuppmann @khaeru FYI this is updated jar built from ixmp_source master


Cannot verify publisher

Describe the bug
A clear and concise description of what the bug is.
To Reproduce
Steps to reproduce the behavior:

Go to https://marketplace.visualstudio.com/manage/createpublisher
Fill in a valid URL in Domain name (e.g. https://microsoft.com)

Expected behavior
The Verify button is enabled
Screenshots
But it's not:

Desktop (please complete the following information):

OS: MacOS
Browsers:

Firefox version 100.0
Chrome version 101.0.4951.54
Safari version 15.4

Additional context
See #291 and #254

@aslakhellesoy Verify button will be enabled once you save button is clicked. Please refer https://code.visualstudio.com/api/working-with-extensions/publishing-extension#verify-a-publisher

What fixed this for me was using the www.mydomain.tld version instead of just mydomain.tld. I'm guessing the redirect was the issue


Provide ability to apply neither ID nor class to groups or elements in exported SVG

It would be great to be able to explicitly mark elements or groups that should not get an ID nor a class.


Reroute old manual url to new manual

Resolves #143 by adding @iantaylor-NOAA's html file that re-routes https://nmfs-stock-synthesis.github.io/doc/SS330_User_Manual.html to https://nmfs-stock-synthesis.github.io/doc/SS330_User_Manual_release.html

@e-gugliotti-NOAA can you use a squash and merge so it is brought in as one commit please.


EVCC: SolarEdge Inverter: sunspec: subdevice 1 not found

Describe the bug
When starting evcc, I get the following error:
[main  ] FATAL 2022/10/06 21:54:49 cannot create meter 'grid1': cannot create meter 'template': cannot create meter 'custom': power: sunspec: subdevice 1 not found
It looks like the issue is coming from the https://github.com/volkszaehler/mbmd, file: sunspec.go#L76
d.subdevice is: 1
devices has 1 item in the array
Is there a missing config attribute I need to add?
Steps to reproduce
Prerequisites

SolarEdge inverter, with MODBUS over TCP Support enabled on the inverter following the instructions PDF.

Run evcc detect
evcc detect brings up the inverter:
+---------------+----------+---------+---------------------------------------------------------------------------------------------------------+
|      IP       | HOSTNAME |  TASK   |                                                 DETAILS                                                 |
+---------------+----------+---------+---------------------------------------------------------------------------------------------------------+
| <IP_ADDRESS> |          | sunspec | {"IP":"<IP_ADDRESS>","Port":1502,"ModbusResult":{"SlaveID":1,"Model":1,"Point":"Mn","Value":"SolarEdge |
|               |          |         | "}}                                                                                |
+---------------+----------+---------+---------------------------------------------------------------------------------------------------------+

Run evcc configure
Add SolarEdge inverter using configuration
Run evcc
Let's go:

 In which mode should this process guide you through the configuration? Standard mode (As simple and quick as possible)

- Setup meters (house installation)

Choose one of the following PV systems, or 'My device is not in this list' if you have none of them

 Choose a PV system: SolarEdge Inverter

Please provide the following settings:

 Modbus ID 1
 IP-Address or Hostname <IP_ADDRESS>
 Port 1502
 Timeout

Testing the grid configuration of SolarEdge Inverter ...
   Error: cannot create meter 'custom': power: sunspec: subdevice 1 not found

 Testing of the grid configuration of SolarEdge Inverter failed. Do you want to add grid anyway? Yes

Testing the pv configuration of SolarEdge Inverter ...
   Error: sunspec: Power not found

 Testing of the pv configuration of SolarEdge Inverter failed. Do you want to add pv anyway? Yes

SolarEdge Inverter was successfully added.

Configuration details
# open evcc at http://evcc.local:7070
network:
  schema: http
  host: evcc.local # .local suffix announces the hostname on MDNS
  port: 7070

log: info
levels:
  cache: error

interval: 10s # control cycle interval

meters:
- type: template
  template: solaredge-inverter
  id: 1
  host: <IP_ADDRESS>
  port: 1502
  usage: grid
  modbus: tcpip
  name: grid1
- type: template
  template: solaredge-inverter
  id: 1
  host: <IP_ADDRESS>
  port: 1502
  usage: pv
  modbus: tcpip
  name: pv2

vehicles:
- type: template
  template: tesla
  title: Minerva
  accessToken: xxxx
  refreshToken: xxxx
  vin: 5YJYxxxx
  capacity: 78
  name: ev3

site:
  title: My home
  meters:
    grid: grid1
    pvs:
    - pv2

Log details
./evcc --log debug
[main  ] INFO 2022/10/07 09:21:07 evcc 0.104.2 (cf8e9bb2)
[main  ] INFO 2022/10/07 09:21:07 using config file: /Users/chrisnovak/projects/evcc/evcc.yaml
[main  ] INFO 2022/10/07 09:21:07 listening at :7070
[main  ] FATAL 2022/10/07 09:21:07 cannot create meter 'grid1': cannot create meter 'template': cannot create meter 'custom': power: sunspec: subdevice 1 not found
[main  ] FATAL 2022/10/07 09:21:07 will attempt restart in: 5m0s

What type of operating system are you running?
Windows
Version
NOTE: MacOS, not Windows
evcc version 0.104.2 (cf8e9bb2)

Du hast keinen Netzzähler, ergo kannst Du den auch nicht über den Inverter abrufen.


Preview 8

@Numpsy everything builds now 🎉

I wasn't clear about what the ItemsControl itmes changed event should be bound to, as I thought I'd read that it can be used with an items collection without setting ItemsSource to a value, but i'm not entirely clear on the relationship between the two :-(
On a positive note, the menu flyout example in the control catalog app was showing an empty dropdown with the preview 6 build, and that looks to have been fixed in the update

I wasn't clear about what the ItemsControl itmes changed event should be bound to, as I thought I'd read that it can be used with an items collection without setting ItemsSource to a value, but i'm not entirely clear on the relationship between the two :-(

This fires every time the button is clicked, but as you say it does not work if viewItems is used instead of dataItems.
Component (fun ctx ->
    let toggle = ctx.useState false
    let items = ctx.useState<IEnumerable> [ 0 .. 10 ]
    DockPanel.create [
        DockPanel.children [
            Button.create [
                Button.dock Dock.Bottom
                Button.onClick (fun _ ->
                    if toggle.Current then
                        items.Set [ 0 .. 10 ]
                    else
                        items.Set [ 'A' .. 'C' ]
                    toggle.Set (not toggle.Current)
                )
                Button.content "change items"
                Button.horizontalAlignment HorizontalAlignment.Stretch
            ]
            ItemsControl.create [
                ItemsControl.onItemsChanged (fun _ -> printfn "Items changed!")
                ItemsControl.dataItems items.Current
            ]
        ]
    ]
)

On a positive note, the menu flyout example in the control catalog app was showing an empty dropdown with the preview 6 build, and that looks to have been fixed in the update

Nice!


Feature/auth0

I want to merge this change because...

Screenshots

Pull Request Checklist

[ ] All visible strings are translated with proper context.
[ ] All data-formatting is locale-aware (dates, numbers, and so on).
[ ] The changes are tested.
[ ] The code is documented (docstrings, project documentation).
[ ] Changes are mentioned in the changelog.

Test Environment Config

API_URI=https://qa.staging.saleor.cloud/graphql/

@mingthegit let me know when it's ready for review

Is this ready yet?!

This is ready, dependent on https://github.com/vonq/saleor-storefront/pull/15.
For failing tests, I found that develop branch has tests failing too. Not sure why PR#15 introduced this Github check.

@mingthegit Do we really noeed to include the sdk this way? Can we not add it to packages: https://github.com/mirumee/saleor-storefront/blob/master/package.json#L11

Do we really noeed to include the sdk this way? Can we not add it to packages:

It was in package.json, but I wanted a surgery on @saler/sdk to customize authentication. That's the reason I started the synchronization and cloned sdk in the repo.

Do we really noeed to include the sdk this way? Can we not add it to packages:

It was in package.json, but I wanted a surgery on @saler/sdk to customize authentication. That's the reason I started the synchronization and cloned sdk in the repo.

Can we not fork the sdk and add needed changes? If we do that we have at least a way of tracking changes. Maybe we can adjust the SDK to support both "standard" and Ath0 and make PR to original repo? @marianmazarovici What is your take on this?

Can we not fork the sdk and add needed changes? If we do that we have at least a way of tracking changes. Maybe we can adjust the SDK to support both "standard" and Ath0 and make PR to original repo? @marianmazarovici What is your take on this?

Definitely we can fork the sdk repo, but @saleor/sdk is only used in storefront, and I foresee lots of divergence again in that repository since it's in active development. Saleor dashboard has so-called its own @saleor/sdk version in the repository itself.
The principle I had in mind was that, the more dependencies, the more difficult to maintain a software.
As Emil and me talked briefly on Slack, we need a detailed discussion on the future of storefront or new JMP.


Sample for resource estimation extension based on arXiv:2302.06639

This sample shows how to use the resource estimation extension API to model the architecture presented in arXiv:2302.06639, which has cat qubits, a biased repetition code, and Toffoli factories.
Items left to do:

[ ] Add README
[ ] Improve code documentation

This was published as an sample in this repository: https://github.com/Alice-Bob-SW/qsharp-alice-bob-resource-estimator. See this blog post for more details.


virtual projects are turning into "real" projects?

I noticed today that some of the virtual projects I maintain has turned into "real" projects, and trying to add new challenge sends me to creating a new challenge instead.

Thanks @govvin , can you provide the ids of the (formerly) virtual projects where this has occurred? You can navigate to them in Create & Manage and then grab the ids from the URL (e.g. admin/project/XXXX where XXXX is the id).

Hi @nrotstan
I have the following:

39612
40200

Could you help with restoring these back to its virtual status?

@govvin They should now be restored

FYI. Indeed, the virtual project containers was restored, but the original challenges are no longer there.

After hitting the "done" button from challenge management, it appears that they've been restored. Sorry for the bother.


Windows support

This should resolve #11 if I can work out all the kinks.

Coverage decreased (-14.4%) to 83.704% when pulling 513212d7b6a41bd7c13f15f25df7073cdf122431 on windows-support into 50e46bec91603f75e2372c596883914ea2412f1e on master.

The PR works on my machine, but fails on appveyor. Dunno why yet.

Windows tests now passing, but something on linux tests is not working, but on nightly only.

Almost there, but something is not right on nightly.  Will have to investigate later.

Ok, finally everything is passing. Something is still wrong with running the linux tests on Python nightlies on travis, but the tests do pass on current CPython master branch, I tested locally.
I think I want to restructure the tests so that they all use subprocess. It seems that Windows requires this, in order to have a CTRL-BREAK signal stop a test, but not kill the test session.

Woohoo, all tests passing everywhere


[All Hosts] (sso) clarify note in walkthroughs

Fixes https://github.com/OfficeDev/office-js-docs-pr/issues/2155
This is too trivial to need a review.

Docs Build status updates of commit 0c97dd3:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/develop/create-sso-office-add-ins-aspnet.md
:white_check_mark:Succeeded
View

docs/develop/create-sso-office-add-ins-nodejs.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


Session is being stored as a shared_ptr rather than unique_ptr

This was introduced as part of my change #263. We are making use of Arcana to make the creation of the XR Session asynchronous, however as part of this change we had to declare the pointer that is returned as a shared_ptr rather than a unique_ptr, because arcana does not properly handle returning expected values as const refs, and is instead defaulting to the copy constructor implementation of expected.result.
The new declaration of CreateAsync in XR.h is here:
static arcana::task<std::shared_ptr, std::exception_ptr> CreateAsync(System& system, void* graphicsDevice);
The expected declaration would be:
static arcana::task<std::shared_ptr, std::exception_ptr> CreateAsync(System& system, void* graphicsDevice);
The current declaration of the consumer in nativexr.cpp is:
return xr::System::Session::CreateAsync(m_system, bgfx::getInternalData()->context).then(arcana::inline_scheduler, m_cancellationSource, [this](std::shared_ptr<xr::System::Session> session) {
m_session = std::move(session);
});
The expected declaration in nativexr.cpp is:
return xr::System::Session::CreateAsync(m_system, bgfx::getInternalData()->context).then(arcana::inline_scheduler, m_cancellationSource, [this](std::unique_ptrr<xr::System::Session> session&&) {
m_session = std::move(session);
});

When addressing this, we should also be sure to move the Session constructor to private rather than Public.  Right now it is currently being kept public for usage with make_shared

Closing for now. Reopen if we want to fix this.


How can I use a client like Postman or Insomnia?

Can you just tell how to do it via cURL or a different client as well?  Is it just one header for the authentication?  If so, what is the header key for the api key that is used for authentication?  Thank you.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: b113ae49-c84f-05c6-e4fd-e414e5c64304
Version Independent ID: a04ff30c-e14b-9b76-6dd3-223e05d3a8cb
Content: App Center API Documentation - Visual Studio App Center
Content Source: docs/api-docs/index.md
Service: vs-appcenter
GitHub Login: @amchew
Microsoft Alias: amchew

@kevinclarkneudesic the swagger page shows you how to do it via curl.  You must authenticate first (using the option at the top of the page), but once you do that, the swagger example updates with the correct auth key.
I updated the docs recently to describe this, but I can't seem to find it.

@kevinclarkneudesic aah, here it is - yes, just the one header for auth: https://docs.microsoft.com/en-us/appcenter/api-docs/#using-an-api-token-in-an-api-request.

Ah, I see it now. "X-API-Token".  Thank you @jwargo!


⚠ Secret Website 3 has degraded performance

In 5d56143, Secret Website 3 ($SECRET_WEBSITE_3) experienced degraded performance:

HTTP code: 200
Response time: 2573 ms

Resolved: Secret Website 3 performance has improved in 93a06d0.


[SUGGESTION] Add ability to use Noxesium Skull components

So there's this mod called Noxesium, that Noxcrew actively use on both MCC and MCCI to display player head icons in chat, bossbars and scoreboards.
By looking at their docs you can see that they use a translatable component.
My issue is that the way that Im making my bossbars, I cannot use translatable components (before your plugin i couldn't use the fonts).
It would be awesome to be able to use them easily.
Maybe something like this?
<noxskull:3e7a89ee-c4e2-4392-a317-444b861b0794,false,0,0,1.0:This is what players without Noxesium will see (fallback)>

I know it's a lot to ask for, but it would be a game changer to me! Im sure Gustias (owner of Drag) would also use this, as he's currently recoding everything anyway

Hey, I don't really have time to make this right now as I'm quite busy, but this gave me an interesting idea of how I could do this, no promises but I might do this in 1-2 weeks

It's been a while, so I just want to know if this will actually get implemented :D

It might, I already have an idea of how I could implement it so it could be more customizable


Explain minimum gene cutoff in documentation

It seems that we do not fully explain our filtering procedure if miQC fails in the docs. We only state that the filtering method will be Minimum_gene_cutoff in the SCE contents table (https://scpca.readthedocs.io/en/stable/download_files.html?highlight=Minimum_gene_cutoff#metadata), but we don't explain this in processing. It would probably be worth adding a little more context here.

closed by #335


Collect same key twice

In 88#discussion_r115333601 @aqrln noticed that collector now increments counter even on same keys. On the one hand it's lightweight but on the other it may lead to errors in applied code. So I'd prefer to have both implementation:

metasync.collect(3)
metasync.collect(3).distinct()

SGTM


Grammar fixes and small wording adjustments

I have fixed grammar, improved clarity, and adjusted the wording of many strings.

LGTM

LGTM


could you please post some basic user instructions

extremally new to this kinda thing and tried to get his to work on my windows pc using anaconda.
ran into constant errors with the code and despite my best effort i could not get it to work.
would you be willing to post a basic setup guide and a bit more simplistic explanation of its operation for us lemans? :)

Sure, I'd be happy to help you with that. I'll be finalizing the documentation on Thursday, 1/06/2023, and I'll make sure to include a basic setup guide and a more simplistic explanation of the operation of the project.
I'm sorry to hear that you're having trouble getting it to work on Windows. I developed and tested the project entirely on Windows Subsystem for Linux (WSL), so it's possible that some things aren't functioning correctly on Windows. You could follow the official guide by Microsoft on how to setup WSL until I finalize the guide.
Moreover, I'll also be making the included notebook compatible with Google Colaboratory, so you can run it on the cloud without any local installation.
Muhammad Umer


A lot of this can be done with [[UIView appearance] setTintColor:color]

Could save you some lines of code. You're approach seems more careful, however. With the UIView method you can also change the button text color for alert views.

Good to know - thanks!


In item properties, property value for "Copy to Output Directory" should be displayed after selecting ""

Create a new Console App (.NET Core)
Select Program.cs in Solution Explorer
In Properties window, change "Copy to Output Directory" from "Do not copy" to "Copy if newer"
Deselect and reselect Program.cs in Solution Explorer (workaround for #1039)
Open dropdown for "Copy to Output Directory", and select ""

EXPECTED: Property value shows "Do not copy" unbolded, to indicate that it is the default value
ACTUAL: Property value shows "" bolded, until item is deselected and selected in Solution Explorer
This may be the same bug as #1039, and may be in CPS as opposed to the Roslyn Project System.

@dsplaisted this is a known issue in CPS, we do not refresh the properties window until the item is deselected then re-selected. We would like to fix this, but it was moved out of RTM. It is on our backlog though and will be revisited later.


Method to update typeahead label for custom datamodel

add a method to allow better control of text update to the in-build TextEditingController

Hi @JohnKuan,
Thanks for your contribution.
This is something that has been requested for quite a while.
I'll have a look to review the changes before merging and let you know if any action is needed.
Have a good one.
Cheers!

Sure @danvick.

Hi @JohnKuan,
I love your implementation of this feature. I've fixed a few issues including the assertion for type checking.
How do you like changing onSuggestionSelectedLabel to a more intuitive (IMO) selectionToTextTransformer?

Hi @danvick,
I just saw your merge. Thank you for fixing the issues on the type assertion.
I also noticed you removed the onSuggestionSelected field from the params. I actually do have a use for it, which is separated from populating the textfieldcontroller.text. I tried to utilised the selectionToTextTransformer field but it resulted in an infinite init loop on my use case. Would it okay to restore that field?

Hello @JohnKuan,
I apologize for removing the field, I'll work to restore it ASAP. I had realized that I wasn't using it initially, that's why I had it removed.
I'll be rolling out v3.5.2 in a few which will contain the fix; I'll let you know when I do.

Now about this infinite loop, is it something that's caused by the changes I had introduced? Can I have the sample code that causes this?

3.5.2 is published.


(1.11.2) Sponge compatibility: New dims do not show up in dialing device and cannot be deleated

Version: 1.1x-5.04
Forge: 2429
Sponge: 2393
As the title states, with sponge installed I am not able to visit my rftools dims.
Attempting to delete them using the safedel command throws an error that the dim is still in use.
None of these issues exist in vanilla.
I'm going to repost this over on the spongeforge github for additional insight.

Already fixed by sponge team, closing.


IPyparallel failure when submitting several apps in parallel threads

I'm having an issue when starting several apps roughly at the same time, within different python threads, with the IPyParallelExecutor/SlurmProvider. I get this kind of exceptions:
Traceback (most recent call last):
  File "/global/homes/f/flanusse/.local/lib/python3.6/site-packages/cwlparsl/command_line_tool.py", line 195, in _parsl_execute
    name=self.name)
  File "/global/homes/f/flanusse/.local/lib/python3.6/site-packages/cwlparsl/command_line_tool.py", line 89, in _job_popen
    proc = run_process(job_dir, job_script, stdout=f"{job_dir}/{name}.out", stderr=f"{job_dir}/{name}.err")
  File "/global/common/software/lsst/common/miniconda/py3-4.3.21-env/envs/parsl-latest/lib/python3.6/site-packages/parsl/app/app_factory.py", line 76, in __call__
    return app_obj(*args, **kwargs)
  File "/global/common/software/lsst/common/miniconda/py3-4.3.21-env/envs/parsl-latest/lib/python3.6/site-packages/parsl/app/bash_app.py", line 150, in __call__
    **self.kwargs)
  File "/global/common/software/lsst/common/miniconda/py3-4.3.21-env/envs/parsl-latest/lib/python3.6/site-packages/parsl/dataflow/dflow.py", line 581, in submit
    task_id, func, *new_args, **kwargs)
  File "/global/common/software/lsst/common/miniconda/py3-4.3.21-env/envs/parsl-latest/lib/python3.6/site-packages/parsl/dataflow/dflow.py", line 353, in launch_task
    exec_fu = executor.submit(executable, *args, **kwargs)
  File "/global/common/software/lsst/common/miniconda/py3-4.3.21-env/envs/parsl-latest/lib/python3.6/site-packages/parsl/executors/ipp.py", line 228, in submit
    return self.lb_view.apply_async(*args, **kwargs)
  File "/global/common/software/lsst/common/miniconda/py3-4.3.21-env/envs/parsl-latest/lib/python3.6/site-packages/ipyparallel/client/view.py", line 220, in apply_async
    return self._really_apply(f, args, kwargs, block=False)
  File "<decorator-gen-137>", line 2, in _really_apply
  File "/global/common/software/lsst/common/miniconda/py3-4.3.21-env/envs/parsl-latest/lib/python3.6/site-packages/ipyparallel/client/view.py", line 49, in sync_results
    return f(self, *args, **kwargs)
  File "<decorator-gen-136>", line 2, in _really_apply
  File "/global/common/software/lsst/common/miniconda/py3-4.3.21-env/envs/parsl-latest/lib/python3.6/site-packages/ipyparallel/client/view.py", line 37, in save_ids
    ret = f(self, *args, **kwargs)
  File "/global/common/software/lsst/common/miniconda/py3-4.3.21-env/envs/parsl-latest/lib/python3.6/site-packages/ipyparallel/client/view.py", line 1042, in _really_apply
    metadata=metadata)
  File "/global/common/software/lsst/common/miniconda/py3-4.3.21-env/envs/parsl-latest/lib/python3.6/site-packages/ipyparallel/client/client.py", line 1418, in send_apply_request
    item_threshold=self.session.item_threshold,
  File "/global/common/software/lsst/common/miniconda/py3-4.3.21-env/envs/parsl-latest/lib/python3.6/site-packages/ipyparallel/serialize/serialize.py", line 179, in pack_apply_message
    serialize_object(arg, buffer_threshold, item_threshold) for arg in args))
  File "/global/common/software/lsst/common/miniconda/py3-4.3.21-env/envs/parsl-latest/lib/python3.6/site-packages/ipyparallel/serialize/serialize.py", line 179, in <genexpr>
    serialize_object(arg, buffer_threshold, item_threshold) for arg in args))
  File "/global/common/software/lsst/common/miniconda/py3-4.3.21-env/envs/parsl-latest/lib/python3.6/site-packages/ipyparallel/serialize/serialize.py", line 122, in serialize_object
    cobj = can(obj)
  File "/global/common/software/lsst/common/miniconda/py3-4.3.21-env/envs/parsl-latest/lib/python3.6/site-packages/ipyparallel/serialize/canning.py", line 398, in can
    _import_mapping(can_map, _original_can_map)
  File "/global/common/software/lsst/common/miniconda/py3-4.3.21-env/envs/parsl-latest/lib/python3.6/site-packages/ipyparallel/serialize/canning.py", line 368, in _import_mapping
    mapping[cls] = mapping.pop(key)
KeyError: 'numpy.ndarray'

I have looked at the source code of ipyparallel but couldn't figure out exactly why this happens. If I had to  guess I would say ipyparallel has some cache it uses for object serialization, and when different threads are accessing it at the same time, things get ugly, but that's a wild guess.
Here is the configuration I'm using:
slurm_config = Config(
    executors=[
        IPyParallelExecutor(
            label='ipp_slurm',
            provider=SlurmProvider(
                'debug',
                nodes_per_block=1,
                tasks_per_node=64,
                init_blocks=1,
                max_blocks=1,
                overrides="#SBATCH --constraint=haswell"
            )
        )
    ]
)

Interestingly enough, if I add a thread lock surrounding the call to the parsl_app, everything woks fine.

Thanks for the report, EiffL! Would it be possible to provide an example script which reproduces the problem? That would speed up our investigation.

hum... Sorry Anna, I would have provided an example if it were easy, but it's not from a standalone script, this is happening deep inside a tool I'm building around parsl. I would take me a while to build a mwe from scratch...

@EiffL I've not has a chance to confirm this behavior, but mapping[cls] = mapping.pop(key) is probably not a thread safe operation. If multiple threads try to pop the same key, you might get a KeyError.
Locking as you've done is the obvious solution. Do you have an performance or concerns from locking ? I wonder if you assume to have many short running (<1s) tasks that might be impacted by not being able to launch in parallel ?

Okay great, so locking on your side addresses this problem. In Parsl, we've been working under the assumption that the calling side is single threaded and that all the parallelism is expressed in the execution side. Thanks for bringing this issue to our attention.


dsGit: fix mapper_parsing_exception error

found lots of these errors in the logs:
{
  "error": {
    "root_cause": [
      {
        "type": "mapper_parsing_exception",
        "reason": "failed to parse field [is_git_commit_co_author] of type [long] in document with id '93072b9e89d4c309f35e72f60ee0f71b6c6c2013_3'. Preview of field's value: 'is_git_commit_co_author'"
      }
    ],
    "type": "mapper_parsing_exception",
    "reason": "failed to parse field [is_git_commit_co_author] of type [long] in document with id '93072b9e89d4c309f35e72f60ee0f71b6c6c2013_3'. Preview of field's value: 'is_git_commit_co_author'",
    "caused_by": {
      "type": "illegal_argument_exception",
      "reason": "For input string: \"is_git_commit_co_author\""
    }
  },
  "status": 400
} after 9 seconds

turns out we were assigning string values to fields that are of type long in the es mapping.

trailer type is handled on here https://github.com/LF-Engineering/da-ds/blob/3b4d1141027e718239b3411e18eb27b36d8eed79/dsgit.go#L2152

OK, building new SDS images with that (test & prod).


[Xamarin Forms] Ability to detect when the user clicks on a notification

Describe the solution you'd like
When a push is received, PushNotificationReceived gets triggered, and this seems to be happening when the app is in foreground or the user clicks on a notification in the background. I'd like to be able to differentiate between the two. If a tap occurs, I'd like to navigate the user to the appropriate page. If a push is received in the foreground, I simply show a notification badge without user redirection. Can we have an extra parameter in the event args to know where the push came from?

@jwargo Can I get a response from the team? Is there any workaround I could use right now? I can't go to production knowing that tapping on notifications does not work.

I'm going to close this one since a duplicate (https://github.com/microsoft/appcenter-sdk-dotnet/issues/875) exists in another repository.


cmd/cgo, runtime: optimize C.GoString

C.GoString ends up being translated into a call to runtime.gostring, which calls findnull, which does a byte-at-a-time search for the terminating NUL.
A quick hack to use bytes.IndexByte to find the NUL shows speed-ups of almost 40%. We cant use this directly, though, because of the danger of a vectorized read past the end of the string faulting.
Perhaps we could call strlen on the C side (which is presumably well-optimized) and pass the length in to the runtime? Or write a safe (length-oblivious, aligned-load-only) IndexByte for use here?
cc @ianlancetaylor @randall77

I'm not sure I understand the concern about a fault from a vectorized read past the end of the string.  Seems like that could happen in Go just as easily as in C.

@ianlancetaylor, because bytes.IndexByte starts with a slice (which contains a length), the assembly for that knows it's safe to do wide loads of many bytes up to that length only (or capacity, at least). C.GoString only takes a *byte but no length, so what if that byte pointer were 2-3 bytes before the end of mapped virtual memory space? If we invented some bogus slice header to give to bytes.IndesByte for GoString, we could be inviting IndexByte to fault on a bogus address.
That's how I read it, at least.

Oh, yeah, OK.  For C strings we need to do it slightly differently.  Since vector instructions are always aligned, we are fine using vectors as long as we haven't found a zero yet, but we can't read ahead.  We could write special purpose code for this, but I doubt it's worth it.  We could call a function in runtime/cgo that calls strlen, but we would need a custom asm wrapper to put the arguments in the right place.  Is this common enough to make this worth it?

A quick GitHub search says yes, it is used a lot. Whether it is in performance-critical paths, or whether the cost is worth it, I don't know. I'll move to Unplanned, unless/until someone comes forward and says they need it or someone is inspired to dig deeper and implement themselves.

I think using indexbyte with fake slice is safe, if all access is limited to 1 page, so doing  something like:
p =  (*slice)(unsafe.Pointer(s))
p.len = int(uintptr(unsafe.Pointer(s)) + uintptr(4093)))/4096*4096 // round up to next pagesize
indexbyte(p,0)
...
for { // page at a time loop
p += 4096*i
p.len = 4096
indexbyte(p,0)
}

@TocarIP That requires fairly strong assumptions about the optimizations present in the rest of the Go compiler and runtime. In general we have no guarantee there isn't some other thread writing to the address just after the string. The Go memory model does not define behavior in the presence of data races, let alone data races that cross language boundaries.
We could, of course, check the rest of the runtime code to ensure that such races are benign, but it seems very difficult to write a test that would reliably detect violations due to future changes.

I'm not sure I understand what extra assumptions this introduces. IndexByte (at least asm version on amd64)  already does out-of-bounds read, as long as they don't cross page for normal go strings.

I think Ilya's strategy should be fine.  IndexByte does not depend on data values past the first \0.
Reading data you don't end up looking at doesn't cause a problem on any architecture I know of (caveat: I/O mapped memory, but I'm pretty sure that's not at issue here).  The only problem is making sure we don't accidentally read from unmapped memory, which Ilya's code solves.

Reverted in https://go-review.googlesource.com/c/go/+/97995
/cc @TocarIP


Fix the logic responsible for deciding if an enhanced location update is predicted

The current logic for deciding whether an enhanced location update is predicted is wrong. Right now, we are simply looking at the intermediateLocations list (a.k.a. keyPoints in the Mapbox SDK) and if it contains at least one item we set the location update type to PREDICTED. If the list is empty we set the type to ACTUAL. This is wrong as the intermediateLocations/keyPoints contain additional locations that aim to help improve the path that the publisher took (more information available here).
We should think of a better way to detect whether a location update is predicted or not. We have asked Mapbox whether it's possible here https://github.com/mapbox-collab/Ably-DH-Collab/issues/23.

According to Mapbox:

The sdk both for iOS and Android currently don't have a property to check if the location is predicted or not.

Therefore we should change the implementation so the type is always set to ACTUAL


How do i use ClassGPT？What is the password in the http://localhost:8501/ ?

Hi, I am almost a stranger to these web tools. I followed your instructions and opened up the website http://localhost:8501/. There is a button on the top of the page "password". I tried my gmail passwords which are used to log into  and failed.
What is this password for?

Yea sorry about that, thats for my deployed version.
If you do git pull again (assuming you cloned the repo), it shouldn't have password anymore.


Please release v1.7.5

So many codes have changed since last release v1.7.4

@taobig sure, v1.8.0 released because of so many commits :)


JavaScript debugging: run to cursor can skip to next statement if cusor is after semicolon

Issue Type: Bug
Repro

For the following node code:

let a = 0;

for (let i = 0; i < 1000; ++i) {
    if (a % 10 === 0) {
        a /= 2;
    }
    a += i;
}

console.log(a);

Use a debug terminal to debug it
Place your cursor at the end of the line after a /= 2; and run Debug: Run to cursor

Expected
Program runs to that line
Actual
The program runs to the next line: a += i:

Even though this behavior makes sense from a program structure perspective, it still caught me off guard
VS Code version: Code - Insiders 1.48.0-insider (e7920dce7bfd0b707ebfc0a5379c6edd2233e475, 2020-07-10T11:55:11.286Z)
OS version: Darwin x64 19.5.0

System Info

Item
Value

CPUs
Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz (16 x 2400)

GPU Status
2d_canvas: enabledflash_3d: enabledflash_stage3d: enabledflash_stage3d_baseline: enabledgpu_compositing: enabledmetal: disabled_offmultiple_raster_threads: enabled_onoop_rasterization: disabled_offopengl: enabled_onprotected_video_decode: unavailable_offrasterization: enabledskia_renderer: disabled_off_okvideo_decode: enabledviz_display_compositor: enabled_onwebgl: enabledwebgl2: enabled

Load (avg)
2, 2, 2

Memory (System)
32.00GB (1.64GB free)

Process Argv

Screen Reader
no

VM
15%

I hadn't actually used this command before, thanks for the tweet tip 😄
It looks like this works purely in UI by setting a breakpoint at the cursor position and then resuming the debugger. We accordingly bubble that breakpoint position to Chrome, which (correctly) resolves that to the following statement.
I think the nicest fix here would be adjusting the logic in VS Code such that:

If the cursor is on a line different than the one the debugger is currently paused on, then send the breakpoint at column 0 on the line
otherwise use the current behavior

I already outed myself by saying I don't use this feature, but this seems like it would generally be desirable behavior, at least for JS. Thoughts @weinand?

IMO this works as designed.
@isidorn but I think we could try @connor's suggestion and see whether this improves the feature.

Yes, I like @connor4312 suggestion.
Assigning this to August so we experiment with the suggestion next week.

I tried out the @connor4312 suggestion and it seems to work just fine for me.
I have pushed it, so try it out and let me know how it goes for you,


Add * as language when calling Ask and Suggest

Getting all sentences at the same time can be useful.

Done for 0.9.8.