[SPARK-20448][DOCS] Document how FileInputDStream works with object storage

Change-Id: I88c272444ca734dc2cbc2592607c11287b90a383
What changes were proposed in this pull request?
The documentation on File DStreams is enhanced to

Detail the exact timestamp logic for examining directories and files.
Detail how object stores different from filesystems, and so how using them as a source of data should be treated with caution, possibly publishing data to the store differently (direct PUTs as opposed to stage + rename)

How was this patch tested?
n/a

Test build #76103 has started for PR 17743 at commit c83af37.

Test build #76104 has started for PR 17743 at commit 1e620ce.

Test build #76103 has finished for PR 17743 at commit c83af37.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76103/
Test PASSed.

Merged build finished. Test PASSed.

Test build #76104 has finished for PR 17743 at commit 1e620ce.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76104/
Test PASSed.

Just reread this; still looks correct. Review comments welcome

People don't realise how much object stores aren't file systems until they discover all their assumptions are broken.
Once you know how they work, you can set up a workflow which is more efficient and reliable.

Test build #3934 has started for PR 17743 at commit 1e620ce.

Test build #3934 has finished for PR 17743 at commit 1e620ce.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged to master


overwriting of symlinks to files outside the grunt directory fails

With overwrite: true set, if a symlink resolves to a file outside of the gruntfile's directory, then when it attempts to overwrite an old symlink it fails with:  Warning: Cannot delete files outside the current working directory. Use --force to continue.
I think it should just unlink/change the old symlink.

I'm on a Windows machine, and the following does not work:
options: {
    overwrite: false,
    force: true
}

I still get the following warning: Cannot delete files outside the current working directory. Use --force to continue.

This is also causing a problem for me.

me too.

Same issue here, running the command with --force appears to work.

Looks like a fix was actually merged: https://github.com/gruntjs/grunt-contrib-symlink/commit/21c520c9abd8dca4e5e56a9b3dab1d91bce3d614

You might want to publish a release after that patch... as npm is not picking it up

Is this going to be published on npm? Last published version is from 2014, and this is rather big fix.

@pleszczynski I just downloaded version 0.3.0 from npm and it's working for me.

To be clear, this bug has always been present when using NodeJS 5.x, and it is not fixed in the 0.3.0 release of grunt-contrib-symlink. @stvkas , I assume you were using NodeJS 4.x or earlier.
This was fixed in master over 16 months ago, from https://github.com/gruntjs/grunt-contrib-symlink/pull/13 , but we desperately need a new release to close this issue and https://github.com/gruntjs/grunt-contrib-symlink/issues/21 .
@shama This is a very useful tool, but if it's not kept updated, the user base may fork and fragment. You appear to be a maintainer on npmjs.com, are you able to push a new release? Please let me know if you require any assistance.

Published as 1.0.0.


Add diagnostics (crashes) support for iOS extensions

Describe the solution you'd like
The key feature of our app is a VPN extension.
We need a way to collect descriptive diagnostics for the extension as for the main app including crash reports, app logs, attachments, user ID e.t.c. And have it available in the same app item as the main app in AppCenter console.
Now we are using HockeyApp SDK which is supports this feature and it is great.
But considering migration to AppCenter we've, unfortunately, faced absence of the feature which is an issue for us to proceed.
Describe alternatives you've considered
Speaking to a support engineer we've figured out that there is no workaround or something we can use for now as an alternative solution to the problem

@GusevAndrey thanks for the request. We understand this is a major limitation and I've added this feature to our roadmap. I don't have an ETA at the moment but I will update this thread as soon as I have a clearer timeline.
Thanks for your patience!

We are trying to use 2.5.0 with a VPN extension, and it crashes on init surpassing the memory limit, right after the first crash. It then gets into infinite OOM crash loop.

@Oddj0b clarify please if the memory limit issue mentioned by @vkrasnov was fixed now (AppCenter SDK 3.0.0)?

@GusevAndrey I'll check with my colleagues.

@Oddj0b Any news so far?)

Hey @GusevAndrey - apologies for the delay. Can you start a support thread (blue chat bubble) so our team can take a look? Our engineering team would like some more details to help with thier investigation.
We will update this thread for others after the investigation. Thanks!


Creating Repository over Nexus Python SDK: Parameter Group must not be null

Environment

Nexus SDK version: 0.1.5
Python version: 3.10
Nexus Repository Manager version: OSS 3.62.0

Steps to Reproduce
I want to manage my Nexus instance over the Python SDK, so I dont have to configure a lot with json handling etc.
So, i have done a python toolset, to configure for example: One Yum Repository.
When I try to create the repo over the python script,
it fails with the following message: HTTP response body: b'[{"id":"PARAMETER group","message":"must not be null"}]'
All looks well - but for my opinion it seems to be that the first maven group function is used?
I use this function:
api_client = nxrm_sdk.ApiClient(configuration)
repository_api = nxrm_sdk.RepositoryManagementApi(api_client)

And this is the json, that will be sent to create the Repo:
 {
   "repositories": [
     {
       "name": "yum-repo",
       "type": "hosted",
       "format": "yum",
       "online": true,
       "storage": {
         "blobStoreName": "default",
         "strictContentTypeValidation": true
       }
     }
   ]
 }

Expected Behavior
A python toolset should be used over helm to do all the configuration stuff of nexus "as code".
Finally, it doesnt work as expected

Observed Behavior
Group Parameter must not be null
My Question to the Nexus Community:
Is this SDK already in use, to do the Rest API Coding Stuff (seems to be mostly automatically generated....) - or are you all "communicating directly" to the Rest API, without using an SDK, which makes the life maybe more easier?
All suggestions to fix  the problems will be very helpful. I will now try to configure the stuff without the Nexus Python SDK.
Kind regards
Torsten

So, this SDK was automatically generated using Swagger Code Generator. I have used it for some automation, mostly around fetching component/asset manifests.

I just switched to do the coding setup with terraform - but if I can integrate the nexus python sdk into my ArgoCD Pipeline over Helm, this would be awesome :) Thanks for accepting this as enhancement!


Rename Address into AddressHex

to match the names in the Raiden client codebase.

@palango pointed out that I could use the type defined in eth_typing https://github.com/ethereum/eth-typing/blob/d06fcac1b6e396a5ecee70b527469f64ba703943/eth_typing/evm.py#L12

why is the code base using hex encoded values instead of binary?

why is the code base using hex encoded values instead of binary?

Maybe because it's hex on every interface of raiden-contracts.  In JSON files it's hex, and web3 is also happy with hex (checksummed).
But I believe we should follow the sandwich principle, and the interface between raiden and raiden-contracts should use the binary format.  I created an issue. https://github.com/raiden-network/raiden-contracts/issues/997


Bug Report: Game crashes when I try to set a keybind

Which target are you using?
[x] Windows
[ ] Linux
[ ] Mac
Explain your issue
Please check first if your issue haven't already been reported yet.
I've downloaded the latest action build, this is what I get when changing a keybind.

can replicate

fixed


feat: 🎸 bump SDK to support Polymesh 5.4

JIRA Link
https://polymesh.atlassian.net/browse/DA-695
Changelog / Description
feat: 🎸 bump SDK to support Polymesh 5.4
Checklist -

[x] New Feature ?
[x] Updated swagger annotation (if API structure is changed) ?
[x] Unit Test (if possible) ?
[x] Updated the Readme.md (if required) ?

:tada: This PR is included in version 3.0.0-alpha.2 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:

:tada: This PR is included in version 3.1.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


[firebase_storage] Add notes on installing firebase to every firebase package

I was trying to install firebase via the firebase_storage package and had difficulties, later i found following the instructions at https://pub.dartlang.org/packages/firebase_auth in order to properly install it.
Apologies if this issue isn't made at the right repo, but I'd like to suggest we add notes to each firebase package that people need to go through this process for installing and setting up firebase for the 1st time.

@acidjazz
The issue at https://github.com/flutter/flutter/issues/15805 has been closed and moved here. Future collaboration on this issue will be done here.

Hey 👋
Our rework of the Auth, Core & Firestore plugins as part of the FlutterFire roadmap was published over a week ago with a ton of fixes and new features.
As part of this we introduced a new documentation site which should has a lot of new documentation that should cover this issue & others in general. If you spot any issues on the documentation or anything missing then please raise a new GitHub issue, or better yet suggest a change via a Pull Request (there's a 'Edit this page' button at the bottom of every page on the docs).
Additionally, for help migrating to these new plugins I'd recommend checking out the migration guide: https://firebase.flutter.dev/docs/migration


Feature #388: Use adbk list in new transactions

Closes #388
Closes #464
Closes #481
Closes #483
Description

Implements the addressbook list within the transaction creation/send funds

Looks like this now:

Note

The designs shows that the selected entry should look like this:

I just displayed the address for now, with our current material ui components was not easy to implement that, so I just simplified it, I'll open an issue for improving this if you guys agree.

Update in the issues reported:
~https://github.com/gnosis/safe-react/issues/477~
~https://github.com/gnosis/safe-react/issues/478~
~https://github.com/gnosis/safe-react/issues/479~
https://github.com/gnosis/safe-react/issues/480
https://github.com/gnosis/safe-react/issues/481
https://github.com/gnosis/safe-react/issues/482
Besides the 3 open issues there are, there is now an issue in the PR461 where no address are shown for custom transaction. At some point it was tried to be implemented that only contract address would show in the selector for custom Tx, but not even those are showing.
I've tested with the WBTC contract: 0x577D296678535e4903D59A4C929B718e1D575e0A
@lukasschor @Agupane

Besides the 3 open issues there are, there is now an issue in the PR461 where no address are shown for custom transaction. At some point it was tried to be implemented that only contract address would show in the selector for custom Tx, but not even those are showing.
I've tested with the WBTC contract: 0x577D296678535e4903D59A4C929B718e1D575e0A

I think we should merge this and create a seperate ticket for the mentioned issue. This does not seem like a high-priority bug to me.

I agree, I'll merge this pr and will continue working on the issues related to the feature in other prs


Convert Intel Windows BAT file to Shell Script

Here is the batch file, and here is the set of rules for converting a BAT to .sh.
Alternately, we could simply try adapting the version for Mac, or Linux.
Edit: Will talk about this w. Adam when he's in.

Actually, talked to Jesse and we can move directly to the cross-compiler.


1347 human readable confluence url

Pull Request Type

[x] ✨ feat
[ ] 🐛 fix
[ ] ♻ refactor
[ ] 💄 style
[ ] 🔨 chore
[ ] 📝 docs

Relevant Issues

resolves #1362
What is in this change?
The baseUrl value for the human readable confluence url cannot have /wiki in it.
Additional Information
Developer Validations

[x] I ran yarn lint from the root of the repo & committed changes
[x] Relevant documentation has been updated
[x] I have tested my code functionality
[x] Docker build succeeds locally

@cope What is a URL example here for this? If the URL includes display it should get matched regardless, no?

@timothycarambat the API url does not have display in it, similar to how the /wiki/space one does not have space.
In other words, for default https://domain.atlassian.net/wiki/space/~SPACEID/* the API url is only https://domain.atlassian.net/wiki/.
Similarly, for https://<customDomain>/display/~SPACEID/* the API url is only https://<customDomain>/.


Repository location

How do I add your repo to helm? Or is your code still based on the stable repository, which is depreciated?
Shouldn't I be able to do this?
helm repo add lebenitza https://lebenitza.github.io/charts

Apparently I made a typo on my terminal, the above command does work.

Hey, glad you were able to fix your problem. I will continue to provide any required help with this chart as I also use it extensively and I could not find anyone else maintaining it.


Review formula for CRPS in documentation

There could be an ambiguity here in the order of operations, some more brackets would clear it up

Mathjax formula for both CRPS methods has now been improved and clarified, so this issue is now resolved.


Unable to import Tensorflow on Mac

I discovered when i use the Python.RunTime.DLL from Lean/packages, the python is running as 32 bit, hence cause an error for tensorflow as in below. However, if i try to compile the pythonnet on my own, it will get me an System.EntryPointNotFoundException: Py_IsInitialized. Please advise a solution.
With great thanks,
Chris
ImportError: dlopen(/Library/Python/2.7/site-packages/tensorflow/python/_pywrap_tensorflow_internal.so, 10): no suitable image found.  Did find:
	/Library/Python/2.7/site-packages/tensorflow/python/_pywrap_tensorflow_internal.so: mach-o, but wrong architecture

Please install 64-bit python 2.7.

umm...the strange thing is either i run the mac's native python or the one i installed with anaconda, they are all in 64 bit. Just if i use mono to run the nPython.exe from the lean packages, it becomes 32 bit...
I've tried compile pythonnet with the above python version my own, still cant resolved the problem. BTW, i am using Mac Sierra 10.12.

I finally managed it to solve by re-installing the mono, the case was some old symbolic link not updated. Thanks for your help anyway.


feat: update fsm stable api

Signed-off-by: Gaius<EMAIL_ADDRESS>
Description

Update fsm stable api.

Related Issue

Motivation and Context

Screenshots (if appropriate)
Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Documentation Update (if none of the other choices apply)

Checklist

[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[x] I have read the CONTRIBUTING document.
[ ] I have added tests to cover my changes.

Codecov Report

Merging #1938 (7e1be5c) into main (0ce703c) will decrease coverage by 0.01%.
The diff coverage is 21.73%.

:exclamation: Current head 7e1be5c differs from pull request most recent head 9229e55. Consider uploading reports for the commit 9229e55 to get more accurate results

@@            Coverage Diff             @@
##             main    #1938      +/-   ##
==========================================
- Coverage   43.39%   43.38%   -0.02%
==========================================
  Files         134      134
  Lines       17130    17130
==========================================
- Hits         7433     7431       -2
- Misses       9142     9144       +2
  Partials      555      555

Flag
Coverage Δ

unittests
43.38% <21.73%> (-0.02%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

scheduler/resource/host.go
87.87% <0.00%> (ø)

scheduler/resource/peer_manager.go
77.00% <0.00%> (ø)

scheduler/resource/seed_peer.go
16.66% <0.00%> (ø)

scheduler/resource/task_manager.go
82.97% <0.00%> (ø)

scheduler/scheduler/scheduler.go
82.23% <0.00%> (ø)

scheduler/resource/task.go
87.73% <20.00%> (ø)

scheduler/resource/peer.go
68.69% <22.22%> (ø)

scheduler/service/service.go
72.36% <36.84%> (ø)

client/daemon/peer/piece_manager.go
52.99% <0.00%> (-0.41%)
:arrow_down:

client/daemon/peer/peertask_conductor.go
57.44% <0.00%> (-0.22%)
:arrow_down:

... and 1 more


[FEATURE] Collect S3 bucket endpoint

Motivation
Currently dataset namespace for s3 has format s3://bucket. This is because:

Spark uses this format of URLs for accessing data.
In case when users rely on some cloud provider's S3 implementation, most of buckets are stored using the same endpoint, so it can be hard to read namespaces with names like s3://bucket1.s3.us-east-2.amazonaws.com.
In case of Amazon S3, users don't have to set fs.s3a.endpoint manually, it is inferred from fs.s3a.endpoint.region.

But there are few drawbacks:

If I understand correctly, bucket is created in specific region, but region name is not a part of namespace.
For users with on-premise S3 instances, there can be different endpoints there bucket can be created, e.g. production/staging/test S3 instances.

Having a S3 endpoint added into OL events could help users to investigate issues ("where is my data is saved to?") and perform impact analysis ("who is using data from this exact bucket and region?").
Description
There can be 2 options there:

Change format of namespace for S3 to s3://bucket.domain.com (domain-style access, used in AWS) or s3://domain.com/bucket (path-style access, could be used in other S3 instances). This may lead to backward compatibility issues on OL event consumers.
Add new facet with mapping between bucket -> endpoint, like:

{
  "facets": {
    "s3_bucketEndpoints": {
      "bucket1": "s3.us-east-2.amazonaws.com",
      "bucket2": "custom.endpoint.com"
    }
  }
}

For Spark, endpoints configuration is quite complex. There could be options like:
# Endpoint for all buckets by default
spark.hadoop.fs.s3a.endpoint=some.domain.com
# Custom settings for specific bucket https://hadoop.apache.org/docs/current/hadoop-aws/tools/hadoop-aws/index.html#Configuring_different_S3_buckets_with_Per-Bucket_Configuration
spark.hadoop.fs.s3a.endpoint.bucket.mybucket.endpoint=another.domain.com
# Iceberg allows to override settings above https://iceberg.apache.org/docs/1.5.1/spark-configuration/#using-catalog-specific-hadoop-configuration-values
spark.sql.catalog.iceberg_catalog.hadoop.fs.s3a.endpoint=more.domain.com

# There could be same options, but for fs.s3n or fs.s3 protocols as well

For Flink: https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/filesystems/s3/#configure-non-s3-endpoint
For Airflow: https://airflow.apache.org/docs/apache-airflow-providers-amazon/stable/connections/aws.html#howto-connection-aws-per-service-endpoint-configuration
Related issues
#2709
Do you plan to make this contribution yourself?

[X] I am interested in doing this work

Related: #2817


DefaultAndroidInput: delta is always zero for dragging events

Gdx.input.getDeltaX(pointer) and Gdx.input.getDeltaY(pointer) return 0 for pointer = 0.
It's a new behaviour appearing in version 1.12. I think the reason is these 4 lines. I don't understand for what kind of problems they should solve.
Another pointers don't have a similar reset and drag works correctly for them.
The demo project is attached. Run it  and check LogCat from a connected device,
inputbug.zip
Libgdx v1.12, Android

This definitely looks like a bug; I ran the demo project, and it only receives drag x and y input as 0 and 0. The only change I made was switching to Gdx.app.log() instead of System.out.println(), just because I am not very experienced with Android and I wasn't sure how to view various things. @Frosty-J , any thoughts on this catchy situation?

Did this work on desktop? I added those lines in Android because it seems equivalent to desktop.
https://github.com/libgdx/libgdx/blob/75612dae1eeddc9611ed62366858ff1d0ac7898b/backends/gdx-backend-lwjgl3/src/com/badlogic/gdx/backends/lwjgl3/DefaultLwjgl3Input.java#L207-L208

It does produce non-zero coordinates on Desktop. They seem to be relative; they're often small negative or positive values in my limited testing.

Did this work on desktop?

Yes, it does.

I added those lines in Android when implementing cursor-catching because it seems equivalent to desktop.

I'm not sure but touches and mouse should have different behaviours (and therefore event handlers). I don't think that the cursor catching for touches is needed (I didn't go deep in it, so maybe I'm wrong).

Hmm, yeah. I'm not sure if there's a good way to detect whether someone is using the touchscreen on an Android device or a mouse (more common on Chromebooks).

What's the plan to fix this? I'm not too bothered about cursor catching on Chromebooks but quite a bit on the regression bug. Shall we revert in the meantime?

I am definitely in favor of reverting the cursor-catching change on Android; I'm surprised this hasn't come up more often.

If we don't know why the other backends set delta to 0, reverting is probably the easiest course of action. Be sure to update the changelog to say the feature has been removed.


Typo

This one was so I could create the video you asked me to make on Friday. I shared it with you on Google Drive. Let me know if there are any issues.


Using nested widgets

Prerequisites

I use in my project react-jsonschema-form.  I have a question.

Can I use such that UI schemes ? :
const uiSchema = {
  activities: {
    "ui:field": CustomParentComponent,
    // note the "items" for an array
    items: {
      requests: {
        "ui:field": CustomChildComponent,
      }
    }
  }
};

When I try to code such a scheme, is drawn only CustomParentComponent.
I want to draw one component inside another component.

What is that requests? Have you tried this?
const uiSchema = {
  activities: {
    "ui:field": CustomParentComponent,
    items: {
      "ui:field": CustomChildComponent,
    }
  }
};

@n1k0  Yes I tried it.  In this scheme occurs only render CustomParentComponent

Doesn't https://jsfiddle.net/ymr6aeck/3/ solve your issue?

@n1k0  Thank you. This solves my problem partially. I need to render the scheme with many levels of nesting. This is my scheme - https://jsfiddle.net/3gyh1u4w/.  I want to make a render my custom components at all levels of nesting.  Is it possible to render with 3-10 levels of nesting custom components ?

I can't see why it wouldn't work. Did you try?

@n1k0 This is code with 3 levels of nested components - https://jsfiddle.net/21964wcm/1/ and this is work. But I need the implementation in which the components do not know anything about ui:scheme. On the backend generated different schemes. The cliend side shall be automatically generated forms with different custom components. Component which one scheme - Parent  to another scheme may be Child.   If you have any ideas how this can be implemented using react-jsonschema-form I'll be happy. Thanks in advance for your time.

If I understood your question correctly, you want the backend to generate different schemas, but the backend is ignorant of uiSchema. Can you write JavaScript to automatically generate a uiSchema from the JSON schema?

This might also be related to #477.


[cxx-interop] Simplify name generation for template arguments of builtin types

We were searching for types in the Swift stdlib by name, just to get the names back from the types. Let's just return the type name without performing the search.
No user-facing change intended.

@swift-ci please smoke test


Port to react, Pwa support ; improve UI/UX and reduce excessive white space

React Adv :

Prevention redundant usage of components by either using .map() or HOC --(.map() better than for --> in vue - v-for has to be used)--
2.Virtual Dom flexibility
Number of available options to implement a particular set of code, as compared to vue

--- UI ---
Use less white spacees
Map dialogue box on Home screen is can be designed with more flexibility to improve user interface with the diagram
Minimalistic designing could be implied
Navbar Items placing can be improved
Testimonials presentation could be highlighted in much better way

Sorry, we just had someone work 3 months to build it in Vue. We're not porting it to react.
If you want, feel free to create a React version, if it fulfills all the requirements we'd be happy to move over.
For the UI issues you listed, you're welcome to create separate issues for those and even more welcome to make PRs :)

So would you be making another repository for react under the organization for bioJS project ?


[BUG]Kafka re-create procedure has bug because of longhorn.

Describe the bug (🐛 if you encounter this issue)
I have a microservice architecture supported by longhorn storage in an on-prem k8s environment. Longhorn storage, which generally works smoothly, may cause problems in recreation situations in some 3rd party applications. One of them is Kafka. When I re-deploy, Kafka cannot remount to the paths I set as volumeMount, and a longhorn PVC does not appear as an error message, thats why The pod remains in the containerCreating state.
The problem here is that one pv of the kafka pod cannot be attached with another pvc. However, due to a situation that I don't know why, Kafka gets attached to a PVC and stands up after a long time after it is re-created, the time being variable. I cannot manage this situation. I'm wondering what the problem is here. I would appreciate it if you could clarify.
Expected behavior
The created pod is attached to the longhorn PVC's in the required period and stands up.
Environment

Longhorn version: v1.5.0
Installation method (e.g. Rancher Catalog App/Helm/Kubectl): kubectl

Number of management node in the cluster: 1
Number of worker node in the cluster: 5

Node config

OS type and version: ubuntu

@Vedooo could you also provide the support bundle? also specify which volume (PV, also it's PVC) was impacted.


Disable MFA authentication

Hi
I'm trying to use this in a Jenkins pipeline with a custom docker container. I am logging in to Okta as a service account which has MFA exception...in other words,  login MFA prompt should not happen.
I tested out the container on my local machine, and it works as expected (no MFA prompt) which means the Okta rules are set up correctly. However, with running the same container in Jenkins and same credentials, I keep getting MFA prompts.
Is there any way to remove MFA prompt from the python code itself (or by using a config file option)?
Thank you in advance!

If this helps, running the package in Docker on my local machine yields:
Detected single role: arn:aws:iam::xxxxx:role/xxxxxx
Saving arn:aws:iam::xxxxxx:role/xxxxx as default
Written profile default to /usr/local/.aws/credentials
and in Jenkins (identical Docker image) container:
Multi-factor Authentication required.
Okta Verify App: SmartPhone_Android: xxxxxxx
Okta Verify push sent...
Detected single role: arn:aws:iam::xxxxx:role/xxxxxx
Saving arn:aws:iam::xxxxxx:role/xxxxx as default
Written profile default to /usr/local/.aws/credentials

realized this was due to mis-configuration on Okta side. Closing issue


Subroutes

Is this library working with sub-routes?
I have modules and submodules with routing and translation not woring on second level of routes
domain.com/en/registration <- working
domain.com/en/registration/step-one <- not-working

Yes I calling LocalizeRouterModule.forChild(routes):
I have:

lazy loaded module (register in root) with lazy loaded sub-routes (with routing modules). Iam calling LocalizeRouterModule.forChild(routes) on lazy loaded module and in subroutes. Translation of names working, but Iam getting "Error: NG04002: Cannot match any routes" on second defined language on lazy loaded subroutes (ex.: domain.com/en/registration/step-one).

Since most of my production projects is running on ng13 I don't see the issue.
I created angular 14 version to test. Looks like something changed in angular 14 routing, seems like it is duplicating routes when changing language.
Without you sharing the whole error, my assumption is that it is attempting to navigate to
/en/registration/step-one/registration/step-one
Can you confirm if that's what's happening?

It looks like it doesnt translate the route, because this routes working:
/en/registration/step-one
/cs/registrace/step-one
but not this desired translated one:
/cs/registrace/krok-jedna

Hello,
Can you try the latest version.
I've changed the version to 14.0.0 to match with angular versioning.
npm i<EMAIL_ADDRESS>Regards

Thanks, now it's working with latest version.


Tutorial "Perform Text Analysis with SAP HANA Express Edition" - Graph Creation Issue

In tutorial "Perform Text Analysis with SAP HANA Express Edition" (https://developers.sap.com/tutorials/hxe-docstore-05-graph-analysis.html) the last point of step 7 (Create Graph Workspace) is not working, because of following points:

The source column name must be upper case: SOURCE COLUMN "src_id" -> SOURCE COLUMN "SRC_ID"
The target column must be upper case: TARGET COLUMN "dest_id" -> TARGET COLUMN "DEST_ID"
The key column name for the Edge and Vertex table must be "ID" instead of "NAME"

BR,
Florian

Hi @pfefferf,
Many thanks for pointing this out. I will try to update the tutorial later today

Will be fixed with PR https://github.com/SAPDocuments/Tutorials/pull/3520


Komikindo

Source information
KomikindoID 1.4.14
Source language
Indonesia
Source new URL
https://komikindo.biz/
Other details
No response
Acknowledgements

[X] I have updated all installed extensions.
[X] I have opened WebView and checked that the source URL has not changed yet.
[X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open or closed issue.
[X] I have written a short but informative title.
[X] I will fill out all of the requested information in this form.

Not blocked for me. In fact its already supported in keiyoushi its the new url of Komikindo.lol (and .biz redirect to .dev now)
https://github.com/keiyoushi/extensions-source/blob/main/src/id/komikindoid/src/eu/kanade/tachiyomi/extension/id/komikindoid/KomikIndoID.kt
SO its a DOMAIN change request.


bootstrap fails on RHEL

Do you want me to try to fix this?  If so, should it always look for the corresponding CentOS?  (I think that won't generally have quite the same package set available, and definitely not the same as SL.)
$ sudo singularity bootstrap /tmp/c6.img examples/centos.def
Loaded plugins: auto-update-debuginfo, changelog, etckeeper, fastestmirror,
              : filter-data, merge-conf, post-transaction-actions, priorities,
              : product-id, protectbase, security, subscription-manager, verify,
              : versionlock
This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register.
Setting up Install Process
http://mirror.centos.org/centos-6Server/6Server/os/x86_64/repodata/repomd.xml: [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404 Not Found"
Trying other mirror.
To address this issue please refer to the below knowledge base article

https://access.redhat.com/articles/1320623

If above article doesn't help to resolve this issue please open a ticket with Red Hat Support.

Error: Cannot retrieve repository metadata (repomd.xml) for repository: os-base. Please verify its path and try again

Oh that is very interesting. Are you running this from RHEL proper?
Yes if you can fix that would be fantastic. I don't have access to any RHEL systems.
Thanks!
Sent from my iPhone

On May 11, 2016, at 2:50 AM, Dave Love<EMAIL_ADDRESS>wrote:
Do you want me to try to fix this? If so, should it always look for the corresponding CentOS? (I think that won't generally have quite the same package set available, and definitely not the same as SL.)
$ sudo singularity bootstrap /tmp/c6.img examples/centos.def
Loaded plugins: auto-update-debuginfo, changelog, etckeeper, fastestmirror,
: filter-data, merge-conf, post-transaction-actions, priorities,
: product-id, protectbase, security, subscription-manager, verify,
: versionlock
This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register.
Setting up Install Process
http://mirror.centos.org/centos-6Server/6Server/os/x86_64/repodata/repomd.xml: [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404 Not Found"
Trying other mirror.
To address this issue please refer to the below knowledge base article
https://access.redhat.com/articles/1320623
If above article doesn't help to resolve this issue please open a ticket with Red Hat Support.
Error: Cannot retrieve repository metadata (repomd.xml) for repository: os-base. Please verify its path and try again
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub

You wrote:

Oh that is very interesting. Are you running this from RHEL proper?

Yes.
$ lsb_release -d
Description:	Red Hat Enterprise Linux Server release 6.7 (Santiago)
but the compute nodes are
Description:	Scientific Linux release 6.7 (Carbon)

Yes if you can fix that would be fantastic. I don't have access to any
RHEL systems.

Probably not necessary, but for what it's worth, you can get a vagrant
box for some version of rhel6 (which presumably isn't updatable as such).

Looking at it, shouldn't there at least be entries for updates, rather than just the base distribution?
Maybe the repos which are enabled in the boostrap environment should be copied, although they might not work elsewhere (especially from RHEL/SLES moved elsewhere).  That suggests being able to specify a list in the configuration somehow.
Examples of things I'd expect to include are EPEL and RH software collections (rebuilt by SL, and possibly CentOS).

What do you mean "entries for updates"? By default, one could point RELEASE at 5, 6 or 7 and always get the current dot release.
Do you have an idea of how to add the EPEL repo? I wouldn't want to do it automatically, but as long as it can be a install flag (possibly InstallFile /etc/yum.repos.d/* and copy from the host?)

"Gregory M. Kurtzer"<EMAIL_ADDRESS>writes:

What do you mean "entries for updates"? By default, one could point
RELEASE at 5, 6 or 7 and always get the current dot release.

The CentOS-Base.repo file I have contains entries for "base" and
"updates".  The compute node sl6x.repo has "sl6x", "sl6x-security", and
"sl6x-fastbugs" enabled.

Do you have an idea of how to add the EPEL repo? I wouldn't want to do
it automatically,

Why not?  It's where most of the useful stuff is.

but as long as it can be a install flag (possibly
InstallFile /etc/yum.repos.d/* and copy from the host?)

Yes, maybe.  However, if the host is, say, our RHEL login node, the
result won't be able to use the repos on SL systems like our compute
nodes.

What provides those yum repo files? I figured it was -release.rpm and that should be getting installed, if not, that should be fixed.
As far as EPEL, I agree most useful stuff is but I don't think it should be included or enabled by default. Maybe make that as part of the default Centos definition but commented out so we can demonstrate how to do it without making it default.

"Gregory M. Kurtzer"<EMAIL_ADDRESS>writes:

What provides those yum repo files? I figured it was -release.rpm
and that should be getting installed, if not, that should be fixed.

I'm confused what's happening, then, and should update the source to
check.  I was trying to fix the generation of a yum.conf file pointing
to a base repo.
To answer the question, on RHEL:
rpm -qf /etc/yum.repos.d/redhat.repo
subscription-manager-1.16.8-8.el6.x86_64
and on SL:
osrpm -qf /etc/yum.repos.d/sl6x.repo
yum-conf-sl6x-1-2.noarch
[osrpm runs rpm in the stateless image.]

As far as EPEL, I agree most useful stuff is but I don't think it
should be included or enabled by default.

OK, but for what it's worth, it's included in the relevant Fedora build
roots (called, e.g. epel-6-x86_64).

Let me know if there is anything I can answer to help, but right now I'm not sure what has confused you. There is one bit that might help. For the bootstrap, I generate an initial yum.conf in root's home directory this way when yum and release packages drop their own configs, it doesn't conflict or get overridden. This does and up with an issue for subsequent yum calls... Which yum configs do we use? ... That is the question!

I think I misunderstood this, looking too hurriedly.  The bootstrap will
work OK if you amend the centos example, at least, to use a specified
target version rather than one deduced from the host.  That will work
between at least el6/epel7 hosts and targets.
However you end up with distribution base packages in the container,
i.e. without any updates, which I think it should get.
Note that the implementation probably needs to be specialized to use dnf
rather than yum for recent fedora.  I'll look at that, but it presumably
constrains the host.
Also it might be worth noting that debian won't bootstrap in el6/epel7
hosts because they lack apt (which is in fedora) even though they have
debootstrap.  I can look at getting apt into epel.

Can you elaborate on what distribution base packages end up in the container?
As much as I love the idea of dnf (hopefully it will all end up in C) obsoleting YUM, I'm still sentimentally attached to YUM. I worked with Seth early on as I wanted out of the RPM wrapper world (I wrote a simple tool called GRAB back in the day) and he wanted in... and to learn Python.
Apt shouldn't be required on the host. In linux_build_debian.smod I call chroot into the newly created base file system that debootstrap created (and thus it should have apt-get within it, not on the host. On a quick check, I see I'm looking for apt-get on the host even though it is not necessary. I'm removing that now, let me know if works.
Thanks!

Tried a RHEL7 bootstrap with yesterday's singularity/2.0 snapshot. It almost finished:
...
Complete!
Loaded plugins: langpacks, product-id, rhnplugin, search-disabled-repos, subscription-manager
Cleaning repos: atomic epel google-chrome rhel-x86_64-server-7 rhel-x86_64-server-7-rhscl-1 rhel-x86_64-server-extras-7 rhel-x86_64-server-optional-7
: rhel-x86_64-server-rh-common-7 virtualbox winswitch
Cleaning up everything
/usr/local/libexec/singularity/mods/linux_build.smod: line 180: echo: write error: Invalid argument

linux_build.smod line 180:
echo "singularity / rootfs rw 0 0" > "$SINGULARITY_BUILD_ROOT/etc/mtab"

I was just looking at that... Very weird. What is the build host type you
used?
Can you also show me your bootstrap definition?

$ cat rhel7.def
Use shell lingo to determine version and repository location
RELEASE=rpm -qf /etc/redhat-release  --qf '%{VERSION}\n'
DistType "redhat"
MirrorURL "http://mirror.centos.org/centos-${RELEASE}/${RELEASE}/os/$basearch/"
MirrorURL "http://winswitch.org/dists/CentOS/7Server/x86_64/"
Setup
Bootstrap
InstallPkgs xpra
Cleanup

I am trying to replicate the build now. Are you building it on Centos7?

Oh, interesting.. I am getting an error in that the second MirrorURL you
supplied does not have a full Centos distribution. that is an interesting
feature though, to supply multiple mirrors for packages and have YUM
configure all that are listed (but at present, it only supports one
MirrorURL with the last one taking precedent).
I could fairly easy make it to support such syntax as:
DistType "redhat"
MirrorURL  "
http://mirror.centos.org/centos-${RELEASE}/${RELEASE}/os/\$basearch/"
Setup
Bootstrap
MirrorURL "http://winswitch.org/dists/CentOS/7Server/x86_64/"
InstallPkgs xpra
Cleanup
But at the moment, it won't work...
If you remove the second MirrorURL line, do you still get the echo error? I
can not seem to replicate it.

Another error when trying to execute a command from the image for the first time:
singularity exec /foo/images/xpra-rhel7.img xpra --version
ERROR: Could not create directory /bar/singularity/20160519/var: Permission denied
ERROR: Could not create directory /bar/singularity/20160519/var/singularity: No such file or directory
ERROR: Could not create directory /bar/singularity/20160519/var/singularity/mnt: No such file or directory
ABORT: Could not create directory /bar/singularity/20160519/var/singularity/mnt: No such file or directory
We have root-squashed shared filesystems all over the place, so suexec won't do anything.
How does this work in a shared environment?

How did you compile and install Singularity? The --prefix path should be pointing to a local directory on the compute node. Hrmm... I might be able to work around that actually if that is not an option.

That's the problem. Our nodes are diskless, so we have to use networked filesystems. I needed to be able to perhaps 'unpack' or 'install' an image, so hundreds or even thousands of concurrent jobs could run commands from it without any write access to the singularity installation directory tree or the image directory tree. They can use cwd or tempdir for some operations as needed.
On May 20, 2016 5:03:47 PM EDT, "Gregory M. Kurtzer"<EMAIL_ADDRESS>wrote:

How did you compile and install Singularity? The --prefix path should
be pointing to a local directory on the compute node. Hrmm... I might
be able to work around that actually if that is not an option.

You are receiving this because you commented.
Reply to this email directly or view it on GitHub:
https://github.com/gmkurtzer/singularity/issues/33#issuecomment-220718010

We run nodes diskless too, but Singularity only writes a few small text files and uses the localstatedir (/var) for mounting the container. But, with that said, I can move that to the session directory which will always exist in /tmp. Is your /tmp local?
I just committed a change to put the image mount into the session directory. Give the master branch a try and see if that helps. Or you can move the --localstatedir=/var in your ./configure.
Let me know! Thanks!

You wrote:

Can you elaborate on what distribution base packages end up in the container?

Ones from the repo you specify.  In the example, that excludes updates
unless you explicitly do an update or dependencies are implicitly
updated if you install other packages.

As much as I love the idea of dnf (hopefully it will all end up in C)
obsoleting YUM, I'm still sentimentally attached to YUM. I worked with
Seth early on as I wanted out of the RPM wrapper world (I wrote a
simple tool called GRAB back in the day) and he wanted in... and to
learn Python.

As I understand it, you should use dnf on fedora, apart from the noise
using yum (but you want to avoid any version installed on centos).  It
apparently can give different results.

Apt shouldn't be required on the host. In linux_build_debian.smod I
call chroot into the newly created base file system that debootstrap
created (and thus it should have apt-get within it, not on the
host. On a quick check, I see I'm looking for apt-get on the host even
though it is not necessary. I'm removing that now, let me know if
works.

OK, I'll test at some stage.

On Sun, May 22, 2016 at 3:13 PM, Dave Love<EMAIL_ADDRESS>wrote:

Can you elaborate on what distribution base packages end up in the
container?

Ones from the repo you specify. In the example, that excludes updates
unless you explicitly do an update or dependencies are implicitly
updated if you install other packages.

Ahh, I see what you mean but I think it is valuable to bootstrap from a
release version, and then upgrade from there if desired. I also agree
though that it would be valuable to be able to bootstrap the most recent
release. Hopefully this won't require multiple Mirrors... But if it does, I
think that should be doable. I'd have to move some of the YUM config code
around so the YUM components get appended with every call to MirrorURL to
include that repo. As I see it, this would then include the update repo as
ell (or any repo of your choosing) during install.
Would that address your desire?

As much as I love the idea of dnf (hopefully it will all end up in C)
obsoleting YUM, I'm still sentimentally attached to YUM. I worked with
Seth early on as I wanted out of the RPM wrapper world (I wrote a
simple tool called GRAB back in the day) and he wanted in... and to
learn Python.

As I understand it, you should use dnf on fedora, apart from the noise
using yum (but you want to avoid any version installed on centos). It
apparently can give different results.

Different results?! That sounds scary... I wonder which decision would be
the source of truth.

Apt shouldn't be required on the host. In linux_build_debian.smod I
call chroot into the newly created base file system that debootstrap
created (and thus it should have apt-get within it, not on the
host. On a quick check, I see I'm looking for apt-get on the host even
though it is not necessary. I'm removing that now, let me know if
works.

OK, I'll test at some stage.

Thanks! I will too! Let's race.. ;)
--
Gregory M. Kurtzer
High Performance Computing Services (HPCS)
University of California
Lawrence Berkeley National Laboratory
One Cyclotron Road, Berkeley, CA 94720

$ singularity exec xpra-rhel7.img xpra start 3232 --start-child=beauti
$ singularity execxpra-rhel7.img xpra list
xpra initialization error:
No xpra sessions found
$ beauti
Picked up _JAVA_OPTIONS: -Xms128m -Xmx1024m
Exception in thread "main" java.awt.HeadlessException:
No X11 DISPLAY variable was set, but this program performed an operation which requires it.
at java.awt.GraphicsEnvironment.checkHeadless(GraphicsEnvironment.java:207)
at java.awt.Window.(Window.java:536)
at java.awt.Frame.(Frame.java:420)
at java.awt.Frame.(Frame.java:385)
at javax.swing.JFrame.(JFrame.java:181)
at dr.app.beauti.BeautiApp.main(Unknown Source)
No cookie, yet.

Ahh, this maybe in part a usage error as well. Every time you exec/shell/run it will create a new series of namespaces. This is because there is no state between them (e.g. no runtime daemon). I may end up writing one at some point, but as of this release, it doesn't have the ability to spawn related commands (e.g. start a daemon process and then come back to them).
There is a work around... Either use a runscript, or use the interactive shell which will keep all processes contained that started via the shell. So your command will instead look like this:
$ singularity shell xpra-rhel7.img
Singularity/xpra-rhel7.img> xpra start 3232 --start-child=beauti
Singularity/xpra-rhel7.img> beauti
...
Also, check your DISPLAY environment variable both outside and inside your container. Singularity passes that automatically into the container.

@loveshack Is this still an issue with the latest changes to linux_build_redhat.smod?
Thanks!

Closing stale issue. If it turns out this is still an issue with the latest releases we can come back and reopen or deal with it from there.
Thanks!


Contact

Added the Contact page.
What needs to be discussed and decided tomorrow:

how do we validate when no contact option is selected: no email option, no phone option & no post option.

what do we do for the summary view when only one option is picked: i.e. the user picked email and that can be shown now. But what do we do when they pick the phone number only? Do we show email option as blank or do we omit it completely? The same goes for contact via post.

Looks fine for now, but let's wait for the conversation about validation and display!


Logistic regression solution notebook refactoring

Fixing features encoding (using ordinal encoder for Item size, categorical encoder for all the other features and label encoder for Color) as recommended by scikit-learn documentation
Using F1 score instead of accuracy to evaluate the model since the dataset is highly skewed
Updating plots to better show the data before and after encofings and the relationships between label and features
Fixing ROC curve plot using matplotlib

Looks great!

Should we remove the output from this notebook? Would make it smaller and easier to diff

Should we remove the output from this notebook? Would make it smaller and easier to diff

@jimbobbennett
Do you mean just for the PR or in general?  Since this is a solution notebook, we would like to have the output (+ we are trying to be consistent with the other solution notebooks from the other sections.

Should we remove the output from this notebook? Would make it smaller and easier to diff

@jimbobbennett Do you mean just for the PR or in general? Since this is a solution notebook, we would like to have the output (+ we are trying to be consistent with the other solution notebooks from the other sections.

I was thinking in general, just this notebook was in the PR so made me think of it. Is it intentional to have the output in the notebooks then?

Yes!  :)

Can't add this inline as the file is too large, but in the Build your model section, this line:
from sklearn.model_selection import train_test_split

is in both of the first 2 cells, it doesn't need to be in the second one.


[SPARK-23120][PYSPARK][ML][WIP] Add basic PMML export support to PySpark

What changes were proposed in this pull request?
Adds basic PMML export support for Spark ML stages to PySpark as was previously done in Scala. Includes LinearRegressionModel as the first stage to implement.
How was this patch tested?
Doctest, the main testing work for this is on the Scala side. (TODO holden add the unittest once I finish locally).

Test build #89899 has started for PR 21172 at commit 8cbef82.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2701/
Test PASSed.

Test build #89900 has started for PR 21172 at commit 9b14a1c.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2702/
Test PASSed.

Test build #89899 has finished for PR 21172 at commit 8cbef82.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
class LinearRegressionModel(JavaModel, JavaPredictionModel, GeneralJavaMLWritable, JavaMLReadable):
class GeneralMLWriter(MLWriter):
class GeneralJavaMLWriter(JavaMLWriter):
class GeneralJavaMLWritable(JavaMLWritable):

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89899/
Test PASSed.

Test build #89900 has finished for PR 21172 at commit 9b14a1c.

This patch fails PySpark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89900/
Test FAILed.

Test build #89902 has started for PR 21172 at commit 64d6db8.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2705/
Test PASSed.

Merged build finished. Test PASSed.

Test build #89902 has finished for PR 21172 at commit 64d6db8.

This patch fails PySpark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89902/
Test FAILed.

Test build #90234 has started for PR 21172 at commit af21aa7.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2937/
Test FAILed.

Test build #90236 has started for PR 21172 at commit 9d7d684.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2939/
Test PASSed.

Test build #90234 has finished for PR 21172 at commit af21aa7.

This patch fails PySpark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90234/
Test FAILed.

Merged build finished. Test FAILed.

Test build #90236 has finished for PR 21172 at commit 9d7d684.

This patch fails PySpark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90236/
Test FAILed.

Merged build finished. Test FAILed.

Test build #90515 has started for PR 21172 at commit 67b59a7.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3146/
Test PASSed.

Merged build finished. Test PASSed.

Test build #90515 has finished for PR 21172 at commit 67b59a7.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90515/
Test PASSed.

Merged to master


Documentation

Gitbooks project structure added
https://ios-docs.salemove.com

Can you rebase onto master?

!squash

!merge


Places: ProgrammaticPlacePredictions   apiException: 9012 : INVALID_REQUEST

Hello,
ProgrammaticPlacePredictions not working when implementing programmatic place predictions.
I tried the exact same code programmaticPlacePredictions ->  apiException: 9012 : INVALID_REQUEST
I tried setting minimum properties: Token, query, TypesFilter -> apiException: 9012 : INVALID_REQUEST
I tried working with widget/fragment and it worked.
I am using Android Studio Dolphin | 2021.3.1 Patch 1 and a physical device Google Pixel 6.
Kind regards,
Hamza

Hi @Hamzaelmi.
Could you send us the query that you are using for this request? I assume you set an API Key for your project properly.

Hi @kikoso
I used different kinds of queries like:

401 George St
401 George St, Sydney
Crown st
Christ

@Hamzaelmi , is the call failing when you execute it on an Activity? Could you share the relevant code or the project here?

@Hamzaelmi If you are setting typesFilter make sure you convert string to lower case. I'm not sure why, but if I build FindAutocompletePredictionsRequest like this:
FindAutocompletePredictionsRequest.builder()
            .setTypesFilter(listOf(TypeFilter.ADDRESS.toString()))
            .setQuery(query)
            .build()

I'm getting 9012 : INVALID_REQUEST error as well.
But if I convert TypeFilter to lower case it works:
val request = FindAutocompletePredictionsRequest.builder()
            .setTypesFilter(listOf(TypeFilter.ADDRESS.toString().lowercase()))
            .setQuery(query)
            .build()

It's strange that google docs example here they do not convert it to lower case, it's misleading.

Oh yeah, that can certainly be the case. This is already reported in the issue tracker.

That was it, I confirm. Really cool finding @rmazajev


feat: add milvus command

[x] Add command to start a local Milvus instance using shelly milvus start
[x] Add command to check the status of the local Milvus vector store using shelly milvus status

:tada: This PR is included in version 1.5.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Demo video

This isn't an issue but I can't see how else to contact you.
I've created a demo video of a tool cloudflare-dns-update which uses tty-prompt.
https://www.youtube.com/watch?v=lQK6bWuQllM&feature=youtu.be&hd=1
I thought you might enjoy seeing how I've used your gem.

Thanks for using tty-prompt and creating a demo! ❤  Plus your accent is awesome, I could listen for hours!
I really enjoy seeing how people use tty libs to create useful tooling. That was the goal from the beginning to make it easy to put scripts together that give good user experience.
I'm not that hard to find on the inter webs 😄  Just followed you on twitter if you need to ping me in the future.

Thanks!
I've always worried about my accent so it's nice to know that it's better than okay :)
I will make some more videos.


Product attributes not being stored/display in cart or on product lists

Although product options are appearing on product pages, they're not appearing elsewhere, and they don't appear to be stored against items in the cart.

So this seems to be a new issue. If you look at the cart single page, you can see where this was suppose to showing. The OrderItem class is even adding them. I think this is getting screwed up somewhere when it gets added to the cart. It's not sending the product options data.


Implements support for decorations for injected text.

For now, only inlineClassName is supported.

This does not work with wrapped lines.


Add "refuse to answer" to the initial survey page

In the Azores, the OUS working group wants to collect information on the number of people that have refused to answer the survey. Perhaps we can add "refuse to answer" to the dropdown list on the first page, below "facilitated response"? This would simply provide a record in our database that an individual was approached but refused to take the survey.

Would this record a name or just a count?

Good question. I presume if an individual declines to answer the survey, they wouldn't want to provide their name. That said, if they were willing to provide a name, that kind of documentation might make it easier to avoid over-counting. I say, if it can include an optional name, that would be ideal.


bug: huggingface API Changed

Describe the bug
It looks like huggingface API has been changed while led to our JSON deserialize failed.
Unexpected (persistent) at stat, context: { service: huggingface, path: normal_file.txt } => deserialize json, source: missing field `name` at line 1 column 396

Steps to Reproduce
Run our tests
https://github.com/apache/opendal/actions/runs/10907259430/job/30270621187
Expected Behavior
Test should pass.
Additional Context
No response
Are you willing to submit a PR to fix this bug?

[ ] Yes, I would like to submit a PR.

Hi @Xuanwo, I can help with this.


Update with dummy code

Added one print statement to test if pull request works.

Closing since this PR was just used as a learning exercise.


remove class attribute if classList is empty

Not really a bug, but when all the class names of prev are removed and class names of curr is empty, there is an empty class attribute on the resulting outputted DOM.
https://github.com/ueberdosis/tiptap/issues/2126

Seems reasonable.


Race condition

==================
WARNING: DATA RACE
Read at 0x00c42018e7d1 by goroutine 38:
  golang.org/x/crypto/salsa20/salsa.HSalsa20()
      /home/legolord208/Coding/Go/src/golang.org/x/crypto/salsa20/salsa/hsalsa20.go:28 +0x52a
  golang.org/x/crypto/nacl/secretbox.setup()
      /home/legolord208/Coding/Go/src/golang.org/x/crypto/nacl/secretbox/secretbox.go:34 +0xb5
  golang.org/x/crypto/nacl/secretbox.Open()
      /home/legolord208/Coding/Go/src/golang.org/x/crypto/nacl/secretbox/secretbox.go:111 +0xd4
  github.com/bwmarrin/discordgo.(*VoiceConnection).opusReceiver()
      /home/legolord208/Coding/Go/src/github.com/bwmarrin/discordgo/voice.go:814 +0x6ad

Previous write at 0x00c42018e7d1 by goroutine 39:
  reflect.Value.SetUint()
      /usr/local/go/src/reflect/value.go:1506 +0x141
  encoding/json.(*decodeState).literalStore()
      /usr/local/go/src/encoding/json/decode.go:994 +0x1e3b
  encoding/json.(*decodeState).literal()
      /usr/local/go/src/encoding/json/decode.go:799 +0x170
  encoding/json.(*decodeState).value()
      /usr/local/go/src/encoding/json/decode.go:405 +0x186
  encoding/json.(*decodeState).array()
      /usr/local/go/src/encoding/json/decode.go:555 +0x246
  encoding/json.(*decodeState).value()
      /usr/local/go/src/encoding/json/decode.go:399 +0xc1
  encoding/json.(*decodeState).object()
      /usr/local/go/src/encoding/json/decode.go:733 +0x163c
  encoding/json.(*decodeState).value()
      /usr/local/go/src/encoding/json/decode.go:402 +0x149
  encoding/json.(*decodeState).unmarshal()
      /usr/local/go/src/encoding/json/decode.go:184 +0x2e8
  encoding/json.Unmarshal()
      /usr/local/go/src/encoding/json/decode.go:104 +0x20a
  github.com/bwmarrin/discordgo.(*VoiceConnection).onEvent()
      /home/legolord208/Coding/Go/src/github.com/bwmarrin/discordgo/voice.go:435 +0x1075

Goroutine 38 (running) created at:
  github.com/bwmarrin/discordgo.(*VoiceConnection).onEvent()
      /home/legolord208/Coding/Go/src/github.com/bwmarrin/discordgo/voice.go:421 +0xab0

Goroutine 39 (finished) created at:
  github.com/bwmarrin/discordgo.(*VoiceConnection).wsListen()
      /home/legolord208/Coding/Go/src/github.com/bwmarrin/discordgo/voice.go:371 +0x16b
==================

Can you still reproduce ? If so can you put the commit reference with it a race condition log ?
(Will be easier to fix with correspondence between lines)

Really sorry, I think it just happened one time (although I don't quite remember.)

Do you think it was on develop or master branch ?

I looked back at the commit history, and it would appear I was using the develop version at the time.

Seems to be commit around f539136306da89c9110e9a340f34e2f09eeffc26
Lines instructions correspond

https://github.com/bwmarrin/discordgo/blob/f539136306da89c9110e9a340f34e2f09eeffc26/voice.go?utf8=✓#L435
https://github.com/bwmarrin/discordgo/blob/f539136306da89c9110e9a340f34e2f09eeffc26/voice.go?utf8=✓#L814
Seems to be that you send message during a voice channel changement.
As it look like to throw the error because of the SecretKey of op4


How to use CrewAI with Openrouter's free LLMs?

There are a bunch of good LLMs there for free or with huge discount:
https://openrouter.ai/models?q=free&o=top-weekly
so it is definitely a real option for many of us.
I tried it using LlamaIndex's OpenRouter class:
https://docs.llamaindex.ai/en/stable/examples/llm/openrouter.html#openrouter
but it caused errors...
I think adding info to CrewAI docs how to use Hugging Face and OpenRouter LLM inference with CrewAI would be beneficial for many of us not wanting to use OpenAI or local LLMs.

Langchain's ChatOpenAI class should be used, as this video explains in its last part:
https://www.youtube.com/watch?v=opR3LozV3NM&list=WL&index=1

import os
from crewai import Agent, Task, Crew, Process
from langchain_openai import ChatOpenAI
llm = ChatOpenAI (model="google/gemma-7b"),
api_key="API_KEY"
base_url="https://openrouter.ai/api/v1'')

Did this work?


Search funcition broken on Makie docs (returns 0 results)

It seems the search function for the official Makie docs has broken
A search for any term returns zero results.
Navigation seems to be unaffected.

Yup can confirm this experience of not returning anything for me as well.
For example: a search for Axis: https://makie.juliaplots.org/stable/search/index.html?q=Axis

Can confirm

Duplicate of #1965 ?

Yes!


feat: create 1000 small tables for testing

SUMMARY

https://github.com/apache/superset/pull/13448 added a new option -b to superset load-examples, that when enabled will create synthetic "big data" to test features and migrations on a realistic environment.
This PR adds 1000 small tables, to test loading tables in SQL Lab.
BEFORE/AFTER SCREENSHOTS OR ANIMATED GIF

N/A
TEST PLAN

Ran superset load-examples -b -t and verified that tables are created.
ADDITIONAL INFORMATION

[ ] Has associated issue:
[ ] Changes UI
[ ] Requires DB Migration.
[ ] Confirm DB Migration upgrade and downgrade tested.
[ ] Introduces new feature or API
[ ] Removes existing feature or API

Codecov Report

Merging #19 (d14f3d8) into ch5457 (95edbd4) will decrease coverage by 0.06%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##           ch5457      #19      +/-   ##
==========================================
- Coverage   77.07%   77.00%   -0.07%
==========================================
  Files         867      867
  Lines       45042    45047       +5
  Branches     5415     5415
==========================================
- Hits        34714    34690      -24
- Misses      10205    10234      +29
  Partials      123      123

Flag
Coverage Δ

cypress
58.57% <ø> (+0.03%)
:arrow_up:

javascript
62.17% <ø> (ø)

python
80.52% <0.00%> (-0.14%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

superset/examples/big_data.py
33.33% <0.00%> (-16.67%)
:arrow_down:

superset/db_engine_specs/presto.py
82.47% <0.00%> (-5.99%)
:arrow_down:

superset/models/core.py
88.55% <0.00%> (-0.28%)
:arrow_down:

...set-frontend/src/dashboard/util/getDropPosition.js
92.42% <0.00%> (+1.51%)
:arrow_up:

...et-frontend/src/dashboard/components/Dashboard.jsx
88.63% <0.00%> (+4.54%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 95edbd4...d14f3d8. Read the comment docs.


Way to exclude directories and files using SimpleDirectoryReader

Sometimes directories contain both relevant and irrelevant subdirectories and/or files, it would be nice to have a keyword argument for excluding them, perhaps even with some matching syntax, e.g.
documents = SimpleDirectoryReader('...', recursive=True, exclude=["*/misc/*, "note.txt"])

nice feature


IdentityServer4 + WebApi in same project

Hi, i'm trying to build a .net core web api with identity server integrated in it using dapper as my orm with an angular2 client on the side.
Now i want the login page to be inside the angular client so i need the identityserver login controllers to be inside my api ).
My real problem is doing all that when theres nothing that helps on the documentation about this. expecially using dapper. If someone can steer me in the right direction i would be thankfull.
I've tried all the quickstarts but i find myself lost halfway everytime, in the docs they say one thing and then all the controllers, models and views are all created on the identityserver .

Use resource owner password flow.

First and foremost, thank you for replying.
But what interfaces do i need to implement and how do i go about configuring all that together?
I've implemented a ProfileService class that uses a UserRepository to fetch User data from database, and i know i have to use ResourceOwnerPasswordValidator, but what then? what do i need to setup in the Startup.cs file? how do i create The login and Logout Controller (AccountController).
And how do i go about replacing the ApplicationUser class that uses EntityFramework? As i've said i'm using Dapper instead of EF. I know i probably should know this by now but i'm feeling truly lost.

Docs are here: https://identityserver4.readthedocs.io/en/release/topics/resource_owner.html

I think i'm too confused by now to explain myself in the most efficient way. But isnt hybrid flow better? i'm mean, from what i saw from the quickstart, it looks like what i want, but instead of using a seperate application for the identityServer i want it running inside my WebApi, and instead of Entityframework i'm using dapper to connect to my database, and instead a mvc client i'm using an angular2 one. but the docs cant seem to help me in any way, i mean sure if i want to use resource owner password flow (for instance) i need to implement the ResourceOwnerPasswordValidator interface but then what? i dont see anywhere what i need to do in the startup.cs to tell identityserver that i'm using my database instead TestUsers or to tell it that i'm using my version of the interface. maybe i'm missing something on the Docs but right now i'm as lost as they come.
Bear with me please.
PS: first time i heard of IdentityServer was 3 days ago, and since everything i see online has been changed recently in recent updates i cnt seem to grasp what i need to do.

To be honest, IdentityServer provides an implementation of the OpenID Connect and OAuth2 specs. That's what it sounds like you need to spend time learning. Once you know those, then IdentityServer will make much more sens.

This seems to be a general question about IdentityServer - not a bug report or an issue.
Please use StackOverflow for that. This has the advantage that questions and answers can be easily found by search engines, and that there are more people answering questions than just us.
For IdentityServer3
https://stackoverflow.com/questions/tagged/?tagnames=identityserver3&sort=newest
For IdentityServer4
https://stackoverflow.com/questions/tagged/?tagnames=identityserver4&sort=newest
For commercial support options - visit
https://identityserver.io

@rafael-chaves did you get this sorted out? I am trying to do what you did i.e. including identity server inside the api, which effectively means hosting both of them in the same app. There is a sample repo which does this. https://github.com/brockallen/IdentityServerAndApi though I haven't tried myself just yet. It would be interesting to know how far you have got.

Same question. Too complicated while trying to implement IdentityServer4 and Web API as a project.

i talked to an software engineer and he said it is best practice to make identiy server an different project becouse if you want to expand it is easier that way

Same question.
I'm lost here too.
Anyone made this ?


Implement lexicographic array comparison

Closes #2711
Algorithm

Zip both arrays and fold to compare element-wise from the start
Keep comparing while the elements are equal (or until there's an error)
As soon as a pair of elements of same index isn't equal, that (the first non-equal comparison) will become the result of the operation
If the result of the operation is that the two arrays are equal, then compare their lengths (since zip stops at the shortest one). A larger array will compare as "greater" than a smaller array when they have the same prefixes. (Consistent with how Python and Rust do it.)

Possible improvements

[x] Could leverage try_fold's stop-on-Err(...) optimization to stop folding when a non-equal result is found. This would require having the cmp_result variable be a Result<Ordering, StrResult<Ordering>>, which is why it felt a bit weird to me at first, but it would probably be faster (right now, from the first non-equal result onwards, it keeps folding on the remaining elements and just returning the accumulator each time). Please tell me if this would be desirable.

Done: switched to find_map instead of try_fold.

[ ] This could lead to a stack overflow on arrays of arrays if they nest too deeply. Is there a sane way we can prevent this? Should we care?

Tests
Added some tests for the expected behavior; feel free to suggest more.

This could lead to a stack overflow on arrays of arrays if they nest too deeply. Is there a sane way we can prevent this? Should we care?

I don't think we care, at least not for the moment.

Thank you!


fleet: init fleet webhook and ensure single fleet per namespace

What type of PR is this?
/kind feature
What this PR does / why we need it:
This PR introduces validation for the Fleet custom resource using webhooks. The primary changes include:

Fleet Validation:

Added checks to ensure that there's only one Fleet instance in a namespace.  see #382
The kind field of a Cluster can only take the values Cluster, AttachedCluster, or CustomCluster. Any other values are considered invalid.

Unit Tests:
Added unit tests to validate the logic in the Fleet webhook.
Created sample yaml files for both valid and invalid Fleet configurations to aid testing.
Here is the result of UT:

=== RUN   TestValidFleetValidation
--- PASS: TestValidFleetValidation (0.00s)
=== RUN   TestValidFleetValidation/..\..\examples\fleet\fleet.yaml
    --- PASS: TestValidFleetValidation/..\..\examples\fleet\fleet.yaml (0.00s)
=== RUN   TestValidFleetValidation/..\..\examples\fleet\metric\metric-plugin.yaml
    --- PASS: TestValidFleetValidation/..\..\examples\fleet\metric\metric-plugin.yaml (0.00s)
=== RUN   TestValidFleetValidation/..\..\examples\fleet\metric\monitor-demo\avalanche.yaml
    --- PASS: TestValidFleetValidation/..\..\examples\fleet\metric\monitor-demo\avalanche.yaml (0.00s)
=== RUN   TestValidFleetValidation/..\..\examples\fleet\policy\badpod-demo\badpod.yaml
    --- PASS: TestValidFleetValidation/..\..\examples\fleet\policy\badpod-demo\badpod.yaml (0.00s)
=== RUN   TestValidFleetValidation/..\..\examples\fleet\policy\kyverno.yaml
    --- PASS: TestValidFleetValidation/..\..\examples\fleet\policy\kyverno.yaml (0.00s)
=== RUN   TestValidFleetValidation/..\..\examples\fleet\quickstart.yaml
    --- PASS: TestValidFleetValidation/..\..\examples\fleet\quickstart.yaml (0.00s)
=== RUN   TestInvalidFleetValidation
--- PASS: TestInvalidFleetValidation (0.00s)
=== RUN   TestInvalidFleetValidation/testdata\fleet\invalid-cluster-kind.yaml
    fleet_webhook_test.go:47: Fleet.fleet.kurator.dev "quickstart" is invalid: spec.clusters[1].kind: Invalid value: "invalid-cluster-kind": unsupported cluster kind; please use AttachedCluster to manage your own cluster
    --- PASS: TestInvalidFleetValidation/testdata\fleet\invalid-cluster-kind.yaml (0.00s)
=== RUN   TestInvalidFleetValidation/testdata\fleet\miss-cluster-name-kind.yaml
    fleet_webhook_test.go:47: Fleet.fleet.kurator.dev "quickstart" is invalid: [spec.clusters[0].name: Required value: name is required, spec.clusters[1].kind: Required value: kind is required]
    --- PASS: TestInvalidFleetValidation/testdata\fleet\miss-cluster-name-kind.yaml (0.00s)
PASS

Which issue(s) this PR fixes:
part of #404
part of #336
Fixes #382
Special notes for your reviewer:
Does this PR introduce a user-facing change?:

fleet: init fleet webhook and ensure single fleet per namespace

maybe we can use resource quota, install fleet manager with a resourceQuota

maybe we can use resource quota, install fleet manager with a resourceQuota

ok

Given that the current design, along with the resourceQuota settings, are inadequate in addressing the issue of ensuring a single fleet per namespace (as detailed in Issue #382), I am closing this pull request.


Update dependencies and modify CrumbManager for new element-based API

This adopts Glide's style of sharing metadata by generating holder element with a new @CrumbIndex annotation that holds the serialized data. This isn't as opaque as the resources implementation, but it's safer version (avoids classpath conflicts), friendly to proguard removal, and most importantly unlocks supporting incremental annotation processing (#33).
Opportunistically updated dependencies along the way and using modern api/implementation configurations.
Other notes:

Will generate java or kotlin depending on the source class
Classes are basically (best-effort) inaccessible
Will implement full incremental apt support in a separate PR after this

Need to do a documentation pass but wanted to get the API change up early for review now

I'm not sure what's going on with travis here, these pass for me locally 🤔

No luck after using trusty :/

I just cloned and checkout your branch and build fails locally as well.
Found this issue on google/compile-testing
https://github.com/google/compile-testing/issues/102

Also, trusty was only needed for oraclejdk it seems.

Tools jar isn't available in newer jdks. Will dig more separately but merging with green for now


Python 2.7 compatibility

In preparation for a ROS driver for the ODrive, I've added Python 2.7 compatibility.
Tested on macOS and Ubuntu 16.04 via direct use and pip -e installs. I haven't tested building the distribution files.
Notable changes:

Threading API constructor can't take the daemon parameter, so all thread creation had to be expanded out.
TimeoutError isn't defined, but it makes for more readable code, so I defined it as an OSError subclass.
ModuleNotFoundError is replaced by the older ImportError.
Print function imported from future

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.Josh Marshall seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.

Just noticed a few issues after generating the distribution tar.gz and installing from that.
odrivetool has python3 set in the hash-bang header. I've been running it with python2 odrivetool .... Not sure of the best option here, but anyone wanting use odrivetool completely under 2.7 will need to tweak this.
I also haven't yet used the DFU functionality, but that has a print function that needs updating to import from future.
tests.py uses type annotations, which aren't backwards-compatible, obviously. I'm thinking just to leave this alone, as I'm not too concerned with actually running the tests.

Awesome thanks so much! It may take quite a while until we have enough time to get around to this PR, but py2 and ROS support is something we definitely want.
Note to self (and others who see this), @neomanic's ROS driver is here: https://github.com/neomanic/odrive_ros


Activity must extend AppCompatActivity

Describe the bug
Documentation does not mention the activity must extend AppCompatActivity that uses codeView
If you do not, you can't edit anything.
To Reproduce
Steps to reproduce the behavior:
use CodeView in a normal Activity, not an AppCompatActivity
Expected behavior
You should be able to use it regardsless (I guess)

Hello, @piemmm Thanks for your report,
I have tested it with Activity, not AppCompatActivity and its work good, for example, you can download the example app and change AppCompatActivity by Activity in the MainActivity class and you will see it will run without problems and you can edit it easily.
So if you can provide more information about this problem so we can know what exactly the problem is, such as android version, SDK version, code example, or a full example if you can and we can solve it 👍🏻
Thanks
Amr Hesham

Hi!
The issue happens if the themes parent is: parent="android:Theme.Material" (and the MainActivity extends plain Activity)

Hi, Thank you @piemmm,
The problem is when you use android:Theme.Material theme you can't navigate on the source code of the View by clicking, if you use Emulator you can work with arrows so after searching I found that if you want to work with this theme you need to add this attribute and it will work fine.
In XML
android:textIsSelectable="true"

Or in Java or Kotlin code
codeView.setTextIsSelectable(true);

I have tested it on the example app, and I will test it more in different SDK's, if you found any other problem please report it 👍🏻
Thank you so much 😄
Amr Hesham

Thankyou!


RestError: Invalid request has been sent.

Hello Team, i am using Azure Face service for Face Recognition in JavaScript.
I am getting an error after following the given steps.
========IDENTIFY FACES========
C:\myapp\node_modules@azure\ms-rest-js\dist\msRest.node.js:2480
var _this = _super.call(this, message) || this;
^
RestError: Invalid request has been sent.
at new RestError (@azure\ms-rest-js\dist\msRest.node.js:2480:28)
at @azure\ms-rest-js\dist\msRest.node.js:3687:37
at processTicksAndRejections (node:internal/process/task_queues:96:5)
at async IdentifyInPersonGroup (myapp\index.js:111:5)
at async main (index.js:135:5) {
code: 'InvalidRequest',
statusCode: 403,
request: WebResource {
streamResponseBody: false,

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 23b4394b-76d2-de5a-8c29-48b42d2e7558
Version Independent ID: 8788e416-f3e3-5a04-161e-df054fc81702
Content: Face recognition - Face - Azure Cognitive Services
Content Source: articles/cognitive-services/Computer-vision/concept-face-recognition.md
Service: cognitive-services
Sub-service: face-api
GitHub Login: @PatrickFarley
Microsoft Alias: pafarley

@RavichandraBadeka
Thanks for your feedback! We will investigate and update as appropriate.

Hello @RavichandraBadeka
Face service access is limited based on eligibility and usage criteria in order to support our Responsible AI principles. Face service is only available to Microsoft managed customers and partners. Use the Face Recognition intake form to apply for access.
List of Limited Access services and features as below:
Face API: Identify and Verify features
Azure Video Indexer: Celebrity Recognition and Face Identify features
Computer Vision: Celebrity Recognition feature
Custom Neural Voice: All features
Speaker Recognition: All features
Features of these services that are not listed above are available without registration.
If you need that, please feel free to use the Face Recognition intake form to apply for access. I hope this helps!

We will now proceed to close this thread. If there are further questions regarding this matter, please respond here and @YutongTie-MSFT and we will gladly continue the discussion.


Touch controls

Implement ability to play the game without a keyboard

Current form can be tested with window.l.current_scene.controls.touch.activate()

Langenium #35

Hotfixing effects arising from PR #30 directly on master and deploying as it's currently broken on live
Controls could definitely be uncoupled at this point, that's how the 2021 v5 build worked.
Working on touch controls

Fixed rotation control position
Adding deactivation function and calls to activate/deactivate

Had issues removing and adding UI elements as they attach stuff to the window and don't have a way to detach so I'm just hiding the controls when not in use. Seems to hold up in testing

TODO:
- Fix regression on keyboard movement when touch controls rotate the camera
- Implement movement controls using touch
- Add new slider controls for elevator and camera distance from aircraft controls
- Add orbit controls back in for keyboard and mouse
- Remove rotation control from touch controls if it's too similar

Langenium #35

Fixing regression on keyboard movement when touch controls rotate the camera

Looking at the issues at hand I think that the touch controls just need to be rebuilt and integrated better within the engine.
Integrated the Touch Controls code and assets and removed the rest
Tweaked rotation to modify the camera's original rotation and it's already better, albeit different now it's doing a look around instead of rotation around the ship - maybe preferrable at this point.

Langenium #35

Added check for whether rotation pad is being used to stop the camera reset from fighting the user input, works well although kinda awkward it lets you loop around over and over till you let go of the controls but that can be tweaked later...
Implementing movement controls using touch

Got the touch movement pad hooked up in a rudimentary way but there's something wrong with the way the ship is moving. When just trying to move forward it keeps veering to the left and it can barely turn right
Adding TweakPane tracking variables, and some structure to the debugging mode to make it easier to see what's going on
Fixed the turning issue but the way that the touch controls work is probably clashing and causing unnecessary calculations to happen. e.g. it needs hitTest on which implies it's calculating rays for collisions, if I switch hitTest off the camera starts to fly forward which isn't ideal

Cleaning up unused code in the touch controls

Implementing a new slider stick touch control using rotation pad as a base

Prototyping the look and feel using CSS and tweaks to original code

Fine tuning the movement controls

Looking good but I can't seem to use the direction pad and elevator controls at the same time... did my best to alleviate but more work could be done

The camera controls could use more work - they should rotate around the aircraft rather than look around.
The look around could make sense inside the airplane cockpit or while controlling a character who is walking around.


if will support arm linux?

Expected Behavior

Current Behavior

Possible Solution

Steps to Reproduce (for bugs)

Context

Your Environment

Version used:
Browser Name and version:
Operating System and version (desktop or mobile):
Link to your project:

Duplicate of #1103 and #892.


Upversion.

What? and Why?

What does this pull request change/fix? Why was it nessessary?

Checklist

[ ] CHANGELOG.md updated? (if required)

Codecov Report

Merging #64 into master will not change coverage.
The diff coverage is 100%.

@@           Coverage Diff           @@
##           master      #64   +/-   ##
=======================================
  Coverage   91.15%   91.15%
=======================================
  Files           5        5
  Lines         226      226
=======================================
  Hits          206      206
  Misses         20       20

Impacted Files
Coverage Δ

server.py
73.01% <100%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f79923b...6de2f36. Read the comment docs.


0.8.13 - issue with condition logic on IE.

Expected behaviour
I expected the condition logic to not fail on IE
Actual behaviour
It actually fails on IE, however you have it fixed in master, I've created a fork and fixed it against 0.8.13 to give you an 0.8.14 however I have no way to PR this properly.
Gist/Plunker/Demo

Description
Related issues
Please review this PR, this is a port back of your fix on the development branch back to something compatible with 0.8.13 in hopes to get an 0.8.14.
https://github.com/Deklin/angular-schema-form/tree/0.8.14
@json-schema-form/angular-schema-form-lead

I have no target branch to PR against for you to see the change,  But the changes are limited to only what was fixed on the development branch for the builder.condition method.

@Deklin try targeting the support/0.x branch, that should be the closest to 0.8.13

@rhelgeby the alphas are fairly stable, you could try them, or just pull the change from the 0.x branch. I made a 0.x branch primarily to keep track of that version as it is in use and the new versions are so different internally.

Unfortunately I can't take that risk at the moment, but referencing the 0.8.13 branch is ok. Though the build in the dist-folder on that branch is outdated.
Would you mind doing a new build and commit it on that branch? Then I can use a github link in my package.json file.

@rhelgeby could you run the build and confirm it works? I'm in the middle of work on another branch, but I would totally accept a PR for that branch that has just run the build. If not then I will try to find time this weekend.

I plan to fork and create a pull request with the updated build soon. Then I should be able to verify this specific fix, and do some regression testing of the features the app is using.

Although the build server couldn't build it, the build I provided in the pull request works for me (the IE bug is fixed). So far it seems good, and I since this is going in production in a few months, I will notify if there are any issues blocking it.
Currently I'm referencing the branch in my fork so that any changes doesn't mess with the release schedule for the app.

@rhelgeby ignore the travis build on that branch, before I started on the project the tests were broken and I only fixed them all for the alphas. One of the reasons I am terrified to touch that older code frankly.

I believe this is closed by @rhelgeby 's merged PR, if not let me know what else is needed


Prompt in zero-shot setting.

Hi, nice work!
My questions are what is the prompt for GPT-3 zero-shot setting and how to ensure that the output of the model conforms to the parsable form.

Hi, thanks for your kind words!
We followed the paper Large Language Models are Zero-Shot Reasoners and prompted GPT-3 "Let’s think step by step" to generate a solution first, and then prompted the GPT-3 model to extract the final answer.

Thanks for your timely reply!


Error loading alert configurations when subscription deleted

Description:
The issue occurs when the API subscription deleted from an application which already has an alert configuration. The following exception throws when a particular user tries to navigate to the settings page in the devportal after deleting the API subscription.
[2021-05-20 16:59:43,233] ERROR - GlobalThrowableMapper An unknown exception has been captured by the global exception mapper. java.lang.NumberFormatException: For input string: "null" at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) ~[?:1.8.0_201] at java.lang.Integer.parseInt(Integer.java:580) ~[?:1.8.0_201] at java.lang.Integer.parseInt(Integer.java:615) ~[?:1.8.0_201] at org.wso2.carbon.apimgt.rest.api.store.v1.mappings.AlertsMappingUtil.toAlertConfigDTO(AlertsMappingUtil.java:45) ~[classes/:?] at org.wso2.carbon.apimgt.rest.api.store.v1.impl.AlertsApiServiceImpl.getAllAlertConfigs(AlertsApiServiceImpl.java:91) ~[classes/:?] at org.wso2.carbon.apimgt.rest.api.store.v1.AlertsApi.getAllAlertConfigs(AlertsApi.java:89) ~[classes/:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_201]
The exception throws from [1] , when it tries to retrieve the application name by passing "null" as the applicationId to the parseInt() method. "null" represents the applicationId of the subscription deleted application.
Furthermore, upon deleting the API subscription, an additional alert configuration is added to the alert configuration list. This additional config is created for the same alert configuration and it represents the subscription deleted alert configuration. This config is where the applicationId becomes "null". Please refer to the below image.

Steps to reproduce:

Configure APIM 3.1.0 with APIM Analytics and start the servers.
Publish an API and subscribe through an application.
Click on the settings button in the devportal and enable both Abnormal Requests per Minute and Abnormal Resource Access.
Add an alert configuration under Abnormal Requests per Minute for the created API application pair.
Delete the API subscription.
Then, navigate to the Alert section by clicking on Settings button. There will be UI error with the above mentioned exception in the logs.

Affected Product Version:
APIM-3.1.0  +<PHONE_NUMBER>694
[1] https://github.com/wso2-support/carbon-apimgt/blob/ea6988907edd112d478382822667ea8be44158f6/components/apimgt/org.wso2.carbon.apimgt.rest.api.store.v1/src/main/java/org/wso2/carbon/apimgt/rest/api/store/v1/mappings/AlertsMappingUtil.java#L45

Closing Since the issue has been stale for a long time.


Implement Data Acquisition task

[ ] Create seller class
[ ] Create buyer class
[ ] Create pricing function
[ ] Create market class
[ ] Test functionality
[ ] Upload final datasets
[ ] Create Lambda
[ ] Test on platform


[Backport 2.x] feat: remove search index tool

Description
Backport https://github.com/opensearch-project/skills/pull/295 to 2.x
Issues Resolved
Backport https://github.com/opensearch-project/skills/pull/295 to 2.x
Check List

[ ] New functionality includes testing.

[ ] All tests pass

[ ] New functionality has been documented.

[ ] New functionality has javadoc added

[x] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Add some commits to open this pull request.

Pushed a commit to fix the CI error.


refactor and add specs for the agent by @morriswinkler

This is a refactor, with specs, of #562.  @morriswinkler, I'd appreciate it if you could test this out!

@morriswinkler, did this work for you?


Not update music cover

Not update music cover while click from notification

Is it still the same now, my test is normal. Can you describe the specific steps in detail?


Resuming training size mismatch

getting size mismatches on the entire checkpoint. This sort of thing.
        size mismatch for transformer.layers.blocks.12.g.net.fn.fn.net.0.weight: copying a param with shape torch.Size([1]) from checkpoint, the shape in current model is torch.Size([8192, 1024]).
        size mismatch for transformer.layers.blocks.12.g.net.fn.fn.net.3.weight: copying a param with shape torch.Size([1]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
        size mismatch for transformer.layers.blocks.13.f.net.fn.fn.to_qkv.weight: copying a param with shape torch.Size([1]) from checkpoint, the shape in current model is torch.Size([1536, 1024]).
        size mismatch for transformer.layers.blocks.13.f.net.fn.fn.to_out.0.weight: copying a param with shape torch.Size([1]) from checkpoint, the shape in current model is torch.Size([1024, 512]).
        size mismatch for transformer.layers.blocks.13.g.net.fn.fn.net.0.weight: copying a param with shape torch.Size([1]) from checkpoint, the shape in current model is torch.Size([8192, 1024]).
        size mismatch for transformer.layers.blocks.13.g.net.fn.fn.net.3.weight: copying a param with shape torch.Size([1]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
        size mismatch for transformer.layers.blocks.14.f.net.fn.fn.to_qkv.weight: copying a param with shape torch.Size([1]) from checkpoint, the shape in current model is torch.Size([1536, 1024]).
        size mismatch for transformer.layers.blocks.14.f.net.fn.fn.to_out.0.weight: copying a param with shape torch.Size([1]) from checkpoint, the shape in current model is torch.Size([1024, 512]).
        size mismatch for transformer.layers.blocks.14.g.net.fn.fn.net.0.weight: copying a param with shape torch.Size([1]) from checkpoint, the shape in current model is torch.Size([8192, 1024]).
        size mismatch for transformer.layers.blocks.14.g.net.fn.fn.net.3.weight: copying a param with shape torch.Size([1]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
        size mismatch for transformer.layers.blocks.15.f.net.fn.fn.to_qkv.weight: copying a param with shape torch.Size([1]) from checkpoint, the shape in current model is torch.Size([1536, 1024]).
        size mismatch for transformer.layers.blocks.15.f.net.fn.fn.to_out.0.weight: copying a param with shape torch.Size([1]) from checkpoint, the shape in current model is torch.Size([1024, 512]).
        size mismatch for transformer.layers.blocks.15.g.net.fn.fn.net.0.weight: copying a param with shape torch.Size([1]) from checkpoint, the shape in current model is torch.Size([8192, 1024]).
        size mismatch for transformer.layers.blocks.15.g.net.fn.fn.net.3.weight: copying a param with shape torch.Size([1]) from checkpoint, the shape in current model is torch.Size([1024, 4096]).
        size mismatch for to_logits.1.weight: copying a param with shape torch.Size([1]) from checkpoint, the shape in current model is torch.Size([50688, 1024]).
Killing subprocess 676

whenever I resume from a checkpoint. Were the checkpoint keys change recently?

whoops! this was a bug in my own branch.

seems my checkpoint wasn't being saved properly. Maybe this is related to deepspeed requiring you to use their methods to load and save pytorch models?

@janEbert Thanks!

@lucidrains I'd rework checkpointing for this so we always (no matter whether distributed or not) save checkpoints resumable for training (which includes the optimizer state) instead of just checkpoints for inference which is the current behavior.
Is that fine with you or would you rather like to keep the old behavior? I could work around it but it would be less clean.

For now, you can use the janEbert/deepspeed branch which has temporary fixes for partitioned models. (The calls may still fail if the VAE is partitioned.)
I realized some underlying issues as well, this is why I don't PR the fix. We'll need to split out the VAE from the DALLE model. You can't load a DeepSpeed checkpoint of the VAE, either, for the DALLE model, because you can't "merge" the VAE into it.

@lucidrains can we get your eyeballs on this? Could use guidance on how to store optimizer state etc.

The possible issue I'm seeing is that DeepSpeed does not handle multiple ZeRO-enabled models at once for whatever reason (e.g. both wanting to take all GPU memory, unhandled shared global state, ...). Not sure, though, I'd need to look into it.
If, only if, that's the case, splitting the models wouldn't help either. I haven't figured out how to handle that case quite yet. :)

Partly solved by #231.


Add await to fix app initialisation

If this is not awaited, then something tries to access the database before it is ready.
@klochowicz I think you just left this out by mistake?  Trivial fix in the end!
Fixes #1002.

bors r+


CoP decimals wrong and unit "unknown"

Dear @DeerMaximum,
I found out, if using the unit CoP "Arbeitszahl", decimals are factor 100 and the unit is "unknown":

Is there a way to fix this?
Thank you, have a nice day!
Günter

Fyi: The Unit-ID used in the json-API for CoP is 24..

Just checked with the API-call, logging the "Arbeitszahl" as output 6 by test..
{ "Number":6, "AD":"A", "Value":{ "Value":4.21, "Unit":"24" }

Can you please test with the server version 1.1.4 and the latest beta of the integration (1.2.0b2) if the bug is fixed.

Testet and works absolutely perfect!
Thank you @DeerMaximum