Can't download certain Youku videos. Chinese error says something about DRM and requiring updates

Checklist

[x] I'm reporting a broken site support
[x] I've verified that I'm running youtube-dl version 2021.06.06
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar issues including closed ones

Verbose log

youtube-dl -v "https://v.youku.com/v_show/id_XMzgyOTYxNjI1Ng==.html" --proxy <IP_ADDRESS>:8080
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', 'https://v.youku.com/v_show/id_XMzgyOTYxNjI1Ng==.html', '--proxy', '<IP_ADDRESS>:8080']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2021.06.06
[debug] Git HEAD: 86612ef
[debug] Python version 3.9.0 (CPython) - macOS-11.4-x86_64-i386-64bit
[debug] exe versions: ffmpeg 4.3.1, ffprobe 4.3.1, rtmpdump 2.4
[debug] Proxy map: {'http': '<IP_ADDRESS>:8080', 'https': '<IP_ADDRESS>:8080'}
[youku] XMzgyOTYxNjI1Ng: Retrieving cna info
[youku] XMzgyOTYxNjI1Ng: Downloading JSON metadata
ERROR: Unable to download JSON metadata: <urlopen error [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:1122)> (caused by URLError(SSLError(1, '[SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:1122)')))
  File "/usr/local/lib/python3.9/site-packages/youtube_dl/extractor/common.py", line 634, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/usr/local/lib/python3.9/site-packages/youtube_dl/YoutubeDL.py", line 2288, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File<EMAIL_ADDRESS>line 517, in open
    response = self._open(req, data)
  File<EMAIL_ADDRESS>line 534, in _open
    result = self._call_chain(self.handle_open, protocol, protocol +
  File<EMAIL_ADDRESS>line 494, in _call_chain
    result = func(*args)
  File "/usr/local/lib/python3.9/site-packages/youtube_dl/utils.py", line 2735, in https_open
    return self.do_open(functools.partial(
  File<EMAIL_ADDRESS>
Description

Video is China-only. Without using debug
youtube-dl "https://v.youku.com/v_show/id_XMzgyOTYxNjI1Ng==.html" --proxy <IP_ADDRESS>:8080
[youku] XMzgyOTYxNjI1Ng: Retrieving cna info
[youku] XMzgyOTYxNjI1Ng: Downloading JSON metadata
ERROR: Youku server reported error -4008: DRM视频，不支持，请升级到最新版本; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

If it's DRM protected, you cannot download anyway.
If you turn off DRM settings in browser, can the video be played in browser?

Issue should be closed, URL is dead


feat: Add example-app-router-with-next-auth-without-i18n-routing

Adding Authentication with next-auth to the example-app-router-without-i18n-routing
This pull request expands the functionality of the existing example by adding user authentication using the next-auth library. The application now supports authentication and allows you to protect routes that require authorization.

Hey @teplostanski, thank you so much for proposing this example—looks like you spent quite some time on it! ❤
That being said, the existing example-app-router-without-i18n-routing is intended to stay without an actual auth service integration to serve more as a routing inspiration. We also have another example example-app-router-next-auth that demonstrates a demo setup with Auth.js.
As examples take significant time to maintain, I'd prefer to not add another example that showcases a demonstration of both examples combined—I believe the important patterns should be covered in either example.
Have you considered though to publish your example as a separate repo under your username? I know that quite a few users are looking for a Auth.js v5 example (see https://github.com/amannn/next-intl/issues/596). In this repo I'm currently waiting for the v5 stable version to drop, but in case you're interesting in upgrading your example to v5, you could link to it in the thread at https://github.com/amannn/next-intl/issues/596 for example.
Hope this makes sense, keep up the good work! 🙌

Closing this due to inactivity …


dragging tabs in a browser

trying to drag tabs in Brave and reorder them, always places the dragged tab in a new window ... this behavior rarely happened before until recently ... it's very annoying, is there any known way to fix/bypass this?

I've noticed this as well on ungoogled chromium, no idea where it came from

It's just their design decision. If your mouse leaves the bar, it will just preemptively make a new window. Firefox browsers don't do this, you just have to be careful.


TECHPUBS-3096-1.2: Added pre-requisite in set_gigabyte_node_bmc_to_fact…

Gigabyte scripts on LiveCD
Added prerequsite in set_gigabyte_node_bmc_to_factory_defaults.md that scripts are available only in PIT environment and can be copied from LiveCD
Backwards compatible bugfix
Issues and Related PRs
TECHPUBS-3096-1.2
Pull Request Checklist

[ X] Target branch correct

/backport release/1.2

/backport release/1.0


Update Readme and add Torch example

@dongreenberg if you give the Readme a read over, I'll merge the Torch and Airflow examples along with the readme, and put up blog posts for them.


When I Run DeploymentTopology.jar i am getting lasterror meg in Bolts please help me

java.lang.UnsatisfiedLinkError: /tmp/linux64_opencv_java248.so: /tmp/linux64_opencv_java248.so: wrong ELF class: ELFCLASS64 (Possible cause: architecture word width mismatch) at java.lang.ClassLoader

Something goes wrong when loading the OpenCV library packed with StormCV. The library to use depends on the operating system executing the topology and it looks like the system tries to load the wrong library. What operating system are you deploying to?

i am using ubantu VM 14.04
opencv is a additional installation

give me a clear description to execute this topaligy

i am using ubantu OS
i tried so many times getting same error i am new to storm
please solve my issue
opencv is freeware oew to install tell me please solve
On Sat, Oct 10, 2015 at 11:01 PM, Corne Versloot<EMAIL_ADDRESS>wrote:

Something goes wrong when loading the OpenCV library packed with StormCV.
The library to use depends on the operating system executing the topology
and it looks like the system tries to load the wrong library. What
operating system are you deploying to?
—
Reply to this email directly or view it on GitHub
https://github.com/sensorstorm/StormCV/issues/5#issuecomment-147111570.

--
Suresh.Kotha

It should work on Ubuntu 14.04 (although I have never executed StormCV on 14.04). Given the error it seems you try to use the 64 bit library on a 32 bit system. Unfortunately there is no pre-build 32 bit OpenCV library within the StormCV distribution. There are two solutions I can think of:

use a 64 bit machine / VM.
build the OpenCV library for 32 bit Ubuntu 14.04. See this tutorial on the OpenCV website.

As a side note, I would recommend going through the examples before building and deploying a topology on a cluster.


Adding requirements.txt with newer keras version

Update keras version number

Closed, due to erroneous webhooks to appveyor


153-Fix_id_column_in_municipality_table

I am closing this PR since this issue has been done in another PR https://github.com/pets-oss/pets-back/pull/184
Thanks and keep up the good work!

Ok, no worries


DRILL-4546: Only generate one zip archive when using apache-release profile

Drill root pom doesn't override completely Apache parent pom configuration
regarding assemblies, which caused a zip archive of the project to be generated
twice, and deployed to a remote server twice too.
The fix updated the Apache parent pom version, and uses the plugin properties
to override the configuration. Also remove Drill source assembly descriptor as
the Apache parent project provides the same one.

Can you confirm that the release artifacts do not change between applying this and not applying it?

The only changes to the resulting src bundles are the changes to pom.xml file, the missing assembly file which has been removed by the patch and changes to the git.properties file (because of the patch commit).
The distributions tar.gz have the same git.properties difference + some jar differences (which are likely caused by differences in the META-INF/METADATA.MF). There's no file missing or added

@laurentgo Any interest in rebasing this?

It is resolved in PR #1561


Define depth in Dijkstra algorithm.

At present depth of path is infinite. To define the shortest path worth it is to define not only sum of weights  but number of paths also.

#30


boards: xtensa: olimex_esp32_evb: list TWAI as supported

List the Two-Wire Automotive Interface (TWAI) as supported in the Olimex ESP32-EVB board documentation.
Signed-off-by: Henrik Brix Andersen<EMAIL_ADDRESS>

I forgot this in #48124.


fix: After coming back from result detail, search result come back to the top, not current position #1150

Details:
I checked if the rootView of EventsFragment is already initialized and check if a new search is called from SearchLocationFragment. Therefore, I make the decision on reusing the rootView
Besides, I prevent the change in action bar by setting the action bar first before rendering the rootView
This fix is for issue 1150
Fixes #1150
Screenshots for the change:
Youtube Link because the GIF file is too large

Any special reason for closing PR #1182 and create a new one?


macmeta interferes with Swedish keyboard

If I start macvim:
mvim -u NONE

and do
:set nocp
:set macmeta
:inoremap <M-e> foo

Then, pressing either å or Alt+e in insert mode will insert foo. Both are treated as the same key. Is there any way to allow them to have separate mappings?

The short answer is no. I assume you are using the GUI version of MacVim instead of just in the terminal?
GVim basically treats <M-e> as the same as the character 'e' with the high bit set, which is the same as å, hence it has trouble determining between the two. When you set macmeta, MacVim basically behaves the same way, so there's no way to differentiate the two easily.
I do agree this is kind of silly as it's sort of just holdover from Vim's terminal roots even when you are running it in GUI mode. I would need to think a little about how to fix this. Ideally, <M-e> just gets triggered when you hit Alt-E, and å only when you hit that character.

@segeljakt Additionally to @ychin said, you can turn on keyboard preview on any OS you want and look how the modifiers work.
in macOS both alts modifies keys before they went to MacVim.
In Windows only right alt key modifies keys, as many apps using Alt+ to do some actions.


docs: add missing scheme for s3 endpoint example

Add https:// scheme to the S3-compatible example for Linode.
Using a value without scheme here will result in a failure with a log message:
ERROR: Barman cloud backup exception: Invalid endpoint: s3.example.com

All the other sample endpointURLs on this page already have a scheme.

/ok-to-merge


Implements SomeOf and OneOf

Created a base class called BaseCompose similar to audiomentations
SomeOf is a subclass of BaseCompose which randomizes the transforms applied on each call (and checks if number of transfroms to be applied is less than total number of transforms available)
OneOf is a subclass of SomeOf which only applies one transform at a time

Thanks for the pull request :) I just got back from vacation. I'll have a look at this within a couple of days


Config service broken with 2.4.x

Component
server, agent
Describe the bug
Since update to 2.4.x, my config service as stopped working, this is my setup:
In my app repo, my .woodpecker.yml contain only this:
extend: https://mygiteahostname/sebclem/woodpecker-pipeline-config/raw/branch/main/playbook.yml

then i have setup a config service with WOODPECKER_CONFIG_SERVICE_ENDPOINT, this is the response form my service:
{
	"configs": [
		{
			"name": "playbook.yml",
			"data": "steps:\n  check-ansible-syntax:\n    image: xxxxxxxxx/sebclem/woodpecker-ansible-runner\n    pull: true\n    settings:\n      playbook: playbooks/install.yml\n      galaxy_file: roles/requirements.yml\n      check_syntax: true\n      vault_token:\n        from_secret: ansible_vault_token\n    when:\n      - event: \"push\"\n        branch: [main, master]\n      - event: [pull_request, manual, deployment]\n\n  run-ansible-playbook:\n    image: xxxxxxxxx/sebclem/woodpecker-ansible-runner\n    pull: true\n    settings:\n      verbosity: ${verbosity=0}\n      limit: ${limit}\n      tags: ${tags}\n      playbook: playbooks/install.yml\n      galaxy_file: roles/requirements.yml\n      vault_token:\n        from_secret: ansible_vault_token\n      private_key:\n        from_secret: ansible_private_key\n    when:\n      environment: production\n      event: deployment\n\nwhen:\n  - event: \"push\"\n    branch: [main, master]\n  - event: [pull_request, manual, deployment]\n"
		}
	]
}

Here the better formatted yml response:
steps:
  check-ansible-syntax:
    image: xxxxxxxxx/sebclem/woodpecker-ansible-runner
    pull: true
    settings:
      playbook: playbooks/install.yml
      galaxy_file: roles/requirements.yml
      check_syntax: true
      vault_token:
        from_secret: ansible_vault_token
    when:
      - event: \"push\"
        branch: [main, master]
      - event: [pull_request, manual, deployment]

  run-ansible-playbook:
    image: xxxxxxxxx/sebclem/woodpecker-ansible-runner
    pull: true
    settings:
      verbosity: ${verbosity=0}
      limit: ${limit}
      tags: ${tags}
      playbook: playbooks/install.yml
      galaxy_file: roles/requirements.yml
      vault_token:
        from_secret: ansible_vault_token
      private_key:
        from_secret: ansible_private_key
    when:
      environment: production
      event: deployment

when:
  - event: \"push\"
    branch: [main, master]
  - event: [pull_request, manual, deployment]

But since 2.4.x, I got those errors:

This worked well before updating.
System Info
{"source":"https://github.com/woodpecker-ci/woodpecker","version":"2.4.1"}

Additional context
No response
Validations

[X] Read the docs.
[X] Check that there isn't already an issue that reports the same bug to avoid creating a duplicate.
[X] Checked that the bug isn't fixed in the next version already [https://woodpecker-ci.org/faq#which-version-of-woodpecker-should-i-use]

I can confirm that rolling back to 2.3.0 make it work again

My config service can be found here: https://git.sebclem.fr/sebclem/woodpecker-config-service
The docker is here if you need to reproduce this issue: https://git.sebclem.fr/sebclem/-/packages/container/woodpecker-config-service/latest

@Sebclem Could you test if #3534 (latest next version) solves your issue.

@Sebclem Could you test if #3534 (latest next version) solves your issue.

Yes, it's working with next
Thank you


Complete example for Multiple File Upload

Hi @jkuri ,
We were trying the sample application of 'Multiple File Upload' referring sample code from the Documentation (http://ng2-uploader.com/docs#multiple) and found that the sample snippet provided doesn't work . We were looking for complete and correct source for the examples provided in the documentation of this package 'ng2-uploader'. Appreciate if you can provide the link to the source or the actual source for the same at the earliest possible .
Thanks,
Kiran.

Just like that addressed @jkuri in the above issue . Appreciate response from any of the other contributors also .

Same problem here :(


hf: warn of deprecating internal callback

Adds a deprecation notice about the internal HF callback and suggests to use the new external callback, which will be available in the next release of https://github.com/huggingface/transformers.
Also adds the external callback to tests since there weren't similar tests in the transformers library, and updates the example notebook.

Codecov Report
Attention: 13 lines in your changes are missing coverage. Please review.

Comparison is base (7d5c088) 88.79% compared to head (8ecc790) 85.32%.

Files
Patch %
Lines

tests/frameworks/test_huggingface.py
7.69%
12 Missing :warning:

src/dvclive/huggingface.py
0.00%
1 Missing :warning:

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #740      +/-   ##
==========================================
- Coverage   88.79%   85.32%   -3.48%
==========================================
  Files          53       53
  Lines        3357     3359       +2
  Branches      294      294
==========================================
- Hits         2981     2866     -115
- Misses        337      455     +118
+ Partials       39       38       -1

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

Docs PR: https://github.com/iterative/dvc.org/pull/4994
The dvclive callback has now been released in both upstream packages:

https://github.com/huggingface/transformers/releases/tag/v4.36.0
https://github.com/huggingface/accelerate/releases/tag/v0.25.0

This one is ready to merge

Tests depend on https://github.com/huggingface/transformers/pull/27983

@shcheklein A new hf transformers release was finally published and all tests are now passing. Could you take a look so we can get this merged please?

One item caught my attention - using an internal callback in the notebook. I didn't check also the details of the code.

Fixed that but also found a new issue and will now need to wait for https://github.com/huggingface/transformers/pull/28653 and one more release for the added test to pass ☹.

Will take a look after the tests are passing 🙏🏻.

Will take a look after the tests are passing 🙏🏻.

👍  Tests pass on the upstream version of transformers, so just waiting for the next release from them.

@mattseddon The next release of transformers is out and tests are passing. Do you still want to take a look?


Add sumSeriesWithRegex function

This allows to sum different series by variables within a node.
Example:
collectd.test1.metric-{cat1, cat2}-*
might become:
sumSeries(collectd.test1.metric-cat1-*)
sumSeries(collectd.test1.metric-cat2-*)
This is a little bit different than sumSeriesWithWildcards, which only allows specifying a node.

Any chance to add this to graphite-api ?


FormsModule: untouched text input is not pristine in IE 11

I'm submitting a ...  (check one with "x")
[x ] bug report => search github for a similar issue or PR before submitting
[ ] feature request
[ ] support request => Please do not submit support request here, instead see https://github.com/angular/angular/blob/master/CONTRIBUTING.md#question

Current behavior
When showing a form in IE 11 with an input field, the initial state of the field is not pristine, leading to error messages being shown to the user before he touched the field.
Expected behavior
The field state should be pristine until the user first entered and removed some text. This works fine in e.g. Google Chrome
Minimal reproduction of the problem with instructions
http://embed.plnkr.co/fm7lH2/
The red error message should only be display when the user entered and removed some text.
What is the motivation / use case for changing the behavior?
Form validation errors should only be displayed when a user touched the form.
Please tell us about your environment:
Windows 7 / IE 11

Angular version: 2.4.7

Browser: IE 11

Language: TypeScript

Node (for AoT issues): node --version =   v6.3.1

see https://github.com/angular/angular/issues/14667

according to https://github.com/angular/angular/issues/14667#issuecomment-281960545, this is a angular material issue.

It is definitely a material issue. Removing material module from imports solves the issue.

Interesting, it does seem to be somehow related to material, though not necessarily mdInput. I am able to reproduce by adding this to the input demo page of the material demo app, but putting this by itself in a plunker I do not see the issue:
<input class="demo-dirty-test" ngModel [placeholder]="'placeholder'">

I will investigate further.

It looks like the source of this bug is the fact that MdInputDirective sets up an @Input() on placeholder and then re-binds it in the host. Ideally this should be fixed in angular core.
Here's an example of this happening with pure angular, no material: http://plnkr.co/edit/cpLxYzEVceJ4MUGiOXi5?p=preview

Will be fixed in core (follow https://github.com/angular/angular/issues/14667), so closing this one


Skip test case

closes #127
Checklist

[ ] Added unit / integration tests for windows, macOS and Linux?
[ ] Added a changelog entry in CHANGELOG.md?
[ ] Updated the documentation (README.md, docs)?
[ ] Does your change work on Linux, Windows and macOS?

@SimonBaeumer, I plan on finishing this implementation tomorrow. I'll then send over my ideas for how skipped test should be displayed in the output. We can the hash out our thoughts there.
Hope all is well

@SimonBaeumer the implementation is ready for review. I plan on moving the printSkipped too cli_template.go once we agree on formatted output. Currently:
commander (skip-test-case) $ ./commander test examples/commander.yaml
Starting test file examples/commander.yaml...

✗ [local] it should fail
- [skipped] it should skip
✓ [local] it should print hello world
✓ [local] it should validate exit code
✓ [local] echo hello

Results

✗ [local] 'it should fail', on property 'Stderr'

Expected

/bin/sh: invalid: command not found

to contain

/bin/sh: 1: command invalid: not found

Duration: 0.026s
Count: 5, Failed: 1, Skipped: 1
Test suite failed, use --verbose for more detailed output

Let me know what you think, I can add some integration tests and docs soon there after.

If you want me to fix the code climate issues as well, I can.

✗ [local] it should fail
- [skipped] it should skip
✓ [local] it should print hello world
✓ [local] it should validate exit code
✓ [local] echo hello

Displaying a - for skipped is fine.
Writing the status of the test inside the node field is a little bit weird, additionally it would break scripts which depend on the given structure result [node] name.
Further if new scripts are created you can not rely on the output structure because in special cases it just changes, i.e. you want to fetch all nodes, and suddenly one node is named skipped.
I would just not list them additionally because the info is available through multiple source (test output and source files).
Adding debug log statements in https://github.com/commander-cli/commander/pull/144/files#diff-cdb01b657d4a9de87f1466a8e642945dR34 when --verbose should be added :)

Do you have any suggestions on the output when we printSkipped during runtime? Or should we just not print skipped tests at runtime? Maybe
// default to local
- [filename.yaml] [local] test name, was skipped

// leave blank []
- [filename.yaml] [] test name, was skipped

// remove bracket
- [filename.yaml] test name, was skipped

@SimonBaeumer great idea to skip for all nodes! This should be the final commit.
Cheers

LGTM


DNM: Testing azure osx wheel versions

Summary
We've recently bumped our CI image from osx 10.13 to 10.15, This commit
is just to trigger a release style wheel build to see what the output
looks like in the new env.
Details and comments

The built wheels are still listed as supporting from osx 10.9 forward which is the same as what we publish today, which is what this was trying to verify:
https://dev.azure.com/qiskit-ci/qiskit-terra/_build/results?buildId=9730&view=artifacts&type=publishedArtifacts


Add index readiness check to data refresh

Fixes

Fixes #2071 by @dhruvkb
Description

Adds an index_readiness_check task to the data refresh DAGs, used to detect issues where the index is ready, but the API is not connecting properly and returning results. The task is an HttpSensor which runs after ingest_upstream completes (creating the new es index), and ~queries the API using the new internal__index param to target the new index~ directly queries the new ES index, passing only when we retrieve a threshold number of hits. Once it passes, the DAG is able to move on to the promote steps and actually promote the indices in production.

Only the data refresh TaskGroup is shown.
The Sensor times out in 24 hours, so the entire DAG will fail (without promoting the new index) and notify in Slack if the ES index does not become ready within that timeframe. After manual intervention, the DAG can be safely manually resumed from this point.
Testing Instructions

Setup

Add ES_INDEX_READINESS_RECORD_COUNT=1000 to your catalog/.env. This is used in local testing to lower the threshold record count, since local test data does not have as many records.

Set up the  ES connection by adding the following to catalog/.env: AIRFLOW_CONN_ELASTICSEARCH_HTTP_PRODUCTION=http://es:9200

Run just down && just up

Enable the create_filtered_audio_index and create_filtered_image_index DAGs

Tests

For each media type, run the associated data_refresh DAG and ensure that the whole DAG passes.
Test "unhealthy" results: the easiest way to do this is to manually edit the ES_INDEX_READINESS_RECORD_COUNT record to a larger number (100_000). Then run the DAG and observe that the index_readiness_check continuously goes up_for_reschedule and does not pass.
Test 404s for invalid index: the easiest way to simulate this is to hardcode the index_readiness_check task to query with an incorrect index name. Manually edit the task here:

...
endpoint=f"{media_type}-foo/_search",  # This index does not exist
method="GET",
...

Re-run the DAG and observe that the task continuously goes up_for_reschedule and does not pass.
Checklist

[ ] My pull request has a descriptive title (not a vague title likeUpdate index.md).
[ ] My pull request targets the default branch of the repository (main) or a parent feature branch.
[ ] My commit messages follow best practices.
[ ] My code follows the established code style of the repository.
[ ] I added or updated tests for the changes I made (if applicable).
[ ] I added or updated documentation (if applicable).
[ ] I tried running the project locally and verified that there are no visible errors.
[ ] I ran the DAG documentation generator (if applicable).

Developer Certificate of Origin

Developer Certificate of Origin
Developer Certificate of Origin
Version 1.1

Copyright (C) 2004, 2006 The Linux Foundation and its contributors.
1 Letterman Drive
Suite D4700
San Francisco, CA, 94129

Everyone is permitted to copy and distribute verbatim copies of this
license document, but changing it is not allowed.

Developer's Certificate of Origin 1.1

By making a contribution to this project, I certify that:

(a) The contribution was created in whole or in part by me and I
    have the right to submit it under the open source license
    indicated in the file; or

(b) The contribution is based upon previous work that, to the best
    of my knowledge, is covered under an appropriate open source
    license and I have the right under that license to submit that
    work with modifications, whether created in whole or in part
    by me, under the same open source license (unless I am
    permitted to submit under a different license), as indicated
    in the file; or

(c) The contribution was provided directly to me by some other
    person who certified (a), (b) or (c) and I have not modified
    it.

(d) I understand and agree that this project and the contribution
    are public and that a record of the contribution (including all
    personal information I submit with it, including my sign-off) is
    maintained indefinitely and may be redistributed consistent with
    this project or the open source license(s) involved.

I'm testing this out locally right now, but wanted to surface something - the Oauth tokens we receive from the API aren't indefinite, right? I think they have an expiration time (my local one was 43200s), which means that the token will only be valid for a short time. We may need to dust off the Oauth DAGs in order to get this working without intervention 😮

The workers should ping /worker_finished when they're done, which triggers the refresh:
https://github.com//WordPress/openverse/blob/4d6e995d2268dcd71381bce61b51b8eb558d7adf/ingestion_server/ingestion_server/api.py#L264-L313
We shouldn't refresh during the bulk insert because the cost of each refresh can be offset until all documents are inserted and indexed (i.e., when /worker_finished is called by the last worker).

A small question here: is health_check appropriate or does it cause too much confusion with our existing service-level healthchecks for the API, frontend, etc? Would "index readiness check" or something potentially be more appropriate?

One question: are we confident that index "readiness" can be sufficiently deduced from cluster health? I can't remember from the original incident whether the cluster was reporting green health even while it wasn't returning any search results.
...
When I run the reindex, it does go yellow at the time we expect here.

I was under this impression from the incident report and this seems like it should be the case from the elasticsearch documentation. However I went back through Slack just now to triple check and saw a comment suggesting the cluster was green when it was returning no documents 😱
I've updated this to check for hits from the index instead. I don't think it's necessary to keep the cluster health check as well, if it indeed cannot be relied upon.

Also, as a follow-up to this change, are we able to remove exact_index after this or do we need to keep it for anything else?

I believe we can and I intend to open that as a follow-up PR, yes.

It seems this needs the elasticsearch_production connection, do you mind adding the steps for defining that in the testing instructions?

It seems this needs the elasticsearch_production connection, do you mind adding the steps for defining that in the testing instructions? Additionally, we're going to have an Elasticsearch-type (rather than HTTP-type) connection added as part of https://github.com/WordPress/openverse/issues/2371, should we distinguish this connection type in some way? Possibly elasticsearch_http_production?

I figured this HTTP based one would be replaced with the full ES provider package one :grimacing: I guess that would need to be added as an addendum to the IP though.

@obulat Can you check that you recreated the catalog/.env file (rm catalog/.env && cp catalog/env.template catalog/.env && just down && just up) and created the data refresh pool? I always get weird behaviour when I forget either of those things even try to rerun.
I opened https://github.com/WordPress/openverse/issues/2434 to prevent the data refresh pool from missing locally.

@sarayourfriend FWIW #2352 made it so that you don't need to set up the data_refresh pool in local development, which I rebased this branch specifically to pick up because it's so annoying :)
@obulat Some of the env variable names changed during development -- the instructions are up to date but maybe you had an outdated connection id? If recreating the catalog/.env file and just down && just up doesn't work, I'd also recommend running just init to ensure you have some data in the catalog & api dbs.

@sarayourfriend FWIW https://github.com/WordPress/openverse/pull/2352 made it so that you don't need to set up the data_refresh pool in local development, which I rebased this branch specifically to pick up because it's so annoying :)

!! Thanks for letting me know, I guess that makes the other issue moot :slightly_smiling_face:

@stacimc I just realised that we probably need the same check in filtered index creation for newly created filtered indexes, right?

@stacimc I just realised that we probably need the same check in filtered index creation for newly created filtered indexes, right?

Very good call! Done.


etcd problem

Hi!
I'm trying to use this plugin with etcd, but when I run rabbitmq-plugins enable autocluster I get this:
Applying plugin configuration to<EMAIL_ADDRESS>failed.
Error: {badarg,[{erlang,list_to_integer,["tcp://<IP_ADDRESS>:2379"],[]},
                {autocluster_util,as_integer,1,
                                  [{file,"src/autocluster_util.erl"},
                                   {line,34}]},
                {autocluster_etcd,nodelist,0,
                                  [{file,"src/autocluster_etcd.erl"},
                                   {line,56}]},
                {autocluster,ensure_registered,2,
                             [{file,"src/autocluster.erl"},{line,97}]},
                {autocluster,init,0,[{file,"src/autocluster.erl"},{line,27}]},
                {rabbit,'-run_step/2-lc$^1/1-1-',1,[]},
                {rabbit,run_step,2,[]},
                {rabbit,'-run_boot_steps/1-lc$^0/1-0-',1,[]}]}

where <IP_ADDRESS>:2379 is my etcd node.
The content of rabbitmq.config is
[{rabbit, [{loopback_users, []}]},{autocluster, [{backend, etcd}, {etcd_host, "etcd"}, {longname, true}]}].

What could be the problem?

The problem looks like the etcd port is defaulting to the tcp URL which is odd, I'm not quite sure how you'd get that without an ETCD_PORT environment variable of tcp://<IP_ADDRESS>:2379 or a etcd_port config value of  tcp://<IP_ADDRESS>:2379. The built-in defaults would not cause that to happen.

It's been quite some time since you opened the ticket, please let me know if you'd still like to try and troubleshoot this. I do not believe it's code related.

Ok, figure this out. Docker container linking is overriding the ETCD_PORT environment variable, making it the URI and setting it to:
ETCD_PORT='tcp://<IP_ADDRESS>:2379'

Addressed in 563acd3


IO_ModeTypedef is not defined

When building a project utilizing the 32l496gdiscovery BSP, the build encounters a missing type name IO_ModeTypedef.
In particular, the file stm32l496g_discovery_io.h/.c references IO_ModeTypedef, but is not brought into scope through any include path.  I am setting up a project that is using git submodules to pull in all STM32 firmware dependencies.  So, all sources in Drivers are from the master branches of the relevant source repositories found at https://github.com/STMicroelectronics.
I have investigated the issue and what has changed is the dependent library https://github.com/STMicroelectronics/stm32-mfxstm32l152.  It used to refer to ../Common/io.h which had this type, but has since removed that #include reference, and is using uint32_t instead of IO_ModeTypedef.  I would suggest the same change needs to be made to this library if it is to continue to work with the associated dependencies from https://github.com/STMicroelectronics.
For reference, when build the project with STM32CubeIDE:
C:/fm/github/stm32-secure-patching-bootloader-demoapp/Drivers/BSP/STM32L496G-Discovery/stm32l496g_discovery_io.h:101:44: error: unknown type name 'IO_ModeTypedef'; did you mean 'JOYMode_TypeDef'?
 uint8_t  BSP_IO_ConfigPin(uint32_t IO_Pin, IO_ModeTypedef IO_Mode);

There may be other incompatibilities between this repository and dependencies like https://github.com/STMicroelectronics/stm32-mfxstm32l152.

I examined the dependencies between these libraries and it builds if the following versions are observed:

library
version

stm32-bsp-common
v5.1.2

stm32-mfxstm32l152
v2.0.3

32l496gdiscovery
v1.1.6

Note that bsp-common is at v7.1.0 and mfxstm32l152 is at v3.0.3.

Hi @firmwareguru,
As you pointed out and as indicated by the Compatibility information paragraph in the README.md file, it is crucial to pick up the correct versions of the different BSP Components' drivers to be used along with a BSP Board's driver.
These versions are indicated in the Relase_Notes.html file of the STM32CubeL4 firmware.
Regarding versions v7.1.0 of the BSP-COMMON and v3.0.3 of the MFXSTM32L152, these are to be used with along with other BSP Boards' drivers (L5xx boards, for example).
I hope this makes things clearer. Please allow me to close this issue.
With regards,
PS: Best wishes for the new year 2022.


Public buckets - should we by default allow users to browse/list objects?

In #2159 @GeorgianaElena sat up a GCP bucket that could be accessed anonymously. Based on GCP documentation, one can learn how to craft https:// links to expose their uploaded objects, but also how users can browse objects in a bucket.
Right now, an anonymous user can't list/browse objects in a bucket.

If they would have the GCP permission storage.objects.list, I think they would be able to do so though. Then it could look like this for example.

Action points

[ ] Understand if listing/browsing a bucket typically is relevant for common workflows. Does for example intake or other tools require this kind of permission?
[ ] If we provide something by default, do we include list/browse permissions?

I think no matter what, users who asks for a public bucket should be asked if they want to allow users to browse the content, and we should have documentation to clarify what we are asking them. Still, I think we should consider a default behvior.

Related

Link to browse a GCP bucket's content: https://console.cloud.google.com/storage/browser/m2lines-public-persistent
Link to download a GCP bucket's file: https://storage.googleapis.com/m2lines-public-persistent/perezhogin_test.txt

I figure its a relevant question, but its not relevant enough, so closing


ParquetSchemaHidingIT should be reintroduced to Parquet store

The ParquetSchemaHidingIT should be reenabled in the Parquet store.

Merged into develop.


Website Dashbord isn't loading

Hello, I've sucessfully installed everything and are able to run it without ny issue, when i visit the site then in the console it give the statuscode 200. the website title changed correctly to Mailwhale BUT the page is just blank without any content. Aftr inspecting the HTML of the Pageit seem like there is nothing:

Now i tried to disable adblock or any other extension which could cause this but sadly did not help. I even tried to visit the site on another machine but the issue is always the same.
Note that i changed all 127.0,0.1 in the config to <IP_ADDRESS> so i can access it outside of the host (cause my linux server don't have an display installed)
Hopefully someone can help me there,
Regards,
FuckingToasters

Do you see any error messages in the browser console?

Update: After adding the actual server's public address as url it show correctly.
I want to implement the smtp stuff into my mybb forum but it seem like that MailWhale only provide an API for it. Is there a way to get the smpt details and then use smpt directly?

I think MailWhale is the wrong thing for you. MailWhale takes an already existing SMTP Server (e.g. Gmail) and essentially adds a REST API on top. If you want to send mail via SMTP directly, there's no point in using MailWhale.


SelectCommand shoots rays, but does not hit objects in scene

@skalarproduktraum, select does shoot spheres when debugRaycast is indicated, but it doesnt hit objects that are already in the scene. It does return the debug spheres along the ray, just not preexisting objects.
https://github.com/scenerygraphics/SciView/blob/f38fc410f4784b0d177dcb8191f6132fb95195d8/src/main/java/sc/iview/SciView.java#L286

This isn't 100% true. I was able to click on a mesh in one scene, but it isn't consistent and selects incorrectly quite a bit.

Solved with scenery 0.5.2


Uncaught ReferenceError: fullScreenMode is not defined

After upgrading to 2.x, I'm getting errors in the javascript console:
Uncaught ReferenceError: fullScreenMode is not defined
Uncaught ReferenceError: isActive is not defined
Are there any changes that I should make to upgrade to 2.x? Is there an upgrade guide available?

There a few upgrade steps listed in the readme. But those are JavaScript errors, so maybe it's a browser cache issue. Also make sure you are using the appropriate output type for your storage.


Issue with my go version perhaps?

-----> Go app detected
/tmp/buildpack_fa8dcb8b-abd8-4b79-81ca-3ceb0ada8e00/bin/compile: line 85: test: too many arguments
-----> Installing devel +65bf677ab8d8 Mon Nov 25 13:36:16 2013 +1100...tar: devel: Cannot open: No such file or directory
tar: Error is not recoverable: exiting now
tar: Child returned status 2
tar: +65bf677ab8d8: Not found in archive
tar: Mon: Not found in archive
tar: Nov: Not found in archive
tar: 25: Not found in archive
tar: 13\:36\:16: Not found in archive
tar: 2013: Not found in archive
tar: +1100.linux-amd64.tar.gz: Not found in archive
tar: Exiting with failure status due to previous errors

My go version is:
go version devel +65bf677ab8d8 Mon Nov 25 13:36:16 2013 +1100 darwin/amd64

I can see that it's trying to install or untar every single argument in the version. Do I need to have a release candidate go version?

Can you duplicate the issue with the current buildpack? If so please let me know the app name and I'll take a look.

PS: I'm going to close for now, so re-open if this is still an issue.
Thanks!


SyntaxError: Unexpected token ... in jasmine-core node module when using karma launcher on older TVs

Current behaviour
when launching unit test on older Tizen TV with custom karma launcher i get SyntaxError: Unexpected token ... for node module jasmine-core
(Tizen 4.0) ERROR [2m 47s]
  Uncaught SyntaxError: Unexpected token ...
  at node_modules/jasmine-core/lib/jasmine-core/jasmine.js:9583:30

  SyntaxError: Unexpected token ...

Environment Details

node version: 16.14.2,
npm version: 8.19.2,
jasmine-core version 4.4.0,
karma-jasmine version 5.1.0,
karma version: 6.4.1,
Platform: Samsung Tizen 4.0 (2018), Web Engine: Chromium M56

Question
Is there a way to polyfill the jasmine-core module so it runs on older TVs?
Is this the right repo for this issue or should I submit one in jasmine repo?

I submitted an issue in jasmine repo and here is the answer
It would be best to downgrade jasmine-core module to version that was actual when TVs browser was released (for Chromium M56 it was jasmine 2.5.2) but version of jasmine-core 3.x should be supported as well
https://github.com/jasmine/jasmine/issues/1981


Add tests

Would be nice if this project could feature tests.

@amilajack Will add it

Naive implementation:
uglify-js some > test === webpack

😆

Ah ha that would be so simpler.  I was thinking of something similar to this https://github.com/nolanlawson/optimize-js/blob/master/test/test.js with webpack config output.

Sounds good

addressed https://github.com/vigneshshanmugam/optimize-js-plugin/commit/89ed3bbb166041b29ea3586eae2d2e954680c37e


a simple debug tool for general nas programming interface

added a new nnictl command: nnictl trial codegen <exp_id> --trial_id <trial_id> to generate an independently executable (without nni) trial code for the trial <trial_id>.
Currently, this command is only for general nas programming interface, will expand this command to the whole nni annotation in future.

seems that there's no good example for using NAS interface with nni.get_next_parameter. At least I don't see any examples/docs for teaching users how to parse & generate network structure according to the output of tuner. Strongly suggest you add this to next release :)

seems that there's no good example for using NAS interface with nni.get_next_parameter. At least I don't see any examples/docs for teaching users how to parse & generate network structure according to the output of tuner. Strongly suggest you add this to next release :)

sorry for making this unclear, this NAS interface follows nni annotation rule, no need to use nni.get_next_parameter. I can think about how to make it more clear.

seems that there's no good example for using NAS interface with nni.get_next_parameter. At least I don't see any examples/docs for teaching users how to parse & generate network structure according to the output of tuner. Strongly suggest you add this to next release :)

sorry for making this unclear, this NAS interface follows nni annotation rule, no need to use nni.get_next_parameter. I can think about how to make it more clear. nni.mutable_layers not only expresses the neural architecture search space, but also indicate how each trial's neural architecture should be.

just out of curious. Did you considered the scenario of tuning architecture & hyper-parameter simultaneously? Does it mean that in this scenario the users can only use NNI annotation?

seems that there's no good example for using NAS interface with nni.get_next_parameter. At least I don't see any examples/docs for teaching users how to parse & generate network structure according to the output of tuner. Strongly suggest you add this to next release :)

sorry for making this unclear, this NAS interface follows nni annotation rule, no need to use nni.get_next_parameter. I can think about how to make it more clear. nni.mutable_layers not only expresses the neural architecture search space, but also indicate how each trial's neural architecture should be.

just out of curious. Did you considered the scenario of tuning architecture & hyper-parameter simultaneously? Does it mean that in this scenario the users can only use NNI annotation?

This is a good question. Tuning both architecture and hyper-parameter at the same time would be inevitable in real application scenarios. Yes, users can use NNI annotation in these scenarios. If they use nni.get_next_parameter, code might be unnecessarily complex because it means neural architecture is expressed through hyper-parameters, they have to parse the hyper-parameters to build the network first. We can have further discussion on this.


Add Version increment automation task

Signed-off-by: pgodithi<EMAIL_ADDRESS>Description
Gradle project: Add gradle task (versionIncrement) that support version increment automation.
Issues Resolved
Part of: https://github.com/opensearch-project/opensearch-build/issues/1375
From solution: https://github.com/opensearch-project/opensearch-build/issues/1375#issuecomment-1159476686
Related issue: https://github.com/opensearch-project/opensearch-plugins/issues/155
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Hello @dblock @AmiStrn , if you are good with updateVersion?
I will go ahead an update across other PR's https://github.com/opensearch-project/opensearch-build/issues/1375#issue-1083595538 that I have raised for each repo.
Thank you


[WIP] Compile on PyPy on Linux

This is something of a placeholder at the moment - the code is pretty much as I plan for it to be (and is based on #2253), but I'm still thinking about a good way to produce llvmlite packages for pypy that can be used to test Numba with. Some thoughts/comments:

All this enables is compiling the C extension part of Numba on PyPy - it won't even import at the moment. Import working correctly, and more straightforward use-cases working, will be part of the following PR - this is just to try and keep the work into as small and manageable chunks as possible.
IIRC llvmlite packages were produced on a Jenkins server internal to Continuum, and then uploaded to anaconda.org - is that still the case? If so, will it be OK to add an extra configuration to build llvmlite packages in the long term?
The llvmlite package that's used here at the moment is created from this recipe: https://github.com/gmarkall/llvmlite/tree/pypycondarecipehack/conda-recipes/llvmlite - this recipe rolls in pip and enum34, which is not ideal. I think that I should build the pypy package again but this time make sure it includes pip and setuptools, and make a pypy-enum34 conda package. I didn't do either of these things yet because it will be a little time-consuming, and wanted to get a bit of feedback first before going ahead with trying to do that.
libllvmlite.so for PyPy is 491MB, which seems a little excessive. Maybe I need to see why that's so big quite soon too.

All feedback / thoughts appreciated! In the meantime, I'll be trying to improve the packaging setup and fixing anything that this appears to have broken.

I completely forgot to do something about making sure Numpy was installed on PyPy, and seem to have upset the build for CPython too. Will come back to this after the weekend.

You are right that llvmlite is still built on an internal Continuum computer, but now we're using buildbot instead of Jenkins.  Same basic idea though.
One issue that comes to mind is how we should distinguish a PyPy build of a package from a CPython build of a package in conda.  There might be some new conda/conda-build features that help here.  I need to talk to @msarahan to see.

One issue that comes to mind is how we should distinguish a PyPy build of a package from a CPython build of a package in conda. There might be some new conda/conda-build features that help here. I need to talk to @msarahan to see.

I had wondered if that would be possible, but I was a bit wary of getting too stuck into generic PyPy/conda stuff and spending a lot of time on it - it would be good to know if there's some things in there that make it relatively easy to do though :-)

Should be easier with conda build 3's more dynamic recipes.  I have not
really thought through this exact use case though.  Happy to talk when I
return from vacation on Monday.
On Mar 28, 2017 2:56 AM, "Graham Markall"<EMAIL_ADDRESS>wrote:

One issue that comes to mind is how we should distinguish a PyPy build of
a package from a CPython build of a package in conda. There might be some
new conda/conda-build features that help here. I need to talk to @msarahan
https://github.com/msarahan to see.
I had wondered if that would be possible, but I was a bit wary of getting
too stuck into generic PyPy/conda stuff and spending a lot of time on it -
it would be good to know if there's some things in there that make it
relatively easy to do though :-)
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/numba/numba/pull/2319#issuecomment-289680711, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AACV-Xr3NRjzFhYknOgYMVhkOfHn35bWks5rqK8lgaJpZM4MotqS
.

Should be easier with conda build 3's more dynamic recipes. I have not really thought through this exact use case though. Happy to talk when I return from vacation on Monday.

It's not so much the package building that I was worried would be an issue, but more a problem of dependency resolution - for example, if I wanted to package pypy and have a numpy package that depends on it, I'm not sure how that would look. For numpy 1.12.1 there are the following variations:
                             1.12.1                   py27_0  defaults
                             1.12.1             py27_nomkl_0  defaults        [nomkl]
                             1.12.1                   py35_0  defaults
                             1.12.1             py35_nomkl_0  defaults        [nomkl]
                          *  1.12.1                   py36_0  defaults
                             1.12.1             py36_nomkl_0  defaults        [nomkl]

None of these will be compatible with a pypy package, and I think quite a few questions arise, e.g.:

If I were to build a Numpy for PyPy, what would the build string be to ensure that it would depend on a PyPy package that implements Python version 2.7?
Should the PyPy package be named Python (given that CPython is called python in conda too)?

If it should be called python, what should its version be?
If not, can build strings be used to denote dependence on particular versions of non-python packages?

I imagine that the answers to these are not trivial and might require some work to support in conda - I was hoping to sidestep these questions by simply building a small "ecosystem" of PyPy and related packages that don't use the exact names "python" or "numpy" as the package names, but it's not a scalable way of working - however, if there's a better, "official" way to do this then that would be preferable for the long term.

Yeah, I think this is something we'll need to figure out for conda more broadly as PyPy cpyext improves and PyPy can run more of the packages relevant to conda users (scipy, pandas, etc).

I think for now we'll have to go with the "small ecosystem" approach.  I spoke with some of the conda developers and they have some ideas for how to deal with this, but nothing that will be available soon.

I think for now we'll have to go with the "small ecosystem" approach. I spoke with some of the conda developers and they have some ideas for how to deal with this, but nothing that will be available soon.

Just to clarify - this means that I'll build and publish a set of PyPy and related packages that are completely independent of other conda packages for the purpose of testing Numba and llvmlite? (I am happy to do this)

Yes.  If you put together the conda recipes, we're also happy to host them under our Anaconda Cloud account.

Just FYI, PyPy3.5 5.9 is out:
https://morepypy.blogspot.com.es/2017/10/pypy-v59-released-now-supports-pandas.html

Any update?
PyPy added almost full Cython support since the last comment was made. llvmlite and builds and runs fine without any patch.

with pypy 7.2 it still failing (Manjaro)   :/
....
copying numba/tests/pycc_distutils_usecase/setup_distutils.py -> build/lib.linux-x86_64-3.6/numba/tests/pycc_distutils_usecase
running build_ext
building 'numba._dynfunc' extension
Warning: Can't read registry to find the necessary compiler setting
Make sure that Python modules winreg, win32api or win32con are installed.
C compiler: gcc -pthread -DNDEBUG -O2 -fPIC
creating build/temp.linux-x86_64-3.6
creating build/temp.linux-x86_64-3.6/numba
compile options: '-I/opt/pypy3/include -c'
extra options: '-g'
gcc: numba/_dynfuncmod.c
In file included from numba/_dynfuncmod.c:1:
numba/_dynfunc.c: In function ‘generator_dealloc’:
numba/_dynfunc.c:361:10: error: ‘_Py_Finalizing’ undeclared (first use in this function)
  361 |     if (!_Py_Finalizing)
      |          ^~~~~~~~~~~~~~
numba/_dynfunc.c:361:10: note: each undeclared identifier is reported only once for each function it appears in
error: Command "gcc -pthread -DNDEBUG -O2 -fPIC -I/opt/pypy3/include -c numba/_dynfuncmod.c -o build/temp.linux-x86_64-3.6/numba/_dynfuncmod.o -g" failed with exit status 1
----------------------------------------

hi guys,
I'm attaching a Dockerfile that you can run in a single line and illustrates the issue. This code builds all the way till llvmlite, but fails on numba.
Scipy, Pandas, Numpy, Cython, everything work with Pypy

FROM buildpack-deps:sid

# ensure local pypy is preferred over distribution pypy
ENV PATH /usr/local/bin:$PATH

# http://bugs.python.org/issue19846
# > At the moment, setting "LANG=C" on a Linux system *fundamentally breaks Python 3*, and that's not OK.
 Since this is a docker image,
# these will be recreated every time, writing them just uses unnecessary disk
# space.
ENV PYTHONDONTWRITEBYTECODE=true

RUN apt-get  update &&  apt-get install -y build-essential

#4 opencv3
ENV OPENCV_VERSION 3.4.2

RUN apt-get install --no-install-recommends -y openssh-client git cmake make

################## shared packages for chromium headless ######################
RUN apt-get install -y libx11-xcb1 libxcb1 libx11-6 libxcomposite1 libxcursor1 \
    libxdamage1 libxext6 libxi6 libxtst6 libgtk-3-0 libnss3 libxss1 libasound2

# RUN  apt-get --no-install-recommends -y install libatlas-base-dev
RUN apt-get install --no-install-recommends -y libopenblas-base  libopenblas-dev

# RUN pypy -m ensurepip

RUN pip download  scipy
RUN apt-get install -y gfortran
RUN pip install --no-cache-dir --only-binary cython,numpy numpy cython
RUN pypy3 -m pip install --upgrade pip
# RUN pip install --no-cache-dir pybind11
RUN apt-get install -y libopenblas-dev liblapack-dev
RUN  pip install git+https://github.com/scipy/scipy@master#egg=scipy

RUN pip install --no-cache-dir  pandas dask

# RUN pip install --no-cache-dir  pandas dask

RUN apt-get install -y llvm-8-dev  llvm-8 pypy-dev
RUN update-alternatives --install /usr/local/bin/llvm-config llvm-config /usr/bin/llvm-config-8 40 && \
    # update-alternatives --install /usr/local/bin/clang clang /usr/bin/clang-8 40 && \
    update-alternatives --install /usr/local/bin/opt opt /usr/bin/opt-8 40 && \
    update-alternatives --install /usr/local/bin/llvm-link llvm-link /usr/bin/llvm-link-8 40
RUN pip install --no-cache-dir  numba

_Py_Finalize is supported since release 7.3.0 in Dec 2019, and conda now has support for PyPy. Could you try again with a python7.3 version of PyPy?

It seems the CI has moved to azure, and the conda environment is created with this line
conda create -n %CONDA_ENV% -q -y python=%PYTHON% numpy=%NUMPY% cffi pip scipy jinja2 ipython gitpython

which can be modified to use PyPy via
conda config --set channel_priority strict
conda create -c conda-forge -n %CONDA_ENV% -q -y pypy python=3.7 numpy pip cffi scipy jinja2 ipython gitpython

The main change is to add a pypy specifier to select the PyPy builds. Other than that:

require conda-forge channel
specify only python3.7
do not specify a numpy version since only a few are available for pypy

Nope, this won't work. Compilation of numba/_dispacther.cpp fails because PyPy's PyThreadState does not have c_profile_func, in fact it does not have the typedef int (*Py_tracefunc)(PyObject *, struct _frame *, int, PyObject *); declaration in pystate.h.


Support JSONObjectEachRow format

New in 22.9

It is reopened as the PR was reverted until we have the support in the Cloud.


Remove setuptools dependency

I could be mistaken, but to me it seems python-readchar should not specify setuptools as install requirement. Typically it is provided by the environment, or specified as build requirement. It is never imported and used in order to run readchar.
As a consequence, a specific version of setuptools leaks into my lock files and I have to specifically exclude it.
See also https://github.com/magmax/python-readchar/issues/111. In pyproject.toml, there would be:
[build-system]
requires = ["setuptools", "wheel"]

[project]
dependencies = [
]

Similar case https://github.com/Gandi/gandi.cli/issues/249
See also: https://stackoverflow.com/questions/65326080/python-setup-config-install-requires-good-practices

Thanks!


Ffmpeg libraries

added links to descriptions of which libraries are included for ffmpeg packages
Description
For the ffmpeg and ffmpeg-full packages, in the readme, I added links to the site that shows the libraries included for each
Motivation and Context

Currently, packages refer to an "essentials" and "full" build, but in the upstream project there is no such thing as either of those. Long-time users of ffmpeg could/do look at it wondering what either of them mean.
fixes https://github.com/chocolatey-community/chocolatey-packages/issues/1765

Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[x] Documentation change
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Migrated package (a package has been migrated from another repository)

Checklist:

[x] My code follows the code style of this repository.
[X] My change requires a change to documentation (this usually means the notes in the description of a package).
[X] I have updated the documentation accordingly (this usually means the notes in the description of a package).
[X] All files are up to date with the latest Contributing Guidelines
~[ ] The added/modified package passed install/uninstall in the chocolatey test environment.~
[ ] The changes only affect a single package (not including meta package).

:white_check_mark: Package verification completed without issues. PR is now pending human review

:white_check_mark: Package verification completed without issues. PR is now pending human review

:white_check_mark: Package verification completed without issues. PR is now pending human review

@slycordinator your changes have been merged, thanks for your contribution 👍
The documentation changes will be part of any future package versions of the ffmpeg packages that will be pushed to the Chocolatey Community Repository.

The list of external libraries in a build is already present in README.txt inside the package.
Starting with the next release, the README.txt will contain a list of all components, whether internal or external.


"Compiler (caching) should build not keep error after fix" test flanky

Do you want to request a feature or report a bug?
bug
What is the current behavior?
the test is flanky
1) Compiler (caching) should build not keep error after fix:
      Uncaught AssertionError: expected 0 to equal 1
      + expected - actual
      -0
      +1

      at Assertion.fail (/home/travis/build/webpack/webpack/node_modules/should/cjs/should.js:231:17)
      at Assertion.value (/home/travis/build/webpack/webpack/node_modules/should/cjs/should.js:305:19)
      at /home/travis/build/webpack/webpack/test/Compiler-caching.test.js:63:36
      at /home/travis/build/webpack/webpack/lib/Compiler.js:9:18029
      at Compiler.emitRecords (/home/travis/build/webpack/webpack/lib/Compiler.js:9:24142)
      at /home/travis/build/webpack/webpack/lib/Compiler.js:9:17431
      at /home/travis/build/webpack/webpack/lib/Compiler.js:9:23827
      at next (/home/travis/build/webpack/webpack/node_modules/tapable/lib/Tapable.js:118:11)
      at Compiler.<anonymous> (/home/travis/build/webpack/webpack/lib/performance/SizeLimitsPlugin.js:9:5297)
      at Compiler.applyPluginsAsyncSeries1 (/home/travis/build/webpack/webpack/node_modules/tapable/lib/Tapable.js:122:13)
      at Compiler.afterEmit (/home/travis/build/webpack/webpack/lib/Compiler.js:9:23477)
      at Compiler.<anonymous> (/home/travis/build/webpack/webpack/lib/Compiler.js:9:23346)
      at /home/travis/build/webpack/webpack/node_modules/async/dist/async.js:356:16
      at iteratorCallback (/home/travis/build/webpack/webpack/node_modules/async/dist/async.js:936:13)
      at /home/travis/build/webpack/webpack/node_modules/async/dist/async.js:840:16
      at Compiler.writeOut (/home/travis/build/webpack/webpack/lib/Compiler.js:9:22436)
      at Compiler.<anonymous> (/home/travis/build/webpack/webpack/lib/Compiler.js:9:21758)
      at /home/travis/build/webpack/webpack/node_modules/async/dist/async.js:3025:16
      at eachOfArrayLike (/home/travis/build/webpack/webpack/node_modules/async/dist/async.js:941:9)
      at eachOf (/home/travis/build/webpack/webpack/node_modules/async/dist/async.js:991:5)
      at Object.eachLimit (/home/travis/build/webpack/webpack/node_modules/async/dist/async.js:3089:3)
      at Compiler.emitFiles (/home/travis/build/webpack/webpack/lib/Compiler.js:9:20857)
      at Object.mkdirp (/home/travis/build/webpack/webpack/test/Compiler-caching.test.js:33:5)
      at Compiler.<anonymous> (/home/travis/build/webpack/webpack/lib/Compiler.js:9:20483)
      at Compiler.applyPluginsAsyncSeries (/home/travis/build/webpack/webpack/node_modules/tapable/lib/Tapable.js:95:46)
      at Compiler.emitAssets (/home/travis/build/webpack/webpack/lib/Compiler.js:9:20043)
      at onCompiled (/home/travis/build/webpack/webpack/lib/Compiler.js:9:16105)
      at /home/travis/build/webpack/webpack/lib/Compiler.js:9:33869
      at next (/home/travis/build/webpack/webpack/node_modules/tapable/lib/Tapable.js:102:11)
      at Compiler.<anonymous> (/home/travis/build/webpack/webpack/test/Compiler-caching.test.js:87:4)
      at next (/home/travis/build/webpack/webpack/node_modules/tapable/lib/Tapable.js:104:14)
      at Compiler.<anonymous> (/home/travis/build/webpack/webpack/lib/CachePlugin.js:9:4498)
      at Compiler.applyPluginsAsyncSeries (/home/travis/build/webpack/webpack/node_modules/tapable/lib/Tapable.js:106:13)
      at /home/travis/build/webpack/webpack/lib/Compiler.js:9:33523
      at Compilation.applyPluginsAsyncSeries (/home/travis/build/webpack/webpack/node_modules/tapable/lib/Tapable.js:95:46)
      at /home/travis/build/webpack/webpack/lib/Compilation.js:9:40026
      at Compilation.applyPluginsAsyncSeries (/home/travis/build/webpack/webpack/node_modules/tapable/lib/Tapable.js:95:46)
      at /home/travis/build/webpack/webpack/lib/Compilation.js:9:39269
      at Compilation.applyPluginsAsyncSeries (/home/travis/build/webpack/webpack/node_modules/tapable/lib/Tapable.js:95:46)
      at /home/travis/build/webpack/webpack/lib/Compilation.js:9:38815
      at Compilation.applyPluginsAsyncSeries (/home/travis/build/webpack/webpack/node_modules/tapable/lib/Tapable.js:95:46)
      at sealPart2 (/home/travis/build/webpack/webpack/lib/Compilation.js:9:38479)
      at Compilation.applyPluginsAsyncSeries (/home/travis/build/webpack/webpack/node_modules/tapable/lib/Tapable.js:95:46)
      at Compilation.seal (/home/travis/build/webpack/webpack/lib/Compilation.js:9:34560)
      at /home/travis/build/webpack/webpack/lib/Compiler.js:9:33220
      at /home/travis/build/webpack/webpack/node_modules/tapable/lib/Tapable.js:189:11
      at Compilation.<anonymous> (/home/travis/build/webpack/webpack/lib/Compilation.js:9:27742)
      at /home/travis/build/webpack/webpack/lib/Compilation.js:9:26407
      at _combinedTickCallback (internal/process/next_tick.js:67:7)
      at process._tickCallback (internal/process/next_tick.js:98:9)

What is the expected behavior?
it should pass always

see PR


Use Json Merge Patch on updateRecord.

Persisting a modified object will now do a Json Merge Patch to Fedora. From the Ember perspective there should be no difference in behavior. This matches the support added to Fedora in fcrepo 4.7.5-2.0-SNAPSHOT-2. If you wish to run with pass-ember, note that you must update the fcrepo image version in docker-compose.yml.
Closes #8.

[x] Use Json Merge Patch on updateRecord.
[x] Integration test against Fedora Json Merge support
[x] Documentation update

Looks good + Ready to merge :+1:


Added afterGetState  hook

Sorry I am gonna close this, as this is something you should do with a custom plugin after registering the vuex-persistedstate plugin.


No scrollbar

Hi,
not sure if this is by design or if it is a bug but the new docs page lost it's sidebar for the main content as of today. If by design - please rethink this as it's making it very hard and slow to navigate longer pages.
Thanks

@pootzko Can you attach a screenshot of what you're seeing? That may have been unintentional...

Sure, here:

The navigation scrollbar is there, but the content one is missing (not even the default chrome sidebar is being displayed). I have been using the docs quite a bit the last few days and the sidebar was there. This morning I noticed it was missing. The green part of the screenshot is the desktop background.
I now checked firefox as well and the problem does not seem to be manifesting there. I have the most recent version of both FF and Chrome. Windows 8.1. Other websites show the sidebar normally.

Fixed this in a small push to master

Thanks, @alexpaxton!


MetricLoadScriptService: omit log messages in production mode

We see a lot of info log messages in the JS console even in production mode, e.g.
Loading script of altmetric
Loading script of dimensions
Loading script of plumX
Resolving with status Loaded

These messages are generated in MetricLoadScriptService. Please consider to remove these debug messages at least in production mode.

this issue is related to the frontend component of DSC - it was moved to https://github.com/4Science/dspace-angular/issues/55


docs: Add OpenSSF Scorecard status badge to README.md

Created OpenSSF Scorecard badge for project README.

Motivation
This was requested by @agilgur5 as part of #9769

Verification

@terrytangyuan generally I am agreed on that.
In this case, this is specifically for the CNCF CLOMonitor, for which #9769 is a tracking issue. That issue was from last year's CNCF Security Slam, which will start up again this year in around ~2 weeks (I'm planning on working on SLSA Level 3 and 4, as recently discussed in SIG Security yesterday).
We are missing two badges for CLOMonitor, this is one of them. Although the OpenSSF Scorecard also requires running in CI, which we don't currently do as far as I know, so I think this badge is using an old result(?) or something.
As CLOMonitor is a metric CNCF highlights for supply chain security, I think it would be good to bring our score up and in line with CD.

Thanks

@redenferno have you worked on setting up the scorecard action? Without that the badge is a bit premature
If you haven't, I was planning to pick it up simultaneously with SLSA in October

FYI @agilgur5, the Scorecard score presented in the badge will be accurate to the last weekly cron job (Google sponsors a scan of over a million repos every week, including this one).
The GitHub Action can serve to increase the precision by updating the score whenever new code is merged, but it isn't a prerequisite for the badge.

FYI @agilgur5, the Scorecard score presented in the badge will be accurate to the last weekly cron job (Google sponsors a scan of over a million repos every week, including this one).

Oh I didn't know that, thanks for the context!
Could you link to a source for this? like docs from OpenSSF or the repo for this cron job?

I didn't find anything in the docs yet, but I know this because the maintainers made sure it was included in the LF Course on the topic. They probably should add it to the docs more clearly.
Here is confirmation from the BigQuery data that argo workflows is included in the cron:

Ah I found it. There are docs on this in the "Public Data" section of the scorecard README. It links to a CSV in the repo of all projects tracked as well (though it's ~70mb so it can be difficult to load 😅 ). I believe the cron directory that the CSV is in is the code for the cron job as well.


Allow TurndownService to accept custom HTML parsers

This solves a problem for me where I need to run turndown in a service worker. That environment doesn't support either the DOM API-based or domino-based solutions that turndown's HTMLParser implementation only supports. I talked a bit more about this in https://github.com/mixmark-io/turndown/pull/443#issuecomment-2003173563
With this change I can pass in a HTMLParser-compatible object to the TurndownService constructor, implemented using a package like linkedom which affords a DOM-like API and works fine in a service worker context.
It should not change anything for existing users in either standard (DOM accessible) browser or node contexts as the existing HTMLParser implementation should still be used by default.

Thank you for your contribution.

domino-based solutions that turndown's HTMLParser implementation only supports

You can pass TurndownService#turndown() a DOM object(element/document/fragment node). This is the current way to use your custom HTML parser - just convert the string yourself and then pass the DOM node to turndown instead of a string.
Unfortunately introducing customizable HTMLParser doesn't solve the packaging issue, that's why I'd prefer to follow the idea described in #290. However, you can achieve the same by wrapping the turndown() method and using your own DOM parser as described above.


SSH tunnel auth fail

Hey there!
I've got a problem with SSH tunneling with public RSA key auth.
If I establish SSH through shell
ssh IP -l user -p 2247 -L 3307:localhost:3306
DBeaver connects to DB normally.
This is a real drag for me, so I decided to try out the tunnel through DBeaver.
I've set everything up,  but on testing connection or trying to connect I get a password prompt.
If I leave it blank like you suggested at other Auth threads (w/ or without Save Password), I get:

Can't initialize tunnel
Cannot establish tunnel
Auth fail
Auth fail

I'm using DBeaver 5.0.2 on ubuntu 17.10.
edit:
from the DBeaver debug:
2018-04-08 02:38:22.789 - SSH INFO: ssh_rsa_verify: signature true
2018-04-08 02:38:22.791 - SSH INFO: Host is IP known and matches the RSA host key
2018-04-08 02:38:22.794 - SSH INFO: SSH_MSG_NEWKEYS sent
2018-04-08 02:38:22.795 - SSH INFO: SSH_MSG_NEWKEYS received
2018-04-08 02:38:22.799 - SSH INFO: SSH_MSG_SERVICE_REQUEST sent
2018-04-08 02:38:22.832 - SSH INFO: SSH_MSG_SERVICE_ACCEPT received
2018-04-08 02:38:22.876 - SSH INFO: Authentications that can continue: publickey
2018-04-08 02:38:22.884 - SSH INFO: Next authentication method: publickey
2018-04-08 02:38:23.168 - SSH INFO: Disconnecting from IP
2018-04-08 02:38:23.177 - Connection failed (mysql5-162a2b08d7b-1d679e479ada54e)

Can't reproduce. Perhaps the problem is in RSA key itelf.
Could you try SSHJ tunnel implementation? (https://github.com/dbeaver/dbeaver/wiki/Optional-extensions#advanced-ssh-tunnel-libraries)

I tried with SSHJ, but I get Host unreachable (when I switch back to JSch I get Auth fail instead).
From the debug:
2018-04-09 18:23:16.752 - Connect with 'MySQL - localhost' (mysql5-161f0accbb1-7dfd396a37b5f901)
2018-04-09 18:23:17.025 - Connection failed (mysql5-161f0accbb1-7dfd396a37b5f901)
2018-04-09 18:23:17.080 - org.jkiss.dbeaver.model.exec.DBCException: Can't initialize tunnel
org.jkiss.dbeaver.model.exec.DBCException: Can't initialize tunnel
at org.jkiss.dbeaver.registry.DataSourceDescriptor.connect(DataSourceDescriptor.java:740)
at org.jkiss.dbeaver.runtime.jobs.ConnectJob.run(ConnectJob.java:70)
at org.jkiss.dbeaver.model.runtime.AbstractJob.run(AbstractJob.java:95)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:56)
Caused by: org.jkiss.dbeaver.DBException: Cannot establish tunnel
at org.jkiss.dbeaver.model.net.ssh.SSHImplementationSshj.setupTunnel(SSHImplementationSshj.java:88)
at org.jkiss.dbeaver.model.net.ssh.SSHImplementationAbstract.initTunnel(SSHImplementationAbstract.java:125)
at org.jkiss.dbeaver.model.net.ssh.SSHTunnelImpl.initializeTunnel(SSHTunnelImpl.java:61)
at org.jkiss.dbeaver.registry.DataSourceDescriptor.connect(DataSourceDescriptor.java:738)
... 3 more
Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable)
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at net.schmizz.sshj.SocketClient.connect(SocketClient.java:126)
at net.schmizz.sshj.SocketClient.connect(SocketClient.java:117)
at org.jkiss.dbeaver.model.net.ssh.SSHImplementationSshj.setupTunnel(SSHImplementationSshj.java:67)
... 6 more

Weird. No ideas so far.
Could you provide a bit more information about your server/key? This must be not so standard config because usually everything works fine.
You could send more info on<EMAIL_ADDRESS>

I'm hacing what I think is the same issue.  Running the DB on Mac OSX, and client machine running Parabola GNU/Linux.  DB adaptor is mariaDB.

Please post full debug log - starting from Connect with '...' line and till the end of log.
Just cut any private info (IP) from it.
Looks like something is wrong with auth. I can reproduce such issues only with wrong user name/ip.

I am having the same issue using SSH with a password login.  I can login with the same credentials via a terminal or through a different GUI, so I don't think it is a database configuration issue.

Hey there!
I've got a problem with SSH tunneling with public RSA key auth.
If I establish SSH through shell
ssh IP -l user -p 2247 -L 3307:localhost:3306
DBeaver connects to DB normally.
This is a real drag for me, so I decided to try out the tunnel through DBeaver.
I've set everything up, but on testing connection or trying to connect I get a password prompt.
If I leave it blank like you suggested at other Auth threads (w/ or without Save Password), I get:

Can't initialize tunnel
Cannot establish tunnel
Auth fail
Auth fail

I'm using DBeaver 5.0.2 on ubuntu 17.10.
edit:
from the DBeaver debug:
2018-04-08 02:38:22.789 - SSH INFO: ssh_rsa_verify: signature true
2018-04-08 02:38:22.791 - SSH INFO: Host is IP known and matches the RSA host key
2018-04-08 02:38:22.794 - SSH INFO: SSH_MSG_NEWKEYS sent
2018-04-08 02:38:22.795 - SSH INFO: SSH_MSG_NEWKEYS received
2018-04-08 02:38:22.799 - SSH INFO: SSH_MSG_SERVICE_REQUEST sent
2018-04-08 02:38:22.832 - SSH INFO: SSH_MSG_SERVICE_ACCEPT received
2018-04-08 02:38:22.876 - SSH INFO: Authentications that can continue: publickey
2018-04-08 02:38:22.884 - SSH INFO: Next authentication method: publickey
2018-04-08 02:38:23.168 - SSH INFO: Disconnecting from IP
2018-04-08 02:38:23.177 - Connection failed (mysql5-162a2b08d7b-1d679e479ada54e)

I had a similar issue with locally generated RSA key and Dbeaver was showing Invalid key. Then I converted RSA to PPK and it works like a charm!

I had a similar issue with locally generated RSA key and Dbeaver was showing Invalid key. Then I converted RSA to PPK and it works like a charm!

same here, although in my case @serge-rider 's advice helped - sshj worked even with locally generated rsa key.
@serge-rider any chances sshj is becoming the default implementation used in Dbeaver? Thanks!

@klimov-gett I hope so. Currently it is not included because of bug size of BouncyCastle package.

It is included to DBeaver EE by default. But for CE version the package is too big. Perhaps it will be included later, but we cannot give any promises.

DBeaver CE is not include sshj package now?

DBeaver CE is not include sshj package now?

It is optional extension. You can install it from marketplace: https://github.com/dbeaver/dbeaver/wiki/Optional-extensions.

It is optional extension. You can install it from marketplace: https://github.com/dbeaver/dbeaver/wiki/Optional-extensions.


Support code_example_list_class in _config.yml

Also, for the <code> tag, use class="#{language}" instead of class="#{language}", this make it possible to use the CSS from https://github.com/isagalaev/highlight.js and other similar projects, without having to make any changes.

Thanks for the PR @jessp01; it looks good. I do have one request; can you add a note about code_example_list_class to the Configure CSS Classes section of the README?

Thanks @wbushey, added to README.


Best practice for installing rubygems in formulas

Background
There are only a handful of formulas for Ruby based applications that are installing gem dependencies.
Not a single one of them are doing it like the formula cookbook instructs or in any other reusable manner.

For example, Ruby 1.9’s gems should be installed to var/lib/ruby/ so that gems don’t need to be reinstalled when upgrading Ruby. You can usually do this with symlink trickery, or better a configure option.

What's the preferred way? (Or an acceptable way if I ever want to get my formula merged?)
I don't think the part about "don't need to be reinstalled when upgrading Ruby" is actually correct, gem directories are ruby version specific, such as /usr/local/opt/rbenv/versions/2.4.0/lib/ruby/gems/2.4.0 or /usr/local/lib/ruby/gems/2.4.0
Also, var/lib/ruby is not in the GEM_PATH even in a brew installed ruby, so any reuse of the formula installed gems would require setting GEM_PATH (this could be caveated in the formula).
I don't think installing to var/lib/ruby during formula is not possible, you have to install under buildpath and then (var/"lib/ruby").install buildpath/"gem_temp"
Prior art
mikutter

Gems are defined as resources.
Installs to /usr/local/Cellar/mikutter/#{version}/lib - not reusable by other ruby apps or even across mikutter versions
HEAD will not work if it requires any other gems or gem versions
A formula update that includes gem updates will require generating a new set of resouces.

At first it looks like the "prime example" of how to do it, but all that fancy stuff actually ends up making this maybe the most difficult to maintain and the most likely to break and adds exactly zero gem reusability.
cocoapods

Installs dependent gems under cocoapods' own directory (a whole bunch of them)
Not usable universally or across versions

hub
Only uses gems during build for creating man pages, installs them privately, ditches them after build.
ghi
Uses depends_on "pygments.rb" => :ruby which results in:
Homebrew does not provide special Ruby dependencies;
install with: `gem install pygments.rb`

..yeah well you could have used gem install ghi in the first place

I think any of the ways except ghi (which should probably be removed, I agree) are fine. We don't aim to have gems reused between versions or software as Homebrew kegs should only depend on other kegs or system-wide things.
We'd also definitely accept PRs to improve/discuss the documentation.
Thanks for some a detailed write-up ❤.


Run this on a new trained model

I have a trained model of inception v3, retrained on the class of Vehicles. I want to use that instead of the by default setting here. How can i do that ?

Hey,
You can use which CNN architecture you want by "TensorFlow Object Counting API" via setting this line!
vehicle_counting_tensorflow is just a sample project that shows how you can develop object counting systems by using "TensorFlow Object Counting API". If you want to reach more features to develop various projects tha are based object counting, you can use "TensorFlow Object Counting API".
BR,
Ahmet

I have a trained model of inception v3, retrained on the class of Vehicles. I want to use that instead of the by default setting here. How can i do that ?

have u been successful with that ?


Reapiting user insert  android

Using Firefox on Android say you type: Hello!
Comes out: Hello!Hello!Hello!

Merging this into an issue that tracks all Android specific Draft.js bugs - see https://github.com/facebook/draft-js/issues/1895


Can't save modified style

V0.9.8, 64 Bit, Windows

View -> Preferences
SQL-Editor -> Style Configurator
change any setting, i.e. Default Style -> Font Name from "Courier New" to "Consolas"
klick save

Error:
can't open file 'C:\Program Files\Firebird\FlameRobin (x64)\xml-styles\stylers.xml' (error 5: access denied)
This is "normal" for Windows, because the application's folder is read-only for non-admin users.
Styles should be stored in the user's profile folder, i.e.  C:\Users(user name)\AppData\Local\flamerobin
At this place, the user can store modified style files.
On program startup, the folder C:\Users(user name)\AppData\Local\flamerobin should be checked; if no style xml files are found, copy the default style files from the application' folder.

Hi @kalwados maybe change the installer to move styles to  C:\Users\(user name)\AppData\Local\flamerobin, and let Flamerobin decide if there is a local folder, use it, if not use from user folder (because you can use Flamerobin portable)
I image thar the same behavior occurs at Linux (if someone could try)
@Jdochoa can you take a look?
The setup need to save to %user%\AppData\Local\flamerobin\xml-styles
The app need to look for  first at %user%\AppData\Local\flamerobin\xml-styles then secondly if not found at .\xml-styles (current)

The setup need to save to %user%\AppData\Local\flamerobin\xml-styles
The app need to look for first at %user%\AppData\Local\flamerobin\xml-styles then secondly if not found at .\xml-styles (current)

No. The setup runs with administrator rights, which can be a complete different user than the user which will run the application (or several users on same machine; think of terminal server) . The only reliable way is to let Flamerobin itself copy the xml files into the current user folder. Or at least use the user's folder when saving a style modified from the default.

hum, let me try something

Please try this version
flamerobin-0.9.8-styles-setup-x64.zip
flamerobin-0.9.8-styles-setup.zip
Commit https://github.com/arvanus/flamerobin/commit/4c2addf9c89bc20ff717882efce0cc54104b86f8
If it work I'll merge later into main repo

OK, no error messages while saving modified styles. Thank you.
But the whole style-edit-dialog does not work as I expect. I would like to use the "DarkModeDefault"; with Font "Consolas" and 12 pt. font size. Since the "set editor font" option does nothing since the past released, I used the "Global override" entry to set my font configuration, but at least the font size is not persistent als falls back to 10 pt. Also the selected font name "Consolas" is not copy into the other style items.

IMHO the initial .xml files should be stored in the installation folder and the modifications in the user folder.
./jo

Hello, @Jdochoa I simply copied everything to user folder in the first time the user saves the preferences. From this point Fr will use the user folder to look for styles
I did this for simplicity reasons and to not change too much code


Add gzip compression to response

http://stackoverflow.com/questions/28406068/express-4-x-compression

closed with 40e3488fc8c98476ecf59816fbc67fcbadc44b15


Printing attributes for an individual org

I've been struggling for a while on how to simply get all of the attributes for a specific Organization, given the org ID, and display them. Can you add this to the wiki? It isn't obvious, at least to me.

You mean this? http://stackoverflow.com/questions/6886493/get-all-object-attributes-in-python


Persist alert 'for' state across restarts

Addresses #422
Design:

Store the time (ActiveAt) in nanoseconds in the series when the alert goes to Pending or Firing state. We add this sample in the series during every Eval.
If it goes to Inactive state, then store -1 in the series.
While restoring for state, we query for the time range (currentTime-holdDuration, currentTime), and if we find any samples in the series, we restore ActiveAt accordingly.

@brian-brazil PTAL, I have fixed some comments since last time. These 2 comments were not very clear though.
https://github.com/prometheus/prometheus/pull/4061#discussion_r183417333
https://github.com/prometheus/prometheus/pull/4061#discussion_r183417614

@brian-brazil I have updated the PR. Now the timestamp of the sample is being used to check for 'firing' state. Control flow has been modified to restore the state after the first Eval.

I've given it a quick test. When an alert stops firing it seems that the two ALERTS series aren't getting marked stale.
The flag names also need changing, as these settings are not AM related.

I think they should have been marked stale at least after few Eval if not active, as that part of code was not tinkered. I will give it a test and see what is the issue.
And about the flags:
alertmanager.outage-tolerance => for-outage-tolerance
alertmanager.for-grace-period => for-grace-period?

The flags still need a prefix, rule.alert... would be one option.

This?
rules.alert.for-outage-tolerance
rules.alert.for-grace-period

It's as good as anything.

@brian-brazil I don't see why the series won't be marked stale when the alert becomes inactive, the original logic is still in place. Did you observe that even 1-2 Evals after it became inactive?

Yes, it seemed to be that way even after waiting a bit.

@brian-brazil while testing for that I found a bug in another place where samples were not being added if alertHoldDuration was less than hold duration (as it was not set as restored).
The series was being marked stale after that (I did not test it before that fix).

That seems to be working okay now.  Can this PR be merged without DCO for some commits ([very]old commits)?

We require DCO on all commits. You could try squashing.

@brian-brazil Many issues while trying to change commit messages. With some methods there is a conflict, and with another method I get
The previous cherry-pick is now empty, possibly due to conflict resolution.

Try squashing everything into one commit. That should bypass all that.

@brian-brazil It's done.

I haven't used Borgmon in 4 years or used Prometheus in 9 months ( 😭 ) but this is so great ❤


Please add a screen shot and a license file

I'd like to add this to awesome-zsh-plugins, but I prefer to add themes with screen shots in the readme so that users can see what they look like without having to install them.
Also, please add a license file, some people won't use any code that doesn't have an open source license. If you don't have one in mind, https://choosealicense.com is a good resource to help you select an appropriate one.
Thanks!

Sorry for not replying sooner. I'm has been done already.


Confusing Text[BUG]

Description
The second to last paragraph in the overview of  Javascript lab, water if needed, mission has some confusing text.
Expected Behavior
it should read  -- 'the string WATER only if'
Actual Behavior
it currently reads -- 'the string WATER if any only if'
Possible Fix
remove the 'if any'
Steps to Reproduce

check the text for the mission

Context
no, it did not prevent me from completing however it may confuse none native English speakers

sry wrong repo


state size does not change dynamically with custom board size

https://github.com/CGLemon/pyDLGO/blob/c237ab644c8bd9f63a52c24e5a5595d1cab3d9c4/board.py#L89
This line seems to use the global constant for 19x19 board. But if the board is initialized for smaller sizes, there seems to be a redundancy in storing the states (a bunch of unnecessary "3"'s). Should it be changed?

Sorry about that. The current BOARD_SIZE is 9. Past 19 is a bug. I fixed it already.
The every go engines I know use the fixed array instead of dynamic array, like Leela Zero, Kata Go, Pachi... . Actually I have no ideal about it. I guess it is in order to bug-free. There are some methods may use the out of board area and make it store some special informations ( Not used in pyDLGO ). It may much complexity if we use dynamic one.
Addition, self.state is not only 9x9. It is (9+2)x(9x2). That because we apply the mailbox. Here is the description.


[WIP] Add coverage helper for migrations

Follow-up to #4218

@miq-bot add_label wip

That didn't seem to change migrations... Adding some debugging.

All migrations are already required since the migration specs migrate all the way up and all the way down.


Adding issuer to Google Authentication QR

Google Authenticator allows a label on top of the tokens showing issuer name such as "redmine.foo.com"

Hi, @colcek! Thank you for your useful pull request.


WIP: Add extract

Related to issue ( https://github.com/dask/dask/issues/2540 ).
Implements the equivalent of NumPy's extract function for use with Dask Arrays. This is not totally lazy yet. However it should hopefully be easier to make this lazy and thus reimplement compress on top of this Dask Array extract implementation.

Was thinking it would be easier to rewrite compress using extract, but it seems that it would be easier to go the other way.

Replaced by PR ( https://github.com/dask/dask/pull/2555 ).


Recent problem

Only recently the script gives me this error, until recently it always worked correctly:
[2020/08/09 09:17:40] - Opening https://my.noip.com/#!/dynamic-dns...
[2020/08/09 09:17:42] - Message: no such element: Unable to locate element: {"method":"xpath","selector":".//a[@class='no-link-style']"}
(Session info: headless chrome=72.0.3626.121)
(Driver info: chromedriver=72.0.3626.121,platform=Linux 4.19.66-v7+ armv7l)

Created a PR https://github.com/loblab/noip-renew/pull/40

Created a PR #40

Work fine, thanks!

Please try the latest version which merged the fix.

Please try the latest version which merged the fix.


Cube demo app does not seem to be resizing properly

On an iMac running macOS 10.15.7. Nothing I do causes the swap chain to get recreated. I can resize the window, maximize it and it seems like it's just stretching the contents of the render to fill the window.
In particular I'm hoping to see how I'm supposed to handle resizing, along with how to handle moving the window from a retina display to a regular loDPI display, to see how the sample handles these cases.

I think the behavior I saw would be resolved with #1455. Closing this one.

Nothing I do causes the swap chain to get recreated.

The Cube demo was modified back in June 2021 to handle VK_SUBOPTIMAL_KHR and resize accordingly. Perhaps you were running an older version when this was posted? You can use the error handling in the current version of cube.c as a template in your own apps.
As @cdavis5e points out, the use of VK_SUBOPTIMAL_KHR is intentional, as the behavior of CAMetalLayer is consistent with the description within the Vulkan spec of the difference between VK_ERROR_OUT_OF_DATE_KHR and VK_SUBOPTIMAL_KHR.


Strange TypeError: Cannot read property '__export' of undefined error after upgrading to 1.0.2

Prerequisites

[X ] Did you check the FAQ?
[ X] Did you search open and closed issues to see if your issue has already been reported?

Description
After upgrading to the latest version of typings, I am getting weird Typescript compilation errors with a very unhelpful stack trace. I also tried renaming the keys in typings.json to globalDependencies and globalDevDependencies, but that did not seem to resolve the issue.
/Users/Jacob/.node/lib/node_modules/typescript/lib/tsc.js:33078
                throw e;
                ^

TypeError: Cannot read property '__export' of undefined
    at visit (/Users/Jacob/.node/lib/node_modules/typescript/lib/tsc.js:12608:49)
    at getExportsForModule (/Users/Jacob/.node/lib/node_modules/typescript/lib/tsc.js:12601:20)
    at getExportsOfModule (/Users/Jacob/.node/lib/node_modules/typescript/lib/tsc.js:12577:70)
    at getExportsOfSymbol (/Users/Jacob/.node/lib/node_modules/typescript/lib/tsc.js:12573:42)
    at resolveEntityName (/Users/Jacob/.node/lib/node_modules/typescript/lib/tsc.js:12506:36)
    at getTypeFromTypeReference (/Users/Jacob/.node/lib/node_modules/typescript/lib/tsc.js:15247:54)
    at checkTypeReferenceNode (/Users/Jacob/.node/lib/node_modules/typescript/lib/tsc.js:20786:24)
    at checkSourceElement (/Users/Jacob/.node/lib/node_modules/typescript/lib/tsc.js:22949:28)
    at checkTypeAliasDeclaration (/Users/Jacob/.node/lib/node_modules/typescript/lib/tsc.js:22324:13)
    at checkSourceElement (/Users/Jacob/.node/lib/node_modules/typescript/lib/tsc.js:23010:28)

typings.json
{
    "version": false,
    "dependencies": {
        "bellona-typescript-definitions": "file:node_modules/bellona-typescript-definitions/typings.json",
        "bluebird": "registry:npm/bluebird#3.3.4+20160427051630",
    },
    "ambientDependencies": {
        "aws-sdk": "registry:dt/aws-sdk#0.0.0+20160316155526",
        "bunyan": "registry:dt/bunyan#0.0.0+20160412155112",
        "underscore": "registry:dt/underscore#1.7.0+20160505190121"
    },
    "devDependencies": {},
    "ambientDevDependencies": {
        "chai-as-promised": "registry:dt/chai-as-promised#0.0.0+20160317120654",
        "mockery": "registry:dt/mockery#1.4.0+20160316155526",
        "promises-a-plus": "registry:dt/promises-a-plus#0.0.0+20160317120654",
        "proxyquire": "registry:dt/proxyquire#1.3.0+20160316155526"
    }
}

tsconfig.json
{
    "compilerOptions": {
        "module": "commonjs",
        "target": "es5",
        "sourceMap": true,
        "diagnostics": true,
        "noImplicitAny": true,
        "outDir": "dist/",
        "suppressImplicitAnyIndexErrors": true
    },
    "buildOnSave": false,
    "compileOnSave": false,
    "filesGlob": [
        "typings/index.d.ts",
        "src/**/*.ts",
        "test/**/*.ts"
    ],
    "atom": {
        "rewriteTsconfig": true
    },
    "files": [
        "typings/index.d.ts",
    ]
}

Steps to Reproduce

Run the tsc command

Expected behavior:
Clean compilation of the source files
Actual behavior:
Thrown exception that leads to inability to compile
Versions
1.0.2

TypeScript error, not Typings. Most likely related to https://github.com/Microsoft/TypeScript/issues/8053, you should log the issue with TypeScript.

Upgrading to the nightly build of Typescript (npm install -g typescript@next) fixed this issue, though I am still pretty clueless as to the underlying cause

Unfortunately, I am also - I knew what it related to but not the underlying cause. It's unfortunate, but I didn't want to keep a bunch of people in the dark that needed the 1.0 release (it'd already been delayed enough).


Fix errors in strings and make duration more obvious

This fixes https://github.com/bulletproofnetworks/pigeonhole/issues/36 which was caused by broken query strings.
I also added some output to the help text in bin/alert_threshold_recommendations.rb. This has been deployed to our staging environment for your testing, @glasnt.

:shipit:

Deployed to staging and production. Looks good so far.


support loading of file from URL

Similarly to itk-vtk-viewer, paraview glance should support loading from URL.
For example https://kitware.github.io/itk-vtk-viewer/app/?fileToLoad=https://data.kitware.com/api/v1/file/5b9abb878d777f43cca8aa85/download/collins.nii
Similarly, after loading a sample data(https://kitware.github.io/paraview-glance/app/), the associated URL should be displayed in the URL bar.
cc: @bastienjacquet

https://discourse.paraview.org/t/automatically-load-data-into-paraview-glance/1539


Propose to specify exact location

closes https://github.com/MicrosoftDocs/OfficeDocs-SkypeForBusiness/issues/8914

@CarolynRowe PR has been copyedited and is ready for final review, could you please check and merge? Thanks!


Propagate select hints to storage

Thanos Stores rely on select hints for returning downsampled data when querying long time ranges. Unless hints are properly set, stores cannot return the correct downsampled chunks, leading to incorrect queries. Hints are also used for query pushdown inside sidecars.
This commit adds support for propagating select hints to the underlying storage.

Thanos Stores rely on select hints for returning downsampled data when querying long time ranges.

Sorry didn't get this one. Select hints is a Prometheus thing, do we really use it to propogate downsampling information? IIRC downsampling info is on the store API level only.

@yeya24 yes this is a bug I saw in Thanos when using the new engine. Stores gateways use the function hint to know which downsampled chunk to return (whether average, sum, count etc..).


Integration Test - Release - 2019/02/13 18:33:53

Auto create for integration test. AnotherAuthorUpdatedArticleFlow

@adunndevster : Thanks for your contribution! The author, @v-caxian, has been notified to review your proposed change.


TextAlign is missing Justify

Our engine supports it:
https://github.com/flutter/engine/blob/6c5315c3a1d72ee2aae520e05c1ebf0f6794ae0e/sky/engine/core/rendering/style/RenderStyleConstants.h#L153
We just don't expose it to Dart:
https://docs.flutter.io/flutter/dart-ui/TextAlign-class.html
@olostan ran into this.

it didn't work in right to left languages.

@Khordad36 would you be willing to file a new bug?  I'd like to make sure we understand and can fix the issues you're seeing.  Thank you!

@eseidelGoogle thanks for your attention!
I submit this issue. #30986

I have a problem with Justify with Arabic, where the lines with numbers have a defect, as well as the footnote number when uploading it, the numbers in one line will be flipped so that if (1) (2) (3) becomes like this (3

) (2) (1)