stoped working, it wont download anything, couldyou please take a look?

Describe the bug
A clear and concise description of what the bug is.
Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Additional context
Add any other context about the problem here.

Same thing happened to me. Seems to be an issue with the res.aweme_list[0] part. Something is up with the API url I think.

Same here:
Error: SyntaxError: Unexpected end of JSON input
at JSON.parse ()
at getVideoNoWM (/Users/nanak/tiktok-downloader/index.js:110:33)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async /Users/nanak/tiktok-downloader/index.js:214:89
Response body:
/Users/nanak/tiktok-downloader/index.js:115
const urlMedia = res.aweme_list[0].video.play_addr.url_list[0]
^
TypeError: Cannot read properties of undefined (reading 'aweme_list')
at getVideoNoWM (/Users/nanak/tiktok-downloader/index.js:115:38)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async /Users/nanak/tiktok-downloader/index.js:214:89
Node.js v19.5.0

same here... it founds the videos but non is downloaded

Same for me:
[*] Getting list video from: XXXX
[*] 16 video found
[*] 30 video found
[*] 30 video found
[X] No more video found
[*] Total video found: 30
[!] Found 30 video
Error: SyntaxError: Unexpected end of JSON input
    at JSON.parse (<anonymous>)
    at getVideoNoWM (/home/tbm/src/tiktok-downloader/index.js:110:33)

    at async /home/tbm/src/tiktok-downloader/index.js:214:89
Response body:
(node:1259272) UnhandledPromiseRejectionWarning: TypeError: Cannot read property 'aweme_list' of undefined
    at getVideoNoWM (/home/tbm/src/tiktok-downloader/index.js:115:38)
    at processTicksAndRejections (internal/process/task_queues.js:97:5)
    at async /home/tbm/src/tiktok-downloader/index.js:214:89

Same thing happened to me, i not working when i any action download, hope anyone fix bug will be honored.  There is log error:
Error: SyntaxError: Unexpected end of JSON input
at JSON.parse ()
at getVideoNoWM (/*****/tiktok-downloader/index.js:110:33)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async /*/tiktok-downloader/index.js:214:89
Response body:
//TikTok/tiktok-downloader/index.js:115
const urlMedia = res.aweme_details[0].video.play_addr.url_list[0]
^
TypeError: Cannot read properties of undefined (reading 'aweme_details')
at getVideoNoWM (//tiktok-downloader/index.js:115:38)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async //tiktok-downloader/index.js:214:89

Made a fix for it, seems the api link was expired so I changed the link and it all works fine for me!

@matthewcoolio can you open a PR or where can we find your fix?

I have solved this problem. please re-clone this repository. Thank u :)

Nice, thank you


Bump MSRV to 1.68

Codecov Report

Merging #123 (4e996f3) into main (97e46e1) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #123   +/-   ##
=======================================
  Coverage   94.07%   94.07%
=======================================
  Files          14       14
  Lines        1418     1418
=======================================
  Hits         1334     1334
  Misses         84       84


Anyway it runs on a Windows Desktop?

Any ways to get around in Windows? Thanks for your work!

I believe that the native plugin(dll) can be built on Windows with some effort (minor code changes), but I have not tried it yet.
However, we cannot make use of GPU acceleration on Windows in any case, because MediaPipe does not support it.

I would also be interested in doing that, @tutu5110  if you figure it out I would be happy to hear about it.

Same here

I believe that the native plugin(dll) can be built on Windows with some effort (minor code changes), but I have not tried it yet.
However, we cannot make use of GPU acceleration on Windows in any case, because MediaPipe does not support it.

Could you give some pointers about this? I'm really interesting in building a native dll to use in Windows Unity. I've built the project in Lubuntu and dragged the files over to Windows and experienced the DllNotFoundError. I suppose there's no way to fix that without building the whole thing correctly, right?

Some problems may remain, but today I confirmed that the plugin works on Windows.
To install MediaPipe on Windows itself doesn't look as straightforward as on Linux for me, but once you succeed it, you can build this plugin too.

Some problems may remain, but today I confirmed that the plugin works on Windows.
To install MediaPipe on Windows itself doesn't look as straightforward as on Linux for me, but once you succeed it, you can build this plugin too.


iOS ConnectCompletionCallback not triggered

Hello everyone, currently I am trying to run below code on cordova iOS(8.2) project.
When I check the javascript console, there is no console output. However when I check xcode output it says "Session did not connect, error code=1006". Do you have any idea why the callback function is not triggered on session.connect method ??
`var session = OT.initSession(apiKey, sessionId);
session.connect(token, function (error) {
if(error){
console.log('Session connection failed');
}
else{
console.log('Connected to session');
}
});`

Facing the same issue. Can anyone help?

check readme file, this plugin not supported any more, here is the new one https://gitter.im/songz/cordova-plugin-opentok?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge&utm_content=badge


Issues while using redis session

Implementing redis session by following this example http://flask.pocoo.org/snippets/75/ but getting
raise TypeError('Expected bytes')
code I'm using

Error

Your session.sid is not a str or bytes, which is needed by to_bytes as seen here:https://github.com/pallets/werkzeug/blob/master/werkzeug/_compat.py
Probably putting str(session.sid) in the response.set_cookie call will fix it
However, like is clearly stated when you create an issue here:

This issue tracker is a tool to address bugs in Flask itself.
Please use the #pocoo IRC channel on freenode or Stack Overflow for general
questions about using Flask or issues not related to Flask.

So please next time use IRC or Stack Overflow for questions like this

Thanks It worked


Add travis integration for coverity

Signed-off-by: Fabio Utzig<EMAIL_ADDRESS>

@d3zd3z I will merge this one to test the coverity port which will live in coverity_scan branch.


logger is not correctly disabled

when using PYAEDT_FILE_LOGS environment variable the log file should be disabled but it is not the case.

@maxcapodi78 I am investigating it.


Turn off this flaky test for now.

cc @cbracken

see also https://github.com/flutter/flutter/issues/9034

lgtm


Use a given element

Hey,

Your script is awesome! I love it, and highly useful.

The only problem I’m facing is that I would like to use it together with vertical scrolling, but when I call your script, vertical scroll stops in other divs.

rough test:
http://www.spe.leoben.org/wp/wp-content/themes/spefifteen/playground/linecept/drops/horwheel/

Is it possible to validate your script on only one div?

Have a nice rest of the weekend,
Dave

Done!.


The command-line structure is a little confusing

Consider the following:

eden controller does some things, but eden adam does others, even though adam is the controller
eden controller edge-node lets me do some edge node things, like update or remove a baseos image, reboot, and get the current config, but eden pod lets me do pod things on an edge node
eden controller edge-node get-config lets me get the actual config json for a node, but eden controller edge-node update lets me set config properties
eden reconf lets me get the actual config json for a node, but so does eden controller edge-node get-config, while eden reconf also lets me set the config

This needs a clean restructuring to make it easier to understand and use. I can propose some options below.

First, I think the high-level eden-focused commands make sense:
  clean       clean harness
  config      work with config
  help        Help about any command
  setup       setup harness
  start       start harness
  status      status of harness
  stop        stop harness
  test        Run tests
  utils       Eden utilities

We also should have the high-level commands to control services:
eve # including console, ssh, status, start, stop
adam
redis
eserver

Beyond those, everything to interact with and control running eve instances should be under one root point. I think eden device makes sense, eden controller is fine too, but everything should be there, similar to:
eden device get-config
eden device set-config
eden device info
eden device logs
eden device metrics
eden device reboot
eden device update
eden device image-update

I general, I very much agree that some streamlining of the top-level CLI command structure is very much needed (believe it or not -- we've done one round of cleanups already).
What you suggesting makes sense, but I would also like to let is stew for a couple of weeks to see what other functionality will emerge in Eden. Then we can have one holistic look and change the structure.
Makes sense?

believe it or not -- we've done one round of cleanups already

I believe it. This stuff is emergent. If we tried to plan the perfect CLI and flags from day 0, we would never have built anything useful.

What you suggesting makes sense, but I would also like to let is stew for a couple of weeks to see what other functionality will emerge in Eden. Then we can have one holistic look and change the structure

If you want to, sure. I have a leaning towards, let's just fix it, and add new emerging commands in that structure. But I don't have the time to clean it up now anyways.

Closing. We fixed this. Feel free to reopen


Namespace not available in Unity.

Hi,
I've compiled to DLL and imported into Unity, but the SimpleTCP namespace isn't available so i can't access any of the SimpleTCP library.
Is there something special i need to do to make this work with Unity?

Oh, it seems it's because it's targeting .net 4.5, and Unity Editor only supports 3.5, which breaks a lot of functionality.

Okay so... using the source code directly in Unity (with the editor scripting runtime version set to .NET 4.x equivalent) allows me to use the library, however compiling to to DLL and importing it still doesn't work.
I'm also having trouble setting my server to run a function on DataReceived, i would have thought this functionality would be somewhat standard?

Unity has its own network handler, see:
https://docs.unity3d.com/Manual/UNet.html
and
https://docs.unity3d.com/Manual/UnityWebRequest.html


Package use npm version of keycloak.js instead of the one bundled with keycloak server

Keycloak server ensure that the javascript library keycloak.js is always at
https://my-keyclaok-auth-url/auth/js/keycloak.js
by installing the npm package instead of using this, it might insert breaking change, or unexpected behavior to the login flow.

Your keycloack.js should come directly from your server and not from npm package.


view:clear should be run after postInstall / Laravel upgrades.

Laravel Version: 5.2.44
PHP Version: 7.0.*
Database Driver & Version: MySQL

Description:
Illuminate\Foundation\ComposerScripts::postInstall should clear views (php artisan view:clear).
Otherwise changes to blade compiler which aren't compatible between versions result in unexpected errors.
As far as I'm aware this currently isn't an issue if moving forward between versions (I havn't tested confirm) but it is an issue if moving BACKWARD. Obviously that's somethign that would never actually happen in production but given it can happen going backwards it could happen when upgrading on a server.
Alternatively, mentioning in the upgrade process that after an upgrade view:clear should be run would make sense.

I'd say go ahead and create a PR that runs the command after the post-update-cmd.
Closing since it's not a bug report :)

In earlier releases or 4.x or 5.0 Laravel does include this under post-install-cmd, however with the introduction of Envoyer and zero downtime deployment (in general) this does create some issue because:

composer is executed very early in the deployment.
storage/framework/views is shared between builds.

For app that has high concurrent access, it's very likely the views will still be loaded from the older build (as deployment still continues in the background) and hence you still getting the old code, which might not work when the deployment completed.

I'd say go ahead and create a PR that runs the command after the post-update-cmd.

Post update command is only executed locally (for development), production should only run composer install.


Fix the read me so that it has valuable information

I want to see a better title, description and maybe a roadmap.

Working on this now.

Included in pre-release v.0.0.1-alpha


Added Brevity Core Principle

Added Brevity principle to MIP0c2
Fixed merge error in component list. 'Three Core Principles' -> 'Core Principles'

LGTM.


Cleanup for registering package

Fix some docstrings
Throw desired error type
Improve some type propagation
Hopefully this package can be added to the general registry soon.  In anticipation of this, I've made a few cosmetic improvements.

Codecov Report
Patch coverage: 69.38% and project coverage change: -0.03 :warning:

Comparison is base (51cf5ca) 81.73% compared to head (215e463) 81.70%.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
Additional details and impacted files
@@            Coverage Diff             @@
##           master      #22      +/-   ##
==========================================
- Coverage   81.73%   81.70%   -0.03%
==========================================
  Files           1        1
  Lines         646      645       -1
==========================================
- Hits          528      527       -1
  Misses        118      118

Impacted Files
Coverage Δ

src/EllipticFunctions.jl
81.70% <69.38%> (-0.03%)
:arrow_down:

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

Why don't you like the @assert macro? I find it more readable than condition || throw(...).
See https://discourse.julialang.org/t/efficient-use-of-test-or-assert/75895/6


export_hf_checkpoint.py cannot be used as base model

Hi, thank for the library,
After finetune the model, I use this script export_hf_checkpoint.py to export hf model (the final result is 13GB on hf_ckpt directory), but cannot use it as independent model for generate.py to work, this is the error:
OSError: Can't load tokenizer for 'hf_ckpt'. If you were trying to load it from 'https://huggingface.co/models',
make sure you don't have a local directory with the same name. Otherwise, make sure 'hf_ckpt' is the correct path to
a directory containing all relevant files for a LlamaTokenizer tokenizer.

Has anyone also run into this? How did you fix it?

turn out it because of missing tokenizer, you can copy tokenizer from original model or create it with:
tokenizer.save_pretrained(f"{output_dir}")


Delete unused code & add tests

Description
What is this PR

[ ] Bug fix
[ ] Addition of a new feature
[x] Other

Why is this PR needed?
There is a lot of code in this repo that is no longer used by any BrainGlobe tool. Keeping it in the repo increases the maintenance burden.
What does this PR do?
Removes unused code and adds some more tests for what remains.
Also closes #12
How has this PR been tested?
Please explain how any new code has been tested, and how you have ensured that no existing functionality has changed.
Is this a breaking change?
Hopefully not. I've checked other BG repos for usage of deleted code, and nothing came up. This process isn't foolproof though, so we may just have to release and hope for the best! This is a fairly dangerous approach, so happy to hear of alternatives.
Does this PR require an update to the documentation?
If any features have changed, or have been added. Please explain how the documentation has been updated (and link to the associated PR). See here for details.
Checklist:

[x] The code has been tested locally
[x] Tests have been added to cover all new functionality (unit & integration)
[x] The documentation has been updated to reflect any changes
[x] The code has been formatted with pre-commit

@willGraham01 I've raised  https://github.com/brainglobe/brainglobe-utils/issues/19 Adding docstrings is something the entirety of BG sorely needs.

Thanks both. Going to release a new version, so yell at me if anything breaks!


Display patient with connected resources.  [base]/Patient/[id]/$everything

https://www.hl7.org/fhir/operation-patient-everything.html

That would be sufficient. Thank you.
Von: Alexander Kiel<EMAIL_ADDRESS>Gesendet: Mittwoch, 11. September 2019 10:16
An: life-research/blaze<EMAIL_ADDRESS>Cc: Wegehaupt, Marko<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Betreff: Re: [life-research/blaze] Display patient with connected resources. [base]/Patient/[id]/$everything (#33)
The Patient-everything operation isn't overly mature and the definition is vague.
@wegehauptmhttps://github.com/wegehauptm would it be sufficient for you to use normal search with revincludehttps://www.hl7.org/fhir/search.html#revinclude? Like [base]/Patient?_revinclude=Observation:subject?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/life-research/blaze/issues/33?email_source=notifications&email_token=AKKU6QF2DF3HFU6GEMUSYLDQJCSLNA5CNFSM4IVHSSZ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD6NVL3Y#issuecomment-530273775, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AKKU6QE7IRMFIJT5KVMSOD3QJCSLNANCNFSM4IVHSSZQ.


THIS PAGE MUST BE REMOVED IMMEDIATELY

There is no longer a team at Azure Dedicated to support Oracle workloads on Azure BareMetal Infrastructure (BMI).  They have either left the company, retired, or been re-assigned.  As a result, it is misleading and confusing to customers for this documentation to continue to be exposed publicly, so all mention of Oracle on BMI must be removed immediately.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 04fb7f5d-4e0d-3d43-60eb-78dc0e54ee6e
Version Independent ID: e653e14f-0387-5248-5613-a4469cd78b38
Content: High availability features for Oracle on Azure BareMetal - Azure Baremetal Infrastructure
Content Source: articles/baremetal-infrastructure/workloads/oracle/high-availability-features.md
Service: baremetal-infrastructure
Sub-service: baremetal-oracle
GitHub Login: @dineshga
Microsoft Alias: dineshga

@tigormanmsft Thank you for reporting this. We will work on this internally with the team and update.

@VikasPullagura-MSFT - please hold off on removing these pages.  Kalyan Kaki of the Azure Dedicated product group has stepped up to take responsibility for the pages, so please do nothing without his authorization.  Thank you!


modified ci/cd script - [closed]

In GitLab by @guyingyan on Jun 13, 2018, 03:24
Merges dev-cicd -> dev

In GitLab by @wknet123 on Nov 13, 2019, 11:05
The test coverage for backend is 25.2%  ,The test coverage for frontend is 38.11   , check  consolse log

In GitLab by @wknet123 on Nov 13, 2019, 11:05
The test coverage for backend is 25.2%  ,The test coverage for frontend is 38.11   , check  consolse log

In GitLab by @wknet123 on Nov 13, 2019, 11:05
The test coverage for backend is 25.2%  ,The test coverage for frontend is 38.11   , check  consolse log

In GitLab by @wknet123 on Nov 13, 2019, 11:05
The test coverage for backend is FAIL  ,The test coverage for frontend is 38.11   , check  consolse log

In GitLab by @wknet123 on Nov 13, 2019, 11:05
The test coverage for backend is 25.2%  ,The test coverage for frontend is 38.11   , check  consolse log

In GitLab by @wknet123 on Nov 13, 2019, 11:05
closed


feat(defi): nullable -> maybe undefined AccountId

Description

Notice

[ ] Have you followed the guidelines in our Contributing guide?
[ ] Have you checked to ensure there aren't other open Pull Requests for the same update/change?

Pull Request Type

[ ] :bug: Bug fix (Non-breaking Change: Fixes an issue)
[ ] :hammer_and_wrench: Chore (Non-breaking Change: Doc updates, pkg upgrades, typos, etc..)
[ ] :nail_care: New Feature (Breaking/Non-breaking Change)

Issue (if applicable)

closes #
Risk

Testing

Engineering

Operations

Screenshots (if applicable)

Current dependencies on/for this PR:

develop

PR #3273   👈

PR #3261

This comment was auto-generated by Graphite.


fix caddy imports

The code was not building for me. Using the github.com/coredns/caddy instead of the github.com/caddyserver/caddy works as expected.

what's the build error?

Sorry, I left out the important pieces.
I tried building from coredns with a current version (768307ef3046f86fe896d4a8bb80d693c9675a15). This throws the error
# github.com/jwhited/wgsd
../wgsd/setup.go:14:18: cannot use setup (type func(*"github.com/caddyserver/caddy".Controller) error) as type "github.com/coredns/caddy".SetupFunc in argument to plugin.Register
../wgsd/setup.go:45:21: cannot use c (type *"github.com/caddyserver/caddy".Controller) as type *"github.com/coredns/caddy".Controller in argument to dnsserver.GetConfig

Using v1.6.9 works or using the other approach (building from this repo here). So the "issue" is the version combination.
This PR can be closed or used as a version bump to make wgsd compatible with newer coredns.
Thanks for this cool plugin!


Problem of nrf8001

Hi,
I have a nrf8001 board form RedBearLab. And this chip is supported by UPM. I have tried the test programs nrf8001-broadcas and nrf8001-helloworld, but they can not work properly. I can not find the ble device from my smartphone. Does anyone have some idea ?

Hello,
Could you please give us more details about your setup? Do you have the Adafruit version of the sensor? What Intel IoT device and board are you using?
Thanks

Hi,
Thank you for your reply. I don't have the Adadruit version of the sensor. What I have is BLE Shield from RedBearLab. It is working OK with Arduino UNO.
I have Intel Edison Kit for Arduino.

About the setup. I have set the REQN to Pin 10 and RDYN to PIN 8 according to the example code

This driver is rather complex and also depends on the acilib library, thus any changes there might break it. I also believe it was developed using the Olimex version of the sensor which might be different from the RBL shield. Sadly, right now I don't have any nrf8001 available, but there are a few things I can suggest.
Since you mentioned it works on the Arduino UNO, try using the same driver with the Arduino SDK (1.6.4) on the Edison. There are also specific drivers from vendors or from Nordic Semiconductor themselves https://github.com/NordicSemiconductor/ble-sdk-arduino. If you can find a driver that works for the shield in Arduino mode on the Edison, then it may be possible to port and merge it with the existing driver.

I think no matter what version of the sensor. Both of them use the same nrf8001 chip, so there should be no different.
The driver from Nordic Semiconductor themselves https://github.com/NordicSemiconductor/ble-sdk-arduino can officially support BLE Shield. Every examples can run on Arduino UNO + BLE Shield. Because UPM driver of nrf8001 is also based on ble-sdk-arduino. It is reasonable to believe that UPM should also support BLE Shield.
Unfortunately ble-sdk-arduino can not be compiled in the Arduino SDK (1.6.4) for the Edison.

You're right, the UPM driver is basically just a port of ble-sdk-arduino that's using MRAA to setup the pins. Thus the only other things that come to mind, do you get any errors on initialization and what version of MRAA are you using?

I have a kernel complain:
spidev spi5.1: setup: unsupported mode bits 8

from
mraa_spi_lsbmode(spi, 0);

But it does not affect the SPI bus. Without it there is no error message.
I clone the latest code of MRAA and UPM from github into the Edison and compile and install directly.

So did you comment out that line from hal_aci_tl.cpp then? By default MRAA sets up SPI as msb first with
mraa_spi_lsbmode(dev, 0)
The nrf8001 driver also provides a REVERSE_BITS macro which is actually being used in m_aci_spi_transfer. This leads me to believe that with the current code the packets are possibly reversed twice leading back to the msb format which is not what the device expects. It's possible to check for this by adding debug code that dumps packet contents to the console.
This would also allow you to reference against the specsheet to see if the device initializes properly and that's the next place I would look into. Unfortunately I won't be able to help with that until I receive this sensor myself.

I've updated the list of known limitations with this and unfortunately I don't think it will work on the Intel Edison without a kernel patch addressing the SPI bus. The driver works as expected on Intel Galileo boards though.


Investigate Connection Pool Reuse

When using Fiddler it appears there is a new CONNECT tunneling request made each time a new request is sent. This adds performance overhead which should be investigated in fixing/improving.

@jianghaolu Would this have been resolved by updated to Reactor Netty 0.9.0?

This is by design - this is how HTTPS traffic gets through a proxy: https://en.wikipedia.org/wiki/HTTP_tunnel

About reusing though, reactor-netty 0.9.0 does change the default pool to a fixed size.

Closing as this is expected behavior.


is there a solution to set scrollable mode ?

i have 10 tabs and need to scrollable tab ! please help

You can use scrollview or recyclerview..

when (Material Tab) has a scrollable tab ! why i use custom scrollview ?

Sorry for that.. i didnt pay attention..
Here is a useful things that you can use..
http://www.androidhive.info/2015/09/android-material-design-working-with-tabs/

Ok ,thank you buddy .

i see PagerSlidingTabStrip his author extends his class to HorizontalScrollView !!!
oh no way ! i should use HorizontalScrollView .
Anyway thank you


[YUNIKORN-306] Add yunikorn rest api document

Work done:

added a new dropdown menu to the site ("API Documentation")
added three pages: Cluster, Scheduler and System that list all the available endpoints from scheduler/routes.go grouping them by first path item
used https://github.com/jamescooke/restapidocs for formatting, but I'm open to any suggestions if you have some problems

The examples are extracted via a locally running running a YK scheduler instance, and crawling the 9080 port on my laptop.

hi @adamantal  thanks for the patch, it looks pretty good.
I only have one minor comment about adjusting the sidebar order, but that can be done in a separate JIRA. Thanks!

Let me file a jira for that. What is your suggestion regarding the order?


data['category_id'] = self.cat_ids[label] IndexError: list index out of range

Greatly appreciated if anyone could help !!!
Checklist

I have searched related issues but cannot get the expected help.
yes
I have read the FAQ documentation but cannot get the expected help.
yes
The bug has not been fixed in the latest version.
maybe

Describe the bug
I was using a custom Cocodataset to run Swin-transformer-Object-Detection, where during training, an error occurred right after 1 epoch.
`
2022-02-13 23:46:06,781 - mmdet - INFO - workflow: [('train', 1)], max: 12 epochs
2022-02-13 23:46:06,781 - mmdet - INFO - Checkpoints will be saved to C:\tf\Swin-Transformer-Object-Detection-master\work_dirs\mask_rcnn_swin_tiny_patch4_window7_mstrain_480-800_adamw_1x_coco by HardDiskBackend.
 Please do not use them for anything important until they are released as stable. (Triggered internally at  ..\c10/core/TensorImpl.h:1156.)
return torch.max_pool2d(input, kernel_size, stride, padding, dilation, ceil_mode)
Gradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 32768.0
Gradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 16384.0
Gradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8192.0
[>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>] 20/20, 1.7 task/s, elapsed: 12s, ETA:     0sTraceback (most recent call last):
File "tools/train.py", line 187, in
main()

File "tools/train.py", line 176, in main
train_detector(

File "c:\tf\swin-transformer-object-detection-master\mmdet\apis\train.py", line 185, in train_detector
runner.run(data_loaders, cfg.workflow)

File "c:\tf\mmcv\mmcv\runner\epoch_based_runner.py", line 127, in run
epoch_runner(data_loaders[i], **kwargs)

File "c:\tf\mmcv\mmcv\runner\epoch_based_runner.py", line 54, in train
self.call_hook('after_train_epoch')

File "c:\tf\mmcv\mmcv\runner\base_runner.py", line 307, in call_hook
getattr(hook, fn_name)(self)

File "c:\tf\swin-transformer-object-detection-master\mmdet\core\evaluation\eval_hooks.py", line 147, in after_train_epoch
key_score = self.evaluate(runner, results)

File "c:\tf\swin-transformer-object-detection-master\mmdet\core\evaluation\eval_hooks.py", line 176, in evaluate
eval_res = self.dataloader.dataset.evaluate(

File "c:\tf\swin-transformer-object-detection-master\mmdet\datasets\coco.py", line 419, in evaluate
result_files, tmp_dir = self.format_results(results, jsonfile_prefix)

File "c:\tf\swin-transformer-object-detection-master\mmdet\datasets\coco.py", line 364, in format_results
result_files = self.results2json(results, jsonfile_prefix)

File "c:\tf\swin-transformer-object-detection-master\mmdet\datasets\coco.py", line 301, in results2json
json_results = self._segm2json(results)

File "c:\tf\swin-transformer-object-detection-master\mmdet\datasets\coco.py", line 252, in _segm2json
data['category_id'] = self.cat_ids[label]

IndexError: list index out of range
`
I had cloesly followed the Cocodataset format, the instances_train2017.json is like :
`
"images": [
    {

        "height": 1024,

        "width": 2048,

        "id": 0,

        "file_name": "1.jpg"

    },

    {

        "height": 1024,

        "width": 2048,

        "id": 1,

        "file_name": "10.jpg"

    },

    {

        "height": 1024,

        "width": 2048,

        "id": 2,

        "file_name": "100.jpg"

    },

    {

        "height": 1024,

        "width": 2048,

        "id": 3,

        "file_name": "101.jpg"

    },

    {

        "height": 1024,

        "width": 2048,

        "id": 4,

        "file_name": "102.jpg"

    },

    {

        "height": 1024,

        "width": 2048,

        "id": 5,

        "file_name": "103.jpg"

    },

    {

        "height": 1024,

        "width": 2048,

        "id": 6,

        "file_name": "104.jpg"

    },

    {

        "height": 1024,

        "width": 2048,

        "id": 7,

        "file_name": "105.jpg"

    },
    {

        "height": 1024,

        "width": 2048,

        "id": 8,

        "file_name": "106.jpg"

    },

`
(part of the file)
and the dataset category is :
`
"categories": [
{
"supercategory": "buckle",
"id": 0,
"name": "buckle"
},
{
"supercategory": "cable",
"id": 1,
"name": "cable"
},
{
"supercategory": "crack",
"id": 2,
"name": "crack"
},
{
"supercategory": "pit",
"id": 3,
"name": "pit"
},
{
"supercategory": "rail",
"id": 4,
"name": "rail"
},
{
"supercategory": "screw",
"id": 5,
"name": "screw"
},
{
"supercategory": "support",
"id": 6,
"name": "support"
}
],
`
and the classes in coco.py and class_names has been correctly modified, num_classes in mask_rcnn_swin_fpn.py is changed to 7. Earlier today I've tried another dataset with 5 labels, which worked properly. The only difference between two datasets is that the one worked has all .jpg and .json files in order, while the one failed begins with 1.json and next come to 10.json, which I think is fine because it matches the .img files.
Reproduction

What command or script did you run?
python tools/train.py configs/swin/mask_rcnn_swin_tiny_patch4_window7_mstrain_480-800_adamw_1x_coco.py
A placeholder for the command.

2. Did you make any modifications on the code or config?
  yes
Did you understand what you have modified?
  yes
3. What dataset did you use?
  Custom Coco Dataset

**Environment**

1. Please run `python mmdet/utils/collect_env.py` to collect necessary environment information and paste it here.
`fatal: not a git repository (or any of the parent directories): .git
sys.platform: win32
Python: 3.8.12 | packaged by conda-forge | (default, Oct 12 2021, 21:19:05) [MSC v.1916 64 bit (AMD64)]
CUDA available: True
GPU 0: GeForce RTX 3090
CUDA_HOME: C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.1
NVCC: Not Available
GCC: n/a
PyTorch: 1.9.0+cu111
PyTorch compiling details: PyTorch built with:
  - C++ Version: 199711
  - MSVC 192829337
  - Intel(R) Math Kernel Library Version 2020.0.2 Product Build 20200624 for Intel(R) 64 architecture applications
  - Intel(R) MKL-DNN v2.1.2 (Git Hash 98be7e8afa711dc9b66c8ff3504129cb82013cdb)
  - OpenMP 2019
  - CPU capability usage: AVX2
  - CUDA Runtime 11.1
  - NVCC architecture flags: -gencode;arch=compute_37,code=sm_37;-gencode;arch=compute_50,code=sm_50;-gencode;arch=compute_60,code=sm_60;-gencode;arch=compute_61,code=sm_61;-gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_75,code=sm_75;-gencode;arch=compute_80,code=sm_80;-gencode;arch=compute_86,code=sm_86;-gencode;arch=compute_37,code=compute_37
  - CuDNN 8.0.5
  - Magma 2.5.4
  - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=11.1, CUDNN_VERSION=8.0.5, CXX_COMPILER=C:/w/b/windows/tmp_bin/sccache-cl.exe, CXX_FLAGS=/DWIN32 /D_WINDOWS /GR /EHsc /w /bigobj -DUSE_PTHREADPOOL -openmp:experimental -IC:/w/b/windows/mkl/include -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DUSE_FBGEMM -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=1.9.0, USE_CUDA=ON, USE_CUDNN=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=OFF, USE_NNPACK=OFF, USE_OPENMP=ON,

TorchVision: 0.10.0+cu111
OpenCV: 4.5.5
MMCV: 1.3.17
MMCV Compiler: MSVC 192930140
MMCV CUDA Compiler: 11.1
MMDetection: 2.11.0+`

2. You may add addition that may be helpful for locating the problem, such as
    - How you installed PyTorch [e.g., pip, conda, source]
    - `pip install torch==1.9.0+cu111 torchvision==0.10.0+cu111 torchaudio==0.9.0 -f https://download.pytorch.org/whl/torch_stable.html`
    - Other environment variables that may be related (such as `$PATH`, `$LD_LIBRARY_PATH`, `$PYTHONPATH`, etc.)
no

**Error traceback**
`Traceback (most recent call last):

  File "tools/train.py", line 187, in <module>

    main()

  File "tools/train.py", line 176, in main

    train_detector(

  File "c:\tf\swin-transformer-object-detection-master\mmdet\apis\train.py", line 185, in train_detector

    runner.run(data_loaders, cfg.workflow)

  File "c:\tf\mmcv\mmcv\runner\epoch_based_runner.py", line 127, in run

    epoch_runner(data_loaders[i], **kwargs)

  File "c:\tf\mmcv\mmcv\runner\epoch_based_runner.py", line 54, in train

    self.call_hook('after_train_epoch')

  File "c:\tf\mmcv\mmcv\runner\base_runner.py", line 307, in call_hook

    getattr(hook, fn_name)(self)

  File "c:\tf\swin-transformer-object-detection-master\mmdet\core\evaluation\eval_hooks.py", line 147, in after_train_epoch

    key_score = self.evaluate(runner, results)

  File "c:\tf\swin-transformer-object-detection-master\mmdet\core\evaluation\eval_hooks.py", line 176, in evaluate

    eval_res = self.dataloader.dataset.evaluate(

  File "c:\tf\swin-transformer-object-detection-master\mmdet\datasets\coco.py", line 419, in evaluate

    result_files, tmp_dir = self.format_results(results, jsonfile_prefix)

  File "c:\tf\swin-transformer-object-detection-master\mmdet\datasets\coco.py", line 364, in format_results

    result_files = self.results2json(results, jsonfile_prefix)

  File "c:\tf\swin-transformer-object-detection-master\mmdet\datasets\coco.py", line 301, in results2json

    json_results = self._segm2json(results)

  File "c:\tf\swin-transformer-object-detection-master\mmdet\datasets\coco.py", line 252, in _segm2json

    data['category_id'] = self.cat_ids[label]

IndexError: list index out of range`

```none
A placeholder for trackback.

It would be great if anyone could help me solve this.

Ok, I found the problem.... The names of images in datasets should not begin with numbers.


Larbas can sometimes spawn behind walls if the spawner marine is stuck to them

Unsure how to replicate

I've witnessed several incidents that required admin intervention to fix otherwise the player would be stuck forever, possibly stalling the round (in the case of one stuck immature queen).

Figured it out, when warriors punch a host it launches them into the wall.

Fixed by the warrior punch fix


Eval on rewriter throws error

While running the below with with MODE='eval' for evaluation it throws error
sh scripts/eval_rewriter.sh
INFO:tensorflow:max_enc_steps: 400, max_dec_steps: 120
INFO:tensorflow:Loading checkpoint log/rewriter/exp_sample/train/model.ckpt-88000
INFO:tensorflow:Restoring parameters from log/rewriter/exp_sample/train/model.ckpt-88000
2019-01-31 10:14:56.590855: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Unsuccessful TensorSliceReader constructor: Failed to find any matching files for log/rewriter/exp_sample/train/model.ckpt-88000
2019-01-31 10:14:56.598651: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Unsuccessful TensorSliceReader constructor: Failed to find any matching files for log/rewriter/exp_sample/train/model.ckpt-88000
2019-01-31 10:14:56.601643: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Unsuccessful TensorSliceReader constructor: Failed to find any matching files for log/rewriter/exp_sample/train/model.ckpt-88000

It seems that the checkpoint path is wrong. You can check if the experiment name for evaluation is the same as training. Or maybe the training progress for 88000 iterations is not done so the checkpoint is not saved yet. Then the evaluation program will wait until the model is available.


Exception on paging through selection

I am still working on my backup script (see #21 ). As one would expect, I am recursively looping through the various directories in the directory structure (rather deep structures, up to approx. 10 levels with between 1 and a couple of hundred files per directory). Now, I ran into an issue where I am trying to get a collection page and the json decoder throws an exception. Some more trial and error eventually got me to realize that the supposed json-string for decoding is actually empty. Here is the call stack followed by the line which throws the error (please ignore my crude style of coding).
Traceback (most recent call last):

  File "<ipython-input-14-f4000242bd12>", line 1, in <module>
    debugfile('F:/IWU/Python_new/OneDriveUpdate.py', wdir='F:/IWU/Python_new')

  File "F:\Software\WinPython\python-3.4.3.amd64\lib\site-packages\spyderlib\widgets\externalshell\sitecustomize.py", line 808, in debugfile
    debugger.run("runfile(%r, args=%r, wdir=%r)" % (filename, args, wdir))

  File "F:\Software\WinPython\python-3.4.3.amd64\lib\bdb.py", line 431, in run
    exec(cmd, globals, locals)

  File "<string>", line 1, in <module>

  File "F:\Software\WinPython\python-3.4.3.amd64\lib\site-packages\spyderlib\widgets\externalshell\sitecustomize.py", line 786, in runfile
    execfile(filename, namespace)

  File "F:\Software\WinPython\python-3.4.3.amd64\lib\site-packages\spyderlib\widgets\externalshell\sitecustomize.py", line 87, in execfile
    exec(compile(open(filename, 'rb').read(), filename, 'exec'), namespace)

  File "f:/iwu/python_new/onedriveupdate.py", line 553, in <module>
    if not checkDirContent(rootDir, upDirID, posFilter):

  File "f:/iwu/python_new/onedriveupdate.py", line 278, in checkDirContent
    if not checkDirContent(localItem['path'], dirID, None, (localItem['name'] == 'Zotero'), (defaultDelete and localItem['name'] == 'storage')):

  File "f:/iwu/python_new/onedriveupdate.py", line 278, in checkDirContent
    if not checkDirContent(localItem['path'], dirID, None, (localItem['name'] == 'Zotero'), (defaultDelete and localItem['name'] == 'storage')):

  File "f:/iwu/python_new/onedriveupdate.py", line 241, in checkDirContent
    upParentItemsList = getParentItemsList(upParentDirID,dirPath)

  File "f:/iwu/python_new/onedriveupdate.py", line 100, in getParentItemsList
    upParentItemsList.append(client.item(id=str(upParentDirID)).children.request().get())

  File "F:\Software\WinPython\python-3.4.3.amd64\lib\site-packages\onedrivesdk\request\children_collection.py", line 90, in get
    collection_response = ChildrenCollectionResponse(json.loads(self.send().content))

  File "F:\Software\WinPython\python-3.4.3.amd64\lib\json\__init__.py", line 318, in loads
    return _default_decoder.decode(s)

  File "F:\Software\WinPython\python-3.4.3.amd64\lib\json\decoder.py", line 343, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())

  File "F:\Software\WinPython\python-3.4.3.amd64\lib\json\decoder.py", line 361, in raw_decode
    raise ValueError(errmsg("Expecting value", s, err.value)) from None

ValueError: Expecting value: line 1 column 1 (char 0)

The code (the essential bit; note I am creating a list of pages to retrieve all items, not just 200, for later use) --> second row causes exception:
        upItemsList = []
        upItemsList.append(client.item(id=str(upParentDirID)).children.request().get())
        while len(upParentItemsList[i]) == 200 and len(upParentItemsList[i]) != 0:
            # Loop while the count is 200 (last one will have less)
            upParentItemsList.append(upParentItemsList[i].next_page_request.get())
            i += 1

Eventual function which crashes is:
    def raw_decode(self, s, idx=0):
        """Decode a JSON document from ``s`` (a ``str`` beginning with
        a JSON document) and return a 2-tuple of the Python
        representation and the index in ``s`` where the document ended.

        This can be used to decode a JSON document from a string that may
        have extraneous data at the end.

        """
        try:
            obj, end = self.scan_once(s, idx)
        except StopIteration as err:
            raise ValueError(errmsg("Expecting value", s, err.value)) from None
        return obj, end

I hope this helps - and it's not really my fault to begin with.

It's hard to debug with the information you have here. Can you do me a favor and follow these steps?

Open F:\Software\WinPython\python-3.4.3.amd64\Lib\site-packages\onedrivesdk\http_provider.py
In send add these new lines:

    ...
        else:
            request = requests.Request(method,
                                       url,
                                       headers=headers,
                                       data=data,
                                       json=content)
            prepped = request.prepare()
            response = session.send(prepped)

        #Add these
        new_headers = dict(headers)
        if 'Authorization' in new_headers:
            del new_headers['Authorization']
        print(method, new_headers, url, data, content, sep='\n')
    ...

Re-run your code
Send me the info printed to your console.

This should give me some more insight into the issue.

Hey Chris,
I messed up at first and forgot the "new_headers = dict(headers)" line, so I replaced "new_headers" with "headers" in the following lines. I.e.:
        if 'Authorization' in headers:
            del headers['Authorization']
        print(method, headers, url, data, content, sep='\n')

After a number of successful listings, this yielded another error, just as yesterday. Note, I was using Spyder's debugging mode to be made aware when the issue occurred. This is the log (both first and second attempt to list directory):
GET
{'X-RequestStats': 'SDK-Version=python-v1.0.1'}
https://api.onedrive.com/v1.0/drive/items/93778B57A564E317!4120/children
None
None
Unknown Error: Failed to list directory: \Literatur\Conference.Proceedings\ASIM_SPL2013 --> Trying again.
> f:\iwu\python_new\onedriveupdate.py(120)getUpItemsList()
    119         L.printL('Unknown Error: Failed to list directory: {0} --> Trying again.'.format(dirPath[(len(rootDir)-len(dirPath)):]))
1-> 120         upItemsList = getUpItemsList(upParentDirID, dirPath, attempt+1)
    121     L.printL('List directory: {0} --> {1} pages'.format(dirPath[(len(rootDir)-len(dirPath)):],len(upItemsList)),False)

GET
{'X-RequestStats': 'SDK-Version=python-v1.0.1'}
https://api.onedrive.com/v1.0/drive/items/93778B57A564E317!4120/children
None
None
> f:\iwu\python_new\onedriveupdate.py(121)getUpItemsList()
1   120         upItemsList = getUpItemsList(upParentDirID, dirPath, attempt+1)
--> 121     L.printL('List directory: {0} --> {1} pages'.format(dirPath[(len(rootDir)-len(dirPath)):],len(upItemsList)),False)
    122     return upItemsList

Sure enough I noticed my error, and added the code as provided by you. I had to retry 5 times for the exception to be raised again - twice. Yesterday, it happened to me on basically every attempt to run the script. Anyhow, here is the log:
GET
{'X-RequestStats': 'SDK-Version=python-v1.0.1'}
https://api.onedrive.com/v1.0/drive/items/93778B57A564E317!4847/children
None
None
Unknown Error: Failed to list directory: \Literatur\Conference.Proceedings\LCE2013
> f:\iwu\python_new\onedriveupdate.py(121)getUpItemsList()
    120         L.printL('Unknown Error: Failed to list directory: {0}'.format(dirPath[(len(rootDir)-len(dirPath)):]))
1-> 121         upItemsList= getUpItemsList(upParentDirID, dirPath, attempt+1)
    122     L.printL('List directory: {0} --> {1} pages'.format(dirPath[(len(rootDir)-len(dirPath)):],len(upItemsList)),False)

Trying again.
GET
{'X-RequestStats': 'SDK-Version=python-v1.0.1'}
https://api.onedrive.com/v1.0/drive/items/93778B57A564E317!4847/children
None
None
> f:\iwu\python_new\onedriveupdate.py(122)getUpItemsList()
1   121         upItemsList= getUpItemsList(upParentDirID, dirPath, attempt+1)
--> 122     L.printL('List directory: {0} --> {1} pages'.format(dirPath[(len(rootDir)-len(dirPath)):],len(upItemsList)),False)
    123     return upItemsList

[...]

GET
{'X-RequestStats': 'SDK-Version=python-v1.0.1'}
https://api.onedrive.com/v1.0/drive/items/93778B57A564E317!6564/children
None
None
Unknown Error: Failed to list directory: \papers\04_GCSM 2012\--- Erstellung ---
> f:\iwu\python_new\onedriveupdate.py(121)getUpItemsList()
    120         L.printL('Unknown Error: Failed to list directory: {0}'.format(dirPath[(len(rootDir)-len(dirPath)):]))
1-> 121         upItemsList= getUpItemsList(upParentDirID, dirPath, attempt+1)
    122     L.printL('List directory: {0} --> {1} pages'.format(dirPath[(len(rootDir)-len(dirPath)):],len(upItemsList)),False)

ipdb>
Trying again.
GET
{'X-RequestStats': 'SDK-Version=python-v1.0.1'}
https://api.onedrive.com/v1.0/drive/items/93778B57A564E317!6564/children
None
None

Something else I noticed: While the error occurred for different directory-items most (not all) were situated in the root\Dokumente\Backup\Literatur\Conference.Proceedings\ path of my OneDrive account. Maybe this is of any significance.
Regards,
Stulle

Hello Stulle,
I looked over your code a few times and I can't peg the issue from the information you gave me here. I did notice, though, that your method for paging through the children collection isn't the recommended way. Check out "Paging Through a Collection" in the Readme. Specifically, you should be using collection.next_page_request.get().
In addition, make sure you grab the newest version of the SDK (currently 1.0.4) using pip. If you are still having issues after making those changes, come on back.
-Chris

Hey Chris,
I am a bit uncertain. I understood the sample in the way that I should use the last collection (page) to get next collection (page). That would be in pseudo-code: collection{n} = collection{n-1}.next_page_request.get().
Are you suggesting it is actually collection{n} = collection{0}.next_page_request.get()?
I will be sure to try a more recent version of the SDK as soon as I get to it.
Regards,
Stulle

What you have in the most recent comment is correct. I must have misread your code.

Hi Chris,
just to let you know: It happened again on a directory/folder with only one page (less than 200 items) and then again twice in a directory with 433 files. I previously downloaded the most recent master of the SDK.
Prolly one more note: I am using a Windows machine and WinPython 3.4.3.xQt5 (I'd say it's <IP_ADDRESS> but I cannot be 100 % certain). I'll try getting a more recent version and keep you posted if anything changes.
Regards,
Stulle

Hi again,
So... using a more recent version did not change a thing. WinPython-64bit-<IP_ADDRESS>Qt5 also produced an exception on a directory with one page (less than 200 items). I vote for a server- or connection-based error.
Is there anything else I can do to help you guys at Microsoft (not just in the python SDK but also elsewhere) to resolve the issue?
Regards,
Stulle

Yes, there is. I think we need more information about what's going on here. Please follow these steps:

Login to your OneDrive
Go to https://storage.live.com/traceme
Select both the checkboxes in the "AutoFiddler" column
Click on "Start a new trace..." in both rows
Wait for about 1 minute
Retry the scenario until you get the error
Copy all the information in the table and send it back to me

Hi Chris,
I did like you asked. Here is the information:
Type

AutoFiddler

XTraceMe

Path

AzureShare

AzurePath

Expiration

Extend/Remove

Calls I make
☑

☐
\93778B57A564E317\2016-03-09_000614  93778B57A564E317\2016-03-09_000614 expired [extend]    [remove]
Calls against my data
☑

☐
\93778B57A564E317\2016-03-09_000546  93778B57A564E317\2016-03-09_000546 expired [extend]    [remove] ```

I started the script on 2016-03-09T09:07:38.897408 (all time stamps are CET) The error occurred between 2016-03-09T09:14:44.048376 and 2016-03-09T09:15:11.006261. The successful retry was completed on 2016-03-09T09:15:17.392586. The path in my drive is `root\Dokumente\{Some Abbreviation}\Literatur\Conference.Proceedings\ASIM_SPL2008\en` (I replaced one directory name for privacy reasons).

I hope it helps. Let me know if there is anything else I could do.

Regards,
Stulle

I looked through your call information. None of the calls appear to fail on the server, and their responses are valid. Something else must be at play here.
I would like to get more information about what you're getting back from the server. Please follow these steps:

In the same HttpProvider file, please add this line in send:

        custom_response = HttpResponse(response.status_code, response.headers, response.text)
        print("Response", response.status_code, response.headers, sep='\n') #Add just this line
        return custom_response

Make sure you also have the lines that gave you before. This way we'll have both the requset and response.
Send me back the stuff that gets printed to the console for just the request that failed.

I'm sorry it's taking so much effort to debug this. We'll get to the bottom of it!

Hey Chris,
Never mind the effort this takes. I am happy as long as I can help improve things. So, here you go. First my logging:
2016-03-11T09:12:49.229516 : Unknown Error: Failed to list directory: \Literatur\Conference.Proceedings\ASIM_SPL2008\Enterprise Dynamics\Movies
2016-03-11T09:12:50.229216 : Trying again.
2016-03-11T09:12:51.220914 : List directory: \Literatur\Conference.Proceedings\ASIM_SPL2008\Enterprise Dynamics\Movies --> 1 pages

Now yours:
GET
{'X-RequestStats': 'SDK-Version=python-v1.0.4'}
https://api.onedrive.com/v1.0/drive/items/93778B57A564E317!3889/children
None
None
Response
502
{'Date': 'Fri, 11 Mar 2016 08:12:35 GMT', 'X-AsmVersion-ProxyApp': 'UNKNOWN; <IP_ADDRESS>', 'X-ProxyErrorDetail': 'Proxy_GetResponse_ConnectFailure', 'Content-Length': '0', 'Via': '1.1 DM2301____PAP243 (wls-colorado)', 'Server': 'Microsoft-HTTPAPI/2.0', 'X-ClientErrorCode': 'ProxyFail', 'X-WLSPROXY': 'DM2301____PAP243'}

Unknown Error: Failed to list directory: \Literatur\Conference.Proceedings\ASIM_SPL2008\Enterprise Dynamics\Movies
ipdb> Trying again.

GET
{'X-RequestStats': 'SDK-Version=python-v1.0.4'}
https://api.onedrive.com/v1.0/drive/items/93778B57A564E317!3889/children
None
None
Response
200
{'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'X-MSEdge-Ref': 'Ref A: F40DA322CF09415CAA6A92958E2B817B Ref B: E07FBCD9EE0EAD5A55AA2CC05DF481F4 Ref C: Fri Mar 11 00:12:50 2016 PST', 'X-AsmVersion': 'UNKNOWN; <IP_ADDRESS>', 'Server': 'Microsoft-IIS/8.5 Microsoft-HTTPAPI/2.0', 'P3P': 'CP="BUS CUR CONo FIN IVDo ONL OUR PHY SAMo TELo"', 'OData-Version': '4.0', 'Date': 'Fri, 11 Mar 2016 08:12:50 GMT', 'Content-Type': 'application/json; odata.metadata=minimal; odata.streaming=true', 'Content-Length': '1442', 'Via': '1.1 DM2301____PAP099 (wls-colorado)', 'X-MSNSERVER': 'CH3301____PAP226', 'X-WLSPROXY': 'DM2301____PAP099'}

I noticed the "Proxy_GetResponse_ConnectFailure"... So I have been trying this from my workstation in the office (which connects through a local proxy) and my private laptop connected to my company network through a Cisco AnyConnect VPN connection. I might have tried this at home when connecting through a cable broadband rooter but I cannot say for sure. Anyhow, I could try that again later today, just let me know.
Regards,
Stulle

Well, I have good news and bad news, depending on how you interpret it. Good news: we have narrowed down the source of the issue. It's our problem, not yours. Bad news: there's nothing you can do right now to make it better; you'll have to wait for us to fix it. Good news: you should be able to just retry the request and see it succeed. I would recommend adding targeted retry logic until we have fixed the issue - retry the request when you see HTTP 502 with X-ClientErrorCode: ProxyFail. That should put a bandage on the issue until we get it fixed on our end.
Thanks for all the help getting us information! I may ask you for more soon, otherwise I'll leave this open until we close the issue on our end.

Hey Chris,
Thank you for the feedback. I'm glad you guys finally found the error. Just let me know as soon as you need more testing, I'll be sure to give it a shot ASAP. Anyhow, judging from your reply - I reckon this is prolly going to take a wee bit. :-)
Regards,
Stulle

Closing because the issue isn't really what's in the title. Also, this isn't an issue with the Python SDK. If this is still occurring, open a similar issue in the OneDrive API Docs repo.


Checking failed with rule 'assume': term was not in original problem's assumptions

Hi,
When trying to check the proof produced by cvc5 for the files in ex.zip, I get the following error:
[ERROR] checking failed on step 'a2' with rule 'assume': term '(and (and (inv_main5 H K A J L) (and (= G 0) (= F A) (= E H) (= D 0) (= C B) (= N J) (= M K) (<= 1 B) (or (and (<= 1 B) (= D 1)) (and (not (<= 1 B)) (= D 0))) (= I 0) (= v_14 D))) (not (inv_main21 E M F N C I G D v_14)))' was not in original problem's assumptions
invalid

The only difference I can see between the term assumed in the proof and the one asserted in the .smt2 file is the inlining of the let statement. I'm running cvc5 v1.0.5 and carcara v1.0.0, CLI commands below.
cvc5 --produce-proofs --proof-format=alethe --proof-granularity=theory-rewrite --flatten-ho-chains ex.smt2
carcara check --skip-unknown-rules --allow-int-real-subtyping ex.proof ex.smt2

Hi @HanielB, thanks for the response and the explanation. Using the option you mentioned does fix the issue. Since there is an interplay between cvc5 and carcara, this was not obvious to me.


原来顺利运行的，突然报错step1

[Step 1] Landmarks Extraction in Video.
Traceback (most recent call last):
File "inference.py", line 342, in
main()
File "inference.py", line 78, in main
kp_extractor = KeypointExtractor()
File "C:\Users\Qiyun\video-retalking\third_part\face3d\extract_kp_videos.py", line 16, in init
self.detector = face_alignment.FaceAlignment(face_alignment.LandmarksType._2D)
File "C:\Users\Qiyun\miniconda3\envs\video_retalking\lib\enum.py", line 384, in getattr
raise AttributeError(name) from None
AttributeError: _2D

Same issue, that something wrong with new version of some package, bc initial one worked fine.


console stuck on 'Building docker image' when installing SAM CPU integration on self hosted CVAT

My actions before raising this issue

[x] Read/searched the docs
[x] Searched past issues
[ ]searched https://stackoverflow.com/questions/58600717/docker-gets-stuck-on-building-and-other-commands
[x] reinstalling everything, following instructions here and here and here

-- also tried downgrading Nuclio to 1.11.19  > but same problem happens

Steps to Reproduce (for bugs)

installed CVAT on windows 11 following instructions
installed Nuclio 1.8.14
console got stuck when running the instructions for installing SAM for CPU

Expected Behaviour

Current Behaviour

console is stuck on
23.06.11 15:31:39.755            nuctl.platform (I) Building docker image {"image": "cvat.pth.facebookresearch.sam.vit_h:latest"}

How much time should it take? maybe I'm not waiting enough? waited about 30 min.
Your Environment

Docker version : 4.20.1
Operating System and version (e.g. Linux, Windows, MacOS): win11 with WSL2 running Ubunto
Other diagnostic information / logs:

snapshot from  Nuclio:

snap from docker (there is no image for SAM):

when opening CVAT I see and can use the SAM tool but this error pops up when waiting for the mask:

It mainly depends on your internet connection and the load of the SAM-Download-Servers. To build the docker image the vit_b checkpoint is downloaded which is 2,4GB in size. This sometimes takes a while.

works!
I just had a terrible network.
Thanks a lot!
remember to run
docker compose -f docker-compose.yml -f components/serverless/docker-compose.serverless.yml up -d
otherwise the magic wand symbol won't come up.


Remove vendored dependency

I can confirm that PFS, installed against a PKS install with internal UAA enabled, still works with this change.


Frontend: Time tracking page of PTO module

Notion
https://www.notion.so/saeloun/Frontend-Time-tracking-page-of-PTO-module-6f30d3ccdbc942d580cf50736d3515bc
What

Added the time-off entry form and ensured the user can create, update, delete, and create a duplicate entry.
Handled minor frontend edge cases.
Fixed minor bugs in update, delete time-off entry API.

@sanjibroy360 This is not looking good. We don't have second dropdown so its looking odd.

@sanjibroy360 This is not looking good. We don't have second dropdown so its looking odd.

Done ✅
Preview:  https://youtu.be/IwV49S-JnOg
cc: @apoorv1316

@apoorv1316 Please test the changes now


pypi/conda hosting

It'd be nice to host this package on pypi (and/or conda forge?).
I'm not sure if there's anything in particular we need to do about the TensorFlow dependency.  It looks like pypi has an up-to-date version of TF.
However, it's not clear whether that provides GPU support.  There's also this, but that looks like it just has a Windows wheel at the moment...

I think we should go for a pip package now even though there might be some issues with TF support. For most users, this is good enough and if they need to do GPU things, they probably know how to set things up anyways.

Also, looks like they have a gpu specific pypy package now
https://pypi.python.org/pypi/tensorflow-gpu

@mheilman ping on this one. thoughts?

making a pypi package seems like a good idea

Mmmmk. I will try and take a first pass at this, but I am a pypi package noob.

Maybe we should push the version we have to pip before upgrading TF in #30? Might be good for dependencies etc.

Done. https://pypi.python.org/pypi?name=muffnn&version=0.2.0&:action=display


Add CSS for images

Add CSS rule for images- probably need to add an id or class to all images to which we want this rule applied. Currently, we do this:
<img src="{{ 'images/v2.1/image-name.png' | relative_url }}" alt="Alternative Text Here" style="border:1px solid #eee;max-width:100%" />

cc @jseldess @rmloveland @Amruta-Ranade

Is there any more info on this issue?


import _pywrap_tensorflow ModuleNotFoundError: No module named '_pywrap_tensorflow'

Hello,  I know already a few had a similar problem. But I just don't get it fixed.
This is my error:
Import tensorflow
`Traceback (most recent call last):
File "C:\Users\danyb\AppData\Local\Programs\Python\Python36-32\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 18, in swig_import_helper
fp, pathname, description = imp.find_module('_pywrap_tensorflow', [dirname(file)])
File "C:\Users\danyb\AppData\Local\Programs\Python\Python36-32\lib\imp.py", line 297, in find_module
raise ImportError(_ERR_MSG.format(name), name=name)
ImportError: No module named '_pywrap_tensorflow'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:\Users\danyb\AppData\Local\Programs\Python\Python36-32\lib\site-packages\tensorflow\python_init_.py", line 54, in
from tensorflow.python import pywrap_tensorflow
File "C:\Users\danyb\AppData\Local\Programs\Python\Python36-32\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 28, in
_pywrap_tensorflow = swig_import_helper()
File "C:\Users\danyb\AppData\Local\Programs\Python\Python36-32\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 20, in swig_import_helper
import _pywrap_tensorflow
ModuleNotFoundError: No module named '_pywrap_tensorflow'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "", line 1, in
File "C:\Users\danyb\AppData\Local\Programs\Python\Python36-32\lib\site-packages\tensorflow_init_.py", line 24, in
from tensorflow.python import *
File "C:\Users\danyb\AppData\Local\Programs\Python\Python36-32\lib\site-packages\tensorflow\python_init_.py", line 60, in
raise ImportError(msg)
ImportError: Traceback (most recent call last):
File "C:\Users\danyb\AppData\Local\Programs\Python\Python36-32\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 18, in swig_import_helper
fp, pathname, description = imp.find_module('_pywrap_tensorflow', [dirname(file)])
File "C:\Users\danyb\AppData\Local\Programs\Python\Python36-32\lib\imp.py", line 297, in find_module
raise ImportError(_ERR_MSG.format(name), name=name)
ImportError: No module named '_pywrap_tensorflow'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:\Users\danyb\AppData\Local\Programs\Python\Python36-32\lib\site-packages\tensorflow\python_init_.py", line 54, in
from tensorflow.python import pywrap_tensorflow
File "C:\Users\danyb\AppData\Local\Programs\Python\Python36-32\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 28, in
_pywrap_tensorflow = swig_import_helper()
File "C:\Users\danyb\AppData\Local\Programs\Python\Python36-32\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 20, in swig_import_helper
import _pywrap_tensorflow
ModuleNotFoundError: No module named '_pywrap_tensorflow'
Error importing tensorflow.  Unless you are using bazel,
you should not try to import tensorflow from its source directory;
please exit the tensorflow source tree, and relaunch your python interpreter
from there.`

Thank you for your post. We noticed you have not filled out the following field in the issue template. Could you update them if they are relevant in your case, or leave them as N/A? Thanks.
Have I written custom code
OS Platform and Distribution
TensorFlow installed from
TensorFlow version
Bazel version
CUDA/cuDNN version
GPU model and memory
Exact command to reproduce

It has been 16 days with no activity and the awaiting response label was assigned. Is this still an issue?

It has been 31 days with no activity and the awaiting response label was assigned. Is this still an issue?

We are closing this issue for now due to lack of activity. Please comment if this is still an issue for you. Thanks!


Compilation error on Windows

Similar to issue https://github.com/BLAKE3-team/BLAKE3/issues/79, I'm getting compilation errors when building blake3 v0.3.7 on Windows:
[2021-01-13T09:05:58.008Z] The following warnings were emitted during compilation:
[2021-01-13T09:05:58.008Z]
[2021-01-13T09:05:58.008Z] warning: The C compiler "C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\VC\\bin\\amd64\\cl.exe" does not support /arch:AVX512.
[2021-01-13T09:05:58.008Z]
[2021-01-13T09:05:58.008Z] error: failed to run custom build command for `blake3 v0.3.7`
[2021-01-13T09:05:58.008Z]
[2021-01-13T09:05:58.008Z] Caused by:
[2021-01-13T09:05:58.008Z]   process didn't exit successfully: `C:\Users\ci\AppData\Local\Temp\cargo-installMihItV\release\build\blake3-98f585247d671863\build-script-build` (exit code: 1)
[2021-01-13T09:05:58.008Z]   --- stdout
[2021-01-13T09:05:58.008Z]   cargo:rerun-if-env-changed=CARGO_FEATURE_PURE
[2021-01-13T09:05:58.008Z]   TARGET = Some("x86_64-pc-windows-msvc")
[2021-01-13T09:05:58.008Z]   HOST = Some("x86_64-pc-windows-msvc")
[2021-01-13T09:05:58.008Z]   CC_x86_64-pc-windows-msvc = None
[2021-01-13T09:05:58.008Z]   CC_x86_64_pc_windows_msvc = None
[2021-01-13T09:05:58.008Z]   HOST_CC = None
[2021-01-13T09:05:58.008Z]   CC = None
[2021-01-13T09:05:58.008Z]   CFLAGS_x86_64-pc-windows-msvc = None
[2021-01-13T09:05:58.008Z]   CFLAGS_x86_64_pc_windows_msvc = None
[2021-01-13T09:05:58.008Z]   HOST_CFLAGS = None
[2021-01-13T09:05:58.008Z]   CFLAGS = None
[2021-01-13T09:05:58.008Z]   CRATE_CC_NO_DEFAULTS = None
[2021-01-13T09:05:58.008Z]   CARGO_CFG_TARGET_FEATURE = Some("fxsr,sse,sse2")
[2021-01-13T09:05:58.008Z]   OPT_LEVEL = Some("3")
[2021-01-13T09:05:58.008Z]   CC_x86_64-pc-windows-msvc = None
[2021-01-13T09:05:58.008Z]   CC_x86_64_pc_windows_msvc = None
[2021-01-13T09:05:58.008Z]   HOST_CC = None
[2021-01-13T09:05:58.008Z]   CC = None
[2021-01-13T09:05:58.008Z]   CFLAGS_x86_64-pc-windows-msvc = None
[2021-01-13T09:05:58.008Z]   CFLAGS_x86_64_pc_windows_msvc = None
[2021-01-13T09:05:58.008Z]   HOST_CFLAGS = None
[2021-01-13T09:05:58.008Z]   CFLAGS = None
[2021-01-13T09:05:58.008Z]   CRATE_CC_NO_DEFAULTS = None
[2021-01-13T09:05:58.009Z]   CARGO_CFG_TARGET_FEATURE = Some("fxsr,sse,sse2")
[2021-01-13T09:05:58.009Z]   DEBUG = Some("false")
[2021-01-13T09:05:58.009Z]   cargo:warning=The C compiler "C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\VC\\bin\\amd64\\cl.exe" does not support /arch:AVX512.
[2021-01-13T09:05:58.009Z]   cargo:rerun-if-env-changed=BLAKE3_CI
[2021-01-13T09:05:58.009Z]   cargo:rerun-if-env-changed=CARGO_FEATURE_PREFER_INTRINSICS
[2021-01-13T09:05:58.009Z]   cargo:rerun-if-env-changed=CARGO_FEATURE_PURE
[2021-01-13T09:05:58.009Z]   cargo:rustc-cfg=blake3_sse2_ffi
[2021-01-13T09:05:58.009Z]   cargo:rustc-cfg=blake3_sse41_ffi
[2021-01-13T09:05:58.009Z]   cargo:rustc-cfg=blake3_avx2_ffi
[2021-01-13T09:05:58.009Z]   TARGET = Some("x86_64-pc-windows-msvc")
[2021-01-13T09:05:58.009Z]   OPT_LEVEL = Some("3")
[2021-01-13T09:05:58.009Z]   HOST = Some("x86_64-pc-windows-msvc")
[2021-01-13T09:05:58.009Z]   CC_x86_64-pc-windows-msvc = None
[2021-01-13T09:05:58.009Z]   CC_x86_64_pc_windows_msvc = None
[2021-01-13T09:05:58.009Z]   HOST_CC = None
[2021-01-13T09:05:58.009Z]   CC = None
[2021-01-13T09:05:58.009Z]   CFLAGS_x86_64-pc-windows-msvc = None
[2021-01-13T09:05:58.009Z]   CFLAGS_x86_64_pc_windows_msvc = None
[2021-01-13T09:05:58.009Z]   HOST_CFLAGS = None
[2021-01-13T09:05:58.009Z]   CFLAGS = None
[2021-01-13T09:05:58.009Z]   CRATE_CC_NO_DEFAULTS = None
[2021-01-13T09:05:58.009Z]   CARGO_CFG_TARGET_FEATURE = Some("fxsr,sse,sse2")
[2021-01-13T09:05:58.009Z]   DEBUG = Some("false")
[2021-01-13T09:05:58.009Z]   running: "C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\VC\\bin\\amd64\\ml64.exe" "-nologo" "-FoC:\\Users\\ci\\AppData\\Local\\Temp\\cargo-installMihItV\\release\\build\\blake3-86dd5a2a633273e8\\out\\c/blake3_sse2_x86-64_windows_msvc.o" "-c" "c/blake3_sse2_x86-64_windows_msvc.asm"
[2021-01-13T09:05:58.009Z]    Assembling: c/blake3_sse2_x86-64_windows_msvc.asm
[2021-01-13T09:05:58.009Z]   c/blake3_sse2_x86-64_windows_msvc.asm(2057)pecified size
[2021-01-13T09:05:58.009Z]   c/blake3_sse2_x86-64_windows_msvc.asm(2057) : error A2070:invalid instrucc/blake3_sse2_x86-64_windows_msvc.asm(2058)pecified size
[2021-01-13T09:05:58.009Z]   c/blake3_sse2_x86-64_windows_msvc.asm(2058) : error A2070:invalid instrucc/blake3_sse2_x86-64_windows_msvc.asm(2189)pecified size
[2021-01-13T09:05:58.009Z]   c/blake3_sse2_x86-64_windows_msvc.asm(2189) : error A2070:invalid instrucc/blake3_sse2_x86-64_windows_msvc.asm(2190)pecified size
[2021-01-13T09:05:58.009Z]   c/blake3_sse2_x86-64_windows_msvc.asm(2190) : error A2070:invalid instrucexit code: 1
[2021-01-13T09:05:58.009Z]   running: "C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\VC\\bin\\amd64\\ml64.exe" "-nologo" "-FoC:\\Users\\ci\\AppData\\Local\\Temp\\cargo-installMihItV\\release\\build\\blake3-86dd5a2a633273e8\\out\\c/blake3_sse41_x86-64_windows_msvc.o" "-c" "c/blake3_sse41_x86-64_windows_msvc.asm"
[2021-01-13T09:05:58.009Z]    Assembling: c/blake3_sse41_x86-64_windows_msvc.asm
[2021-01-13T09:05:58.009Z]   c/blake3_sse41_x86-64_windows_msvc.asm(1820)specified size
[2021-01-13T09:05:58.009Z]   c/blake3_sse41_x86-64_windows_msvc.asm(1820) : error A2070:invalid instruc/blake3_sse41_x86-64_windows_msvc.asm(1821)specified size
[2021-01-13T09:05:58.009Z]   c/blake3_sse41_x86-64_windows_msvc.asm(1821) : error A2070:invalid instruc/blake3_sse41_x86-64_windows_msvc.asm(1941)specified size
[2021-01-13T09:05:58.009Z]   c/blake3_sse41_x86-64_windows_msvc.asm(1941) : error A2070:invalid instruc/blake3_sse41_x86-64_windows_msvc.asm(1942)specified size
[2021-01-13T09:05:58.009Z]   c/blake3_sse41_x86-64_windows_msvc.asm(1942) : error A2070:invalid instruexit code: 1

I'm actually trying to build sccache 0.2.15, and blake3 is a dependency (or transient dependency?) of that, so forgive me for my unfamiliarity with this project. I've checked the open issues/PRs and didn't see this reported yet.

This doesn't look like it has much to do with AVX-512 at all; the build script detects that VS2015 doesn't support it, and doesn't include it in the build.
What is ultimately failing is VS2015's MASM inability to recognize movq xmm, r64 as a valid instruction; it only recognizes movd. A quick fix would be to mechanically replace movq by movd in the affected lines.

This doesn't look like it has much to do with AVX-512 at all; the build script detects that VS2015 doesn't support it, and doesn't include it in the build.
What is ultimately failing is VS2015's MASM inability to recognize movq xmm, r64 as a valid instruction; it only recognizes movd. A quick fix would be to mechanically replace movq by movd in the affected lines.

Ah sorry, that wasn't obvious to me from the compiler output. I'll rename this issue to something less specific.

Ah sorry, that wasn't obvious to me from the compiler output. I'll rename this issue to something less specific.

3a8204f5f38109aae08f4ae58b275663e1cfebab should have made this not fail, but I do not have a VS 2015 handy to check.

3a8204f5f38109aae08f4ae58b275663e1cfebab should have made this not fail, but I do not have a VS 2015 handy to check.

@sneves Thanks for the quick fix! I will try to setup a VM to test your change.

@sneves Thanks for the quick fix! I will try to setup a VM to test your change.

@sneves Ok, I have verified that 3a8204f5f38109aae08f4ae58b275663e1cfebab now compiles with VS2015. Thanks again!

@sneves Ok, I have verified that 3a8204f5f38109aae08f4ae58b275663e1cfebab now compiles with VS2015. Thanks again!

I was just bitten by this, because I'm also on VS2015 and any blake3 version >= 0.3.1 doesn't build for me.
Could you please release a new version on crates.io that includes this fix? :)

@Boscop sorry for the delay. The next release is likely to be 1.0, and I've been waiting until I have a chunk of time to go over everything and make sure the whole API is in good shape. If this is a major blocker for you, though, we could cherry-pick it onto a patch release branch as a workaround?

It's fine, I just depend on the git version for now :)

@oconnor663 Actually, it is a problem, because I cannot cargo install trunk because it fails with the same error.
If there was a new blake3 version with this fix, cargo would fetch that instead.
So could you please release a new version with this fix? :)

@Boscop ok I'm going to stop dragging my feet and just release 1.0. Could you help me test that this branch works for you?

Thanks, I'll test it soon.
But it would be nice to have a semver-compatible version with the fix, so that cargo will automatically pull them it I depend on crates that transitively depend on blake3 (which is the case with several crates).
Otherwise it requires waiting more time until the other crates bump blake3 to 1.0.
But I understand if it's not easy to create a branch that only contains this fix and no API changes..

@Boscop I think it's doable. I just put up a new branch, where I've cherry-picked just the changes from master that fix bugs in C and assembly files. (These are all build bugs, not get-the-wrong-answer bugs, as far as I know.) Could you see if this branch works for you: https://github.com/BLAKE3-team/BLAKE3/tree/release_0.3.8

@oconnor663 Thanks a lot, I just tested that branch, and it works!
I tested it by building this with:
[patch.crates-io]
blake3 = { git = "https://github.com/BLAKE3-team/BLAKE3", branch = "release_0.3.8" }

on Win 8.1 with Visual Studio 2015.

@Boscop I just released 0.3.8. Please let me know if cargo install trunk looks good under VS2015, when you get a chance.

@oconnor663 Yes, it worked, thanks!
Btw, I'm also using blake3 directly in a project, and because of VS2015 and because of my old CPU it won't be able to use AVX-512.
I'm regularly hashing thousands of small files (avg size 45 kb) for indexing purposes, is there a way to speed it up?
The docs say that enabling rayon usage doesn't make sense below 128 kb.
Would it help to memory map each file, or to have more threads than cores for parallel hash computation?
I'm using this function:
fn hash_file(path: impl AsRef<Path>) -> io::Result<Vec<u8>> {
	use blake3::Hasher;

	const BLOCKSIZE: usize = 16 * 1024; // 16 KiB supports all SIMD instruction sets

	let mut buf = [0u8; BLOCKSIZE];
	let mut file = File::open(path)?;
	let mut hasher = Hasher::new();
	loop {
		match file.read(&mut buf)? {
			0 => break,
			n => {
				hasher.update(&buf[.. n]);
			}
		}
	}
	Ok(hasher.finalize().as_bytes().to_vec())
}

Also, is there a way to compile my exe so that it will use runtime detection of SIMD features, so that it uses AVX-512 when running on a CPU that supports that? (If I compile it with the latest VS2019)
Btw, would it still run on CPUs that don't support AVX-512 if I compile it on a CPU that supports it?

Would it help to memory map each file, or to have more threads than cores for parallel hash computation?

I haven't done much work with lots of small files. My instinct is that hashing speed is less likely to be your bottleneck than disk read or directory traversal speed. You might want to look into some of the strategies that ripgrep uses to read lots of small files quickly. (I think the walkdir crate might be involved one way or another.) On the other hand, having a ton of threads reading lots of different directories might thrash a spinning disk if nothing is in cache. You might want to decide up-front about whether you care about benchmarking the cold cache case, or exclusively the hot cache case. (Notably I think burntsushi focused on hot cache benchmarks in his famous ripgrep post.)
b3sum uses 16 KiB as a hard cutoff (based on only a little bit of by-hand testing) below which it doesn't even attempt to memory-map files. At some point the overhead of mapping files (which is larger than that of a single read) starts to outweigh the gains. If you're at ~45 KiB, my wild guess is that you might see some mild-but-probably-not-impressive gains from memory mapping. Another thing I'd try is using a larger read buffer, to cut down on the number of read system calls you execute. (Maybe even just read_to_end into a Vec, if you can reuse the Vec.)

Also, is there a way to compile my exe so that it will use runtime detection of SIMD features, so that it uses AVX-512 when running on a CPU that supports that? (If I compile it with the latest VS2019)
Btw, would it still run on CPUs that don't support AVX-512 if I compile it on a CPU that supports it?

BLAKE3 does CPU feature detection automatically in both C and Rust. So unless you use special flags to turn it off, you'll get what you want here by default.

Thanks for the detailed response!
Yeah, I used to use walkdir but now I'm using jwalk because it scans the fs in parallel using rayon.

BLAKE3 does CPU feature detection automatically in both C and Rust. So unless you use special flags to turn it off, you'll get what you want here by default.

Even when compiling with VS2015 which doesn't support the flag for AVX-512?

Even when compiling with VS2015 which doesn't support the flag for AVX-512?

Ah good question, this slipped my mind above. If you take a look at our build.rs, there's a place where we explicitly check whether the compiler supports AVX-512. If we find that the compiler doesn't support the necessary flags, we skip building it, and we set some cfg flags that suppress the corresponding Rust wrapper code.
What that means is, if you compile BLAKE3 with a modern C compiler that supports AVX-512 flags, then the AVX-512 implementation will be available for the dispatch functions to choose, based on processor support detected at runtime. But if you compile BLAKE3 with an old C compiler that doesn't support AVX-512, then the dispatch functions won't have the AVX-512 implementation available, even if you run the binary on a CPU that could have supported it.
If Rust adds support for AVX-512 in the future (either through intrinsics, like it has for SSE2/4.1 and AVX2 today, or through stable inline assembly), we'll be able to get rid of this reliance on the C compiler.


Add endwise rule for Ruby

I wrote some endwise rules for Ruby. It's not perfect and it's just based on my daily usage, but I think this one can be a good start.
There's one case I cannot manage to do though. If things like if condition is at the beginning of a line, it won't have endwise because it will conflict with inline if condition. I have to choose one. I appreciate if you guys have any advice on this.

can you move it to endwise-ruby.lua?

Yes, I moved. Btw, how can the rule be applied after this PR is merged? Seems like I have to set it up somewhere right?

Thank for your PR
you can do this to use ruby rules.
npairs.add_rules(require('nvim-autopairs.rules.endwise-ruby')).

Thank you @dakennguyen !


Introduce Kafka event logger for server events

Why are the changes needed?

introduce new event logger type KAFKA
send server events to the Kafka topic with initializing and closing Kafka producer properly with server's lifecyle
use Kafka 3.4.0 as the client version, and tested with Kakfa servers of 2.8.x and 3.4.x

How was this patch tested?

[x] Add some test cases that check the changes thoroughly including negative and positive cases if possible

[ ] Add screenshots for manual tests if appropriate

[x] Run test locally before make a pull request

cc @lxbalex @jeanlyn

Codecov Report

Merging #4733 (10e8d50) into master (8c7b457) will decrease coverage by 0.01%.
The diff coverage is 88.09%.

@@             Coverage Diff              @@
##             master    #4733      +/-   ##
============================================
- Coverage     58.07%   58.06%   -0.01%
  Complexity       13       13
============================================
  Files           580      583       +3
  Lines         32236    32337     +101
  Branches       4305     4314       +9
============================================
+ Hits          18720    18776      +56
- Misses        11721    11753      +32
- Partials       1795     1808      +13

Impacted Files
Coverage Δ

...rg/apache/kyuubi/events/EventHandlerRegister.scala
50.00% <33.33%> (-2.39%)
:arrow_down:

...vents/handler/ServerKafkaLoggingEventHandler.scala
66.66% <66.66%> (ø)

...uubi/events/handler/KafkaLoggingEventHandler.scala
90.90% <90.90%> (ø)

...in/scala/org/apache/kyuubi/config/KyuubiConf.scala
97.11% <100.00%> (-0.05%)
:arrow_down:

...ala/org/apache/kyuubi/events/EventLoggerType.scala
100.00% <100.00%> (ø)

...che/kyuubi/events/ServerEventHandlerRegister.scala
100.00% <100.00%> (ø)

... and 14 files with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

We can use Testcontianers to address the Kafka server compatibility issues

cc @iodone @wForget
I am looking for proper timing to close event handlers for Kyuubi Server. But repeated errors comes in the irreverent places.
As I tried to close event handlers via EventBus.close() in KyuubiSever's stop() or stopServer,
the get operation log test case failed, which is completely unrelated to Kafka logger introduced in this PR, and it also never uses the Kafka logger in context.
If you guys have any idea for this, feel free to ping me any time. Thanks.
java.lang.IllegalStateException: Cannot perform operation after producer has been closed
	at org.apache.kafka.clients.producer.KafkaProducer.throwIfProducerClosed(KafkaProducer.java:892) ~[kafka-clients-2.8.1.jar:?]
	at org.apache.kafka.clients.producer.KafkaProducer.doSend(KafkaProducer.java:901) ~[kafka-clients-2.8.1.jar:?]
	at org.apache.kafka.clients.producer.KafkaProducer.send(KafkaProducer.java:885) ~[kafka-clients-2.8.1.jar:?]
	at org.apache.kafka.clients.producer.KafkaProducer.send(KafkaProducer.java:773) ~[kafka-clients-2.8.1.jar:?]
	at org.apache.kyuubi.events.handler.KafkaLoggingEventHandler.apply(KafkaLoggingEventHandler.scala:50) ~[kyuubi-events_2.12-1.8.0-SNAPSHOT.jar:?]
	at org.apache.kyuubi.events.handler.KafkaLoggingEventHandler.apply(KafkaLoggingEventHandler.scala:31) ~[kyuubi-events_2.12-1.8.0-SNAPSHOT.jar:?]
	at org.apache.kyuubi.events.EventBus$EventBusLive.$anonfun$post$4(EventBus.scala:87) ~[kyuubi-events_2.12-1.8.0-SNAPSHOT.jar:?]
	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) ~[scala-library-2.12.17.jar:?]
- get operation log *** FAILED ***
  scala.collection.JavaConverters.asScalaBufferConverter[String](logRowSet.getLogRowSet()).asScala.exists(((x$1: String) => x$1.contains("show tables"))) was false (OperationsResourceSuite.scala:107)

Thanks, LGTM, only minor things of docs

Thanks for the detailed reviews. Wait for the CI builds and it will be merged. @pan3793 @cxzl25

Thanks, merged to master


Question: Integration of Dropshipper

Hi Folks,
how effortful do you think would be an integration of a dropshipper API like this:
https://www.bigbuy.eu/en/api_bigbuy.html
I'm just curious if it's better to go with shopify or integrate it into the (more loved by me) community store?
Cheers

My initial thinking would be that it would be a very large undertaking to integrate the two.
If something like Shopify is an option, I'd be weighing up the ongoing costs against a rough estimate of the development work to both set up Community Store and develop a well tested integration add-on. I'd be thinking that Shopify costs would be much lower.  Keep in mind that there are ways to integrate Shopify with a concrete5 site too (we've got an add-on for this), you don't have to run a Shopify site, you'd just use Shopify's cart and checkout.


demo/dev/preprod postmark is out of credits

Someone has triggered large amount of calls to dev postmark so we are out of credits now
All calls seems to be done to<EMAIL_ADDRESS>can you pls investigate who was doing that? tnx

this is the result of the performance tests

that's not nice :(
BR, Pavel V. Zhuk
2017-12-04 23:40 GMT+02:00 lymychp<EMAIL_ADDRESS>
this is the result of the performance tests
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/edenlabllc/ehealth.api/issues/1586#issuecomment-349114899,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AJ4gYHQKxkwnbDRbf6ZLYdmo85SLu3rEks5s9GbAgaJpZM4Q1VtK
.


Android Linking Problem

Originally posted by @MartinEesmaa in https://github.com/fraunhoferhhi/vvdec/issues/198#issuecomment-2395778005 :

          Hey guys! I got also problem too when I found out that exception error code when configuring my custom FFmpeg repo:

Last twenty lines of ffbuild/config.log:
ld.lld: error: undefined symbol: std::__ndk1::basic_iostream<char, std::__ndk1::char_traits<char>>::~basic_iostream()
>>> referenced by sstream:1102 (/home/martineesmaa/mpv-android-vvc/buildscripts/sdk/android-ndk-r27b/toolchains/llvm/prebuilt/linux-x86_64/sysroot/usr/include/c++/v1/sstream:1102)
>>>               DecLib.cpp.o:(vvdec::DecLib::create(int, int, vvdec::UserAllocator const&, vvdec::ErrHandlingFlags)) in archive /home/martineesmaa/mpv-android-vvc/buildscripts/prefix/arm64/lib/libvvdec.a
>>> referenced by sstream:1010 (/home/martineesmaa/mpv-android-vvc/buildscripts/sdk/android-ndk-r27b/toolchains/llvm/prebuilt/linux-x86_64/sysroot/usr/include/c++/v1/sstream:1010)
>>>               vvdecimpl.cpp.o:(std::__ndk1::basic_stringstream<char, std::__ndk1::char_traits<char>, std::__ndk1::allocator<char>>::basic_stringstream[abi:ne180000]()) in archive /home/martineesmaa/mpv-android-vvc/buildscripts/prefix/arm64/lib/libvvdec.a
>>> referenced by sstream:1102 (/home/martineesmaa/mpv-android-vvc/buildscripts/sdk/android-ndk-r27b/toolchains/llvm/prebuilt/linux-x86_64/sysroot/usr/include/c++/v1/sstream:1102)
>>>               vvdecimpl.cpp.o:(std::__ndk1::basic_stringstream<char, std::__ndk1::char_traits<char>, std::__ndk1::allocator<char>>::~basic_stringstream()) in archive /home/martineesmaa/mpv-android-vvc/buildscripts/prefix/arm64/lib/libvvdec.a

ld.lld: error: undefined symbol: std::__ndk1::basic_ios<char, std::__ndk1::char_traits<char>>::~basic_ios()
>>> referenced by sstream:1102 (/home/martineesmaa/mpv-android-vvc/buildscripts/sdk/android-ndk-r27b/toolchains/llvm/prebuilt/linux-x86_64/sysroot/usr/include/c++/v1/sstream:1102)
>>>               DecLib.cpp.o:(vvdec::DecLib::create(int, int, vvdec::UserAllocator const&, vvdec::ErrHandlingFlags)) in archive /home/martineesmaa/mpv-android-vvc/buildscripts/prefix/arm64/lib/libvvdec.a
>>> referenced by sstream:1103 (/home/martineesmaa/mpv-android-vvc/buildscripts/sdk/android-ndk-r27b/toolchains/llvm/prebuilt/linux-x86_64/sysroot/usr/include/c++/v1/sstream:1103)
>>>               DecLib.cpp.o:(vvdec::Exception& vvdec::Exception::operator<<<char [78]>(char const (&) [78])) in archive /home/martineesmaa/mpv-android-vvc/buildscripts/prefix/arm64/lib/libvvdec.a
>>> referenced by sstream:901 (/home/martineesmaa/mpv-android-vvc/buildscripts/sdk/android-ndk-r27b/toolchains/llvm/prebuilt/linux-x86_64/sysroot/usr/include/c++/v1/sstream:901)
>>>               DecLib.cpp.o:(vvdec::Exception& vvdec::Exception::operator<<<char [78]>(char const (&) [78])) in archive /home/martineesmaa/mpv-android-vvc/buildscripts/prefix/arm64/lib/libvvdec.a
>>> referenced 466 more times

I think exception code may be problem, which may be not able to configure probably on native systems, but I'm not too sure...
Feel free to ask or reply to me. Thanks! :)

Martin Eesmaa

@adamjw24 replied :

Looks like a linking problem, see https://stackoverflow.com/questions/49183886/error-undefined-reference-to-std-ndk1localelocale
Seems you are mixing up the libstdc++ implementations.

@MartinEesmaa wrote :

Hi, @adamjw24! Thank you for your response back! :)
I already tried to compile with c++_shared with ANDROID_STL.

It did not work for FFmpeg configuration only, so I might need to add extra libs of libc++ or still if that persist problem exists, then I might have look something else...
Feel free to reply or ask question again to me. Thanks! :)
* Martin Eesmaa

Thanks for posting this issue of my comment. :) By the way, the title is misspelled Adroid, correct first title word is Android.

Martin Eesmaa

Why did you explicitly set the ANDROID_STL ? Did the default not work? Otherwise the cmake command line looks Ok to me.
I see you are building mpv-android. We actually do have instructions for building that with VVdeC in our wiki:
https://github.com/fraunhoferhhi/vvdec/wiki/How-to-use-VVdeC#build-mpv-android-with-vvc-support

Why did you explicitly set the ANDROID_STL ? Did the default not work? Otherwise the cmake command line looks Ok to me.

Cause, I set ANDROID_STL for C++ shared creates shared library module, so whenever the user can disassembly apk file and replace latest vvdec shared library built of Android on lib folder and repack apk file using apktool. Also default without ANDROID_STL argument did not work too.
Last twenty-one lines of default without ANDROID_STL, but different log:
>>> referenced by sstream:901 (/home/martineesmaa/mpv-android-vvc/buildscripts/sdk/android-ndk-r27b/toolchains/llvm/prebuilt/linux-x86_64/sysroot/usr/include/c++/v1/sstream:901)
>>>               vvdecimpl.cpp.o:(vvdec::Exception& vvdec::Exception::operator<<<char [14]>(char const (&) [14])) in archive /home/martineesmaa/mpv-android-vvc/buildscripts/prefix/arm64/lib/libvvdec.a
>>> referenced by sstream:901 (/home/martineesmaa/mpv-android-vvc/buildscripts/sdk/android-ndk-r27b/toolchains/llvm/prebuilt/linux-x86_64/sysroot/usr/include/c++/v1/sstream:901)
>>>               vvdecimpl.cpp.o:(vvdec::Exception& vvdec::Exception::operator<<<char [14]>(char const (&) [14])) in archive /home/martineesmaa/mpv-android-vvc/buildscripts/prefix/arm64/lib/libvvdec.a
>>> referenced by sstream:901 (/home/martineesmaa/mpv-android-vvc/buildscripts/sdk/android-ndk-r27b/toolchains/llvm/prebuilt/linux-x86_64/sysroot/usr/include/c++/v1/sstream:901)
>>>               vvdecimpl.cpp.o:(vvdec::Exception& vvdec::Exception::operator<<<char [6]>(char const (&) [6])) in archive /home/martineesmaa/mpv-android-vvc/buildscripts/prefix/arm64/lib/libvvdec.a
>>> referenced 461 more times
>>> the vtable symbol may be undefined because the class is missing its key function (see https://lld.llvm.org/missingkeyfunction)

ld.lld: error: undefined symbol: VTT for std::__ndk1::basic_ostringstream<char, std::__ndk1::char_traits<char>, std::__ndk1::allocator<char>>
>>> referenced by ostream:216 (/home/martineesmaa/mpv-android-vvc/buildscripts/sdk/android-ndk-r27b/toolchains/llvm/prebuilt/linux-x86_64/sysroot/usr/include/c++/v1/ostream:216)
>>>               vvdecimpl.cpp.o:(vvdec::Exception& vvdec::Exception::operator<<<char [14]>(char const (&) [14])) in archive /home/martineesmaa/mpv-android-vvc/buildscripts/prefix/arm64/lib/libvvdec.a
>>> referenced by ostream:216 (/home/martineesmaa/mpv-android-vvc/buildscripts/sdk/android-ndk-r27b/toolchains/llvm/prebuilt/linux-x86_64/sysroot/usr/include/c++/v1/ostream:216)
>>>               vvdecimpl.cpp.o:(vvdec::Exception& vvdec::Exception::operator<<<char [14]>(char const (&) [14])) in archive /home/martineesmaa/mpv-android-vvc/buildscripts/prefix/arm64/lib/libvvdec.a
>>> referenced by ostream:216 (/home/martineesmaa/mpv-android-vvc/buildscripts/sdk/android-ndk-r27b/toolchains/llvm/prebuilt/linux-x86_64/sysroot/usr/include/c++/v1/ostream:216)
>>>               vvdecimpl.cpp.o:(vvdec::Exception& vvdec::Exception::operator<<<char [6]>(char const (&) [6])) in archive /home/martineesmaa/mpv-android-vvc/buildscripts/prefix/arm64/lib/libvvdec.a
>>> referenced 463 more times

Full log of compressed file: config.zip
I remember last time I compiled vvdec commit (c26979fac06cf0405da7c901b7826ed517444f95) with mpv-android-vvc was 17th June 2024.
Feel free to reply me again. Thanks! :)

Martin Eesmaa

Hi, @K-os! Thanks for information.
-DBUILD_SHARED_LIBS=1 worked for me, but for static I had to insert --pkg-config-flags="--static" of FFmpeg.
Libs.private: -lc++ -lm -l:libunwind.a -ldl -l:libunwind.a -ldl -pthread

Even linux as well too:
Libs.private: -lstdc++ -lm -lgcc

Thanks for helping me, sorry about the pull request closed due to my unexpected issue of Android linking problem! :)
You may close the issue and proceed pull request at #199 for only version.

Martin Eesmaa


Leonardo Di Caprio #iqc2021 meme

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

@Avhijit-codeboy Thanks for your meme submission!


#2999: Tools: use prettier in addition to eslint

Add prettier plugin for eslint. ESLint formatting options should be migrated to prettier to avoid massive reformatting.

This issue has been mirrored in Jira: https://reddata.atlassian.net/browse/GROK-16511

prettier-eslint plugin can use eslint rules to do very nice formatting. not sure what you mean here.


GetNftSales endpoint might be missing some Sale events

[REQUIRED] Environment

Browser version:
Alchemy SDK version: 2.9.0

[REQUIRED] Describe the problem
I am running some tests with the GetNftSales endpoint (https://docs.alchemy.com/reference/getnftsales) and noticed it does not return all the Sales events for a given seller. In my case, it is missing 2 sale events.
How to reproduce:

Find all NFT sales

from Seller: 0xb9eb79e3e735ee636255dd8d65872a1287744e33
Contract: 0xa49a0e5eF83cF89Ac8aae182f22E6464B229eFC8
Token: 74

The response returned by the API contains 11 Sales, but it is missing two other Sales that happened on-chain:

A) https://etherscan.io/tx/0x454404c899b8fce2012d5fbfb85342f44554ef70eb702c02030db808c60df132
B) https://etherscan.io/tx/0xc030426032d57f017a5b9f552af7f26f6fb13b000c3ed0b987165feaea7cd2c8

Why Sales A & B are not included in the GetNFTSales endpoint response?

Relevant code or sample repro:
const options = {method: 'GET', headers: {accept: 'application/json'}};
const alchemy_api = 'https://eth-mainnet.g.alchemy.com/nft/v2/docs-demo'

const contract = '0xa49a0e5eF83cF89Ac8aae182f22E6464B229eFC8';
const token = '74';
const seller = '0xb9eb79e3e735ee636255dd8d65872a1287744e33';

const query_args = `fromBlock=0&toBlock=latest&order=asc&contractAddress=${contract}&tokenId=${token}&sellerAddress=${seller}`;

fetch(`${alchemy_api}/getNFTSales?${query_args}`,options)
  .then(response => response.json())
  .then(response => console.log(response))
  .catch(err => console.error(err));

Any thoughts on that? Apologies if it is not a bug on the API side, happy to fix whatever is wrong on the client side.

Alchemy Support team replied back via Discord:

I've just discussed with our engineering team and there is a reason why we are not showing the 2 sales that are missing from your getNFTSales request: we are not yet supporting multi-fees sales.

As you can see from this transaction on Etherscan: https://etherscan.io/tx/0x454404c899b8fce2012d5fbfb85342f44554ef70eb702c02030db808c60df132

There is 0.0108825 WETH going to OpenSea which is the protocol fee, 0.4026525 WETH is going to the seller, but we have to payments of 0.0021765
and 0.0195885 WETH to two separate addresses which looks like the royalties.

We don't support OpenSea sales with multiple royalty fee payments for now but have it in our backlog! We are looking of fixing this in the long term since it causes us to miss sales!