The media is missing (even with the media folder available)

WhatsApp version: Android
Platform: macOS
Branch and version: Main (WhatsApp Chat Exporter: 0.9.7 Licensed with MIT)

I'm having issues with The media is missing, but the chat/text exports fine.
I have the "Media" folder (copied from the phone – and placed in the WhatsApp folder in the working directory. Verified manually that the files are there). I even tried to place it manually with the -m flag.
So not sure what's going on?
Thanks!

Hey, same issue here. Is it right to copy the WhatsApp folder from /Android/media/com.whatsapp to the root directory of the program?

I'm having issues with The media is missing, but the chat/text exports fine.
I have the "Media" folder (copied from the phone – and placed in the WhatsApp folder in the working directory. Verified manually that the files are there). I even tried to place it manually with the -m flag.

@NoLooseEnds Does #68 helps?

Hey, same issue here. Is it right to copy the WhatsApp folder from /Android/media/com.whatsapp to the root directory of the program?

@BLACK4585 The WhatsApp media folder should be located in the root of your shared storage, i.e. /WhatsApp (or /sdcard/WhatsApp if you know what I am referring to)

Do you mean the folder in MainStorage/Android/media/com.whatsapp/WhatsApp?

Are your media stored in MainStorage/Android/media/com.whatsapp/WhatsApp/Media?

Do you mean the folder in MainStorage/Android/media/com.whatsapp/WhatsApp?

Are your media stored in MainStorage/Android/media/com.whatsapp/WhatsApp/Media?

I'm not sure but since I don't have an SD Card inserted..
The folder looks like this:

Do you mean the folder in MainStorage/Android/media/com.whatsapp/WhatsApp?

Are your media stored in MainStorage/Android/media/com.whatsapp/WhatsApp/Media?

I'm not sure but since I don't have an SD Card inserted.. The folder looks like this: !

Right. Seems legit. You should copy the whole directory MainStorage/Android/media/com.whatsapp/WhatsApp to the working directory, so that your working directory has a folder called "WhatsApp".

@KnugiHK #68 Not really, unless I misunderstand something. I do have a WhatsApp directory in the working directory, and the WhatsApp directory has a Media directory.
Please see tree of working directory (only went down 4 levels – and removed "the middle" where there is a lot of files) and you can tell me if I'm placing it correct?
$ tree -L 4 -I result
├── WhatsApp
│   ├── Backups
│   │   ├── backup_settings.json.crypt14
│   │   ├── chatsettingsbackup.db.crypt14
│   │   ├── commerce_backup.db.crypt14
│   │   ├── statusranking.db.crypt1
│   │   ├── stickers.db.crypt14
│   │   ├── wa.db.crypt14
│   │   └── wallpapers.backup.crypt13
│   ├── Databases
│   │   ├── msgstore-2024-01-14.1.db.crypt14
│   │   ├── msgstore-2024-01-15.1.db.crypt14
│   │   ├── msgstore-2024-01-16.1.db.crypt14
│   │   ├── msgstore-2024-01-17.1.db.crypt14
│   │   ├── msgstore-2024-01-18.1.db.crypt14
│   │   ├── msgstore-2024-01-19.1.db.crypt14
│   │   ├── msgstore-2024-01-20.1.db.crypt14
│   │   ├── msgstore-2024-01-21.1.db.crypt14
│   │   └── msgstore.db.crypt14
│   ├── Media
│   │   ├── WallPaper
│   │   ├── WhatsApp Animated Gifs
│   │   │   ├── Private
│   │   │   └── Sent
│   │   ├── WhatsApp Audio
│   │   │   ├── Private
│   │   │   └── Sent
│   │   ├── WhatsApp Calls
│   │   ├── WhatsApp Documents
│   │   │   ├──  Utlandsbetalning.pdf
│   │   │   ├── DB_Ticket_884594179938.pdf
│   │   │   ├── Private
│   │   │   ├── Sent
│   │   │   └── Tentamen_Stadler.pdf
│   │   ├── WhatsApp Images
│   │   │   ├── IMG-20221030-WA0008.jpg
│   │   │   ├── IMG-20221030-WA0009.jpg
│   │   │   ├── │(…)
│   │   │   ├── IMG-20240121-WA0000.jpg
│   │   │   ├── IMG-20240121-WA0001.jpg
│   │   │   ├── IMG_20230325_145907.jpg
│   │   │   ├── Private
│   │   │   └── Sent
│   │   ├── WhatsApp Profile Photos
│   │   ├── WhatsApp Stickers
│   │   ├── WhatsApp Video
│   │   │   ├── Private
│   │   │   ├── Sent
│   │   │   ├── VID-20230114-WA0008.mp4
│   │   │   ├── VID-20230114-WA0010.mp4
│   │   │   ├── (…)
│   │   │   ├── VID-20230821-WA0005.mp4
│   │   │   ├── VID-20230821-WA0006.mp4
│   │   ├── WhatsApp Video Notes
│   │   ├── WhatsApp Voice Notes
│   │   │   ├── 201825
│   │   │   ├── 201827
│   │   │   ├── (…)
│   │   │   ├── 202352
│   │   │   └── 202403
│   │   ├── thumbnails
│   │   │   ├── 02e3541192674ba26a8d3bac310f0e2c52752ed2daeec6c065895ebe2e96c187.png
│   │   │   ├── 05c663045bf27aa9fe80ae0081020609c9219f6b91b2a40b042830c1fa1c0570.png
│   │   │   ├── (…)
│   │   │   ├── e5ec2d1b0429c59cb881f3a8a9b650e245b92326e2a5bc1a81f882fab7a4b635.png
│   │   │   └── f9b8caedd5aab6dd696349cf9ec5e14aeae2138a58c1cfb032c34d3dc60f6487.png
│   │   └── vCards
│   ├── thumbnails
│   │   ├── 02e3541192674ba26a8d3bac310f0e2c52752ed2daeec6c065895ebe2e96c187.png
│   │   ├── 05c663045bf27aa9fe80ae0081020609c9219f6b91b2a40b042830c1fa1c0570.png
│   │   │   (…)
│   │   ├── e2a686c38f67132bfc08df78e7288507df12eba87c1cf474da61fcd661c1d23a.png
│   │   ├── e5ec2d1b0429c59cb881f3a8a9b650e245b92326e2a5bc1a81f882fab7a4b635.png
│   │   └── f9b8caedd5aab6dd696349cf9ec5e14aeae2138a58c1cfb032c34d3dc60f6487.png
│   └── vCards
├── axolotl.db
├── chatsettings.db
├── msgstore.db
├── tree.log
├── wa.db
└── whatsapp.cryptkey

The The media is missing is shown when the program cannot find your media file.
file_path = f"{media_folder}/{content['file_path']}"
...
if os.path.isfile(file_path):
    ...
else:
    ...
    message.data = "The media is missing"

The media_folder by default is WhatsApp and the content['file_path'] should be the relative path to the file starting from ./Media. You may want to check the media files location against the paths stated in the database.

Am I missing something. Is the working directory supposed to be the WhatsApp directory (with the Media directory inside)? Or should the working directory be whatever and have WhatsApp (still with the Media directory inside)?

The latter one is correct.

Yes, and that's what I have?
The path is pretty far down in the filesystem /Volumes/<hdd-name-mount>/<Team> Dropbox/<full name>/<_directory>/Whatsapp-backup/working_wts

Yes, and that's what I have?
The path is pretty far down in the filesystem /Volumes/<hdd-name-mount>/<Team> Dropbox/<full name>/<_directory>/Whatsapp-backup/working_wts but should that matter?

How many characters does this path has? In another issue, long path name did affect the program.

76 chars, but it also contains space and a nordic char. Anyhow, I just moved it to a shorter non space non nordic char directory /Users/username/Desktop to be precise, and I still experience the same issue. And it seems like it sees the media and copies it, but I still get The media is missing
$  ~/Desktop/working_wts  wtsexporter -a
Processing contacts...(284)
Processing messages...(56623/56623)
Processing media...(9639/9639)
Processing vCards...(4/4)
Processing calls...(664)
Generating chats...(283/283)
Copying media directory...

Everything is done!

76 chars, but it also contains space and a nordic char. Anyhow, I just moved it to a shorter non space non nordic char directory /Users/username/Desktop to be precise, and I still experience the same issue. And it seems like it sees the media and copies it, but I still get The media is missing
$ ~/Desktop/working_wts  wtsexporter -a
Processing contacts...(284)
Processing messages...(56623/56623)
Processing media...(9639/9639)
Processing vCards...(4/4)
Processing calls...(664)
Generating chats...(283/283)
Copying media directory...

Everything is done!

Copying and finding a media file are two different logics. I think in this case you should take a look into the database.

Ok, not totally sure what to look for, but I found table called media_refs and the path it uses is: /storage/emulated/0/WhatsApp/Media/WhatsApp Images/Sent/filename.jpg (it's from an Huawei P30 pro phone)

I think I might have messed up the copy of the WhatsApp folder. On further investigation it looks like I only have newer-ish files – giving me missing media in the beginning of all the chats, but getting media at the end. So it seems like the issue is with me and not the software (as often is the case it feels like when debugging).
Appreciate the help, but I think this can be closed.

I think I might have messed up the copy of the WhatsApp folder. On further investigation it looks like I only have newer-ish files – giving me missing media in the beginning of all the chats, but showing media files at the end. So it seems like the issue is with me and not the software (as often is the case it feels like when debugging).
Appreciate the help, but I think this can be closed.

I see. The (really) missing media used to concerns me as well. But I rarely use WhatsApp now.
@BLACK4585 Any further question/issue on the matter? If not I am closing this.

Oh yeah, same issue for me. The media files at the end are present, seems like the old media files are simply not existent anymore. Thank you very much for your help!


save_screenshot does not overwrite screenshot.png

Describe the bug
ClickIcon makes comparison against screenshot.png.
However this only works once as save_screenshot is not overwriting screenshot.png when new is taken but renames those as screenshot_000, etc.. If there is multiple Icon related keywords in test suite those latter ones are failing because of this.
I believe this only happens in Linux and is pyautogui/scrot -related issue with newer Python versions (at least i haven't noticed it before with older versions).

Hi,
Thanks for reporting this. I may not understand the use case fully. Can you elaborate it a bit? Any snippet of script that could reproduce this?
Best regards,
Tuomas

I dont have log (this came from customer) and it's already fixed using workaround but i am trying to explain:
We have script like this:
ClickIcon   some_image
Do something else
ClickIcon   some_other_image
Now when we reach that first ClickIcon it takes screenshot.png and after that makes comparision if screenshot.png matches to some_image = all is good.
Problem appears when we reach ClickIcon some_other_image. It again takes screenshot, but as we already have screenshot.png in our folder it names this new one to screenshot_000.png instead of overwriting screenshot.png. However comparision is still made against screenshot.png, which in this case is obviously wrong picture and we are getting Fail.

I believe combination where this happened was Ubuntu, Python 3.7 or 3.8 and newest QWeb

Ok, thanks for the clarification. Sounds weird, but we'll debug this.

Could not repro this with Ubuntu and python 3.7/3.8. Turns out you need a newer scrot version which is included in Ubuntu 20; the default operation of scrot is different.
Since this is not yet fixed in pyautogui, we fixed this by removing the file. Fix should be included in release 1.0.5 later this week.


support schedule for pod

multus cr has vlan, cniTpe information, and  spiderippool has vlan information
pod need to add mutlus  annotation , and add nodeAffinity
it could add mutating webhook to add nodeAffinity to pod , according to mutlus  annotation

@Icarus9913 any update？

Still need schedule arrangement


⚠ Bofrost.lu has degraded performance

In fdd5dfe, Bofrost.lu (https://www.bofrost.lu) experienced degraded performance:

HTTP code: 200
Response time: 1870 ms

Resolved: Bofrost.lu performance has improved in c336059 after 13 minutes.


[4.10] - org.gradle.api.tasks.compile.CompileOptions:incremental - default is false?

Description:
Do the docs need to be updated? CompileOptions:incremental default returns false according to the docs.
Docs:

https://docs.gradle.org/current/dsl/org.gradle.api.tasks.compile.CompileOptions.html#org.gradle.api.tasks.compile.CompileOptions:incremental

Release Notes:

https://github.com/gradle/gradle/releases/tag/v4.10.0
https://docs.gradle.org/4.10/release-notes.html#incremental-java-compilation-by-default

Indeed, thanks for the pointer.

How often do you update the site?

The docs are static and built together with the release. We generally don't touch them after the fact. So the correction would be in the docs of the next release.
@eriwen how involving would an ad hoc correction to the published docs be?

@oehme much more involved than I'd like. Luckily we have a chance to fix with 4.10.1. Should we cherry pick a fix here?


Make file/blob metadata & properties persistent after update

Fixes #327

This only fixes files/blobs updated by AzureStorageFS. I need to update for the Azure view use case.


Continuous fuzzing

Proposing to integrate with Fuzzit to get some bug discovery running.
This patch writes fuzz to envvars then runs Process() to detect any crashes. A local run has found a corpus of ~100 cases. No crashes so far.
There's a successful build under my Travis account. The PR build will fail due to missing the API key. If it seems interesting setup is like this:

In Fuzzit create target envconfig.
In Fuzzit settings grab an API key. In repo settings in Travis paste it to envvar FUZZIT_API_KEY.

I don’t understand what it benefits for? Could you introduce?

Thanks for looking at it @TonyPythoneer.
Fuzzing runs the program with a bunch of random input and detects crashes. It finds a lot of bugs. It gives you a way to find bugs automatically before your users run into them.
There's a nice article discussing it.
https://docs.google.com/document/d/1N-12_6YBPpF9o4_Zys_E_ZQndmD06wQVAM_0y9nZUIE/edit

go-fuzz has found 200+ bugs in Go stdlib when it was already mature, written by very experienced developers, and used in production for years. Fuzzing has found 15000+ bugs in Chrome; 1500+ bugs in FFMpeg library; and thousands more ([1], [2], [3], [4], [5]). Generally fuzzing finds bugs in any code it is applied for the first time.


How can modal box adapt to image size automatically?

I use modal to display images with different sizes.
My code has class="modal-box relative max-w-5xl" attribute.
When the image is big enough to take the use the specified width, it's displayed as expected:

However, when the image is smaller, I keep getting white margin, as the image does not fill the 5xl width:

I'd like the modal box size to adapt to the image size if the image is smaller.
Thanks for your help.

You can add max-w-max to modal-box
https://play.tailwindcss.com/tJcxUZ6OAY


⚠ File access (beta) has degraded performance

In 4ba68a3, File access (beta) (https://beta.fyle.uk/file/fish) experienced degraded performance:

HTTP code: 200
Response time: 2123 ms

Resolved: File access (beta) performance has improved in f07e2e6.


How to get the time which the task instance is covering?

Consider a task with schedule_interval=timedelta(hours=1) and start_date=datetime(2015,12,1,0,0,0).

#
task

1
2015-12-01 00:00:00

2
2015-12-01 01:00:00

3
2015-12-01 02:00:00

4
2015-12-01 03:00:00

n
...

On the example above, the task 1 covers a data extraction for 2015-12-01 00:00:00 ~ 2015-12-01 00:59:59, the task 2 for 2015-12-01 01:00:00 ~ 2015-12-01 01:59:59, and so on...
A lot of our python scripts are parameterized with 'initial' and 'end' datetimes.
Nowdays, in Airflow, is very tricky to pass these parameters to the tasks, once the execution_date is only available within the jinja templates (is that right?), unlike the schedule_interval, which is a dag level parameter and it's available directly on both scenarios (the python code and the jinja templates).
So, if I want to run a python script that takes date_ini and date_end as parameters, I need to code a BashOperator task with export execution_date={{ execution_date }}; export schedule_interval={{ dag.schedule_interval }}; python path/to/python_script.py. Then in my python script I use os.getenv() to retrieve the values and sum the schedule_interval with the execution_date.
Searching the docs I couldn't find none simple way to access the vars available in jinja from my python scripts.
I feel uncomfortable getting stuck on BashOperator with this mess of code. Would be really great if we kept all the things in python.
Anyone had a similar use case? Do you know a better way to achieve the solution to this problem.

Hi Wesley,
Note that if you create a PythonOperator and set the parameter provide_context to True, you will get the context of the task instance provided to you.
In particular in the context dict, you get execution_date, which is the datetime object corresponding to 2015-12-01 00:00:00 for instance.
I hope this helps.

The context dictionary made available to your templates is also made available to all operators' execute method. As @artwr said, it's also available to your python callable when using the PythonOperator

Good to know about the provide_context. Sorry, I didn't saw.
Thanks for the answers guys!
Surely in the roadmap we aim to have the most tasks using PythonOperator. But I think I'm given one step higher than the leg putting everything in PythonOperators.
We are still understanding the options that we have with Airflow. Aiming a soft transition, we actually need to keep the things running on their bashs scripts and later transform in PythonOperators.
I guess the right question should be something like "How to put/modify the BashOperator task's context"
I will open another issue :)

#775


Remove DEPRECATED commands

We have a some commands marked as **DEPRECATED**.
Currently, configure-bosh is deprecated in favor of configure-director and set-errand-state with configure-product. Probably best to remove these before any official om CLI comes out.

Closing as the two PRs were merged in.


Add support for offscreen GL contexts

It'd be great to be able to create a non-window context in Flitter, for containing scene nodes that will be used only as references and to allow generating images and videos in a non-windowed environment – which would be great for doing functional tests.

So basic offscreen support turned out to be super easy. What will need a bit more thinking about, to avoid a nasty hack, is how to add an --offscreen command-line option.


v1.14 backports 2023-10-24

[ ] #27229 -- spire: add scheduling configurations to helm-chart (@tvonhacht-apple)
[ ] #28391 -- bpf: lxc: remove stale ENABLE_IDENTITY_MARK ifdefs (@julianwiedmann)

:warning: Minor conflict, kept SECLABEL instead of SECLABEL_IPV4 and SECLABEL_IPV6 as used on main

[x] #28425 -- Print full labelset for all identities in 'cilium ip list' output (@joestringer)
[x] #26798 -- docs: update clustermesh troubleshooting guide (@giorio94)

:warning: Minor conflict in context, kept version from the PR.

[x] #28141 -- docs: Update IPsec key rotation command (@jschwinger233)
[x] #28481 -- helm: don't expose kvstoremesh metrics if not enabled (@giorio94)
[ ] #28633 -- Fix IPv6 cilium_host address assignment (@CallMeFoxie)
[x] #28610 -- helm: Correct spire labels indentation (@sayboras)
[ ] #28676 -- install: Remove AWS-CONNMARK-CHAIN iptable rules (@nebril)
[x] #28682 -- docs: Clarify BPF Map Pressure Metric (@nathanjsweet)

:warning: Minor conflict in context, kept version from the PR.

[x] #28400 -- ipsec: New Prometheus metrics for XFRM configs (@pchaigno)
[ ] #28638 -- fixed cilium-operator delete CEC cilium-ingress when other ingressclass resources are created (@chaunceyjiang)
[x] #28703 -- policy: Fix Unspecified Protocol Type (@nathanjsweet)
[x] #28640 -- cmd: Display decryption interfaces in encrypt status (@pchaigno)

Once this PR is merged, you can update the PR labels via:
$ for pr in 27229 28391 28425 26798 28141 28481 28633 28610 28676 28682 28400 28638 28703 28640; do contrib/backporting/set-labels.py $pr done 1.14; done

/test-backport-1.14

My commit looks good as well, thanks :)


Fix the issue of videos in main app dependent on library app

@pai-meghna When installing the mainapp as a standalone app (without installing the library app), and opening a video, it does not load:

Is there a corresponding pull request for this GitHub issue?


datasets dynamic update(add, delete, update)

Ggnn does not support dynamic updating of datasets?

Hi, sorry for the late reply,
do you mean updating the values of existing points in the dataset?
In that case, running one or two refinement iterations (depending on how much the values change) should already do the trick.
If you want to add more datapoints to the dataset after the construction of the kNN search-graph, there is currently no option for this and one would need to change the code.
One could think of searching for the nearest neighbors of the new points in the existing graph as a starting point and then simply add the new points on the bottom layer and run a few refinement iterations.
If you want to progressively build the search graph for regularly sized blocks, you could instead go for sharding and build independent graphs for each block of data which are then all queried and the results are merged.
But that code path also does not yet support adding shards after the initial construction.


NodeUnion + Trivial Type changes (ABI=8)

This PR is based on the original type PR proposed here: https://github.com/AcademySoftwareFoundation/openvdb/pull/865. It was reverted here due to ABI issues: https://github.com/AcademySoftwareFoundation/openvdb/pull/895
ABI branching on the implementation of NodeUnion fixes these issues. I have introduced an ABI test which attempts to dereference a PointDataTree::LeafNodeType. This breaks prior to the ABI branching of NodeUnion  as the selected NodeUnion implementation changes before and after this PR for PointIndex types:
template<typename ValueT, typename ChildT, typename Enable = void>
class NodeUnion

template<typename ValueT, typename ChildT>
class NodeUnion<ValueT, ChildT, typename std::enable_if<std::is_pod<ValueT>::value>::type>

template<typename ValueT, typename ChildT>
class NodeUnion<ValueT, ChildT, typename std::enable_if<CopyTraits<ValueT>::IsCopyable>::type>

template<typename T> struct CopyTraits { static const bool IsCopyable = false; };
template<typename T> struct CopyTraits<math::Vec2<T>> { static const bool IsCopyable = true; };
template<typename T> struct CopyTraits<math::Vec3<T>> { static const bool IsCopyable = true; };
template<typename T> struct CopyTraits<math::Vec4<T>> { static const bool IsCopyable = true; };
template<> struct CopyTraits<math::Coord> { static const bool IsCopyable = true; };

Before, PointIndex types would select the first specialization as std::is_pod<PointIndex32>::value == 0 even though  std::is_trivially_copyable<PointIndex32>::value = 1.
template<typename ValueT, typename ChildT, typename Enable = void>
class NodeUnion

template<typename ValueT, typename ChildT>
class NodeUnion<ValueT, ChildT, typename std::enable_if<std::is_trivially_copyable<ValueT>::value>::type>

Now, PointIndex32 types select the equivalent CopyTraits::IsCopyable specialization.
NOTE:
This PR does not address the changes to the constructors of container types (Vec3() = default; etc). I think the only ABI issue that could arise with the constructor changes is if someone is deriving from these classes as the C++ ABI prohibits using the tail padding of a base subobject of POD type. For example:
struct MyType : public openvdb::Vec3R {   int data;   }

The size of MyType may now be different. As these are not marked as final, this could very well exist in someone's codebase. A reminder, this change was made such that they can be used within a default union i.e. union A { Vec3f data; } vs union B { B() : data() {} Vec3f data; }.
https://stackoverflow.com/questions/24110347/when-extending-a-padded-struct-why-cant-extra-fields-be-placed-in-the-tail-pad

I encountered yet another problem with TypedAttributeArrays templated on one of the container types (i.e. Vec3f). I added another ABI test for this which failed so have guarded every single constructor/copy/assignment operator for all the math types in ABI >= 8. This PR should no longer have any impact for any ABI versions other than 8.

I should note that, because of this change, PointDataGrid topology now has half the memory footprint!
Before:
Information about Tree:
  Type: Tree_ptdataidx32_5_4_3
  Configuration:
    Root(1 x 8), Internal(8 x 32^3), Internal(8 x 16^3), Leaf(9 x 8^3)
  Background value: 0
  Min value: 1
  Max value: 1
  Number of active voxels:       9
  Number of active tiles:        0
  Bounding box of active voxels: [-100, -100, -100] -> [100, 100, 100]
  Dimensions of active voxels:   201 x 201 x 201
  Percentage of active voxels:   0.000111%
  Average leaf node fill ratio:  0.195%
  Number of unallocated nodes:   0 (0%)
Memory footprint:
  Actual:                4.593 MB
  Active leaf voxels:       36 Bytes
  Dense equivalent:     30.978 MB
  Actual footprint is 14.8% of an equivalent dense volume
  Leaf voxel footprint is 0.000747% of actual footprint
Transform:
  voxel size: 0.1
  index to world:
     [0.1, 0, 0, 0]
     [0, 0.1, 0, 0]
     [0, 0, 0.1, 0]
     [0, 0, 0, 1]

After:
Information about Tree:
  Type: Tree_ptdataidx32_5_4_3
  Configuration:
    Root(1 x 8), Internal(8 x 32^3), Internal(8 x 16^3), Leaf(9 x 8^3)
  Background value: 0
  Min value: 1
  Max value: 1
  Number of active voxels:       9
  Number of active tiles:        0
  Bounding box of active voxels: [-100, -100, -100] -> [100, 100, 100]
  Dimensions of active voxels:   201 x 201 x 201
  Percentage of active voxels:   0.000111%
  Average leaf node fill ratio:  0.195%
  Number of unallocated nodes:   0 (0%)
Memory footprint:
  Actual:                2.343 MB
  Active leaf voxels:       36 Bytes
  Dense equivalent:     30.978 MB
  Actual footprint is 7.56% of an equivalent dense volume
  Leaf voxel footprint is 0.00147% of actual footprint
Transform:
  voxel size: 0.1
  index to world:
     [0.1, 0, 0, 0]
     [0, 0.1, 0, 0]
     [0, 0, 0.1, 0]
     [0, 0, 0, 1]

I did get a failure on my branch: https://github.com/Idclip/openvdb/runs/1595362883?check_suite_focus=true
Blosc related - @danrbailey any thoughts?

That does seem safer, thanks. I haven't seen that test fail recently and nothing stands out in the list of dependencies.


Auto generate schema.graphql on server startup

Is your feature request related to a problem?
I want to write my generated HotChocolate schema.graphql file to a particular folder when I run my server in development mode. That way I don't have to remember to run dotnet graphql update every time I make a schema change.
The solution you'd like
I tried something like this:
public class MyCodegenWorker : IHostedService {
	private readonly ISchema _schema;

	public MyCodegenWorker( ISchema schema ) {
		_schema = schema;
	}

	public Task StartAsync( CancellationToken cancellationToken ) {
		File.WriteAllText( "schema.graphql", _schema.ToDocument(  ).ToString() );
		return Task.CompletedTask;
	}

	public Task StopAsync( CancellationToken cancellationToken ) {
		return Task.CompletedTask;
	}
}

The important part is that I'm injecting an ISchema here. If I run this code right now I get this error:
Cannot resolve parameter 'HotChocolate.ISchema schema' of constructor

Product
Hot Chocolate

From my understanding there isn't a single ISchema in the DI container, since your server could have potentially multiple schemas.
You need to resolve an executor for a specific schema (in your case likely the default one) and access the schema through it.
var executorResolver = builder.Services.GetRequiredService<IRequestExecutorResolver>();
var executor = await executorResolver.GetRequestExecutorAsync(); // the name of a specific schrma can be used as an argument
var schemaText = executor.Schema.ToString();

In your example you could inject the IRequestExecutorResolver via the constructor. Personally I wouldn't create a hosted service and just perform this action directly from the Main method.
I'm closing this for now, feel free to re-open if you have further questions. :)

Thank you, this is exactly what I needed!


doctrine not more integrated in Laravel 11

Laravel Version: 11.#.#
PHP Version:8.3
Laravel-admin: #.#.#

Description:
fix ResourceGenerator.php :
use Illuminate\Support\Facades\Schema;
protected function getTableColumns()
{
    $table = $this->model->getConnection()->getTablePrefix().$this->model->getTable();

    return Schema::getColumns($table);
}

$name = $column['name'];
$type = $column['type_name'];
$default = $column['default'];
Steps To Reproduce:

Look at the fork https://github.com/dedermus/open-admin-core .git, which solves the problem with doctrine and works in Laravel 11

Friends, I have not yet completely solved the problem with the doctrine, since I am not satisfied with the result that I got.

干的不错,去提交一个合并申请呗


Kubernetes Support

Question via e-mail:

One of the deployments we are looking at requires Kubernetes 1.15.  I am trying to ensure that everything will work nicely together via the version issues that we have encountered with Kubernetes so far.  Do you have a recommendation for a Centos 8 or Centos 7 stack?  I want to ensure that I have the right Docker version, Kubernetes version and Xain version to ensure that it works without unforeseen issues.

As of right now, we're not hosting in Kubernetes. Whenever we start using k8s, the documentation will be updated accordingly.
Regarding the underlying operating system, that shouldn't be a problem. However, we use Ubuntu for our servers, can't know for sure about CentOS/RedHat

To add to that, for the open source stack we provide docker images, which gives you the flexibility to deploy it your way. We also provide a fully managed solution of XAIN and here we work with more specific deployements for us. We will provide the Kubernetes support approximately in Spring 2020.

I'm closing this issue because Kubernetes is now part of the repository. (since version 0.8.0)


Error with Apple Pay on production only

Hello,
I'm currently chatting with the stripe team about the following issue. For some reasons I'm not able to use PaymentSheet with Google pay in production mode only, in test mode, everything goes fine.
When I try I get an "unknown error"
Here is the log of /v1/tokens call related, I tested with various cards, and always the same HTTP 500 error from stripe. I guess it's related to some configuration I might be missing ?
{
  "card": {
    "address_city": "Montpellier",
    "address_country": "FR",
    "address_line1": "<My_address_hidden>",
    "address_zip": "34000",
    "name": "<My_name_hidden>"
  },
  "guid": "5993f99b-e209-<Hide_some_characters>-b0a7-1002340d1583118564",
  "muid": "db971b25-024f-<Hide_some_characters>-90a7-16fd1e595ed33c8be9",
  "payment_user_agent": "stripe-ios/22.3.0; variant.legacy; PaymentSheet; STPApplePayContext",
  "pk_token": "******",
  "pk_token_instrument_name": "MasterCard 7319",
  "pk_token_payment_network": "PKPaymentNetwork(_rawValue: MasterCard)",
  "pk_token_transaction_id": "45B74<Hide_some_characters>A78D655A4AC1487DE45122E8A56112F4F7EBB595C4406BBB59E",
  "sid": "8b0fdf2f-5f43-4e3a-ab9b-b18ea8f9f4093c9a38"
}

Respond with HTTP 500
{
  "error": {
    "message": "An unknown error occurred",
    "type": "api_error"
  }
}

Any idea what could cause that ?
As it seems related to a server issue, I'm not sharing my app version (I'm on 0.9) but I'm using PaymentSheet (like stripe checkout) and Apple Pay

@davidme-stripe Thanks for your support, way better than the chat support ahah, even if the guys are really cool on it.
Just to be sure :

If you have separate Production/Test App IDs in Xcode, the Merchant ID should be added to the entitlements of the production app.

Does it means that I can't use the ID in test and production at the same time and it will somehow get "locked" between the two ? So i need two merchant ID ?
Take note that in Stripe documentation u linking they ask for merchant.com.{{YOUR_APP_NAME}} where Expo CLI (or in stripe portal i don't remember) ask for merchant.{{YOUR_APP_NAME}}

Code sample
For the information, here is my implementation code for various places in the meantime i'm trying your manipulation.
async ({ error }) => {
      if (!error) {
        await mutate(ME_CACHE_KEY);
        goBack();
      }
      if (error && error.code !== PaymentSheetError.Canceled) setError(error);
    },
    [mutate],
  );

  useMount(async () => {
    const {
      data: { client_secret },
    } = await methods.authentication.checkout();

    setClientSecret(client_secret);

    const [{ error: initPayError }, { error: initGpayError }] =
      await Promise.all([
        initPaymentSheet({
          setupIntentClientSecret: client_secret,
          merchantDisplayName: t("app"),
          applePay: true,
          googlePay: false, // TODO: Wait for expo to fix latest react native stripe and test it
          merchantCountryCode: "FR",
          testEnv: Config.STRIPE.TEST_ENVIRONMENT,
        }),
        Platform.OS === "android"
          ? initGooglePay({
              countryCode: i18n.language,
              merchantName: t("app"),
              testEnv: Config.STRIPE.TEST_ENVIRONMENT,
            })
          : Promise.resolve<GooglePayInitResult>({}),
      ]);

    if (initPayError || initGpayError) setError(initPayError ?? initGpayError);
  });

  return (
    <ScrollView
      alwaysBounceVertical={false}
      contentContainerStyle={tw("grow justify-around px-8")}

<AppText
        size="2xl"
        weight="extraBold"
        style={tw("text-text-strong text-center")}

{t("card_payment.title")}
      </AppText>
      <Image
        source={require("@modules/settings/assets/CardCollectorIllu1.png")}
        resizeMode="contain"
        style={tw("h-40 w-full")}
      />
      <AppText style={tw("text-center leading-6")}>
        {t("card_payment.description")}
      </AppText>
      <View style={tw("mt-4")}>
        {error && (
          <AppText
            weight="bold"
            style={tw("text-primary-strong text-center mb-8")}

{error.localizedMessage ?? error.message ?? t("card_payment.error")}
          </AppText>
        )}
        {clientSecret === null ? (
          <Loader />
        ) : Platform.OS === "android" ? (
          <>
            <GooglePayButton
              type="standard"
              style={tw("h-12")}
              onPress={() =>
                presentGooglePay({
                  clientSecret,
                  forSetupIntent: true,
                  currencyCode: Config.STRIPE.CURRENCY_CODE,
                }).then(handlePaymentRes)
              }
            />
            <View style={tw("h-4")} />
            <AppButton
              title={t("card_payment.android_register_card")}
              onPress={() => presentPaymentSheet().then(handlePaymentRes)}
            />
          </>
        ) : (
          <AppButton
            title={t("card_payment.ios_register_method")}
            onPress={async () => {
              presentPaymentSheet().then(handlePaymentRes);
            }}
          />
        )}

        <AppText
          onPress={goBack}
          weight="bold"
          style={tw("mt-4 p-4 text-center text-primary-base")}

{t("actions.later")}
        </AppText>
      </View>
    </ScrollView>
  );
};

app.json
{
"plugins": [
    [
      "@stripe/stripe-react-native",
      {
        "enableGooglePay": true,
        "merchantIdentifier": [MerchantIdentifier],
      },
    ],
  ]
}

app.tsx
 <StripeProvider
      publishableKey={Config.STRIPE.PUBLISHABLE_KEY}
      stripeAccountId={Config.STRIPE.ACCOUNT_ID}
      urlScheme={ExpoAppConfig.scheme}
      merchantIdentifier={Config.STRIPE.MERCHANT_IDENTIFIER}
    >

Does it means that I can't use the ID in test and production at the same time and it will somehow get "locked" between the two ? So i need two merchant ID ?

No, you should be able to use the same merchant ID for both testing and production, but you need to make sure the merchant ID in your production app matches the merchant ID in your production Stripe account.
In your code sample, Config.STRIPE.MERCHANT_IDENTIFIER in your app.tsx should match the Merchant ID in your Xcode project and the Merchant ID in your Stripe account's Apple Pay Settings page, and Config.STRIPE.PUBLISHABLE_KEY should match the livemode publishable key for that same account. merchant.com.AppName vs merchant.AppName shouldn't matter, but it does need to be a consistent ID across all Apple Pay settings.

Thanks for the info, sorry for the confusion! @charliecruzan-stripe, can you help me check if this is being forwarded correctly to PaymentSheet?

Thanks for the info, sorry for the confusion! Is it possible that Config.STRIPE.MERCHANT_IDENTIFIER isn't set to "merchant.stride"? @charliecruzan-stripe, can you help me check if the merchantIdentifier is being forwarded correctly to PaymentSheet?

On my side looks like it's the same key, I used the config key and it still works. Even thought could be nice to enhance the error message on stripe side 😅 U spotted well but the message is clearly cryptic ahah

Yep! I will take a look, thanks for the issue @ScreamZ

I'm still getting (from time to time) when I repeat setup intent apple pay the
{
  "error": {
    "message": "An unknown error occurred",
    "type": "api_error"
  }
}

Not sure for which reasons
Working Log ID:

req_y0sTt6oJj03KrY

Not working log ID:

req_GLV6lYzccmnZ8D

I can confirm that the merchantIdentifier from the provider is being passed along to the payment sheet correctly. If it wasnt, but you passed true to applePay, then you'd received an error directly from the RN SDK saying that the merchant id was missing.
@ScreamZ it looks like you're using Expo- are you building with EAS then? Or how are you using @stripe/stripe-react-native v0.9.0?

@charliecruzan-stripe I'm using Expo SDK45 with a development client.
I'm building with EAS-CLI, and I'm up-to-date most of the time.
I'm using 0.9.0
`- @stripe/stripe-react-native - expected version: 0.6.1 - actual version installed: 0.9.0```
I had to do this because this was patched for SDK45 on this release before brentvane ask explicitly the stripe team to backport the fix of SDK45 plugin on actual 0.6.
Also I can benefit for various changes from 0.9

I had your mate at stripe support also telling me the following:

Hello Andréas,
My name is Mike, I am an engineer at Stripe. Here to help with your ApplePay issue.
After looking further in to your error, it looks like this was caused by your account having two ApplePay certificates with us that were generated with the same CSR. To resolve this we recommend deleting your old certificate and going through our Apple Pay set up process again with a new CSR[1]. Once you have uploaded a new .cer file to us that was generated with a new CSR, this issue should be resolved for you.
I agree that this generic error message is not helpful in this scenario and will raise feedback so that we can hopefully surface a more informative error message for this error in future. Also apologies for the delay in my reply, I had to consult a colleague on this error and meant to send you a heads up message that this response might take a bit longer than usual. Let me know if you have any further questions.
Thanks,
Mike

Got it, thanks for sharing that! Can you let me know if the issue is resolved after uploading a new .cer file?

heya @ScreamZ , any update on the behavior after uploading the new cert?

sure thing!


Appstudio update hacbs-test-project-vpwg

Pipelines as Code configuration proposal
To start the PipelineRun, add a new comment with content /ok-to-test
For more detailed information about running a PipelineRun, please refer to Pipelines as Code documentation Running the PipelineRun
To customize the proposed PipelineRuns after merge, please refer to Build Pipeline customization

Pipelines as Code CI has failed.There was an error creating the PipelineRun: hacbs-test-project-vpwg-on-pull-request-
creating pipelinerun hacbs-test-project-vpwg-on-pull-request- in namespace rhtap-demo-crkd-tenant has failed.
Tekton Controller has reported this error: the namespace of the provided object does not match the namespace sent on the request


Add debian standard iso to emulators

hey, quick thing, could you add the iso from this link to the disk images folder? the size is 1.3 GB and it runs on https://copy.sh, but the filesize is too large to upload to the website. the file is from the debian website.

I am able to drag/drop this onto the website to run locally.

oh, before, if i tried to upload something more than a GB, then it would fail. wait, my chromebook just crashed while uploading it

accessed it by using map directory, and i think it froze my chromebook

Ya I am not sure tbh but there is indeed a limit to how big the files can be. If you want to add larger files it's best to fork the repo and add it that way. Thanks for the suggestion to add debian iso but I'd rather not have such a large file hosted or in the repo.


Make SET_META keep meta data not set in the payload

SET_META currently overwrites any meta already set, so any meta properties not specified in the current action is lost.
Two alternative solutions:

Retrieve existing meta data before setting
Keep each meta property separate

As there are still some unresolved issues on data integrity, let's solve this for now in the couchdb beforeSerialize hook. This hook already fetches data from the source, so it is an easy quick fix.


Items removed from source storage are still present in list of tasks after syncing.

Describe the bug
I am labelling sound events from a list of audio stored in a local folder. My source storage is this folder and I sync it every now and then whenever I have new audio in it. BUT, when I delete some audio from this folder, and that I sync it in LS, the removed audio are not deleted from my list of tasks. I then have to remove them all manually or start a new project from scratch to have everything clean.
To Reproduce
Steps to reproduce the behavior:

Set a local folder as a source storage
Add some audio to it
Sync it in LS
Remove a couple of audio from this source storage
Sync it again in LS
Check the list of tasks (removed audio are still present)

Expected behavior
I want the removed audio to disappear from the list of tasks after I sync. Sometimes I just change the naming convention for my data and I end up with two versions of the same data in my list of tasks, with different names, because the old one didn't get removed.
Screenshots
N/A
Environment (please complete the following information):

OS: Windows 10
Label Studio Version 1.7.3dev

Additional context
N/A

@AbubakarSaad or @makseq, any thoughts on this one? It's causing us a real pain currently. We had to rename a whole bunch of audio which were already synced in label-studio, some of them annotated some not. After renaming them and syncing again, we have the two versions listed in label-studio, the ones with the old names and the ones with the new names. Obviously we would like the old names versions to be deleted from the last of tasks to annotate.
Cheers

@Antoine101 in looking at this use case, I think that Label Studio is doing the right thing in not removing the tasks. We can't really know the users' intentions, and deleting the tasks may result in the removal of data for some users. I can put in a feature request for an option to delete tasks on storage sync, but I think it's a fairly difficult solution to implement in a way that won't cause data loss for some users.
This is an instance where I think the best option is to leverage the Label Studio API. For example, I could see a job that watches the local storage and triggers the deletion of tasks if files are deleted.

Hi Chris,
Thanks a lot for getting back to me!
I get your point of view. However I think this comes at a cost of creating a lot of mess.
Let's say I have 20.000 audio I need to label. I label 3/4 of them. As my project evolve, I may need to change the naming convention on my audio, thus slightly changing their names. If I do that and sync LS on my source storage, I will have my new tasks with the new audio name as well as the old tasks (labeled or not). By the way, for these old tasks, we can't play the audio anymore (as the old name doesn't point to anything in the source storage). When we label tasks iteratively, we stumble upon tasks related to old audio and that prompt an error, so we have to manually skip them.
I'm talking about 20.000 audio here but imagine if you have way more data and you have some mix of old and new versions of similar audio.
Also, a nice feature is to be able to see how many audio we have labeled on the total number of audio in our dataset (say 10.000 out of 20.000). If we keep old versions of similar audio, we end up screwing that indicator as we are not sure of how many doubles we have in our list of tasks.
As for the solutions you suggest, If I understood you correctly, it would be to create an external script to automatically remove the tasks according to what is remaining in the source storage?
Could implementing a multiple delete tasks feature directly from the LS UI be a solution? I don't see such a feature at the moment. The idea would be to search for all files that have a certain name pattern in the list of tasks and delete them all at once in LS. This way, it would not be automatic and be the user's manual doing, thus not leading to errors.
Cheers
Antoine

Implementing it directly from the UI isn't something that's supported right now. We are planning on some improvements for Label Studio that will make the Javascript frontend more scriptable, and probably let you implement a feature extension like this. Unfortunately I don't have a timeline for when that will be available

Thanks for your reply Chris! I understand that your backlog must be huge. Thanks for all the work you accomplish with the HS teams.
I hope there will be a fix in the not too far future or at least a workaround to help us. At least now you are aware that the current state of things are causing us trouble.
Cheers


Starting the daemon/computer while plugged in will keep the computer in powersave

Self assign pls

Should this be in 0.1.6 or 0.1.7?

Really simple fix I'll do it after my homework today

So 0.1.6


Stevenic/action scope

This PR adds support for new GotoAction, BreakLoop, and ContinueLoop actions. It also adds a new ActionScope action which lets you statically groups sets of actions into blocks.
Testing
Still need to add unit tests.

Closing Per Steve


Feature: In-place modification functions

It's far more efficient to modify arrays in-place than to copy them to new arrays. The convention in many languages/libraries is to postfix with an underscore. Functions like add_, sub_, mult_, etc would be great. They could then be aliased by +=, -=, +=$, *=$ etc.

I think so. I actually tried another design before by introducing  an extra out argument into every function so user can choose where to write output, but it makes the API ugly imo, especially Algodiff is a functor built on top. Introducing add_ is another solution same as that used in Julia. The API is cleaner, the downside is we need to double the size of API we need to maintain.
I guess there is no perfection solution, so I am happy with current suggest.

Not really doubling the size of the API per se, since many functions don't make sense in terms of in-place modification.
Also, having a unit result type for these functions makes the API clearer, I think.


collapsing BUS into TCC

I want to collapse BUS data into TCC for differential analysis method shown in
Ntranos, Yi et al., 2019.
I have modified the code from BUS notebooks for generating cell_gene dictionary to make an analogous cell_ec dictionary. For each umi, I incremented each equivalence classes by its count divided the sum of all counts for that umi. Should I instead increment each equivalence class matched for a particular umi with equal weight (ex. 1/len(eclist))?
Do you have suggestions for collapsing BUS into TCC?

Thank you for asking! We currently have an example bus to tcc notebook available here: https://github.com/BUStools/BUS_notebooks_python/blob/master/dataset-notebooks/10x_t4k_TCC/bus2tcc-gene.ipynb
Although we use the t4k dataset as an example, the notebook is general so you should be able to use it without any major modifications; it takes the sorted bus file as input together with the tx to gene and gene to name dictionaries generated from get_dicts-from-ref.ipynb (available in the utils folder: https://github.com/BUStools/BUS_notebooks_python/blob/master/utils/) and outputs both the TCC and the corresponding Gene Count matrices.

slicing the ENST caused problems in downstream analysis when the ENST has double digits for version number. For example, ENST00000348564.11 (transcript for CD45 RO) became 'ENST00000348564.' with an extra period.
# load transcripts
trlist = []
with open(busdir+'transcripts.txt') as f:
    for line in f:
        trlist.append(line[:-3])

Should replace with  trlist.append(line.split('.')[0])


Add facade for TensorFlow.js converter

TensorFlow.js converter enables conversion of pretrained Keras and (experimentally) TensorFlow models into a web friendly format that can be loaded using the JS part of the converter.
It would be nice to be able to use the loading part from Scala.js code as well.

Done


Bunch of fs access related errors on compile (though does compile)

Probably something weird I've done, but I issue it in case a better, more concise error message can be made.
These are just the two last (path shortened for brevity) - there where tons, but it compiles and runs anyway.
Error deleting file '/proj/.crystal/proj/src/app.cr/TimeFormat5858Error.new.bc': No such file or directory
*Errno::new<String>:Errno +435 [0]
*File::delete<String>:Nil +312 [0]
*Crystal::Compiler#codegen_single_unit<Crystal::Compiler, Crystal::Compiler::CompilationUnit, String, Bool>:(Nil | LLVM::Module) +1446 [0]
*Crystal::Compiler#codegen_many_units<Crystal::Compiler, Array(Crystal::Compiler::CompilationUnit), String, Bool>:Nil +219 [0]
*Crystal::Compiler#build<Crystal::Compiler, Crystal::Program, Crystal::Expressions, Array(Crystal::Compiler::Source), String>:(Nil | Int32 | Bool) +11754 [0]
*Crystal::Compiler#compile<Crystal::Compiler, Array(Crystal::Compiler::Source), String>:Crystal::Compiler::Result +4772 [0]
*Crystal::Command::run<Array(String)>:(Nil | Bool | FileDescriptorIO+ | Crystal::Compiler::Result | Array(Crystal::Init::View+:Class)) +1836 [0]
main +16666 [0]
__libc_start_main +245 [0]
_start +41 [0]
 +41 [0]

Error: you've found a bug in the Crystal compiler. Please open an issue: https://github.com/manastech/crystal/issues
Error deleting file '/proj/.crystal/proj/src/app.cr/Pointer40Que5858Position41.new.bc': No such file or directory
*Errno::new<String>:Errno +435 [0]
*File::delete<String>:Nil +312 [0]
*Crystal::Compiler#codegen_single_unit<Crystal::Compiler, Crystal::Compiler::CompilationUnit, String, Bool>:(Nil | LLVM::Module) +1446 [0]
*Crystal::Compiler#codegen_many_units<Crystal::Compiler, Array(Crystal::Compiler::CompilationUnit), String, Bool>:Nil +219 [0]
*Crystal::Compiler#build<Crystal::Compiler, Crystal::Program, Crystal::Expressions, Array(Crystal::Compiler::Source), String>:(Nil | Int32 | Bool) +11754 [0]
*Crystal::Compiler#compile<Crystal::Compiler, Array(Crystal::Compiler::Source), String>:Crystal::Compiler::Result +4772 [0]
*Crystal::Command::run<Array(String)>:(Nil | Bool | FileDescriptorIO+ | Crystal::Compiler::Result | Array(Crystal::Init::View+:Class)) +1836 [0]
main +16666 [0]
__libc_start_main +245 [0]
_start +41 [0]
 +41 [0]

Error: you've found a bug in the Crystal compiler. Please open an issue: https://github.com/manastech/crystal/issues

What's the path to your source file?

Per above re-written output the path to the main file (the one passed to compiler) is "/proj/src/app.cr" - it's a longer path under my home dir in reality of course.

Anybody found a way to reproduce these?

If anybody found a way to reproduce these, please comment or open a new issue.


Detect config changes and reconfigure itself

When config files are changed Logagent should

detect that
reconfigure itself according to new configs

Do you have any plan to add this feature? @otisg


Don't use : separator when using a FSCommandLoader on a real path

Closed with go-go-golems/sqleton#207


Constructor to wrap billy.Filesystem

Requesting a way to instantiate a GitFS instance using a billy.Filesystem directly.  The main use case is for situations where I need to instantiate a go-git Repository separately, such as to do some modifications to the repository, but then still want to make the repo's contents available via io.FS.  Right now the constructors abstract away go-git entirely, requiring that I re-open the repo.
At the risk of making go-git part of your API and not just implementation, this may be as simple as making the FS field public, which could allow me to do this myself:
	worktree, err := repository.Worktree()
	if err != nil {
		return nil, err
	}
	return &GitFS{FS: worktree.Filesystem}, err

Otherwise a FromWorktree(billy.Filesystem) function would probably meet my needs here.

FS is exported now.


h1 unexpected EOF

Hi, h1 failed.
╰─ bbscope h1 -t xx -u xx -b -o td                   ─╯
2022/08/30 19:55:05 HTTP request failed: Get "https://api.hackerone.com/v1/hackers/programs/coursera": unexpected EOF
╭─    ~                                                                                  ✔  1m 30s  ─╮
╰─ bbscope h1 -t xx -u xx -b -o td                                                 ─╯
2022/08/30 19:59:01 HTTP request failed: Get "https://api.hackerone.com/v1/hackers/programs/arkadiyt-projects": unexpected EOF

add output file option too please

i have same issue

getting "Invalid print flag"

This has been fixed a while ago, closing the issue


How to turn off ESC on windows 10

There is a brief note here states about setting a a windows office add-in dev environment:
`NOTE`: Internet Explorer's Enhanced Security Configuration (ESC) must
be turned off forOffice Web Add-ins to work. If you are using a Windows
Server computer as your client when developing add-ins,
note that ESC is turned on by default in Windows Server

but there is not enough information on how to disable this feature, more specifically on WINDOWS 10 V1803. I have no access to Windows server. any help will be appreciated.
WHAT IS EXPECTED:
to be able to run my add-in locally in office suite.
WHAT IS HAPPENING
Office suite crashes and forcefully restarts my addin and throw error:
Sorry, we had to restart this application since it was not responding
My addin runs fine on IE11, Chrome, Safari, OfficeOnline, OfficeMac.
NOTE: this is only for our localhost address. our prod works fine on PC office suite. So I know that our manifest syntax and logic are correct. I'm pretty sure something is blocking to have a secure HTTPS connection locally. I just don't know where/how to disable this.
Another Question
Also another question, why does office add-in runs IE11(32bit) instead of 64bit? any possible way to change this?

ESC is off by default on Windows client computers. Why do you think there's a connection between the crashing and ESC?

because of the documentation states that ESC is on by default and I thought I was using a windows server computer, but I guess I'm not. We basically can't test our addin on any windows machine office suite nor IE11.  any ideas on why we are only getting this error [Sorry, we had to restart this application since it was not responding ] on windows machine when the addin is running locally?

We use the issues of this repo to track problems with the documentation. Please raise this technical issue on Stack Overflow. Tag it office-js . Be sure to include your Office version, Windows version, and the exact steps that lead to the error. Also, be sure that you have trusted a certificate for your localhost before you try to run add-in.


kak-fzf: 2020-05-24 -> 2020-07-26

Plugin is no longer maintained, but still works fine. Update to the final commit, unless and until a new maintainer takes over the project.

Result of nixpkgs-review pr 107772 run on x86_64-linux 1


running gcc failed: exit status 1

What version of Go are you using (go version)?

$ go version
go version go1.16 linux/amd64

Does this issue reproduce with the latest release?
yes
What operating system and processor architecture are you using (go env)?
go env Output
$ go env
GO111MODULE="off"
GOARCH="amd64"
GOBIN="/root/src/go_dev/bin"
GOCACHE="/root/.cache/go-build"
GOENV="/root/.config/go/env"
GOEXE=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GOINSECURE=""
GOMODCACHE="/root/src/go_dev/pkg/mod"
GONOPROXY=""
GONOSUMDB=""
GOOS="linux"
GOPATH="/root/src/go_dev"
GOPRIVATE=""
GOPROXY="https://repo.haplat.net/go-local,https://repo.haplat.net/go,direct"
GOROOT="/root/dongb/go"
GOSUMDB="off"
GOTMPDIR=""
GOTOOLDIR="/root/dongb/go/pkg/tool/linux_amd64"
GOVCS=""
GOVERSION="go1.16"
GCCGO="gccgo"
AR="ar"
CC="gcc"
CXX="g++"
CGO_ENABLED="1"
GOMOD=""
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build2255314678=/tmp/go-build -gno-record-gcc-switches"

os

centos7

kernel version

5.6.7-1.el7.elrepo.x86_64

xfsprogs version

xfsprogs-devel-4.5.0-18.el7.x86_64

gcc version

$ gcc --version
gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-4)
Copyright (C) 2015 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

What did you do?

git clone https://github.com/cirocosta/xfsvol.git
cd xfsvol/xfsvolctl
go build -v
What did you expect to see?
Compiled successfully
What did you see instead?
github.com/cirocosta/xfsvol/xfsvolctl
/root/dongb/go/pkg/tool/linux_amd64/link: running gcc failed: exit status 1
/usr/bin/ld: /tmp/go-link-476550193/000008.o: unrecognized relocation (0x2a) in section `.text'
/usr/bin/ld: final link failed: Bad value
collect2: error: ld returned 1 exit status

/usr/bin/ld: /tmp/go-link-476550193/000008.o: unrecognized relocation (0x2a) in section `.text'

This is not an object generated by Go. It is probably generated by the C compiler. Is you C compiler compatible with your binutils? What version of binutils are you using?

binutils  version is binutils-<IP_ADDRESS>.1-55.el7.x86_64， gcc binutils  xfsprogs installed by yum，so it should not be a compatibility issue。
I can compile successfully through " go build -v -gcflags="all=-N -l"  "。
go <= 1.15 is ok。

Closing as dup of #43996. Please comment if you disagree.

binutils version is binutils-<IP_ADDRESS>.1-55.el7.x86_64， gcc binutils xfsprogs installed by yum，so it should not be a compatibility issue。
I can compile successfully through " go build -v -gcflags="all=-N -l" "。
go <= 1.15 is ok。

As discussed on #43996, you will get this error if you use the prebuilt Go install from golang.org and are using GNU binutils earlier than 2.24.


(ffmpeg) 4.3 build missing libx264, libx265

Expected Behavior
ffmpeg -encoders includes libx264, libx265
Current Behavior
ffmpeg -encoders doesn't include libx264, libx265
Possible Solution
It looks like upstream rebuilt the package with the needed libraries. ffmpeg @ chocolately might just need a rebuild too.
Steps to Reproduce (for bugs)

Run ffmpeg -encoders, check for  libx264, libx265 in output.

Context
Cannot use the x264 or x265 encoder in ffmpeg.
Your Environment

Package Version used: 4.3
Operating System and version: Windows 10 2004

@majkinetor would you be able to force a new package fix for the ffmpeg package?
The latest compiled binary on the location we use as the source should have been rebuild (checksums have at least changed), but is still under the same version so a fix version is needed.
I am unfortunately unable to do that myself until the coming weekend.

By the time it took you to write that message you could do it from GitHub UI ? :)

@majkinetor

I do not like making commits through the GitHub UI
It do not allow empty commits
I am on a very slow and unstable network connection, so no it would have been faster to make the changes than adding aa commit (it would actually take way longer time).

Anyways, thanks for forcing the new fix version.

One of the goals of entire AU setup was to enable you quick ad hoc interventions via GitHub UI. I am not saying you should use it for other stuff in general. To circumvent empty commit, I add space in main readme or delete it.

Thanks for forcing the rebuild. Confirming issue is resolved!


Add Python Examples to Queue Storage usage documentation.

Add Python Examples to Queue Storage usage documentation.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 5063120f-d48e-6a76-8e6d-208ead92d187
Version Independent ID: 72bb8ecc-6dec-079a-a9d4-52205466a8c6
Content: Azure Queue storage bindings for Azure Functions
Content Source: articles/azure-functions/functions-bindings-storage-queue.md
Service: functions
GitHub Login: @tdykstra
Microsoft Alias: tdykstra

@ratchetwrench Thanks for sending feedback, but unfortunately Python is not yet GA (still Experimental per our supported languages article). We don't have resources for developing samples for experimental languages for documentation such as the binding ref docs.  That said, if Python gets to preview and GA status, contributions will be welcome!


I can't seek by dragging

Sometimes I can't seek the music by dragging progress bar while playing.
Also, there isn't any error message. I need to seek the music while it's playing.
@DIYgod It's a serious bug that needs to be fix and clean.
Also, I'm using from vue-aplayer

I got the same issue but sometimes in different browser.
And especially, when use mobile to use the player, I can't seek. It always return to 00:00


FR: Inline audio player

Hi
I use the audio recorder addon to send voice message, but that is half of the story. The received audi ofile does not look nice on the receiving side, it just looks like an attachment.
It would be very nice if Riot enables some inline player when it detects a playable audio file, like it does with images, movies etc.
thanks

Duplicate of #57
#3207 is a solution?


Migrate to shared RADIUSS Spack configs

Instead of duplicating our own environment files, we should use these:
https://github.com/LLNL/radiuss-spack-configs

Yes! You should 😄


Rename or extract the solidus executable

Using solidus as the executable name makes little sense for a gem called solidus_dev_support, we should establish a base solidus command within core and allow it to be extended by the ecosystem.
solidus_dev_support can keep using the extension namespace but should deprecate defining the executable.
A possible alternative could be to switch to solidus-extension with commands such as:

generate for new extensions
update similar to rails app:update
release

Worth adding that we also discussed with @elia the possibility of moving the solidus executable to solidus_core and simply adding the extension subcommand in solidus_dev_support. This seems the cleanest route, since it gives us the ability to have commands such as solidus extension generate and solidus extension update that make a lot of sense semantically.

@aldesantis 💯
The tricky part about that is supporting older versions, so maybe we could resurrect solidus_cmd for that purpose, moving it to thor and leaving out the extension generation… then reintegrating it in side solidus_core with the next release.


Add a unique message id to each mqtt message [feat]

I have some workflows that need to ensure that they are not processing an 'old' message.
I can kind of tell message uniqueness by checking for a number of fields (currently lastupdate + nodeid + property) but it would be better to have a unique message id in every message.
Maybe a UUID?
I think ok to use a new message id on restart etc when publishing all current values. So every message that is sent would be 'new' from zwavejs2mqtt perspective, but when external clients are picking retained messages they can see if they processed it before.

Isn't the time in the payload like an uuid? YOu could simply store the timestamp in unix format along with the topic, if the received message in a specific topic has the same timestamp it means it's an old one

can you guarantee that the timestamp is unique? there are multiple nodes sending to the same topics. I know that you can be 'fairly certain' be comparing a few fields (timestamp, nodeid, property) that the message is unique - but I guess it is pretty easy to add a unique message id - then we can be sure.

it's a serial protocol, it's impossible that two messages are emitted with the same timestamp, at least for sure not from the same device. If you keep track of valueId topic ---> timestamp you are done.


Integrate reentrancy for Actors in C# sdk when implemented in Dapr runtime.

needs runtime support https://github.com/dapr/dapr/issues/21

This is done.


This is more for information as I cannot find clear documentation.

Can anyone point me to or provide me with advance breakdown for the following:
The MPOS pool requirements for json communications and order of input for jobs received from and sent to and from pool? All the components and standards  around:
Difficulty
Exrtranonce1
Extranonce2
Header
then mining submit.
I am developing a mining software and I am having challenges in determining errors in how MPOS based pools communicate.
I have read all sorts of stratum json documentation but still am having issues in properly connecting. Worker connection and authentication are ok.
Any help most appreciated.
Thanks

MPOS has no api or json endpoint to post worker shares to. It’s using the underlying MySQL table shares which is filled by stratum or any other mining software. If you fill that table and use the workers table in MPOS for authentication you should be fine.

Hi firstly thank you very much for taking the time to answer. So is there any way to get samples of such a worker table? will that tell me error messaging output and reason for things like, low difficulty shares, invalid job id, etc.
My issue I is in getting the pool software reason(my development can then be made to fix). As an example maybe my extranonce is wrong or I have the coinbase header incorrect..
Its that type of messaging that will help me.
thanks again

You can find the table format I MySQL in the dB import file (in the repo).
MPOS is not handing any mining errors. It’s not a mining software but a payout system for pooled mining based on data inserted by stratum.
I can’t help you further than that since I have no idea (anymore) how mining actually works. You’ll have to find other places to figure that out (like mining software out there and ask they code authors?).

ok thanks for your help.


Remove incubating identifier

Removes all instances of "incubating", except for those in
filenames/docs of previous releases. This makes it clear that those
releases are considered incubating releases. Future releases will not
have this identifier.
Removes the disclaimer file and footer text

DAFFODIL-2470

Adds a new commit to update the People page. Everyone is changed to a PMC role (which Mike marked as "chair"), and Beth changed to Committer.


Adding VS2017 support in nuget packages

@jasonsandlin,
Thanks for your contribution as a Microsoft full-time employee or intern. You do not need to sign a CLA.
Thanks,
Microsoft Pull Request Bot

:shipit:


Option to paste the clonse repository wont show up on VsCODE

after clicking source control
i then click onto clone repository
but then nothing happens?
the space to paste the code doesn't pop up no matter how many times i click on clone repository

/gifPlease


HTML export error ENOENT

see https://github.com/laurent22/joplin/issues/6971
@laurent22 said

Looks like it should be reported to the Snap package maintainer.

Might be related to https://github.com/MrCarroll/joplin-desktop-snap/issues/18

Hey,
The other issues are still myserious as I can't reproduce them, but the output from your linked issue actually has something I've picked up on as being very perculiar.
Specifically, the top line:
InteropService.ts:444 Error: ENOSYS: function not implemented, mkdir '/run/user/1508765214/doc/a0233181/pluginAssets'

Particularly regarding
/run/user/1508765214

The number there is supposed to reflect the User ID of the user on the system, e.g, the first non-system user on most non-networked systems is usually 1000, so the line above would suggest your system has another one and a half billion users. Or less ridiculously, there's likely something going on with determining the UID, the UID is being randomised, the UID is in a namespace, or anything else other than you have one and a half billion accounts!
Could you please try a basic test, opening the terminal, and running
echo $UID
snap run --shell joplin-desktop
echo $UID
exit

Ultimately, the files are ending up in /run since Electron is using the XDG Desktop FileOpen portals. Judging that these errors didn't occur until relatively recently, I'm imagining something may have changed in Electron or the Portals, with Electron being more likely. There's a fairly large jump in Electron versions in the Joplin 2.9 release that's due soon, and it's possible that this may fix the problem.

Thanks for the quick response! Yes, the user id is correct and also reported by the `echo $UID``, both within and outside of the snap shell. The shell prints:
groups: cannot find name for group ID<PHONE_NUMBER>
groups: cannot find name for group ID XXXXXXXX
[...]
I have no name!@MYCOMPUTERNAME:/home/MYUSERNAME$

I agree that this setup is pretty specific. In case that's likely to change with 2.9 it would also be fine for me to wait whether that might fix it.

Are you logging into a networked system by any chance? Would you also be able to run id in bash and post the results?
The UID/GID being big shouldn't cause problems by itself, but the "cannot find name for group ID" is concerning. Groups usually are listed in /etc/group on non-networked systems, so it'd be expected you'd get a hit for e.g:
grep "1508765214` /etc/group

Presumably on your system, it'll return nothing. It could be worth trying to add a group with that name, but it's still difficult to determine why (or if) there's a relation between the group setup and the errors being returned.
If there isn't a group you could consider:
sudo addgroup --gid<PHONE_NUMBER> xdg-portal-workaround
sudo groupadd $user xdg-portal-workaround

But ultimately I'm feeling this issue is actually slightly distinct from the other two issues involving exports, and might be more of a system configuration problem than implementation problem from what it looks like so far.

Thanks a lot for the support so far. I didn't think that this issue might be caused by the network setup of the machine, otherwise I wouldn't have opened it. User accounts are managed via SSSD and LDAP. And as much as I'd like to see this issue fixed I'm afraid I can't share any further details of the specific setup, I'm sorry. Since this issue might be very specific to my setup and not affect many other users I'd close it therefore even though not all information can be provided to solve the real cause.

No worries, it's a shame but there's a few concessions.
This issue would probably effect you less on Ubuntu 22.04 (due to newer xdg-desktop-portal packages). If you're trying to export to $HOME, in 22.04, the portals wouldn't use the indirection through /run/user, which I assume would bypass this problem.
Similarly, the Joplin Flatpak wouldn't suffer this issue (even in 20.04), and neither would the AppImage.
The data format shoudl be identical between all 3, so if you fancied transfering over to the AppImage/Flatpak, you should be able to copy and paste the folders in $HOME/snap/joplin-desktop/ over to the equivilent's in $HOME; or export as Jex and re-import, use built syncronisation, etc.


Code Fencing Not Retaining Language

I am using jstranformer with the markdown transformer and it creates a code block such as

code..

The issue I am having is that when converted to markdown it is simply converting without retaining the language name.  I have noticed that if i change my html source to be language-js then it will work just fine.  Is there a way to tell turndown that it should look for lang-js and not language-js?

I agree it would be nice to have this out of the box, mainly for when one uses the "online service" Paste to Markdown (not sure if it is the official web frontend or not)

In our custom rule, we configure this using an array of regexps, where capture group 1 of the first matched regexp is expected to give the resulting info string.
From our config:
const defaultOptions = {
  // ...
  codeClassPatterns: [
    /^(?:language|code)-(\S+)$/, // CommonMark spec and JIRA
    /^(\S+)\s+syntaxhl$/, // Redmine
  ],
  // ...
}

Evaluation is then as brief as:
function codeLanguageFromClassName(className, options) {
  return options.codeClassPatterns.reduce((match, regexp) => (
    match || (className.match(regexp) || [null, null])[1]
  ), null);
}

The great advantage is that a single Turndown instance/config can cover several different HTML sources and we are not limited to suffixes (see the pattern for Redmine). Which would be probably good for Paste to Markdown.
I can incorporate this if @domchristie likes it. The performance impact should be negligible and added complexity justifiable IMO.


Resource isolation policy

This PR is created for diff reading only now.
Resources:
https://web.dev/fetch-metadata/
https://web.dev/same-site-same-origin/
https://www.w3.org/TR/fetch-metadata/
https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Sec-Fetch-dest
https://discuss.rubyonrails.org/t/feature-proposal-implement-resource-isolation-policy-based-on-fetch-metadata-http-headers/76075
Running tests:
cd actionpack
bundle exec ruby -w -Itest test/dispatch/resource_isolation_policy_test.rb

cd railties
bundle exec ruby -w -Itest test/application/resource_isolation_policy_test.rb

TODO:

[ ] Think about the "default" policy. Is the one described in https://github.com/Zerocopter/rails/pull/1/files#diff-f020ee1953020c2cab3d94f129618a3fR14-R16 good enough? Should sec-fetch-site: same-site be allowed or disallowed by default?
[ ] Think about which aspects of the policy should be configurable in the Rails config and how the config values should be provided, e.g.

  config.resource_isolation_policy do |policy|
    policy.same_site = false
  end

vs
  config.resource_isolation_policy do |policy|
    policy.allowed_sites = [nil, "same-origin", "same-site", "none"]
  end

vs
  config.resource_isolation_policy do |policy|
    policy.strategy = :same_site
  end

vs
config.resource_isolation_policy do |policy|
  policy.rules = [
    {
      # Lack of rules implies "everything" allowed: all methods, all modes, all dests
      sites: %i(same-site same-origin none)
    },
    {
      # Implies all sites allowed
      methods: %i(GET),
      modes: %i(navigate),
      dests: %i(document)
    },
    {
      # Every kind of request allowed if path is prefixed with `/assets`
      paths: [/\Aassets/]
    }
  ]
end

etc.

[x] Introduce controller helpers that would allow to specify controller-specific policies. The ones implemented for CSP can be found here: actionpack/lib/action_controller/metal/content_security_policy.rb
[x] Write tests for the controller helpers
[ ] Any ideas for other tests?
[ ] Think about how the 403 page that is displayed in case of a blocked request should look like (currently https://github.com/Zerocopter/rails/pull/1/files#diff-bea5d78e294ba1746beb2e143f8fe7f0)
[ ] Documentation

I haven’t done a deep dive into all possible edge cases, but here is my feedback at first glance:
I think by default I would disallow same-site. Obviously, I’m biased towards security rather than usability, but subdomain take-overs are becoming an increasingly common vulnerability. Maybe I’m missing something. Afaik the most common use case for same-site would be an API that responds to requests from another subdomain, in which case you already need a custom policy for most functionality?
There should probably be an option for only logging instead of actually rendering a 403. On an existing app it would be nice to start off with just logging everything that is disallowed, and running it for a few weeks to see if there are any exceptions that should be configured. Only after that would you make it actually render a 403. I think this was also recommended in the blogpost introducing the spec.
I’m wondering if there is more information out there enumerating all the different edge cases that would pop up when deploying this into a large-scale production app. So far all I have seen is the main blogpost on web.dev and the W3 spec. Have you guys found any other resources?
Let me know when the PR is further along, and I’ll give it a more thorough review!


Add tests for the Draggable component when rendered into an iframe

Add tests for #180 (all passing ✅ )
Note that I was unable to get these tests working using TestUtils’ renderIntoDocument function (or the various find* helpers) and had to use actual ReactDOM.render along with querySelector on the returned DOM node to make assertions on the rendered results. Has something to do with the tricky parts of react-frame-component (rendering an iframe with React), and looking at the react-frame-component tests, they take the same approach.
As a result of needing to use ReactDOM.render, I had to add a setTimeout before selecting the rendered nodes from the DOM to avoid the tests breaking in Firefox. Here’s the error I saw when I tried to select the nodes synchronously:
[1A[2K[1A[2K[1A[2KFirefox 42.0.0 (Mac OS X 10.11.0) react-draggable props should be draggable when in an iframe FAILED
	TypeError: domComponentOrNode is null in specs/main.js (line 22648)
	makeSimulator/<@specs/main.js:22648:1
	simulateMovementFromTo@specs/main.js:1376:1
	@specs/main.js:801:8

I had another weird seemingly unrelated test failure on Firefox that I worked around by rounding the mouse event’s deltaY in the onDrag function’s assertions. Here’s that error:
Firefox 42.0.0 (Mac OS X 10.11.0): Executed 11 of 37 (2 FAILED) (0 secs / 0.096 secs)
[1A[2K[1A[2K[1A[2KFirefox 42.0.0 (Mac OS X 10.11.0) ERROR
  AssertionError:   # specs/draggable.spec.jsx:527

    assert(coreEvent.deltaY === 500)
           |         |      |
           |         |      false
           |<PHONE_NUMBER>5878906
           Object{node:#HTMLDivElement#,x:0,y:500.00001525878906,deltaX:0,deltaY:500.00001525878906,lastX:0,lastY:0}

    [number] 500
    => 500
    [number] coreEvent.deltaY
    =><PHONE_NUMBER>5878906

Just noticed that these new tests brings the number of tests running in CI up to 111, which strikes me as highly auspicious. 😉

:shipit: 111 sounds lucky enough to me

Thanks for the contribution!

My pleasure! And thanks to you.


Reparenting AnimationPlayer at same time or after animated mesh/sprite breaks the animation paths.

Godot version:

3.3 RC7 custom build 5fdb8b02e (happened in 2017 with older version too, according to a report. see description below)
OS/device including version:

Windows 10
Issue description:

Moving the AnimationPlayer in a basic scene imported from gltf, together with the armature and mesh to a new parent breaks all animation paths. This only happens if you select everything together and move them, or move things first and only then the player. Moving everything out of that parent doesn't fix the issue, the paths stay wrong. I tested this with a 3D model only, but same thing can happen with sprites given this Q&A from 2017.
I also tried just moving the AnimationPlayer alone. While it stops playing animations, the paths stay the same, and moving the player out of the new parent node fixes this. On the other hand, if the player is moved last, the paths get changed and stay broken.
Steps to reproduce:

Make simple model in another program with armature animations. (I used Blender.)
Save as gltf (format might not matter).
Import. It becomes a read-only scene.
Open the scene as-is (no inheritance or anything.) Save as tscn.
Check and see that there is an armature, a skeleton and a mesh. AnimationPlayer in the root plays animations as expected.
Create new Spatial node (though I think type doesn't matter,)
Select the armature with skeleton and meshes inside. Also select AnimationPlayer.
Move the whole selection together into the new Spatial node.
Paths get changed and playback breaks.

Minimal reproduction project:

testproject.zip

For reference, this was originally asked about on the Godot Forums: https://godotforums.org/discussion/25903/editor-animation-breaks-when-moving-every-node-inside-another#latest

I'd just like to add that this bug also happens when using a scene with AnimationPlayer that references child nodes of the scene. In this case, if you reparent any of the instances of the scene in the editor, the animation paths for the scene gets reset to the absolute path from the root. The animation path in the scene gets set to the name of the scene instance that you just reparented, breaking all the other instances. This is compounded by the fact that it's easy to accidentally drop a new instance as a child to a selected node, which then breaks animations for all instances when you reparent it to the game node.
So even if you manually change the paths in the scene, the next time you reparent an instance of the scene, the scene gets changed and the paths break.

(Dropping it here in case is helpful for anyone)
Reparenting the nodes via right-click menu (instead of directly draggin) worked for me:

(I always forgot it, but is always a good idea to make things with the right click menu, from reparenting, moving things, rename, etc., Specially on nodes who deppends on different subresources).
PS: Stills present in 3.4.stable

Still presents in 3.5 stable.


How???

How Can I Put A Default Rank In Skyblock
And A Default Rank For Faction
Its Like
Rank For Skyblock
ANd Rank For Faction
PLss Reply

A server can only have one default group in PEX 1.x versions.  PEX 2.x is still in development, but will offer that feature.


Fix result ls always filtering by benchmark

This PR fixes an issue where medperf result ls would always fetch results from a benchmark even if not passsed.

Hey Alejandro! thanks! can you please rebase your changes according to the current main branch? I see a lot of old commits and also some extra changes related to another PR: #435

Huh, I thought I made sure I was working with the latest main branch. Thanks @hasan7n for reminding me! I must be messing something up with my workflow and I'll keep it in mind. It should look good now!


JsonNodeConfigurationFactory improve

To support all Jackson deserialization features,  init TreeTraversingParser by another constructor accepting the object mapper.

For the history, this request grew out of https://github.com/bootique/bootique-jdbc/issues/48


Perf opportunity: avoid numpy.isclose()

overview
The same performance analyis mentioned in #4481 also indicated that 10.2% of time is spent in numpy.isclose():

A brief look at numpy.isclose() shows it to be a very general purpose function, handling cases of arrays, etc which we don't need. All we need is to be able to compare two scalars, for which the following function suffices;
def is_close(x, y, atol=1e-08, rtol=1e-05):
    if x == y:
        return True
    return abs(x-y) <= atol + rtol * abs(y)

Avoiding numpy.isclose() in favor of the above sould be a simple but significant performance improvement.
current behavior
An overabundance of time is spent comparing two scalars for closeness.
steps to reproduce
See above.
expected behavior
Simple things should be fast :-).

@rgatkinson thanks for the report - great catch! We'll take a look at it. It's a fundamental part of our system and requires a lot of testing but the proposed fix does look really simple and valid.


Mondo is not updated on Bioportal

https://bioportal.bioontology.org/ontologies/MONDO

how do we get it updated?

BioPortal's nightly pull process for MONDO fails due to a known issue, documented mostly in these tickets:
https://github.com/ncbo/ontologies_linked_data/issues/112
https://github.com/ncbo/ncbo_cron/issues/23
We actually have an open pull request from an external developer that I believe would fix this issue. Let me consult with the team to see if we can accept it and get a REST API release out.

The latest MONDO that I manually uploaded is available in BioPortal now. This is the version number:
data-version: releases/2022-07-01/reasoned.owl.owl

@jvendetti Thank you for dealing with that manually for now:

What URL are you using for obtaining mondo? We have no ontology with that data-version
Is there anything we can do to help moving the fix of the PURL->GitHub release issue along? Many of the key OBO ontologies are published as GitHub releases, including Uberon, Mondo, ZP and they will only become more now.. Also is there a way to see publicly which URLs you are using for downloading all the ontologies in bioportal? For OBO ontologies, do you always use the OBO Purl?

Hi @matentzn

What URL are you using for obtaining mondo? We have no ontology with that data-version

I did the following to download the latest MONDO:

Navigated to the MONDO page at the OBO Foundry website: https://obofoundry.org/ontology/mondo.html
Clicked on the "mondo.obo" link in the "Products" section

With the developer console open in the browser, I can see that clicking on that link results in the following series of redirects:
GET http://purl.obolibrary.org/obo/mondo.obo
GET https://github.com/monarch-initiative/mondo/releases/latest/download/mondo.obo
GET https://github.com/monarch-initiative/mondo/releases/download/v2022-07-01/mondo.obo

... and here is the first 5 lines of the resulting download that shows the data-version attribute:
format-version: 1.2
data-version: releases/2022-07-01/reasoned.owl.owl
subsetdef: clingen "initial subset used by clingen"
subsetdef: disease_grouping "disease_grouping"
subsetdef: do_inheritance_inconsistent "classes where the corresponding DO term is both AR and AD https://github.com/monarch-initiative/monarch-disease-ontology/issues/406"

If there's a different file you'd like me to manually upload, let me know.

Is there anything we can do to help moving the fix of the PURL->GitHub release issue along?

I'm looking into this now, and hope to have something in place by next week. I'll follow up if something goes awry.

Also is there a way to see publicly which URLs you are using for downloading all the ontologies in bioportal?

We don't offer a page with this sort of listing. Each BioPortal user has access to this information for the ontologies that they maintain. I looked at MONDO and see that I'm the only person with administrative access. If you or others in your group have BioPortal accounts, I'm happy to add you as MONDO administrators so that you can access/modify your ontology metadata.

For OBO ontologies, do you always use the OBO Purl?

Not necessarily - we don't have an official policy for this. Essentially it's up to the person who submits the ontology to specify the URL they'd like to use.

@jvendetti thank you for your detailed report. It lead me to fix some oddity in the version IRI #5181 :)
Is there any reason you use the mondo.obo instead of mondo.owl (which is more complete)?

@matentzn - BioPortal calculates and displays a series of metrics for every ontology:

... and this part of the processing fails for mondo.owl. See https://github.com/ncbo/bioportal-project/issues/125 for full details. We've been serving the OBO version since this issue was reported.
Something occurs to me - @stdotjohn is in the process of refactoring the code to calculate max depth. When the new code is committed, we should test against mondo.owl to see if the problem persists.

Thank you @jvendetti

@matentzn - I performed a production release yesterday that contained the fix for the PURL -> GitHub release issue. I reinstated the pull URL (http://purl.obolibrary.org/obo/mondo.obo) for MONDO and verified that BioPortal successfully pulled the source file from GitHub. Going forward, the nightly pull process should automatically pick up new versions.


Remove underline from left pagination link

Removes the underline that extends past the left pagination link's border. Before:

After:

👍


This repo needs to be deprecated and removed

All lua samples are now located in https://github.com/SparkPost/momentum_sample_policy

I've staged the migration to here:
https://github.com/SparkPost/momentum_sample_policy/tree/consolidate/move_jira_lua_examples


FileNotFoundError: [WinError 3] specifically file "0_gt_wavs"

Tested multiple times but came out to the same issue
['extract_f0_print.py', 'C:\TCHT\Retrieval-based-Voice-Conversion-WebUI/logs/suisei', '12', 'harvest']
['extract_feature_print.py', 'cuda:0', '1', '0', '0', 'C:\TCHT\Retrieval-based-Voice-Conversion-WebUI/logs/suisei', 'v1']
C:\TCHT\Retrieval-based-Voice-Conversion-WebUI/logs/suisei
load model(s) from hubert_base.pt
move model to cuda
Traceback (most recent call last):
File "C:\Python310\lib\site-packages\gradio\routes.py", line 437, in run_predict
output = await app.get_blocks().process_api(
File "C:\Python310\lib\site-packages\gradio\blocks.py", line 1352, in process_api
result = await self.call_function(
File "C:\Python310\lib\site-packages\gradio\blocks.py", line 1093, in call_function
prediction = await utils.async_iteration(iterator)
File "C:\Python310\lib\site-packages\gradio\utils.py", line 341, in async_iteration
return await iterator.anext()
File "C:\Python310\lib\site-packages\gradio\utils.py", line 334, in anext
return await anyio.to_thread.run_sync(
File "C:\Python310\lib\site-packages\anyio\to_thread.py", line 33, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "C:\Python310\lib\site-packages\anyio_backends_asyncio.py", line 877, in run_sync_in_worker_thread
return await future
File "C:\Python310\lib\site-packages\anyio_backends_asyncio.py", line 807, in run
result = context.run(func, *args)
File "C:\Python310\lib\site-packages\gradio\utils.py", line 317, in run_sync_iterator_async
return next(iterator)
File "C:\TCHT\Retrieval-based-Voice-Conversion-WebUI\infer-web.py", line 932, in train1key
set([name.split(".")[0] for name in os.listdir(gt_wavs_dir)])
FileNotFoundError: [WinError 3] The system cannot find the path specified: 'C:\TCHT\Retrieval-based-Voice-Conversion-WebUI/logs/suisei/0_gt_wavs'

there is some other errors before this
see preprocess.log

What should we do if we see this error?

preprocess.log won't inform you of anything useful, since this is a problem that occurs when training is about to start.
What solved it for me was running the bat from the location of the original directory used when installing everything.
So if you initially set things up in C:/SomeFolder, it will then give the FileNotFoundError if you've moved the repository outside of that directory, say C:/NewFolder/SomeFolder. In my case, I just had to move it back to C:/SomeFolder.
Not sure how to reconfigure it properly, but that was how I solved it in my case.

I am running into this issue as well, version RVC-beta-v2-0618...

I also have this problem....
C:\Users\Max Sun\Desktop\RVC-beta\RVC-beta-v2-0618>runtime\python.exe infer-web.py --pycmd runtime\python.exe --port 7897
Use Language: zh_CN
Running on local URL:  http://<IP_ADDRESS>:7897
Traceback (most recent call last):
File "C:\Users\Max Sun\Desktop\RVC-beta\RVC-beta-v2-0618\trainset_preprocess_pipeline_print.py", line 20, in
f = open("%s/preprocess.log" % exp_dir, "a+")
FileNotFoundError: [Errno 2] No such file or directory: 'C:\Users\Max/preprocess.log'
Traceback (most recent call last):
File "C:\Users\Max Sun\Desktop\RVC-beta\RVC-beta-v2-0618\extract_f0_print.py", line 14, in
f = open("%s/extract_f0_feature.log" % exp_dir, "a+")
FileNotFoundError: [Errno 2] No such file or directory: 'C:\Users\Max/extract_f0_feature.log'
Traceback (most recent call last):
File "C:\Users\Max Sun\Desktop\RVC-beta\RVC-beta-v2-0618\extract_feature_print.py", line 29, in
f = open("%s/extract_f0_feature.log" % exp_dir, "a+")
FileNotFoundError: [Errno 2] No such file or directory: 'C:\Users\Max/extract_f0_feature.log'
Traceback (most recent call last):
File "C:\Users\Max Sun\Desktop\RVC-beta\RVC-beta-v2-0618\runtime\lib\site-packages\gradio\routes.py", line 321, in run_predict
output = await app.blocks.process_api(
File "C:\Users\Max Sun\Desktop\RVC-beta\RVC-beta-v2-0618\runtime\lib\site-packages\gradio\blocks.py", line 1006, in process_api
result = await self.call_function(fn_index, inputs, iterator, request)
File "C:\Users\Max Sun\Desktop\RVC-beta\RVC-beta-v2-0618\runtime\lib\site-packages\gradio\blocks.py", line 859, in call_function
prediction = await anyio.to_thread.run_sync(
File "C:\Users\Max Sun\Desktop\RVC-beta\RVC-beta-v2-0618\runtime\lib\site-packages\anyio\to_thread.py", line 31, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "C:\Users\Max Sun\Desktop\RVC-beta\RVC-beta-v2-0618\runtime\lib\site-packages\anyio_backends_asyncio.py", line 937, in run_sync_in_worker_thread
return await future
File "C:\Users\Max Sun\Desktop\RVC-beta\RVC-beta-v2-0618\runtime\lib\site-packages\anyio_backends_asyncio.py", line 867, in run
result = context.run(func, *args)
File "C:\Users\Max Sun\Desktop\RVC-beta\RVC-beta-v2-0618\runtime\lib\site-packages\gradio\utils.py", line 408, in async_iteration
return next(iterator)
File "C:\Users\Max Sun\Desktop\RVC-beta\RVC-beta-v2-0618\infer-web.py", line 1072, in train1key
set([name.split(".")[0] for name in os.listdir(gt_wavs_dir)])
FileNotFoundError: [WinError 3] 系统找不到指定的路径。: 'C:\Users\Max Sun\Desktop\RVC-beta\RVC-beta-v2-0618/logs/untest/0_gt_wavs'

Create a new folder within the project, place the materials in this folder, and specify the material path as the path of the newly created folder.

Create a new folder within the project, place the materials in this folder, and specify the material path as the path of the newly created folder.

It solves my problem

Create a new folder within the project, place the materials in this folder, and specify the material path as the path of the newly created folder.

With project, are you referring to where the original audio files are located, or where the unfinished training data is located?

With project, are you referring to where the original audio files are located, or where the unfinished training data is located? Apologies if my question is potentially stupid

original audio files

At first, I tried creating a new folder within the project, placing the materials in this folder, and specifying the material path as the path of the newly created folder, but it didn't work. However, when I moved the entire 'rvc' folder with the materials to the root directory of the C drive, the program started running. I guess my initial path was too long for the program.

Create a new folder within the project, place the materials in this folder, and specify the material path as the path of the newly created folder.

With project, are you referring to where the original audio files are located, or where the unfinished training data is located?  Huh.

At first, I tried creating a new folder within the project, placing the materials in this folder, and specifying the material path as the path of the newly created folder, but it didn't work. However, when I moved the entire 'rvc' folder with the materials to the root directory of the C drive, the program started running. I guess my initial path was too long for the program.

I guess it might be caused by spaces in the folder names.

It actually does seem like that this RVC web UI hates spaces. Everything works for me now since I've removed any and all spaces from my paths, and this specific error only appears when I've specified a path that contains spaces.
That is very annoying, but at least now I know how to avert the error.

Try downloading this:
https://huggingface.co/lj1995/VoiceConversionWebUI/blob/main/mute.zip

I was able to resolve this issue by moving the training set data folder to the root directory where the UI .bat file is launched.

I resolved this issue a while ago by just not having any spaces in the file path.