Sanity checker

We need a sanity checker to check for problems with the data.
In a workflow you would go Constraint Builder -> CMIP5 -> Sanity Check.

@didiermonselesan and WIll Hobbs in Tasmania pretty much know all the sanity checking that would need to be done. They are going to list the types of things that need checking below...

Also related to this (and a wider issue than just the plugin) is to work out what to do when the sanity checker fails - how do we deal with 'faulty' data in the archive at NCI?

Tim,
Agreed. The first thing would be to log the failures and the reasons  why the workflow fails on particular files.
One of the first steps for CMIP or any data files of the same kind would be to check individual files (as produced by the modelling group) to make sure they comply with the a priori agreed ‘conventions’ regarding, for examples

naming of the file
naming of the file together with meta data (especially inheritance, i.e. parent  experiment,  time correspondence, etc …)
data itself, correct missing/fill values, data range given unit given variable, monotonicity and gaps given time frequency and bounds, missing coordinates and coordinates bounds

Then possibly moving to more ‘subjective' checks

Physically relevant checks (e.g. daily and seasonal cycles

Note that some packages do perform conventions checking either for single files or when apply across files.
Cheers, Didier
From: Tim Bedin <notifications<EMAIL_ADDRESS>Reply-To: CWSL/cwsl-mas <reply<EMAIL_ADDRESS>Date: Friday, 5 June 2015 4:26 pm
To: CWSL/cwsl-mas <cwsl-mas<EMAIL_ADDRESS>Cc: Didier Monselesan <Didier.Monselesan<EMAIL_ADDRESS>Subject: Re: [cwsl-mas] Sanity checker (#42)
Also related to this (and a wider issue than just the plugin) is to work out what to do when the sanity checker fails - how do we deal with 'faulty' data in the archive at NCI?
—
Reply to this email directly or view it on GitHubhttps://github.com/CWSL/cwsl-mas/issues/42#issuecomment-109175388.

My feeling is that rather than using the 'sanity checker' to handle exceptions it's probably best just to flag issues that can then be investigated. I also agree that as a first run checking the metadata on each file is complete and accurate would be a good start (we would hope that PCMDI would do this, but that's unlikely).
Physical-consistency checks would also be helpful, but we'd need to consider each variable separately. Some variables lend themselves to 'hard limits' e.g. salinity and precip can never be less than zero (although they are in some CMIP5 models!); others are less obvious (what should the maximum allowable be temperature be?)
I would add a test of the time coords on all merged lists of variables across a range of files. Time arrays should be consistent across all files within the same experiment, monotonic, have no gaps, and no 'overlaps'. In my experience these types of errors have been the biggest and most persistent headache.
There are some simple 'experiment' tests based on global energy balance that both Didier and I have found can highlight some sneaky issues; these would not be applied to all files of course, but are a useful model diagnostic.
Will
From: didiermonselesan <notifications<EMAIL_ADDRESS>Reply-To: CWSL/cwsl-mas <reply<EMAIL_ADDRESS>Date: Sunday, 7 June 2015 9:06 AM
To: CWSL/cwsl-mas <cwsl-mas<EMAIL_ADDRESS>Cc: Will Hobbs <will.hobbs<EMAIL_ADDRESS>Subject: Re: [cwsl-mas] Sanity checker (#42)
Tim,
Agreed. The first thing would be to log the failures and the reasons why the workflow fails on particular files.
One of the first steps for CMIP or any data files of the same kind would be to check individual files (as produced by the modelling group) to make sure they comply with the a priori agreed 'conventions' regarding, for examples

naming of the file
naming of the file together with meta data (especially inheritance, i.e. parent experiment, time correspondence, etc ...)
data itself, correct missing/fill values, data range given unit given variable, monotonicity and gaps given time frequency and bounds, missing coordinates and coordinates bounds

Then possibly moving to more 'subjective' checks

Physically relevant checks (e.g. daily and seasonal cycles

Note that some packages do perform conventions checking either for single files or when apply across files.
Cheers, Didier
From: Tim Bedin <notifications@github.commailto:notifications<EMAIL_ADDRESS>Reply-To: CWSL/cwsl-mas <reply@reply.github.commailto:reply<EMAIL_ADDRESS>Date: Friday, 5 June 2015 4:26 pm
To: CWSL/cwsl-mas <cwsl-mas@noreply.github.commailto:cwsl-mas<EMAIL_ADDRESS>Cc: Didier Monselesan <Didier.Monselesan@csiro.aumailto:Didier.Monselesan<EMAIL_ADDRESS>Subject: Re: [cwsl-mas] Sanity checker (#42)
Also related to this (and a wider issue than just the plugin) is to work out what to do when the sanity checker fails - how do we deal with 'faulty' data in the archive at NCI?

Reply to this email directly or view it on GitHubhttps://github.com/CWSL/cwsl-mas/issues/42#issuecomment-109175388.

Reply to this email directly or view it on GitHubhttps://github.com/CWSL/cwsl-mas/issues/42#issuecomment-109656913.
University of Tasmania Electronic Communications Policy (December, 2014).
This email is confidential, and is for the intended recipient only. Access, disclosure, copying, distribution, or reliance on any of it by anyone outside the intended recipient organisation is prohibited and may be a criminal offence. Please delete if obtained in error and email confirmation to the sender. The views expressed in this email are not necessarily the views of the University of Tasmania, unless clearly intended otherwise.

In order to get this into the tool it would have to be implemented in a script that takes in the name of the file to check on the command line. Something like:
./sanity_checker tas_1981_..._ACCESS1.0.nc

etc.
We could have it integrated with every workflow, but I think it could be a better approach to have a specific workflow just for data checking.
Another issue is what to do when problems are found - should they be fixed in the downloaded data? Should the files be deleted from the archive? Do the modelling groups need to be contacted this far after release? I know that people at Aspendale have been working on this problem as part of the data archive download.
I am getting in touch with NCI to seek their input on this issue.

During the CWSLab phone meeting last week @taerwin suggested that the checking/cleaning of CMIP5 data could handled by NCI. Instead of pointing at the raw CMIP5 data directory, the CWSLab workflow tool could instead be pointed at directory of data that has passed a quality check. If users found an error in the quality checked data, they could report it to NCI and that data could be removed from the directory until the data were fixed (and an appropriate test could be added to the quality check). NCI would report errors back to PCMDI if necessary.
NCI would obviously need assistance from people like @didiermonselesan and @willrhobbs in defining the checks that should be included in the quality checking procedure. For the sake of transparency it would be good if the code for the tests were hosted on a public GitHub repo (possibly in the CWSL repo).

Late to the party, sorry. I'm watching this space now so you can contact me here, but email's probably still better for me having a searchable record :) I think you all have my address.
Anyway, if/whenever you need NCI input, just give me a yell. We've got some errata tracking pages similar to the ACCESS and CMIP5 official structures but that will be open for all NCI users to edit once our Confluence goes live beyond NCI. In the mean time, just keep reporting anything you find to me directly. Sorry for the inefficiency.... Will be good to see a sanity checker tool developed! :)


Error starting o3d3xx-viewer

As soon as I start the program I get this error message and the application crashes.
error: (-218) Library was built without OpenGL support in function cvNamedWindow
I built opencv 3.0 using this command that seems to include OpenGL support
cmake -D CMAKE_BUILD_TYPE=RELEASE -D CMAKE_INSTALL_PREFIX=/usr/local -D BUILD_NEW_PYTHON_SUPPORT=ON -D WITH_V4L=ON -D WITH_OPENGL=ON ..
Probably I did something wrong, any ideas?
Thanks,
Emanuele

We currently only support OpenCV 2. More info when I am at a computer.
(Sorry).
--
Tom Panzarella
(sent from my phone)
On Dec 9, 2015 5:25 PM, "Obbart"<EMAIL_ADDRESS>wrote:

As soon as I start the program I get this error message and the
application crashes.
error: (-218) Library was built without OpenGL support in function
cvNamedWindow
I built opencv 3.0 using this command that seems to include OpenGL support
cmake -D CMAKE_BUILD_TYPE=RELEASE -D CMAKE_INSTALL_PREFIX=/usr/local -D
BUILD_NEW_PYTHON_SUPPORT=ON -D WITH_V4L=ON -D WITH_OPENGL=ON ..
Probably I did something wrong, any ideas?
Thanks,
Emanuele
—
Reply to this email directly or view it on GitHub
https://github.com/lovepark/libo3d3xx/issues/31.

Guidance from the following closed issues may also be useful:
https://github.com/lovepark/libo3d3xx/issues/18
https://github.com/lovepark/o3d3xx-ros/issues/8
https://github.com/lovepark/libo3d3xx/issues/19
Bottom-line: Just install the binaries for OpenCV 2.4 via apt-get from the official Ubuntu repos and you should be fine.

ok, now it works just fine, thanks


brew install from source installs unnecessary formulas

Please always follow these steps:

[X] Confirmed this is a problem with running a brew command and not brew installing or the post-install behaviour of one or more formulae? If it's a formulae-specific problem please file this issue at the relevant tap e.g. for Homebrew/homebrew-core https://github.com/Homebrew/homebrew-core/issues/new
[X] Ran brew update and retried your prior step?
[X] Ran brew doctor, fixed all issues and retried your prior step?
[X] Ran brew config and brew doctor and included their output with your issue?

Having all mame dependencies installed (build and run), and installing mame from source requires installation of unrelated packages:
$ brew info mame
mame: stable 0.189, HEAD
Multiple Arcade Machine Emulator
http://mamedev.org/
Not installed
From: https://github.com/Homebrew/homebrew-core/blob/master/Formula/mame.rb
==> Dependencies
Build: pkg-config ✔, sphinx-doc ✔
Required: sdl2 ✔, expat ✔, jpeg ✔, flac ✔, sqlite ✔, portmidi ✔, portaudio ✔, utf8proc ✔
==> Requirements
Required: macOS >= 10.10 ✔

$ brew install -s mame
==> Installing dependencies for mame: cython
==> Installing mame dependency: cython
[...]

I think this is because cython is a build dependency of mame's dependency portmidi:
$ brew info portmidi
portmidi: stable 217
Cross-platform library for real-time MIDI I/O
https://sourceforge.net/projects/portmedia/
/usr/local/Cellar/portmidi/217_1 (15 files, 192.5KB) *
  Poured from bottle on 2017-09-06 at 14:41:40
From: https://github.com/Homebrew/homebrew-core/blob/master/Formula/portmidi.rb
==> Dependencies
Build: cmake ✔, cython ✘

However, it still does not make sense: I already have portmidi installed, so it should recurse down to its build dependencies.

Same issue as https://github.com/Homebrew/brew/issues/3033 maybe?

Right you are!

Confirms it reproduces with formulae other than wireshark at least 😭.


i always get 1 for the result

hello, thank you very much for your code but there is something I do not understand.
I saved some training .wav file in the following path:      "\speaker-recognition-py3-master\tmp\person\1.wav", "\speaker-recognition-py3-master\tmp\person\2.wav", "\speaker-recognition-py3-master\tmp\person\3.wav"
when I tried to predict, this was the output.

could u help me with the problem?
thank you

I have the same problem

how to give input to this code in spyder

请问如何添加音频数据进行训练？

我也遇到了同样的问题，有人解答一下吗？

Actually, I had this problem too and I fixed it by training all the .wav files in just one command instead of training them one by one.
The reason ,which caused this problem, I guess it's because the code will generate a model.out file for every training command. If you train them one by one, the posterior model.out file will replace the prior one. As a consequence, you will always get a score 1.0 for your latest training sample.
Hope this could be helpful.

Sir what was length of each training file?

Actually, I had this problem too and I fixed it by training all the .wav files in just one command instead of training them one by one.
The reason ,which caused this problem, I guess it's because the code will generate a model.out file for every training command. If you train them one by one, the posterior model.out file will replace the prior one. As a consequence, you will always get a score 1.0 for your latest training sample.
Hope this could be helpful.

Sir what was length of each training file?

Actually, I had this problem too and I fixed it by training all the .wav files in just one command instead of training them one by one.
The reason ,which caused this problem, I guess it's because the code will generate a model.out file for every training command. If you train them one by one, the posterior model.out file will replace the prior one. As a consequence, you will always get a score 1.0 for your latest training sample.
Hope this could be helpful.

It up to you. In my case, I recorded three 1-min .wav files for each volunteer.


ascii file reading crashes

pyfocal crashed when trying to read in both of the attached ascii files.
example_spec_ipac.txt
example_spec_ascii.txt

@hcferguson , #48 should fix this, as far as I could test from your files. Please use the latest master and try again. Thanks!

Tried and it loads but crashes when I try to make the plot. Not sure if I've done the installation right though.

@hcferguson , please post the traceback here. Thanks.

Also, were you able to plot with the FITS test file provided by @nmearl ?

Yes.

Here's the traceback:
(pyf_env)Henrys-MacBook-Pro:specview hcferguson$ pyfocal
Creating from file.
WARNING: FITSFixedWarning: The WCS transformation has more axes (1) than the image it is associated with (0) [astropy.wcs.wcs]
WARNING:astropy:FITSFixedWarning: The WCS transformation has more axes (1) than the image it is associated with (0)
WARNING: UnitsWarning: 'erg/cm^2/s/Angstrom' contains multiple slashes, which is discouraged by the FITS standard [astropy.units.format.generic]
WARNING:astropy:UnitsWarning: 'erg/cm^2/s/Angstrom' contains multiple slashes, which is discouraged by the FITS standard
WARNING: UnitsWarning: The unit 'Angstrom' has been deprecated in the FITS standard. Suggested: 10**-1 nm. [astropy.units.format.utils]
WARNING:astropy:UnitsWarning: The unit 'Angstrom' has been deprecated in the FITS standard. Suggested: 10**-1 nm.
DataFactory.create_layer: None, None
(pyf_env)Henrys-MacBook-Pro:specview hcferguson$ pyfocal
Creating from file.
DataFactory.create_layer: None, None
Traceback (most recent call last):
  File "/Users/hcferguson/Documents/stsci/science_software/data_analysis_tools/sprints/specview/pyfocal/pyfocal/ui/controller.py", line 38, in <lambda>
    lambda: self.new_plot_sub_window())
  File "/Users/hcferguson/Documents/stsci/science_software/data_analysis_tools/sprints/specview/pyfocal/pyfocal/ui/controller.py", line 218, in new_plot_sub_window
    self.add_plot(data=data, window=window)
  File "/Users/hcferguson/Documents/stsci/science_software/data_analysis_tools/sprints/specview/pyfocal/pyfocal/ui/controller.py", line 249, in add_plot
    plot_container = plot_manager.new_line_plot(layer, window)
  File "/Users/hcferguson/Documents/stsci/science_software/data_analysis_tools/sprints/specview/pyfocal/pyfocal/interfaces/managers.py", line 224, in new_line_plot
    style, pen)
  File "/Users/hcferguson/Documents/stsci/science_software/data_analysis_tools/sprints/specview/pyfocal/pyfocal/interfaces/factories.py", line 146, in create_line_plot
    if plot_container.layer.uncertainty is not None:
  File "/Users/hcferguson/Documents/stsci/science_software/data_analysis_tools/sprints/specview/pyfocal/pyfocal/core/data.py", line 136, in uncertainty
    return self._source.uncertainty[self._mask]
TypeError: 'NoneType' object is not subscriptable
Abort trap: 6

@hcferguson , this should really be fixed now with #51. Please try again with latest master version and let me know if it works for you. Thank you for your patience.

Works now with both files.

Good to hear! :+1:


lower-level API

its a bit clunky to use this for one-off calls like readme or contents.
would be nice to have a lower level callback based API that lives in its own module. it would not deal with pagination. it can also be optimized for a very small browser footprint using xhr instead of got.
same setup as:

https://github.com/mattdesl/marvel-comics-api
https://github.com/mattdesl/marvel-comics-api-stream

conceptually idea is good. but given libs are totally no logical. ;d
Just side comment on both libs
in *-stream you use through2 to create empty stream (which is pretty slow process and btw that's the reason why gulp core (glob-stream) is so damn slow) and then use the async api, instead of just create one module that will inherit nature of got - if not cb so stream (before v4). got have streaming api, there's no reason to create stream form through.

but given libs are totally no logical

Hmm, what do you mean?

and then use the async api, instead of just create one module that will inherit nature of got

I can't return the got stream since these modules need to span multiple requests. I would be interested in seeing how you think these modules could be improved/optimized without through2, though.

This now exists, and its 9kb in the browser:
https://github.com/Jam3/gh-api


Error handling on channel closing while reconnecting.

Hello, probably here error handling missed.
It looks like even if it needs to be ignored here it would be good to add some logging in case of error. It is the wrong behavior of Close and the developer needs to know that something not good happened.

Agree, but this error will have some reason, and probably the old channel won't be closed. In this case, the channel can remain open and unused. So what do you think about just logging with 'warn' level? Added how it can be to PR.


Fix for #809

This addresses https://github.com/sensu/sensu-puppet/issues/809
and replaces https://github.com/sensu/sensu-puppet/pull/811
General

[x] Update README.md with any necessary configuration snippets

[x] New parameters are documented

[x] New parameters have tests

[x] Tests pass - bundle exec rake validate lint spec

Thanks @alvagante

Released in v2.37.0


az network front-door routing-rule create --backend-pool is mandatory

Parameter --backend-pool is documented as optional, but it is mandatory: BadRequest - Property 'FrontdoorEntity.RoutingRules[1].Properties.RouteConfiguration.BackendPool' is required but it was not set is the error, if argument was not supplied.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: bc41d7b5-ab21-fe9b-2f2e-93ac02e5af86
Version Independent ID: 67398425-8b96-f515-72af-22255ea1ae49
Content: az network front-door routing-rule
Content Source: latest/docs-ref-autogen/ext/front-door/network/front-door/routing-rule.yml
GitHub Login: @rloutlaw
Microsoft Alias: routlaw

HI @MyronFanQiu  could you pls have a look? thanks.

add to S167.

@wasker Thanks. We will fix it later.

@wasker I just checked the code. --backend-pool is required when you try to create a Forward routing rule. But it's not required for a Redirect rule. So it's by design to mark it as optional. I updated the help message.


Error: Can't find SEV_ES_RESET_BLOCK_GUID entry in OVMF table

I am trying to run the sev-snp-measure tool in SNP mode using the example in the readme:
sev-snp-measure --mode snp --vcpus=1 --vcpu-type=EPYC-v4 --ovmf=OVMF.fd --kernel=vmlinuz --initrd=initrd.img --append="console=ttyS0 loglevel=7"
but i get the following error:
Error: Can't find SEV_ES_RESET_BLOCK_GUID entry in OVMF table
the type of the OVMF.fd file is the following:
file OVMF.fd
OVMF.fd: Matlab v4 mat-file (little endian) \226v\213L\251\205'G\007[OP, numeric, rows 0, columns 0
i tried with different images but the problem always seems to be the OVMF.fd file.
what could be the cause of the error? is there a specific format that i have to use ?

The SEV_ES_RESET_BLOCK_GUID exists in OVMF builds for more than 3 years, if I recall correctly. Unless something changed recently that removed it...
How did you build/obtain OVMF.fd ? Currently, for SNP, you should follow the instructions in https://github.com/AMDESE/AMDSEV/tree/snp-latest .

Yes i am following the instruction of https://github.com/AMDESE/AMDSEV/tree/snp-latest .
And i am also able to boot the SNP VM with the OVMF.fd file.
But then when i try to run the sev-snp-measure tool i still get that error message.

hi, yes here is the file.
https://drive.google.com/file/d/1_4A5ON1cPUgm6nntCXWoUwEaflCtLbHW/view?usp=drive_link

Thanks @LucaStabo for providing the file.
It is very weird:
First, the image.fd file is only 540672 bytes long. Usually OVMF builds are 3-4 MB.
  Can you share the QEMU command-line that refers to that file and successfully boots an SNP VM?
Maybe there's a mix-up between OVMF_VARS and OVMF_CODE files?

Hi,
i followed the instruction of : https://github.com/AMDESE/AMDSEV/tree/snp-latest
after creating an empty 10G qcow2 image file, i downloaded an official ubuntu server .iso file and i run the command
./launch-qemu.sh -hda <your_qcow2_file> -cdrom <your_distro_installation_iso_file>
to launch it, i used :
./launch-qemu.sh -hda <your_qcow2_file> -sev-snp

@larrydewey Any idea why the instructions in AMDSEV will generate an OVMF build that is only ~500KB and contains mostly 0xff bytes? And how could that successfully launch an SNP VM?

@LucaStabo Please make sure again that the file you use is the OVMF_CODE.fd generated by the build process (and not OVMF_VARS.fd).

i tryed again and OVMF_CODE.fd and OVMF_VARS.fd are correct.
any other reasons why this could be happening?

@LucaStabo Can you please paste again the size OVMF_CODE.fd (in bytes) and the hexdump of the last 32 bytes of OVMF_CODE.fd ?


Automated Downsampling

What is missing?
A feature that I would love to use more is promscales downsampling. However it is pretty low level if you want to do continuous aggregates. It involves running SQL commands against your timescaledb manually.
It would be nice if this chart could handle some of this automatically, basically giving it your SQL queries, or metric names, and running these queries as a job for you automatically.
Why do we need it?
It would allow greater adoption of downsampling features that are offered in timescale
Copy from: https://github.com/timescale/tobs/issues/558

Potential resolution: https://github.com/timescale/tobs/issues/558#issuecomment-1221923148


Cannot read property 'SIGN_IN_CANCELLED' of undefined   Evaluating module://react-native-google-signin.js

On adding reference to react-native-google-signin getting following compilation error:
Cannot read property 'SIGN_IN_CANCELLED' of undefined
Evaluating module://react-native-google-signin.js

Hi there! Sorry you're having an issue. As the issue template explains, we require that you provide a runnable example that reproduces your issue (see the issue template). The reason is that maintainers do not have time to try reproduce bugs themselves. Please try to minimize the superfluous code and focus only on reproducing the bug.
please create a new issue with this and we'll be happy to review it!


Commit the new package version on release workflow

Right now, the */dist folders are push only with a tag and don't land into the main branch.
This is also the case for package.json, meaning it doesn't have the right version after a release.
There should be 2 commits, one in main for only package.json, and a tagged one with */dist.

Theoretically closed in 5174d1a28633c50f672ff30a19460defa2a493b5


added dark mode in App.js

Before:

After:

Refer #116

Refer #116

Refer #116

So it's on Low Priority.
But Why am I getting this issue ?
At least 'now bot' could have deployed the code so that i could see a preview.
Error 1:

Main Issue:

Am I doing anything wrong ?

@devmanojsoni Doesn't build on my PC either. Here are the errors

@abhishekkhandait @devmanojsoni I think it's best if you create an issue regarding Dark mode and ask people to comment on their preferred colour palette. I'm afraid we won't be able to merge this until there's a consensus.


PWD return 500 when click "start" button

POST Error:
Request URL:https://labs.play-with-docker.com/
Request method:POST
Remote address:<IP_ADDRESS>:443
Status code:
500
Version:HTTP/2.0
Referrer Policy:no-referrer-when-downgrade

Response Headers:
HTTP/2.0 500 Internal Server Error
location: /500
content-type: text/plain; charset=utf-8
content-length: 0
date: Sun, 14 Jul 2019 14:47:38 GMT
X-Firefox-Spdy: h2

@marcosnils
Thank you for fixing this, it works again.


[HOLD for payment 2023-10-16] [$500] Report screen becomes empty when resizing to big size from LHN

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Action Performed:

Resize the app to small width.
Navigate to LHN.
Resize again to larger width

Expected Result:
The report screen should be present on the right
Actual Result:
There is no report screen on the right.
Workaround:
Can the user still use Expensify without this being fixed? Have you informed them of the workaround?
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android / native
[ ] Android / Chrome
[ ] iOS / native
[ ] iOS / Safari
[x] MacOS / Chrome / Safari
[ ] MacOS / Desktop

Version Number: 1.3.74-2
Reproducible in staging?: y
Reproducible in production?: y
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Notes/Photos/Videos: Any additional supporting documentation
https://github.com/Expensify/App/assets/43996225/9d737caa-a219-4a66-8494-0444e76c90d6
https://github.com/Expensify/App/assets/43996225/551328de-861d-40ed-bfb0-ab480ebdd2fb
Expensify/Expensify Issue URL:
Issue reported by: @esh-g
Slack conversation: https://expensify.slack.com/archives/C049HHMV9SM/p1695664942781769
View all open jobs on GitHub
Upwork Automation - Do Not Edit

Upwork Job URL: https://www.upwork.com/jobs/~0117356277518975bf
Upwork Job ID:<PHONE_NUMBER>110151168
Last Price Increase: 2023-09-27
Automatic offers:

tienifr | Contributor | 26975213
esh-g | Reporter | 26975214

I think this is normal behaviour since in the videos, once resized to small screen the Back button is pressed which closes the report screen, in this case it is expected that when you resize back to big screen no report is opened hence we see empty screen.
If you resize to small screen but don't close the chat, when you resize back to big screen the report screen will re-appear.
This can be observed in the URL too:

as long as the URL is r/:reportId the report screen will persist on resize
if the report back button is clicked on small screen size then URL becomes root then the report screen won't be there

Anyhow, if report screen persistence is required then here's my proposal:
Proposal
Please re-state the problem that we are trying to solve in this issue
The report screen should be present on the right.
What is the root cause of that problem?
If you resize to small screen but don't close the chat, when you resize back to big screen the report screen will re-appear.
This can be observed in the URL too:

as long as the URL is r/:reportId the report screen will persist on resize
if the report back button is clicked on small screen size then URL becomes root then the report screen won't be there

What changes do you think we should make in order to solve the problem?
I would check if we're on small screen and when pressing the report screen back button within header I would persist the route of the currently opened report instead of changing it to root.
What alternative solutions did you explore? (Optional)
N/A

Proposal from @tienifr looks good to me https://github.com/Expensify/App/issues/28354#issuecomment-1738629777
To be sure that rehydrate state will be up-to-date we should use direct hook for getting isSmallScreenWidth

Proposal from @tienifr looks good to me https://github.com/Expensify/App/issues/28354#issuecomment-1738629777
To be sure that rehydrate state will be up-to-date we should use direct hook for getting isSmallScreenWidth
🎀 👀 🎀 C+ reviewed

@allroundexperts Hey! debounce was added only for one particular case - to prevent crash during fast resizing and remove loading indicator https://github.com/Expensify/App/issues/26071 - and i think that fix was a hack. Using debounce in useEffect may lead to unpredictable results - like even fetching not correct size. BTW now we planning to move away from HOC withWindowDimensions - and we can use direct hook without listening for changes in useEffect inside HOC.
Also i checked solution from @tienifr for current issue and for issue with resizing image:
https://github.com/Expensify/App/assets/28352309/c124deda-55df-4efd-baa1-25f86e18d5c7
On the other hand - @allroundexperts solution is working but breaking go back logic
https://github.com/Expensify/App/assets/28352309/4f5a98f4-984f-4221-b68c-e3437333fd71
Current issue is a regression from adding debounce to track resize changes - and using direct size from useWindowDimensions is a correct workflow.
cc @arosiclair

@arosiclair Is it eligible for 50% bonus because I and @narefyev91 finished work very early?

I think we usually count any time for review so probably no but I'm not sure really. @zanyrenney ^

This issue is still present on Web/Desktop on staging, @tienifr please look into this.

https://github.com/Expensify/App/issues/28354#issuecomment-1748357124 based on this comment, it is not eligible for the urgency bonus.

payment summary
@narefyev91 does not require payment (Contractor)
@tienifr requires payment offer (Contributor) - paid $500
@esh-g requires payment offer (Reporter) paid $50


feat: ICU Support

@brianheineman I have one more (and believe last) feature I am missing: Support for ICU.
We are using case insensitive collations defined as:
    CREATE COLLATION case_insensitive (
      provider = icu,
      locale = 'und-u-ks-level2',
      deterministic = false
    )

Which currently raises:
Error: DriverError(IoError(error returned from database: ICU is not supported in this build

Caused by:
   ICU is not supported in this build

Would it be possible to add ICU-support for the binaries?

I see it is explicitly disabled here:
https://github.com/theseus-rs/postgresql-binaries/blob/d4c483ab39324d1984918c0fdad2dc899ced0607/dockerfiles/Dockerfile.linux-gnu#L60

Hello @c-thiel, thank you for the request.  The ICU API appears to be versioned such that creating a build for one version (7.2) will be incompatible with another (7.4).  In order to add ICU support to all the builds, there is some additional work that needs to be done to postgresql_embedded to detect the type/version of a linux distribution so that the appropriate binary could be pulled from this repository.  This repository would then need to be updated to support the main distributions/versions.  I think this would be the least disruptive way to add ICU support for all users.  I think this would be a useful feature to add but I cannot commit to if/when I will have the time to look into it.

Thank you @brianheineman for trying - I appreciate the effort!


Unmanaged TXT record when name clashes is deleted

This has been proven with the Cloudflare provider, with my brief look at how the code is structured I believe this logic will be present in the core of external-dns and thus effect all providers. This is only relevant for the DNS TXT registry.
Given that I already have a TXT DNS record service.example.com with some arbitrary value. When I use that same host for an ingress and external-dns picks that up it will correctly create the CNAME as well as its own TXT record. When I then remove the service, external-dns correctly deletes the CNAME and the TXT record, but it will also remove my manual TXT record.
Without having dug into the logic yet, my guess is that external-dns is just removing all TXT records for a given name rather than just the registry entry. This is an issue for us to integrate with an existing zone and we don't want to risk clobbering anything at all that already exists.
I'll have a dive into the code to see if I can get any kind of patch together.

Using this comment as notes to self while debugging.

Seems like just the TXT registry should be the only thing touching any TXT records. registry/txt.go.
Probably the ApplyChanges function, somewhere in the lines 141-151 block.

As a small aside if you're using External DNS to create CNAME's I'd recommend using --txt-prefix so that the TXT records are created under a slightly different domain.
e.g. --txt-prefix prefix_ would mean the ownership record is created as prefix_domain.tld.
As per https://tools.ietf.org/html/rfc1034 If a CNAME RR is present at a node, no other data should be present -- Having both a CNAME and a TXT record is against this, I don't know why Cloudflare allows it however many other DNS providers won't and I wouldn't be surprised if you find some funky behaviour because of it


GlobalReadCoalesceGroupA[B] leads to wrong results

Hello!
I'm experimenting with *.yaml configurations and it is not clearly for me - can I uses GlobalReadCoalesceGroupA[B] for not transposed A and B inputs? Set option to GlobalReadCoalesceGroupA[B] : [False] in *.yaml leads to an incorrect result.
Thanks!

Closing old issue; Please reopen if still relevant, after testing latest version of Tensile. If opening again, please identify key info such as GPU/device information and Tensile version and rocm version


create_featurestore

after creating a PostGIS store the type in GeoServer is '?'.
geo.create_featurestores(
store_name='postgis',
workspace='webgis_studying',
host='localhost',
port=5433,
db='sua_2021',
schema='public',
pg_user='postgres',
pg_password='**********',
)
geo.publish_featurestore(
workspace='webgis_studying',
store_name='postgis',
pg_table='pub_preplot'
)

There is an error in https://github.com/gicait/geoserver-rest/blob/88c26f114ecd6622a48b0d8a172fe985998cee4d/geo/Geoserver.py#L674. There are three duplicated lines.


Cannot run the first example on Mac OS.

I am installing Spinning Up on Mac OS. I followed this link
After this, to see if you’ve successfully installed Spinning Up, I tried running PPO in the LunarLander-v2 environment with
python -m spinup.run ppo --hid "[32,32]" --env LunarLander-v2 --exp_name installtest --gamma 0.999
Then an error pops up

I have no idea about this error. Can anyone give me help?

@zhjmcjk The error is related to the version of python. As discussed here, Pickle protocol version 4 is not supported in Python 2.7. What python version are you using?

python

@zhjmcjk The error is related to the version of python. As discussed here, Pickle protocol version 4 is not supported in Python 2.7. What python version are you using?

The python version I used is Python 3.6.7

@zhjmcjk Are you using Anaconda with the separate environment as described in official spinningup docs here

@zhjmcjk we see this error when the default python executable is python2.7 instead of python3.
The library launches sub-processes which run the command python ... so your launched shells need to have python correctly configured for them.
If you are using pyenv-virtualenv you can set the python environment for the local directory with pyenv local <myenvname> -- conda has similar functionality.
A good way to test that this works as expected is: open up a new shell in your working directory and run the command python -c "import spinup" -- if that works, then you probably have it setup correctly.

@zhjmcjk Duplicate issue to #13, recommend you try the solution given there. Leaving this open in case that doesn't work.

@zhjmcjk Are you using Anaconda with the separate environment as described in official spinningup docs here?

Yes. I ignored these two commands:conda create -n spinningup python=3.6 and source activate spinningup. I always used pip command. Do I have to install Anaconda? Are there any other ways to solve this problem?

@zhjmcjk we see this error when the default python executable is python2.7 instead of python3.
The library launches sub-processes which run the command python ... so your launched shells need to have python correctly configured for them.
If you are using pyenv-virtualenv you can set the python environment for the local directory with pyenv local <myenvname> -- conda has similar functionality.
A good way to test that this works as expected is: open up a new shell in your working directory and run the command python -c "import spinup" -- if that works, then you probably have it setup correctly.

@machinaut. I run the example using this command: python3 -m spinup.run ppo --hid "[32,32]" --env LunarLander-v2 --exp_name installtest --gamma 0.999
I also run the commands python -c "import spinup" and python3 -c "import spinup" in my computer. the result is

@zhjmcjk, have you tried the solution recommended here?


Reconnect mechanism

You know reconnect method is not working.But I have to reconnect to server if connection lost.What do you suggest for this ? Example:If user switches to 3g from wifi,socket.io is not reconnecting.

Or lets say the server restarts for some reason, the connection of the device is lost and doesn't reconnect itself. Is there a solution to this? Any help, appreciated.


Revise espr::ir::Namespace

Namespace should have following two features:

Resolve name, (Scope, Name) -> Path
Get AST portion specified by the path, Path -> AST

Currently, Namespace::lookup returns TypeRef, but it has additional info like has_supertype_decl as https://github.com/ricosjp/ruststep/pull/88#issuecomment-887806764 . Since the namespace construction have to be done before the IR construction starts, we should not use the IR type TypeRef for lookup API.

The change of has_supertype_decl to is_supertype causes the problem which #88 tackles.

Inherited to #88


Remove unused code

Description
Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.
Fixes # (issue)
Type of change
What is it?

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Documentation update
[ ] Tests update
[x] Refactor

Checklist:

[x] I have commented my code, particularly in hard-to-understand areas
[x] I have made corresponding changes to the documentation
[ ] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes
[x] I run go fmt ./... to check that my code is properly formatted
[x] I run go vet ./... to check that my code is free of common Go style mistakes

Codecov Report

Merging #503 (b766e6c) into main (ef902a2) will increase coverage by 0.01%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main     #503      +/-   ##
==========================================
+ Coverage   30.98%   31.00%   +0.01%
==========================================
  Files          33       33
  Lines        3231     3229       -2
==========================================
  Hits         1001     1001
+ Misses       2136     2134       -2
  Partials       94       94

Impacted Files
Coverage Δ

pkg/services/ownershipvoucher_active.go
94.79% <ø> (+1.93%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ef902a2...b766e6c. Read the comment docs.


server: EACCESS troubles on building

If server can't store artifacts or create .tmp folder it leaks request object and do not closing response → timeout.

https://github.com/enb-make/enb/blob/0c2b94874a417ebe34a8636c5188b24311d92d28/lib/server/server.js#L173 — here we need to add .catch


Low performance on forceAtlas2

[x] I have searched the issues of this repository and believe that this is not a duplicate.

Reproduction link

Steps to reproduce
My data contains: 2585 nodes and 3669 edges
Rendering took 1m 38s
I do aim to render a force directed graph I did look over the documentation and over the performance usecases but in the performance usecases the positioning of the graph is already computed so the lib's job remains to display directly.
The graph that I will present will be changed depending on filters added by the user...such filter might limt the data but the above example is most of an middle sized graph.
The graph is not editable but changing filter params is most common so the layout needs to be redone and waiting over 1m after new data(data may be completly different) comes in seems quite long.
Also tried 'force' layout with workerEnabled for that case it was faster but the nodes were too close together nodeSpacing function was never called.
If there is any way that I can render this nicely and improved that would be nice.

Environment
Info

g6
4.3.4

System
-

Browser
-

The performance usecases aim to show the performance of rendering.
workerEnabled is just put the computation to a worker which will not block the UI, but it will not speed up the computation.
For the large graph layout, first, try gpuEnabled: true for gForce or fruchterman, which are also force-directed algorithms with different force models, and they support gpu parallel computing. Second, if the data is too large to be realtime computed by front-end, we suggest you to do the layout computing on the server instead.

@Yanyan-Wang Thanks for the response, will try the above and see where I will get with it.
For layout computing on the server-side can you recommend something (using Java server side)?

Maybe try node.js? And the @antv/layout may be available on node.

Hi, dear user. Since there was no response for a long time, we cannot figure out the answer of the problem you described. If there is new progress, feel free to open a new issue.


RayJob: update Finished() to account for JobDeploymentStatus

What type of PR is this?
/kind bug
What this PR does / why we need it:
RayJob status has both a JobStatus field and a JobDeploymentStatus field. The former represents the status of the running Ray job and the latter represents the state of the RayCluster and RayJob. The Finished() implementation in Kueue for RayJob should look at the JobDeployment for "finished" since that is what represents whether resources for the job have been cleaned up. This will also catch some cases where JobStatus will remain "Running" even though JobDeploymentStatus is "Failed". This can specifically happen when activeDeadlineSeconds is exceeded.
Which issue(s) this PR fixes:

Fixes #
Special notes for your reviewer:
Does this PR introduce a user-facing change?

RayJob's implementation of Finished() now inspects at JobDeploymentStatus

@tenzen-y @kevin85421 @astefanutti PTAL

/retest

That makes sense, thanks.
/lgtm

Already merged, that's fine :)

@mimowo is there a v0.8.2 release planned? If so I'd like to consider this for backport

We haven't yet planned it, but we estimated 0.9 to be in around 3-4 weeks.
Given that we have an important bug fixed, and the timeline for 0.9 is rather distant I'm in favor of preparing 0.8.2.
/cc @tenzen-y @alculquicondor
/cherry-pick release-0.8

@mimowo if this is the only bug fix then I think it's fine to wait for v0.9.0. I don't consider this a critical bug fix.
However, if there were other fixes that warrant a new patch release, then please include this one. Thank you! :)

This will also catch some cases where JobStatus will remain "Running" even though JobDeploymentStatus is "Failed". This can specifically happen when activeDeadlineSeconds is exceeded.

I guess that the regression situation happen only when users use the latest KubeRay version, right?

I guess that the regression situation happen only when users use the latest KubeRay version, right?

No it's specifically if you set activeDeadlineSeconds and a RayJob expires. In this case JobStatus=Running and JobDeploymentStatus=Failed and the workload is never removed from ClusterQueue

We haven't yet planned it, but we estimated 0.9 to be in around 3-4 weeks.
Given that we have an important bug fixed, and the timeline for 0.9 is rather distant I'm in favor of preparing 0.8.2.

SGTM, ideally, we want to cut a patch release every month and want to cut a minor release every 4 months.


parse latest weekly pdf and get number of tests

I accidentally closed #867, so here we go again rebased on current master.

Thanks  @maekke


EPEX Spot Web Scraper (AT) not working anymore

Some changes at the API?
2024-04-09 08:47:41.348 DEBUG (MainThread) [custom_components.epex_spot] Finished fetching epex_spot data in 0.000 seconds (success: True) 2024-04-09 08:47:41.355 ERROR (MainThread) [custom_components.epex_spot_sensor.binary_sensor] Invalid price sensor "sensor.epex_spot_data_net_price" selected for EPEX Spot Sensor "epex_start_low_period": "'data' missing in sensor attributes" 2024-04-09 08:47:41.355 ERROR (MainThread) [custom_components.epex_spot_sensor.binary_sensor] Invalid price sensor "sensor.epex_spot_data_net_price" selected for EPEX Spot Sensor "00": "'data' missing in sensor attributes"

https://www.epexspot.com/en/market-data?market_area=AT&trading_date=2024-04-07&delivery_date=2024-04-08&underlying_year=&modality=Auction&sub_modality=DayAhead&technology=&product=60&data_mode=table&period=&production_period=
No data for this combination

Same for DE-LU data. Disapperared yesterday afternoon.

+1

+1
last price in my Database is from yesterday (08.04.2024) 18:00

seems to be solved for me

Well, looks like an temporary issue on epexspot.com

thx! also for me working again. (will import missing prices from the past manually and correct all the calculated prices and costs manually)


Add support for enum forward declarations

These will otherwise create duplicate bindings.

Thanks @JamesWrigley for your contribution.


User control under sub folder- BlankUserControl.xaml.g.hpp not generated

The header file that had 'InitializeComponenent' does'nt get generated if the user component is under a project subfolder. This works if the user component in the root folder.

There are certainly limitations in the way this works today, but it's not something we can easily change at this point as there are too many other tools that depend on it working just the way it does.

So, we expect all sources be in the project root directory, even for large projects ?

cppwinrt itself has no such requirements, but it sounds like it might be an issue for xaml. You may want to bring it up with the team here: https://github.com/Microsoft/microsoft-ui-xaml


InvalidParameterCombination: Cannot find version 5.7.12 for aurora-mysql

Description
I am getting this error running terraform apply from /examples/mysql/
│ Error: error creating RDS cluster: InvalidParameterCombination: Cannot find version 5.7.12 for aurora-mysql
│       status code: 400, request id: 4d1b6b45-4958-452a-a4a4-c7d61e91c44d
│
│   with module.aurora.aws_rds_cluster.this[0],
│   on ../../main.tf line 47, in resource "aws_rds_cluster" "this":
│   47: resource "aws_rds_cluster" "this" {
Versions

Module version [Required]:

Terraform version:
Terraform v1.2.4
on darwin_arm64

Provider version(s):

provider registry.terraform.io/hashicorp/aws v4.22.0
provider registry.terraform.io/hashicorp/random v3.3.2

Reproduction Code [Required]
Steps to reproduce the behavior:
cd /examples/mysql
terraform init
terraform apply
Expected behavior
success
Actual behavior
│ Error: error creating RDS cluster: InvalidParameterCombination: Cannot find version 5.7.12 for aurora-mysql
│       status code: 400, request id: 4d1b6b45-4958-452a-a4a4-c7d61e91c44d
│
│   with module.aurora.aws_rds_cluster.this[0],
│   on ../../main.tf line 47, in resource "aws_rds_cluster" "this":
│   47: resource "aws_rds_cluster" "this" {
Terminal Output Screenshot(s)

Additional context
I believe the cause of the issue is that version 5.7.12 for aurora-mysql has been deprecated. I googled it and found this https://github.com/hashicorp/terraform-provider-aws/issues/10585 (see most recent comment at the bottom). So I replaced the engine_version on line 47 of main.tf with "5.7.mysql_aurora.2.10.1" and it worked.

I have the fix but I don't have the access to push my branch. Can someone grant me access? I'll then push and create an MR.

@antonbabenko done. https://github.com/terraform-aws-modules/terraform-aws-rds-aurora/pull/303


[BUG] Weird path concatenation on macOS

Describe the bug
I'm trying to run ImportFromTiffTask by specifying the folder parameter when the task is initialized. The path of the filesystem gets duplicated or something. Like Users/mlubej/work/projects/sh-project/Users/mlubej/work/projects/sh-project/eo-learn/example_data/import-tiff-test1.tiff
To Reproduce
mask_feature = (FeatureType.MASK_TIMELESS, "TEST_TIF")
path = '/Users/mlubej/work/projects/sh-project/eo-learn/example_data/'

task = ImportFromTiffTask(feature=mask_feature, folder=path)
task.execute(None, filename='import-tiff-test1.tiff')

Stack trace or screenshots
---------------------------------------------------------------------------
FileNotFoundError                         Traceback (most recent call last)
File ~/.pyenv/versions/3.8.7/envs/sh/lib/python3.8/site-packages/fs/osfs.py:357, in OSFS.openbin(self, path, mode, buffering, **options)
    356         sys_path = os.open(sys_path, os.O_RDWR | os.O_CREAT | os.O_EXCL)
--> 357     binary_file = io.open(
    358         sys_path, mode=_mode.to_platform_bin(), buffering=buffering, **options
    359     )
    360 return binary_file

FileNotFoundError: [Errno 2] No such file or directory: b'/Users/mlubej/work/projects/sh-project/Users/mlubej/work/projects/sh-project/eo-learn/example_data/import-tiff-test1.tiff'

During handling of the above exception, another exception occurred:

ResourceNotFound                          Traceback (most recent call last)
Input In [6], in <module>
      1 mask_feature = (FeatureType.MASK_TIMELESS, "TEST_TIF")
      3 task = ImportFromTiffTask(feature=mask_feature,
      4                           folder='/Users/mlubej/work/projects/sh-project/eo-learn/example_data/',
      5                           no_data_value=0)
----> 6 task.execute(None, filename='import-tiff-test1.tiff')

File ~/work/projects/sh-project/eo-learn/io/eolearn/io/local_io.py:442, in ImportFromTiffTask.execute(self, eopatch, filename)
    440 data = []
    441 for path in filename_paths:
--> 442     with filesystem.openbin(path, "r") as file_handle:
    443         with rasterio.open(file_handle) as src:
    445             if eopatch.bbox is None:

File ~/.pyenv/versions/3.8.7/envs/sh/lib/python3.8/site-packages/fs/osfs.py:357, in OSFS.openbin(self, path, mode, buffering, **options)
    355     if six.PY2 and _mode.exclusive:
    356         sys_path = os.open(sys_path, os.O_RDWR | os.O_CREAT | os.O_EXCL)
--> 357     binary_file = io.open(
    358         sys_path, mode=_mode.to_platform_bin(), buffering=buffering, **options
    359     )
    360 return binary_file

File ~/.pyenv/versions/3.8.7/envs/sh/lib/python3.8/site-packages/fs/error_tools.py:89, in _ConvertOSErrors.__exit__(self, exc_type, exc_value, traceback)
     87     if getattr(exc_value, "args", None) == 32:  # pragma: no cover
     88         fserror = errors.ResourceLocked
---> 89 reraise(fserror, fserror(self._path, exc=exc_value), traceback)

File ~/.pyenv/versions/3.8.7/envs/sh/lib/python3.8/site-packages/six.py:718, in reraise(tp, value, tb)
    716         value = tp()
    717     if value.__traceback__ is not tb:
--> 718         raise value.with_traceback(tb)
    719     raise value
    720 finally:

File ~/.pyenv/versions/3.8.7/envs/sh/lib/python3.8/site-packages/fs/osfs.py:357, in OSFS.openbin(self, path, mode, buffering, **options)
    355     if six.PY2 and _mode.exclusive:
    356         sys_path = os.open(sys_path, os.O_RDWR | os.O_CREAT | os.O_EXCL)
--> 357     binary_file = io.open(
    358         sys_path, mode=_mode.to_platform_bin(), buffering=buffering, **options
    359     )
    360 return binary_file

ResourceNotFound: resource 'Users/mlubej/work/projects/sh-project/Users/mlubej/work/projects/sh-project/eo-learn/example_data/import-tiff-test1.tiff' not found

Desktop (please complete the following information):

Mac OS Monterey

Something weird happens in https://github.com/sentinel-hub/eo-learn/blob/feat/update-import-from-tiff/core/eolearn/core/utils/fs.py#L62
os.path.join(*path_parts)
'Users[/mlubej/work/projects/sh-project/eo-learn/io/eolearn/tests/../../../example_data/import-tiff-test1.tiff]()'
os.path.abspath(os.path.join(*path_parts))
'[/Users/mlubej/work/projects/sh-project/eo-learn/Users/mlubej/work/projects/sh-project/eo-learn/example_data/import-tiff-test1.tiff]()'

Works if I use relpath instead of abspath

Some of the issues above might be due to my own fault and changes, perhaps they are even not existing, since they happened due to my own change.
However, there is an issue with an extra forward slash in an s3 path, I've traced the issue back to what was already discovered with @zigaLuksic and I forgot about it. I pushed a fix in https://github.com/sentinel-hub/eo-learn/pull/388/commits/d0b962b9da8be878e3e0fc9e2f12cf3dc4953e19#diff-f43e8f8beb214d89bb32e94c32f4ddefeb303c97acbbcfd1c4148b31947474c0R52
Closing this issue since it's not related.


Cannot install on .NET 4.8 project

I am getting an error when i try to install 2.1.0 via nuget on a .NET4.8 project
Unable to find a version of 'RestSharp' that is compatible with 'Mindee 2.1.0 constraint: RestSharp (>= 109.0.0-preview.2)'.
It looks like this version of RestSharp is not supported for .NET4
https://www.nuget.org/packages/RestSharp/
Installing 2.0.0 works but would rather have the latest version
Regards

Hi @des2k7 ,
It's weird, because it should works with NET 4.8.
If you have a look on the associates branch, you'll see that the non regression test seems to works well when targeting 4.8.
I will try with creating a console app targeting 4.8 later in the day.

@des2k7 I am able to reproduce it, sorry about that.
I'm investigating tight now and will come back to you asap.

For history :
It is interesting that when add directly reference of Mindee into a 4.8 (or 4.7.2) console app, it is working but when using the nuget Mindee 2.1.0 it fails due to Docnet.Core or Restsharp dependencies.
Example :
Attempting to gather dependency information for package 'Mindee.2.1.0' with respect to project 'Mindee.Sample.Net48', targeting '.NETFramework,Version=v4.8' Gathering dependency information took 2.1 sec Attempting to resolve dependencies for package 'Mindee.2.1.0' with DependencyBehavior 'Lowest' Unable to find a version of 'RestSharp' that is compatible with 'Mindee 2.1.0 constraint: RestSharp (>= 109.0.0-preview.2)'.

Hi @des2k7 ,
We published a new preview package.
Could you test it please?
(https://www.nuget.org/packages/Mindee/2.1.1-preview1)


Add swift-stdlib-build-type=Release to the

Add swift-stdlib-build-type=Release to the
LLDB_Swift_DebugAssert_with_devices and
LLDB_Swift_ReleaseAssert_with_devices presets -
we don't need debug information in the stdlib
that we use when testing on-device.
(cherry picked from commit c7ce1148a3d735282e072115b3eebc9309d710b3)

@swift-ci please test and merge


Release 0.2.4

Coverage decreased (-0.006%) to 86.153% when pulling da798850966c12d466c1433b3acc87ac10a56580 on mziccard:release-0.2.4 into f5b5d3dde6a8070ebe58a0ae40102d9ecfffcdc3 on GoogleCloudPlatform:master.


SNI compatibility

We've started using this crate to pre-parse the SNI and do some async work before handing it off to the synchronous rustls handshake.
We've stumbled on some issues parsing SNI in some scenarios. I'm not sure if it's just a question of different clients sending different TLS extension formats.
Here's an error we get:
Error(([170, 170, 0, 0, 0, 0, 0, 23, 0, 21, 0, 0, 18, 119, 119, 119, 46, 97, 109, 105, 114, 97, 104, 122, 97, 107, 121, 46, 99, 111, 109, 0, 23, 0, 0, 255, 1, 0, 1, 0, 0, 10, 0, 10, 0, 8, 218, 218, 0, 29, 0, 23, 0, 24, 0, 11, 0, 2, 1, 0, 0, 35, 0, 0, 0, 16, 0, 14, 0, 12, 2, 104, 50, 8, 104, 116, 116, 112, 47, 49, 46, 49, 0, 5, 0, 5, 1, 0, 0, 0, 0, 0, 13, 0, 20, 0, 18, 4, 3, 8, 4, 4, 1, 5, 3, 8, 5, 5, 1, 8, 6, 6, 1, 2, 1, 0, 18, 0, 0, 0, 27, 0, 3, 2, 0, 2, 122, 122, 0, 1, 0], Tag))

If I decode to UTF8 lossy, I get:
��www.amirahzaky.com�
��#h2http/1.1
zz

It looks like the data is in there? The error doesn't say this is incomplete, so I assume this is a parser issue?
Thanks for creating this, it's a huge time save for us.
This is how I'm parsing it btw:
    let acceptor = store.get(&svc, &metrics, should_h2).await?;
    let mut bytes = [0; 1024];
    let n = io.peek(&mut bytes).await?;
    log::trace!("read {} bytes from tls handshake", n);
    let res = tls_parser::parse_tls_plaintext(&bytes);
    match res {
        Ok((_rem, record)) => {
            // rem is the remaining data (not parsed)
            // record is an object of type TlsRecord
            log::trace!("record: {:?}", record);
            match record.msg.get(0) {
                Some(tls_parser::tls::TlsMessage::Handshake(
                    tls_parser::tls::TlsMessageHandshake::ClientHello(hello_contents),
                )) => match hello_contents.ext {
                    Some(exts) => match tls_parser::tls_extensions::parse_tls_extension_sni(exts) {
                        Ok((_rem, tls_parser::tls_extensions::TlsExtension::SNI(sni))) => {
                            match sni.get(0) {
                                Some((tls_parser::tls_extensions::SNIType::HostName, hostname)) => {
                                    let hostname = std::str::from_utf8(hostname)?;
                                    log::debug!("got hostname: {}", hostname);
                                    store.ensure_cert(svc, should_h2, hostname).await;
                                }
                                _ => log::warn!("unhandled SNI Type!"),
                            };
                        }
                        Err(e) => {
                            log::debug!("error decoding sni: {:?}", e);
                        }
                        _ => {
                            log::warn!("did not find SNI");
                        }
                    },
                    _ => {
                        log::warn!("could not get client hello contents");
                    }
                },
                _ => log::warn!("didn't care about message type..."),
            };
        }
        Err(nom::Err::Incomplete(needed)) => {
            log::error!(
                "Defragmentation required (TLS record), needed: {:?}",
                needed
            );
        }
        Err(e) => {
            log::debug!("parse_tls_plaintext failed: {:?}", e);
        }
    };

(I get the error at error decoding sni line)

Here is the full record with debug formatting (for a different request):

My bad, I should've been parsing all extensions and iterating to find the SNI one.


Trying to use Measurements to differentiate respect to a unitful quantity.

Hi,
I have tried with the following:
x = (98.1 ± 12.7)u"km"
y = (105.4 ± 25.6)*u"km"
Measurements.derivative.(x^2*y^2+2*x^3*y, [x, y])
ERROR: MethodError: no method matching derivative(::Quantity{Measurement{Float64}, 𝐋^4, Unitful.FreeUnits{(km^4,), 𝐋^4, nothing}}, ::Quantity{Measurement{Float64}, 𝐋, Unitful.FreeUnits{(km,), 𝐋, nothing}})
Stacktrace:
 [1] _broadcast_getindex_evalf
   @ ./broadcast.jl:683 [inlined]
 [2] _broadcast_getindex
   @ ./broadcast.jl:656 [inlined]
 [3] getindex
   @ ./broadcast.jl:610 [inlined]
 [4] copy
   @ ./broadcast.jl:912 [inlined]
 [5] materialize(bc::Base.Broadcast.Broadcasted{Base.Broadcast.DefaultArrayStyle{1}, Nothing, typeof(Measurements.derivative), Tuple{Quantity{Measurement{Float64}, 𝐋^4, Unitful.FreeUnits{(km^4,), 𝐋^4, nothing}}, Vector{Quantity{Measurement{Float64}, 𝐋, Unitful.FreeUnits{(km,), 𝐋, nothing}}}}})
   @ Base.Broadcast ./broadcast.jl:873
 [6] top-level scope
   @ REPL[28]:1

I would like to know how could I modify the code.
Besides I would like to know if giving gradients with units to DifferentialEquations is possible and if it has time penalty.
Thank you very much

Measurements.derivative.(x^2*y^2+2*x^3*y, [x, y])

That is a weird call, where did you get it?
derivative takes either a single Measurement argument + tag, or two Measurement arguments:
https://github.com/JuliaPhysics/Measurements.jl/blob/55332725ad6826cef711103de7a2413c3b1b1fd6/src/utils.jl#L40-L56
I'm not sure what you are trying to do, more generally.
#144 might be relevant.

Hi, thanks for the answer. I took the example from here, it is this example:
 Measurements.derivative.(log1p(x) + y^2 - cos(x/y), [x, y, z])
Am I interpreting something wrongly?

Hm, works for me:
$ julia
               _
   _       _ _(_)_     |  Documentation: https://docs.julialang.org
  (_)     | (_) (_)    |
   _ _   _| |_  __ _   |  Type "?" for help, "]?" for Pkg help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 1.9.2 (2023-07-05)
 _/ |\__'_|_|_|\__'_|  |
|__/                   |

julia> using Measurements

julia> x = 98.1 ± 12.7
98.0 ± 13.0

julia> y = 105.4 ± 25.6
105.0 ± 26.0

julia> z = 78.3 ± 14.1
78.0 ± 14.0

julia> Measurements.derivative(2x - 4y, x)
2.0

julia> Measurements.derivative(2x - 4y, y)
-4.0

julia> Measurements.derivative.(log1p(x) + y^2 - cos(x/y), [x, y, z])
3-element Vector{Float64}:
   0.017700515090289737
<PHONE_NUMBER>496422
   0.0

Perhaps you have too old julia/Measurements package?

As it can be seen in
https://github.com/JuliaPhysics/Measurements.jl/blob/55332725ad6826cef711103de7a2413c3b1b1fd6/ext/MeasurementsUnitfulExt.jl
only the main public interface is unit-aware.

Hi. I do not understand what it means.

Hi. I do not understand what it means.

The error you are getting is correct, Measurements.jl does not support
calling derivative() with an Unitful arguments, only with Measurements.

I thought that measurements could have units, like
x = (98.1 ± 12.7)u"km"
y = (105.4 ± 25.6)*u"km"

I thought that measurements could have units, like
x = (98.1 ± 12.7)u"km"
y = (105.4 ± 25.6)*u"km"

Do you say that derivative() only accepts measurements without units?

The thing is that is not a measurement with units,
it's a Measurement-typed value inside of an AbstractUnit-typed value,
and derivative() is missing special-handling to unwrap
the outer AbstractUnit type to get to the actual Measurement inside.

Ok, just to understand, could you give me an example of a "measurement with units" that Measurement.jl understands ?

All normal mathematical operations work, only the functionality that is defined in https://github.com/JuliaPhysics/Measurements.jl/blob/c12fb10d3deef0251d671028dfccb3faa9c880dd/src/utils.jl does not.

https://github.com/JuliaPhysics/Measurements.jl/pull/152 kind-of helps,
but i'm not sure yet how to actually deal with unit mismatch in derivative().

Thank you very much


Suggest to use litgpt chat after finetuning

Our finetuning tutorials end with suggesting to run litgpt generate but no mention of litgpt chat. I believe chatting is a more intuitive suggestion to immediately use and test the model. So I propose to incluce this as the first step after finetuning in our tutorials.
(this would apply to full and lora only at the moment)
Thoughts @rasbt?
We could even print the commands to the terminal after finetuning ends, so the user can copy paste it.

I agree. I think generate.py is more useful when you want to execute the end-to-end example in a bash script, but for the general tutorials let's use chat.py


Lua Filter Response Handle Metadata is nil when method is "OPTIONS"

If you are reporting any crash or any potential security issue, do not
open an issue in this repo. Please report the issue via emailing
<EMAIL_ADDRESS>where the issue will be triaged appropriately.
Title:  Lua Filter Response Handle Metadata is nil when method is "OPTIONS"
Description:
I am using Lua filter  v2 to copy request headers into metadata and then in the response handle I am copying the metadata and adding it as headers in the response.
When the request method is GET, everything works as expected.
When the request method is OPTIONS, it seems that metadata is returning nil. and this is creating an error.

I am not able to check using lua if the metadata is nil before trying to query the metadata. If I try to check if metadata is nil, i still get a nil error

Also I tried to run the code only when the request method is GET but in the response handle, I dont have access to the request method

So I am not able to to run my code only when the method is not OPTIONS
            local headers = handle:headers()
            local metadata = handle:streamInfo():dynamicMetadata()
            local rid = headers:get("x-request-id")
            local mymeta = metadata:set("envoy.filters.http.lua", "request-id", rid)
          end
          function envoy_on_response(res_handle)
             local metadata = res_handle:streamInfo():dynamicMetadata()
             local pis =  metadata:get("envoy.filters.http.lua")["request-id"]
             res_handle:headers():add("x-request-id", pis)
          end

Repro steps:
try above lua code in v2 (maybe also v3)
make sure u have CORS to generate OPTIONS request methods
if u dont have the request-id, u can generate any header u want

Note: The Envoy_collect tool
gathers a tarball with debug logs, config and the following admin
endpoints: /stats, /clusters and /server_info. Please note if there are
privacy concerns, sanitize the data prior to sharing the tarball/pasting.

Admin and Stats Output:

Include the admin output for the following endpoints: /stats,
/clusters, /routes, /server_info. For more information, refer to the
admin endpoint documentation.

Note: If there are privacy concerns, sanitize the data prior to
sharing.

Config:

Include the config used to configure Envoy.

Logs:

Include the access logs and the Envoy logs.

Note: If there are privacy concerns, sanitize the data prior to
sharing.

Call Stack:

If the Envoy binary is crashing, a call stack is required.
Please refer to the Bazel Stack trace documentation.

Can you provide an Envoy config that reproduces this issue? I think that would be helpful in tracking down the cause of this, thanks!

Most of us aren't familiar with Istio enough to reproduce Istio deployments, so I would suggest looping the Istio folks in first to understand what Envoy configuration this is using as a first step. Once we have a way to reproduce this it will be a lot easier for us to take a look. Alternatively if you are able to set up an example Envoy config that doesn't use Istio that would be helpful.
At a high level I'm not sure why SETTINGS would be different from any other types in this regard, so there might be some interaction with the CORS filter, but it's hard to verify without a reproducer.


Context object not getting sent

Sorry if this is already answered but I couldn't easily find info on this.
Hey guys great library here!  I'm a huge graphql fan here and was trying to figure out how to do microservice to microservice communication.  graphql-bindings greatly simplifies the schema delegation.
My issue is this:
The docs seem to state you can pass context as the third parameter:
        resolve(account, args, context, info) {
            console.log("context", context);
            return context.myService.query.getItems(
              args,
              info,
              {
                context: {
                  user: context.user,
                },
              },
            );
          },

however this is all I see  on the context in my microservice.
context { _extensionStack: GraphQLExtensionStack { extensions: [ [Object] ] } }

Perhaps I'm missing something I'd expect to see my user object?

I face the same problem, however after some digging it seems that the issue may not be with this package. The context is getting passed to delegate https://github.com/graphql-binding/graphql-binding/blob/9eb4bd06fa0d118eee11e9e1938d127d343637d1/src/Delegate.ts#L160 but from then on something weird happens. I've tried to track down the cause and it seems that the context gets passed to delegateToSchema https://github.com/apollographql/graphql-tools/blob/dacfd83566b6d8a9bee61ee1b5cda373b2b531a7/src/stitching/delegateToSchema.ts#L109 but I'm not sure what happens next

Got it - works perfectly thanks @almostprogrammer


Package dependencies.

ossfs 2023.1.0 has requirement fsspec==2022.11.0, but you have fsspec 2023.1.0.

Thanks for your reporting.  Now the latest version of ossfs is 2023.3.0 and it depends on the 2023.3.0 version of fsspec. I'll try to keep the version of ossfs sync with fsspec.
Some related discussions. https://github.com/fsspec/filesystem_spec/discussions/1239


How to get "fields" like last mod date? Setting "field" in options does nothing.

So I set options like this:
const sitemap = new Sitemapper({ url: host, field: { loc: true, lastmod: true, changefreq: true, priority: true } });

and then
sitemap
	.fetch()
	.then(function (data) {
		console.log(data);
	});

But this just displays an array of sites, nothing more.
Am I missing something here?

I have the same problem

Same here


[Bug Report] https://element.eleme.io/ certificate has been expired

Element UI version
Not applicable
OS/Browsers version
Windows 10, Chrome, Firefox
Vue version
Not applicable
Reproduction Link
https://element.eleme.io/
Steps to reproduce

Open link https://element.eleme.io/
Check certificate

What is Expected?
Valid SSL certificate
What is actually happening?
Expired SSL certifciate
SSLShoper says it expired 4 days ago:
https://www.sslshopper.com/ssl-checker.html#hostname=https://element.eleme.io/

Most likely to be Github's issue, as they just start using Lets Encrypt to support custom domain SSL. They might have issue with renewing certificate.
Nothing we can do now. For the time being, ignore this error.


routing+channeldb: implement batched channel announcement+update writing

As implemented today, only a single channel can be written (synchronization wise) within the daemon at any given time. As a result, one of the current bottle necks to spinning up a new lnd node is actually just ingesting the graph. Due to the recently added edge/node caching within channeldb, using the Batch call from bbolt won't result in any increased concurrency due to the required mutex synchronization. Instead, we can coalesce several channels at the router level, which are then periodically written to disk in a single database transaction. This change should significantly reduce the amount of time it takes to ingest the graph given that atm, we need a new database transaction for each channel, which can take some time (in the realm of computers).
Steps To Completion

[ ] Add a new AddBatchedChannelEdge (or diff name) method that's able to take a variadic *channeldb.ChannelEdgeInfo to be written in a single database transaction. Alternatively, we can simply extend the prior version (AddChannelEdge) with a variadic parameters which will allow us to keep all existing callers in place.

[ ] A similar method should be created the permits the caller to write several *channeldb.ChannelEdgeInfo instances in a single database transaction.

[ ] Rather than write channels one at a time, the router should return immediately to the caller, but cache that channel in memory until the next batch flush criteria is met. This can either be time based, or based on a maximum/minimum batch size.

[ ] Add a new coalescer component to the router that will "periodically" write the latest batch of channels to disk.

[ ] Determine how to maintain external consistency w.r.t channels in the next scheduled batch that haven't yet been written to disk.

tackling this


Single configuration file

Most of the settings across different deployment scripts such as staging.yaml and production.yaml are the same. Usually, they only differ in the name of the branch, therefore I would like to propose to use a single configuration file with different sections instead of separate files, the format might look like:
repo: git@github.com:<org>/<repo>
build_script:
   - stack setup
   - stack build
restart_command: <restart command>

staging:
  revision: origin/master

production:
  revision: origin/production

Then we could change the CLI to take a section as an argument:
$ stack exec hap -- deploy staging
$ stack exec hap -- deploy production
``

@sestrella Although, I'm totally aware that staging ideally should be a carbon copy of the production environment. I also think that sometimes we need flexibility and that a user may not be able to have the ideal scenario. In that sense, how would you suggest that we should handle the case when there is a difference between the necessary scripts between both. Also, it may exist the case when a project has more than one environment in continuos integration & delivery pipeline, g.e. development -> staging -> qa -> production. In those scenarios we would still another yaml file

 Single configuration file

Maybe this could be achieved using TOML files @sestrella? https://kowainik.github.io/posts/2019-01-14-tomland#prefix-tree

@ibarrae sorry for the late response. I would suggest start taking a look at Dhall, perhaps? It looks promising and has Haskell support. @CristhianMotoche, @DavidMazarro any thoughts?

@sestrella @ibarrae Why do you want to include a new notation for the build script? Is it impossible to accomplish this only with YAML? Please, let me know your thoughts.

I haven't used Dhall but have known it for a while. Despite looking interesting, I think the sort of config users are doing with Hapistrano isn't complex enough to justify defaulting to Dhall (unless we want to support both languages for deployment scripts?). It might just make Hapistrano a bit harder to use for people unfamiliar with Dhall.
I would try to review if this can be done in YAML directly like @CristhianMotoche says, but I don't recall it can be done off the top of my head. In that case, TOML is a good pick IMO: it looks like it supports that feature, and is as simple/easy to use as YAML.

Hey @sestrella I think we could accomplish this defining a new file version. Like some tools (e.g. CircleCI, GH Actions) do it. I think something like:
---
version: 2
repo: git@github.com:<org>/<repo>
build_script:
   - stack setup
   - stack build
restart_command: <restart command>

targets:
  - staging:
      revision: origin/master
  - production:
      revision: origin/production

If version is not given it will take the current version (let's call it 1). Would that make sense?

@CristhianMotoche yes, I think versioning the configuration file is required here to ensure backward compatibility. Additionally, maybe we could add a command to scaffold configuration files? I think that would make it easier for current users to familiarize themselves with the new schema:
> hap init -v1 # outputs an example configuration file using the current schema
> hap init -v2 # outputs an example configuration file with the proposed schema

Hey team! I'm assigning @well1791 to this issue since he wants to give it a try. Let me know @well1791 if there is anything that you need from my end.

Hello @well1791 I was wondering if everything is clear with this issue. Do you need any help to review it? Let me know.


"Save" doesnt save

When editing collaboratively in fast mode (using nextcloud), it appears the file is never written back to nextcloud until everyone ends their editing session.
Hitting the "save" button in the file menu pane does not seem to change that.
That mean that if everyone keeps all their browser tabs open, then the file never gets saved to nextcloud... until something blows up.
For example, when the file becomes no longer accessible e.g. because the sharing link timed out etc, then all of the edits can't be written back and we've lost two peoples work at once.
At other times, we've had an issue when A had shared a file with B and C, then A was temporarily locked out of the LDAP server because of a few false logins on the mail account... meanwhile B and C kept working, and didn't notice that OO now failed to save the file... boom! two days worth of data entry gone.
Can you specify how the writeback behaviour is intended to be? Why doesn't "Save" seem to save the file on Nextcloud/Owncloud?

Hi,
same on my system with latest Nextcloud and OO-App. If i create a new file in NC und write something into this, close Tab after Document is saved, the Date in NC didnt updated. If i downloaded this file, the file doesnt have the changes. Actually i can only view existing files or write into it, but never see changes in NC. After last Update of NC i lost all Data i added in the last 4 weeks - very annoying...

@Taste-IT
Hello, Could you please provide us with any information about the versions of the products installed on your server(s). We will try to reproduce the issue on our side.
Please describe your actions step by step.

After last Update of NC i lost all Data i added in the last 4 weeks - very annoying...

Have you tried to contact NC to clear the situation? If you are sure that the problem is caused by ONLYOFFICE application please provide the details. I am sure that we are able to find a solution

I have this problem since i use OO in NC and noticed it first as i do an update of OO and all my data are gone. I have a parallel thread link i think its an handling with the cert, but dont know where the problem is, NC or OO

Аналогичная проблема не сохраняются в файл изменения после редактирования.
nextcloud 12.0.0
onlyoffice-owncloud 1.1.2
onlyoffice-documetserver 4.3.6-2

I'm seeing this as well. Pressing "save" dismisses the menu, but does nothing. I can export, however. In my case, I opened a .txt file in onlyoffice. My workaround wsa to simply export it in the format I wanted.

Hi. Same problem here. any fix yet?

Вообще сейчас у меня все работает.
In general now everything works for me.
nextcloud 12.0.4
onlyoffice: 1.1.6
onlyoffice-documetserver 4.3.6-2

Hi all,
I had the same problem.
I wasn't able to update email of users.
Could you help me?

I reviewed my email, in side of spam and other but I didn't see nothing with notifications of this mail.
What I need to do?
How can I review log of mails sended? Where .. ?
ONLYOFFICE | 1.1.4
ownCloud | 0.2.2

Same here.  "Save" does not save, however closing the OnlyOffice document tab (on all browsers where it is open) does.
onlyoffice-documentserver 5.0.7-38 (Debian, not in a docker)
nextcloud 12.0.5
postgresql 10+190

Hello,
Please do the following:
Open browser's console (tab Console and then ab Network) and click on the Save button. Please send us screenshots if there is any information about the errors.
Send us also logs of the document server and Nextcloud to<EMAIL_ADDRESS>with a note "for technical support" in email.

@e-tagirov, we are waiting for requested information.

@alexanderonlyoffice sent a couple of screenshots to the requested mail.

Just lost 5 hours of work due to this bug. Looks like nobody is really caring about fixing data loss bugs here -.-

is there an option to actually force from the client side a save back to nextcloud?

This is exactly force saving, which is not working in integration with Nextcloud due to some technical limitations, which cannot be solved at the moment.

So the owncloud integration can save back to the owncloud when all tabs are closed but not forced by some client action? This would be a really important feature.
The 'Save' button does not do anything at our instance, there is nothing on the console or in the network tab of the dev tools.

@KuenzelIT,

So the owncloud integration can save back to the owncloud when all tabs are closed but not forced by some client action? This would be a really important feature.

Thank you for your feedback. As it was mentioned before there are some technical issues preventing us from implementing this feature. We are working on it.

The 'Save' button does not do anything at our instance, there is nothing on the console or in the network tab of the dev tools.

When you click on the 'Save' icon in editor changes made to the file are sent to the Document Server, but the new version of the file will be built only when the tab with editor is closed in browser (when the editing session is over).

As pointed out here the problem might be hot-fixed by disabling the Versions App (in particular when the files to edit are located on an external storage).

Any progress on this? I've lost some important data... it seems to be long time since this tread are open...

I have the same issue using NextCloud. It is annoying to loose some data or to wait for everyone to close its browser tab.
Is there any progress about this ?

The part that actually solved it for me was the cronjob. I didnt have it on in the beginning and just used the automatic cronjobbing that works off things through requests.
After I enabled native cronjobs (using actual cron to schedule them) the onlyoffice files always saved when the cronjob ran. So after all clients logged out of the file, on the next 5th minute it was saved.

Can you at least describe the technical issues, so that we can understand the underlying problem? This issue is open for quite a while...

Files can be edited in OnlyOffice, but they never save back to Nextcloud is the issue. People who have it never really see any error messages anywhere usually, which is why they can't pinpoint anything helpful...

Can you at least describe the technical issues, so that we can understand the underlying problem? This issue is open for quite a while...

The problem is that when editing a file, the file is saved inside the Document Server, but not directly on the backend (NextCloud, OwnCloud, etc..). OnlyOffice saves the file only when every people closed its browser tab containing the file in edition.
It's a problem because there can be idle sessions, or backup processes that will not take the modified file since it is only inside Document Server.
What would be great is like a timer / cronjob that saves the file every X minutes to the backend

What would be great is like a timer / cronjob that saves the file every X minutes to the backend

I found for me that using native cronjobs (using actual OS cron running php-cli) will actually save the file when it runs. I have my cron running the Nextcloud jobs every 5 minutes, and on those 5 minute marks, it will reliably save OnlyOffice files... This is how it was fixed for me.

It ONLY does it as long as no browser clients are connected to OnlyOffice for that file, though.

Yes, that does not solve the problem for me. What would be best is to save the file to the backend even if sessions are still connected

I see, that would be a nice feature indeed. I hope that can be made possible

Sorry I did not made myself clear here. We have the exact same issue at our company. My question was pointed at the OnlyOffice Team and since the issue doesn't get solved I wanted to ask for specific details about WHY the issue is so hard to solve technically.
Some cronjob that saves the opened document every minute to Nextcloud would already help a lot. Also some button to push the document back to Nextcloud is also something that users expect. We had this issue with the "Save" Button, where everyone expected the document to be saved to Nextcloud while it was only saved to the document server (which happens anyways while editing...). The button seemed useless like that.
I just the issue gets solved soon. This is the only thing that stops a lot of people using Nextcloud + OnlyOffice for any serious stuff.

@KuenzelIT Did you got a reply? I also can not understand why this this so hard to solve. I don't have the time to dig into the code, but i assume it could be a one-liner.

@KuenzelIT Did you got a reply? I also can not understand why this this so hard to solve. I don't have the time to dig into the code, but i assume it could be a one-liner.

Unfortunately not.

We have same issue by using the integrated application "$HOST/index.php/apps/documentserver_community/" This problem becomes nowadays more urgent, because of Corona so many more colleagues are forced to work from Home and we need to share some files safely, privately and within the browser.
Our System:

Ubuntu LTS 18.04
Nextcloud 18.0.3
OnlyOffice 4.1.4

We've tried cronjobs, putting down session time of users and many more. We appreciate any help!

we are also affected by this bug, exactly  the same behaviour. @alexanderonlyoffice  please keep us updated

We have integrated Nextcloud and OnlyOffice into our online platform. The problem that all tabs of all users of a document have to be closed first is a huge problem for us. We would be so grateful if there could be a solution for a regular forced save. Who can we turn to to solve the problem? Can you tell us what the problem is that for years the problem has not been solved? Perhaps we could also work together.
@alexanderonlyoffice @LinneyS

https://api.onlyoffice.com/editors/save
I've checked out this page of the API of OnlyOffice and there are a few interesting infos relating to this topic:
First of all, apparently automatic saving (back to the document storage) should happen within 10 seconds after editing has concluded. It doesn't define what that means, so I can't say if they mean "after the file was closed out" or something else.
Second, there is a "force saving" mode where one can either force save by a request to the document server (triggering the save callback to the document storage, nextcloud/owncloud in our case, instantly), or the force save will be triggered 5 minutes (by default?) after (guessing here) nothing happened on the document anymore.
I'm almost guessing the force save is executed on the timeout for some reason, except the regular automatic saving. I don't have enough insight into the code here to even say how the regular saving would be triggered (hitting "save" apparently only saves to the document server)... I've tried to investigate it for a bit and haven't been coming up with anything good.
But there's an option that would attach the "save" button in the document to the "force save" function. Quoting from the page above:

Enable the editorConfig.customization.forcesave mode setting it to true in the editor initialization configuration. In this case each time the user clicks the Save button, the forcesave will be done, and the forcesavetype parameter will have the 1 value when sending the request to the callback handler.

This could be configurable using the config gui in the nextcloud configuration for the onlyoffice app, the editor configs are applied here: https://github.com/ONLYOFFICE/onlyoffice-owncloud/blob/master/controller/editorcontroller.php#L847
$params["editorConfig"]["customization"]["forcesave "] = true;

We have the same problem here. We have OnlyOffice Version 5.6.0, running within the docker solution "onlyoffice/documentserver-ie   latest".
Already edited the /etc/onlyoffice/documentserver/local.json and added "autoAssembly": { "enable": true, "interval": "5m" } as suggested here https://api.onlyoffice.com/editors/save and did a /usr/bin/documentserver-generate-allfonts.sh to trigger a restart within the docker container. No Help.
Tried the cron solution, so did a  crontab -u www-data -e adding */5 * * * * php -f /var/www/html/nextcloud/cron.php and changed in admin settings from nextcloud the cron managment from AJAX to cron.  No Help.
Looked in the Browser Network analytics everything is fine:

So where to look next?

Since 2017, this bug exists, and it makes OnlyOffice UNUSABLE as a plugin for NextCloud. Anyone disagrees?

I heard that the bug was fixed with the last update. But we haven't been able to test it yet, because we integrated Nextcloud with OnlyOffice into an online platform and with the update the structure has changed as well, so we can only program the link properly again.
Has anyone tested the latest update to see if the bug is really fixed?
@mhl66 @grueneedv @sinni800 @philipp1992 @alexanderonlyoffice

In case you´re referring to the next update of Nextcloud (18.0.7): it is not. The last version of OnlyOffice in this version is displayed as 4.3.0.

We're currently using

Nextcloud 18.0.3
4.3.0 Plugin of OnlyOffice
5.6.0 as OnlyOffice Version (within docker document-ie version).

This setup didn't worked on friday, but today after I restartet the nextcloud and the onlyoffice server completly. Will investigate further when saving files doesn't work again.

Clarification: Using Nextcloud 18.0.7 (=latest production version), 4.3.0 Plugin of OnlyOffice (latest) and Community Document Server of OnlyOffice, Version 0.1.7
INACCEPTABLE PROBLEM! Data lost! See https://github.com/nextcloud/documentserver_community/issues/12

We have the same problem ....
NC version 19.0.2
can anyone help? I mean, we used collabora for years without bigger issues and swiched to OnlyOffice since it was build in to Nextcloud Hub and now changes are not written to file and the save button can't be used.

Hi all!
Try Keep intermediate versions when editing in settings in v6.0.1

Hi all!
Try Keep intermediate versions when editing in settings in v6.0.1

Very funny - the newest version is 6.0.0 here.
The issue is still the same since 2017. Time to fix it.

I looked into the current code and the solution applied here is the same that I detailed in https://github.com/ONLYOFFICE/onlyoffice-owncloud/issues/59#issuecomment-649832269, but I concluded that it didn't work for me... Does this change work for anyone else?

To clarify: KEEP INTERMEDIATE VERSIONS WHEN EDITING (= "ZWISCHENVERSIONEN BEI DER BEARBEITUNG AUFBEWAHREN") does not change anything, it still does not "force save".
An office suite without saving?

I think the option is even weirdly named for what it does (enable force save)

Yeah, and the german translation is even more ridiculous. But anyway, IT DOES NOT WORK!

It seems to work for me, at least!

Does not work for me. Fresh installation.

An office suite without saving?

Cold you please contact us at<EMAIL_ADDRESS>(subject "OC saving issue") and we will analyze the issue.
We will need a temporary access to your environment.

You´re kidding? "we will analyze the issue" is hardly appropriate, if you kindly read this thread from 2017 on.
Moreover, it´s sure to border on insolence to close this thread, referring to a version that is not even available for Nextcloud (6.0.1) by @LinneyS .

You´re kidding? "we will analyze the issue" is hardly appropriate, if you kindly read this thread from 2017 on.
Moreover, it´s sure to border on insolence to close this thread, referring to a version that is not even available for Nextcloud (6.0.1) by @LinneyS .

Don't you mind if I ask you again to send us access to your environment.
Looking forward to hearing from you.

@mhl66

Very funny

Have you messed up the repository?

Indeed, the 6.0.0 is the newest version on https://github.com/ONLYOFFICE/onlyoffice-nextcloud. That´s what I was referring to. Please excuse the inappropriate comment "very funny". Nevertheless, it obviously (see issue section) does not work on both worlds - OWNCLOUD AND NEXTCLOUD for those users (probably the majority) using the document server module.

@mhl66
The analysis showed that Community Document Server does not work with forcesave.
Please note that Community Document Server was developed by Nextcloud Team, if you have any issues with it, please contact them in the appropriate GitHub repository.
If you are using our official method of integration (Nextcloud + dedicated Document Server instance as per our installation guide), we will be glad to answer your questions. Please see more info on our forum.

Hi all!
Try Keep intermediate versions when editing in settings in v6.0.1

This was quite confusing since there is no version v6.0.1.

@KuenzelIT
Have you messed up the repository?

Seems like it. I just now noticed the owncloud/nextcloud difference in the repository name. I assume my brain already processes those words as being the same.


Windows: Output filename without exe suffix gives "scons failed to create the expected file"

I'm using the latest version of the action and scons can't create the binary file after compiliation.
The platform is Windows.
Nuitka 1.3.8
Here's the run of the CI/CD Pipeline.
Am I doing something wrong/incorrectly?
How can I help SCons create the file?
Should I check back with the people from SCons?
Thanks in advance ❤

Okay that a good to know info.
I checked through the repo and I think that's already handled [correct me if I'm wrong].
From OutputDirectories.py
        elif isWin32OrPosixWindows():
            result += ".exe"

Check one branch higher, that is the one your configuration triggers. I will have something for that soon.

I am getting this, so it's actually disallowed by Nuitka:

FATAL: Error, may only specify output filename for acceleration and onefile mode,
but not for module mode where filenames are mandatory, and not for
standalone where there is a sane default used inside the dist folder.

That was changed for 1.4 I think, but arguably that is a bit close minded, esp. as a recently discovered that the default picked on Linux/macOS can collide with package directory names, and was changed to containing a .bin suffix.

Not my favorite bit of the code, lets see if that will be doable for a hotfix.

Thanks for your report, this is fixed on the factory branch, which is a development version under rapid development. You can try it out by going here: https://nuitka.net/doc/factory.html
Feedback if this is working is very welcome, just please do not share plans of doing it, but rather confirmations or denials of it working.

@kayhayen thanks for the quick fix ❤
I updated my fork of the action with
pip install -U "https://github.com/Nuitka/Nuitka/archive/factory.zip" -r "$github_action_path\requirements.txt"
and ran it through the pipeline.

It just works!

It's wonderful, most gracious thanks.

I am going to add support for branch names later this week likely, then that kind of action should no longer be necessary, and you would be on the 1.4.2 that I published in the mean time maybe.

Will be part of the 1.4.3 hotfix when it comes.

This was release as part of the 1.4.3 hotfix I just made.


add convertReqRes boolean option; make req/res conversion off by default

The current version of the winston and pino ecs-logging formatters automatically handle logging of req, res, request, and response extra fields: converting them from HTTP request and response objects to ECS HTTP, URL, and User agent fields.
This ticket is proposing a BREAKING CHANGE to this while these packages are still in pre-1.x beta:

Turn this off by default and provide a convertReqRes: true boolean option to turn it on.
Only handle req and res as special.

My understanding is the main idea for specially handling HTTP request/response objects stems from:

req/res serializers in pino and Bunyan, and in the
arguably also from req/res handling in many of the provided morgan formats

The argument for making this configurable is to handle the case where a user wants to log req/res but not for an HTTP request or response. The main argument for turning off req/res handling by default is that the req/res handlers in pino and Bunyan are also off by default. As well, having the option to turn on an extra feature feels a little more discoverable... but one could go either way on that.
The argument for only supporting req / res and not request / response is the prevalent usage of just req / res in pino and Bunyan. All examples of logging in code docs for Node.js frameworks that I could find use the short "req" and "res". I would prefer to start these libraries without multiple ways to perform the same thing. If there is a strong use case brought up for them, a separate ticket could discuss re-adding them.
Exception: morgan
Morgan is explicitly "HTTP request logger middleware for node.js". It doesn't provide logging methods for the app developer to even pass in extra fields. It doesn't make sense to have the default @elastic/ecs-morgan-format not render request and response fields.

^^ Done for winston and pino, and morgan won't get the option (see "Exception" note).
These will be in the next release.

^^ Done for winston and pino, and morgan won't get the option (see "Exception" note).
These will be in the next release.


feat: support to mount projected volume in cnpg cluster

This feature enable the support to mount projected volumes, projected volumes sources
will be mounted to /projected base folder.
Closes: #1259
Signed-off-by: Tao Li<EMAIL_ADDRESS>

/test

/test

/ok-to-merge


Set render target to a opengl framebuffer

Issue description:
Hello everyone. Recently, I am focus on playing with godot. And I got a problem when I try to set render target to a opengl framebuffer. I tried RasterizerGLES2::set_base_framebuffer but it does not work.
My sample code:
// create framebuffer and attach texture
glGenFramebuffers(1, &my_target_framebuffer);
glBindFramebuffer(GL_FRAMEBUFFER, my_target_framebuffer);

glGenTextures(1, &my_target_texture);
glBindTexture(GL_TEXTURE_2D, my_target_texture);
glTexParameteri(xxx);
glTexImage2D(xxx);
glFramebufferTexture2D(GL_FRAMEBUFFER, GL_COLOR_ATTACHMENT0,
					GL_TEXTURE_2D, my_target_texture, 0);
GLenum status = glCheckFramebufferStatus(GL_FRAMEBUFFER);

//clear to RED
glClearColor(1, 0, 0, 1);
glClear(GL_COLOR_BUFFER_BIT | GL_DEPTH_BUFFER_BIT);

glBindFramebuffer(GL_FRAMEBUFFER, 0);

// then call set_base_framebuffer, something like:
RasterizerGLES2::set_base_framebuffer(my_target_framebuffer, Vector2(my_target_width, my_target_height));

It does not work at all,  and my_target_framebuffer is always RED (does not draw to my_target_framebuffer), and screen flicker.
plz help!

btw, I use godot 2.1.


Fetching files from container environment to local machine

Is your feature request related to a problem? Please describe.
Fetching files from container environment to local machine
Describe the solution you'd like
Execute copy_files_container.yml playbook, inside tools directory

Solved in devel branch in PR #840


Add pep440-pre-nopost version style

Because the version number should track the upstream swig releases that are included in the PyPI package, post release numbers are used to indicate a change to the PyPI package. It would be nice if versioneer had a version style that just used the TAG[.devN] without appending a post0 in between.

Switched to using setuptools_scm instead of versioner.