error with downloading 2

I'm again. i dont think so that you told me.
because this video is lately video
just same errors in every video download
Download task has been started!
TWITCH LEECHER INFO
Version: 1.5.6
VOD INFO
VOD ID: 488369191
Selected Quality: 1920x1080@60fps (Source)
Download Url: https://www.twitch.tv/videos/488369191
Crop Start: No
Crop End: No
OUTPUT INFO
Output File: A:\Twich\20190930_488369191_Just Chatting.mp4
FFMPEG Path: A:\Twitch Leecher\ffmpeg_x64.exe
Temporary Download Folder: A:\Twich\TL_30c761b1-3d4d-40c2-9440-f45617bcaf01
ACCESS INFO
Token: %7B%22authorization%22%3A%7B%22forbidden%22%3Afalse%2C%22reason%22%3A%22%22%7D%2C%22chansub%22%3A%7B%22restricted_bitrates%22%3A%5B%5D%7D%2C%22device_id%22%3Anull%2C%22expires%22%3A1570403842%2C%22https_required%22%3Afalse%2C%22privileged%22%3Afalse%2C%22user_id%22%3Anull%2C%22version%22%3A2%2C%22vod_id%22%3A488369191%7D
Signature: 2f97d1eafc9455c6e7df6511ecbbc12b7c7ef1ee
Sub-Only: No
Privileged: No
Creating temporary download directory 'A:\Twich\TL_30c761b1-3d4d-40c2-9440-f45617bcaf01'... done!
Retrieving m3u8 playlist urls for all VOD qualities... done!
https://vod-secure.twitch.tv/3955ae8056a45dcab3ae_saddummy_35827849552_1307923309/chunked/index-muted-ANJ9N818ZT.m3u8
https://vod-secure.twitch.tv/3955ae8056a45dcab3ae_saddummy_35827849552_1307923309/720p60/index-muted-ANJ9N818ZT.m3u8
https://vod-secure.twitch.tv/3955ae8056a45dcab3ae_saddummy_35827849552_1307923309/720p30/index-muted-ANJ9N818ZT.m3u8
https://vod-secure.twitch.tv/3955ae8056a45dcab3ae_saddummy_35827849552_1307923309/480p30/index-muted-ANJ9N818ZT.m3u8
https://vod-secure.twitch.tv/3955ae8056a45dcab3ae_saddummy_35827849552_1307923309/audio_only/index-muted-ANJ9N818ZT.m3u8
https://vod-secure.twitch.tv/3955ae8056a45dcab3ae_saddummy_35827849552_1307923309/360p30/index-muted-ANJ9N818ZT.m3u8
https://vod-secure.twitch.tv/3955ae8056a45dcab3ae_saddummy_35827849552_1307923309/160p30/index-muted-ANJ9N818ZT.m3u8
Playlist url for selected quality 1920x1080@60fps (Source) is https://vod-secure.twitch.tv/3955ae8056a45dcab3ae_saddummy_35827849552_1307923309/chunked/index-muted-ANJ9N818ZT.m3u8
Retrieving playlist... done!
Parsing playlist... done!
Number of video chunks: 4276
Starting parallel video chunk download
Number of video chunks to download: 4276
Maximum connection count: 10
Parallel video chunk download is running...
Downloading file 'https://vod-secure.twitch.tv/3955ae8056a45dcab3ae_saddummy_35827849552_1307923309/chunked/1135.ts' failed! Trying again in 20s
System.Net.WebException: 원격 서버에서 (500) 내부 서버 오류 오류를 반환했습니다.
위치: System.Net.WebClient.DownloadDataInternal(Uri address, WebRequest& request)
위치: System.Net.WebClient.DownloadData(Uri address)
위치: TwitchLeecher.Services.Services.TwitchService.<>c__DisplayClass63_0.b__0(VodPlaylistPart part, ParallelLoopState loopState)
Downloading file 'https://vod-secure.twitch.tv/3955ae8056a45dcab3ae_saddummy_35827849552_1307923309/chunked/1135.ts' failed! Trying again in 20s
System.Net.WebException: 원격 서버에서 (500) 내부 서버 오류 오류를 반환했습니다.
위치: System.Net.WebClient.DownloadDataInternal(Uri address, WebRequest& request)
위치: System.Net.WebClient.DownloadData(Uri address)
위치: TwitchLeecher.Services.Services.TwitchService.<>c__DisplayClass63_0.b__0(VodPlaylistPart part, ParallelLoopState loopState)
Downloading file 'https://vod-secure.twitch.tv/3955ae8056a45dcab3ae_saddummy_35827849552_1307923309/chunked/1135.ts' failed! Trying again in 20s
System.Net.WebException: 원격 서버에서 (500) 내부 서버 오류 오류를 반환했습니다.
위치: System.Net.WebClient.DownloadDataInternal(Uri address, WebRequest& request)
위치: System.Net.WebClient.DownloadData(Uri address)
위치: TwitchLeecher.Services.Services.TwitchService.<>c__DisplayClass63_0.b__0(VodPlaylistPart part, ParallelLoopState loopState)
Starting temporary download folder cleanup!
Deleting directory 'A:\Twich\TL_30c761b1-3d4d-40c2-9440-f45617bcaf01'... done!
Download task ended with an error!
System.AggregateException: 하나 이상의 오류가 발생했습니다. ---> System.AggregateException: 하나 이상의 오류가 발생했습니다. ---> System.ApplicationException: Could not download file 'https://vod-secure.twitch.tv/3955ae8056a45dcab3ae_saddummy_35827849552_1307923309/chunked/1135.ts' after 3 retries!
위치: TwitchLeecher.Services.Services.TwitchService.<>c__DisplayClass63_0.b__0(VodPlaylistPart part, ParallelLoopState loopState)
위치: System.Threading.Tasks.Parallel.<>c__DisplayClass17_01.<ForWorker>b__1()    위치: System.Threading.Tasks.Task.InnerInvokeWithArg(Task childTask)    위치: System.Threading.Tasks.Task.<>c__DisplayClass176_0.<ExecuteSelfReplicating>b__0(Object <p0>)    --- 내부 예외 스택 추적의 끝 ---    위치: System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)    위치: System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)    위치: System.Threading.Tasks.Parallel.ForWorker[TLocal](Int32 fromInclusive, Int32 toExclusive, ParallelOptions parallelOptions, Action1 body, Action2 bodyWithState, Func4 bodyWithLocal, Func1 localInit, Action1 localFinally)
위치: System.Threading.Tasks.Parallel.ForEachWorker[TSource,TLocal](IEnumerable1 source, ParallelOptions parallelOptions, Action1 body, Action2 bodyWithState, Action3 bodyWithStateAndIndex, Func4 bodyWithStateAndLocal, Func5 bodyWithEverything, Func1 localInit, Action1 localFinally)
위치: System.Threading.Tasks.Parallel.ForEach[TSource](IEnumerable1 source, ParallelOptions parallelOptions, Action2 body)
위치: TwitchLeecher.Services.Services.TwitchService.DownloadParts(Action1 log, Action1 setStatus, Action1 setProgress, VodPlaylist vodPlaylist, CancellationToken cancellationToken)    위치: TwitchLeecher.Services.Services.TwitchService.<>c__DisplayClass57_0.<StartQueuedDownloadIfExists>b__2()    위치: System.Threading.Tasks.Task.Execute()    --- 내부 예외 스택 추적의 끝 --- ---> (내부 예외 #0) System.AggregateException: 하나 이상의 오류가 발생했습니다. ---> System.ApplicationException: Could not download file 'https://vod-secure.twitch.tv/3955ae8056a45dcab3ae_saddummy_35827849552_1307923309/chunked/1135.ts' after 3 retries!    위치: TwitchLeecher.Services.Services.TwitchService.<>c__DisplayClass63_0.<DownloadParts>b__0(VodPlaylistPart part, ParallelLoopState loopState)    위치: System.Threading.Tasks.Parallel.<>c__DisplayClass17_01.b__1()
위치: System.Threading.Tasks.Task.InnerInvokeWithArg(Task childTask)
위치: System.Threading.Tasks.Task.<>c__DisplayClass176_0.b__0(Object )
--- 내부 예외 스택 추적의 끝 ---
위치: System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
위치: System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
위치: System.Threading.Tasks.Parallel.ForWorker[TLocal](Int32 fromInclusive, Int32 toExclusive, ParallelOptions parallelOptions, Action1 body, Action2 bodyWithState, Func4 bodyWithLocal, Func1 localInit, Action1 localFinally)    위치: System.Threading.Tasks.Parallel.ForEachWorker[TSource,TLocal](IEnumerable1 source, ParallelOptions parallelOptions, Action1 body, Action2 bodyWithState, Action3 bodyWithStateAndIndex, Func4 bodyWithStateAndLocal, Func5 bodyWithEverything, Func1 localInit, Action1 localFinally)    위치: System.Threading.Tasks.Parallel.ForEach[TSource](IEnumerable1 source, ParallelOptions parallelOptions, Action2 body)    위치: TwitchLeecher.Services.Services.TwitchService.DownloadParts(Action1 log, Action1 setStatus, Action1 setProgress, VodPlaylist vodPlaylist, CancellationToken cancellationToken)
위치: TwitchLeecher.Services.Services.TwitchService.<>c__DisplayClass57_0.b__2()
위치: System.Threading.Tasks.Task.Execute()
---> (내부 예외 #0) System.ApplicationException: Could not download file 'https://vod-secure.twitch.tv/3955ae8056a45dcab3ae_saddummy_35827849552_1307923309/chunked/1135.ts' after 3 retries!
위치: TwitchLeecher.Services.Services.TwitchService.<>c__DisplayClass63_0.b__0(VodPlaylistPart part, ParallelLoopState loopState)
위치: System.Threading.Tasks.Parallel.<>c__DisplayClass17_0`1.b__1()
위치: System.Threading.Tasks.Task.InnerInvokeWithArg(Task childTask)
위치: System.Threading.Tasks.Task.<>c__DisplayClass176_0.b__0(Object )<---
<---

I can download the given VOD without any problems. Like the log says, TL is unable to download some files. That is not the problem of TL. To check that you can click on the URLs in the log file of the failed parts:
What happens if you click on the following link?
https://vod-secure.twitch.tv/3955ae8056a45dcab3ae_saddummy_35827849552_1307923309/chunked/1135.ts
Can you download this file or not?
I can download it. If you cannot there must be an issue that I am not able to reproduce or fix. Twitch has some weird region-locking going on. There were multiple errors in the past where people of different countries could not download a certain VOD whereas other people could. I am not aware what Twitch is doing.
As I states before, I cannot do anything about this. TL only tries to download files Twitch tells it to download. There is nothing to fix.

I can download the given VOD without any problems. Like the log says, TL is unable to download some files. That is not the problem of TL. To check that you can click on the URLs in the log file of the failed parts:
What happens if you click on the following link?
https://vod-secure.twitch.tv/3955ae8056a45dcab3ae_saddummy_35827849552_1307923309/chunked/1135.ts
Can you download this file or not?
I can download it. If you cannot there must be an issue that I am not able to reproduce or fix. Twitch has some weird region-locking going on. There were multiple errors in the past where people of different countries could not download a certain VOD whereas other people could. I am not aware what Twitch is doing.
As I states before, I cannot do anything about this. TL only tries to download files Twitch tells it to download. There is nothing to fix.

i can download you given to me.

So try again downloading the VOD...

So try again downloading the VOD...

um.. i tried download again
this time i can download up to 70% of the same video.
but same error came up again..
i cant understand 'internal exception'


Lamdera 1.3.1

Summary of changes in this release
https://dashboard.lamdera.app/releases/v1-3-1
Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[x] aarch64-darwin

@Zimmi48


Class not found on some pages

normaly phpwkhtmltopdf working fine
but error come on new pages, this is not working on some or new pages
and error  display
Fatal error: Class 'mikehaertl\wkhtmlto\pdf' not found
when i add this line
require 'wkhtmltopdf/vendor/mikehaertl/phpwkhtmltopdf/src/Pdf.php';
then its work fine
but this line need only new pages

Sorry, I can't provide help with basic class loading issues. Please consult the according documentation in composer here: https://getcomposer.org/doc/01-basic-usage.md#autoloading


IntoPy and FromPyObject integration

As currently designed, pythonize and depythonize on structs with both Serialize and IntoPy implementations will always use the Serialize implementation.
I'm not sure if that's surprising - it's certainly predictable though.
Open point of discussion as to whether pythonize should attempt to re-use existing IntoPy implementations, and if so, how could this be implemented?

I had a crate (closed source unfortunately) that does the same as pythonize. The idea is to opt in to custom serialization/deserialization.
I exposed a choice as there are pros and cons with each:

A module that can be used at the field level with #[serde(serialize_with = "as_py_object")]
A SerdePyObject<T> wrapper which has its own Serialize and Deserialize, implemented in terms of the same as_py_object module

(1) is transparent on the struct as it requires no changes to field types, whereas (2) is finer grained and can be applied like things: HashMap<String, SerdePyObject<MyThing>>.
In terms of implementation, serialization works as follows:

Borrow a pointer from the PyObject
Write a struct with a specially named [u8] field like { "__pyobject_ptr": [ /* 8 pointer bytes go here */ ] }

Deserialization works by looking for the specially named field and treating it as a pointer.

I would certainly appreciate this. My use case is as follows:

Define a rust enum that can be exposed to python using the pyclass attribute
Include that enum in a rust struct
Use pythonize to convert struct to python dict

At the moment I get a Python str which is annoying because it can't be compared
Example:
use pyo3::prelude::*;
#[pyclass]
enum E {
    Foo,
    Bar,
}

#[derive(Serialize)]
struct S {
    other_field: String
    enum_field: E,
}

let s = S {
    other_field: "potato".to_owned(),
    enum_field: E:Foo,
}
pythonize::pythonize(py, &s)

which then gives in python
{'other_field': 'potato', 'enum_field': 'Foo'}

At the moment I'm too busy to look into this myself; contributions are welcome. The proposal by @1tgr sounds like it could work as an opt-in mechanism!
(I think to have something work automatically would require specialization, though I haven't thought too hard!)


Should use exit code to distinguish between no results and an invocation error

ack, grep, and rg all return a different exit code when there is an error (different from the usual "1" which means "no results"). It would be nice if ag did the same.
Related rg issue: https://github.com/BurntSushi/ripgrep/issues/948

I don't know whether this issue was never closed, or whether haven't examined the recent code, but die(), the function utilised for reporting errors in ag and defined in util.c, looks like the following:
void die(const char *fmt, ...) {
    va_list args;
    va_start(args, fmt);
    vplog(LOG_LEVEL_ERR, fmt, args);
    va_end(args);
    exit(2);
}

The exit(2) at the end returns 2 as the exit code. However, the code returned in main during normal operation (no errors) is
return !opts.match_found;

Essentially, the above returns 1 if no results are found and 0 if results are found.
I'm not sure whether you would like to distinguish between specific errors or whether you just wanted to know whether an error occurred during operation via the exit status. I personally don't know the internals of ag very well, but as far as I can tell, die() is used for reporting all errors and exiting when an error occurs. Unless there are certain places where this doesn't occur, I think your issue has been solved.

@s1l3ntcat: I reported this based on the behavior of (what I think is) the latest release, v2.2.0:
$ ag --non-existent > /dev/null
ag: unrecognized option `--non-existent'
zsh: exit 1

It is possible this has already been fixed in master.

@wincent: That would explain things. It's strange they didn't close your issue though...


Container now supports dynamic layout changes.

Fixes #67 and #165

Pull Request Test Coverage Report for Build 995

93 of 95 (97.89%)  changed or added relevant lines in 5 files are covered.
2 unchanged lines in 1 file lost coverage.
Overall coverage increased (+0.4%) to 92.524%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

container/container.go
27
29
93.1%

Files with Coverage Reduction
New Missed Lines
%

termdash.go
2
93.71%

Totals

Change from base Build 983:
0.4%

Covered Lines:
6535

Relevant Lines:
7063

💛  - Coveralls

Pull Request Test Coverage Report for Build 995

93 of 95 (97.89%)  changed or added relevant lines in 5 files are covered.
2 unchanged lines in 1 file lost coverage.
Overall coverage increased (+0.4%) to 92.524%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

container/container.go
27
29
93.1%

Files with Coverage Reduction
New Missed Lines
%

termdash.go
2
93.71%

Totals

Change from base Build 983:
0.4%

Covered Lines:
6535

Relevant Lines:
7063

💛  - Coveralls


Domain reference for Format-Custom views

I am working with multiple domains, and doing something like this:
foreach($DC in $DCs){
     $accounts += Get-ADReplAccount -All -Server $DC
}
$accounts |  Test-PasswordQuality -WeakPasswordHashesSortedFile $HIBP | Out-File $auditoutput  -Encoding ASCII
$accounts |  Format-Custom -View PwDump | Out-File $hashoutput -Encoding ASCII

In the output for Test-PasswordQuality i get domain\user.
But in the PwDump I only get username.
Is there a way to get a domain reference in the pwdump etc.?
Thank you

Hi @Jupithor, all custom views would deserve some improvements, including a filter that would drop user accounts without password hashes and computer accounts.
You could try to manually modify the DSInternals.DSAccount.ExportViews.format.ps1xml file and replace $PSItem.SamAccountName with $PSItem.LogonName. I would be curious to hear if the \ character is compatible with the current versions of tools like Hashcat, John the Ripper, Ophcrack, Rainbowcrack, or Elcomsoft Distributed Password Recovery.

Thank you for your reply.
Yes, i am currently using -replace to prepend $domain\ .
I can confirm that it works with Hashcat.


narrowlink: init at 0.1.2

Description of changes
Closes https://github.com/NixOS/nixpkgs/issues/248617.
Disclaimer: I haven't tested the resulting binaries thoroughly yet.

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Once this gets merged I'll make a nixos module for it.


[Workers] Added a tutorial for storing data with Fauna in tutorials/store-data-with-fauna/index.md

Added a tutorial for storing data with Fauna

JK – it's not letting me apply suggestions. Is the "allow maintainers to edit" option checked?

JK – it's not letting me apply suggestions. Is the "allow maintainers to edit" option checked?

Odd - it doesn't give me the option. It's not that it isn't checked, it just isn't there at all.
Ok with you if I push a new commit integrating your requested changes?

Yes of course! It's just a lot more manual/tedious for you that way. Sorry about that

We took care of the<EMAIL_ADDRESS>upgrade here: https://github.com/fauna-labs/fauna-workers/pull/1
The PR also removes the customFetch util, which wasn't needed.

Commented on each individual issue as I updated on the original branch.
I believe this leaves two open items:

Line 47: @lukeed and @deadlypants1973 formatting for steps / UI elements
Line 116: @lukeed and @rts-rob to discuss Worktop 0.6.3 -> 0.7 migration

Thanks for the quick and thorough review, @lukeed!

@rts-rob Hi Rob, thank you for the tutorial :) I've just added my comments on UI directions and style guide formatting.


Leash and Name scaling fixes only in FORGE, not FABRIC, or QUILT

The changes from the 2 commits
https://github.com/bernie-g/geckolib/commit/59e211c68fba8e8d1ed339a6b58098a99824bdd1
https://github.com/bernie-g/geckolib/commit/7c755701878ae94331fe218750977f1784dab03e
only were applied to the FORGE project. Please transfer the fixes to FABRIC.

I just recognized the new method: scaleModelForBaby which looks like handling scaling stuff.
Maybe this already solves the problem, so the issue can probably be closed?


Chore: removes unnecessary css imports + enable system fonts

What's the purpose of this pull request?

[x] Removes unnecessary fonts imported in the theme file and its docs.
[x] Import the reset.css as the first file.

Related PR

https://github.com/vtex/faststore/pull/1792

How it works?

We don't need to import this external files inside the theme file since it's already imported in the global css from _app.tsx.
Import the reset.css as the first file so that the font-family from modern normalize, that is imported from reset.scsscan be overrided  by the ones from the theme in starter.store.

How to test it?

Use the midnight theme file from this branch in starter.store PR and check if the font family from the HTML is Raleway (from midnight) instead of system-ui, -apple-system (from modern-normalize).

Starters Deploy Preview
https://github.com/vtex-sites/starter.store/pull/62

Closed. We are dealing with it in

https://github.com/vtex/faststore/pull/1792


SL Review: Change error message to address autopopulate error

#724 did not address the auto populate issue. It still happens occasionally. To address the confusion cause by having a name in the field but still seeing the validation error for name.
Change validation error message for employee name to -
"Enter employee name e.g. Doe Jane is required. If you are seeing this error after the field has been filled, refresh the page and fill the name again. Don't forget to save changes if you don't want to lose your work "

I have updated the save changes condition with one more value.
Could you please confirm the below point?
When you face a similar issue, try to save using "save changes" button on the right-bottom. If it shows a success message in green on the top-right.
If the above case works fine, we can direct the user to click on save changes and go to the draft form, and continue. In this manner, they can retain filled data and the form gets reloaded.

@fazil-ey to update the error message

@fazil-ey
Is it working for you? like click on "save changes" and then start editing in draft form.
It must be work if we are planning to put this message. I'm not able to reproduce this by playing around with hidden fields and a search bar for employee names.

@bhumin-fw

@fazil-ey Ohh that's bad. The script that we are using is not working.
The original step looks good to you ? the one with "clear name" and select it again?
If you got some time, could you share what you are doing to reproduce it?

https://bcgov.sharepoint.com/:v:/r/teams/03991/Shared Documents/SL Review/Auto populat error 2 dec 19.mov?csf=1&web=1&e=WFGMuO
https://bcgov.sharepoint.com/:v:/r/teams/03991/Shared Documents/SL Review/Autopopulate error dec 19.mov?csf=1&web=1&e=NDoD3t

the error message does not last under the name field. The pop up error message does not have the instructions
https://bcgov.sharepoint.com/:v:/r/teams/03991/Shared Documents/Bullying - Misuse of Authority Complaint Form/Autopoulate error Dec 21.mov?csf=1&web=1&e=MNM1CC

@fazil-ey
I have matched both the error messages component and the popup.

Error message is clear and valid. Reentering name solves the error


Importing into Android Studio fails

Importing my fork of the project through the Android studio interface fails.
the error shown is :
Neither path nor baseDir may be null or empty string path='null' basedir='/path/to/project'
tried to google the problem and it most likely is an issue with build.grade in the app directory

this is the line causing the problem
https://github.com/dinosaurwithakatana/hacker-news-android/blob/master/app/build.gradle#L19
after commenting the whole block I was able to build the app

Correct, you need to create a keystore.properties file as shown here: https://github.com/dinosaurwithakatana/hacker-news-android/blob/master/keystore.properties.example
and fill it with your own keystore. I dont think this is necessary for debug builds though


Reducing vendors filesize

Codecov Report

Merging #152 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #152   +/-   ##
=======================================
  Coverage   83.37%   83.37%
=======================================
  Files          81       81
  Lines        2635     2635
  Branches      541      541
=======================================
  Hits         2197     2197
  Misses        431      431
  Partials        7        7

Impacted Files
Coverage Δ

src/component/chart/ContactMapChart.tsx
96.15% <0%> (ø)
:arrow_up:

src/component/chart/PlotlyChart.tsx
95.23% <0%> (ø)
:arrow_up:

src/data/PlotlyData.ts
100% <0%> (ø)
:arrow_up:

src/component/chart/AuxiliaryAxis.ts
100% <0%> (ø)
:arrow_up:

src/helper/ColorMapper.ts
100% <0%> (ø)
:arrow_up:

src/data/TintedBioblocks1DSection.ts
90.9% <0%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a567a52...8efc3c8. Read the comment docs.


Anonymous declared function/promise self invokes itself

Hey Michel, I'm having a slight issue here with anonymous declared queries. This might not even have to do with your code at all, but when I declare a query as an anonymous variable, it invokes itself.
For example:
var deleteContactsPendingDoc = r.table( 'contacts_pending' ).get( doc.id ).delete().run().then( function () {
	return true
} ).error( function ( err ) {
	return next( new restify.errors.InternalServerError( err ) )
} )

That code will execute on it's own no matter the circumstances. I'm trying to declare a few querys as variables so later I can then use Promise.all()
Here's an example route:
module.exports = function ( req, res, next ) {

	var data = _.pick( req.json, 'id', 'block' )

	r.table( 'contacts_pending' ).get( data.id ).run().then( function ( doc ) {
		// doc: {
		//     "dname": "Android Tablet",
		//     "fav": false,
		//     "groups": [],
		//     "id": "9878eacd-e78e-4468-8244-443fa64646ae",
		//     "uname": "cel1337",
		//     "xid": "roblav96"
		// }

		var deleteContactsPendingDoc = r.table( 'contacts_pending' ).get( doc.id ).delete().run().then( function () {
			console.warn( 'deleteContactsPendingDoc()' )
			return true
		} ).error( function ( err ) {
			return next( new restify.errors.InternalServerError( err ) )
		} )

		var blockUname = r.table( 'users' ).get( doc.uname ).run().then( function ( rDoc ) {
			// this function gets executed EVEN when data.block = false and the function is not in the promises array
			console.warn( 'blockUname()' )
			rDoc.blockedUsers.push( doc.xid )
			rDoc.blockedUsers = _.unique( rDoc.blockedUsers )

			return r.table( 'users' ).get( rDoc.id ).update( {
				blockedUsers: rDoc.blockedUsers
			} ).run().then( function () {
				return true
			} ).error( function ( err ) {
				return next( new restify.errors.InternalServerError( err ) )
			} )

		} ).error( function ( err ) {
			return next( new restify.errors.InternalServerError( err ) )
		} )

		var promises = [ deleteContactsPendingDoc ]
		if ( data.block == true ) {
			promises = [ deleteContactsPendingDoc, blockUname ]
		}

		return Promise.all( promises ).then( function ( resolved ) {
			res.send( resolved[ 0 ] )
			return next()
		} ).catch( function ( err ) {
			return next( new restify.errors.InternalServerError( err ) )
		} )

	} ).error( function ( err ) {
		return next( new restify.errors.InternalServerError( err ) )
	} )

}

I only want to run the query in the variable blockUname if data.blocked = true and when it's added to the Promise.all()
I remember how helpful you were last time, so I figured I'd give this a shot. Thank you!!!

Also, should I send my donations to:
<EMAIL_ADDRESS>or
<EMAIL_ADDRESS>?

If you call run on a query, it will immediately run it. If you want to store the query to later execute it, you can do something like:
var query1 = r.db('test').table('test').filter(r.row('name').eq('John')) // not that this do not call `run`
var query2 = r.db('test').table('test').get(2) // not that this do not call `run`

// Do more stuff here

// Execute all the queries now:
Promise.all([query1.run(), query2.run()]).then(...).error(...)

As for donations, I haven't set up anything so you can't make a donation for now :)

Ah, I actually misread the question.
When you call any reql method with an anonymous function, the function is immediately closed and serialized since it will be executed in the server.
This also means that you cannot have promises for example in your anonymous functions.

You've explained it perfectly for me! I thought that defining the promise as a variable wouldn't invoke itself. Thank you sir!!!


ViaVersions And Viaversions Backwards "cannout connect to server"

What is the output link of /viaversion dump?
Are you using any additional software like BungeeCord? If so, what software and version? (Please list your plugins as well)
Viaversions
Backwards Viaversions
ProtocolLib
How does this error happen? login? Using an item?
On the Minecraft Server List
Is there an error in the console? Use pastebin.com. Is there a kick message?

We can't help you with the very limited information you provided.

Please recreate this issue / update it with proper information and instructions on what happens and the dump and we'd be happy to help.


turnOff should be idempotent

Hello,
I experience this bug: https://github.com/hobbyquaker/lgtv2/issues/15 (webOS 4.5 in my case)
Shortly after turning off the TV it is turned on by issuing the same turnOff command via the HTTP API.
To work around this, my suggestion is to:

Issue turnOff only when we know the TV is on states.power == true or states.on == true.
After sending the command and not getting back an err immediately switch both states above to their "off" representations.

What is the difference between states.power and states.on?

I implemented idempotency and will test that with my setup:
https://github.com/agross/ioBroker.lgtv/commit/03c93c7810b63ae2e7989ba36213d490f556d925


Text not visible due to color scheme

Reported by /u/Aoi32 on reddit:

...my default color scheme obscures the text I have not yet typed. Do you think you could set the color of the text you have not yet typed as the inverse of the terminals current color?

You answered:

Good catch – I'll definitely try and do something along those lines. At the very least I should make the colours configurable...

For me, only the text under the cursor is invisible. But that is an issue.
Using version <IP_ADDRESS>, built from git commit 11e626449ce746f432e52c4b2ac3bcfe0e1b866a, on Mac OS X 10.10.5, using stack install.

v<IP_ADDRESS> includes --fg-empty and --fg-error options. If you set fg-empty to some other colour that doesn't clash with your background then you should be able to see the text.
The colours are
0: black
1: red
2: green
3: yellow
4: blue
5: magenta
6: cyan
7: white

If you find one that works well, I would alias gotta-go-fast to gotta-go-fast --fg-empty n.


🚀 Feature: Custom ruleset for entity validation

🔖 Feature description
Add the possibility to define a custom ruleset for the entity validation plugin which will be checked additionally.
🎤 Context
At the moment the entity validation plugin only checks whether the syntax is valid. I think it would be a great addition to be able to add custom rules that will be checked additionally. Specifically every backstage instance should be able to have custom rules.
Examples:

type of owner needs to be a group
a description must be set
each system must have a domain as parent
etc.

✌ Possible Implementation
The ruleset should be defined in app-config.yaml.  Moreover, the implementation should be generic and easy to upgrade.
👀 Have you spent some time to check if this feature request has been raised before?

[X] I checked and didn't find similar issue

🏢 Have you read the Code of Conduct?

[X] I have read the Code of Conduct

Are you willing to submit PR?
Yes I am willing to submit a PR!

Do you mean the catalog backend plugin itself or something different? In case of the catalog backend you can define your own validation logic through custom processors, see this and below as well as this. Since #14898 all these validators will run as well, not just the first one the matches.


Syntax Highlighting, Compilation, a P Theme File, Problem Reporting

Preliminary instructions to install this extension:

Clone this repository.
cd into this repository and call 'npm install'
Run 'cmd' 'shift' 'B' on this repository in VSCode to build this project.
Move this folder into the ~/.vscode/extensions directory.
Add {"identifier":{"id":"undefined_publisher.peasy-ide-vscode"},"version":"0.0.1","location":{"$mid":1,"path":"~/.vscode/extensions/peasy-ide-vscode","scheme":"file"},"relativeLocation":"peasy-ide-vscode"} to ~/.vscode/extensions/extensions.json
Restart VS Code.
Any P files should now be populated with syntax highlighting! Use P's Custom Theme by selecting with the dropdown at Code > Settings > Theme > Color Theme.

Further P Extension Support:

Compilation: Open any P project folder. Navigate to a file that ends with .p or .pproj and press 'f5' to compile.
Use P's Custom Theme by selecting with the dropdown at Code > Settings > Theme > Color Theme.\
P should now support Errors that occur during compilation in the Problems panel.

Section 1: Summary
This extension so far supports syntax highlighting, a new custom P theme file, compilation when the user presses f5, and problem reporting within the VSCode IDE. The P theme and grammar file now groups together different keywords based on the Quip document as well as different types, constants, expressions, statements, and other keywords.
I provided error support by implementing a task that runs in the background and re-compiles the program every time it detects a user change. A user can navigate to the Problems panel in order to view the errors their program encounters currently.
I also provided compilation support by using configurations.keybindings to bind the command 'p.run' to the key f5.
ERROR REPORTING SUPPORT

SYNTAX HIGHLIGHTING + P CUSTOM THEME FILE

RUNNING F5 RESULT

Section 2: Testing
I tested my code by running an npm watch task in the background every time VSCode launched my extension that translated my typescript files into javascript files. Then, pressing f5 would launch the extension inside a folder inside VS Code and compile the javascript code. I could open a sample file in P where I could see the changes I made affect the file.

FYI, to use npm from https://www.npmjs.com/, I created a new https://www.npmjs.com/ account and do the following instead of npm install:
npm login --auth-type=legacy --registry=https://registry.npmjs.org
npm install --auth-type=legacy --registry=https://registry.npmjs.org

Beyond this, the instructions work!
On opening a P project with the new plugin, VS code reported the plugin crashed multiple times. Error reported:
Could not execute because the specified command or file was not found.
Possible reasons for this include:
  * You misspelled a built-in dotnet command.
  * You intended to execute a .NET program, but dotnet-/Users/esthersu/P/PLanguageServer/bin/Debug/net7.0/PLanguageServer.dll does not exist.
  * You intended to run a global tool, but a dotnet-prefixed executable with this name could not be found on the PATH.
[Error - 9:50:56 AM] Server initialization failed.
  Message: Pending response rejected since connection got disposed
  Code: -32097
[Info  - 9:50:56 AM] Connection to server got closed. Server will restart.
true
[Error - 9:50:56 AM] p-vscode client: couldn't create connection to server.
  Message: Pending response rejected since connection got disposed
  Code: -32097
Could not execute because the specified command or file was not found.
Possible reasons for this include:
  * You misspelled a built-in dotnet command.
  * You intended to execute a .NET program, but dotnet-/Users/esthersu/P/PLanguageServer/bin/Debug/net7.0/PLanguageServer.dll does not exist.
  * You intended to run a global tool, but a dotnet-prefixed executable with this name could not be found on the PATH.
[Error - 9:50:56 AM] Server initialization failed.
  Message: Pending response rejected since connection got disposed
  Code: -32097
[Info  - 9:50:56 AM] Connection to server got closed. Server will restart.
true
[Error - 9:50:56 AM] p-vscode client: couldn't create connection to server.
  Message: Pending response rejected since connection got disposed
  Code: -32097
Could not execute because the specified command or file was not found.
Possible reasons for this include:
  * You misspelled a built-in dotnet command.
  * You intended to execute a .NET program, but dotnet-/Users/esthersu/P/PLanguageServer/bin/Debug/net7.0/PLanguageServer.dll does not exist.
  * You intended to run a global tool, but a dotnet-prefixed executable with this name could not be found on the PATH.
[Error - 9:50:57 AM] Server initialization failed.
  Message: Pending response rejected since connection got disposed
  Code: -32097
[Info  - 9:50:57 AM] Connection to server got closed. Server will restart.
true
[Error - 9:50:57 AM] p-vscode client: couldn't create connection to server.
  Message: Pending response rejected since connection got disposed
  Code: -32097
[Error - 9:50:57 AM] Restarting server failed
  Message: Pending response rejected since connection got disposed
  Code: -32097
Could not execute because the specified command or file was not found.
Possible reasons for this include:
  * You misspelled a built-in dotnet command.
  * You intended to execute a .NET program, but dotnet-/Users/esthersu/P/PLanguageServer/bin/Debug/net7.0/PLanguageServer.dll does not exist.
  * You intended to run a global tool, but a dotnet-prefixed executable with this name could not be found on the PATH.
[Error - 9:50:58 AM] Server initialization failed.
  Message: Pending response rejected since connection got disposed
  Code: -32097
[Info  - 9:50:58 AM] Connection to server got closed. Server will restart.
true
[Error - 9:50:58 AM] p-vscode client: couldn't create connection to server.
  Message: Pending response rejected since connection got disposed
  Code: -32097
[Error - 9:50:58 AM] Restarting server failed
  Message: Pending response rejected since connection got disposed
  Code: -32097
Could not execute because the specified command or file was not found.
Possible reasons for this include:
  * You misspelled a built-in dotnet command.
  * You intended to execute a .NET program, but dotnet-/Users/esthersu/P/PLanguageServer/bin/Debug/net7.0/PLanguageServer.dll does not exist.
  * You intended to run a global tool, but a dotnet-prefixed executable with this name could not be found on the PATH.
[Error - 9:50:58 AM] Server initialization failed.
  Message: Pending response rejected since connection got disposed
  Code: -32097
[Error - 9:50:58 AM] The p-vscode server crashed 5 times in the last 3 minutes. The server will not be restarted. See the output for more information.
[Error - 9:50:58 AM] p-vscode client: couldn't create connection to server.
  Message: Pending response rejected since connection got disposed
  Code: -32097
[Error - 9:50:58 AM] Restarting server failed
  Message: Pending response rejected since connection got disposed
  Code: -32097

We need to clean this up in the main branch, and experiment with PLangServer on a different experimental branch.
The P compiler works as expected through the plugin if the .pproj file is open in the editor or all editor windows are closed. Since a P project is generally of the structure like:
.
├── PForeign
│   └── ForeignCode.cs
├── PSpec
│   └── Spec.p
├── PSrc
│   └── Source.p
├── PTst
│   ├── TestDriver.p
│   └── TestScripts.p
└── ProjectName.pproj

right now, if Source.p is only open in the editor, the p compile command through the plugin fails. Is there a way to get around this, so that we always run p compile from the project root, i.e., the folder containing *.pproj file?

Also, right now, if we open or close any file in the editor, the p compile command is triggered. If I open two files too quickly, I get the VS code error: The task 'MyTask: Errors (2_TwoPhaseCommit)' is already active..
Is it possible to resolve this?

I fixed all the errors you commented on. Should I push all my changes again? I changed things so that the extension doesn't attempt to connect with a server anymore. Also, the VSCode error for the task should be fixed now. And the "p compile" command should now work from any file.

I made a change so that the Error Reporting only occurs when the user changes a ".p" file and saves it. I also commented out the language server implementation.

I made a change so that the Error Reporting only occurs when the user changes a ".p" file and saves it. I also commented out the language server implementation. And, the P grammar highlighting errors should be fixed now.

Thanks @suesther for the changes. It looks good now.
One small thing I see now is that compile errors are not getting displayed in the Problems tab in VS code (unlike before). Having them in the Problems tab was neat, since clicking them directly jumps to the line where the error is reported.

For me, the compile errors are displayed in the Problems tab in VS Code. Are you sure that your file has errors?

My mistake. The Problems tab is indeed showing compile errors. However, they remain stale at times.
Say you have a single .p file open in the editor. And press F5 to compile it. Say it reports compile error ERROR1. Now even after correcting ERROR1 and pressing F5, terminal compiles P model without any error. But Problems tab is not updated. The reason is Problems tab is getting updated whenever you switch editor from one file to another. But not on F5.
Terminal and Problems tabs should be updated always together.
Do you see the same on your end?

Also, I still see the VS code warning: "The task 'MyTask: Errors (2_TwoPhaseCommit)' is already active." when switching to different .p files in the editor too quickly.
Do you see the same?

Thanks for all updates. Looking solid!


Request : force fullscreen in landscape on mobile devices

[x] Issue does not already exist
[ ] Issue observed on https://plyr.io

Expected behaviour
Not sure if it should be a default behaviour but when using the chrome player fullscreen button we get the video forced in landscape mode which is nice, same thing with the youtube app, even if you don't enable landscape or auto rotation on the device, in plyr there's no way to force landscape fullscreen like that

Browser: Chrome
Version: 52
Operating System: Android
Version: 7.1.1

Players affected:

[x] HTML5 Video
[ ] HTML5 Audio
[ ] YouTube
[ ] Vimeo

Steps to reproduce

Click fullscreen when device is in portrait

Relevant links

Good idea. Will look into it... 👍

Yes. I've been looking solutions for that Mobile Orientation. By default behaviour using <video src="somelink" allowfullscreen > that allowfullscreen works perfectly when pressed for fullscreen, automatically landscape orientation for mobile. We need this feature ASAP ! . Also, I've been thinking using eventlistener for orientationchange where a device is using mobile size.

@ammein Get a pull request in 👍

@ammein I tried doing that but in vain. Any other suggestions?

I am wait for next version

Okay, so after forgetting about this just found an easy way to get this working, I'm using some code on my custom javascript not tested to add to plyr yet,
When fullscreen toggling is done just force "landscape", this will align on the actual landscape orientation
:
$(document).on('webkitfullscreenchange mozfullscreenchange fullscreenchange MSFullscreenChange', function() {
if(plyr.fullscreen.active) {
screen.orientation.lock("landscape");
} else {
screen.orientation.unlock();
}
}
Would need to be disabled if height > width

Looks like there's no support in Safari:
https://developer.mozilla.org/en-US/docs/Web/API/ScreenOrientation/lock
But we can always add this in...

But we can always add this in...

Just a reminder to please add this in so that Plyr can be on par with the normal html5 player in Android Chrome.

Looks like there's no support in Safari:
https://developer.mozilla.org/en-US/docs/Web/API/ScreenOrientation/lock
But we can always add this in...

Any progress yet?

No updates on this one yet?!

No updates on this one yet?!

No pull requests yet?!

`var winwidth=$(window).width();
var winheight=$(window).height();
        const player = Plyr.setup('#player');
        player.forEach (item => {

            item.on('enterfullscreen', event => {

             $(".plyr__video-wrapper").css({"transform": "rotate(90deg)", "height": winwidth, "width": winheight, "margin-left": "0px", "margin-right": "0px"});
            })
            item.on('exitfullscreen', event => {
             $(".plyr__video-wrapper").css({"transform": "rotate(0deg)", "height": "100%", "width": "100%", "margin-left": "auto", "margin-right": "auto"});
            })
        });`

I also faced the same problem. And that's how I did it, it works very nicely!

I have same problem , you ca help me ?

Plyr


[SUPPORT] Hudi delete not working when using UuidKeyGenerator

Describe the problem you faced
We wish to delete records matching specified record keys. This works for records written with ComplexKeyGenerator, but fails for records written with UuidKeyGenerator.
If these records have been written with ComplexKeyGenerator, this succeeds. The record key is 2 fields, env_id and user_id. We query hudi to find all the records that match. We then delete these records using the datasource API. Success - the expected records are deleted.
We try the same thing for records that have been written with UuidKeyGenerator. The record key for the table is the same as above: a combination of 2 fields, env_id and user_id. We query hudi as before and as before we find all the records that match. We then try to delete these records using the datasource API. No records are deleted.
Again: we did confirm that records to delete are found. They are just not deleted.
To Reproduce

Successful case using ComplexKeyGenerator

    writeToHudi(records, classOf[ComplexKeyGenerator].getName)
    val written1 = spark.read.format("hudi").load(s"file://${tablePath}")
    assertEquals(written1.collect().length, 6)
    val deleteRecs1 = spark.read.format("hudi")
      .option(HoodieMetadataConfig.ENABLE.key(), "false")
      .load(tablePath)
      .where(col("env_id") === deleteEnvId)
      .where(col("user_id").isInCollection(deleteUserIDs))

    assertEquals(deleteRecs1.collect().length, 3) // confirms matching 3 records have been found to delete
    deleteRecs1.write
      .format("hudi")
      .options(writeOptionsDelete(classOf[ComplexKeyGenerator].getName))
      .mode("append")
      .save(tablePath)

    val snapshot1 = spark.read
      .format("hudi")
      .load(s"file://${tablePath}")

    assertEquals(snapshot1.collect().length, 3).  // confirms 3 records were deleted, and 3 remain, as expected
    assertEquals(
      snapshot1.select(col("user_id")).collect().map(_.getAs[Long](0)).toSet,
      Set(11L, 21L, 22L)
    )

Failing case using UuidKeyGenerator

    writeToHudi(records, classOf[UuidKeyGenerator].getName)
    val written2 = spark.read.format("hudi").load(s"file://${tablePath}")
    assertEquals(written2.collect().length, 6)
    val deleteRecs2 = spark.read.format("hudi")
      .option(HoodieMetadataConfig.ENABLE.key(), "false")
      .load(tablePath)
      .where(col("env_id") === deleteEnvId)
      .where(col("user_id").isInCollection(deleteUserIDs))

    assertEquals(deleteRecs2.collect().length, 3)  // confirms matching 3 records have been found to delete
    deleteRecs2.write
      .format("hudi")
      .options(writeOptionsDelete(classOf[UuidKeyGenerator].getName))
      .mode("append")
      .save(tablePath)

    val snapshot2 = spark.read
      .format("hudi")
      .load(s"file://${tablePath}")

    assertEquals(snapshot2.collect().length, 3) //FAILS! Should be 3, but this finds 6 records. None were marked for deleted.

supporting functions with write options

  def writeToHudi(properties: Seq[UserProperties], keyGeneratorClass: String): Unit = {
    val df = spark.createDataFrame(properties)
    df.write
      .format("hudi")
      .options(writeOptionsSave(keyGeneratorClass))
      .mode("append")
      .save(tablePath)
  }

  def writeOptionsSave(keyGeneratorClass: String) =  Map[String, String](
    "hoodie.table.name" -> "users_changes",
    "hoodie.datasource.write.keygenerator.class" -> keyGeneratorClass,
    "hoodie.datasource.write.recordkey.field" -> "env_id,user_id",
    "hoodie.datasource.write.partitionpath.field" -> "env_id,week",
    "hoodie.datasource.write.precombine.field" -> "schematized_at",
    "hoodie.datasource.write.operation" -> BULK_INSERT_OPERATION_OPT_VAL,
    "hoodie.datasource.write.table.type" -> MOR_TABLE_TYPE_OPT_VAL,
    "hoodie.datasource.write.hive_style_partitioning" -> "true",
    "hoodie.datasource.write.row.writer.enable" -> "false",
    "hoodie.metadata.enable" -> "false",
    "hoodie.bulkinsert.shuffle.parallelism" -> "2",
    "hoodie.datasource.compaction.async.enable" -> "false",
    "hoodie.compact.schedule.inline" -> "false",
    "hoodie.compact.inline" -> "false",
    "hoodie.bulkinsert.sort.mode" -> "NONE",
    "hoodie.combine.before.insert" -> "false",
    "hoodie.clean.automatic" -> "false",
    "hoodie.archive.automatic" -> "false"
  )
  def writeOptionsDelete(keyGeneratorClass: String) =  Map[String, String](
    "hoodie.table.name" -> "users_changes",
    "hoodie.datasource.write.keygenerator.class" -> keyGeneratorClass,
    "hoodie.datasource.write.recordkey.field" -> "env_id,user_id",
    "hoodie.datasource.write.partitionpath.field" -> "env_id,week",
    "hoodie.datasource.write.precombine.field" -> "schematized_at",
    "hoodie.datasource.write.operation" -> DELETE_OPERATION_OPT_VAL,
    "hoodie.datasource.write.table.type" -> MOR_TABLE_TYPE_OPT_VAL,
    "hoodie.datasource.write.hive_style_partitioning" -> "true",
    "hoodie.datasource.write.row.writer.enable" -> "false",
    "hoodie.metadata.enable" -> "false",
    "hoodie.bulkinsert.shuffle.parallelism" -> "2",
    "hoodie.datasource.compaction.async.enable" -> "false",
    "hoodie.compact.schedule.inline"-> "false",
    "hoodie.compact.inline" -> "true",
    "hoodie.compact.inline.max.delta.commits" -> "1",
    "hoodie.clean.automatic" -> "false",
    "hoodie.archive.automatic" -> "false"
  )

Expected behavior
Deletes using the datasource API should work regardless of keyGeneratorClass.
Environment Description

Hudi version : 0.13.0
Spark version : 3.3
Storage (HDFS/S3/GCS..) : local storage (this is an integration test)
Running on Docker? (yes/no) : no

Additional context
I also tried using a JavaRDD<HoodieKey> to delete the data as described here. This too failed but it threw an exception.
    writeToHudi(records, classOf[UuidKeyGenerator].getName)
    val written4 = spark.read.format("hudi").load(s"file://${tablePath}")
    assertEquals(written4
      .collect().length, 6)

    val deleteRecs4: Array[Row] = spark.read.format("hudi")
      .option(HoodieMetadataConfig.ENABLE.key(), "false")
      .load(tablePath)
      .where(col("env_id") === deleteEnvId)
      .where(col("user_id").isInCollection(deleteUserIDs))
      .select("_hoodie_record_key","_hoodie_partition_path", "env_id","user_id", "week")
      .collect()
    val deleteRecsHoodieKeys4 = deleteRecs4.map{row => {
      val recordKey = row.getAs[String](0)
      val partitionPath = row.getAs[String](1)
      new org.apache.hudi.common.model.HoodieKey(recordKey, partitionPath)
    }}

    assertEquals(deleteRecsHoodieKeys4.length, 3) // confirms that 3 records were found to delete

    val uuidKeysRDD: RDD[HoodieKey] = JavaSparkContext.fromSparkContext(spark.sparkContext).parallelize(deleteRecsHoodieKeys4.toList)
    val writeClient = getWriteClient()
    val deleteInstant: String = getDeleteInstant() // this is just a new hudi instant value

    // TODO: this fails with
    // org.apache.hudi.exception.HoodieUpsertException: Failed to delete for commit time<PHONE_NUMBER>0821617... caused by...
    // IllegalArgumentException at org.apache.hudi.common.util.ValidationUtils.checkArgument(ValidationUtils.java:31)
    // because it does not find any requested file for this instant. What should deleteInstant be set to?
    val statuses = writeClient.delete(uuidKeysRDD, deleteInstant)

(it is not clear what the commitTime should be)
Stacktrace

org.apache.hudi.exception.HoodieUpsertException: Failed to delete for commit time<PHONE_NUMBER>0821617

	at org.apache.hudi.table.action.commit.HoodieDeleteHelper.execute(HoodieDeleteHelper.java:117)
	at org.apache.hudi.table.action.deltacommit.SparkDeleteDeltaCommitActionExecutor.execute(SparkDeleteDeltaCommitActionExecutor.java:45)
	at org.apache.hudi.table.HoodieSparkMergeOnReadTable.delete(HoodieSparkMergeOnReadTable.java:105)
	at org.apache.hudi.table.HoodieSparkMergeOnReadTable.delete(HoodieSparkMergeOnReadTable.java:80)
	at org.apache.hudi.client.SparkRDDWriteClient.delete(SparkRDDWriteClient.java:243)
	at com.heap.datalake.delete.DeleteVariationsSuite.$anonfun$new$1(DeleteVariationsSuite.scala:166)
	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
Caused by: java.lang.IllegalArgumentException
	at org.apache.hudi.common.util.ValidationUtils.checkArgument(ValidationUtils.java:31)
	at org.apache.hudi.common.table.timeline.HoodieActiveTimeline.transitionState(HoodieActiveTimeline.java:633)
	at org.apache.hudi.common.table.timeline.HoodieActiveTimeline.transitionRequestedToInflight(HoodieActiveTimeline.java:698)
	at org.apache.hudi.table.action.commit.BaseCommitActionExecutor.saveWorkloadProfileMetadataToInflight(BaseCommitActionExecutor.java:147)
	at org.apache.hudi.table.action.commit.BaseSparkCommitActionExecutor.execute(BaseSparkCommitActionExecutor.java:172)
	at org.apache.hudi.table.action.commit.BaseSparkCommitActionExecutor.execute(BaseSparkCommitActionExecutor.java:83)
	at org.apache.hudi.table.action.commit.HoodieDeleteHelper.execute(HoodieDeleteHelper.java:103)
	... 6 more

this is a known limitation of UUID Key generator. This key gen is generally meant to be used only for immutable data.
with 0.14.0, we are adding pk less(primary key less) table, you can use spark-sql DELETES to delete records. but this is coming in 0.14.0 and we don't have any such support in prior versions.

Please post details how to workaround this problem as we discussed in office hours. I believe it was using the WriteClient, and empty RDD and some hoodie metadata fields?

@bhasudha Can you please guide @ehurheap on that fix we discussed.

@ehurheap Were you able to implement the workaround as suggested by Sudha on slack. Do you need any other help on this?

Yes, the workaround using the writeClient that we discussed in slack worked for me.
Here is a summary:
we build the writeClient:
def buildWriteClient(): SparkRDDWriteClient[_] = {

  val lockProperties = new Properties() // populate lockProperties as appropriate
  val metricsProperties = new Properties() // populate metricsProperties as appropriate

  val writerConfig = HoodieWriteConfig
    .newBuilder()
    .withCompactionConfig(
      HoodieCompactionConfig
        .newBuilder()
        .withInlineCompaction(true)
        .withScheduleInlineCompaction(false)
        .withMaxNumDeltaCommitsBeforeCompaction(1)
        .build()
    )
    .withArchivalConfig(HoodieArchivalConfig.newBuilder().withAutoArchive(false).build())
    .withCleanConfig(HoodieCleanConfig.newBuilder().withAutoClean(false).build())
    .withMetadataConfig(HoodieMetadataConfig.newBuilder().enable(false).build())
    .withLockConfig(HoodieLockConfig.newBuilder().fromProperties(lockProperties).build())
    .withMetricsConfig(HoodieMetricsConfig.newBuilder().fromProperties(metricsProperties).build())
    .withDeleteParallelism(config.deleteParallelism)
    .withPath(config.tablePath)
    .forTable(datalakeRecord.tableName)
    .build()
  val engineContext: HoodieEngineContext = new HoodieSparkEngineContext(
    JavaSparkContext.fromSparkContext(sparkContext)
  )
  new SparkRDDWriteClient(engineContext, writerConfig)
}

Then run delete and compaction for the specified keys:
    var deleteInstant: String = ""
    try {
      deleteInstant = writeClient.startCommit()
      writeClient.delete(keysToDelete, deleteInstant)
      // :TRICKY: explicitly calling compaction here: although the write client was configured to auto compact in-line, compaction is not in fact triggered by this delete operation.
      val maybeCompactionInstant =
        writeClient.scheduleCompaction(org.apache.hudi.common.util.Option.empty())
      if (maybeCompactionInstant.isPresent) writeClient.compact(maybeCompactionInstant.get)
      else
        log.warn(
          s"Unable to schedule compaction after delete operation at instant ${deleteInstant}"
        )
    } catch {
      case t: Throwable =>
        logErrorAndExit(s"Delete operation failed for instant ${deleteInstant} due to ", t)
    } finally {
      log.info(s"Finished delete operation for instant ${deleteInstant}")
      writeClient.close()
    }

Thanks @ehurheap . Closing this issue. Let us know in case of any concerns.


Add get_model_status to get a model status on InferenceAPI

Related to https://github.com/huggingface/huggingface_hub/issues/1557 but can be implemented separately.
InferenceClient could have an extra method get_model_status to get the status of a deployed model. This only makes sense for InferenceAPI at least for now. We could think about a status for InferenceEndpoint as well but that will probably be implemented separately (see https://github.com/huggingface/huggingface_hub/issues/1541). API endpoint for a given model is https://api-inference.huggingface.co/status/{model_id}.
This /status endpoint gives 2 main information:

is the model loadable?
is the model loaded?

# Not loaded model
>>> curl https://api-inference.huggingface.co/status/google/flan-t5-xxl
{"loaded":false,"state":"Loadable","compute_type":"gpu","framework":"text-generation-inference"}

# Not loadable model
>>> curl https://api-inference.huggingface.co/status/bigscience/bloomz
{"loaded":false,"state":"TooBig","compute_type":"cpu","framework":"transformers"}

# Loaded model
>>> curl https://api-inference.huggingface.co/status/bigcode/starcoder
{"loaded":true,"state":"Loaded","compute_type":"gpu","framework":"text-generation-inference"}

# Missing model
>>> curl https://api-inference.huggingface.co/status/unknown/model
{"error":"Model unknown/model does not exist"}

Here is how I see the method signature (can be discussed if needed). Would be good to define a dataclass for the returned value.
class InferenceClient:
    ...

    def get_model_status(self, model: Optional[str] = None, *, token: Optional[str] = None) -> ModelStatus:
        model = model or self.model
        if model is None:
             raise ValueError("Model id not provided")
        if model.startswith("https://"):
            raise ValueError("...")  # only works for InferenceAPI, not any URL

        return ...

Hello it's a nice issue and I think I solve it following your initial function blueprint. Also I added a  @dataclass.
Here is the dataclass:
@dataclass
class ModelStatus:
    loaded: bool
    state: str
    compute_type: str
    framework: str

And then after your if statement I think you could include something like this:
huggingface_interface_response = request.get(f"https://api-inference.huggingface.co/status/{model}")
huggingface_interface_response.raise_for_status()

Finally you can insert couple lines of code one just to check if you have an error in your responsed data. Something like this:
response_data = huggingface_interface_response.json()
if "error" in data:
    raise ValueError(response_data["error"])
elif response_data["loaded"] == False:
    raise ValueError(response_data["state"])

And then you can just return the data through your dataclass you have already created. Something like this:
return ModelStatus(
            loaded=data['loaded'],
            state=data['state'],
            compute_type=data['compute_type'],
            framework=data['framework'],
        )

FYI you need to import some modules.
from dataclasses import dataclass
import requests

I think this is what you need for this issue :smile:
Let me know if it helped you.

Thanks for your comment @sifisKoen! Yes I definitely think this is the way to go. The only think I would do differently is to not raise an issue if model is not loaded. If response_data["loaded"] == False it is still a valid information to get for the user.
Would you like to open a PR to put everything together? :hugs:

Thank you for your reply.
Ok I got it. So you think something like:
1st Case
if response_data["loaded"] == False then we raise a ValueError
if response_data["loaded"] == False:
    raise ValueError(response_data["state"])

2nd Case
if response_data["loaded"] == False then we just return the state of the model
if response_data["loaded"] == False:
    return response_data["state"]

3rd Case
if response_data["loaded"] == False then we do nothing and we just make return. Witch I think is the less optimized way.
if response_data["loaded"] == False:
    # Do nothing and just do return?
    return

I am just asking so to provide you with the most suitable code for the project.
Yep I will do it. :smiley:
You have a very nice project here btw. :clap:

Ok so my idea would be to return the dataclass, no matter the value of loaded. Something like that:
    response_data = huggingface_interface_response.json()
    if "error" in data:
        raise ValueError(response_data["error"])
    return ModelStatus(
            loaded=data['loaded'],
            state=data['state'],
            compute_type=data['compute_type'],
            framework=data['framework'],
    )

By doing so, we let the user decide what's best to do with the information.
Thanks for your help and enthousiasm! :hugs: :heart:

Ohhhh, cool got you. I will open a new PR with the new function, and a doc string with function description.
No problem I will check other issues if I can help to them too. :handshake:

Any update on the progress for this issue? Knowing the status of deployed models is specially important as I couldn't find a way to list all the models that are deployed and available through the API.

@sjjpo2002 Implementation has started in this PR: https://github.com/huggingface/huggingface_hub/pull/1559
cc @sifisKoen about the development itself (implementation is mostly done, just some tests remaining)

@sjjpo2002 Implementation has started in this PR: #1559 cc @sifisKoen about the development itself (implementation is mostly done, just some tests remaining)

Hello, these days I am out of office. I am at my vacations. I will be back in 5 days, so I will finish the tests then. @Wauplin

Great, thanks @sifisKoen. Enjoy your vacation time! :tada: :smile:

@Wauplin hey mate. I just finished the tests I will upload them now. Sorry for my delay tho. :disappointed:

Thank you @Wauplin loved work with you :smile:


Add RazorSourceDocument.Create(string template)

Add document and fix casing of RazorSourceDocument.FileName
Fixes #1063

Being assigned reviewer totally didn't put this in my participating portion of notifications -_-


Feedback on RISC-V Trace Control Interface Specification - Chapter 9

trPibDivider - "After PIB reset value of this pin.."
reword to "value of this field". The word "safe" should
be explained.
trPibCalibrate - explain what happens to the trace data
when this bit is 1. Does the Sink backpressure the source
or drops the packets?
Section 9.1 - LSB bytes is redundant. The first bullet
should be reworded to separately state transmission order
for bits and bytes.
Section 9.1 - "In 16-bit mode" - does that refer to
trPibMode=12? "16-bit mode" is not defined before and if so
should replace with the trPibMode value.
Section 9.1 - its more accurate to state "even bytes are
transmitted on TRC_DATA[7:0] and odd bytes on TRC_DATA[15:8]
as many messages have more then 2 bytes.
Section 9.1 - reword first and second sub-bullet of third
bullet.
Section 9.2 - LSB is sometimes used to reference least
significant byte and sometimes least significant bit. Should
use consistent terminology. Explain "next bit period"
Table 53 - Patters -> Patterns

All notes to Control PDF handled in 1.0.0_rc20.


bump governor from 0.5.1 to 0.6.0

governor has breaking changes in this upgrade: https://github.com/apache/incubator-opendal/pull/3691

has breaking changes

Is there a brief for the breaking changes?

Is there a brief for the breaking changes?

Here is a compare between the version: https://github.com/boinkor-net/governor/compare/v0.5.1...v0.6.0
I didn't go deep into the governor's change.


Please confirm these before moving forward

[X] I have searched for my issue and not found a work-in-progress/duplicate/resolved issue.
[X] I have not been informed if the issue is resolved in a preview version of the winget client.

Category of the issue
Other
Brief description of your issue
winget reads version of the installed package incorrectly and suggests to upgrade it.
Steps to reproduce
From the PowerShell command line
> winget install Perforce.P4V
...
> winget upgrade
Name                 Id                       Version  Available    Source
--------------------------------------------------------------------------
Helix Core Apps      Perforce.P4V             242.42.4<PHONE_NUMBER> winget

Actual behavior
winget is asking to upgrade freshly installed package because of incorrect read of its version
Expected behavior
winget should not list Perforce.PV4 as one with update available
Environment
Windows Package Manager v1.8.1911
Windows: Windows.Desktop v10.0.22631.4169
System Architecture: X64
Package: Microsoft.DesktopAppInstaller v1.23.1911.0

Screenshots and Logs

WinGet.log
> winget list | Select-String -SimpleMatch "Microsoft.VCRedist.2015+.x64","Perforce","----","Name  "
Name                                   Id                                     Version               Available    Source
-----------------------------------------------------------------------------------------------------------------------
Helix Core Apps                        Perforce.P4V                           242.42.4<PHONE_NUMBER> winget
Microsoft Visual C++ 2015-2022 RedistΓÇª Microsoft.VCRedist.2015+.x64           14.40.33810.0                      winget

> winget upgrade
Name                 Id                       Version  Available    Source
--------------------------------------------------------------------------
Helix Core Apps      Perforce.P4V             242.42.4<PHONE_NUMBER> winget
Cisco Webex Meetings Cisco.CiscoWebexMeetings 43.10.0  <IP_ADDRESS>   winget
2 upgrades available.

> winget upgrade Perforce.P4V
Found Helix Core Apps [Perforce.P4V] Version<PHONE_NUMBER>
This application is licensed to you by its owner.
Microsoft is not responsible for, nor does it grant any licenses to, third-party packages.
This package requires the following dependencies:
  - Packages
      Microsoft.VCRedist.2015+.x64
Downloading https://www.perforce.com/downloads/perforce/r24.2/bin.ntx64/p4vinst64.msi
  ██████████████████████████████   159 MB /  159 MB
Successfully verified installer hash
Starting package install...
Successfully installed

> winget upgrade
Name                 Id                       Version  Available    Source
--------------------------------------------------------------------------
Helix Core Apps      Perforce.P4V             242.42.4<PHONE_NUMBER> winget
Cisco Webex Meetings Cisco.CiscoWebexMeetings 43.10.0  <IP_ADDRESS>   winget
2 upgrades available.

Close with reason: Resolved;

Resolved by #198538


Timed modpack update releases [Suggestion]

It would be really awesome if you could schedule the release of a certain modpack version to a set date. This means you could make a new version ready for releases, set an automatic release date and after the set time is met the status of version x.x.x.x will change from "private" to "public".
This would be really great for larger servers that have a high load over the day. It would give you the possibility to plan an update for 06:00 in the morning (for example) and synchronize the release of the modpack update with an automatic server update (via bash script / cronjob / GitHub archive etc.) to let your users play disturbance free.
Could be realized via MySQL events http://dev.mysql.com/doc/refman/5.6/en/events.html

hmm, this is an interesting idea

I like this idea


Error Upgrading from Master

I normally upgrade Zulip every month with this:
# apt-get update; apt-get -y upgade; apt-get -y dist-upgrade; apt-get -y autoremove

# cd /home/zulip/deployments/current/scripts

# ./upgrade-zulip-from-git master

Today I tried and I received these errors:
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-x36tapo9/sockjs-tornado/

Error running a subcommand of /home/zulip/deployments/2018-11-10-09-26-58/scripts/lib/create-production-venv: pip install --no-deps --requirement /home/zulip/deployments/2018-11-10-09-26-58/requirements/prod.txt
Actual error output for the subcommand is just above this.

Traceback (most recent call last):
  File "/home/zulip/deployments/2018-11-10-09-26-58/scripts/lib/setup_venv.py", line 288, in do_setup_virtualenv
    install_venv_deps(requirements_file)
  File "/home/zulip/deployments/2018-11-10-09-26-58/scripts/lib/setup_venv.py", line 61, in install_venv_deps
    run(["pip", "install", "--no-deps", "--requirement", requirements_file])
  File "/home/zulip/deployments/2018-11-10-09-26-58/scripts/lib/zulip_tools.py", line 164, in run
    subprocess.check_call(args, **kwargs)
  File "/usr/lib/python3.5/subprocess.py", line 581, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['pip', 'install', '--no-deps', '--requirement', '/home/zulip/deployments/2018-11-10-09-26-58/requirements/prod.txt']' returned non-zero exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/zulip/deployments/2018-11-10-09-26-58/scripts/lib/create-production-venv", line 31, in <module>
    virtualenv_args=['-p', 'python{}'.format(python_version)])
  File "/home/zulip/deployments/2018-11-10-09-26-58/scripts/lib/setup_venv.py", line 243, in setup_virtualenv
    do_setup_virtualenv(cached_venv_path, requirements_file, virtualenv_args or [])
  File "/home/zulip/deployments/2018-11-10-09-26-58/scripts/lib/setup_venv.py", line 292, in do_setup_virtualenv
    install_venv_deps(requirements_file)
  File "/home/zulip/deployments/2018-11-10-09-26-58/scripts/lib/setup_venv.py", line 61, in install_venv_deps
    run(["pip", "install", "--no-deps", "--requirement", requirements_file])
  File "/home/zulip/deployments/2018-11-10-09-26-58/scripts/lib/zulip_tools.py", line 164, in run
    subprocess.check_call(args, **kwargs)
  File "/usr/lib/python3.5/subprocess.py", line 581, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['pip', 'install', '--no-deps', '--requirement', '/home/zulip/deployments/2018-11-10-09-26-58/requirements/prod.txt']' returned non-zero exit status 1
Traceback (most recent call last):
  File "/home/zulip/deployments/2018-11-10-09-26-58/scripts/lib/upgrade-zulip-stage-2", line 66, in <module>
    deploy_path])
  File "/usr/lib/python3.5/subprocess.py", line 581, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/home/zulip/deployments/2018-11-10-09-26-58/scripts/lib/create-production-venv', '/home/zulip/deployments/2018-11-10-09-26-58']' returned non-zero exit status 1
Traceback (most recent call last):
  File "./upgrade-zulip-from-git", line 73, in <module>
    deploy_path, "--from-git"] + deploy_options)
  File "/usr/lib/python3.5/subprocess.py", line 581, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/home/zulip/deployments/2018-11-10-09-26-58/scripts/lib/upgrade-zulip-stage-2', '/home/zulip/deployments/2018-11-10-09-26-58', '--from-git']' returned non-zero exit status 1

@stone212 can you post the actual root-cause error?  The top of the traceback you posted says "Actual error output for the subcommand is just above this.", and what we need is the output above that point :).

@timabbott
That was very silly of me not to notice.  But I can't post what you need because when I re-ran the upgrade it worked.  I did do another update/upgrade/dist-upgrade on the server so either that changed or something about the latest git commit changed are my two guesses.
I will try to be more observant if I have to post again.

OK.  Given that it worked on retry, it was almost certainly a transient network error when downloading Python dependencies (since that's what pip install ... does).  So probably there's no code change we can make to fix it (though one could imagine doing further tweaks to our network-error retry strategy to make this less common).  Thanks for the follow-up!


I have a problem with embedding

I have a github page, and I was planning to add NESbox. It's a fork of this project. But I can't figure out how to embed it.
Here's the repo: https://github.com/Alobex/nesbox
And here is the site: http://alobex.github.io/nesbox/

And if I try a smc fie with weebly, then it says click t pay the game, and whenever I hover over it, I get the fullscreen button, and the save buttons
Here is my weebly:http://awegame1.weebly.com/nesbox.html

@Alobex hi, as I see you have problems with relative paths to the .swf files
On the page http://alobex.github.io/nesbox/ I caught the error "http://alobex.github.io/nesbox/flash/Nesbox.swf Failed to load resource: the server responded with a status of 404 (Not Found)". Please enter correct path here "swfobject.embedSWF('flash/Nesbox.swf', 'emulator', '640', '480', '11.2.0', 'flash/expressInstall.swf', flashvars, params, attributes);"

Wait, I thought I did that, check out my index.html at my repo

Actually the correct path for me was flash/flash/Nesbox.swf and flash/flash/expressInstall.swf

now your flashvars parameter is empty
it has to be like this
var flashvars =
{
system : 'sega',
url : '/roms/Flappy Bird (PD) v1.0.gen'
};

How can I do that? Weebly is block based

I also have another question, how can I get my favicon to work?


Distance and Direction - Ellipse tool does not create correct Full ellipse when typing in coordinates

Widget
Version of widget
Final 1172 (20 Jan 2017)
Bug or Enhancement
Repo Steps or Enhancement details
A correct ellipse is created when Ellipse type is set to Semi and you type in the following Center Point and Axis' values:
Center Point: 0 0
Major 3000
Minor 1500
Units: Kilometers
Using the measure tool, the width of the ellipse is 6000 kilometers and height 3000 kilometers.
The tool labels the ellipse with the semi major axis and semi minor axis values.

Now set the Ellipse type to Full and enter the same parameters; an incorrect ellipse is created.
Center Point: 0 0
Major 3000
Minor 1500
Units: Kilometers
Using the measure tool, the width of the ellipse is 6000 kilometers and height 3000 kilometers. It creates the same exact ellipse as when you set the type to semi (ignore the current labeling. Its not setting the values in the labels to match the ellipse that was created). The tool should have created an ellipse that's 3000 kilometers wide and 1500 kilometers high.

NOTE: this was added to the known issues doc for the 1.0 release of Military Tools.

@elinz
When I asked @kgonzago what was the difference between a semi ellipse and a full ellipse the answer was just that the label of the major axis was either the diameter for a full or radius for a semi, no change in the actual size of the ellipse being created, so the tool is correct for how it was designed to work.

@adgiles That's only when you interactively create an ellipse (fyi: labeling for major and minor should change; current tool only changes the major label). When you type in the center point and axis values and the user selects full, the values entered are the length of the major and minor axis (i.e. total width and height of the ellipse). In the case described above, the ellipse should be half the distance in both the major and minor axis'. This is how the Pro and ArcMap addins work.

@adgiles We will have to get together and discuss this full vs semi ellipse stuff so that the widget and addins are all working the same way. There has been a lot of confusion about this. I entered this issue after talking with @mfunk to make sure I understood how ellipses should be created.

revisiting these issues as I was testing the wab widgets disconnected, and I think @elinz is right, there is a difference between creating the ellipse dynamically with the map point tool, and manually entering parameters. The ellipse treats the manually entered full major and minor axis as semi, and an ellipse twice the size of the parameters entered will be created as a result. The major full axis label will also be twice the parameter entered. However, the minor full axis will maintain the correct label.

Issue should be addressed please can somebody verify
@NatalieCampos @dfoll @topowright @ACueva

I got this one.

Ran tool using examples listed above.  Working properly now.
Semi now gives accurate results.

DOCUMENTATION CHANGES
Removed the following line :
When creating full ellipses by typing in Center Point and Axis values,  invalid ellipses are created; the Axis values are doubled and the labels are invalid. https://github.com/Esri/solutions-webappbuilder-widgets/issues/816
from:
/General/ArcGIS Solutions/ArcGIS for Defense/Distance and Direction/Web


[Whisper] fine-tune Whisper with int-8 (scripts + example notebook)

Hi @pacman100,
Happy to follow your lead on this. Just creating this issue so that we can track progress here.
I think ideally it'd be cool to have a script here and potentially a copy of this script in transformers/examples, since that is the one location with most eyeballs.
WDYT?

Tracking Progress https://github.com/huggingface/peft/pull/90#pullrequestreview-1298964811


Create OrthoMosaic-creation extractor for CyVerse

Port the current OM extractor to CyVerse & put in a docker container

@julianpistorius I think this can be closed


Text style updates 3

Update color scheme to match hubbleds
Apply @heywooddogwood's fix for Free Response Class Summary issue where the breadcrumbs toggler scrolls out of view
Update tables and free response styling to have a more unified look
Adjust layout for Multiple Choice tab in single student view
Show rounded integer # of tries in table of students for a given question. If they didn't answer question, display blank instead of NaN
Update Data Layouts onto cards in rows and columns
Start updating some of the plotly styling, but will add more after merging in #35.

Wow, this looks amazing!!
If you'd like, you could probably just merge PR #35 into yours. I removed some uneccesary changes which should make it merge without any conflicts.
In trying to make things a bit more small-screen friendly, there are a couple changes I would suggest. You can get an idea of them on #37.


schema.headers warning in python:3.8-slim

Running the 3.8 slim docker container produces warnings when doing pip install:
FROM python:3.8-slim
RUN python -m pip install --disable-pip-version-check --quiet tox

Output:
WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/9617>
distutils: /usr/local/include/python3.8/UNKNOWN
sysconfig: /usr/local/include/python3.8
WARNING: Additional context:
user = False
home = None
root = None
prefix = None

how can the image be fixed?
from issue https://github.com/pypa/pip/issues/9617

Our Python installation process amounts to "download Python sources, ./configure && make && make install, install PIP directly from get-pip.py", so https://github.com/pypa/pip/issues/9617#issuecomment-826108606 confuses me a lot (if a pretty stock ./configure gives us a "misconfigured" Python by default, we're all in a heap of trouble, I'd think?).
That being said, I think from both the OP there and specifically https://github.com/pypa/pip/issues/9617#issuecomment-826152560, it's pretty clear this warning is currently very harmless and should simply be ignored until there's a new release out that might silence it (likely 21.1.1).  It looks like https://github.com/pypa/pip/pull/9838 probably handles the specific case we have (I'm not going to say "fix" here because frankly, nothing is actually broken, as made very clear repeatedly over in https://github.com/pypa/pip/issues/9617).

Thanks for the comments! I really was posting here because he had locked the discussion on the main thread :) My gitlab-ci was crashing on the warning.

Your CI crashed on the warning?? :grimacing:
Are you specifically grepping the logs for warnings and erroring out, or did this somehow cause a failure?

We caught this too. A lot of teams prefer to run software without warnings, such as to head off security surprises, so false alarms in official repos is surprising.

Your CI crashed on the warning?? 😬
Are you specifically grepping the logs for warnings and erroring out, or did this somehow cause a failure?

😁 just looked closer, there were other issues in there as well.. the ci normally passed so I jumped on this one first. Thanks for correcting 😄

Given https://github.com/pypa/pip/issues/9617#issuecomment-830053765, today's pip bump should've resolved this. :+1:


[GitProxy] Support branches containing shell metacharacters

Closes #5295

What if the branch name contains a single quote? Why are we quoting user input instead of using ShellWords.escape here?

@indirect isn't that only 1.9+?

@segiddins doesn't seem like it? http://www.rubydoc.info/stdlib/shellwords/1.8.7/Shellwords

@segiddins looks fine to me:
$ chruby 1.8.7
$ irb
irb(main):001:0> require 'shellwords'
=> true
irb(main):003:0> Shellwords.shellescape "foo'bar"
=> "foo\\'bar"

@indirect r?

@bundlerbot r+


[NUTCH-3017] Allow fast-urlfilter to load from HDFS/S3

and support gzipped input
See https://issues.apache.org/jira/browse/NUTCH-3017

Thanks, @jnioche!
Merged into master, adding the lines to make use of Hadoop-provided compression codecs.
Successfully tested in local and pseudo-distributed mode with various codecs (gzip / .gz, bzip2, ZStandard / .zst).
One final note: if the fast-urlfilter is not found, the Nutch job (local mode) or the tasks (distributed mode) fail with an exception. I didn't change this behavior.


9 ci remove dependancy on moose

fux #11

Pull Request Test Coverage Report for Build 835874280

187 of 187 (100.0%)  changed or added relevant lines in 5 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 83.799%

Totals

Change from base Build 834620961:
0.0%

Covered Lines:
750

Relevant Lines:
895

💛  - Coveralls


Data Wrangling: Twitter, DaNews, DAGW

@KennethEnevoldsen Anything in particular you would like me to take a look at? :-)

Create a validator for the dataset format


This project references NuGet package(s) that are missing on this computer

I clone a project from azure git and I can't run its
I get many errors "are you missing a using .. or an assembly reference"
and this error with the NuGet.
I did all that you say in the troubleshooting to restore the NuGet packages
but still, my project doesn't build successfully.

@alexvy86 please file an issue on the Home repo for all product-related bugs - https://github.com/nuget/home/issues

@karann-msft I assume you meant that message for @ayalwe ?

Is this issue fixed?, because I'm still getting a similar issue.


Add variable shadowing rule.

This is a rebase of #790 to compile with head. Fixes #247

Continuation of #2133 here (accidentally deleted the old branch)


Build failed ...

After a failed attempt to run WhereHows with docker Im trying a real machine running Ubuntu LTS.
While compiling Im getting the build failed with the following tests:
Failed tests
* JobsUtilTest. testGetEnabledJobs
* JobsUtilTest. testGetEnabledJobsByType
* JobsUtilTest. testGetScheduledJobs
Any ideas?
Joao

Having the exact same issue. Haven't tried the docker yet, went straight to an Ubuntu EC2 instance, but I'm having those same failing unit tests pop up. Did anyone ever get back to you on this?

Dear issue owner,
Thanks for your interest in WhereHows. We have recently announced DataHub which is the rebranding of WhereHows. LinkedIn improved the architecture of WhereHows and rebranded WhereHows into DataHub and replaced its metadata infrastructure in this direction. DataHub is a more advanced and improved metadata management product compared to WhereHows.
Unfortunately, we have to stop supporting WhereHows to better focus on DataHub and offer more help to DataHub users. Therefore, we will drop all issues related to WhereHows and will not accept any contribution for it. Active development for DataHub has already started on datahub branch and will continue to live in there until it's finally merged to master and project is renamed to DataHub.
Please check the datahub branch to get familar with DataHub.
Best,
DataHub team


Kotlin resource added

Fixes Issue
#280
Changes proposed

I have added kotlin resource from freecodecamp.
Screenshots

Note to reviewers

@siddhant-khisty I have added kotlin resource in the right section. Can u please check my pr.


python310Packages.twilio: 7.16.1 -> 7.16.2

Diff: https://github.com/twilio/twilio-python/compare/refs/tags/7.16.1...7.16.2
Changelog: https://github.com/twilio/twilio-python/blob/7.16.2/CHANGES.md
Description of changes

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[ ] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 212732 run on x86_64-linux 1

3 packages built:

home-assistant-component-tests.twilio
python310Packages.twilio
python311Packages.twilio


proposal: crypto/tls: new option for mTLS servers to not advertise acceptable certificate_authorities

Problem
In the context of an mTLS server, the name of the CAs it accepts may represent an information leak. Especially, if the CA is use-case specific and contains information about the customer. Example from Google space: https://buganizer.corp.google.com/issues/187209748
Currently, the tls/crypto package does not provide a way to not populate certificate_authorities, even though it is not mandatory part of the handshake.
Solution
This could be addressed by adding a new boolean field (something like DontAdvertiseClientCAs bool) in tls.Config to disable this behavior optionally.
Servers that prefer not advertising the CA names could opt-out by flipping this new setting.

cc @golang/security

Problem
A Golang mTLS server includes a list of Distinguished Names of acceptable CAs in the TLS handshake. In some threat models, the name of the CAs the server accepts may represent an information leak. Especially, if the CA is use-case specific and contains information about the customer; like this example from the Google space: https://buganizer.corp.google.com/issues/187209748
Currently, the tls/crypto package does not provide a way to not populate certificate_authorities, even though it is not mandatory part of the handshake.
Solution
This could be addressed by adding a new boolean field (something like DontAdvertiseClientCAs bool) in tls.Config to disable this behavior optionally. Servers that prefer not advertising the CA names could opt-out by flipping this new setting.


NET-638: Allow clients to provide the telnet subnegotiation limit

See: https://issues.apache.org/jira/browse/NET-638

To verify that the provided size is actually respected? I suppose so; I figured there wasn't much changed here so existing tests of subnegotiation should cover it, but I can look into how the TelnetClientTest tests are structured and come up with something.

@garydgregory Added a unit test. Please let me know if you had something else in mind.


Offset background color support

Is there any way to make the gray background of the 3 datasets transparent?

You can hide the tracks instead of giving a transparent background

Example: https://codepen.io/apexcharts/pen/YjJOgB

Thank you @junedchhipa, that worked fine!


10.0.19045.5247 Not Supported

This build is not yet supported
I attached a dll file but changed the extension to zip so your application would accept it.

No RDPConf screenshot => not accepted.


Make max number of digits in "Transaction fee" same as in Desktop wallet.

Currently, it's possible to enter max number of digits -8
In Desktop wallet max number of digits -15 in "Transaction fee" field.

checked


python312Packages.typer-shell: 0.1.11 -> 0.1.12

Diff: https://github.com/FergusFettes/typer-shell/compare/refs/tags/v0.1.11...v0.1.12

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Result of nixpkgs-review pr 349405 run on x86_64-linux 1

4 packages built:

python311Packages.typer-shell
python311Packages.typer-shell.dist
python312Packages.typer-shell
python312Packages.typer-shell.dist


[question] The natvis warnings for unknown types spam the output window. Is there a possibility to suppress these?

The natvis warnings for unknown types sometimes spam the output window. Is there a possibility to suppress these?
Example:
Natvis C++/WinRT: Unrecognized type: winrt::impl::producer<winrt::TestApp::implementation::MyValue,winrt::TestApp::IMyValue,void>

I don't know - @Scottj1s? This might be more of a feature request for Visual Studio.

I suggest you try the VS feedback site https://developercommunity.visualstudio.com/search?space=62 or https://stackoverflow.com/ - sorry I don't have any experience with this.


Codeforces API

Hi!
Nice script! :) Do you still develop it? Do you plan to use Codeforces API instead of parsing in the future?

Hello!
I have been a bit busy for last few months, but the project is not dead. I'll continue development one day. ;) Neither submission nor samles fetching are supported by the API, so it is completely useless for us. Parsing html in lisp is evil, I will be happy to use API when better times come.

@gnull thanks for the response! :) Very well then. Let's wait for the better times. I close this issue for now.


Expose methods to change viewport alignment

As discussed in #1912, consumers need to be able to calculate new viewport offsets when swapping between alignments.
This exposes two new with_<direction>_alignment methods. If user wants to keep the scrollable's viewport anchored in the same position while swapping alignments, they can call viewport.with_alignment(new_alignment) and return the new viewport's relative_offset to scroll_to.

Eventually, we should probably expose a variant of the Scrollable widget that lets the user completely manage the offset.

Eventually, we should probably expose a variant of the Scrollable widget that lets the user completely manage the offset.

At what point should we prefer widget operations over managed app state?
The same can probably be said for text input widget.
As for composing widgets, a parent widget can still do widget operations within on_event right? It's not just the application that can do these.

At what point should we prefer widget operations over managed app state?

When commands are regularly needed to keep a widget in sync with some application state, then that's a sign there are multiple sources of truth.
With managed app state you can derive any scrolling state from your application state without necessarily storing offsets at all.

The same can probably be said for text input widget.

As for composing widgets, a parent widget can still do widget operations within on_event right? It's not just the application that can do these.

Yes, although I'm not sure that'd be very useful. You'd want the unmanaged widget to depend on the managed one, and the managed one won't expose operations ideally.

Agreed! The need for managed state satisfies both use cases.
The text input seems like a good test case for this since it really can go either way.
Would you prefer two separate widgets, or one widget that exposes a managed builder for taking state provided by the application and internally it can switch between that or tree state?

Two separate widgets; one built on top of the other.