Competing repo?

What is the difference between this repo and https://github.com/z-shell/fast-syntax-highlighting?

Not much besides the "ownership", I obviously cannot vouch for the z-shell though and wouldn't advise using any of the z-shell repos but that's just my opinion ;)

Seems like there are a few recent commits on it. I personally use the repo I own

@pschmitt @alichtman thanks. I am aware that zdharma-continuum is an attempt at keeping the zdharma projects alive in a more "community-oriented" fashion.
But what is this z-shell user/group? It appears to be new, and they don't seem to have any equivalent of https://github.com/zdharma-continuum/I_WANT_TO_HELP. Is it a former member of the zdharma-continuum group? Someone opposed to how the zdharma situation was handled?
It might be useful if you explained why you recommend avoiding them, other than "they aren't us".

We're not recommending not using their fork. It's just a fork that we don't manage or monitor. Feel free to use it if you'd like.

Looks like there is an update on this. The https://github.com/zdharma/fast-syntax-highlighting repo just got created again and now points as a fork to above mentioned https://github.com/z-shell/fast-syntax-highlighting. So it looks like it may have been wise to not recommend the z-shell group, if it is really owned by @psprint .
I have created an issue at https://github.com/z-shell/fast-syntax-highlighting/issues/8 to get an official reply from whoever z-shell is on this, but if it really is the real zdharma I don't see how we can trust him on not deleting the repo again.
If zdharma will be doing real progress in the repo over there, we can still manually handpick and port over his patches to this repo after all.

Hi
Just to clarify the authorship issue – I'm not the owner of the new zdharma group.
Thank you for continuing zdharma at @zdharma-continuum. I can say that you have my blessing.

I'm glad you're alive and well :) If you'd ever like to contribute to the project again, you're more than welcome.


Sticky sidebar overwrites menu dropdown

Adding css for sticky sidebar (class="sticky-top") causes dropdown menu to be covered by sidebar content.

Fixed by https://github.com/PASTAplus/web-x/commit/7f6dfe8497c213cc70bc54e5a44d3b2a0a693fab


Center tokens.

Also deprecated minInputWidth.
When adding logic to center icons, I also modified the logic for positioning the inputTextField. Now, the text it contains is treated like a token. So, the inputTextField goes wherever the token positioning logic puts this placeholder token (whose titleText is the current text in the inputTextField). Because the token locations are now refreshed every time the user inputs a character, the tokenField will now create newlines while the user types as necessary, eliminating the need for a minInputWidth.
More frequent updating of the token locations is critical for centering to maintain the "centered" feel as illustrated by the gif below.

Fix #66.

deleteBackward seems to be broken in iOS < 8.3 (a known bug). Looking into solutions.

Found a solution that works from here but seems risky in terms of getting rejected for private API usage... @ayanonagon ideas?


Copy member fails with "Extension must be provided when creating a member."

Describe the bug
Copy member fails with "Extension must be provided when creating a member."
We have an IASP, so I don't know what effect that has on the action.
No Code for IBM i log entry is made so the action never makes it to the IBM server.
To Reproduce
Steps to reproduce the behavior:

In a filter that you can add members to, expand and find any member.
Right-click and select the action "Copy Member"
Fill out the popup dialog line to make the member unique to the source file copying to.
Press Enter.
See the error notification appear.

Expected behavior
New member is created.
Environment (please complete the following information):

Extension version 1.2.6
IBM i OS version 7.3

@m-tyler Need some more info from you:

What format is the new path you're copying to?
Please share a screenshot of the error
Any output in the Code for IBM i output channel?

Prompt open from selection

My string before Enter

Error after Enter

@m-tyler Try it without the ASP and the leading / and see if that works.

Removed WIASP/.

Error in log.

Cool. I will look into it!


fix: Make getTopScoringIntent return '' instead of undefined

Fixes Composer#8368. fixes #minor.
Description
There is a minor drift between the dotnet and nodeJs implementation of getTopScoringIntent.

In the NodeJS implementation, topIntent is declared but not initialized. In the case of empty intents bag, can return undefined.
NodeJS Implementation
     let topIntent: string;

In the dotnet implementation, the topIntent is initialized.
Dotnet Implementation
      var topIntent = (string.Empty, 0.0d);

This later causes an issue in crossTrainedRecognizerSet line 110, where an undefined intent can be set.
The isRedirect function  will eventually be called on the undefined intent and cause the 500 error in the bot.

Note: this entire chain of events is started at the end of a text input, when the recognizers are fired with an empty utterance (not sure why). Orchestrator recognizer will return a RecognizerResult with this shape in the case of empty utterance:
        let recognizerResult: RecognizerResult = {
            text,
            intents: {},
            entities: {},
        };

Both LUIS and QnA fill the intents bag.
The dotnet Orchestrator implementation also returns an empty intents dictionary in the case of an empty utterance so we follow that behavior.
Testing
UT added, manual testing to test for correct behavior.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

2 of 2 (100.0%)  changed or added relevant lines in 2 files are covered.
1 unchanged line in 1 file lost coverage.
Overall coverage increased (+0.2%) to 84.345%

Files with Coverage Reduction
New Missed Lines
%

libraries/botbuilder-lg/src/templateExtensions.ts
1
84.48%

Totals

Change from base Build<PHONE_NUMBER>:
0.2%

Covered Lines:
19685

Relevant Lines:
22143

💛  - Coveralls


Clarification on the "selection of the meta data broker"?

https://github.com/International-Data-Spaces-Association/IDS-RAM_4_0/blob/5febe55e98cf293d1ea9ada69a4392f80bda48c5/documentation/3_Layers_of_the_Reference_Architecture_Model/3_4_Process_Layer/3_4_2_Data_Offering.md#ids-metadata-broker
"The selection of the appropriate IDS Metadata Broker is in the responsibility of each data space Participant."
More information on how the participant could find the appropriate meta data broker is needed.

Following up with @JessicaRombs 's email, @ssteinbuss would you recommend closing the issue for now? or there's an existing mechanism documented somewhere about the possibility of selecting the right broker (or catalog)?


Blog: Mapping Locations on Dashboard 2.0

Description
Write a blog post detailing how to obtain location data (latitude, longitude) and plot it on a map within Dashboard 2.0.

What needs the additional work for multiple items?
Each code can be setup to render at a different path, and therefore, the iframe can be adjusted accordingly

@joepavitt I think it's still valuable to blog about how to track say busses in a city on that worldmap. So multiple items (busses) need to be plotted on the map, and updated later. Or any other item that works well for a blog.

Yes, sorry, thought you meant functionally, we were missing something on the Dashboard side.
All of that would be a general purpose "how to use worldmap" tutorial, but displayed in  a Dashboard 2.0 UI

Why can't we plot multiple items on the map?

We can @sumitshinde-84 - just use the worldmap node

We can @sumitshinde-84 - just use the worldmap node


Update dRPC's Sei RPC Endpoint

Added link on dRPC's Sei RPC Endpoint

Next time please use a descriptive PR title


line-height customization fix

Tweaked CSS  .terminal .xterm-rows to align with bottom instead of top. Now a margin can be set in .hyper.js such as:
termCSS: '.terminal .xterm-rows > div {margin: 3px 0}',
Previously that would mess up the terminal prompt. Yay for better line-height! Should fix https://github.com/zeit/hyper/issues/75 for now

Notice this isn't a complete fix, the prompt isn't positioned correctly on startup.

in fact, with no additional changes to the code (ignore this pull request) this seems to be working for me:
termCSS: '.xterm {line-height: 17px} .xterm-rows > div {display: block; line-height: 15px}'

@Cygnusfear do you have a link to the issue this is fixing?

xterm.js allows configuration of the line-height via CSS, I believe calling term.refresh(0, term.rows - 1) afterwards will do the refresh and fix everything.
Note that this is becoming an option in v3 https://github.com/sourcelair/xterm.js/blob/66688c19a6fb336fb68fb085b98e121caf9df018/src/Terminal.ts#L82

With all respect, @Tyriar what does line-height coming to xterm v3 have to do with hyper?

@JesseLeite it's my understanding that Hyper will be upgrading to v3 when it's out in the next couple of weeks.


SSR'd diffing taking ~2x the time of non-SSR'd boot.

I've just pushed a blog post, and I've noticed that in 7.1.0 I'm seeing SSR'd content boot take upto 2x as long as Client-Side: https://aerotwist.com/blog/when-everything-is-important-nothing-is/
Looking at a timeline it seems it's mostly in the diffing.

Very strange that it's stripping nodes for sure. I can see how that would take 2x longer. There's some combination of components in the hierarchy that is being considered a mismatch when doing the initial render. I'm diving into your repo to take a look!

Discovered the source! Since the HTML you're treating as the server render contains whitespace, Preact is diffing against that instead of the firstChild of <section class="post">. It's discarding the entire tree.

Interesting findings. Since JSX treats whitespace differently than HTML is there anything you can do about this? Maybe ignore whitespace if it seems to be unimportant?

Trying to look into the edge cases. It'd be something like "ignore whitespace nodes adjacent to element boundaries" (so leading/trailing whitespace, and whitespace-only Text node siblings of Elements).

What would be the most efficient way of helping to eliminate this in the short term? Would stripping white space on the SSR'd content do it? (i.e. with something like htmlmin

Yes. Using minified HTML entirely solves the issue.

Thanks @developit I didn't notice that preact-render-to-string already did that.

Indeed! There's an option to turn on pretty whitespace (really just used because it can output JSX, which gets used in preact-jsx-chai).

Does it make sense to supporting diffing against HTML rendered by something other than Preact?

To me it sortof comes down to whether it can reasonably be supported without adding much overhead.  I've been wrestling with that issue and I do have a fairly elegant solution that meets the need and only seems to add 30-40 bytes of overhead (not 0, but not a ton).
Another option we have at our disposal is modularity.  For example, to fix the whitespace issue Paul's demo showed, you could run this standalone function against the DOM prior to invoking Preact:
// process(document.body);
function process(node) {
  if (node.nodeType==3 && !node.nodeValue.trim()) node.remove();
  for (var i=(node.childNodes || '').length; i--; ) process(node.childNodes[i]);
}

This is essentially the whitespace fix I've applied, but as a standalone module.

I'm not a Preact user, so take this as a low value comment, but I think it's the correct thing to do. I don't think using Preact should require that you use Node.js and use Preact for server templating. Requiring that HTML be identical, including TextNodes, imo restricts Preact's usefulness.

I'm not saying that it should require the HTML to be generated by Preact, but I do think it's reasonable that the responsibility should be on the user to make sure they're maintaining consistency with what Preact expects.
Deferring to an optional package that the user should include does exactly that, so I'm 👍 with that!

Bah I'm so undecided on this. It's such a small amount of code to support the use-case. I'm going to keep running benchmarks and if I find something horrible about it at least that's a line in the sand. Right now I can't decided.

For what it's worth, I'm of the same opinion as @aweary. I think it's fine if preact just clearly documents what is necessary to get isomorphic behavior working properly, but then leaves it up to the developer to make sure they do this correctly.

Plus there's a module now that handles it for you, just have to invoke it on document.body.

FWIW, Inferno gets around this by removing all whitespace during the compilation step via its babel-plugin-jsx.

That happens in the default JSX plugin. Issue we ran I to here was whitespace in the server rendered HTML DOM. JSX rendered by preact-render-to-string never has extra whitespace, but this HTML wasn't re served by preact-render-to-string. Funky case but the fix was simple enough.

The last bit of this is going into 8.0, which involves having Preact's diff ignore whitespace-only nodes why doing SSR hydration.

Fixed in 8!


Downloaded the current youtube-dl, and now it fails on everything...

rpn - mov : 1$ youtube-dl https://www.youtube.com/watch?v=igRbL9HpqFw
[youtube] igRbL9HpqFw: Downloading webpage
[youtube] igRbL9HpqFw: Downloading video info webpage
[youtube] igRbL9HpqFw: Extracting video information
[youtube] igRbL9HpqFw: Downloading MPD manifest
Traceback (most recent call last):
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py", line 162, in _run_module_as_main
"main", fname, loader, pkg_name)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/usr/local/bin/youtube-dl/main.py", line 19, in
File "/usr/local/bin/youtube-dl/youtube_dl/init.py", line 411, in main
File "/usr/local/bin/youtube-dl/youtube_dl/init.py", line 401, in _real_main
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1692, in download
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 677, in extract_info
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 722, in process_ie_result
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1345, in process_video_result
File "/usr/local/bin/youtube-dl/youtube_dl/postprocessor/ffmpeg.py", line 35, in init
File "/usr/local/bin/youtube-dl/youtube_dl/postprocessor/ffmpeg.py", line 92, in _determine_executables
File "/usr/local/bin/youtube-dl/youtube_dl/postprocessor/ffmpeg.py", line 92, in
File "/usr/local/bin/youtube-dl/youtube_dl/utils.py", line 1547, in get_exe_version
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 710, in init
errread, errwrite)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 1334, in _execute_child
child_exception = pickle.loads(data)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/pickle.py", line 1382, in loads
return Unpickler(file).load()
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/pickle.py", line 858, in load
dispatchkey
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/pickle.py", line 966, in load_string
raise ValueError, "insecure string pickle"
ValueError: insecure string pickle
rpn - mov : 1$ youtube-dl --version
2016.03.01
rpn - mov : 0$

Duplicate of #6840.


RBF manager: not able to drive a control from two solvers.

I have a rightleg en leftleg RBFsolver driving a few jacket controls. But when I want to control the middle control from the other driver it doesn't create the right hierarchy. It could be naming convention related but I  am not sure at the moment.

This is a limitation of the current design. The best way to solve this is to add 2 controls one on top of the other. So you can use one for the left input and other for the right input.
other option is to plug all the input values in a dummy object with custom attributes. for example all the translation from left + all translation  from right.  later use this dummy object as driver.


cache: variant computation produces too few variants

Something like:
cache:
  requirements:
    host:
      - python

...

With a variants file of
python: ['3.9', '3.10']

should create 2 x N-outputs variants.

This was user error! :)


Lint issue.go

Superceeds #215 improving it

Current coverage is 3.03% (diff: 0.00%)

Merging #234 into master will not change coverage

@@            master      #234   diff @@
========================================
  Files           33        33
  Lines         8107      8107
  Methods          0         0
  Messages         0         0
  Branches         0         0
========================================
  Hits           246       246
  Misses        7841      7841
  Partials        20        20

Powered by Codecov. Last update 6ed7f26...8aa960f

LGTM

LGTM

resolved #70


bug: Error on render when including options in markdown.lua file

Neovim version (nvim -v)
0.10.0
Operating system
MacOS
Terminal emulator / GUI
Wezterm
Describe the bug
I updated to the latest version of your markdown.nvim in lazyvim and when I input the plugin like the lazy.nvim instructions, everything works fine. But the moment I add any the setups to change anything, it fails and hands me a rendering error.

Expected behavior
Looking for the plugin to render the correct display once I exit out of insert mode
Healthcheck output (:checkhealth render-markdown)

render-markdown: require("render-markdown.health").check()
markdown.nvim [nvim-treesitter] ~

OK installed
OK markdown: parser installed
OK markdown_inline: parser installed
WARNING latex: parser not installed

ADVICE:

If you do not want LaTeX support avoid this warning by setting { latex_enabled = false }

OK highlights enabled

markdown.nvim [executables] ~

WARNING latex2text: not installed

ADVICE:

If you do not want LaTeX support avoid this warning by setting { latex_enabled = false }

markdown.nvim [configuration] ~

ERROR dash: expected string, got table
ERROR checkbox.checked: expected string, got table
ERROR callout.caution: expected string, got table

Additional information
No response

I saw the breaking changes and fixed the issue. My apologies

No worries, totally understandable!
Did you have any problems getting things working again? Just wanted to double check if the fixes made sense and worked or if I missed anything.

No worries, totally understandable!
Did you have any problems getting things working again? Just wanted to double check if the fixes made sense and worked or if I missed anything.

Yes, the fixes made sense. Once I noticed and made the necessary changes then everything turned out fine. Seems that I was a bit impatient is all lol. Thank you for the follow up and for what you do with this plugin. It is amazing. I will continue to support however I can.

Thank you for the kind words :)
Glad you are liking the plugin!


Take --sources and --output into account when generating deployer.

This is a follow-up on a previous issue I opened regarding deployer generation in projects with a non-standard file structure.
My current issue is that despite being able to set the build directory for the deployer using the --output flag, the files generated have the wrong path set for importing contracts.
This is because the call to generate_deployer does not take the relative output path into account when populating the handlebars template with generated_folder_path as it is here
It would be very helpful if the output could overwrite the cli.root in that case, since while the root is still correct for locating contracts with --sources, the relative paths are incorrect.
In my case, this:
import './contracts/src/Counter.sol' as _Counter;
import { Counter } from './contracts/src/Counter.sol';

Should really be:
import '../contracts/src/Counter.sol' as _Counter;
import { Counter } from '../contracts/src/Counter.sol';

Thank you!

Thanks @BarakChamo for the report, I ll investigate later


[SPARK-48948][SQL] Introduce SHOW VARIABLES LIKE ...  SQL syntax to  get variables

What changes were proposed in this pull request?
The pr aims to introduce SHOW VARIABLES LIKE ... SQL syntax to get variables.
Why are the changes needed?

currently, regarding VARIABLE, we support the following syntax:

DECLARE (OR REPLACE)? VARIABLE ...
DROP TEMPORARY VARIABLE (IF EXISTS)? ...
SET (VARIABLE | VAR) ...

But we are unable to obtain the current status of VARIABLE

other databases have similar syntax, eg:
snowflake: https://docs.snowflake.com/en/sql-reference/sql/show-variables

Mysql: https://dev.mysql.com/doc/refman/8.4/en/show-variables.html
oracle: https://docs.oracle.com/cd/E17952_01/mysql-5.7-en/show-variables.html
teradata: https://docs.teradata.com/r/Enterprise_IntelliFlex_VMware/Database-Utilities/Control-GDO-Editor-ctl/Ctl-Commands/PRINT-variable

so I propose introducing syntax SHOW VARIABLES LIKE ... that can retrieve all variables in the spark system.

Does this PR introduce any user-facing change?
No.
How was this patch tested?
Add new UT.
Was this patch authored or co-authored using generative AI tooling?
No.

cc @srielau @cloud-fan

let's move away from SHOW commands. I think UDTF is a better choice.

let's move away from SHOW commands. I think UDTF is a better choice.

I'm very sorry, I missed this message.
I will reopen this PR and continue to complete it.
Thank you very much!


[Help] Saving Attachments

Hi,
Not sure how people have done this basically I want my script to use each attachment and save them and send them to s3 how have people managed to save their attachments and save them in this way?
Any examples would be appreciated, thank you.
$outlook->connect();
$folder = $outlook->getFolder('Inbox');
foreach($folder->getMessages() as $message){
	$subject = $message->subject;
	$attachments = $message->getAttachments();
	dd($attachments);
	foreach($attachments as $attachment){
		$file = header('Content-type: '.$attachment->content_type.'');
		$file .= header('Content-disposition: attachment; filename='.$attachment->name.'');
		print $attachment->content;
		// send it to s3 Storage::disk('s3')->put
	}
	$message->moveToFolder('Success');
}

@narwy I'm working on this too, found some article on how to use it with imap_fetchstructure() function, but haven't really implement this with laravel-imap.
Check this out

Hi @narwy @kevinp1005 ,
I save attachments using the followoing:
/** @var $oClient \Webklex\IMAP\Client */
$oClient = \Client::connect();
$aMailboxes = $oClient->getFolders();

/** @var \Webklex\IMAP\Folder $oMailbox */
foreach($aMailboxes as $oMailbox){

   /** @var \Webklex\IMAP\Message $oMessage */
   foreach($oMailbox->getMessages() as $oMessage) {

       $oMessage->getAttachments()->each(function ($oAttachment) use ($oMessage) {
           file_put_contents(storage_path('attachments/' . $oMessage->getMessageId() . '/' . $oAttachment->name), $oAttachment->content);
       });
   }
}

..if this doesn't work please provide some addiotional information so we can find a solution :)

Hi @Webklex,
Thanks for that snippet. I will look at it a bit more this weekend :) 👍

@narwy @kevinp1005 I added it to the usage documentation :)
Best regards


show how to make your software citable

A good option is using Zenodo with GitHub:
https://guides.github.com/activities/citable-code/
but maybe this fits better in the reproducibility lesson?

I think here it can be a link or a mention but I agree that we can discuss more in detail in the reproducibility lesson.

It's good if we plug it in somewhere in passing to remind participants and to re-connect to other lessons.

this is covered now in the reproducibility lesson (b5c05c5fa379f3001c5c9669509551ca768aff02)
resolving


ctx.Arg(0) is always nil

It's supposed to return the first arg but it actually returns nil every time
Example:
//kick @Silver#0543 offline forever
ctx.Args: [<nil> 0xc0001583e0 0xc000158400 0xc000158440]
ctx.Arg(2): &{offline true}

What's your usage string, also be sure to run spgen everytime you modify any of those comments.

wrong usage string whops


Jack server is not running or cannot be started

IMPORTANT: Before you create an issue, please take a look at our Issue Reporting Guide.
Briefly summarize your issue:

What is the expected behavior?

What behavior are you observing?

Provide the steps to reproduce the issue, if applicable:

Tell us about your environment:

What version of the AVS Device SDK are you using?
  <x.y.z>

Tell us what hardware you're using:

[ ] Desktop / Laptop
[x] Raspberry Pi
[ ] Other - tell us more:

Tell us about your OS (Type & version):

[ ] Linux
[ ] MacOS
[ ] Raspbian Stretch
[ ] Raspbian Jessy
[ ] Other - tell us more:

Hi @shreyas-rc , this issue does not contain any information. I am going to close it. Please open a new issue and fill out our  Issue Reporting Guide if you want guidance.


deprecated plugins in Jekyll 3.0.0

The RSS and sitemap generator plugins are deprecated in Jekyll 3.0.0
The RSS plugin is especially important for our site. I will not merge the 3.0.0 branch until the following two plugins' functionality is re-implemented.
plugins

rss generator
sitemap generator

here is the change log for 3.0.0
I need your guys' help more than ever

relevant

the default feed is now atom instead of rss. To prevent a disrupt in service /rss.xml points to an atom feed


Weird behavior for MediaCount.single

Hi again,
When using this configuration:
MediaPicker(
                mediaList: const [],
                onPicked: (e) => viewModel.selectMedia(e, context),
                onCancel: () {},
                mediaCount: MediaCount.single,
                mediaType: MediaType.all,
                decoration: PickerDecoration(
                  cancelIcon: const SizedBox.shrink(),
                  completeText: 'Select',
                  completeTextStyle: const TextStyle(
                    color: AppColors.textColorLight,
                  ),
                  completeButtonStyle: ElevatedButton.styleFrom(
                    backgroundColor: AppColors.accent,
                  ),
                ),
              ),

when the user clicks on one item it is  selected, but if the user clicks in other item, instead of change the selection to the new item, both Items are selected but only one gets picked

In this image I have the card picture selected, and when I click other picture it gets marked but not selected

Ah yes! Sorry for missing out the documentation code.
Let me find out the issue in single image picker, also album selector is overlaying your button

hey @reliance-engineer ,
It has been solved in v1.0.2.
Thank you for letting me know


Does not work

Operating System
Windows 10/11
Environment
P2P Host (You are hosting a game locally and your friends are joining you)
Game Version
Stable
SML Version
v3.9.0
Mod Version
v2.0.1
Describe the bug
Does not work, displays the same error as without the mod when 5th player is trying to join (007).
Tried creating a new game / changing the settings to different amount of players, nothing worked.
Btw why is the source code empty?
Expected Behavior
5th player connects without problems
Attachments
No response

Hi, thanks for reporting this issue! I am not able to look into it right away, but I will get to it as soon as I can. Also, the source code isn't empty, all of the functionality is in the \Content folder.

Oh, didn't realize that :D
I have no idea how the mod is supposed to work, but if this could anyhow help you, we managed to play with the 5th player just by changing / adding following lines in config %localappdata%/FactoryGame/Saved/Config/Windows/Game.ini:
[/Script/Engine.GameSession]
MaxPlayers=5

Some of us had a separate folder WindowsNoEditor with own Game.ini, some had just the Windows folder.
Only people with just the Windows folder could host it for more players. When others tried editing the Game.ini (in either or both folders), it still didn't work for some reason.


I coud not use standalone mode in pytorch

I installed DL-Framework Windows Pytorch and git clone examples of pytorch.
(1)Enviroment
・   Windows10 64bit pro
・  CUDA10.0
・  Python3.7(Windows)
・Conpiler (Microsoft Visual studio 2015 SP3)
・ I installed Pytorch as below
pip3 install https://download.pytorch.org/whl/cu100/torch-1.0.1-cp37-cp37m-win_amd64.whl
pip3 install torchvision
・I installed nutka as bwlow
pip install
・I checked nuitka version as blow
python -m nuitka --version
python -m nuitka --version
0.6.2
・System Reply
Python: 3.7.3 (v3.7.3:ef4ec6ed12, Mar 25 2019, 22:22:05) [MSC v.1916 64 bit (AMD64)]
Executable: C:\Users\e10853\AppData\Local\Programs\Python\Python37\python.exe
OS: Windows
Arch: x86_64
(1)Python Example Pytorch mnist main.py
At first ,I tested python example by pyhton.

Nuitka:WARNING:Not recursing to 'torch.nn' (C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\torch\nn), please specify --nofollow-imports (do not warn), --follow-imports (recurse to all), --nofollow-import-to=torch.nn (ignore it), --follow-import-to=torch.nn (recurse to it) to change.
Nuitka:WARNING:Not recursing to 'torch.nn.functional' (C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\torch\nn\functional.py), please specify --nofollow-imports (do not warn), --follow-imports (recurse to all), --nofollow-import-to=torch.nn.functional (ignore it), --follow-import-to=torch.nn.functional (recurse to it) to change.
Nuitka:WARNING:Not recursing to 'torch.optim' (C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\torch\optim), please specify --nofollow-imports (do not warn), --follow-imports (recurse to all), --nofollow-import-to=torch.optim (ignore it), --follow-import-to=torch.optim (recurse to it) to change.

Nuitka:WARNING:Unresolved 'import' call at 'C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\numpy\core\function_base.py:453' may require use of '--include-plugin-directory' or '--include-plugin-files'.
Nuitka:WARNING:Unresolved 'import' call at 'C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\numpy\lib\utils.py:366' may require use of '--include-plugin-directory' or '--include-plugin-files'.
Nuitka:WARNING:Unresolved 'import' call at 'C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\numpy\lib\utils.py:865' may require use of '--include-plugin-directory' or '--include-plugin-files'.
Nuitka:WARNING:Unresolved 'import' call at 'C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\numpy\lib\utils.py:923' may require use of '--include-plugin-directory' or '--include-plugin-files'.
Nuitka:WARNING:Unresolved 'import' call at 'C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\torch_utils.py:156' may require use of '--include-plugin-directory' or '--include-plugin-files'.
・I cinfirmed some files and 2 directoried.
2019/04/08  14:19              main.build
2019/04/08  14:20              main.dist
2019/04/08  13:03           399,360 main.exe
2019/03/01  09:11             5,036 main.py
2019/04/08  13:02         3,748,368 python37.dll
・I checked  main.dist
There were a lot of Dlls and some directories.

・I'd really appreciate it if you give me any advice for this error.
I did any mistakes?

Let me check this out.
Can you please provide me with a minimal script that uses pytorch?
My first suspicion would be that the package does "hidden imports", i.e. imports not detectable by Python source scanning.
If this turns out true, we will need to provide this information to Nuitka ...

One thing I have seen installing pytorch already is, that it depends on numpy. So - on your Windows system - including the numpy plugin is probably required (but maybe not sufficient).

Thank you for your reply.
(1)Pytorch Script
You can copy it form https://github.com/pytorch/examples/blob/master/mnist/main.py
#mnist ｍain.py
from future import print_function
import argparse
import torch
import torch.nn as nn
import torch.nn.functional as F
import torch.optim as optim
from torchvision import datasets, transforms
class Net(nn.Module):
def init(self):
super(Net, self).init()
self.conv1 = nn.Conv2d(1, 20, 5, 1)
self.conv2 = nn.Conv2d(20, 50, 5, 1)
self.fc1 = nn.Linear(4450, 500)
self.fc2 = nn.Linear(500, 10)
def forward(self, x):
    x = F.relu(self.conv1(x))
    x = F.max_pool2d(x, 2, 2)
    x = F.relu(self.conv2(x))
    x = F.max_pool2d(x, 2, 2)
    x = x.view(-1, 4*4*50)
    x = F.relu(self.fc1(x))
    x = self.fc2(x)
    return F.log_softmax(x, dim=1)

def train(args, model, device, train_loader, optimizer, epoch):
model.train()
for batch_idx, (data, target) in enumerate(train_loader):
data, target = data.to(device), target.to(device)
optimizer.zero_grad()
output = model(data)
loss = F.nll_loss(output, target)
loss.backward()
optimizer.step()
if batch_idx % args.log_interval == 0:
print('Train Epoch: {} [{}/{} ({:.0f}%)]\tLoss: {:.6f}'.format(
epoch, batch_idx * len(data), len(train_loader.dataset),
100. * batch_idx / len(train_loader), loss.item()))
def test(args, model, device, test_loader):
model.eval()
test_loss = 0
correct = 0
with torch.no_grad():
for data, target in test_loader:
data, target = data.to(device), target.to(device)
output = model(data)
test_loss += F.nll_loss(output, target, reduction='sum').item() # sum up batch loss
pred = output.argmax(dim=1, keepdim=True) # get the index of the max log-probability
correct += pred.eq(target.view_as(pred)).sum().item()
test_loss /= len(test_loader.dataset)

print('\nTest set: Average loss: {:.4f}, Accuracy: {}/{} ({:.0f}%)\n'.format(
    test_loss, correct, len(test_loader.dataset),
    100. * correct / len(test_loader.dataset)))

def main():
# Training settings
parser = argparse.ArgumentParser(description='PyTorch MNIST Example')
parser.add_argument('--batch-size', type=int, default=64, metavar='N',
help='input batch size for training (default: 64)')
parser.add_argument('--test-batch-size', type=int, default=1000, metavar='N',
help='input batch size for testing (default: 1000)')
parser.add_argument('--epochs', type=int, default=10, metavar='N',
help='number of epochs to train (default: 10)')
parser.add_argument('--lr', type=float, default=0.01, metavar='LR',
help='learning rate (default: 0.01)')
parser.add_argument('--momentum', type=float, default=0.5, metavar='M',
help='SGD momentum (default: 0.5)')
parser.add_argument('--no-cuda', action='store_true', default=False,
help='disables CUDA training')
parser.add_argument('--seed', type=int, default=1, metavar='S',
help='random seed (default: 1)')
parser.add_argument('--log-interval', type=int, default=10, metavar='N',
help='how many batches to wait before logging training status')
parser.add_argument('--save-model', action='store_true', default=False,
                    help='For Saving the current Model')
args = parser.parse_args()
use_cuda = not args.no_cuda and torch.cuda.is_available()

torch.manual_seed(args.seed)

device = torch.device("cuda" if use_cuda else "cpu")

kwargs = {'num_workers': 1, 'pin_memory': True} if use_cuda else {}
train_loader = torch.utils.data.DataLoader(
    datasets.MNIST('../data', train=True, download=True,
                   transform=transforms.Compose([
                       transforms.ToTensor(),
                       transforms.Normalize((0.1307,), (0.3081,))
                   ])),
    batch_size=args.batch_size, shuffle=True, **kwargs)
test_loader = torch.utils.data.DataLoader(
    datasets.MNIST('../data', train=False, transform=transforms.Compose([
                       transforms.ToTensor(),
                       transforms.Normalize((0.1307,), (0.3081,))
                   ])),
    batch_size=args.test_batch_size, shuffle=True, **kwargs)

model = Net().to(device)
optimizer = optim.SGD(model.parameters(), lr=args.lr, momentum=args.momentum)

for epoch in range(1, args.epochs + 1):
    train(args, model, device, train_loader, optimizer, epoch)
    test(args, model, device, test_loader)

if (args.save_model):
    torch.save(model.state_dict(),"mnist_cnn.pt")

if name == 'main':
main()
(2) Pytorch install
Aftes install pytorch to my Windows, I installed your "nuikta".
Do you mention that I have to install "numpy" additionaly?
Best Regards,

Actually you should not be able to run pytorch without numpy being installed! When reading the pytorch website they mention that this is a prerequisite ...
I did a first experiment with the script following further down.
This is the result under Windows - differences under a different operating system are to be expected.

Numpy plugin must be used
Pytorch loads DLLs "under the hood" - meaning not detectable by source code analyzers like Nuitka
As amazing as this may be: my script also needed 2 C header files to run correctly!
Assuming the test script is named torch1.py, then making a lib sub-folder like so: ...\torch1.dist\torch\lib containing the following files let me successfully run the script:

c10.dll
c10_cuda.dll
caffe2.dll
caffe2_detectron_ops_gpu.dll
caffe2_gpu.dll
caffe2_module_test_dynamic.dll
caffe2_observers.dll
cublas64_100.dll
cudart64_100.dll
cudnn64_7.dll
cufft64_100.dll
cufftw64_100.dll
curand64_100.dll
cusparse64_100.dll
dll.txt
libiomp5md.dll
libiompstubs5md.dll
nvcuda.dll
nvfatbinaryLoader.dll
nvrtc-builtins64_100.dll
nvrtc64_100_0.dll
nvToolsExt64_1.dll
onnxifi.dll
onnxifi_dummy.dll
shm.dll
THCUNN.h
THNN.h
torch.dll
torch_python.dll

These are all DLL files from the torch\lib folder in Python site-packages.
This is the script torch1.py I used:
# -*- coding: utf-8 -*-

import torch

dtype = torch.float
device = torch.device("cpu")
device = torch.device("cuda:0")  # Uncomment this to run on GPU

# N is batch size; D_in is input dimension;
# H is hidden dimension; D_out is output dimension.
N, D_in, H, D_out = 64, 1000, 100, 10

# Create random input and output data
x = torch.randn(N, D_in, device=device, dtype=dtype)
y = torch.randn(N, D_out, device=device, dtype=dtype)

# Randomly initialize weights
w1 = torch.randn(D_in, H, device=device, dtype=dtype)
w2 = torch.randn(H, D_out, device=device, dtype=dtype)

learning_rate = 1e-6
for t in range(500):
    # Forward pass: compute predicted y
    h = x.mm(w1)
    h_relu = h.clamp(min=0)
    y_pred = h_relu.mm(w2)

    # Compute and print loss
    loss = (y_pred - y).pow(2).sum().item()
    print(t, loss)

    # Backprop to compute gradients of w1 and w2 with respect to loss
    grad_y_pred = 2.0 * (y_pred - y)
    grad_w2 = h_relu.t().mm(grad_y_pred)
    grad_h_relu = grad_y_pred.mm(w2.t())
    grad_h = grad_h_relu.clone()
    grad_h[h < 0] = 0
    grad_w1 = x.t().mm(grad_h)

    # Update weights using gradient descent
    w1 -= learning_rate * grad_w1
    w2 -= learning_rate * grad_w2

I did an import analysis of this script - and it does indeed import numpy. So again a confirmation that numpy is needed.
Can you try and recreate the above situation on your computer? Your compile script should look something like
python -m nuitka --standalone .... --enable-plugin=numpy main.py
Then manually create and fill main.dist\torch\lib with the files as described.

Thank your for your help.
Tomorrow I will try main.exe in same environment that you tested main.exe.
Thank you again!

BTW you should always invoke the nuitka compiler like so python -m nuitka ... - see the website for an explanation.

Another comment:
The pytorch DLLs are a lot of data: 1.11 GB (!!!).
So I have my doubts, whether the distribution of a standalone compile will ever make a lot of sense, but anyway ...

Dear JoriMcKie
Thank you for your reply ! But I did not get good result yet.
I have some questions.
(1)What is numpy-plugin?
・ I already installed numpy.
I checked as below.
C:\nuitka0403\Standalone>pip install --upgrade numpy
Requirement already up-to-date: numpy in c:\users\e10853\appdata\local\programs\python\python37\lib\site-packages (1.16.2)
・I tested nuitka by your python code  ”torch1.py".
2019/04/09  10:32              .
2019/04/09  10:32              ..
2019/04/09  09:40             1,254 torch1.py
・I used nuitaka with option -- --enable-plugin=numpy
But I got the error-message as below.
C:\nuitka0409>python -m nuitka --standalone --enable-plugin=numpy torch1.py
Error, unknown plug-in 'numpy' referenced.
・So I changed nuitak-option as blow.
C:\nuitka0409>python -m nuitka --standalone --include-plugin-directory=C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\numpy torch1.py
・I got no error.
C:\nuitka0409>python -m nuitka --standalone --include-plugin-directory=C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\numpy torch1.py
C:\nuitka0409>
・I checked Directory;torch1.build and torch1.dist were made.
2019/04/09  11:08              torch1.build
2019/04/09  11:09              torch1.dist
2019/04/09  09:40             1,254 torch1.py
・I checked torch1.dist

・I checke torch directory ;New 2 pyd files were made
2019/04/09  10:56            10,240 _C.pyd
2019/04/09  10:56            10,240 _nvrtc.pyd
・I  did "mkdir lib " and copy  a lot of Dlls fromC:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\torch\lib
・\torch1.dist\torch\lib contents were as blow

・After copy Dlls, I did torch1.exe in torch1.dist
C:\nuitka0409\torch1.dist>torch1.exe
Traceback (most recent call last):
File "C:\nuitka0409\torch1.dist\torch1.py", line 3, in
File "", line 983, in _find_and_load
File "", line 967, in _find_and_load_unlocked
File "", line 668, in _load_unlocked
File "", line 638, in load_backward_compatible
File "C:\nuitka0409\torch1.dist\torch_init.py", line 102, in
File "", line 983, in _find_and_load
File "", line 967, in _find_and_load_unlocked
File "", line 668, in _load_unlocked
File "", line 638, in _load_backward_compatible
AttributeError: _ARRAY_API not found
・The result is same as my "torch main.py yesterday" also.
I cheched to installed numpy ,made /torch/lib , copied a lot of Dlls and same result as below.
・I'd really appreciate it if you give me any advice to solve this issue.
But I worry about that I used --include-plugin-directory=C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\numpy ,
but you told me to use --enable-plugin=numpy.
Did I do mistake to install numpy ?

Dear JoriMcKie
・I tell you new information.
・I found exe-maker2.py in github.
C:\nuitka0403>python exe-maker2.py
Now executing Nuitka as follows. Please be patient and let it finish!
python -m nuitka --standalone --python-flag=nosite --remove-output --output-dir="C:\nuitka0403\Standalone\out" --recurse-not-to=PIL.ImageQt --recurse-not-to=PyQt5 --recurse-not-to=PyQt4 --recurse-not-to=PySide --recurse-not-to=PIL.ImageTk --recurse-not-to=tkinter --plugin-enable=numpy-plugin --experimental=use_pefile "C:\nuitka0403\Standalone\torch1.py"
Nuitka:WARNING:Unresolved 'import' call at 'C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\numpy\core\function_base.py:453' may require use of '--include-plugin-directory' or '--include-plugin-files'.
Nuitka:WARNING:Unresolved 'import' call at 'C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\numpy\lib\utils.py:366' may require use of '--include-plugin-directory' or '--include-plugin-files'.
Nuitka:WARNING:Unresolved 'import' call at 'C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\numpy\lib\utils.py:865' may require use of '--include-plugin-directory' or '--include-plugin-files'.
Nuitka:WARNING:Unresolved 'import' call at 'C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\numpy\lib\utils.py:923' may require use of '--include-plugin-directory' or '--include-plugin-files'.
Nuitka:WARNING:Unresolved 'import' call at 'C:\nuitka0403\Standalone\torch_utils.py:156' may require use of '--include-plugin-directory' or '--include-plugin-files'.
Nuitka:INFO: Now copying extra binaries from 'numpy' installation:
Nuitka:INFO: c:\users\e10853\appdata\local\programs\python\python37\lib\site-packages\numpy.libs\libopenblas.ipbc74c7kurv7cb2pkt5z5fnr3sibv4j.gfortran-win_amd64.dll
Nuitka:INFO: Copied 1 binary.
Scanning the 'dist' folder for removable items.
Removed the following files or folders:
C:\nuitka0403\Standalone\out\torch1.dist\tcl86t.dll (Tk file)
C:\nuitka0403\Standalone\out\torch1.dist\tk86t.dll (Tk file)
C:\nuitka0403\Standalone\out\torch1.dist_tkinter.pyd (Tk file)
Nuitka compile successful (550 sec) ...
・I used this tool and test your torch1.py.
・I could make torch1.exe and it operated correctly.
C:\nuitka0403\Standalone\out\torch1.dist>torch1.exe
0 32916528.0
1 25613108.0
2 20623204.0
3 15841126.0
4 11371295.0
5 7702422.5
6 5096000.5
7 3392954.0
8 2334030.0
9 1677430.375
10 1261932.25
11<PHONE_NUMBER>
12 799247.25
13<PHONE_NUMBER>
14<PHONE_NUMBER>
15<PHONE_NUMBER>5
16 411456.5
17<PHONE_NUMBER>
18 312997.375
19 275326.5
20<PHONE_NUMBER>5
21<PHONE_NUMBER>75
22 192034.625
23<PHONE_NUMBER>5
24<PHONE_NUMBER>75
25<PHONE_NUMBER>
26<PHONE_NUMBER>25
27<PHONE_NUMBER>25
28<PHONE_NUMBER>5
29 91559.2890625
30 83065.59375
31 75486.609375
32 68715.640625
33 62653.8359375
34 57218.4140625
35 52322.0625
36 47903.40625
37 43909.5703125
38 40293.2578125
39 37015.1875
40 34042.84765625
41 31344.783203125
42 28889.90234375
43 26651.44921875
I
I
I
I
486 0.00016222865087911487
487 0.0001594257482793182
488 0.00015655209426768124
489 0.0001535465708002448
490 0.00015107370563782752
491 0.0001481018407503143
492 0.00014578484115190804
493 0.00014338604523800313
494 0.000140447256853804
495 0.0001379921450279653
496 0.00013538113853428513
497 0.00013299239799380302
498 0.00013105370453558862
499 0.000128860556287691
C:\nuitka0403\Standalone\out\torch1.dist>
・So,I used exe-maker2.py and I copied a lot of Dlls to main.dist/torch/lib.
・I used exe-maker2.py
・I had to write --plugin-enable as  --plugin-enable=numpy-plugin .
C:\nuitka0403>python exe-maker2.py
Now executing Nuitka as follows. Please be patient and let it finish!
python -m nuitka --standalone --python-flag=nosite --output-dir="C:\nuitka0403\Standalone\out" --recurse-not-to=PIL.ImageQt --recurse-not-to=PyQt5 --recurse-not-to=PyQt4 --recurse-not-to=PySide --recurse-not-to=PIL.ImageTk --recurse-not-to=tkinter --plugin-enable=numpy-plugin --experimental=use_pefile "C:\nuitka0403\Standalone\main.py"
Nuitka:WARNING:Unresolved 'import' call at 'C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\PIL\Image.py:428' may require use of '--include-plugin-directory' or '--include-plugin-files'.
Nuitka:WARNING:Unresolved 'import' call at 'C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\numpy\core\function_base.py:453' may require use of '--include-plugin-directory' or '--include-plugin-files'.
Nuitka:WARNING:Unresolved 'import' call at 'C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\numpy\lib\utils.py:366' may require use of '--include-plugin-directory' or '--include-plugin-files'.
Nuitka:WARNING:Unresolved 'import' call at 'C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\numpy\lib\utils.py:865' may require use of '--include-plugin-directory' or '--include-plugin-files'.
Nuitka:WARNING:Unresolved 'import' call at 'C:\Users\e10853\AppData\Local\Programs\Python\Python37\lib\site-packages\numpy\lib\utils.py:923' may require use of '--include-plugin-directory' or '--include-plugin-files'.
Nuitka:WARNING:Unresolved 'import' call at 'C:\nuitka0403\Standalone\torch_utils.py:156' may require use of '--include-plugin-directory' or '--include-plugin-files'.
Nuitka:INFO: Now copying extra binaries from 'numpy' installation:
Nuitka:INFO: c:\users\e10853\appdata\local\programs\python\python37\lib\site-packages\numpy.libs\libopenblas.ipbc74c7kurv7cb2pkt5z5fnr3sibv4j.gfortran-win_amd64.dll
Nuitka:INFO: Copied 1 binary.
Removed the following files or folders:
C:\nuitka0403\Standalone\out\main.dist\tcl86t.dll (Tk file)
C:\nuitka0403\Standalone\out\main.dist\tk86t.dll (Tk file)
C:\nuitka0403\Standalone\out\main.dist_tkinter.pyd (Tk file)
Nuitka compile successful (689 sec) ...
・So I could make main.exe in main.dist.
・I did "mkdir lib" in torch derectory and copied a lot of torch Dlls from site-packaes.
・The result is as below.
C:\nuitka0403\Standalone\out\main.dist>main.exe
Downloading http://yann.lecun.com/exdb/mnist/train-images-idx3-ubyte.gz to ../data\MNIST\raw\train-images-idx3-ubyte.gz
100.1%Extracting ../data\MNIST\raw\train-images-idx3-ubyte.gz
Using downloaded and verified file: ../data\MNIST\raw\train-labels-idx1-ubyte.gz
Extracting ../data\MNIST\raw\train-labels-idx1-ubyte.gz
Downloading http://yann.lecun.com/exdb/mnist/t10k-images-idx3-ubyte.gz to ../data\MNIST\raw\t10k-images-idx3-ubyte.gz
100.4%Extracting ../data\MNIST\raw\t10k-images-idx3-ubyte.gz
Downloading http://yann.lecun.com/exdb/mnist/t10k-labels-idx1-ubyte.gz to ../data\MNIST\raw\t10k-labels-idx1-ubyte.gz
180.4%Extracting ../data\MNIST\raw\t10k-labels-idx1-ubyte.gz
Processing...
Traceback (most recent call last):
File "C:\nuitka0403\Standalone\out\main.dist\main.py", line 116, in
File "C:\nuitka0403\Standalone\out\main.dist\main.py", line 91, in main
File "C:\nuitka0403\Standalone\out\main.dist\torchvision\datasets\mnist.py", line 68, in init
File "C:\nuitka0403\Standalone\out\main.dist\torchvision\datasets\mnist.py", line 151, in download
File "C:\nuitka0403\Standalone\out\main.dist\torchvision\datasets\mnist.py", line 321, in read_label_file
File "C:\nuitka0403\Standalone\out\main.dist\torchvision\datasets\mnist.py", line 315, in get_int
ValueError: invalid literal for int() with base 16: b''
・Pytorch mnist main.exe opereted correctly at first as blow
Downloading http://yann.lecun.com/exdb/mnist/train-images-idx3-ubyte.gz to ../data\MNIST\raw\train-images-idx3-ubyte.gz
100.1%Extracting ../data\MNIST\raw\train-images-idx3-ubyte.gz
Using downloaded and verified file: ../data\MNIST\raw\train-labels-idx1-ubyte.gz
Extracting ../data\MNIST\raw\train-labels-idx1-ubyte.gz
Downloading http://yann.lecun.com/exdb/mnist/t10k-images-idx3-ubyte.gz to ../data\MNIST\raw\t10k-images-idx3-ubyte.gz
100.4%Extracting ../data\MNIST\raw\t10k-images-idx3-ubyte.gz
Downloading http://yann.lecun.com/exdb/mnist/t10k-labels-idx1-ubyte.gz to ../data\MNIST\raw\t10k-labels-idx1-ubyte.gz
180.4%Extracting ../data\MNIST\raw\t10k-labels-idx1-ubyte.gz
Processing...
・But suddenly Error occured.
Traceback (most recent call last):
File "C:\nuitka0403\Standalone\out\main.dist\main.py", line 116, in
File "C:\nuitka0403\Standalone\out\main.dist\main.py", line 91, in main
File "C:\nuitka0403\Standalone\out\main.dist\torchvision\datasets\mnist.py", line 68, in init
File "C:\nuitka0403\Standalone\out\main.dist\torchvision\datasets\mnist.py", line 151, in download
File "C:\nuitka0403\Standalone\out\main.dist\torchvision\datasets\mnist.py", line 321, in read_label_file
File "C:\nuitka0403\Standalone\out\main.dist\torchvision\datasets\mnist.py", line 315, in get_int
ValueError: invalid literal for int() with base 16: b''
・Unfortunately my main.exe (was made by nuikta) is not perfect yet.
・I'd really appreciate it if you give me any advice to solve this issue.
Regards,

So I look at this down from your call stack. And the main question would be if read_label_file is not reading your file properly, but it contains an error.
Checkout out this:
https://github.com/pytorch/vision/blob/8759f3035b860365cae15656a5636e408163e8b4/torchvision/datasets/mnist.py#L311
Not sure if that is related to Nuitka at all, because you are downloading and extracting stuff, and maybe something is not right or not working correctly in that.

Thank you for your advice, kayhayen.
I only used mnist main.py ,it is one of pytorch's exmple.
Do you mention that original "main.py  code" have bug and the bug made call stack error ?
Could you suggest any way to avoid this error ?
Do I have to correct original code ?
Reagrds,

@yoshihingis I am just saying that it may have been a spurious error due to a download problem, since the exception is in the reading of a file. Is it reproducible?

Dear Kayhayen.
Today I checked download problem as below.
At first, I run original python pytorch mnist main.py ,  Python code downloaded the training set (images and labels) and the test set (images and labels) in the data directory ,The mnist training operated correctly  with no problems.
I copyied this data folder to  new data folder to "check nuitka main.exe" . The main.exe ( was made by nuitka) use same training set and test set ,when I run original python code. But maine.exe made a lot of errors soon .
So,I don't think that it is download problem.
Regards,

Dear JorjMcKie and kayhayen.
If you have time,could you try to make standalone mode main.exe of mnist  example of Windows pytorch 1.01 by nuitka. It is very rare case that nuitka is used to make change the python code of Deep Learning framework to executable binary.  A lot of guys use pyinstaller in same case.  But I know that the Pyinstaller is poor compiler tool.

@yoshihingis - I wll take this one on.
Please send me again the script you are trying to compile.
Obviously the one I have been using was not able to reproduce the error.
If possible send to my private e.-mail address, because my internet connection currently is extremely bad.
Thanks.

Heureka! I made it!
Your example now runs when compiled in standalone mode.
I have to make a few adjustments before I can release it to you or the public. The major thing I need to do is creating a new plugin for supporting torch.
This plugin will copy additional shared libraries (DLLs on Windows) to your script's dist folder.

@kayhayen  - (py-) torch applications obviously by nature are users of the multiprocessing plugin, as well as numpy. Which is fine.
The last road block to remove was changing the sys.executable value to script.exe (instead of leaving the original python.exe). This was due to the fact, that module multiprocessing\popen_spawn_win32.py starts a process (via Popen) with the value it find in that variable. Would it make sense to do that in the multiprocessing plugin at all? Or am I missing something here?

@yoshihingis, another thing to get under control is the awful long compile time. In the end I brought it down to 4 minutes by using a handful of parameters for compilation, and some other means.
Please give me an impression of what your needs are:
I need some more time to package everything in a reusable format.
As for the new torch plugin, there are two basic options.

a user plugin, which is a separate Python script that needs to be used every time, when a torch script gets compiled
a Nuikta standard plugin, which will become part of Nuitka in some future Nuitka version.

Option 1 is faster available for you, and easier to adapt, when new issues pop up.
I have to ask you again:
You are aware, that pytorch standalone applications are very, VERY large folders? At least on Windows? Your example main.py is 1.2 Gigabytes (!!!) on my computer.
How much sense does it make to distribute a folder of this size?

Dear, JoriMcKie
Thank you for your help,
I am very glad to hear that my example run correctly at standalone compiler.
1.about torch plugin
It is OK as a user plugin. I want to test main.exe of pytorch which was compiled  standalone mode.
But Please tell me the usage of plugin and compiled option when main.py willbe compiled by nuitka(s standalone mode.
2.About file size
1.2Gbyte is no ploblem for me,because I use this executable file(main.exe and other dll,lib,include dir,etc) at Desktp Windows10 PC. Desktop pc has large size capacity of HDD.
*By the way ,I found another issue about standalone mode.
I think that Standalone mode executable file with other dll, lib,include dir will be able to run at pc with out pyhton,pytorch,torchvision,cuda.
At the previous,you made simple eample exe "torch.exe" by standalone mode ,I copied dist folder and torch dll and torch lib and include dir and etc accoding with your advice to The desktop Windows pc without python3.7.2,Dl-Framework(pytorch and torch vision) and cuda,
I run torch.exe, but torch exe did "error"; So I installed pyhton3.7.3 ,DL-Framework and cuda10 ,your torch.exe run correctly.
Does torch.exe need Python,DL-Flamework,and cuda when it was compile by nuitka stand alone mode?
I think that nuitka's standalone mose is same as pyinstaller's onefile mode. The Executable file ,which was made by Pyinstaller's onefile mode) operate correctly without python.DL-framework,CUDA.
Did I miss-understanding about nuitaka's standalone mode?
Regards,

@yoshihingis - in the meantime you should have received an e-mail from me.
I hope the ZIP file in there helps resolve the issue. It did on my Windows 10 system anyway.
Please let me know how this works for you, or any other issues arising.
@kayhayen - as per my remark in the previous post: I have seen in the meantime that the multiprocessing plugin does modify the sys.executable with the value contained in sys.argv[0]. So my remark was due to lack of knowledge.
This hack does work for the pytorch case ... provided the user is kind enough to invoke his script program with the .exe suffix (relevant on Windows platform only). I will suggest a little mod to cover any sloppy user entry.

OK,I will check this issue monday im my ofiice and I will report the result.

Hello, I'm facing similar issues when building a pytorch example with nutika, but in linux (ubuntu 16.04). Can you share a initial version of the script, even without the adjustments?
Thanks in advance!

@walbermr - in the meantime, the development version of Nuitka containsw the required plugin for pytorch.
So you should be fine by just using it. I will however include the complete set of plugins and associate compilation script here:
hinting.zip

Make sure you have the current Nuitka development version.
run python get-hints.py yourscript.py. This will execute your script using the normal Python interpreter and create a JSON file containing all import calls your script has been making.
Compile your script in --standalone mode via python nuitka-hints.py yourscript.py. This will automatically use the JSON from before and activate / enable all required standard plugins (eg. numpy, scipy and what not). You way want to look into the nuitka-hints.py script to make sure you are fine with the choice of parameters it will hand through to the nuitka compiler.

That should be it.
I am not a regular pytorch user, and thus have run demo scripts only so far. So maybe your script will detect missing pieces or required adjustments.
Good luck.

The torch plugin is about to be merged to develop.

Released as 0.6.5


BIGTOP-1126. Add Hama to Bigtop

Hi @youngwookim
I resend a PR as directed because a conflict occurs during the merge.
Please check this PR. And Do I close another PR on the following link?
https://github.com/apache/bigtop/pull/24
Please let me know about that.
Thanks.

@eoriented  bigtop.mk file is missing!? please take a look, Thanks!

@youngwookim I add bigtop.mk file in this branch.
Please check it!
And Would I close PR which is #24?
Thanks.

Thanks @eoriented
#24 is obsolete, Should be closed i believe. Thanks!

Ok.
Thank you for the friendly words in your comments.


lua: add stats

Commit Message: lua: add stats
Additional Description: Currently stats are not available in lua filter, which makes it hard to
track/alert for the script errors. This change adds error stat.
Risk Level: Low
Testing: Manual and Unit tests
Docs Changes: Done
Release Notes: Done
Platform Specific Features:
[Optional Runtime guard:]
[Optional Fixes #Issue]
[Optional Fixes commit #PR or SHA]
[Optional Deprecated:]
[Optional API Considerations:]

(re-assigning from @markdroth to @mattklein123 for API review)


[QUERY] Any reason why Azure.Data.Tables only accepts classes as entity types and not structs?

Library name and version
Azure.Data.Tables 12.7.1
Query/Question
Methods on the TableClient class that support a generic type for entities have a class constraint on the generic type. Is this necessary? This does not allow structs to be used as an entity type which might be useful when dealing with a lot of entity objects and trying to optimise for memory usage.
Environment
No response

Thank you for your feedback.  Tagging and routing to the team member best able to assist.

Hi @alinia  - Previously we had a new() generic constraint which required class. However, since that has been removed, it could be possible to remove class as well. We'd have to investigate to confirm.


Error when adding endpoint in init

Getting this error when using the endpoint parameter in  FingerprintJS.init:
index.bundle?platfor…&minify=false:27518 Exception '-[__NSCFString isFileReferenceURL]: unrecognized selector sent to instance 0x60000387a130' was thrown while invoking init on target RNFingerprintjsPro with params (
    ------, (hiding the real key here)
    us,
    "\"https://google.com\""(hiding the real domain)
)

Tried using different domains as well, no luck

I believe we need this format in the native code:
URL(string: "https://fp.yourdomain.com")

Inside of:
@objc(init:region:endpoint:)
    public required init(_ apiToken: String, _ region: String? = "us", _ endpoint: URL? = nil) {
        fpjsClient = FingerprintJSProFactory
            .getInstance(
                token: apiToken,
                endpoint: URL(string: endpoint),
                region: region
            )
    }

Thanks for reporting this. It indeed looks like the Obj-C API has a non-matching type (Swift interface is supposed to be String as well). We'll introduce a fix.


fix the value of null map will overflow when LazyRead merges too many empty batches

Proposed changes
Problem summary
When running q18 of tpch100, some errors were thrown:
doris_be: /mnt/disk2/gaoxin/ws/doris/be/src/vec/common/pod_array.h:337: T& doris::vectorized::PODArray<T, initial_bytes, TAllocator, pad_right_, pad_left_>::operator[](ssize_t) [with T = unsigned char; long unsigned int initial_bytes = 4096; TAllocator = Allocator<false>; long unsigned int pad_right_ = 15; long unsigned int pad_left_ = 16; ssize_t = long int]: Assertion `(n >= (static_cast<ssize_t>(pad_left_) ? -1 : 0)) && (n <= static_cast<ssize_t>(this->size()))' failed.
7# doris::vectorized::ColumnSelectVector::set_run_length_null_map(std::vector<unsigned short, std::allocator<unsigned short> > const&, unsigned long, doris::vectorized::PODArray<unsigned char, 4096ul, Allocator<false, false>, 15ul, 16ul>*) at /mnt/disk2/gaoxin/ws/doris/be/src/vec/exec/format/parquet/parquet_common.cpp:118
8# doris::vectorized::ScalarColumnReader::_read_values(unsigned long, COW<doris::vectorized::IColumn>::immutable_ptr<doris::vectorized::IColumn>&, std::shared_ptr<doris::vectorized::IDataType const>&, doris::vectorized::ColumnSelectVector&) at /mnt/disk2/gaoxin/ws/doris/be/src/vec/exec/format/parquet/vparquet_column_reader.cpp:177

The run length of null map is saved as uint16_t. Previously, the run length of null map was limited by batch_size in the ParquetReader, by setting batch_size = std::min(batch_size, (size_t)USHRT_MAX). It works well when the batch size is less than USHRT_MAX.
However, Lazy read will merge empty batches until reading a non-empty batch or reaching the EOF of a row group, so the batch_size may be greater than USHRT_MAX in non-predicate columns.
In addition, even if the batch_size does not exceed USHRT_MAX, the adjacent batches may also make the run  length exceed the USHRT_MAX in ColumnSelectVector::get_next_run.
Checklist(Required)

Does it affect the original behavior:

[ ] Yes
[x] No
[ ] I don't know

Has unit tests been added:

[ ] Yes
[x] No
[ ] No Need

Has document been added or modified:

[ ] Yes
[x] No
[ ] No Need

Does it need to update dependencies:

[ ] Yes
[x] No

Are there any changes that cannot be rolled back:

[ ] Yes (If Yes, please explain WHY)
[x] No

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 35.03 seconds
load time: 434 seconds
storage size:<PHONE_NUMBER>2 Bytes
https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20221124133448_clickbench_pr_52303.html


feat: publish search click events

This add search event reporting when a user clicks on a search item in the global search box.
It generates a hashed version of the connection information presented to the server. This means there are no cookies dropped on a users machine, and the information is only used to attempt to uniquely identify users to algolia for its reporting and analytics.

Here is a view of the algolia event debugger indicating dispatched events are "correct" and starting to feed the engine:


Add minor fixes to links in UG

Codecov Report

Merging #216 (6e0df48) into master (1c2acba) will not change coverage.
The diff coverage is n/a.

:exclamation: Current head 6e0df48 differs from pull request most recent head 81d51d8. Consider uploading reports for the commit 81d51d8 to get more accurate results

@@            Coverage Diff            @@
##             master     #216   +/-   ##
=========================================
  Coverage     63.15%   63.15%
  Complexity      634      634
=========================================
  Files           105      105
  Lines          2399     2399
  Branches        310      310
=========================================
  Hits           1515     1515
  Misses          758      758
  Partials        126      126

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Failed to start service hivedscheduler-hs

Short summary about the issue/question:
2020-11-09 00:33:25,919 [INFO] - deployment.paiLibrary.paiService.service_management_start : Begin to start service: [ hivedscheduler ]
2020-11-09 00:33:25,920 [INFO] - deployment.paiLibrary.paiService.service_management_start : Begin to execute service hivedscheduler's start script.
configmap/hivedscheduler-config created
serviceaccount/hivedscheduler-account created
clusterrolebinding.rbac.authorization.k8s.io/hivedscheduler-role-binding created
service/hivedscheduler-service created
statefulset.apps/hivedscheduler-hs created
statefulset.apps/hivedscheduler-ds-default created
hivedscheduler-hs is not ready yet. Please wait for a moment!
hivedscheduler-hs is not ready yet. Please wait for a moment!
hivedscheduler-hs is not ready yet. Please wait for a moment!
hivedscheduler-hs is not ready yet. Please wait for a moment!
hivedscheduler-hs is not ready yet. Please wait for a moment!
hivedscheduler-hs is not ready yet. Please wait for a moment!
hivedscheduler-hs is not ready yet. Please wait for a moment!
hivedscheduler-hs is not ready yet. Please wait for a moment!
hivedscheduler-hs is not ready yet. Please wait for a moment!
hivedscheduler-hs is not ready yet. Please wait for a moment!
hivedscheduler-hs is not ready yet. Please wait for a moment!
hivedscheduler-hs is not ready yet. Please wait for a moment!

Brief what process you are following: deploy Openpai on dev-box, running commend echo -e "pai\n" | python paictl.py service start

How to reproduce it:

OpenPAI Environment:

OpenPAI version:V1.3.0
OS (e.g. from /etc/os-release):Ubuntu 16.04 LTS
Others:I'm going to deploy openpai in a single node, and i follow #4614

Anything else we need to know:
Hope these information helpful
kubectl get pods
root@zcy:/pai# kubectl get pods
NAME                               READY   STATUS             RESTARTS   AGE
database-controller-sts-0          4/4     Running            0          4m36s
frameworkcontroller-sts-0          1/1     Running            0          5m31s
hivedscheduler-ds-default-0        1/1     Running            0          3m59s
hivedscheduler-hs-0                0/1     CrashLoopBackOff   5          3m59s
internal-storage-create-ds-lvvx7   1/1     Running            0          5m20s
postgresql-ds-ckgf5                2/2     Running            0          4m58s

kubectl describe pod hivedscheduler-hs-0
root@zcy:/pai# kubectl describe pod hivedscheduler-hs-0
Name:         hivedscheduler-hs-0
Namespace:    default
Priority:     0
Node:         openpai-master-01/<IP_ADDRESS>
Start Time:   Mon, 09 Nov 2020 00:33:28 +0000
Labels:       app=hivedscheduler-hs
              controller-revision-hash=hivedscheduler-hs-d99dd5dcf
              statefulset.kubernetes.io/pod-name=hivedscheduler-hs-0
Annotations:  cni.projectcalico.org/podIP: <IP_ADDRESS>/32
              cni.projectcalico.org/podIPs: <IP_ADDRESS>/32
Status:       Running
IP:           <IP_ADDRESS>
IPs:
  IP:           <IP_ADDRESS>
Controlled By:  StatefulSet/hivedscheduler-hs
Containers:
  hivedscheduler:
    Container ID:  docker://801d78892934ce66c366aae3e932788066a77a45caf6410dd3d8c66811f51ca0
    Image:         hivedscheduler/hivedscheduler:v0.3.4
    Image ID:      docker-pullable://hivedscheduler/hivedscheduler@sha256:d2d58d04520ba579484a82de242ff73b6f5d31fb728fe100f8b6576a0381d3f9
    Port:          <none>
    Host Port:     <none>
    Command:
      bash
      -c
      cp /hivedscheduler-config/hivedscheduler.yaml . && ./start.sh
    State:          Waiting
      Reason:       CrashLoopBackOff
    Last State:     Terminated
      Reason:       Error
      Exit Code:    2
      Started:      Mon, 09 Nov 2020 00:36:31 +0000
      Finished:     Mon, 09 Nov 2020 00:36:31 +0000
    Ready:          False
    Restart Count:  5
    Environment:    <none>
    Mounts:
      /hivedscheduler-config from hivedscheduler-config (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from hivedscheduler-account-token-tp2z6 (ro)
Conditions:
  Type              Status
  Initialized       True
  Ready             False
  ContainersReady   False
  PodScheduled      True
Volumes:
  hivedscheduler-config:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      hivedscheduler-config
    Optional:  false
  hivedscheduler-account-token-tp2z6:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  hivedscheduler-account-token-tp2z6
    Optional:    false
QoS Class:       BestEffort
Node-Selectors:  pai-master=true
Tolerations:     node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                 node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason     Age                     From               Message
  ----     ------     ----                    ----               -------
  Normal   Scheduled  4m32s                   default-scheduler  Successfully assigned default/hivedscheduler-hs-0 to openpai-master-01
  Normal   Pulled     2m59s (x5 over 4m29s)   kubelet            Container image "hivedscheduler/hivedscheduler:v0.3.4" already present on machine
  Normal   Created    2m58s (x5 over 4m29s)   kubelet            Created container hivedscheduler
  Normal   Started    2m58s (x5 over 4m28s)   kubelet            Started container hivedscheduler
  Warning  BackOff    2m57s (x10 over 4m26s)  kubelet            Back-off restarting failed container

kubectl logs hivedscheduler-hs-0
root@zcy:/pai# kubectl logs hivedscheduler-hs-0
I1109 00:36:31.516257       9 scheduler.go:123] Initializing hivedscheduler
I1109 00:36:31.517024       9 scheduler.go:126] With Config:
kubeApiServerAddress: ""
kubeConfigFilePath: ""
webServerAddress: :30096
forcePodBindThreshold: 3
waitingPodSchedulingBlockMilliSec: 50
physicalCluster:
  cellTypes:
    DT-NODE:
      childCellType: DT
      childCellNumber: 100000000
      isNodeLevel: true
    DT-NODE-POOL:
      childCellType: DT-NODE
      childCellNumber: 0
      isNodeLevel: false
  physicalCells:
  - cellType: DT-NODE-POOL
    cellAddress: "0"
    pinnedCellId: ""
virtualClusters:
  default:
    virtualCells:
    - cellNumber: 0
      cellType: DT-NODE-POOL.DT-NODE
I1109 00:36:31.517173       9 config.go:208] Watching config file: ./hivedscheduler.yaml
W1109 00:36:31.517212       9 client_config.go:549] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
panic: runtime error: index out of range

goroutine 1 [running]:
github.com/microsoft/hivedscheduler/pkg/algorithm.newClusterView(0xc0003a3f20, 0xc0003d61b0, 0xc0000455d0, 0xc)
        /go/src/github.com/microsoft/hivedscheduler/pkg/algorithm/topology_aware_scheduler.go:166 +0x335
github.com/microsoft/hivedscheduler/pkg/algorithm.NewTopologyAwareScheduler(...)
        /go/src/github.com/microsoft/hivedscheduler/pkg/algorithm/topology_aware_scheduler.go:59
github.com/microsoft/hivedscheduler/pkg/algorithm.NewHivedAlgorithm(0xc00030adc0, 0x168cd80)
        /go/src/github.com/microsoft/hivedscheduler/pkg/algorithm/hived_algorithm.go:138 +0x587
github.com/microsoft/hivedscheduler/pkg/scheduler.NewHivedScheduler(0x11b5ef0)
        /go/src/github.com/microsoft/hivedscheduler/pkg/scheduler/scheduler.go:149 +0x350
main.main()
        /go/src/github.com/microsoft/hivedscheduler/cmd/hivedscheduler/main.go:35 +0x22

physicalCluster:
  cellTypes:
    DT-NODE:
      childCellType: DT
      childCellNumber: 100000000
      isNodeLevel: true
    DT-NODE-POOL:
      childCellType: DT-NODE
      childCellNumber: 0
      isNodeLevel: false
  physicalCells:
  - cellType: DT-NODE-POOL
    cellAddress: "0"
    pinnedCellId: ""

Could you use a valid configuration? You configured 0 child cell for DT-NODE-POOL but still specified a cell address.

Thank you very much! @abuccts
I successfully deploy openpai in a single node after modify layout.yaml
At first i set machine both master and worker:
machine-list:
    - hostname: openpai-master-01
      nodename: openpai-master-01
      hostip: <IP_ADDRESS>
      machine-type: GENERIC-MASTER
      dashboard: "true"
      pai-master: "true"
      pai-worker: "true"

So i remove the last line, the file become:
machine-list:
    - hostname: openpai-master-01
      nodename: openpai-master-01
      hostip: <IP_ADDRESS>
      machine-type: GENERIC-MASTER
      dashboard: "true"
      pai-master: "true"

It seems that the master node can't be master and worker at the same time?
If I encounter a new problem, I will reopen the issue
Thank you again!


Use Origin Shield Failover to improve cost efficiency and allow bigger images to be processed

Is your feature request related to a problem? Please describe.

If there is a miss on Cloudfront, Lambda will always be called to generate an image.
Lambda limits the size of images that can be processed (returned to the client)

Describe the feature you'd like

There is another 'image optimization' project from AWS which describes a way to use Sharp to resize images. It's a lot less sophisticated on the transformations, but it does use a failover mechanism provided by Origin Shield which allows the 'transformed' image to be persisted to another S3 bucket (which solves 1).
It would also provide a mechanism for supporting larger images by persisting the image and returning a status code that tells te client to restart the request. At the time the client restarts the request the image will be available in S3 and can be served.
https://github.com/aws-samples/image-optimization.
From my perspective it would also make sense to combine these two repositories / solutions because of their similarities.
Additional context

https://github.com/aws-samples/image-optimization/compare/main...graceful-failover

Thanks for the suggestion. We add this to our backlog and try to add it in our future release upon getting proper approvals.


Add an example

It'd be nice if there was a minimal example showing how to use this module.

Absolutely. Thanks for pinging on me – time to complete the docs. I’ll try to do it tomorrow.

No rush! I was just thinking of using this library for a clone of html-patcher called html-patcher-light and using it within my apps.

Sounds good! I too use this for patching a single element. I’ll let you know when I’m done!

https://github.com/tomekwi/virtual-dom-lite/tree/1f70eac#usage
https://github.com/tomekwi/virtual-dom-lite/tree/1f70eac#caveats
The implementation has changed a bit as well, in case you’ve already built something on it.

Awesome, thanks!


Re-attach resized disk with SSD TRIM feature enabled.

This allows to shrink the .vdi file on the host when disk space
is reclaimed in the guest OS.
For some reason VirtualBox doesn't expose this feature on its
GUI.  It's only available in VBoxManage when attaching a
virtual hard disk.  So this plugin is the perfect place to
enable this feature.
More information about this feature here:
https://www.virtualbox.org/manual/ch08.html
Look at the storageattach --discard option.
I've been using it for many months on my Ubuntu guest VMs with
no ill side-effects.

I would love to have this too. But maybe it can be an optional feature? TRIM might cause unexpected behavior down the line, especially since it changes the disk to appear to be an SSD. (which it might not be)

Sure, it could be an option. I don’t know Ruby much so adding an option is not trivial for me.  I wouldn’t mind trying if first I could get this PR merged.  :-)
However, I’m not sure an option would be that useful as in a VM the hardware is virtualized so as far as I know it doesn’t matter what the physical disk type actually is, the OS in the VM will think it’s an SSD and virtualbox will handle writing to the virtual hard disk, which is just a file on the real file system.

Well, using windows as an example, if the disk type is HDD, it will run defragmenter every week, if SSD,  it will run TRIM. So it does change the behavior of the VM.


SFT may crash if input data exceeds the context length

Describe the bug
One can run into a crash
"/opt/NeMo/nemo/collections/nlp/modules/common/megatron/language_model.py", line 352, in forward
    embeddings = words_embeddings + position_embeddings
RuntimeError: CUDA error: device-side assert triggered

e.g. when running a model with 512 context length.
This may or may not be a bug, but we should ideally:

have a clearer error message
mention it in the tutorial and/or update the Dolly15k conversion script to filter out too long samples

Encountered a possibly related issue:
ValueError: Caught ValueError in DataLoader worker process 0.

File "nemo/collections/nlp/data/language_modeling/megatron/gpt_sft_dataset.py", line 459, in collate_fn
  contexts = torch.LongTensor(self._collate_item(contexts, max_length=max_length, pad_id=self.tokenizer.eos_id))
ValueError: expected sequence of length 4096 at dim 1 (got 4870)


Mazerunner

Your checklist for this pull request
Ayoub Chafiq
About your game
This is a simple maze game with 10 levels. In the starting menu screen, there are 3 themes to choose from.
What is your game about?
In this game, the objective is to reach the Crown. Sometimes this crown will be split into two and both players will have to reach the crown. In this game you will have to avoid obstacles and solve (extremely simple) puzzles.
How do you play your game?
Player One - WASD
Player Two - IJKL
Code
Check off the items that are true.

[x] The game was made using the Sprig editor.
[x] The game is placed in the in the /games directory.
[x] The code is significantly different from all other games in the Sprig gallery (except for games labeled "demo").
[x] The game runs without errors. *To my knowledge
[x] The name of the file/game contains only alphanumeric characters, -s, or _s.
[x] The game name is not the same as the others from gallery

Image (If an image is used)

[x] The image is in the /games/img directory.
[x] The name of the image matches the name of your file.

@LucasHT22
The file with the name Maze_runner is my latest version

@LucasHT22 The file with the name Maze_runner is my latest version

Could you delete the other files? If you need help, please ask:)

I believe I deleted them now, but they still appear, so I am unsure. Thanks for the help

@LucasHT22 I believe I deleted them now, but they still appear, so I am unsure. Thanks for the help.

@LucasHT22 I believe I deleted them now, but they still appear, so I am unsure. Thanks for the help.

I think you forget the other file:) try doing it one more time

In the attached image I showed the image I was trying to delete. The delete button is grayed out and I cannot delete it
@LucasHT22

This file needs to be in the games folder.

Congratulations on making a great game!  If you're a teenager, and haven't already received one, please fill out this form to receive a Sprig device of your own!  Also, feel free to check out Hack Club's Slack, and chime in on the #sprig channel to share your game w/ others in our community!

@grymmy I really appreciate all your help on this. I just had one last question, I was wondering if I could order this in August instead of now, since I won't be home this summer


For email-notifications plugin: Added third party dependencies

Added third party dependencies to plugin-hub repo and removed the jar files in the email-notifications plugin repo. Updated metadata as per https://github.com/runelite/plugin-hub/blob/master/README.md.

We don't want to be storing/handling gmail credentials


Issue#1478 retry

Add retry effect doc
(https://github.com/redux-saga/redux-saga/issues/1478)[related issue]

I will update PR tomorrow, thanks)


unix,win: add uv_randbytes

Refs: https://github.com/nodejs/node/issues/5798
This is still WIP (Windows seems to be failing but I can't access a VM right now to debug it.) but I'd like to get some feedback.  I think the most important thing here is the documentation, as in, what we promise with this API.  That's the main reason why this PR targets master and not v1.x.  Maybe we'll backport it, maybe not.
Question for reviewers: should the buffer be char* or void* I make it void* for consistency with system APIs...
Question 2: what would be a proper test for this?
All reviews are welcome!

Is this something that should be available as an asynchronous thread pool feature?

/cc @joepie91, @paragonie-scott.

Is this something that should be available as an asynchronous thread pool feature?

@addaleax IMHO not really.  AFAIK it can only block in certain platforms (FreeBSD IIRC) and under very specific conditions (very early on in the boot process) so all other systems would be penalized.  For now I chose to document this behavior, but I'm open to discuss it :-)

What is the behaviour of this code when none of the strategies (including the /dev/urandom fallback) are available?

@saghul Sounds good to me, thanks for explaining!

Few nits, otherwise LGTM

What is the behaviour of this code when none of the strategies (including the /dev/urandom fallback) are available?

@joepie91: it will return an error like all other libuv APIs. If it returns 0 the buffer will have been filled. Otherwise its content is undefined.

@joepie91 I added an explanation in the docs about the return value.

Updated the initial comment with a question: how should this be tested?  All I can think of is to run a bunch of iterations zeroing the buffer between them and making sure that the buffer has been modified after every call.  Thoughts?

Refs: nodejs/node#5798

@saghul If you wrote this PR specifically for that issue, note that I made it abundantly clear that this should be fixed upstream in openssl first.

I didn't write it for it specifically :-)  Not so long ago there was a
related discussion in the Python ecosystem, and I also found myself looking
into it for another project of mine.
IMHO this API has a place in libuv, since it's a platform abstraction
library, and this can be useful. The use of this API in Nose would be nice,
but it's not necessarily my end goal. It has value on its own.
Since I found the Node issue (a piece of news made it to HN recently) I
thought I'd throw in a Ref.
On Sep 16, 2016 10:34, "Ben Noordhuis"<EMAIL_ADDRESS>wrote:

Refs: nodejs/node#5798 https://github.com/nodejs/node/issues/5798
@saghul https://github.com/saghul If you wrote this PR specifically for
that issue, note that I made it abundantly clear that this should be fixed
upstream in openssl first.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/libuv/libuv/pull/1055#issuecomment-247547481, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AATYGNeFS79gVxaMV7xN8GfVeIpRTk-rks5qqlSogaJpZM4J-SLK
.

@saghul Has this stalled?  If not, it will need a rebase - there are a couple of conflicts.

@saghul Can I suggest an improvement for when getrandom(2) isn't available and /dev/urandom cannot be opened?  From one of my side projects, feel free to steal:
#include <errno.h>
#include <string.h>
#include <unistd.h>
#include <syscall.h>
#include <linux/sysctl.h>

int
getrandom(char *p, int n)
{
        static int name[] = { CTL_KERN, KERN_RANDOM, RANDOM_UUID };
        struct __sysctl_args args;
        char *pe, uuid[16];
        size_t len;

        pe = p + n;
        while (p < pe) {
                memset(&args, 0, sizeof(args));
                args.name = name;
                args.nlen = sizeof(name) / sizeof(*name);
                args.oldval = uuid;
                args.oldlenp = &len;
                len = sizeof(uuid);

                if (syscall(SYS__sysctl, &args) == -1)
                        return -errno;

                if (len != sizeof(uuid))
                        return -EIO;  // Can't happen.

                // uuid[] is now a type 4 UUID; bytes 6 and 8 (counting from
                // zero) contain 4 and 5 bits of entropy, respectively.  For
                // ease of use, we skip those and only use 14 of the 16 bytes.
                uuid[6] = uuid[14];
                uuid[8] = uuid[15];

                n = pe - p;
                if (n > 14)
                        n = 14;

                memcpy(p, uuid, n);
                p += n;
        }

        return 0;
}

sysctl(2) is deprecated and prints a warning in the syslog with some kernels but as a fallback that seems acceptable to me.

Oops, it fell through the cracks! I'll try to give it an update this weekend. Thanks for the reminder!

Updated, PTAL. @bnoordhuis I haven't incorporated your suggestion, will do. I need some help with the Windows side (can't really test right now), @bzoz @refack can you help?

@saghul testing

Phase 1 vcbuild test:
not ok 177 - randbytes
# exit code -1073741819
# Output from process `randbytes`: (no output)

Phase 2: ... (hard work) ...
Phase 3: Profit!

P.S. @saghul any specific reason you chose RtlGenRandom and not CryptGenRandom?

@refack Thanks for taking a look. TBH I don't fully remember why I went that route, but it might have been to avoid linking with the CryptoAPI, since we only need that function: https://en.wikipedia.org/wiki/CryptGenRandom#Using_RtlGenRandom

@saghul I'm going to close this, but of course feel free to revisit when you get time.


[IconMenu] IconMenu can change state when click on Link component of react-router

I am using IconMenu with some more components on my page such as Link of react-router. I opened the popover menu, after that I click on Link, I cant see the event onRequestChange fired. So the popover till appear. The same when I click on RaisedButton.
material-ui v0.15 alpha2

1

I think this is related to a check in the IconMenu on line 181 and line 196 where it checks is open is not null, I believe this should be onRequestChange instead of open. Does that make sense or am I missing something?


How to generate  IPFS.20Desktop-<IP_ADDRESS>Setup.exe

I hope I can get help.

You can:

Clone the repository.
Execute npm install.
npm run make.

And it will build the Windows binary if executed on Windows. Sorry for not having it available to download on our page, but our CI is failing on Windows and it wasn't possible to solve the issue yet.

run as administrator
error
EPERM: operation not permitted, scandir 'C:\Users\x\AppData\Local\Temp\electron-packager\win32-x64\IPFS Desktop-win32-x64\resources\app\node_modules\abab'

@jieweili try cleaning node_modules and doing everything again. NPM has some permission issues on Windows. Although I can't reproduce it here


SSL Example and fixes

Codecov Report

Merging #6 into master will increase coverage by 2.57%.
The diff coverage is 65.51%.

@@            Coverage Diff             @@
##           master       #6      +/-   ##
==========================================
+ Coverage   31.88%   34.45%   +2.57%
==========================================
  Files          46       47       +1
  Lines         803      862      +59
  Branches      136      149      +13
==========================================
+ Hits          256      297      +41
- Misses        536      547      +11
- Partials       11       18       +7

Impacted Files
Coverage Δ

src/cli/index.ts
0.00% <0.00%> (ø)

src/serviceManager.ts
0.00% <0.00%> (ø)

src/lib/services/globalConfig.ts
61.90% <66.66%> (+61.90%)
:arrow_up:

src/lib/services/updater.ts
68.29% <68.29%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4361c20...5b1ed0f. Read the comment docs.


[QA] Minigame - Peer Can Desync and Join the Game Twice

Explorer Alpha build versions:

v0.33.0

Issue Description:
A peer can enter another player's game while it is in progress. This issue occurs when a user teleports quickly and clicks "Play" before the Room SID loads.
Preconditions: Have the debug menu open.

Go to the Tower of Hanoi scene (61,-22).
User A enters the game.
User B teleports to Alavara.
User B teleports to (60,-22) and runs quickly to the minigame.
User B clicks "Play" before the Room SID in the debug menu loads.

❌ Actual Result
User B can join the game in progress with User A and potentially desync by entering the game twice.
https://github.com/user-attachments/assets/e95f4fa5-087d-46ad-9239-c7b2712464d3
✅ Expected Result
User B should not be able to join User A's game while it is in progress.
📜 Logs
Player.zip
Additional Notes:
Windows 11. 12th Gen Intel(R) Core(TM) i7-12650H 2.30 GHz. nvidia geforce RTX
Macbook M1 Pro Sonoma 14.5

We added some changes to the minigames library that improves the queue sync propagation, hopefully it can reduce greatly the appearance of this issue.

There is a new queue system in place that have fixed this issue, I failed to reproduce it with this new system


Minor style tweaks to notebook and style updates to example

Updating some small notebook styles and updating the example to reflect those changes.

Screenshot?

new version:

old version:

@cameronoelsen, @ellisonbg, any objections?

I'm playing "spot the differences", and not winning...
Looks good to me.

The main thing was moving some margins out of the core widget and into theme so that the widget is more embeddable.

Great; thanks!


embree: Fix include order causing unwanted dllexport symbols

Fixes #94178
(Created upstream PR https://github.com/RenderKit/embree/pull/494)

This is now included upstream in Embree v4.3.3

Thanks!


V8.91 won't compile without C++11 on Ubuntu Linux

I want to use the library without C++11 but it won't compile for me:
(Theoretically it should as per documentation @http://easylogging.muflihun.com:
"For lower version of C++ (non-C++11), please consider using Easylogging++ v8.91. ")
error: #error This file requires compiler and library support for the ISO C++ 2011 standard. This support is currently experimental, and must be enabled with the -std=c++11 or -std=gnu++11 compiler options.
File structure:
./Main.cpp
./logger/easylogging++.h
Contents of Main.cpp:
#include "logger/easylogging++.h"
_INITIALIZE_EASYLOGGINGPP
using namespace std;
int main(int argc, char* argv[]) {
LINFO << "This is my first log";
return 0;
}
../src/logger/easylogging++.h: In function ‘std::string easyloggingpp::internal::threading::getCurrentThreadId()’:
../src/logger/easylogging++.h:691:16: error: ‘std::this_thread’ has not been declared
ss << std::this_thread::get_id();

me too


Remove initContainer, add Dockerfile for mongod node+extra tools we g…

Remove initContainer from Pod
Add 'make docker-mongod' and 'make docker-mongod-push' steps
Add 'imagePullPolicy' flag
Add Dockerfile for image of PSMDB node+extra tools we got with wget before

Note: we will ask the PSMDB devs to fix the group-read permission error in MongoDB so that we can remove the need to copy the secret file.
Also, we will eventually move the changes done in the tmp/psmdb/Dockerfile to percona/percona-server-mongodb if possible.

Codecov Report

Merging #36 into master will decrease coverage by 1.33%.
The diff coverage is 94.73%.

@@            Coverage Diff             @@
##           master      #36      +/-   ##
==========================================
- Coverage   59.07%   57.73%   -1.34%
==========================================
  Files           9        9
  Lines         821      795      -26
==========================================
- Hits          485      459      -26
  Misses        300      300
  Partials       36       36

Impacted Files
Coverage Δ

pkg/stub/replset.go
35.24% <0%> (ø)
:arrow_up:

pkg/stub/psmdb.go
95.55% <100%> (-0.04%)
:arrow_down:

pkg/stub/container.go
67.96% <100%> (-3.47%)
:arrow_down:

pkg/stub/secrets.go
100% <100%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1e24c59...ab6b9ee. Read the comment docs.


Download failure - AttributeError: 'NoneType' object has no attribute 'get_quality'

Describe the bug
When trying to download a course from Udemy it fails. This occurs on previously downloaded courses as well as if you clear the previously downloaded course and try to download it from scratch again.
To Reproduce

Run the download (see additional context).
Error occursTraceback (most recent call last):
  File "./udemy-dl/udemy-dl.py", line 607, in <module>
    main()
  File "./udemy-dl/udemy-dl.py", line 591, in main
    skip_hls_stream=args.skip_hls_stream,
  File "./udemy-dl/udemy-dl.py", line 354, in course_download
    quality,
  File "./udemy-dl/udemy-dl.py", line 81, in download_lecture
    lecture = lecture.get_quality(quality)
AttributeError: 'NoneType' object has no attribute 'get_quality'

Expected behavior
Download course video and/or assets correctly with out errors
Screenshots
Example error out put to screen

Python Environment (please complete the following information):

OS Platform: Ubuntu 18.04.5 LTS & Ubuntu 20.04 (both running in Windows 10 WSL2)
Python Version 3.6.9

Additional context
Tried running it in the following combinations
./udemy-dl/udemy-dl.py "$i" -k ./udemy_authcookie.txt --skip-sub -q 1080 -o ../Manuals/udemy
./udemy-dl/udemy-dl.py "$i" -k ./udemy_authcookie.txt --skip-sub -q 1080 -o ../Manuals/udemy --skip-assets
./udemy-dl/udemy-dl.py "$i" -k ./udemy_authcookie.txt --skip-sub -q 1080 -o ../Manuals/udemy --skip-assets --skip-hls

"$i" can be replaced with the following course url's which I have tried and fail.

"https://www.udemy.com/course/70533-azure"
"https://www.udemy.com/course/advanced-css-and-sass"
"https://www.udemy.com/course/angular-advanced-masterclass"

What was the cause?

the lecture type was not video which cause the issue


Use Intent#withExtras extension function

Description

This replaces a few intent.putExtra with the new Intent.withExtras extension function and thereby simplifies the code.

Thank you, unfortunately we currently can't accept unsolicited PRs.

Pull Requests that are not linked to an issue with you as an assignee will be closed, except for minor fixes for typos or grammar mistakes in documentation or code comments.


updated link to Udacity reviewer home page.

Hey @ablacklama
This PR make sense, but i prefer the old link https://review.udacity.com/#!/submissions/dashboard for now.
Thanks :+1:


Try using OpenTK's GameWindow

Avoid our custom form stack.
Things to note:

We need to make sure we can still make angle work.
We need to make sure we can get exclusive full-screen (GLControl likely needs to be derived from Form).
Switch to OpenTK based input handlers and remove the form counterparts (these are already implemented but not used).
Figure a way to handle input for things like TextBoxes.
Figure out what we can do about IME.

Figure out what we can do about IME.

We can just implement it ourselves, which is what we'd probably need to do for the Linux port anyway. I have a friend who implemented his own IME in a tty based on Anthy. A couple of DLLMaps and we can pass in keystrokes and get back UTF-8 suggestions.

I was thinking of having a go at this since I can't stand the current situation on Linux. A few questions though:

Is it alright if angle is added later since it's disabled now anyway (have you seen https://github.com/opentk/opentk/pull/253 by the way)?
Exclusive fullscreen is a Windows thing, right?
Where can one find these implemented opentk input handlers?
What, more exactly, do you mean by the input for textboxes? Aren't the in-game textboxes already just taking input from the normal keyboard input?
IME can't be that important for now, can it?
Is it even worth doing all this if we're planning a monogame switch anyway?

Exclusive fullscreen is not just a windows thing. The important part is that osu! doesn't need to go through a compositor, but rather goes directly to the video buffer.

I think it's definitely fine to ignore angle support when testing things like GameWindow (and making everything else work first), after which we can figure out how to tackle the angle issue.
Exclusive fullscreen and text input is important though.
So going down your list:

yes
no (see @Tom94's answer)
they are already being used in LinuxGameHost.
look at the textbox code, specifically CreateTextInput()
it's of utmost importance.
no one said anything about switching to monogame? we need to examine all possible paths and choose the best.

Alright. Just so we're on the same page here, we want IME's for other languages than Japanese to work too, right?

I think I'm abandoning ship on this one. While I did have a look at it, there is just way too much stuff that relies on the custom implementation, especially Windows only stuff. Since I'm on Linux, I am unable to debug that and I also have to work with MonoDevelop (which is absolutely terrible IMO) which makes navigating the code a pain.  I am looking forward to the future of osu! though!

WIP @ #136