bug: pinpad cancel does nothing on macos

macos 15.1 M1 with Gemalto Ezio Shield.
Cancelling PIN entry (long-pressing yellow C button) will result in the following screen and locked up application. Expect it to cancel gracefully and report it back to the application/website.

Its the Apple CCID driver fault
Secure Verify PIN comand
The most problematic issue is that the Secure Verify PIN command (FEATURE_VERIFY_PIN_DIRECT) using the Apple driver returns:

Secure verify PIN
command: 00 00 82 08 00 08 04 07 01 09 04 00 00 00 00 0D 00 00 00 00 20 00 00 08 30 30 30 30 00 00 00 00
Enter your PIN:
SCardControl: OK
card response [0 bytes]::
The SCardControl() returns SCARD_S_SUCCESS (i.e. no error) but the PIN is not asked by the pinpad reader, and of course not submitted and verified by the card.

This command just silently fails. A pinpad reader can't be used with the Apple CCID driver.

It works without issues when actually entering the PIN. When pressing the cancel button, the "operation failed" dialogue pops up, so it does detect some kind of change/failure. The main issue for me is that pressing cancel in the popping up failure dialogue will not cancel the underlying dialogue with progress bar, that keeps on spinning without a "cancel" button until it reaches zero.
While the macos pcsc-like layer is probably full of annoyances, this seems like a UX issue in web-eid app.

I do have two proprietary drivers installed, as visible from the picture and the list below

1: [ ] [   ] Circle CIR315(1)
2: [*] [VMD] Gemalto Ezio Shield
3BDB960080B1FE451F830012233F536549440F9000F1
https://smartcard-atr.apdu.fr/parse?ATR=3BDB960080B1FE451F830012233F536549440F9000F1
3: [ ] [   ] Circle CIR315(2)
4: [ ] [   ] ACS ACR38U-CCID

Not to mention that it would be lovely to be able to just press ESC (or the missing CANCEL button) on the normal keyboard for the pinpad progresss bar dialogue to cancel the ongoing operation before the timeout...


Fix dark diffuse values

Related to #210
Fix #250
TODO

[x] Comparisons
[x] Ensure check the metalness case, too
[ ] Move weights to consolidate them


[main] Bug 1904307: Update ant plugin CVE-2020-11979

Fix already exists in https://github.com/apache/ant/commit/87ac51d3c22bcf7cfd0dc07cb0bd04a496e0d428
Using latest release of ant plugin as it is using the fixed version of ant

/lgtm

/lgtm

/cherry-pick release-4.6

/cherry-pick release-4.6

ART request: https://issues.redhat.com/browse/ART-2632 and https://issues.redhat.com/browse/ART-2631

ART request: https://issues.redhat.com/browse/ART-2632 and https://issues.redhat.com/browse/ART-2631


[BUG] EGX nightly tests fail to detect Spark version on startup

Recently EGX nightly test have been failing to determine the Spark version with this error:
08:27:37  ++ PYTHONPATH=/home/****/rapids_it-EGX-Yarn/****-3.1.2-bin-hadoop3.2/python:/home/****/rapids_it-EGX-Yarn/****-3.1.2-bin-hadoop3.2/python/lib/py4j-0.10.9-src.zip
08:27:37  ++ python -c 'import py****, re; print(re.sub('\''\.dev0?$'\'', '\'''\'', py****.__version__))'
08:27:37  Traceback (most recent call last):
08:27:37    File "<string>", line 1, in <module>
08:27:37    File "/home/****/rapids_it-EGX-Yarn/****-3.1.2-bin-hadoop3.2/python/py****/__init__.py", line 53, in <module>
08:27:37      from py****.rdd import RDD, RDDBarrier
08:27:37    File "/home/****/rapids_it-EGX-Yarn/****-3.1.2-bin-hadoop3.2/python/py****/rdd.py", line 40, in <module>
08:27:37      from py****.statcounter import StatCounter
08:27:37    File "/home/****/rapids_it-EGX-Yarn/****-3.1.2-bin-hadoop3.2/python/py****/statcounter.py", line 24, in <module>
08:27:37      from numpy import maximum, minimum, sqrt
08:27:37    File "/usr/local/lib/python3.5/dist-packages/numpy/__init__.py", line 142, in <module>
08:27:37      from . import core
08:27:37    File "/usr/local/lib/python3.5/dist-packages/numpy/core/__init__.py", line 24, in <module>
08:27:37      from . import multiarray
08:27:37    File "/usr/local/lib/python3.5/dist-packages/numpy/core/multiarray.py", line 14, in <module>
08:27:37      from . import overrides
08:27:37    File "/usr/local/lib/python3.5/dist-packages/numpy/core/overrides.py", line 69, in <module>
08:27:37      ArgSpec = collections.namedtuple('ArgSpec', 'args varargs keywords defaults')
08:27:37    File "/home/****/rapids_it-EGX-Yarn/****-3.1.2-bin-hadoop3.2/python/py****/serializers.py", line 390, in namedtuple
08:27:37      for k, v in _old_namedtuple_kwdefaults.items():
08:27:37  AttributeError: 'NoneType' object has no attribute 'items'
08:27:37  Error in sys.excepthook:
08:27:37  Traceback (most recent call last):
08:27:37    File "/usr/lib/python3/dist-packages/apport_python_hook.py", line 63, in apport_excepthook
08:27:37      from apport.fileutils import likely_packaged, get_recent_crashes
08:27:37    File "/usr/lib/python3/dist-packages/apport/__init__.py", line 5, in <module>
08:27:37      from apport.report import Report
08:27:37    File "/usr/lib/python3/dist-packages/apport/report.py", line 21, in <module>
08:27:37      from urllib.request import urlopen
08:27:37    File "/usr/lib/python3.5/urllib/request.py", line 88, in <module>
08:27:37      import http.client
08:27:37    File "/usr/lib/python3.5/http/client.py", line 1262, in <module>
08:27:37      import ssl
08:27:37    File "/usr/lib/python3.5/ssl.py", line 308, in <module>
08:27:37      "cafile capath openssl_cafile_env openssl_cafile openssl_capath_env "
08:27:37    File "/home/****/rapids_it-EGX-Yarn/****-3.1.2-bin-hadoop3.2/python/py****/serializers.py", line 390, in namedtuple
08:27:37      for k, v in _old_namedtuple_kwdefaults.items():
08:27:37  AttributeError: 'NoneType' object has no attribute 'items'
08:27:37
08:27:37  Original exception was:
08:27:37  Traceback (most recent call last):
08:27:37    File "<string>", line 1, in <module>
08:27:37    File "/home/****/rapids_it-EGX-Yarn/****-3.1.2-bin-hadoop3.2/python/py****/__init__.py", line 53, in <module>
08:27:37      from py****.rdd import RDD, RDDBarrier
08:27:37    File "/home/****/rapids_it-EGX-Yarn/****-3.1.2-bin-hadoop3.2/python/py****/rdd.py", line 40, in <module>
08:27:37      from py****.statcounter import StatCounter
08:27:37    File "/home/****/rapids_it-EGX-Yarn/****-3.1.2-bin-hadoop3.2/python/py****/statcounter.py", line 24, in <module>
08:27:37      from numpy import maximum, minimum, sqrt
08:27:37    File "/usr/local/lib/python3.5/dist-packages/numpy/__init__.py", line 142, in <module>
08:27:37      from . import core
08:27:37    File "/usr/local/lib/python3.5/dist-packages/numpy/core/__init__.py", line 24, in <module>
08:27:37      from . import multiarray
08:27:37    File "/usr/local/lib/python3.5/dist-packages/numpy/core/multiarray.py", line 14, in <module>
08:27:37      from . import overrides
08:27:37    File "/usr/local/lib/python3.5/dist-packages/numpy/core/overrides.py", line 69, in <module>
08:27:37      ArgSpec = collections.namedtuple('ArgSpec', 'args varargs keywords defaults')
08:27:37    File "/home/****/rapids_it-EGX-Yarn/****-3.1.2-bin-hadoop3.2/python/py****/serializers.py", line 390, in namedtuple
08:27:37      for k, v in _old_namedtuple_kwdefaults.items():
08:27:37  AttributeError: 'NoneType' object has no attribute 'items'
08:27:37  + VERSION_STRING=
08:29:43  + '[' 1 '!=' 0 ']'
08:29:43  + exit 1

Spark-3.x requires python3.6+,
Someone changed the python3.6 bin pointing to 3.5 on EGX-03 yarn, yuk.
Let me fix it again.
Looks like some one was testing on EGX3 host, and changed the python env
A week ago someone changed the default python from 3.6 to 2.7, causing the nightly CI failure. I just fixed it. Now he soft-linked 3.6 to 3.5
lrwxrwxrwx 1 root root       7 Jul  5 06:02 /usr/bin/python3.6 -> python3*

lrwxrwxrwx 1 root root      18 Aug 23  2022 /usr/bin/python3 -> /usr/bin/python3.5*


bypass hcaptcha?

Hi is there a way to bypass the hcaptcha?

Hi there I dont have time back to this project yet.
But here are some directions on how to avoid  the hcaptcha being triggered.
https://stackoverflow.com/questions/55501524/how-does-recaptcha-3-know-im-using-selenium-chromedriver
But even you found a way to bypass it, they can change the algorithm and update the site again immediately.


Allow for up- / download limitation of torrent

As I see it, vigilio uses qbittorrent as a torrent backend. It would be nice if we could pass in up/download rate limitation.

Thank you for your suggestion.
Yes, it is using qbittorrent. Qbittorrent is available at http://localhost:8080 with the docker installation. There you can set any limit and change any other options as you see fit. Would this be enough for your needs or is there any other reason you think adding this feature baked into vigilio beneficial?


Fix PSSA Issues in MSFT_xExchDatabaseAvailabilityGroupNetwork (Fixes #67)

Fixing the PSSA Issues in MSFT_xExchDatabaseAvailabilityGroupNetwork.
This fixes #67.
Running Invoke-ScriptAnalyzer with the following rules excluded no longer has any output:
PSUseShouldProcessForStateChangingFunctions
PSDSCDscTestsPresent
PSDSCDscExamplesPresent
These rules have been approved to be ignored.

This change is

Hi @kwirkykat, I'm your friendly neighborhood Microsoft Pull Request Bot (You can call me MSBOT). Thanks for your contribution!

It looks like you're a Microsoft contributor (Katie Keim). If you're full-time, we DON'T require a Contribution License Agreement. If you are a vendor, please DO sign the electronic Contribution License Agreement. It will take 2 minutes and there's no faxing! https://cla.microsoft.com.

TTYL, MSBOT;

Looks good to me.


v1 fails with "ssh: Could not resolve hostname netbsd: nodename nor servname provided, or not known"

If you are migrating from the previous v0, please change the runs-on:  to runs-on: ubuntu-latest

This seems to work with one minor diff: pkg_add seems to be no longer in PATH.


sphinx documentation

One thing that would be really nice to have if you're using sphinx is man pages for voctocore and voctogui. sphinx even makes it easy to embed them in the regular HTML documentation.


samv7: channel gain switching in aefc

Summary
via ioctl one can make use of the samv7's afec internal gain amplifiers
Impact
none
Testing
on custom board with current 0.000 ... 50 Amps, dynamic gain selection implemented

please squash your change, @SimonFilgis


New Logo Design For Pigim

Hi @reiterj1 @JacobMinneman  , you have a good project. But on the logo, there are some disadvantages. That's why I want to contribute by making a new logo for this project. What do you think?

Thank you for the offer but we will reject. Thank you.

Okay.


Improve Veeam Plugin logs

Description
This PR intends to improve logs in Veeam Backup Plugin, to help troubleshooting. Also, I removed some duplicated code.
Types of changes

[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] New feature (non-breaking change which adds functionality)
[ ] Bug fix (non-breaking change which fixes an issue)
[x] Enhancement (improves an existing feature and functionality)
[ ] Cleanup (Code refactoring and cleanup, that may add test cases)

Feature/Enhancement Scale or Bug Severity
Feature/Enhancement Scale

[ ] Major
[x] Minor

How Has This Been Tested?

I maked a new build with this alterations and test in a local lab;
I run some tests, like import a backup offering, assign VM to backup offering, try listing backups, etc;
And I readed the logs to verify if the new informations appears.

@SadiJr was this tested against Veeam 9.x?

@SadiJr can you address the comments and advise if you've tested this against Veeam 9.x?

@blueorangutan package

Packaging result: :heavy_check_mark: el7 :heavy_multiplication_x: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 1362

@blueorangutan package

@nvazquez a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Agree with @DaanHoogland's comment to trust on @SadiJr's tests

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 1367

@blueorangutan test

@nvazquez a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Trillian test result (tid-2172)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 33996 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5455-t2172-kvm-centos7.zip
Smoke tests completed. 89 look OK, 0 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File

@rhtyd @DaanHoogland this looks ready to merge, however, I am concerned about the Veeam version 9.x which is not tested and was previously supported

I checked the code and I think it should work on Veeam 9.x as well, the change introduces using a powershell utility to format the list than introduce change in veeam cmds themselves. Merging this based on review, smoketests and @SadiJr 's confirmation of some manual tests against Veeam.


Flutter, How to handle the scroll of PDF Viewer when the parent has a long height with scroll?

I have a column include several widgets. This column is the parent and its children cause the column has scroll. On the other hand I used PDF View Plugin and its PdfVeiwer widget inside the column.
But I have a problem. If both of the PdfVeiwer and the Column widgets have scroll. I can not scroll the PDF pages and just the Column can scroll!
How should I solve this problem?
SingleChildScrollView(
  child: Column(
	children: <Widget>[
	  ExpandablePanel(
		hasIcon: false,
		header: Container(
		  height: 50.0,
		  child: Row(
			mainAxisAlignment: MainAxisAlignment.spaceBetween,
			children: <Widget>[
			  Icon(Icons.keyboard_arrow_down),
			  Text('Title'),
			],
		  ),
		),
		expanded: Container(
			padding: EdgeInsets.all(8.0),
			child: SizedBox(
			  height: 500.0,
			  child: PdfViewer(filePath: path),
			)),
	  ),

      //My Other widgets are here

	],
  ),
);

Why this issue is still open?

This will help https://www.youtube.com/watch?v=gAUVz0U7eyA


Error while trying to train multiple models for TSP of size 20 and 50.

Describe the bug
I used the quickstart example to train TSP of size 20 in a conda environment on a gpu connected via SSH in VS code Jupyter notebook. But when I am trying to train a new TSP model of size 50 in the same  folder from scratch and trying to load the render the dataset , I am still getting dataset of size 20 instead of 50. The model trains fine but even the below lines seem to only generate Dataset of size 20 instead of 50:
env = TSPEnv( num_loc = 50)
new_dataset = env.dataset(10000)
dataloader = model._dataloader(new_dataset, batch_size=100)
print(new_dataset[0]["locs"].shape)
Output:
Unused keyword arguments: num_loc. Please check the documentation for the correct keyword arguments
torch.Size([20, 2])
I tried running a new jupyter notebook of size 50 in a new folder but the problem still persists. Can you please helop me identify the issue?

The reason is that we changed the API: now we have a separate Generator class that handles the data generation. So you may call it like this:
env = TSPEnv(generator_params={'num_loc': 50})

(example here)

Yes. You could set the trining with multi GPUs by editing the parameter trainer.devices.
For example, if you want to try the example experiment in the README (AM on TSP) with multiple GPUs, you can launch the training with
python run.py +trainer.devices="[0, 1]"

This training will use coda:0 and coda:1. And you can set it to more devices if you want.
Here are some useful materials you may want to refer to:

RL4CO trainer tutorial.
Hydra config tutorial.

Do you guys plan on including MCTS in the list of decoding strategies in the near future?

@ujjwaldasari10 We are not planning to in the near future since MCTS has not been applied much in the NCO literature, such as routing and scheduling. I remember some work that did, but other methods outperformed it without MCTS.
I think that is an interesting direction, and we gladly accept contributions! If you are interested, I invite you to give it a shot :)
What kind of problem would you like to use it for?

Note: closing issue now, @ujjwaldasari10 about MCTS, if you are interested feel free to open a new discussion here or contact us on Slack :rocket:


Use quarto-cli 1.2 (now RC)

The linter error is for the quarto extension and is installed code, so ignore it and merge.


can raspberry3 use create_ap wlan0 wlan0 apname passwd

Hi,everyone
I tried to use my pi3 to create ap use the wlan0 both link to my router and then send it to my phone
I don't know much about this,so I try the one close to my wish
‘’’
Internet sharing from the same WiFi interface:
create_ap wlan0 wlan0 WorldofWarcraft mypasswd
‘’‘
and the problem is it doesn't work well,I get an MyAccessPoint without password,and I can link to it ,but can't link to internet.
So,can pi3 can do the 'wlan0 wlan0 ' thing ,or I can only use eth0 to the router and wlan0 to be only ap?
If so how can I delete the ap I already created,I just find the command to stop it,(by the way,I use vnc to the pi3 ,if you stop the wlan0,you will lose the connection, and had to use the screen to restart wifi)
I read all the issues before,didn't find the problem,help please

No pi3 can not support AP and client on same interface.
try:
create_ap wlan0 eth0 WorldofWarcraft mypasswd --no-virt

Thank you,macmpi,I see now


[auto-bump] dependency by JCOR11599

:coffee: An Automated Dependency Version Bump PR :crown:
Initial Changes
The initial changes contained in this PR were produced by `go get`ing the dependency.
```
$ cd ./go
$ go get github.com/dolthub//go@
$ go mod tidy
```
Before Merging
This PR must have passing CI and a review before merging.
After Merging
An automatic PR will be opened against the LD repo that bumps the bounties version there.

This PR has been superseded by https://github.com/dolthub/bounties/pull/2249

This PR has been superseded by https://github.com/dolthub/bounties/pull/2250


[MXNET-543][WIP]Scala Spark test

Description
This PR is a bug fixes on the Spark Example for Scala. We need to ensure there are enough amount of tests. Here is the plan for the release:

Fix the Ubuntu GPU problem
Fix the Ubuntu CPU problem
Fix the Mac problem (USE_DIST_KVSTORE=1)

@nswamy @yzhliu @CodingCat @marcoabreu @andrewfayres
Checklist
Essentials
Please feel free to remove inapplicable items for your PR.

[x] The PR title starts with [MXNET-$JIRA_ID], where $JIRA_ID refers to the relevant JIRA issue created (except PRs with tiny changes)
[ ] Changes are complete (i.e. I finished coding on this PR)
[x] All changes have test coverage:
Unit tests are added for small changes to verify correctness (e.g. adding a new operator)
Nightly tests are added for complicated/long-running ones (e.g. changing distributed kvstore)
Build tests will be added for build configuration changes (e.g. adding a new build option with NCCL)
[ ] Code is well-documented:
For user-facing API changes, API doc string has been updated.
For new C++ functions in header files, their functionalities and arguments are documented.
For new examples, README.md is added to explain the what the example does, the source of the dataset, expected performance on test set and reference to the original paper if applicable
Check the API doc at http://mxnet-ci-doc.s3-accelerate.dualstack.amazonaws.com/PR-$PR_ID/$BUILD_ID/index.html
[x] To the my best knowledge, examples are either not affected by this change, or have been fixed to be compatible with this change

Closing this PR until we have a proper fix that works across platforms


Use layerConfig in useCartoLayerProps

This feature was a proposal by @borja-munoz, so it's already approved by him.
Now you can optionally pass layerConfig object to useCartoLayerProps to automatically get id, visible and opacity props.
By default visible is true and opacity is 1.
Example:
const layerConfig = {
  title: 'Store types',
  visible: true,
  showOpacityControl: true,
  opacity: 0.4,
  legend: {
    ...
  },
};

function StoresLayer() {
  const { storesLayer } = useSelector((state) => state.carto.layers);
  const source = useSelector((state) => selectSourceById(state, storesLayer?.source));
  const cartoLayerProps = useCartoLayerProps({ source, layerConfig: storesLayer });

  ...
}

cartoLayerProps contains:
...
id: 'storesLayer',
visible: true,
opacity: 0.4
...

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.04%) to 70.402%

Totals

Change from base Build<PHONE_NUMBER>:
0.04%

Covered Lines:
1221

Relevant Lines:
1635

💛  - Coveralls


Weird issue when loading more tableview cells

Hi
Thanks for your awesome component !
I'm facing an issue when using your component with a refresh/load more component available here:
https://github.com/OpenFibers/DragRefreshAndLoadMoreTableDemo
Basically, everything works as expected until I trigger a load more cells by scrolling down the table view.
You can see the issue in this video :
https://dl.dropboxusercontent.com/u/7821793/shynavBarIssue.mov
from 0 to 35sec all is working fine
At sec 36 I trigger a load more cells
After the table has loaded more cells, you can see the shynavBar weird issue when scrolling down the table.
Do you have an idea about this problem ?
I'm using default expansionResistance/contractionResistance
Thanks again for this nice job you have done !
Jerome

I am facing similar issue. The link to video is not working.

I think I experienced the same issue.  After I loaded additional cells to a tableView the shynavBar would appear.  This might not be the right forum for a workaround, but this was the only place where I've seen the issue mentioned.
What I did to fix it is in your code where you add additional cells to the tableView, disable shynavBar and then enable is 1.5 seconds later.  This issue only started happening for with Xcode 8 and iOS 10.
`
self.shyNavBarManager.disable = YES;
        [NSTimer scheduledTimerWithTimeInterval:1.5 target:self selector:@selector(enableShyNav) userInfo: nil repeats:NO];`


Use PHP Variables in Markdown

Hey,
I use Parsedown for my Imprint and Privacy Policy so my lawyer can read it and I have to specify some sources from my database. These documents are in one file. How can I insert them? Maybe something like this could be a nice to have feature. At least I found no documentation 🤷🏻♂
<?php
      $current_date = date("Y-m-d");
      $Parsedown = new Parsedown();
      $Parsedown->setVariables(array(
           'current_date' => $current_date
      ));
      echo $Parsedown->text("Today is: {current_date}");
    ?>

<!-- output -->
Today is: 2020-12-15

Using plain str_replace() to convert variable after convert:
$text = $Parsedown->text('Today is: {current_date}');

$vars = [
    'current_date' => date('Y-m-d'),
    'client' => 'Tom',
    // ...
];

foreach ($vars as $var => $value) {
    $text = str_replace('{' . $var . '}', $value, $text);
}

echo $text;

This would make sense yes, right now I'm doing it this way but I wish there was something like this as a feature in Markdown


Add UI for directory creation

See #161.
https://user-images.githubusercontent.com/17034772/124270650-c7b54b00-db3c-11eb-9be7-19289a5debb3.mp4

To confirm, we can press enter to submit and escape to cancel, right?

Correct, blur works as escape too!


cargo crate registry error: 'SDL' linked with two different versions.

The whole message is (rust stable 1.5):
native library `SDL2` is being linked to by more than one package, and can only be linked to by one package

  sdl2-sys v0.7.0
  sdl2-sys v0.6.2

or (rust nightly 1.7):
native library `SDL2` is being linked to by more than one version of the same package, but it can only be linked once; try updating or pinning your dependencies to ensure that this package only shows up once

  sdl2-sys v0.7.0
  sdl2-sys v0.6.2

This can be reproduced by removing .cargo and rerunning cargo build on clean git tree. Then, the registry is updated, the crates are downloaded and then the message appears.

Huh, can reproduce. Looking into it now.

Created PR to fix. sdl2_ttf and sdl2 were bringing in different versions of sdl2-sys. Not sure how that happened despite the existence of a Cargo.lock file, but nevermind. I'll merge that once tests pass.

Hey @edward-san, thanks a lot for the issue! I think #78 should have fixed it, could you please try on your end and see if it's fixed?

I just tried it before and after the commit. Works for me.

It's fixed. Thanks!

Looks like this is happening again. What can be done to keep the repos in sync?


Add a Page class

Add a Page class for storing Page metadata and outputting to file.

Add a tags Hash of XPaths and Procs, which convert nodes in the page to arbitrary YAML tags which are added to the YAML front-matter.

Add an API for adding given XPaths and YAML front-matter keys for extracting arbitrary data from the HTML pages.


Add custom events callback for json

This reimplements custom events support for json. Needs tests.

Can confirm this works. Added another run for the same trace test to cover the json format.


Fixed a bug with disappearing whitespace before "inline" plugins

We were setting the cms-plugin tag as a nonEditable but that's not
really needed since the widgets are non-editable anyway. What it did was
setting "isBlockLike" property on ckeditor html parser elements, which
in turn trimmed whitespace on the right of any text node preceding this
cms-plugin while it was parsing, which would result in e.g. links sticking to the text
before them.
Ref: https://github.com/ckeditor/ckeditor-dev/blob/12f0de314fd6fbee0bc4d35d541123d283fdecc9/core/htmlparser/fragment.js#L484

Coverage remained the same at 81.579% when pulling 1b0ab48d1c21ab141fb8ea8178685118d47bfbba on vxsx:bugfix/disappearing-whitespace into 83c13163a52db88d594e7d69e055c808d521e511 on divio:master.

this is huuuuge ;D 👍


Small fixes. See details.

Fix small indenting issue in the readme. Added link to contributor profile.

Thanks!


adam optimizer does not work with FP16

Hi,
I noticed some weird behaviour when training a sequential model using FP16, mse as loss function and adam as optimizer; the loss can't be calculated and I get an output similar to:
Epoch 1/10
1381/1381 [==============================] - 1033s 748ms/step - loss: nan

There is no issue when using FP32, or changing the optimizer with FP16 (I tried both adamax and sgd). Am I missing something or is there something wrong with the implementation of adam?
It is worth noting that I'm using an RTX 2080 which does support FP16.

[ * ] Check that you are up-to-date with the master branch of Keras. You can update with:
pip install git+git://github.com/keras-team/keras.git --upgrade --no-deps

done

[ * ] Check that your version of TensorFlow is up-to-date. The installation instructions can be found here.

done

[ * ] Provide a link to a GitHub Gist of a Python script that can reproduce your issue (or just copy the script here if it is short).

gist link with code snippet here
link for the original full code (before adding FP16) here

Not all operations work correctly with FP16. This is nothing we can do about. Half the running time doesn't come for free. See http://on-demand.gputechconf.com/gtc/2017/presentation/s7218-training-with-mixed-precision-boris-ginsburg.pdf for example

I thought I should include the solution I found here and close the issue
my specific problem was due to the default epsilon value of 1e-7 beeing too small for FP16 and leading to nan values, changing it with K.set_epsilon(1e-4) solves the problem. Well, at least for mse, msle, and mae metrics, mape and cosine still give inf and nan respectively.


Cannot see images created using Azure Portal via list_os_images()

Steps:

Create Linux VM using Azure web portal
Run sudo waagent -deprovision
Shutdown vm
Capture role (using Azure web portal)
Verify if the image is present in Virtual Machine->Images
Use python sdk
sms = ServiceManagementService('account-id','path to pem file')
images = [i for i in sms.list_os_images() if i.category=='User']
for i in images: print i.name

I dont see the captured VM image in the list. However, I can see it via the xplat-cli.
Also I can only see images which dont have the Source field populated.

Hi,
I have one image in my account which i created last week and above method gives me the result as below. It may not be problem with SDK.
If you see the last line of result. It has mine
mycentos|||---|||----User
for osimage in result:
print len(result);
print osimage.name+"|||"+osimage.publisher_name+"---|||----"+osimage.category;
489
........
ad072bd3082149369c449ba5832401ae__Windows-Server-Remote-Desktop-Session-Host-on-Windows-Server-2012-R2-20140403-2126|||Microsoft Windows Server Remote Desktop Group---|||----Public
9b7cfe55da0349d5a8316a8cc4741f87__Internal-StorSimple-VirtualAppliance-1100-20141230|||Microsoft Hybrid Cloud Storage Group---|||----Public
9b7cfe55da0349d5a8316a8cc4741f87__Internal-StorSimple-VirtualAppliance-1100-201412312|||Microsoft Hybrid Cloud Storage Group---|||----Public
mycentos|||---|||----User
Check if there is something you are missing while creating it in portal

Try creating a new virtual machine from gallery and check if the image you have created is listed in portal.
It would be visible in the first step "Choose an Image". Click on MY Images in left nav and you should see that image

Try list_vm_images instead, what you are getting out of a capture on the portal is most likely a vm image, not an os image.  That's pretty confusing, but vm images is a newer concept that replaces os images.  os images were restricted to a single disk, where vm images can be multiple disks.

Please reopen if you still need help.


Add Google Translate Feature

Describe your suggested feature
Should work at Lnreader ?
Other details
No response
Acknowledgements

[X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open or closed issue.
[X] I have written a short but informative title.
[X] If this is an issue with a source, I should be opening an issue in the sources repository.
[X] I have updated the app to version 2.0.0.
[X] I will fill out all of the requested information in this form.

Duplicate of #1254


'vapor build' unable to link dependencies

It's nothing much, but might be useful for beginners who want to try server-side swift
Log :
vapor build
warning: refname '0.1.1' is ambiguous.
warning: refname '0.1.1' is ambiguous.
Resolved version: 0.1.1
warning: refname '0.4.0' is ambiguous.
warning: refname '0.4.0' is ambiguous.
Resolved version: 0.4.0
error: The dependency graph could not be satisfied (https://github.com/qutheory/vapor.git)
Works when .Package line changed to minor: 4 :
Resolved version: 0.4.0
Resolved version: 0.6.1

Thanks!


Handle invalid wind direction in recent observations

https://opendata.dwd.de/climate_environment/CDC/observations_germany/climate/hourly/wind/historical/stundenwerte_FF_00126_19791101_20101130_hist.zip shows a wind direction of 990 for 2010-01-05 00:00.
I'm reluctant to simply ignore these with a warning as I'd rather have our system crash early and loudly for the case that we introduce parsing errors.
We could allow defining a list of explicitly ignored values (i.e. (file_url, timestamp, element)), but where would we store it?

Specifically ignoring "990" seems safe enough for now.
Alternative, abandoned approach: https://github.com/na-boa/brightsky/tree/ignored-values-file


Send to paynym from the send box, No need for menu.

In the same way we can send directly to another open wallet we should be able to select a paynym to send to directly from the dropdown on "Pay to"

What happens if I follow more than 10 PayNyms? How would it looks like? ATM I follow more than 200, actually.
Anyway, you could paste the PM8TJ code or the +PayNym handle and it send it directly to the PayNym by BIP47.

What happens if I follow more than 10 PayNyms?

This is how Electrum handle very large contact list.

200 must be very rare, I didn't know there was even 200 people using Paynym.
It's also above the Dunbar's number https://en.wikipedia.org/wiki/Dunbar's_number

It's indeed large number, but it's only because I participate in Make Every Spend a Coinjoin whenever any random user need collaborator.
Might be a nice to have some favorites contacts to be added there, if used frequently.

I would imagine the list of PayNyms that a wallet is linked to (as opposed to just following) is probably quite a bit lower, so it might be practical to add 8-10 linked PayNyms to the dropdown. Unfortunately there is no simple way to determine favourites.


Thanks

Thanks for releasing.
Was looking for it just yesterday! ^_^
Regarding code size, is it possible to apply tree-shaking?

Hey @vshymanskyy,
happy to hear that :). Good question re tree-shaking – I believe that tree-shaking (coming from JS world) is essentially the same as what --gc-section does. --gc-section is a linker's flag which makes the linker remove all sections unreachable from the executable's entry point (well, simply said). Unfortunately, Swift's executable contains sections with runtime metadata, which ties everything up, and the linker can't remove much then.
If you want to read more about it, feel free to checkout section 2.5 in my thesis. That section is dedicated to code-size reduction and specifically section 2.5.6 is dedicated to using --gc-sections 🙂.

Also thanks from my side :)
Having support for Teensy 4.0 in the future would be great as Teensy is next to Arduino (where I can't find a board with 2048KiB min.) one of the most used embedded boards.

A small update re Teensy 4.0: Inspired by your comment @flocked, I've ordered Teensy 4.0 as I believed that it would be quite easy to add support for it. However, I just found out that the board does not provide any access to a debug interface (JTAG/SWD). I am a bit disappointed, the board looks great otherwise, but considering it offers 2 MB of FLASH (so it can fit quite a complex program), but has no real way to debug such a program? 🤨 I am not feeling adventurous enough to start using this board, as I can't imagine that if there would be any toolchain-related bug and I would have to debug it using print() statements and blinking the LEDs 🙈. I hope the next Teensy board will provide the interface.
On the other side, I'm expecting to receive Pyboard D-series (STM32F767) any day now. It features 4 MB of FLASH, WiFi+BT and more! 👀

I have read your thesis with great pleasure. It is very well written end explains all the details of your process very well. We are currently working on a project opensforyou.com and where using particle.io for this until they decided to stop supporting mesh. I then decided that I would use my knowledge about swift and build the product in swift. Your project is a super starting point for this  and I am looking forward to the support for the STM32F767 and would like to help too. I can offer help in 3 ways.

I have a engineering background but not in software. I would like to learn and work on getting support for the STM32F767 as it would be a good fit. But I lack some knowlegde that I hope to make up for with trial and error
I have some experience with swift as a cli tool. Would you be interested in that I port the tooling for setup to be ran from a swift command line tool? I believe for beginners that lack the knowledge of python it might be less discouraging if everything is in swift?
my company would like to sponsor your project. Maybe the easiest would be if you apply like we did with dooZdev for https://github.com/sponsors so we could sponser this project. I'm not promising big sums, but that might just be the beginning :)


arpack eigendecomposition and dense eigendecomposition gave different eigenvalues

I am using the isomap.
I tried arpack eigendecomposition and it gave the two largest eigenvlues of a shortest distance matrix as
-7.12559e+06 4.72011e+06
But when I tried the dense eigendecomposition, it gave the two largest eigenvlues of the same shortest distance matrix as
3.62429e+06 4.72011e+06
By the way, I have symmetrized the neighbors (see issue https://github.com/lisitsyn/tapkee/issues/30) and have checked the input matrix of eigendecomposition is symmetric.
arpack eigendecomposition and dense eigendecomposition agree on the second eigenvalue but not on the first one in this case.
In the embedIsomap() function, there is such code block
for (IndexType i=0; i < static_cast(p_target_dimension); i++)
embedding.first.col(i).array() *= sqrt(embedding.second(i));
arpack eigendecomposition gave a negative eigenvalue and  it did not work to call sqrt() here in this case
I tried to increase the ncv from current 20 to 100 in arpack_wrapper.hpp but it did not work and still gave the two eigenvalues -7.12559e+06 4.72011e+06
By the way, the input symmetric matrix is 5000 by 5000
Appreciate very much for any idea on the arpack eigendecomposition issue in my this case.

By the way, the input symmetric matrix is 5000 by 5000

@coderlevi thanks for this investigation :)
This big negative eigenvalue sounds weird and must be due to some issue with arpack or tapkee's interface to arpack. Could you please output the matrix somewhere and then check (with some other code, python, matlab  etc) what are the eigenvalues?

There is no issue with the arpack eigendecomposition. I output the matrix of 5000 by 5000 and use octave eigs() to solve the matrix. I got the same eigenvalues as using tapkee arpack eigendecomposition. octave got the two largest magnitude eigenvalues as -7.12559e+06 4.72011e+06 as well.
This is good. Our tapkee arpack eigendecomposition is working pretty well.
The issue is that we may not use arpack eigendecomposition correctly in isomap.
Currently tapkee is setting ARPACK_CODE = "LM" when using arpack eigendecomposition. I think we should set ARPACK_CODE = "LA"
dense eigendecomposition will sort the eigenvalues in increasing order and when using dense eigendecomposition isomap just uses the largest two eigenvalues (which are largest algebraic not largest magnitude).
Also I found this paper on isomap : http://wearables.cc.gatech.edu/paper_of_week/isomap.pdf
In the Table 1 of this paper, the step 3 says : Let \lambda_p be the p-th eigenvalue (in decreasing order) and v_p be the p-the eigenvector. Then set the p-th vector y equal to \squar_root(\lambda_p)v_p
From this we can see that isomap is not using the largest magnitude eigenvalues but using the largest algebraic eigenvalues.
So in the tapkee we should set ARPACK_CODE = "LA" instead of "LM"
When I set ARPACK_CODE = "LA", I got the same answer using arpack eigendecomposition as using dense eigendecomposition, which was awesome!

@coderlevi awesome research, thanks for that! I'd need to check what implications it would have to set it to LA. IIRC it affects only Isomap and MDS.

Closing as we now use @coderlevi solution to employ 'LA' option.


can't subtract offset-naive and offset-aware datetimes

We are generating Dependent tasks dynamically based on datetime instance.
However, after upgrading 2.5.0, following error has appeared and it can not be executed:
Traceback (most recent call last):
  File "~/workspace/sandbox/luigi/venv/local/lib/python2.7/site-packages/luigi/worker.py", line 305, in check_complete
    is_complete = task.complete()
  File "~/workspace/sandbox/luigi/venv/local/lib/python2.7/site-packages/luigi/task.py", line 744, in complete
    return all(r.complete() for r in flatten(self.requires()))
  File "hourly_task.py", line 10, in requires
    return HourlyTask(date_hour=date_hour, text=self.text)
  File "~/workspace/sandbox/luigi/venv/local/lib/python2.7/site-packages/luigi/task_register.py", line 88, in __call__
    param_values = cls.get_param_values(params, args, kwargs)
  File "~/workspace/sandbox/luigi/venv/local/lib/python2.7/site-packages/luigi/task.py", line 354, in get_param_values
    result[param_name] = params_dict[param_name].normalize(arg)
  File "~/workspace/sandbox/luigi/venv/local/lib/python2.7/site-packages/luigi/parameter.py", line 490, in normalize
    delta = (dt - self.start).total_seconds()
TypeError: can't subtract offset-naive and offset-aware datetimes

Reproducible code is as follows:
import luigi
import dateutil.parser

class Invoke(luigi.WrapperTask):
    text = luigi.Parameter()

    def requires(self):
        date_hour = dateutil.parser.parse('2017-01-01T10:00+09:00') # offset-aware instance causes this error
        return HourlyTask(date_hour=date_hour, text=self.text)

class HourlyTask(luigi.Task):
    date_hour = luigi.DateHourParameter()
    text = luigi.Parameter()

    def run(self):
        with self.output().open('w') as output:
                print self.text
                output.write(self.text)

    def output(self):
        return luigi.LocalTarget(path='/tmp/hourly_task_{}.txt'.format(self.date.strftime('%Y%m%d')))

if __name__ == '__main__':
    luigi.run()

Actually, it seems like https://github.com/spotify/luigi/commit/f9562627a8142560b170c6f9d01f8237cac8fa63 causes this error.

Nice catch. Would love it if you can put together a fix for it, ideally with a unit test!

@erikbern
changing _UNIX_EPOCH[1] to following code does work.
_UNIX_EPOCH = datetime.datetime.utcfromtimestamp(0).replace(tzinfo=pytz.utc)

However, in that way, users need to define all of the datatime instance as offset-aware, so it is not good enough. Possible solution is...

fallback to UTC(or local timezone) if the datetime instance is offset-naive
provide new config for timezone, default UTC
or else...

what do you think? any ideas?

@cynipe, thanks for this issue! What version did you upgrade from? :)
I'm not sure if it's a good thing or bad thing that it started to crash. I think we shouldn't add any "fix" to luigi here. I rather have users stumble upon this problem and be forced to think how they want an offset-aware datetime to be converted to an offset-naive datetime. Having a "default" behavior in luigi sounds dangerous.

@Tarrasch we use 2.0.1, so it's bit old one. Actually https://github.com/spotify/luigi/commit/f9562627a8142560b170c6f9d01f8237cac8fa63 is released in 2.1.0, so to me, it is wonder that no issues filed. no one faced this issue before? no offense, just wondering :)

I think we shouldn't add any "fix" to luigi here.

Is your "any" includes fixing _UNIX_EPOCH to offset-aware instance?
IMHO, It seems more uncomfortable to "remove" the offset information.

My reasoning is something along the lines that it's not clear what the hour of 2017-01-01T10:00+09:00 is, nor if it's equal to 2017-01-01T11:00+08:00 or not. Hence in scheduling applications I think I would most often want a time-value without timezone awareness. Most users probably do something like described in the docs here.
On the other hand, it should be just a datetime value without any magic around it. Do you know why luigi can't just accept both offset-aware and offset-naive datetimes? I mean currently it crashes on offset-aware, and with your _UNIX_EPOCH fix it will crash on offset-naive you say?


Added functionality to create new branch if target doesnt exist

I inserted the correct commands into, where I think, should be the correct place.
I was not able to test it, as I currently still havent set up docker on my computer, but if my experience and understand is right, this should work. Only thing I am not entirely sure about is the handling of failures. It might be possible to differentiate between a complete failure to clone from target and a failure due to the branch not existing.

Fixed a missing quotation mark, and noticed there is no need to exit if cloning fails, as that is handled already.

I think we're good to go.


Upgrade kubebuilder to 1.0.3.

/sig multicluster
/cc @font @madhusudancs @perotinus @pmorie

/lgtm

/ok-to-test

/retest

@gyliu513 can you separate generated code from non-generated code into distinct commits?

@font all of the code are generated automatically via kubebuilder 1.0.3 by following steps at https://github.com/kubernetes/cluster-registry/blob/master/docs/development.md#updating-generated-codedocs , and I just update this PR by separating the fix for gofmt which was not automatically generated by kubebuilder, hope it is OK.

/test pull-cluster-registry-verify-gosrc

@gyliu513 Can you check the failed job?

/retest

Ping @font for a /lgtm label


globalnetworkpolicy with networkpolicy not allowing expected traffic

Note: This issue is with master builds
With two namespaces, nsa and nsb, and an nginx pod deployed to both and exposed as a service and the following policies applied, I was not able to run an 'access' pod in nsa that could access the nginx service in the nsa namespace.  The DNS traffic is dropped on the host with the DNS pod, hitting the DROP rule for traffic that does not match a policy.
Since there is no policy that selects the dns pod with type Ingress I do not expect the traffic to be dropped.
Even if that is incorrect I attempted to add the policy in the Ingress block below and still was not able to access the DNS service.
apiVersion: projectcalico.org/v2
items:
- apiVersion: projectcalico.org/v2
  kind: NetworkPolicy
  metadata:
    creationTimestamp: 2017-11-09T07:11:23Z
    name: e2e-tests-calico-policy-dd86s.namespace-isolation-a
    namespace: nsa
    resourceVersion: "14343"
    uid: 31721445-c51d-11e7-8069-0800276b50bb
  spec:
    egress:
    - action: allow
      destination:
        namespaceSelector: nsa
      source: {}
    ingress:
    - action: allow
      destination: {}
      source:
        namespaceSelector: nsa
    order: 1000
    selector: ""
    types:
    - Ingress
    - Egress
- apiVersion: projectcalico.org/v2
  kind: NetworkPolicy
  metadata:
    creationTimestamp: 2017-11-09T06:50:39Z
    name: e2e-tests-calico-policy-b-sn9fn.namespace-isolation-b
    namespace: nsb
    resourceVersion: "12704"
    uid: 4c491c08-c51a-11e7-818d-0800276b50bb
  spec:
    egress:
    - action: allow
      destination:
        namespaceSelector: nsb
      source: {}
    ingress:
    - action: allow
      destination: {}
      source:
        namespaceSelector: nsb
    order: 1000
    selector: ""
    types:
    - Ingress
    - Egress
kind: NetworkPolicyList
metadata:
  resourceVersion: "14362"
apiVersion: projectcalico.org/v2
items:
- apiVersion: projectcalico.org/v2
  kind: GlobalNetworkPolicy
  metadata:
    creationTimestamp: 2017-11-09T06:52:01Z
    name: e2e-tests-calico-policy-dd86s.allow-dns
    resourceVersion: "12813"
    uid: 7d0a05d6-c51a-11e7-b0c2-0800276b50bb
  spec:
    egress:
    - action: allow
      destination:
        selector: k8s-app == "kube-dns"
      source: {}
    order: 4000
    selector: all()
    types:
    - Egress
kind: GlobalNetworkPolicyList
metadata:
  resourceVersion: "14362"

DNS Ingress policy
- apiVersion: projectcalico.org/v2
  kind: GlobalNetworkPolicy
  metadata:
    creationTimestamp: 2017-11-09T07:19:09Z
    name: dns-ingress
    resourceVersion: "14960"
    uid: 47184fe6-c51e-11e7-82f8-0800276b50bb
  spec:
    ingress:
    - action: allow
      destination: {}
      source: {}
    order: 1000
    selector: k8s-app == "kube-dns"
    types:
    - Ingress

Context
Working on network policy e2e tests.
Your Environment

Calico version: Master components
Orchestrator version (e.g. kubernetes, mesos, rkt): Kubernetes setup with the Vagrant setup from the docs

@tmjd - https://semaphoreci.com/calico/calico/branches/master/builds/1120 is the first build with @caseydavenport 's fix for non-namespaced policy having namespace restrictions applied. I think any master newer than this one (was published around Wed afternoon) should be fine. Just wanted to verify you got the newer version ...

I'm fairly certain I have it but I'll re-deploy and double check

Yeah redeployed and I'm seeing the same behavior.

OMG I'm not thinking right. I realized those namespace selectors aren't right.
.... Though I've updated to the following and still seeing the same behavior.
apiVersion: projectcalico.org/v2
items:
- apiVersion: projectcalico.org/v2
  kind: NetworkPolicy
  metadata:
    creationTimestamp: 2017-11-09T17:05:36Z
    name: e2e-tests-calico-policy-dd86s.namespace-isolation-a
    namespace: nsa
    resourceVersion: "5096"
    uid: 345ec8d5-c570-11e7-972f-0800276b50bb
  spec:
    egress:
    - action: allow
      destination: {}
      source: {}
    ingress:
    - action: allow
      destination: {}
      source:
        namespaceSelector: e2e-framework == nsa
    order: 1000
    selector: ""
    types:
    - Ingress
    - Egress
- apiVersion: projectcalico.org/v2
  kind: NetworkPolicy
  metadata:
    creationTimestamp: 2017-11-09T17:05:40Z
    name: e2e-tests-calico-policy-b-sn9fn.namespace-isolation-b
    namespace: nsb
    resourceVersion: "5089"
    uid: 36a534a1-c570-11e7-841f-0800276b50bb
  spec:
    egress:
    - action: allow
      destination: {}
      source: {}
    ingress:
    - action: allow
      destination: {}
      source:
        namespaceSelector: ns-name == nsb
    order: 1000
    selector: ""
    types:
    - Ingress
    - Egress
kind: NetworkPolicyList
metadata:
  resourceVersion: "5446"
apiVersion: projectcalico.org/v2
items:
- apiVersion: projectcalico.org/v2
  kind: GlobalNetworkPolicy
  metadata:
    creationTimestamp: 2017-11-09T17:07:44Z
    name: dns-ingress
    resourceVersion: "2144"
    uid: 80918fe9-c570-11e7-bbe6-0800276b50bb
  spec:
    ingress:
    - action: allow
      destination: {}
      source: {}
    order: 1000
    selector: k8s-app == "kube-dns"
    types:
    - Ingress
- apiVersion: projectcalico.org/v2
  kind: GlobalNetworkPolicy
  metadata:
    creationTimestamp: 2017-11-09T17:05:30Z
    name: e2e-tests-calico-policy-dd86s.allow-dns
    resourceVersion: "1968"
    uid: 310334b3-c570-11e7-a94e-0800276b50bb
  spec:
    egress:
    - action: allow
      destination:
        selector: k8s-app == "kube-dns"
      source: {}
    order: 4000
    selector: all()
    types:
    - Egress
kind: GlobalNetworkPolicyList
metadata:
  resourceVersion: "5446"

At least one issue might be the formatting of your selector:
namespaceSelector: e2e-framework == nsa

There should be quotes around nsa
e.g.
namespaceSelector: e2e-framework == "nsa"

Updated policies to the following and still seeing the problem.
apiVersion: projectcalico.org/v2
items:
- apiVersion: projectcalico.org/v2
  kind: NetworkPolicy
  metadata:
    creationTimestamp: 2017-11-09T17:05:36Z
    name: e2e-tests-calico-policy-dd86s.namespace-isolation-a
    namespace: nsa
    resourceVersion: "8741"
    uid: 345ec8d5-c570-11e7-972f-0800276b50bb
  spec:
    egress:
    - action: allow
      destination: {}
      source: {}
    ingress:
    - action: allow
      destination: {}
      source:
        namespaceSelector: e2e-framework == "nsa"
    order: 1000
    selector: ""
    types:
    - Ingress
    - Egress
- apiVersion: projectcalico.org/v2
  kind: NetworkPolicy
  metadata:
    creationTimestamp: 2017-11-09T17:05:40Z
    name: e2e-tests-calico-policy-b-sn9fn.namespace-isolation-b
    namespace: nsb
    resourceVersion: "8747"
    uid: 36a534a1-c570-11e7-841f-0800276b50bb
  spec:
    egress:
    - action: allow
      destination: {}
      source: {}
    ingress:
    - action: allow
      destination: {}
      source:
        namespaceSelector: ns-name == "nsb"
    order: 1000
    selector: ""
    types:
    - Ingress
    - Egress
kind: NetworkPolicyList
metadata:
  resourceVersion: "11198"
apiVersion: projectcalico.org/v2
items:
- apiVersion: projectcalico.org/v2
  kind: GlobalNetworkPolicy
  metadata:
    creationTimestamp: 2017-11-09T17:07:44Z
    name: dns-ingress
    resourceVersion: "2144"
    uid: 80918fe9-c570-11e7-bbe6-0800276b50bb
  spec:
    ingress:
    - action: allow
      destination: {}
      source: {}
    order: 1000
    selector: k8s-app == "kube-dns"
    types:
    - Ingress
- apiVersion: projectcalico.org/v2
  kind: GlobalNetworkPolicy
  metadata:
    creationTimestamp: 2017-11-09T17:05:30Z
    name: e2e-tests-calico-policy-dd86s.allow-dns
    resourceVersion: "1968"
    uid: 310334b3-c570-11e7-a94e-0800276b50bb
  spec:
    egress:
    - action: allow
      destination:
        selector: k8s-app == "kube-dns"
      source: {}
    order: 4000
    selector: all()
    types:
    - Egress
kind: GlobalNetworkPolicyList
metadata:
  resourceVersion: "11198"

The egress policy was allowing only to the kube-dns pod but the kube-dns pod makes outbound connections which were not allowed.  Allowing outbound from the kube-dns pod seems to fix this.


Could not write standard input to Gradle Worker Daemon

Expected Behavior

I wannt build the project of grpc-java
Current Behavior

When I use gradle to build the project, an exception occurred as follows:

Context

I wannt build the project of grpc-java for study, which I can debug the grpc-java 's source codes.
Steps to Reproduce

Download the grpc-java project
Create $project-root$/gradle.properties file
Add skipAndroid=true and skipCodegen=true in gradle.properties file
Use Windows cmd to run gradle build or Use IDEA terminal to run gradlew build

Your Environment

Build scan URL: https://scans.gradle.com/s/33robo6iif7o6
Operating System: Windows 10
Machine: desktop
JDK: openjdk 1.8.0_265

I left comment on your previous report. May be downgrading java version would resolve this issue.

I left comment on your previous report. May be downgrading java version would resolve this issue.

Thanks for your help, I'll try it.

I believe the IOException is a red herring there. The actual problem is that the worker process failed to start because of
java.lang.InternalError: Could not create SecurityManager: worker.org.gradle.process.internal.worker.child.BootstrapSecurityManager
  at sun.misc.Launcher.<init>(Launcher.java:106)
  at sun.misc.Launcher.<clinit>(Launcher.java:54)
  at java.lang.ClassLoader.initSystemClassLoader(ClassLoader.java:1444)
  at java.lang.ClassLoader.getSystemClassLoader(ClassLoader.java:1429)

This error indicates that the worker process failed to start. Unfortunately, it is hard to say what went wrong without a reproducer. There are multiple potential reasons for that failure, e. g. corrupted data in $GRADLE_USER_HOME folder. See https://github.com/gradle/gradle/issues/4689#issuecomment-803924544 for some advice.
@pinxiong, are you still able to reproduce the issue by chance? I'll close the issue otherwise because we cannot proceed without more information.

@mlopatkin I don't have the previous environment to reproduce this issue because it has been over for a long time, and I have chosen another way to meet my needs.

@mlopatkin I don't have the previous environment to reproduce this issue because it has been over for a long time, and I have chosen another way to meet my needs.

Thanks, that is understandable. Sorry, we didn't get to this issue in time.


[BUG] Duplicate line in issue template

Description
The line describing -  " add X to mark " is printed twice
Screenshots

Additional information
No response
🥦 Browser
Google Chrome
👀 Have you checked if this issue has been raised before?

[X] I checked and didn't find similar issue

🏢 Have you read the Contributing Guidelines?

[X] I have read and understood the rules in the Contributing Guidelines

Are you willing to work on this issue ?
None

Hi Dunsin, I was wondering if I can take on this Issue while following the repo's guidelines

Hi Dunsin, I was wondering if I can take on this Issue while following the repo's guidelines

Definitely, thanks for wanting to contribute.
Good Luck

Hey Dunsin, I went through the PR Template md file, I think its just a redundant statement ( 2 checkbox showing same content ).
Its in a comment block (not bothering the template itself exactly). Do you want me to remove either one of them ?
For example -- (removed the [X] - Correct ... )
[x] - Correct; marked as done
[ ] - Not correct; marked as not done

Hey Dunsin, I went through the PR Template md file, I think its just a redundant statement ( 2 checkbox showing same content ).
Its in a comment block (not bothering the template itself exactly). Do you want me to remove either one of them ?
For example -- (removed the [X] - Correct ... )
[x] - Correct; marked as done
[ ] - Not correct; marked as not done

Yes

:tada: This issue has been resolved in version 2.51.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Got 400 when downloading 44mm Galaxy Watch 5

model name for 44mm: SM-R910 40mm: SM-R900
40mm's firmware can be downloaded while 44mm's returns 400

Watch downloads are not supported. https://github.com/zacharee/SamloaderKotlin/issues/44#issuecomment-998948183


update to new html5.sortable version

Adding lessons on courses and courses on tracks doesn't work because html5.sortable has new changes in 4.0

resolved in commits c7da1afb2340dc569915f629bce3d74bd40d6d2c, b4477529d7a2bcdc8ce05110c8901b6ab646543c


Saturday night social

I cannot determine from the budget (nor remember from our discussions) if we have a budget for the Saturday night social? I think I remember we said Saturday night was going to be informal? Everyone buys there own kind of thing? Please correct me if I am wrong.

That is correct. Although we don't have a budget for the social on Saturday and it will be informal, we might need to book a space. @minisciencegirl would it be possible to talk with Joe about this? We could go to the Pit on Sat and to the Gallery on Monday.

Sounds good @adrisua. I will go ahead and provide an estimate of 50 - 100 people for Saturday.

@adrisua: October 17th at the Gallery is confirmed. Unfortunately the Pit is reserved for October 15th for a private function. Gallery is still open - do we want to do two nights at the Gallery?

Sure, let's do that.

Saturday night Social will happen at the Pit. They have a private function but they don't mind us using the other portion of the pub. Everything is confirmed.


Use a custom dialog for proxy authentication

This PR adds a (temporary) setting window.enableExperimentalProxyLoginDialog to enable a new login flow that runs from within a VSCode window as opposed to what we had before. On top of that, you can chose to persist proxy credentials to not get prompted again:

This PR fixes https://github.com/microsoft/vscode/issues/106489

This is quite a large change coming in late and I want to get some testing coverage this week so I will not ask for reviews, but shout out to individual owners:

@sbatten I had to change dialog.ts to allow for input fields and added IDialogService#input as new method for supporting that
@joaomoreno I left the old proxy auth code in given the setting is not yet enabled by default but if enabled I kept the logic of only showing 1 dialog per session


Remove load_template plugin hook

I couldn't get it working correctly with async (necessary for include/extend to function), and on deeper investigation it appears that I can build something equivalent to what I wanted using the existing prepare_jinja2_environment hook.

I'm going to remove the load_template plugin hook and see if it's possible to build the edit templates extension against prepare_jinja2_environment instead.
Originally posted by @simonw in https://github.com/simonw/datasette/issues/1072#issuecomment-719833744

Should mostly be a case of backing out the changes from this commit: 81dea4b07ab2b6f4eaaf248307d2b588472054a1


Add prefix of export-policy name using dynamic export policies

Describe the solution you'd like
Please add prefix of export-policy name in dynamic export policies.
The export-policy name of dynamic export policies in NetApp/Trident v20.04.0 is trident-<BackendUUID>.
https://github.com/NetApp/trident/blob/b72e614daa3ace9226c1deeb4214ba0bdda7ba16/storage_drivers/ontap/ontap_common.go#L285
It's good idea. But I want to give a prefix so that the administrator can manage it easily.
(e.g) <exportPolicy>-trident-<BackendUUID>
Describe alternatives you've considered
none
Additional context
none

Also Volume name is same.

Hi @ysakashita,
Can you explain the use case in more detail? What does the administrator need to manage for dynamically created export policies? Also, why is the BackendUUID not sufficient?

@gnrl We manage over 600 Kubernetes. NetApp/Trident can use SVM on NetApp/Ontap. So admin of Kubernetes are able to access to there's SVM only as svm admin(who is in our customer).
However, when it occurs trouble etc..., the cluster admin of NetApp/Ontap try to check and manage the export policies and volumes. As you may know, the cluster admin of NetApp/Ontap don't know NetApp/Trident's backend information. The backend information is used  to set up NetApp/Trident by svm admin. Also the cluster admin of NetApp/Ontap (aka. our storage admin) can't access our customer's Kubernetes.
Therefore, we set a cluster name of kubernetes to the storagePrefix and exportPolicy in backend now.
This prefix is very useful for cluster admin of NetApp/Ontap without backend information.
However, the dynamic export policies don't have prefix. So the cluster admin can't manage it.
The Prefix is very important if you have a team of two or more admins like us. The more you manage a large Kubernetes, the more divided the administrator will be.

Hi @ysakashita,
Thank you for describing your use case. This is becoming a more common use case for multiple clusters. The use of extending the storagePrefix on the volume has a number of issues including the inability to update the storagePrefix without impacting already mounted volumes.
Would you prefer being able to specify custom labels on the volume that Trident provisions? This would satisfy your use case and add the ability to associate the backend UUID to the custom label. Also, see this similar discussion.

@gnarl Thank you for good idea.
I think custom labels are good for us. Also we want that label to be added to export-policy as well as volume.

@gnarl Please let me know when it will be supported if you know.

@gnarl Please let me know when it will be supported if you know.


Plan for support multiple tfstate (like ecspresso)

I wanna lookup multi tfstate files in pulgins secion.
like  ↓
plugins:
   - name: tfstate
     config:
       url: s3://tfstate/first.tfstate
     func_prefix: first_
   - name: tfstate
     config:
       url: s3://tfstate/second.tfstate
     func_prefix: second_

May I implement it?

Nice. Please implement it.


oj-template fails with "Cant locate template for uri 'template.cpp'"

$ pip3 show online-judge-template-generator | grep Version
Version: 4.0.1

$ oj-template https://codeforces.com/contest/1333/problem/D
INFO:onlinejudge._implementation.logging:[x] load cookie from: /home/user/.local/share/online-judge-tools/cookie.jar
INFO:onlinejudge._implementation.logging:[x] problem recognized: CodeforcesProblem.from_url('https://codeforces.com/contest/1333/problem/D'): https://codeforces.com/contest/1333/problem/D
INFO:onlinejudge._implementation.logging:[x] GET: https://codeforces.com/contest/1333/problem/D
INFO:onlinejudge._implementation.logging:[x] 200 OK
INFO:onlinejudge._implementation.logging:[x] save cookie to: /home/user/.local/share/online-judge-tools/cookie.jar
ERROR:onlinejudge_template.analyzer.combined:input analyzer failed:
ERROR:onlinejudge_template.analyzer.combined:output analyzer failed:
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.6/site-packages/mako/lookup.py", line 249, in get_template
    return self._check(uri, self._collection[uri])
KeyError: 'template.cpp'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/user/.local/bin/oj-template", line 8, in <module>
    sys.exit(main())
  File "/home/user/.local/lib/python3.6/site-packages/onlinejudge_template/main.py", line 39, in main
    code = onlinejudge_template.generator.run(analyzed, template_file=parsed.template)
  File "/home/user/.local/lib/python3.6/site-packages/onlinejudge_template/generator/__init__.py", line 25, in run
    template = lookup.get_template(template_file)
  File "/home/user/.local/lib/python3.6/site-packages/mako/lookup.py", line 263, in get_template
    "Cant locate template for uri %r" % uri
mako.exceptions.TopLevelLookupException: Cant locate template for uri 'template.cpp'

fixed by https://github.com/kmyk/online-judge-template-generator/commit/4b5c4a6d4283edad7afa898fdaa121094a33a6a6


fix(config): set default outDir to $$ts-jest when allowJs is enabled without outDir

closes #1471

Pull Request Test Coverage Report for Build 4257

2 of 2 (100.0%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.02%) to 93.03%

Totals

Change from base Build 4256:
0.02%

Covered Lines:
1130

Relevant Lines:
1167

💛  - Coveralls


Error and full system crash running Flux-GGUF

Having this issue since update, everything was working perfectly yesterday. Now soon as I hit Queue and it starts to run. I get either this error each time or my system completely crashes and restarts.
`[2024-08-21 16:53] Requested to load FluxClipModel_
[2024-08-21 16:53] Loading 1 new model
[2024-08-21 16:54] loaded completely 0.0 5180.35888671875 True
[2024-08-21 16:54] !!! Exception during processing !!! Allocation on device
[2024-08-21 16:54] Traceback (most recent call last):
File "G:\ComfyUI_windows_portable\ComfyUI\execution.py", line 316, in execute
output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\ComfyUI\execution.py", line 191, in get_output_data
return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\ComfyUI\execution.py", line 168, in _map_node_over_list
process_inputs(input_dict, i)
File "G:\ComfyUI_windows_portable\ComfyUI\execution.py", line 157, in process_inputs
results.append(getattr(obj, func)(**inputs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\ComfyUI\nodes.py", line 65, in encode
output = clip.encode_from_tokens(tokens, return_pooled=True, return_dict=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\ComfyUI\comfy\sd.py", line 126, in encode_from_tokens
o = self.cond_stage_model.encode_token_weights(tokens)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\ComfyUI\comfy\text_encoders\flux.py", line 57, in encode_token_weights
t5_out, t5_pooled = self.t5xxl.encode_token_weights(token_weight_pairs_t5)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\ComfyUI\comfy\sd1_clip.py", line 41, in encode_token_weights
o = self.encode(to_encode)
^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\ComfyUI\comfy\sd1_clip.py", line 229, in encode
return self(tokens)
^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl
return forward_call(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\ComfyUI\comfy\sd1_clip.py", line 201, in forward
outputs = self.transformer(tokens, attention_mask_model, intermediate_output=self.layer_idx, final_layer_norm_intermediate=self.layer_norm_hidden_state, dtype=torch.float32)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl
return forward_call(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\ComfyUI\comfy\text_encoders\t5.py", line 241, in forward
return self.encoder(x, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl
return forward_call(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\ComfyUI\comfy\text_encoders\t5.py", line 213, in forward
x, past_bias = l(x, mask, past_bias, optimized_attention)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl
return forward_call(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\ComfyUI\comfy\text_encoders\t5.py", line 190, in forward
x = self.layer-1
^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl
return forward_call(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\ComfyUI\comfy\text_encoders\t5.py", line 66, in forward
forwarded_states = self.DenseReluDense(forwarded_states)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl
return forward_call(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\ComfyUI\comfy\text_encoders\t5.py", line 46, in forward
hidden_gelu = self.act(self.wi_0(x))
^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl
return forward_call(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-GGUF\ops.py", line 146, in forward
weight, bias = self.get_weights(x.dtype)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-GGUF\ops.py", line 125, in get_weights
weight = self.get_weight(self.weight, dtype)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-GGUF\ops.py", line 117, in get_weight
weight = dequantize_tensor(tensor, dtype)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-GGUF\dequant.py", line 19, in dequantize_tensor
return out.to(dtype) if out.dtype != dtype else out # why is .to() not a no-op?
^^^^^^^^^^^^^
torch.OutOfMemoryError: Allocation on device
[2024-08-21 16:54] Got an OOM, unloading all loaded models.
[2024-08-21 16:54] Prompt executed in 87.08 seconds
`

Just a little update of what I've done so far.  I completely trashed my whole setup of ComfyUI and started from scratch just in case something that I had installed with another node was causing issues. Still getting the same full crash of my computer. Was working perfectly before 8-20-24. now I can't run Flux-GGUF even on a clean install with only GGUF installed and manager as the only custom nodes installed. Thought it might be my system, so I did a fully graphics card benchmark and also a memory benchmark, all passed no issues. Also did a CPU on as well no issues. So I'm completely stumped cause I can run any other models perfectly. And like I said I was running Flux-GGUF for a while making images till, I updated then crash after crash. 🤷♂

Here's the log of the current event. Can someone help figure out what is all of the sudden wrong? Right after the last part of the log is when my computer crashes and reboots.
[2024-08-22 05:47] Starting server
[2024-08-22 05:47] To see the GUI go to: http://<IP_ADDRESS>:8188
[2024-08-22 05:47] FETCH DATA from: C:\Users\renef\Downloads\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Manager\extension-node-map.json [DONE]
[2024-08-22 05:48] got prompt
[2024-08-22 05:48] Using pytorch attention in VAE
[2024-08-22 05:48] Using pytorch attention in VAE
[2024-08-22 05:48] C:\Users\renef\Downloads\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-GGUF\nodes.py:35: UserWarning: The given NumPy array is not writable, and PyTorch does not support non-writable tensors. This means writing to this tensor will result in undefined behavior. You may want to copy the array to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at C:\actions-runner_work\pytorch\pytorch\builder\windows\pytorch\torch\csrc\utils\tensor_numpy.cpp:212.)
torch.from_numpy(tensor.data), # mmap
[2024-08-22 05:48]
ggml_sd_loader:
[2024-08-22 05:48]  1                             472
[2024-08-22 05:48]  8                             304
[2024-08-22 05:48]
[2024-08-22 05:48]
[2024-08-22 05:48] model weight dtype torch.bfloat16, manual cast: torch.float16
[2024-08-22 05:48] model_type FLOW
[2024-08-22 05:48]
ggml_sd_loader:
[2024-08-22 05:48]  8                             169
[2024-08-22 05:48]  0                              50
[2024-08-22 05:48]
[2024-08-22 05:48]
[2024-08-22 05:48] C:\Users\renef\Downloads\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-GGUF\dequant.py:8: UserWarning: To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requires_grad_(True), rather than torch.tensor(sourceTensor).
data = torch.tensor(tensor.data)
[2024-08-22 05:48] C:\Users\renef\Downloads\ComfyUI_windows_portable\python_embeded\Lib\site-packages\transformers\tokenization_utils_base.py:1601: FutureWarning: clean_up_tokenization_spaces was not set. It will be set to True by default. This behavior will be depracted in transformers v4.45, and will be then set to False by default. For more details check this issue: https://github.com/huggingface/transformers/issues/31884
warnings.warn(
[2024-08-22 05:48] Requested to load FluxClipModel_
[2024-08-22 05:48] Loading 1 new model
[2024-08-22 05:49] loaded completely 0.0 5180.35888671875 True
[2024-08-22 05:49] C:\Users\renef\Downloads\ComfyUI_windows_portable\ComfyUI\comfy\ldm\modules\attention.py:407: UserWarning: 1Torch was not compiled with flash attention. (Triggered internally at C:\actions-runner_work\pytorch\pytorch\builder\windows\pytorch\aten\src\ATen\native\transformers\cuda\sdp_utils.cpp:555.)
out = torch.nn.functional.scaled_dot_product_attention(q, k, v, attn_mask=mask, dropout_p=0.0, is_causal=False)

Looks like a recent ComfyUI update probably broke mmap and massively increased system memory usage.

Whelp my computer is 🔥 .. I now get a complete crash even on video games now. I can watch videos fine and put my system through benchmarks but soon as I try running ComfyUI or a game my system crashes.
Dump says:
General information
Bug Check Code
0x00000116
Bug Check String
VIDEO_TDR_ERROR
Parameter 1
0xFFFF8304D91AA010
Parameter 2
0xFFFFF80660CE1120
Parameter 3
0xFFFFFFFFC000009A
Parameter 4
0x0000000000000004
Crash date
August 22, 2024 4:16 AM
Architecture
x64
Major version
15
Minor version
22621
Number of processors
6
Dump file size
131 kB
Crash source
Crash source
dxgkrnl.sys+30B00E
Process path
C:\WINDOWS\system32\drivers\dxgkrnl.sys
Description
DirectX Graphics Kernel
Version
10.0.22621.3958
Company
Microsoft Corporation
Size
4.52 MB
Call Stack
Stack address
dxgkrnl.sys+30B00E
Stack address
nvlddmkm.sys+1621120
Stack address
dxgkrnl.sys+2BCE32
Stack address
nvlddmkm.sys+1621120
Stack address
dxgkrnl.sys+2B53A9
Stack address
dxgkrnl.sys+30A8A0
Did all the steps to fix a VIDEO_TDR_ERROR but still having the issue. So not sure if it was related to Comfy or my PSU,CPU or Graphics card went poof 🔥 🥹  I tell yah what luck I have smh

@falcon204 Try power limit your card. Either using something like MSI afterburner or just nvidia-smi -pl 150 in an admin command prompt (set it to e.g. half of whatever your card uses normally). If it's fine like that it's possible that it's a PSU issue. Could also grab hwinfo64 and look at voltages under load, though if it crashes due to transient spikes then that won't help you much.

@falcon204 Try power limit your card. Either using something like MSI afterburner or just nvidia-smi -pl 150 in an admin command prompt (set it to e.g. half of whatever your card uses normally). If it's fine like that it's possible that it's a PSU issue. Could also grab hwinfo64 and look at voltages under load, though if it crashes due to transient spikes then that won't help you much.

Thanks @city96 for you taking the time to help, I really appreciate it. Tried what you said and went 75 for previous 150 and still same issues. Checked using hwinfo64 and had my screen looking like NASA lol . looked at everything and don't see anything that sticks out as alarming voltages or temps. Yet when I tried to do a CPUID powerMAX for testing can't see anything cause soon as I do the GPU test it crashes. CPU passes perfectly. But Anywhooo thanks for taking time to help. Sucks I was so enjoying ComfyUI and your node. Flux is absolutely amazing.  Even though I'm now out, I'll be cheering you on, on the sidelines 😃

Most likely a hardware error then, sorry to hear. I guess you can try clean the card / PCIe slot / power connectors in a last ditch effort but sounds like a replacement / RMA will be your best shot.

@city96 Fixed my issue, was driver related. DirectX and my Graphics card drivers. Was wondering I'm getting a User Warning message in the terminal saying the following
ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-GGUF\dequant.py:8: UserWarning: To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requires_grad_(True), rather than torch.tensor(sourceTensor).
data = torch.tensor(tensor.data)
ComfyUI runs fine with the images producing fine but I'm always seeing this warning.

You can ignore that warning, will probably change the code eventually so pytorch stops complaining.


In DC-iOS it is not possible to access a bot via app

In DC-iOS 1.42.8 it is not possible to call a bot via the bot app.
The chat cannot be opened even by tapping the link several times. Nothing happens.
The problem does not exist in DC-Desktop and DC-Android.

hi, sorry for the late reply, the problem is that DC in iOS doesn't support opening the kind of link that is used for contact verification in DC

recent DC iOS version already support the bot links (fixed in https://github.com/deltachat/deltachat-ios/pull/2158)


Audio issues with Robocop 3 shootout sections

Hi guys, just adding this as an issue here as per a previous conversation with @Optiroc.
Easiest way to replicate:
If you load it up and select arcade mode, and then select one of the shootout sections (I think F2 on the selection screen is one). When the game starts, hold down the mouse button to shoot and you'll see how messed up the sound is. It plays a load of random game samples followed by some horrid white noise/glitched sample sounds, which does eventually stop (thankfully). It should just play the sample of Robocop's pistol.
I think this is another one of those 68020 CPU speed / timing things.
It doesn't happen in WinUAE using the preset expanded A1200 configuration, so it isn't a WHDload issue.
If I boot from floppies in A500+/ECS mode, it is fine of course.
I've stumbled across a few games now which have messed up or glitchy sound in 68020 mode on MiSTer - as i've mentioned previously games like Hostages and Shufflepuck Cafe are slightly glitchy, same in WinUAE, but ticking cycle-exact fixes it.
Not sure if you can really do anything about the issue with this game given the fact MegaAGS has to boot in 68020/AGA mode. @Optiroc suggested it could be a regression with MiSTer regarding sound in 68020 mode.
I thought i'd flag it here though in case you wanted to add a note to the DB.
There are no bugs filed on the WHDload Mantis bugtracker for this issue, but as I say I think it may be MiSTer specific, as it doesn't happen when you mount MegaAGS in WinUAE.
I'm not sure if this would still happen when using the WHDload version of the game on a A600HD 68000 type config - I don't have the environment to test this. But as MegaAGS needs 68020/AGA to run, this is a moot point anyway.
Perhaps this issue would be best placed in the Minimig issues for MiSTer - let me know what you think.
Cheers!

I’ll add the sound issues to the note or issues field in the DB, so they can be followed up in future core releases.
I used to include an automated list for titles with issues noted in the launcher. I should probably reintroduce it!

No worries. Hopefully the sound in general when using 68020 can be improved in the future.
It might be worth me collecting some of this into a single issue and raising it on the Minimig Github for MiSTer. Although it's likely that this kind of behaviour is 'expected' because of the CPU running faster than a real A1200. Workaround of course is to use A500/A500+ type config + floppies, but then we don't have the benefit of using MegaAGS, which is what I prefer by a mile.

Added issue note in fd924a1b1894bcf4eb54a2c3bb476ee608182d21. Let's hope someone can fix this in the core at some point. Maybe something to bring up with Ole who implemented the PWM audio recently?

Yes, that's not a bad idea. Will have to put together some wording to post on the forum or something, or maybe I'll drop him a PM. It would be great if these audio issues (including the minor glitches on those other games I've mentioned before) can be resolved on the core itself.


Enhancement - more rollback options

I noticed when you lookup a block-space using the wand it spits out a little ID, it would be nice if you could rollback individual entries using that ID.
Image of what I'm talking about:
http://i.imgur.com/NL34lCd.png
example:
/d3log rollback 184258 would rollback the above entry.
Also it would be nice to rollback using a specific time frame, radius, and other more fine tuned options.
Great forge mod :+1:

The rollback never got the attention it needs because we don't ever end up using it.

Nice to have that extra control when you need it though. Even just being able to rollback using the lookup entry ID would be nice.

Can you try with another item? I just did more testing and it definitely works with vanilla items.

@dries007 Responded over at proper spot https://github.com/DoubleDoorDevelopment/ItemBlacklist/issues/5#issuecomment-181630323


Language server failure: python (no cached binary)

Check for existing issues

[X] Completed

Describe the bug / provide steps to reproduce it

Open a project with python files
Try to edit a python file

Environment
Zed: v0.80.5 (stable)
OS: macOS 13.4.0
Memory: 16 GiB
Architecture: aarch64
If applicable, add mockups / screenshots to help explain present your vision of the feature

If applicable, attach your ~/Library/Logs/Zed/Zed.log file to this issue.
If you only need the most recent lines, you can run the zed: open log command palette action to see the last 1000.
2023-04-06T10:40:15 [INFO] Opening main db
2023-04-06T10:40:15 [ERROR] No path stored for this editor
2023-04-06T10:40:16 [INFO] set environment variables from shell:/bin/zsh, path:/Users/nickolas/.bun/bin:/Users/nickolas/opt/anaconda3/condabin:/Users/nickolas/.poetry/bin:/Users/nickolas/.yarn/bin:/Users/nickolas/.config/yarn/global/node_modules/.bin:/opt/homebrew/opt/mysql-client/bin:/Users/nickolas/.nvm/versions/node/v18.12.0/bin:/Users/nickolas/Library/Application Support/edgedb/bin:/opt/homebrew/bin:/opt/homebrew/sbin:/usr/local/bin:/System/Cryptexes/App/usr/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/go/bin:/usr/local/share/dotnet:~/.dotnet/tools:/Library/Apple/usr/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/local/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/appleinternal/bin:/Users/nickolas/.cargo/bin:/Users/nickolas/Library/Application Support/JetBrains/Toolbox/scripts:/Users/nickolas/Library/Android/sdk/emulator:/Users/nickolas/Library/Android/sdk/platform-tools:/Users/nickolas/.cargo/bin:/Users/nickolas/flutter/bin:/usr/local/go/bin:/Users/nickolas/go/bin
2023-04-06T10:40:16 [ERROR] no cached binary
2023-04-06T10:40:16 [ERROR] failed to run npm info

Quit Zed. Run the following in a terminal of choice:
$ rm -rf ~/Library/Application\ Support/Zed/node

Open Zed and try again. Does that resolve the issue?

I'm willing to bet that the Node extraction was interrupted, go ahead and run the command @hovsater suggested and let us know if that resolves the issue. I intend on us being smarter about this potential case the future

I got this same error for the JSON language server:

failed to run npm info

Caused by:
    Permission denied (os error 13)```

After running [this command](https://github.com/zed-industries/community/issues/1376#issuecomment-1498935036) and restarting Zed the error didn't appear again

@nkyryliuk did https://github.com/zed-industries/community/issues/1376#issuecomment-1498935036 resolve your issue? 🙂

I'm closing this under the assumptions that the suggested solution did work.


[SPARK-6869][PySpark] Add pyspark archives path to PYTHONPATH

From SPARK-1920 and SPARK-1520 we know PySpark on Yarn can not work when the assembly jar are package by JDK 1.7+, so ship pyspark archives to executors by Yarn with --py-files. The pyspark  archives name must contains "spark-pyspark".

Test build #30111 has started for   PR 5478 at commit 413fa25.

Test build #30111 has finished for   PR 5478 at commit 413fa25.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.
This patch does not change any dependencies.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30111/
Test PASSed.

@Sephiroth-Lin the point of running PySpark on YARN is that the user does not have to install Spark on the slave machines. Instead, we package the python files in the assembly jar, which is automatically shipped by YARN to all containers.
This change assumes that the python files will already be present on the slave machines, since PYTHONPATH reads from the local file system. I don't believe this is a deployment requirement that we want to enforce, especially since the user must now ensure all Spark python files are consistent across all the machines (as they must do so in standalone mode).

IIUC, the motivation for this change is that the assembly jar distribution mechanism doesn't work for some Java versions.
I agree with Andrew that, if at all possible, we should avoid deployment models that expect PySpark or anything to be on every node.  Even if we advise against it, it increases the number of places one needs to check when debugging why something does or does not appear on the executor PYTHONPATH.
Are there workarounds for the Java versions issue that don't require python to be installed on the NodeManagers?

@andrewor14 @sryza Yes, to assume that the python files will already be present on the slave machines is not very reasonable. But if user want to use PySpark, then they must compile the Spark in JDK1.6, but I think now most user are use JDK1.7+. Maybe a good solution is package the PySpark in another jar and automatically shipped by YARN to all containers. And add this jar to PYTHONPATH with asseambly jar.

That alternative solution makes sense to me.  If it's not going to be added to the classpath, it might make more sense to use a zip than a jar.

That sounds good. We can ship it through --py-files. @Sephiroth-Lin Would you mind updating the PR and the JIRA to reflect this change in intention?

Test build #30407 has started for   PR 5478 at commit 51ebb26.

Test build #30407 has finished for   PR 5478 at commit 51ebb26.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.
This patch does not change any dependencies.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30407/
Test PASSed.

Test build #30414 has started for   PR 5478 at commit 309679a.

@andrewor14 @sryza Done, thanks.

Test build #30415 has started for   PR 5478 at commit 052e288.

Hey guys, after discussion with @Sephiroth-Lin offline, we have some questions:

If we try to ship the zip file to executer backend with --py-files:

User must use --py-file to point to the xxx.zip file we provide;
We must change format of directories(use xxx.zip to replace python dir) in our release.
Even the zip file is not very big, shipping it everytime still cost time.

Inspired by the former solution, I thought we might add some config like spark.exectuor.extraClassPath in PySpark side, which points to the files needed by user's application so that user could use them without shipping.

Test build #30415 has finished for   PR 5478 at commit 052e288.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.
This patch does not change any dependencies.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30415/
Test PASSed.

Test build #30414 has finished for   PR 5478 at commit 309679a.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.
This patch does not change any dependencies.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30414/
Test PASSed.

@andrewor14 @sryza @WangTaoTheTonic As I have test again, if we install Spark on each node, then we can set spark.executorEnv.PYTHONPATH=${SPARK_HOME}/python:${SPARK_HOME}/python/lib/py4j-<IP_ADDRESS>-src.zip to pass PYTHONPATH to executor. So this PR is another solution to run PySpark on yan if we don't install Spark on each node.

Yeah, spark.executorEnv.PYTHONPATH is PySpark's spark.executor.extraClassPath in some way.

Test build #30417 has started for   PR 5478 at commit 3a0ec77.

Test build #30417 has finished for   PR 5478 at commit 3a0ec77.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.
This patch does not change any dependencies.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30417/
Test PASSed.

yes, i think in SparkSubmit we can automatically add PYSPARK_ARCHIVES_PATH to dist files. and then in Client and ExecutorRunnable can set PYTHONPATH according to PYSPARK_ARCHIVES_PATH if it exist. and if user set PYTHONPATH, PYSPARK_ARCHIVES_PATH is unused. i have run successfully on yarn client and cluster.

Regarding the performance issue, this can be solved with the YARN distributed cache in the same way it works for the Spark assembly jar.  If the file is placed on HDFS in a public location, it will be cached on the nodes as a public YARN local resource so it doesn't need to be downloaded each time an app is submitted.

if we install Spark on each node, then we can set spark.executorEnv.PYTHONPATH

That's a workaround, but not really in the spirit of how Spark-on-YARN is expected to work. For example, you'd have to have all nodes have $SPARK_HOME be the same for that to work.
If this must be distributed as a separate file, then Sandy's solution is the way to go. The pyspark zip needs to be treated the same way the spark assembly is: if no configuration, find it locally and upload it to nodes using the distributed cache; add a config option so that users can store that file on HDFS or even use local: URIs in case they want to manually distribute the file.

Also, how big is the actual zip? I would imagine that it's at least one or two orders of magnitude smaller than the assembly jar, so it shouldn't be expensive especially if we cache it. As others have pointed out, the whole point of Spark on YARN is that the user doesn't need to install it on every node, and doing this through spark.executorEnv.PYTHONPATH defeats this purpose.

@sryza we can export PYSPARK_ARCHIVES_PATH=local://xx/pyspark.zip;local://xx/py4j.zip in spark-env.sh and we also can export PYSPARK_ARCHIVES_PATH=hdfs://xx/pyspaark.zip. then in SparkSubmit we can automatically add PYSPARK_ARCHIVES_PATH to yarn's dist files. and then Spark-on-Yarn can put dist files to YARN distributed cache. these work is same as Spark assembly jar.
@andrewor14  in my test, the pyspark.zip is 378KB, i think it is very small than  the assembly jar.so it can put it to dist files automatically.

Test build #30462 has started for   PR 5478 at commit 547fd95.

Test build #30462 has finished for   PR 5478 at commit 547fd95.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.
This patch does not change any dependencies.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30462/
Test FAILed.

Test build #30478 has started for   PR 5478 at commit c63f31f.

Test build #30478 has finished for   PR 5478 at commit c63f31f.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.
This patch does not change any dependencies.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30478/
Test PASSed.

@Sephiroth-Lin I looked at the latest changes and it doesn't seem to reflect what I had in mind. My proposal was to automatically zip up the python files in SparkSubmit and add it to the --py-files. If you do that then I believe all the PYTHONPATH will just be automatically set up as well. You can take a look at Java's ZipEntry or this post as a reference on how to do this.

@Sephiroth-Lin i think later i will submit my PR based on this PR and then please help me review it. thanks.

@lianhuiwang OK.

@Sephiroth-Lin would you mind closing this PR then?

Test build #30747 has started for   PR 5478 at commit d012cde.

@andrewor14 Sorry, these days I am busy, now I have update the code. ^-^

Test build #30748 has started for   PR 5478 at commit 5d9bcb6.

Test build #30747 has finished for   PR 5478 at commit d012cde.

This patch passes all tests.

This patch does not merge cleanly.

This patch adds no public classes.

This patch adds the following new dependencies:

commons-math3-3.1.1.jar
snappy-java-<IP_ADDRESS>.jar

This patch removes the following dependencies:

commons-math3-3.4.1.jar
snappy-java-<IP_ADDRESS>.jar

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30747/
Test PASSed.

Test build #30748 has finished for   PR 5478 at commit 5d9bcb6.

This patch passes all tests.

This patch does not merge cleanly.

This patch adds no public classes.

This patch adds the following new dependencies:

commons-math3-3.1.1.jar
snappy-java-<IP_ADDRESS>.jar

This patch removes the following dependencies:

commons-math3-3.4.1.jar
snappy-java-<IP_ADDRESS>.jar

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30748/
Test PASSed.

@andrewor14 @sryza how about your opinions? thanks. @lianhuiwang please help me review this, thanks.

so is this competing directly with https://github.com/apache/spark/pull/5580?

@tgravescs yes


feat: add serverless saas api

This PR adds a serverless API server to the server list and make default to it.

Per our chat, this will happen automatically when the server is redeployed.

Oh wait, leaving it open so we can review the unit test changes when the regenerate happens.


Non localized vendor and runtime bundles

Is your feature request related to a problem? Please describe.
It would be great to have the ability to create non localized bundles for vendor and runtime bundles. These bundles are not actually localized, so they could be more widely cached if we didn't create a locale bundle for them.
Describe the solution you'd like
A config option for this would be best, as it would allow a simple filename input.
Describe alternatives you've considered
The ability to use a functional filename allows one to pass a filename without a locale placeholder for some bundles. Once #15 is done, this would be a good solution, though it would require allowing some files to not have a locale place holder.

I think this might be out of scope for the plugin as it can be solved with how you configure Webpack.
For example, using DllPlugin or externals to split the build up into vendor vs application build.
The root problem is your config file is telling Webpack to create the vendor chunk in the same configuration that's telling it to localize assets. Even if you were to be able to use a function for filename, Webpack would still write the vendor asset to the same path multiple times, which is only masking the problem.