Support for netcdf4/hdf5 compression

It would be great to be able to specify netCDF4 compression parameters when saving datasets.
If this is unlikely to be supported, can you suggest a reasonable work-around? I am assuming it would involve directly accessing a backend?

This seems useful. xray uses the netCDF4 library here, and they support it. In the meantime, you could always add a post processing step from the command line: http://www.unidata.ucar.edu/blogs/developer/en/entry/netcdf_compression.

I don't see any reason why we couldn't support this.  The difficulty is that the implementation will be different (or not possible) for difficult backends.
netCDF4 adds compression at the Variable level so we would have to think about how to implement this to our Dataset.to_netcdf method.  Would we end up setting the compression level / type in each DataArray or would we add an argument to the to_netcdf method?

This is actually already supported, though poorly documented (so it's basically unknown).
We seem to have some sort of bug in our documentation generation for recent versions, but in the v0.5.1 IO docs, you can see the encoding attribute at the end of the section on writing netCDFs:
http://xray.readthedocs.org/en/v0.5.1/io.html#netcdf
The way this works is that encoding on each data array stores a dictionary of options that is used when serializing that array to disk. It support most of the options in netCDF4-python's createVariable method, including chunksizes, zlib, scale_factor, add_offset, _FillValue and dtype. This metadata is automatically filled in when reading a file from disk, which means that in principle xray should roundtrip the encoding faithfully.
Because encoding is read in when files are opened, invalid encoding options are currently ignored when saving a file to disk. This means that the current API is not very user friendly.
So I'd like to extend this into a keyword argument encoding for the to_netcdf method. The keyword argument would expect a dictionary where the keys are variable names and the values are encoding parameters, and errors would be raised for invalid encoding options. Here's my branch for that feature:
https://github.com/shoyer/xray/tree/encoding-error-handling

Brilliant. Thanks. I looked into the code but thought the encoding information was being stripped out.
So I've confirmed xray will round-trip fine. Shallow copies also round trip. Similarly making a new dataset from a variable with encoding information preserves that information and will output properly.
% tmp = xray.open_dataset('saved_on_disk_compressed.nc')
% tmp
<xray.Dataset>
Dimensions:         (time: 3, x: 2, y: 2)
Coordinates:
    reference_time  datetime64[ns] 2014-09-05
    lon             (x, y) float64 -99.83 -99.32 -99.79 -99.23
  * time            (time) datetime64[ns] 2014-09-06 2014-09-07 2014-09-08
    lat             (x, y) float64 42.25 42.21 42.63 42.59
  * x               (x) int64 0 1
  * y               (y) int64 0 1
Data variables:
    temperature     (x, y, time) float64 10.66 8.539 6.713 8.519 29.07 27.86 ...
    precipitation   (x, y, time) float64 0.3385 6.773 8.985 0.9651 0.1359 ...

% tmp.temperature.encoding
{'chunksizes': (2, 2, 3),
 'complevel': 5,
 'contiguous': False,
 'dtype': dtype('float64'),
 'fletcher32': False,
 'shuffle': True,
 'source': 'saved_on_disk_compressed.nc',
 'zlib': True}

% tmp2 = tmp
% tmp2.to_netcdf('saved_on_disk_comp_tmp2.nc')
% tmp3 = xray.open_dataset('saved_on_disk_comp_tmp2.nc')
% tmp3.temperature.encoding
{'chunksizes': (2, 2, 3),
 'complevel': 5,
 'contiguous': False,
 'dtype': dtype('float64'),
 'fletcher32': False,
 'shuffle': True,
 'source': 'saved_on_disk_comp_xray.nc',
 'zlib': True}

% tmp4 = xray.DataArray(tmp.temperature.values).to_dataset(name='temperature')
% tmp4.temperature.encoding
{}
% tmp4.temperature.encoding = tmp.temperature.encoding
% tmp4.temperature.encoding
{'chunksizes': (2, 2, 3),
 'complevel': 5,
 'contiguous': False,
 'dtype': dtype('float64'),
 'fletcher32': False,
 'shuffle': True,
 'source': 'saved_on_disk_compressed.nc',
 'zlib': True}
% tmp4.to_netcdf('saved_on_disk_comp_tmp4.nc')
% tmp5 = xray.open_dataset('saved_on_disk_comp_tmp4.nc')
% tmp.temperature.encoding
{'chunksizes': (2, 2, 3),
 'complevel': 5,
 'contiguous': False,
 'dtype': dtype('float64'),
 'fletcher32': False,
 'shuffle': True,
 'source': 'saved_on_disk_compressed.nc',
 'zlib': True}

That will do nicely. Thanks.


update-pypi-classifiers

IMPORTANT: Please do not create a Pull Request without creating an issue first.
Before submitting (must do checklist)

[x] Did you read the contribution guide?
[ ] Did you update the docs? We use Numpy format for all the methods and classes.
[ ] Did you write any new necessary tests?
[ ] Did you update the CHANGELOG?

Type of Change

[x] Examples / docs / tutorials / contributors update
[ ] Bug fix (non-breaking change which fixes an issue)
[ ] Improvement (non-breaking change which improves an existing feature)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Proposed Changes

Related Issue

Closing issues

Codecov Report

Merging #497 (bdf5b6d) into master (2ebfbd8) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #497   +/-   ##
=======================================
  Coverage   87.83%   87.83%
=======================================
  Files         115      115
  Lines        5452     5452
=======================================
  Hits         4789     4789
  Misses        663      663

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2ebfbd8...bdf5b6d. Read the comment docs.


[R] Review Feather/Arrow/Arrow IPC file format naming

This mailing list discussion might lead to a consensus re: dominant name for the Arrow/Feather file format. The cookbook should be consistent with where the community lands, and ideally, only use one name throughout.

https://issues.apache.org/jira/browse/ARROW-18148


Pact Slots Not Fully Refreshed on Rest

I have given a character an item which increases the max number of pact slots.  This modifies 'system.spells.pact.max' to 'Add' '1', and it properly increases the max pact slots; at lvl 9 Warlock this increases it from 2 slots to 3 and works correctly.  However, when you rest (short or long), it only restores up to the normal maximum of 2, not the new maximum of 3.

pact.level is force set to Math.min(pact.level, pact.max) in _prepareSpellCasting overwriting the value in actor._source, before I get a chance to change pact.max.
This is not done for other spell slots. Is it really necessary to do so for pact spell slots?
Alternatively could we introduce bonus fields for spell/pact slots so that the issue does not arise?

pact.level is force set to Math.min(pact.level, pact.max) in _prepareSpellCasting overwriting the value in actor._source, before I get a chance to change pact.max.
This is not done for other spell slots. Is it really necessary to do so for pact spell slots?
Alternatively could we introduce bonus fields for spell/pact slots so that the issue does not arise?

You can use pact.override. I tested this, and a short/long rest will then properly restore all Pact Slots (without DAE).


Full screen Figure

Bokeh 0.13.0 opens up custom HTML, CSS and JS. Change figure to use full screen positioning

It is possible to access a Figure instance in bokehjs
let figure = Bokeh.documents[0].roots()[0];
figure.width = window.innerWidth;
figure.height = window.innerHeight;

A call back can be assigned to watch innerWidth and innerHeight changes and update the associated bokeh.js Figure instance dynamically

Stack overflow suggests hooking in to window.onresize

I prefer window.addEventListener('resize', resize) to prevent other resize call backs being replaced


Replace kube-vip with MetalLB to expose Tinkerbell services

For EKS-A baremetal, we expose Tinkerbell services using kube-vip loadbalancer. We recently released MetalLB curated package and that will be the default LB so we need to migrate the Tinkerbell services to use that instead

May I ask why MetalLB was chosen over kube-vip? As I mentioned here, one benefit of kube-vip is that it can load balance services as well as the Kubernetes API.

This is for an internal dependency of Tinkerbell stack that is used for creating bare-metal clusters.


How to build code with flow "correctly" before pushing to npm?

This is a little vague question, but I have to ask it.
I have a code with Flow type annotations, that I want to put into a package and push to npm repository.
I want people, who don't use Babel and don't have transform-flow-strip-types babel plugins installed to be able to just require my package and use it outright. On the other hand, I want people who do have flow to be able to typecheck against my annotations.
How to do that correctly? Is that even possible?
The only think I can think of is to build it with browserify and babelify, and add .js.flow annotation that I will make by hand, but that is not effective.

@jeffmo What workflow do you recommend?

Here is a script that we use: https://github.com/sim-sys/node-template/blob/master/Makefile#L89-L97
Basically, it  compile files with babel and also copies originals with .flow extension

Oh, that works too? That sounds great

Closing this issue, I didn't realize you can just copy the .js files as .js.flow.


What does this do over factorio-type-kit?

Hi,
Just found out we could use typescript to do mods now and I'm trying to figure which of those two options I should start my mod with and since you're the most recent one I figure I would ask here.
Why should I use this over factorio-type-kit.. like what was the motivation behind doing your own solution rather than using the other existing one?
Thanks!

Hi, thanks for inquiring!
factorio-type-kit itself says it has 70-80% complete types. Also, when working with it a while back, I found many bugs and incomplete definitions -- such as variant parameter groups not being handled properly. I ended up manually editing the definitions during the project.
I made this project to fix those issues, provide type definitions as complete as possible, and provide more intelligent types by utilizing more typescript features. This type generator also takes advantage of the machine-readable json factorio api release a few months ago (factorio-type-kit used wiki scraping), and includes many manually defined additions/overrides to fill in where the json-api is lacking.
Currently, types for the runtime stage are 100% complete, i.e. all runtime factorio types have a non-trivial definition. You can find details on most of the typescript features utilized on the Readme. This project is currently getting updates as the factorio version moves or additional improvements to the types are found.

ah man, i wish you would have filed an issue with me. would have loved to fix/refactor those problems. (:wave: factorio-type-kit guy)

...this is much better :)

Im going to mark my ftk as “dont use” and point here


1.1.1 and 1.1.2 are identical, how the Envoy patch is applied?

Hi,
We build istio/proxy to get the envoy binary running on a different Linux. But 1.1.1 and 1.1.2 are identical, how can we apply the security patches for envoy?
Thanks,
yzha

I believe the patches were applied from a private repo due to the envoy embargo. They are being backported (or will be soon?) to the public repo

@howardjohn it will be really useful if decisions like this are conveyed to the broader public. Is there an easy way for anyone build a private version of istio proxy repo to build a version with Envoy patches without diverging from upstream release 1.1.2 branch?

That is about all I know, I wasn't involved with the release at all. @mjog or @silentdai can provide more info

Thanks @howardjohn Your clarification helped me out understand how 1.1.2 was built. Looks like 1.1.3 proxy tag has the correct Envoy version.

For the coming 1.1.3, according to the commit id of envoy used in file istio/proxy/istio.deps, the fix below for the securities are there, so i will wait for the official 1.1.3 release, then build my private envoy binary.

codec: reject embedded NUL in headers. (#2)  …
build: import manually minified Chrome URL lib. (#3)  …
hcm: path normalization. (#1)

Thanks.

Honestly, if I get CC'ed on another one of your tickets, I'm going to start posting goatse in reply every time it happens.

@mandarjog

@mailzyok That is correct. 1.1.2 istio-proxy was built from a private branch of envoy.
With 1.1.3 we are back to using upstream envoy sha. You should be able to build your own version of envoy from that now.

@mandarjog Thanks a lot! This issue is closed.


Fix MLFlow logger

Currently, the MLFlow logger always tries to create a new experiment by calling create_experiment. If the experiment name already exists, this throws an error - so in practice running your script for the second time will crash the run. Additionally, MLFlow considers an experiment as a collection of runs, so we don't want to create a new experiment for each run.
This PR modifies this logic by first checking if an experiment exists, creating one if necessary, and otherwise just retrieves the experiment ID.
Additionally, the MLFlow runs should be closed using mlflow.end_run() when it's not called as a context manager (as is the case for us). Do we want to add a shutdown method to the Logger base class to handle that? I can do that in this PR or in another.

Thanks for this! MLFlow hasn't been used a lot so any bug fix of feature improvement is more than welcome!


Add German translation (mostly from original German version)

This is the german version of winfile

I see I forgot to set the width of the controls.

The about menu item was removed from the context menu (what is named "Dummy Popup"); can you remove that from your version?
Otherwise, look fine to me.

Oh and please do not use tabs; 4 spaces == tab (e.g., wfloc.c).

I removed the entry and will add a new pull request as soon as I have corrected the Dialog width.
@craigwi: Where did I used tabs? I checked my files and there are only spaces.

Fixed in #176.


[v2] f7-range events not working

(using 2.0.10)
I have changed default template for f7-vue. In form.vue I changed the slider into
<f7-range min="0" max="100" value="50" step="1" :label="true" @change="alert('change');" @click="alert('click');"></f7-range>

I can see in the vue developer plugin of chrome that the event is fired, but no alert is shown

There is no change event in range component http://framework7.io/vue/range-slider.html#range-slider-events it must be @range:change="..."

And there is no click event on range. You may use native click event then as @click.native="..."

I have changed the line into
<f7-range min="0" max="100" value="50" step="1" :label="true" @range:change="onRange"></f7-range>

and added
<script>
export default {
  methods: {
    onRange() {
      console.log("bla");
    }
  }
}
</script>

This works on Chromium, i.e. the console shows bla on changing the range. But on firefox, the range does not work. I cannot change the slider and it never calls onRange
Furthermore, when I use the range withing a f7-list-item as f7-input, the event is not fired:
<f7-list class="innerlist" inset>
   <f7-list-item>
      <f7-input class="source-volume" type="range" min="0" max="100" step="1" @range:change="onRange">/f7-input>
   </f7-list-item>
</f7-list>


P0 [dev.net] - Allow hostnames to be parsed for Narwhal config

Quick review - allow hostnames to be used for Narwhal and Genesis/network configuration, not just IP addresses.
This is needed for AWS dev.net deployment (using local domain names, like in K8s, instead of fixed IPs)

looking at this I'm fairly confused on why this would be needed. At the end of the day the exact same code path is going to be called (if you look though the stdlib). this did work at some point so maybe there's something misconfigured in the environment you're running in?

@bmwill sorry the code was wrong, hopefully the new code will make it a bit more clear.   The to_socket_addrs() function returns an Iter of addresses, it's not at all the same as the old parse() method.
parse() does not work with hostnames.  It gives the same error as I got in a container:
thread 'rest_server_tests::test_concurrency' panicked at 'called `Result::unwrap()` on an `Err` value: AddrParseError(())', sui/src/config.rs:106:49
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

I have changed the default hostname to localhost which did not work before in tests.


Odd difference using text literals

λ> runEffect $ (over Text.lines (Group.maps (>-> (toDelimPipe [5,2,2]) ))) (Text.fromLazy $ "xxxxxyyzz") >-> Text.stdout
xxxxx|yy|zz|
λ> runEffect $ (over Text.lines (Group.maps (>-> (toDelimPipe [5,2,2]) ))) (Text.fromLazy $ LT.replicate 5 "x" <> "yyzz") >-> Text.stdout
xxxxx|||yyzz

toDelimPipe is:
toDelimPipe :: Monad m => [Int] -> Pipe T.Text T.Text m r
toDelimPipe offsets = do
    chunk <- await
    let text = (fixedWidthLine offsets) chunk-- trace ("chunk is: " ++ show chunk) (fixedWidthLine offsets) chunk
    if T.null text
      then (toDelimPipe offsets)
      else do yield text
              cat

I feel like both of these should return the same result.

This sounds like it is related to https://github.com/bos/text/issues/184.  See the discussion on that ticket

I updated to text 1.2.3 that includes the food from bos but it didn't seem
to fix my issue.
I also tried defining null as you suggested and still have the issue.
I can post the full code later, but do you have any ideas?
On Jun 30, 2017 10:13 AM, "Gabriel Gonzalez"<EMAIL_ADDRESS>wrote:

This sounds like it is related to bos/text#184
https://github.com/bos/text/issues/184. See the discussion on that
ticket
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/Gabriel439/Haskell-Pipes-Group-Library/issues/13#issuecomment-312294433,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AANyNzXaq2P1R4xxYafULaogZmlzHedDks5sJRCKgaJpZM4OKN3X
.

I finished the minimum repro of the issue I'm having, it looks like pipes-group is ending my group at 2047 characters even though I'm using over Text.lines:
https://github.com/codygman/minrep-pipes-text-group-issue/blob/master/src/Main.hs#L51

I thought I could do something like this:
runEffect $ over Text.lines (Group.maps (>-> toDelimPipe [682,682])) (Text.fromHandleLn hIn) >-> Text.toHandleLn hOut

But that seems to only apply toDelimPipe to one line.

Can you reproduce the problem using a pure Text value as in your original example?  The reason I ask is that this affects whether or not the bug is in pipes-group or in text


Bad BOLD skullstripping in ds000157

ds000157 sub-23_task-passiveimageviewing

Weird:

Just got this running this subject. I've tried with and without --fs-no-reconall. It remained consistent. Docker image :1.0.0 official.

What about with and without --force-syn? Because we re-compute BOLD masks after applying fieldmap correction, if I remember correctly.

That's a reasonable explanation
On Dec 21, 2017 08:34, "Chris Markiewicz"<EMAIL_ADDRESS>wrote:
What about with and without --force-syn? Because we re-compute BOLD masks
after applying fieldmap correction, if I remember correctly.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/poldracklab/fmriprep/issues/902#issuecomment-353396298,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAkhxi8MmkI_ZuUP_Uy0smTZ1m2lZvRSks5tCoiogaJpZM4RHqy1
.

With --force-syn:

Apparently, the N4BiasFieldCorrection in the reference generation workflow didn't make any correction to the intensity. However, using my local version gave me the same result I have with the docker image. Running it multiple times with multithreading didn't change anything (actually, it seems like N4BiasFieldCorrection does not spawn multiple threads, or it does not have time to spawn with these little EPI images).

https://sourceforge.net/p/advants/discussion/840261/thread/354df4c0/#116c


fixes: hovering links enhancement #781

Solution:
Text Color Change: The text color of the sublinks now changes on hover, providing a clear visual indication of interactivity.
Background Box with Pop-up Effect: A subtle background box has been added that pops up and makes the sublink content appear bigger when hovered. This creates a modern and dynamic feel to the hover state.
Font Style Change on Hover for Headings: The headings of each domain now change their font style upon hovering to further enhance interactivity.
Changes in CSS:
Sublink Hover Effect:
Text color changes to a more vibrant color on hover (e.g., $brightblue).
Added a background box with a slight scale-up effect to make the link appear larger on hover.
Heading Font Change:
The font changes to a bolder or alternate font-family when the user hovers over a heading.
issue resolved #781

Closing-reopening to run checks


Add UNINITIALIZED state to istioctl proxy-config secret

This is a state Envoy can get into when it fails to parse a secret.
Today, everything in istioctl reports its fine, when it really is just
as blocking as WARMING
Can reproduce with a cert that has the cert field in both the cert AND key section. which is not valid of course

@howardjohn: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name
Commit
Details
Required
Rerun command

integ-pilot-istiodremote-tests_istio
61b9773ca724e27a84faebb3ca1e1161c5e73796
link
true
/test integ-pilot-istiodremote-tests_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/retest

/retest


Orbit calculations don't match expected output

In the 9-17 export of the asteroids, the xyz positions are included of the asteroids. None of the position vectors from PyAstronomy match that.

Working as of ffac36bf35d99614f80bdaf2458739fe0cca6c8d


Typescript Type Definitions

Provide Typescript type definitions with this library.

I took a shot at creating the type definitions. Will be available from NPM as @types/postmate. Follow progress on PR here:
https://github.com/DefinitelyTyped/DefinitelyTyped/pull/32980

Type definitions now available via npm: @types/postmate


Solve Dependency Resolution Problem for Java 8

This PR proposes replacing the deprecated depends_on :java => "1.8" with the appropriate openjdk version.

@raffael-dzikowski thanks!
Adding a link to https://github.com/Homebrew/homebrew-core/issues/63290 for reference/posterity


bamoe-9.0.0-container-images.zip product artifact

We need to build IBM Business Automation Manager Open Editions 9.0.0 - Container Images product tar.gz artifacts. (Using Docker save)
Acceptance criteria:

The tar.gz file contains image binaries of an built branded IBM image.
There needs to be tar.gz file for each individual container image.
The tar.gz files are uploaded to a specified folder.
Required images are on Quay.io, see screenshot, except dmn-dev image.

PR is merged, closing this.


Proposal: Early evaluation of logging configuration.

Background
Currently, if Grafana Alloy fails to start, no logs are sent to Loki, even if it's configured in the main configuration. If the main configuration contains import.http, the startup fails. Since no logs are sent, an operator has to log in to the virtual machine to diagnose the issue.
Proposal
Early Evaluation of Loki Logging Configuration
If possible, evaluate the Loki logging configuration early during the startup process to ensure logs are sent even if the startup fails.
CLI Flags for Logging Configuration
Add CLI flags to configure logging settings during startup. This approach allows operators to specify logging configurations directly via command line, ensuring logs are captured early in the startup process.
Splitting Core Configuration and Metric Processing Configuration
Split the core configuration from the metric processing configuration. This separation simplifies the configuration and isolates logging settings, making it easier to ensure that logging is properly configured and operational early in the startup process.

Hi, thank you for the proposal! I'm personally not too sure if it's worth the additional complexity if we could alternatively just advise folks to run a separate Alloy cluster that is solely responsible for gathering logs.

I have a couple of ideas how such a feature may work:

We could sandbox each component DAG so that if one fails, the other ones run ok. E.g. If the logging pipeline is a DAG which consists of a logging block + loki.write, then that should be isolated from the other DAGs.
There was a discussion a few months ago about having a new clustering feature with which an Alloy instance will be the sole instances the cluster to run a specific component. The discussion was prompted by the need to run only one prometheus exporter of a given type per cluster. Maybe we could have a variation of this so that logging is ran on an Alloy instance which only does logging, so that it's more isolated from others.


Fix return checking in behaviours and constructors

Our checks to make sure that the usage of return in behaviours and constructors was overly restrictive. It was checking for any usage of return that had a value including when the return wasn't from the method itself.
For example:
actor Main
  new create(env: Env) =>
    let f = {() => if true then return None end}

Would return an error despite the return being in a lambda and therefore not returning a value from the constructor.
Fixes #3682

To be a full PR, this needs a regression test added as well as release notes and the PR comments etc cleaned up.

Hi @SeanTAllen,
The changelog - fixed label was added to this pull request; all PRs with a changelog label need to have release notes included as part of the PR. If you haven't added release notes already, please do.
Release notes are added by creating a uniquely named file in the .release-notes directory. We suggest you call the file 3971.md to match the number of this pull request.
The basic format of the release notes (using markdown) should be:
## Title

End user description of changes, why it's important,
problems it solves etc.

If a breaking change, make sure to include 1 or more
examples what code would look like prior to this change
and how to update it to work after this change.

Thanks.

When this is squashed for merging, the comment should be:

Fix return checking in behaviours and constructors
Our checks to make sure that the usage of return in behaviours and constructors was overly restrictive. It was checking for any usage of return that had a value including when the return wasn't from the method itself.
For example:
actor Main
  new create(env: Env) =>
    let f = {() => if true then return None end}

Would return an error despite the return being in a lambda and therefore not returning a value from the constructor.

Looks good, but can you also add a test showing that this works for object literals (and if it doesn't, fix the code so that it does)?

@jemc 2 additional tests were added. Let me know if it looks good. This always worked for object literals. The problem was the check came before the lambda's got desugared. The additional tests verify that it working for object literals (an axiom upon which this is based) continues to remain true.


Problem: coverall messages are annoying

See #197 for an example on how annoying this can be. This just
temporarily remove coverall tests (which isn't the matrix we're
monitoring right now).

Don't merge yet. @splix has disabled comments for coveralls. So it might has been fixed already but we might still keep coverall enabled. I'll test this tomorrow.

Yep, we don't have this issues any more. Thanks @splix.

Coverall messages are still there. So we need to merge this.
@sjmackenzie please review.


Adds 'pa app get', solving #2110

Adds 'pa app get', solving #2110

Awesome! Let's get it reviewed asap 👏

Merged manually. Thank you! 👏


Update set-up-sso-azure-active-directory.md

Update the expiration value for client secret to reflect the option in Azure AD
What are you changing in this pull request and why?

Checklist

[ ] Review the Content style guide and About versioning so my content adheres to these guidelines.
[ ] Add a checklist item for anything that needs to happen before this PR is merged, such as "needs technical review" or "change base branch."

Adding new pages (delete if not applicable):

[ ] Add page to website/sidebars.js
[ ] Provide a unique filename for the new page

Removing or renaming existing pages (delete if not applicable):

[ ] Remove page from website/sidebars.js
[ ] Add an entry _redirects
[ ] Ran link testing to update the links that point to the deleted page

🚢


chore: make some source log debug instead of info

I hereby agree to the terms of the RisingWave Labs, Inc. Contributor License Agreement.
What's changed and what's your intention?

When the parallelism is high, the log can easily fill up several pages.
The logs seem only useful for developers who want to do debugging.

Checklist

[ ] I have written necessary rustdoc comments
[ ] I have added necessary unit tests and integration tests
[ ] I have added test labels as necessary. See details.
[ ] I have added fuzzing tests or opened an issue to track them. (Optional, recommended for new SQL features #7934).
[ ] My PR contains breaking changes. (If it deprecates some features, please create a tracking issue to remove them in the future).
[ ] All checks passed in ./risedev check (or alias, ./risedev c)
[ ] My PR changes performance-critical code. (Please run macro/micro-benchmarks and show the results.)

[ ] My PR contains critical fixes that are necessary to be merged into the latest release. (Please check out the details)

Documentation

[ ] My PR needs documentation updates. (Please use the Release note section below to summarize the impact on users)

Release note
If this PR includes changes that directly affect users or other significant modifications relevant to the community, kindly draft a release note to provide a concise summary of these changes. Please prioritize highlighting the impact these changes will have on users.

It should be ok if one source only print once? I think it is helpful to see if source works as expected.


PayloadTypeWebRTCBinary mapped to deprecated value

The PPID for the binary data type PayloadTypeWebRTCBinary is currently defined as 52 (file https://github.com/pions/webrtc/blob/master/internal/sctp/chunk_payload_data.go#L75)
Shouldn't it be equal to 53 instead, per IETF spec: https://tools.ietf.org/html/draft-ietf-rtcweb-data-channel-13#section-8
   +-------------------------------+----------+-----------+------------+
   | Value                         | SCTP     | Reference | Date       |
   |                               | PPID     |           |            |
   +-------------------------------+----------+-----------+------------+
   | WebRTC Binary Partial         | 52       | [RFCXXXX] | 2013-09-20 |
   | (Deprecated)                  |          |           |            |
   | WebRTC Binary                 | 53       | [RFCXXXX] | 2013-09-20 |
   +-------------------------------+----------+-----------+------------+

As a matter of fact, sending binary data from chrome will fail using the following code:
let message = new Uint32Array(2)
sendChannel.send(message)

pions/webrtc will fail with the message Unhandled Payload Protocol Identifier Unknown Payload Protocol Identifier: 53.
if changing the PayloadTypeWebRTCBinary value from 52 to 53 - then the above example works - although I have not done any intensive testing.

Yep! This looks like a typo, thanks for catching it!

Associated fix / pull request: https://github.com/pions/webrtc/pull/86

This was fixed by the merged PR for #86
Thanks again @ronanj


Tensorflow crashes python when using Keras Convolution/Max Pooling layers on rtx 3070

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): No.
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Windows 10 Pro
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device:
TensorFlow installed from (source or binary):
TensorFlow version (use command below): pip install tensorflow-gpu==2.4.0-rc0
Python version: 3.8
Bazel version (if compiling from source):
GCC/Compiler version (if compiling from source):
CUDA/cuDNN version: 11.1/8
GPU model and memory: RTX 3070 (8gb)

Current Behavior
Running "Code 1" [in standalone code sect.] works fine and engages the GPU, obviously the results are garbage but it is an illustrative example.
By adding either a convolutional layer, max pooling layer, or both and running "Code 2" [in standalone code sect.] causes python to crash and yields the terminal output in the "other info" section. The error comes when the model.fit(...) call is made; the model is able to compile successfully but crashes on the first epoch of training.
Expected behavior
Since the standard sequential ANN trains fine on the GPU i would expect the CNN to be able to train as well.
Standalone code to reproduce the issue
Code 1 - works fine
from tensorflow.keras import datasets, layers, models

(train_images, train_labels), (test_images, test_labels) = datasets.cifar10.load_data()

train_images, test_images = train_images / 255.0, test_images / 255.0

print(tf.config.list_physical_devices('GPU'))

model = models.Sequential()
model.add(layers.Flatten())
model.add(layers.Dense(64, activation='relu'))
model.add(layers.Dense(10))

model.compile(optimizer='Adam', loss=tf.keras.losses.SparseCategoricalCrossentropy(from_logits=True))

history = model.fit(train_images, train_labels, batch_size=1, epochs=100)

Code 2 - crashes when .fit(...) is called on model
from tensorflow.keras import datasets, layers, models

(train_images, train_labels), (test_images, test_labels) = datasets.cifar10.load_data()

train_images, test_images = train_images / 255.0, test_images / 255.0

print(tf.config.list_physical_devices('GPU'))

model = models.Sequential()
model.add(layers.Conv2D(32, (3, 3), activation='relu', input_shape=(32, 32, 3)))
model.add(layers.MaxPooling2D((2, 2)))
model.add(layers.Flatten())
model.add(layers.Dense(64, activation='relu'))
model.add(layers.Dense(10))

model.compile(optimizer='Adam', loss=tf.keras.losses.SparseCategoricalCrossentropy(from_logits=True))

history = model.fit(train_images, train_labels, batch_size=1, epochs=100)

Other info / logs
2020-12-11 14:28:08.841765: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cudart64_110.dll
2020-12-11 14:28:11.095172: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2020-12-11 14:28:11.096076: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library nvcuda.dll
2020-12-11 14:28:11.124073: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties:
pciBusID: 0000:01:00.0 name: GeForce RTX 3070 computeCapability: 8.6
coreClock: 1.77GHz coreCount: 46 deviceMemorySize: 8.00GiB deviceMemoryBandwidth: 417.29GiB/s
2020-12-11 14:28:11.124461: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cudart64_110.dll
2020-12-11 14:28:11.136398: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublas64_11.dll
2020-12-11 14:28:11.136622: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublasLt64_11.dll
2020-12-11 14:28:11.139581: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cufft64_10.dll
2020-12-11 14:28:11.140535: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library curand64_10.dll
2020-12-11 14:28:11.147342: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cusolver64_10.dll
2020-12-11 14:28:11.149809: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cusparse64_11.dll
2020-12-11 14:28:11.150352: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cudnn64_8.dll
2020-12-11 14:28:11.150569: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
[PhysicalDevice(name='/physical_device:GPU:0', device_type='GPU')]
2020-12-11 14:28:11.153569: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2020-12-11 14:28:11.154591: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties:
pciBusID: 0000:01:00.0 name: GeForce RTX 3070 computeCapability: 8.6
coreClock: 1.77GHz coreCount: 46 deviceMemorySize: 8.00GiB deviceMemoryBandwidth: 417.29GiB/s
2020-12-11 14:28:11.154972: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cudart64_110.dll
2020-12-11 14:28:11.155203: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublas64_11.dll
2020-12-11 14:28:11.155383: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublasLt64_11.dll
2020-12-11 14:28:11.155567: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cufft64_10.dll
2020-12-11 14:28:11.155753: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library curand64_10.dll
2020-12-11 14:28:11.155934: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cusolver64_10.dll
2020-12-11 14:28:11.156112: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cusparse64_11.dll
2020-12-11 14:28:11.156288: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cudnn64_8.dll
2020-12-11 14:28:11.156488: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2020-12-11 14:28:11.595698: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-12-11 14:28:11.595908: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0
2020-12-11 14:28:11.596028: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N
2020-12-11 14:28:11.596248: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6177 MB memory) -> physical GPU (device: 0, name: GeForce RTX 3070, pci bus id: 0000:01:00.0, compute capability: 8.6)
2020-12-11 14:28:11.597093: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2020-12-11 14:28:12.139175: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
Epoch 1/100
2020-12-11 14:28:12.386035: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublas64_11.dll
2020-12-11 14:28:13.019914: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublasLt64_11.dll
2020-12-11 14:28:13.024711: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cudnn64_8.dll
Process finished with exit code -1073740791 (0xC0000409)

@taylrcawte,
Could you please update TensorFlow to v2.4.0rc4 and check if it works.
Also, try setting a hard limit on the total GPU memory as per this guide and let us know if you are facing the same issue. Thanks!

No changes in behavior following the above recommendations; Version=2.4.0rc4 and limiting GPU memory growth with the below yields a python crash with Process finished with exit code -1073740791 (0xC0000409)
Limit memory growth with:
gpus = tf.config.experimental.list_physical_devices('GPU')
if gpus:
  # Restrict TensorFlow to only allocate 1GB of memory on the first GPU
  try:
    tf.config.experimental.set_virtual_device_configuration(
        gpus[0],
        [tf.config.experimental.VirtualDeviceConfiguration(memory_limit=1024)])
    logical_gpus = tf.config.experimental.list_logical_devices('GPU')
    print(len(gpus), "Physical GPUs,", len(logical_gpus), "Logical GPUs")
  except RuntimeError as e:
    # Virtual devices must be set before GPUs have been initialized
    print(e)

@taylrcawte,
I was able to run the code with TF v2.4 stable version without any issues. Please check the attached screenshot for reference.

Could you please try running the code in a virtual environment and check if it works. Thanks!

it is being run in a venv already, and still crashes python with stable release.

@amahendrakar i reinstalled Cuda11.0/cudnn8, and uninstalled and reinstalled tensorflow 2.4 and then ran the code again, i previously had cuda 11.1 and 10.2 installed on the same machine; is there a way to tell if the previous versions of cuda are interfering?
2020-12-17 11:04:21.846887: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cudart64_110.dll
2020-12-17 11:04:23.182121: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2020-12-17 11:04:23.182665: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library nvcuda.dll
2020-12-17 11:04:23.209308: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties:
pciBusID: 0000:01:00.0 name: GeForce RTX 3070 computeCapability: 8.6
coreClock: 1.77GHz coreCount: 46 deviceMemorySize: 8.00GiB deviceMemoryBandwidth: 417.29GiB/s
2020-12-17 11:04:23.209700: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cudart64_110.dll
2020-12-17 11:04:23.212767: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublas64_11.dll
2020-12-17 11:04:23.212993: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublasLt64_11.dll
2020-12-17 11:04:23.214872: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cufft64_10.dll
2020-12-17 11:04:23.215484: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library curand64_10.dll
2020-12-17 11:04:23.219111: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cusolver64_10.dll
2020-12-17 11:04:23.220411: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cusparse64_11.dll
2020-12-17 11:04:23.221049: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cudnn64_8.dll
2020-12-17 11:04:23.221260: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2020-12-17 11:04:23.221809: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2020-12-17 11:04:23.222777: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties:
pciBusID: 0000:01:00.0 name: GeForce RTX 3070 computeCapability: 8.6
coreClock: 1.77GHz coreCount: 46 deviceMemorySize: 8.00GiB deviceMemoryBandwidth: 417.29GiB/s
2020-12-17 11:04:23.223118: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cudart64_110.dll
2020-12-17 11:04:23.223343: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublas64_11.dll
2020-12-17 11:04:23.223522: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublasLt64_11.dll
2020-12-17 11:04:23.223707: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cufft64_10.dll
2020-12-17 11:04:23.223889: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library curand64_10.dll
2020-12-17 11:04:23.224068: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cusolver64_10.dll
2020-12-17 11:04:23.224248: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cusparse64_11.dll
2020-12-17 11:04:23.224419: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cudnn64_8.dll
2020-12-17 11:04:23.224607: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2020-12-17 11:04:23.643601: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-12-17 11:04:23.643789: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0
2020-12-17 11:04:23.643925: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N
2020-12-17 11:04:23.644157: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6177 MB memory) -> physical GPU (device: 0, name: GeForce RTX 3070, pci bus id: 0000:01:00.0, compute capability: 8.6)
2020-12-17 11:04:23.644947: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
1 Physical GPUs, 1 Logical GPUs
[PhysicalDevice(name='/physical_device:GPU:0', device_type='GPU')]
2020-12-17 11:04:24.926289: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
Epoch 1/100
2020-12-17 11:04:25.241425: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublas64_11.dll
2020-12-17 11:04:25.827191: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublasLt64_11.dll
2020-12-17 11:04:25.831846: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cudnn64_8.dll
Process finished with exit code -1073740791 (0xC0000409)

I was experiencing the exact same problem. The process will crash only when using a Convolution Layer, with
Process finished with exit code -1073740791 (0xC0000409)
System information

OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Windows 10 Pro
TensorFlow version (use command below): pip install tensorflow-gpu==2.4.0
Python version: 3.6.5
CUDA/cuDNN version: 11.0/8.0.1
GPU model and memory: RTX 3060 (6gb)

I tried everything that I can find on the internet, but nothing solved the problem.
In the end I just downgraded to:

TensorFlow version (use command below): pip install tensorflow-gpu==2.3.0
CUDA/cuDNN version: 10.1/7.6.0

This did solve the issue and my model will compile and fit without problem.

@MattYoon Thanks for the input but the 3000 series RTX cards are not compatible with Cuda < 11 because they are running on ampere architecture rather than turing; so for other users this may be helpful however for me it is not.

@taylrcawte,
TensorFlow v2.4 is build and tested against CUDA 11 (not CUDA 11.1).
In this case could you please uninstall CUDA and cuDNN completely. Then install CUDA 11 with cuDNN 8 and check if it works. Thanks!

@amahendrakar ; TF is being run with 11.0 and cudnn 8.0.3 and it still does not work. No other versions of cuda or cudnn are present on local machine anymore.

@amahendrakar i reinstalled Cuda11.0/cudnn8, and uninstalled and reinstalled tensorflow 2.4 and then ran the code again, i previously had cuda 11.1 and 10.2 installed on the same machine; is there a way to tell if the previous versions of cuda are interfering?
2020-12-17 11:04:21.846887: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cudart64_110.dll
2020-12-17 11:04:23.182121: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2020-12-17 11:04:23.182665: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library nvcuda.dll
2020-12-17 11:04:23.209308: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties:
pciBusID: 0000:01:00.0 name: GeForce RTX 3070 computeCapability: 8.6
coreClock: 1.77GHz coreCount: 46 deviceMemorySize: 8.00GiB deviceMemoryBandwidth: 417.29GiB/s
2020-12-17 11:04:23.209700: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cudart64_110.dll
2020-12-17 11:04:23.212767: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublas64_11.dll
2020-12-17 11:04:23.212993: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublasLt64_11.dll
2020-12-17 11:04:23.214872: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cufft64_10.dll
2020-12-17 11:04:23.215484: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library curand64_10.dll
2020-12-17 11:04:23.219111: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cusolver64_10.dll
2020-12-17 11:04:23.220411: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cusparse64_11.dll
2020-12-17 11:04:23.221049: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cudnn64_8.dll
2020-12-17 11:04:23.221260: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2020-12-17 11:04:23.221809: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2020-12-17 11:04:23.222777: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties:
pciBusID: 0000:01:00.0 name: GeForce RTX 3070 computeCapability: 8.6
coreClock: 1.77GHz coreCount: 46 deviceMemorySize: 8.00GiB deviceMemoryBandwidth: 417.29GiB/s
2020-12-17 11:04:23.223118: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cudart64_110.dll
2020-12-17 11:04:23.223343: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublas64_11.dll
2020-12-17 11:04:23.223522: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublasLt64_11.dll
2020-12-17 11:04:23.223707: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cufft64_10.dll
2020-12-17 11:04:23.223889: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library curand64_10.dll
2020-12-17 11:04:23.224068: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cusolver64_10.dll
2020-12-17 11:04:23.224248: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cusparse64_11.dll
2020-12-17 11:04:23.224419: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cudnn64_8.dll
2020-12-17 11:04:23.224607: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2020-12-17 11:04:23.643601: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-12-17 11:04:23.643789: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0
2020-12-17 11:04:23.643925: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N
2020-12-17 11:04:23.644157: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6177 MB memory) -> physical GPU (device: 0, name: GeForce RTX 3070, pci bus id: 0000:01:00.0, compute capability: 8.6)
2020-12-17 11:04:23.644947: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
1 Physical GPUs, 1 Logical GPUs
[PhysicalDevice(name='/physical_device:GPU:0', device_type='GPU')]
2020-12-17 11:04:24.926289: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
Epoch 1/100
2020-12-17 11:04:25.241425: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublas64_11.dll
2020-12-17 11:04:25.827191: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublasLt64_11.dll
2020-12-17 11:04:25.831846: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cudnn64_8.dll
Process finished with exit code -1073740791 (0xC0000409)

@ymodak update; i did a clean install of windows, reinstalled cudnn 8 and cuda 11 and still get the same crash and error message.

@ymodak update; when running the program from terminal and not in an IDE the error message is
Could not load library cudnn_ops_infer64_8.dll. Error code 126
Please make sure cudnn_ops_infer64_8.dll is in your library path!

@ymodak update; when running the program from terminal and not in an IDE the error message is
Could not load library cudnn_ops_infer64_8.dll. Error code 126
Please make sure cudnn_ops_infer64_8.dll is in your library path!

@ymodak
UPDATE:
For whatever reason when run in the IDE terminal an error message was being suppressed and Process finished with exit code -1073740791 (0xC0000409) was logged as the error message.
When run from the command line the below error messages were displayed instead of logging the exit code error.
Could not load library cudnn_ops_infer64_8.dll. Error code 126
Please make sure cudnn_ops_infer64_8.dll is in your library path!

I recognized this was a package included in the cudnn library and copy and pasted it from the bin folder in cudnn to NVIDIA GPU computing toolkit > CUDA > V11.0 > bin. This process was repeated for the below packages and the issue was resolved.
cudnn_adv_infer64_8.dll
cudnn_adv_train64_8.dll
cudnn_cnn_infer64_8.dll
cudnn_cnn_train64_8.dll
cudnn_ops_infer64_8.dll
cudnn_ops_train64_8.dll

@ymodak
UPDATE:
For whatever reason when run in the IDE terminal an error message was being suppressed and Process finished with exit code -1073740791 (0xC0000409) was logged as the error message.
When run from the command line the below error messages were displayed instead of logging the exit code error.
Could not load library cudnn_ops_infer64_8.dll. Error code 126
Please make sure cudnn_ops_infer64_8.dll is in your library path!

I recognized this was a package included in the cudnn library and copy and pasted it from the bin folder in cudnn to NVIDIA GPU computing toolkit > CUDA > V11.0 > bin. This process was repeated for the below packages and the issue was resolved.
cudnn_adv_infer64_8.dll
cudnn_adv_train64_8.dll
cudnn_cnn_infer64_8.dll
cudnn_cnn_train64_8.dll
cudnn_ops_infer64_8.dll
cudnn_ops_train64_8.dll

@ymodak
UPDATE:
For whatever reason when run in the IDE terminal an error message was being suppressed and Process finished with exit code -1073740791 (0xC0000409) was logged as the error message.
When run from the command line the below error messages were displayed instead of logging the exit code error.
Could not load library cudnn_ops_infer64_8.dll. Error code 126
Please make sure cudnn_ops_infer64_8.dll is in your library path!

I recognized this was a package included in the cudnn library and copy and pasted it from the bin folder in cudnn to NVIDIA GPU computing toolkit > CUDA > V11.0 > bin. This process was repeated for the below packages and the issue was resolved.
cudnn_adv_infer64_8.dll
cudnn_adv_train64_8.dll
cudnn_cnn_infer64_8.dll
cudnn_cnn_train64_8.dll
cudnn_ops_infer64_8.dll
cudnn_ops_train64_8.dll

After struggling to get this work for the last 3 weeks,  Installing different versions of CUDA and Tensorflow over and over again finally it worked.
I can't believe I was making such silly mistakes over and over again the solution was right in front of me but I chose to ignore it.
Thank you @taylrcawte for sharing the update.

The problem is caused due to OOM issues
My GPU RTX 3060 jumped to 12 GB as soon as a started training a simple CNN-
The only thing that helped in my case was:
pip install tf-nightly-gpu
Resolved all the problems

@ymodak UPDATE:
For whatever reason when run in the IDE terminal an error message was being suppressed and Process finished with exit code -1073740791 (0xC0000409) was logged as the error message.
When run from the command line the below error messages were displayed instead of logging the exit code error.
Could not load library cudnn_ops_infer64_8.dll. Error code 126
Please make sure cudnn_ops_infer64_8.dll is in your library path!

I recognized this was a package included in the cudnn library and copy and pasted it from the bin folder in cudnn to NVIDIA GPU computing toolkit > CUDA > V11.0 > bin. This process was repeated for the below packages and the issue was resolved.
cudnn_adv_infer64_8.dll
cudnn_adv_train64_8.dll
cudnn_cnn_infer64_8.dll
cudnn_cnn_train64_8.dll
cudnn_ops_infer64_8.dll
cudnn_ops_train64_8.dll

Oh my goodness - thank you! This was so helpful. I struggled with this too and was installing and uninstalling different versions of keras and tensorflow. I only found this post because the error I was seeing was identical to the crash you were seeing. Thanks for posting this. Super big help.


Settings object fails to create with FMOD installed

Hello! Thought I'd let you know about an odd conflict of settings I discovered. My project has the FMOD Unity plugin installed, and when I tried installing Hierarchy Decorator, it gave me a null reference exception at line 101 of HierarchyDecorator.cs. After digging into it a bit, it seems the settings asset was failing to be created/found. Trying to trace where the problem was, I discovered that it seemed to think the settings asset already existed, which it didn't, and was then failing to create a new one.
In AssetUtility.cs, in FindOrCreateScriptable, the guids array is getting populated with one pre-existing asset: FMODStudioSettings.asset.
I discovered this by adding after line 56:
string scriptablePathTest = AssetDatabase.GUIDToAssetPath(guids[0]);
Debug.Log(scriptablePathTest);

This printed:
Assets/Plugins/FMOD/Resources/FMODStudioSettings.asset
UnityEngine.Debug:Log (object)

So I'm not sure why, but when the utility tries to find or create the settings, instead of creating the settings, it finds the FMOD settings, thinks its what it's looking for, and then throws an error because it's not actually the settings it needs. I'm not sure how to fix this exactly, and it's probably a weird edge case, but I thought I should give you a heads up!
EDIT: I forgot to specify, I'm using Unity 2021.1.17f1.

Hey there,
cheers for bringing this to my attention! I'm sure quite some time back I had concerns about conflicts like this as it's looking for a project asset based on name rather than the type.
I should be doing an extra step or two, checking what the actual type is and then returning the information from there. I should also be checking all results returned.
I've assigned high priority to this and I'll get a fix out as soon as possible 🙂
Cheers,
Wooshii


Detailed documentation for each value in values.yaml

Is your feature request related to a problem? Please describe.
Lack of documentation in values.yaml
Describe the solution you'd like
Just like in SCF, each value has a comment.
Describe alternatives you've considered
n/a
Additional context
n/a

https://github.com/cloudfoundry-incubator/kubecf/pull/1056 added to start on the documentation (and to ensure we don't add any new ones lacking comments).  Will still leave this open though, as that doesn't include all the sub-chart knobs.

Closing this as good enough: if we want more, we could consider writing a schema for the file instead.


Tutorial in the documentation for adding packages has a bug

Describe the bug
On the help page for adding new ports, doing vcpkg install zlib2 yields an error.
Computing installation plan...
Errors occurred while parsing C:\src\vcpkg\ports\zlib2\vcpkg.json
    $.features[0].name (an identifier): must be lowercase alphanumeric+hy
phens and not reserved (see https://github.com/Microsoft/vcpkg/tree/maste
r/docs/specifications/manifests.md for more information)
Error: failed to load port from C:\src\vcpkg\ports\zlib2
Note: Updating vcpkg by rerunning bootstrap-vcpkg may resolve this failur
e.

Environment

OS: Windows

To Reproduce
Follow the tutorial until section "Tweak the generated portfile". Then perform the command in the tutorial.

@XsongyangX, could you attach  C:\src\vcpkg\ports\zlib2\vcpkg.json file? I suspect the features part hasn't to be removed from vcpkg.json file, that results the errors, please replace vcpkg.json file with following content. I test it locally, and it installed as expect.
vcpkg.json
{
  "name": "zlib2",
  "version-string": "1.2.11",
  "description": "A Massively Spiffy Yet Delicately Unobtrusive Compression Library"
}

This is what I have right after using vcpkg's create. I thought we just add the json fields in the tutorial, not replace all of the file.
{
  "name": "zlib2",
  "version-string": "",
  "homepage": "",
  "description": "",
  "dependencies": [],

  "default-features": [],
  "features": [
    {
      "name": "",
      "description": "",
      "dependencies": []
    }
  ]
}

@XsongyangX, this is a template for a new port, since it doesn't has any dependency and features, so they need to be removed, Just replace them with the example code. Let me know if you have any others question.

Great!


USB-IF Test Suite - USB3CV HID test

Hello,
HID Class GET/SET Idle Test fails :
rv003usb  demo_gamepad testing  by USB3CV - USB 3 Gen X  ( USB 3 Command Verifier  )

This passes ANY TESTS?!?!?!!?
I never imagined it could.
That said - that's very cool.  That should totally be supportable.  Keeping issue open to revisit... Unless someone wants to fix that.
That said - I don't think this is needed.


Understanding static and dynamic routing

Article Checklist
NOTE: (1st time contributors - submit ONLY one article to get familiar with the process, quality, and style-once published, you can then submit any number of articles.)
Preliminary Checks - Formatting and Structure

[x] Does your article follow any of the suggested structure formats? - see example formats
[x] Is your article properly formatted in Markdown? - see Github Markdown guide
[x] Have you used the correct folder and file structure? - see Contribution Guidelines
[x] Is your article over 750 words? - Tool: Wordcounter.net
[x] Have you used our preferred heading structure? - H3 (###) and up
[x] Does your article provide enough value and detail about your topic? - Articles should be clear, accurate, and fully explained.
[x] Can your article be understood by beginners? - Assume the audience is smart but has no prior exposure to the common terminology in your article.
[x] Have you included a hero image that is 600x400 pixels and have the copyright to use it? - Tools: Pixlr Image Editor for resizing and Unsplash for Creative Commons images
[x] In your PR - add a comment that states "This fixes #(enter your Idea Content Form #)" to link and close your Idea Content (issue) when the PR is merged.

Grammar Checks

[x] Have you spellchecked and grammar checked your article? - Tools: Write&Improve - ProWritingAid -  Grammarly
[x] Have you checked your article for readability? - Tool: Hemmingway
[x] Have you added sources for quotes and images that aren't yours?

Technical Checks

[x] Are your code snippets properly formatted for syntax highlighting - see Syntax guide

Contribution Guidelines
For first-time contributors and for more details, see Contributing Guidelines
This fixes #1091

@hectorkambow, I'll be reviewing this article!

@raboba2re, where is the index.md file?

@jumamiller, It has been updated, sorry for that error.

@jumamiller I have made the changes.

@raboba2re, have a look at the image sources, they aren't working!

@raboba2re, have a look at the image sources, they aren't working! Better still, reference them at the end of the article!

@jumamiller The author owns the images and I have made changes to reflect that.

@raboba2re, review is done, add your author details( in case you've not).

@raboba2re, review is done, add your author details( in case you've not).

I realized this could be your "first article" since the other one is not yet ready for final review!

@raboba2re, have a look at the image sources, they aren't working! Better still, reference them at the end of the article!

@jumamiller The author owns the images and I have made changes to reflect that.

Authors are advised to use non copyrighted images in their article! Just an FYI!!!!

ops! Author details are added separately in the author's directory! read more here.

ops! Author details are added separately in the author's directory! read more here.

@jumamiller  the author's directory has been created from my first submission. Thank you .

ops! Author details are added separately in the author's directory! read more here.

@jumamiller the author's directory has been created from my first submission. Thank you .

oh thanks for clarification!

@hectorkambow, this article is ready for final review!

@jumamiller , @zolomohan I have made some serious changes, can you please go through it?

Understanding static and dynamic routing #1520.pdf
👋  Good afternoon @raboba2re
Upon running this article through our 3rd party plagiarism checker it raised a few red flags and the % was higher than we typically like to accept.
Please revisit the article to make sure we are contributing unique and original content to the community and that we are adding any sources (if we haven't already).
cc @jumamiller  just an FYI for potential future revisions - please make sure to add the plagiarism label to the PR before doing the review to help save time and effort 👍

@raboba2re  Also want to make sure that the images do not need any sources.

@raboba2re Also want to make sure that the images do not need any sources
@hectorkambow  Only two images require source, and the sources have been added.

@hectorkambow The article has been reviewed and updated to address your concerns.

@raboba2re, I noticed you constantly make changes! When an article has been marked "ready for final review" do not make changes unless you're asked to do so! an FYI

@raboba2re, I noticed you constantly make changes! When an article has been marked "ready for final review" do not make changes unless you're asked to do so! an FYI

Good day @jumamiller , @hectorkambow  requested  some changes to address  plagiarism issues.

Understanding static and dynamic routing #1520.pdf
wave Good afternoon @raboba2re
Upon running this article through our 3rd party plagiarism checker it raised a few red flags and the % was higher than we typically like to accept.
Please revisit the article to make sure we are contributing unique and original content to the community and that we are adding any sources (if we haven't already).
cc @jumamiller just an FYI for potential future revisions - please make sure to add the plagiarism label to the PR before doing the review to help save time and effort +1

@jumamiller

@hectorkambow, I'm not sure whether this article is ready for final review due to the changes made(by the contributor) without my knowledge. I will have to review this article again!
@raboba2re, when you're done with plagiarism issues, DO NOT make changes unless I ask you to do so!

@raboba2re, the article looks good, my only concern is images. Use NON-COPYRIGHTED images in your article without sources indicated.
You can get free images here for use in your article.

@jumamiller , Thank you for your time.
@jumamiller  @hectorkambow I own the copyright to all the images except two, which I referenced in the article.

@hectorkambow, he has worked on plagiarism, you can proceed with the final review (pay attention to images used).Thanks!

@jumamiller I have changed the image

@raboba2re
Due to the increased level of revisions - this article qualifies for a tiered payout.
Please reference our FAQ for more info on tiered payouts 👍
Thank you


Fix typo detaild -> detailed

Q
A

Is bugfix?
no

New feature?
no

Breaks BC?
no

Tests pass?
no

Fixed issues
Fix typo detaild -> detailed

Thanks!


feat: QR code on invite page

@sugarpusher I tagged you because I changed the styling a bit to look similar to the design, but feel free to do your magic as well.
I used this page as the source: https://www.sketch.com/s/98c659f4-66e3-4800-8c2b-ebc5125c5090/a/oMbW20x


Docker build fails at "Retrieving 'isl-0.24'"

The source code was downloaded from Github and build under Ubuntu 20.04 on Intel Platform. Apparently the code failed to build at the line "Retriebing 'isl-0.24'". After doing a search, the line is found in the file 'x86_64.config' under "dcgmbuild" directory. Apparently, when the build script tried to fetch the "isl-0.24" package from "isl.gforge.inria.fr", it failed. Changing the line "CT_ISL_MIRROTS" to point to "http://libisl.sourceforge.io" seems to  solve the build issue.

Hello,
This is a known issue with the isl dependency for GCC. We are preparing a newer version of DCGM for publication on GitHub and the issue is already fixed there.
As an alternative, you could update the crosstool-ng commit that is mentioned in the Dockerfile to point to a crosstool-ng latest commit where this issue is also already fixed.


Remove publisher connector page

I am not sure in this but I found that this page was never finished (there is missing in the document text). So, we can probably remove it.

oh content branch again 😄


Revert "Adopt activationEventsGenerator for onTaskType (#173192)"…

fixes #176006

Reverting this commit does not fix it for me, which makes me believe this is not a regression. I can still reproduce the issue in insider's when I await fetchTasks in activate of an extension with onTaskType in its activationEvents

I can still reproduce the issue with this change, which makes me think this is not a regression, but due to a change in the extension that is experiencing the issue.


SQL Injection and Cross-site Scripting in class-validator

Hello, i am updating one of my project and i've seen an error coming from this libraries.
Obfuscator-io-metro-plugin depend on javascript-obfuscator and it seems that there is a critical error on this libraries as the name of the issue say, it would be an SQL injection and cross-site scripting in class-validator. I was wondering it there was any plan on patching it or update the libraries so it get the fix (if there's one)

Thanks for creating this issue. fixed it in PR #18


Shaded iterators jar causes deployment of custom function jars to fail

The fix for issue gh-722 that was included in the last release means custom functions don't work. They  have to be shaded to apply the jackson package name transformation.
We need to back out the fix and reopen gh-722. A different approach will need to be applied to fix gh-722.

The current workaround is:
Any custom jars containing serialisers/functions that are added to Accumulo's classpath that use jackson will need to be shaded. You will need to add something similar to this in your pom:
<plugin>
    <artifactId>maven-shade-plugin</artifactId>
    <version>${shade.plugin.version}</version>
    <executions>
        <execution>
            <id>iterators</id>
            <phase>package</phase>
            <goals>
                <goal>shade</goal>
            </goals>
            <configuration>
                <shadedArtifactAttached>true
                </shadedArtifactAttached>
                <shadedClassifierName>iterators
                </shadedClassifierName>
                <relocations>
                    <relocation>
                        <pattern>com.fasterxml.jackson</pattern>
                        <shadedPattern>
                            uk.gov.gchq.gaffer.shaded.com.fasterxml.jackson
                        </shadedPattern>
                    </relocation>
                </relocations>
            </configuration>
        </execution>
    </executions>
</plugin>

Merged into develop. A script to shade jars will be used instead: gaffer-tools: 69

Migration Steps
This issue reverts the changes made by gh-722. If you made the migration changes in gh-722 then you will need to revert them.


No link to PlayFabAuthService

The tutorial is great, however it references the class PlayFabAuthService throughout. This class is not in the SDK, nor is it in the PlayFab editor extensions. I have it from prior work, but it would be great if this was included in the SDK or at least a link to the most updated version was included.
Thank you
[Enter feedback here]

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: a08c46a3-3141-4cd3-c013-7afe9a765aad
Version Independent ID: 9870d595-f100-6f1c-2ae9-90529de842c0
Content: Adding PlayFab to Endless Runner - PlayFab
Content Source: playfab-docs/resources/EndlessRunner.md
Product: playfab
GitHub Login: @mawillia
Microsoft Alias: joanlee

@samhain323 thanks for submitting this issue. i will inform the team about this.

Thanks for reporting this. Upon closer review, we determined that there are many issues with this sample and it's no longer a good base from which to provide an updated sample, so we're going to just remove it for now.


2 TAB issue

Sometimes fields are separated with two TAB instead of one. Please see attached capture.
BTW, an idea: old "get cookies.txt" extension (not yours, I know!) had a counter on the icon, was quite handy...
Nice extension, thanks!

Ok, the issue is not the 2 tabs but a missing "0" between them. Thanks

Resolved by #5 #6


re-enable more browsers

We had to temporarily disabling browsers due to localtunnel issues, which is used by zuul, and it tends to crash & fail our travis builds. I think it’s this issue here: https://github.com/localtunnel/localtunnel/issues/81
Before launching new Hoodie, we should get this fixed

Is localtunnel a dependency of zuuls' or just something hoodie is using as part of workflow generally?
Just wondering if zuul is the fault or localtunnel here..

I think it’s part of zuul. But it’s quite a while since we looked at it, if can look into it and see how the situation is these days that’d be very helpful


1.0.0-beta-3 - Page not changing on Link click.

I'm trying out the master branch of react-router on a project I'm working on. I recently pulled and rebuilt the react-router module and now none of my pages change when I click a <Link> tag, even though the URL changes. The pages do change when I move forward and back in history.
My app.js file with all the routes is something like this.
import React from 'react';
import {Route, Link} from 'react-router';

// routes
import Designer from './routes/designer/index';
import Dashboard from './routes/dashboard/index';
import {GalleryContainer, Gallery, Published} from './routes/gallery/index';

// components
import ProfileMenu from './common/ProfileMenu';

const App = React.createClass({

    render() {
        return (

                    <Link to="/" activeClassName="">

                    </Link>
                    <Link to="/designer">

Designer

                    </Link>
                    <Link to="/dashboard">

Dashboard

                    </Link>
                    <Link to="/gallery">

Gallery

                    </Link>

                    <ProfileMenu />

                {this.props.children}

        );
    }
});

export default (
    <Route component={App}>
        <Route path="/" component={Dashboard} />

        <Route component={Designer}>
            <Route path="/designer" />
            <Route path="/designer/:design" />
        </Route>

        <Route component={Dashboard}>
            <Route path="/dashboard" />
            <Route path="/dashboard/:group" />
        </Route>

        <Route component={GalleryContainer} >
            <Route path="/gallery" component={Gallery} showBanner={true} />
            <Route path="/gallery/channel/:channel" component={Gallery} />
            <Route path="/gallery/category/:category" component={Gallery} />
            <Route path="/gallery/design/:design" component={Published}/>
        </Route>
    </Route>
);

not sure what's going on, but I'm using it and my links work, maybe you aren't providing a history object to <Router/> somewhere? Let me know and I'll reopen, but we've got tests around this too so its seems weird.

It ended up being something I was doing it seems. I unfortunately have to require my routes asynchronously so I think that was messing things up.
Going from:
someAsyncAction(() => {
    const app = require('./app');
    React.render(
        <Router history={createBrowserHistory()}>
            {app}
        </Router>,
        document.body
    );
});

to:
const history = createBrowserHistory();
someAsyncAction(() => {
    const app = require('./app');
    React.render(
        <Router history={history}>
            {app}
        </Router>,
        document.body
    );
});

fixed it.

@nickclaw I am running into the same issues with the same version of the router, is the code above when rendering on the server or client?
And would you mind providing what your createBrowserHistory() implementation looks like?


Error: Unable to install extension 'github.copilot-chat' as it is not compatible with VS Code '1.95.1'.

Unable to install Github Copilot chat extension in VS Code v1.95.1
Error: Unable to install extension 'github.copilot-chat' as it is not compatible with VS Code '1.95.1'.
Set up version:

Version: 1.95.1

Commit: 65edc4939843c90c34d61f4ce11704f09d3e5cb6

Date: 2024-11-01T17:20:55.708Z

Electron: 32.2.2

ElectronBuildId: undefined

Chromium: 128.0.6613.186

Node.js: 20.18.0

V8: 12.8.374.38-electron.0

OS: Linux x64 6.11.3-arch1-1

Copilot Extension Version: v1.243.1193

Copilot Chat Extension Version: (tried most recent VSIX  available)

GitHub.copilot-chat-0.23.2024110401

GitHub.copilot-chat-0.23.2024110101

GitHub.copilot-chat-0.23.2024103101

GitHub.copilot-chat-0.23.2024103002

Steps to Reproduce:

Search for "GitHub.copilot-chat" extension in VS Code Extensions marketplace - no results
Manually download vsix from https://marketplace.visualstudio.com/items?itemName=GitHub.copilot-chat
In VS Code, select Extensions menu and click "Install from VSIX"
Select vsix file downloaded. Error shown in pop up:  "Error: Unable to install extension 'github.copilot-chat' as it is not compatible with VS Code '1.95.1'."

No additional logs

Some additional info - the Github Copilot Chat option is available on the VS Command  Palette (available following installing the Copilot extension). Selecting this does nothing (nothing logged to Copilot logs). Hence trying to install chat extension with VSIX. I also had to install the Copilot extension from the VSIX file as the extension was not showing up in the extensions search either.  I can successfully call Copilot Suggestions from within VS Code.

That VSIX requires VS Code Insiders: https://code.visualstudio.com/insiders


GetReponse return binary file

Is there any way to make GetResponse to return a binary file? I tried the following but it didn't work.
StorageFolder storageFolder = ApplicationData.Current.LocalFolder;
                StorageFile file = await storageFolder.GetFileAsync("myimage.jpg");
                if (file != null)
                {
                    var stream = await file.OpenStreamForReadAsync();
                    var bytes = new byte[(int) stream.Length];
                    stream.Read(bytes, 0, (int) stream.Length);

                    IReadOnlyDictionary<string, string> header = new Dictionary<string, string>
                    {
                        {"Content-Type", "image/jpeg"},
                        {"Content-Disposition", "myimage.jpg"},
                        {"Accept-Ranges", "bytes"},
                        {"Content-Length", stream.Length.ToString()}
                    };
                    return new GetResponse(
                        GetResponse.ResponseStatus.OK,
                        header,
                        bytes
                    );

Not by default, no. You could implement your own (handler)[https://github.com/tomkuijsten/restup/wiki/Custom-route-handler].

I want to implement a rest route that will receive a request like /api/fileid/112 and return a binary file to the user to download. Would that still be done by implementing IRouteHandler?

Jup. The default handlers uses json or xml (based on the http request headers) as return type, doesn't support binary.

Could you provide a sample how to write and use such a Routehandler?


Update Dockerfiles

Status
Ready/In Progress/In Hold (Reason for hold)
Related Content Pull Request
Related PR: link to the PR at demisto/content
Related Issues
Related: link to the issue
Description
A few sentences describing the overall goals of the pull request's commits.

Docker Image Ready - Dev
Docker automatic build at CircleCI has deployed your docker image: devdemisto/sane-doc-reports:<IP_ADDRESS>860
It is available now on docker hub at: https://hub.docker.com/r/devdemisto/sane-doc-reports/tags
Get started by pulling the image:
docker pull devdemisto/sane-doc-reports:<IP_ADDRESS>860

Docker Metadata

Image Size: 451.73 MB

Image ID: sha256:176b93d5891d996e464519fcd48d8d06d650eecdd76f0e905432462d87de9449

Created: 2022-11-24T12:19:45.481810197Z

Arch: linux/amd64

Command: ["python3"]

Environment:

PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
LANG=C.UTF-8
GPG_KEY=A035C8C19219BA821ECEA86B64E628F8D684696D
PYTHON_VERSION=3.10.8
PYTHON_PIP_VERSION=22.2.2
PYTHON_SETUPTOOLS_VERSION=63.2.0
PYTHON_GET_PIP_URL=https://github.com/pypa/get-pip/raw/66030fa03382b4914d4c4d0896961a0bdeeeb274/public/get-pip.py
PYTHON_GET_PIP_SHA256=1e501cf004eac1b7eb1f97266d28f995ae835d30250bec7f8850562703067dc6
DOCKER_IMAGE=devdemisto/sane-doc-reports:<IP_ADDRESS>860

Labels:

org.opencontainers.image.authors:Demisto<EMAIL_ADDRESS>org.opencontainers.image.revision:0ff30fa8754da52d8cdb86e041290437ceab6225
org.opencontainers.image.version:<IP_ADDRESS>860

Docker Image Ready - Production
Docker automatic build at CircleCI has deployed your docker image: demisto/sane-doc-reports:<IP_ADDRESS>307
It is available now on docker hub at: https://hub.docker.com/r/demisto/sane-doc-reports/tags
Get started by pulling the image:
docker pull demisto/sane-doc-reports:<IP_ADDRESS>307

Docker Metadata

Image Size: 451.73 MB

Image ID: sha256:5b201f48c8d3e9c311baf51a0d710675623bf29e4efb1fdc6f182e69da6dc623

Created: 2022-11-24T14:05:55.147629345Z

Arch: linux/amd64

Command: ["python3"]

Environment:

PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
LANG=C.UTF-8
GPG_KEY=A035C8C19219BA821ECEA86B64E628F8D684696D
PYTHON_VERSION=3.10.8
PYTHON_PIP_VERSION=22.2.2
PYTHON_SETUPTOOLS_VERSION=63.2.0
PYTHON_GET_PIP_URL=https://github.com/pypa/get-pip/raw/66030fa03382b4914d4c4d0896961a0bdeeeb274/public/get-pip.py
PYTHON_GET_PIP_SHA256=1e501cf004eac1b7eb1f97266d28f995ae835d30250bec7f8850562703067dc6
DOCKER_IMAGE=demisto/sane-doc-reports:<IP_ADDRESS>307

Labels:

org.opencontainers.image.authors:Demisto<EMAIL_ADDRESS>org.opencontainers.image.revision:5b5d5debf8b270e9f202a8e2fd7342e5b0c0e6ec
org.opencontainers.image.version:<IP_ADDRESS>307


error with a animated webp

When I try to load an animated webp, I get an error.
Will there be management of animated files?

Yeah, it would be nice to see the support of animated files.

Ditto. Could really use it.

Please, give me more details.
Load animated WebP into ¿....?
Convert animated WebP to ¿...?

With the version defined here, I've this error:

With any WebP animated image.
Actually, with the last commited version, there is no error but there is no image displayed.
Neverless, I can get file information:

In the new version, the DLL suport animated WebP.
But it is trying to decode and render in an image (a windows bitmap).
Bitmaps are static, so they will hardly be able to present a moving image. In addition, the windows form control does not support animations either.
So the question is, what do you want that webP to become? Where do you want to present it? What container do you want to send it to?

It does not need to handle the animation.
Ideally, we should be able to get every frame.
By their index for example.

As Lacro59 said, just be able to get every frame in a manner similar to the way an animated GIF is converted to an Image.

I need this too. Actually I would love to be able to throw a WEBP file into this library and be returned an object with a list of images. If the webp file is not an animation then there will only be 1 image in the images collection. There could also be like and IsAnimated property.
Im sure there are a bunch of other information about the file that can be returned as well. Like it animated then some info on framerate or something like that.
This would be awesome to have for sure.

来信已收到，谢谢，吼吼！O(∩_∩)O~

FWIW, I ended up using Magick.NET to convert WebP images to PNG's (single frame) or GIF's (animated). My code looks like:
    public static Bitmap NewBitmap(this FileInfo fi) {
        Bitmap bitmap = null;
        try {
            bitmap = new Bitmap(fi.FullName);
        } catch (Exception) {
          // use 'MagickImage()' if you want just the 1st frame of an animated image.
          // 'MagickImageCollection()' returns all frames
            using (var magickImages = new MagickImageCollection(fi)) {
                var ms = new MemoryStream();
                if (magickImages.Count > 1) {
                    magickImages.Write(ms, MagickFormat.Gif);
                } else {
                    magickImages.Write(ms, MagickFormat.Png);
                }
                bitmap?.Dispose();
                bitmap = new Bitmap(ms);
                // keep MemoryStream from being garbage collected while Bitmap is in use
                 bitmap.Tag = ms;
            }
        }
        return bitmap;
    }

FWIW, I ended up using Magick.NET to convert WebP images to PNG's (single frame) or GIF's (animated). My code looks like:
    public static Bitmap NewBitmap(this FileInfo fi) {
        Bitmap bitmap = null;
        try {
            bitmap = new Bitmap(fi.FullName);
        } catch (Exception) {
          // use 'MagickImage()' if you want just the 1st frame of an animated image.
          // 'MagickImageCollection()' returns all frames
            using (var magickImages = new MagickImageCollection(fi)) {
                var ms = new MemoryStream();
                if (magickImages.Count > 1) {
                    magickImages.Write(ms, MagickFormat.Gif);
                } else {
                    magickImages.Write(ms, MagickFormat.Png);
                }
                bitmap?.Dispose();
                bitmap = new Bitmap(ms);
                // keep MemoryStream from being garbage collected while Bitmap is in use
                 bitmap.Tag = ms;
            }
        }
        return bitmap;
    }

This works. But it takes a while to load the webp files. My browser can quickly load the same files. Maybe chrome is just optimized for webp files. Also they play at different framerates too.
Thanks for posting.

Still no support for animated webp?
There doesn't seem to be any wrapper that handles them yet this one suggests being "the most complete wrapper", unfortunate.

来信已收到，谢谢，吼吼！O(∩_∩)O~

I've been using  Magick.NET to convert WebP images animated GIFs for about 6 months - see my code example above. It's not super fast, but works well.


Add zero-cost bindings for the ImageEditor API

@sgny reminder: you have write access on the repo & using your fork is not required if you want :) (pr are still required to get at least one review from another contributor)


Bgra8 support

stacktrace from hoolamike:
2024-12-28T17:11:33.791449Z ERROR install_modlist:handle_directives{directives=333167}:handle{hash="XICKikzz8UU=" size=5592580 format=BC7_UNORM height=2048 mip_levels=12 width=2048 to="TEMP_BSA_FILES\\af074b5d-2703-4d83-a594-b4b406bed01d\\textures\\ks hairdo's\\equanimity2.dds" archive_hash_path=ArchiveHashPath { source_hash: "02DUdsXfSp4=", path: ["Children of the Pariah FOMOD\\Data\\00 - Universal\\textures\\KS Hairdo's\\Equanimity2.dds"] }}:could not resize texture, copying the original{reason=Error {
    context: "copying file from archive",
    source: Error {
        context: "recompressing/resizing a dds file",
        source: Error {
            context: "reading surface",
            source: UnsupportedDdsFormat(
                DdsFormatInfo {
                    dxgi: None,
                    d3d: Some(
                        R8G8B8,
                    ),
                    fourcc: None,
                },
            ),
        },
    },
}}: hoolamike::install_modlist::directives::transformed_texture: could not resize the file, but it should still work

for now I'm just keeping the original size but it would be cool to fully conform with wabbajack

This should work for you now if you switch to a git dependency with the latest commit.

thank you very much


Ability for ordinary users to add domains

It would be great if ordinary users could add domains themselfes, instead of involving the admin.

This feature would be definitely nice for users because every time our clients need to add a domain they need to send an e-mail or open a support ticket.
Also a domain quota option can be added to users so that we can limit the number of domains a user can manage when required.

@loewexy
How about open a liberapay/opencollective account so we can chip in some pizza-money for you?


[ISSUE #5741]Specifiy logback configuration file in cmd command line for windows platform

Make sure set the target branch to develop
What is the purpose of the change
close #5741
Brief changelog

Specifiy logback configuration file in cmd command line for windows platform

Verifying this change
XXXX
Follow this checklist to help us incorporate your contribution quickly and easily. Notice, it would be helpful if you could finish the following 5 checklist(the last one is not necessary)before request the community to review your PR.

[x] Make sure there is a Github issue filed for the change (usually before you start working on it). Trivial changes like typos do not require a Github issue. Your pull request should address just this issue, without pulling in other changes - one PR resolves one issue.
[x] Format the pull request title like [ISSUE #123] Fix UnknownException when host config not exist. Each commit in the pull request should have a meaningful subject line and body.
[x] Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
[x] Write necessary unit-test(over 80% coverage) to verify your logic correction, more mock a little better when cross module dependency exist. If the new feature or significant change is committed, please remember to add integration-test in test module.
[x] Run mvn -B clean apache-rat:check findbugs:findbugs checkstyle:checkstyle to make sure basic checks pass. Run mvn clean install -DskipITs to make sure unit-test pass. Run mvn clean test-compile failsafe:integration-test  to make sure integration-test pass.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

@RongtongJin @aaron-ai  PTAL~

@mxsm could you rebase the develop branch, the bazel error should have been fixed.

@aaron-ai  hava done


core-to-plc: abstract datatypes (CGP-310)

This is a fairly significant change to codegen. At the moment, we
generate all types inline. This has the advantage of simplicity, and
makes constructing and destructing types nice and easy, but the
resulting code is very hard to read, and inlining everything makes it
very big as well.
Instead, we now use the "abstract data type" style of definition. This
is quite fiddly for reasons I won't repeat here - see the Abstract data types note in the code for a detailed explanation of what's going on.
The resulting codegen does not look much better for small examples,
because there is still a fair amount of overhead in defining the types,
and we now need explicit constructor and matcher functions. However, I
think it will pay off a lot for bigger examples.
This also makes it easier to support hoisted definitions for non-locally
defined terms, although we don't do that yet.

I'll merge this in a bit since people seem happy.

Thanks for the review - I didn't realise you were looking at it otherwise I would have waited (and my follow-up has got stuck anyway). I'll address your comments in another PR.


[Doc] Wrong handleFastifyError signature or typo in example

The doc uses:
handleFastifyError(reply, e)

Code:
function handleFastifyError(e, res)  // <---- inversed

No PR, cuz not sure which one is intended. Should be a simple fix though.

seems express adaptor also got the same issue

Perfect thanks for calling this out


Production Security Approval

Backlog Task
Work with our CDC security contact to perform Fortify scans on our code base.
Completion Criteria

[ ] Fortify scan completed and results shared securely with the team.
[ ] Depending on severity, additional tasks are created to address the Fortify scan findings.

Tasks

[x]<EMAIL_ADDRESS>is the contact address
[ ] Verify if this is a one time scan or ongoing?
[ ] Update onboarding checklist to have people add themselves after they have a CDC account

Combine with #721?

Ensure "additional automated security scanning (could be informed by the ISSO)." Per Eng Block on 1/17/24

https://docs.cdc.gov/docs/devsecops/services/code-scan/fortify

I requested access to fortify from the cdc sharepoint form and am awaiting a response.  After I hear back I can request access for everyone on the team

I just emailed the SoftwareAssurance team at the cdc to follow up on the access to fortify scans.  I haven't received any word from them so figured I'd give them a poke to get a status update.

This is in progress and confirmed that the information I gave to the Fortify team is sufficient.

This should be for both the intermediary and the ingestion service.

Finished our first pass on Fortify. We marked what we thought were false positives and set the remaining issues as under review due to needing research or a group decision to be made.


Added information that either text or summary is required in MessageCard

Fixes #811

Docs Build status updates of commit f2411a8:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/actionable-messages/message-card-reference.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Crash when trying to interact with currency

Information

Minecraft Version: 1.16.5
Fabric API Version: fabric-api-0.36.0+1.16
OS: Windows 10
Other installed mods: Plenty. A full list is contained in the Crash Log.

Describe the issue
Whenever I try to do something which alters a player's balance (/bal works to view the initial value), the server hangs with an SQLite exception.
Up to and including adding things to and viewing the Market is fine, but adjusting a player's balance or attempting a purchase in the Market hangs the server.
Crash/Error logs
https://pastebin.com/Z9z4VfLq
To Reproduce
Steps to reproduce the behavior:

Open Minecraft
Open a new world/connect to a server with Gunpowder
Attempt to do anything that manipulates your balance
See error

Expected behavior
No crash when trying to adjust currency.
Additional context
I feel like I might be missing something, but I didn't find any instructions. Maybe I need to install a program that can manipulate .db files?

Can you attach your gunpowder.db?

Thing is, I've tried deleting it, and no luck with the freshly-generated one.
I'd love to attach it just in case, but Github complained that it doesn't support that filetype.

There's been multiple reports of this on 1.16. Basically what happens is I take everything from the database file and load it in, then when changing data it checks if we have it loaded, otherwise it creates a new entry. The weird part is that it tries to create a new entry when it exists and should be loaded in... and I have no clue why.