Training on tokens available in textual file and how could I achieve a best model?

Dear all,
I am new in the field of NLP. I find transformer library, which is amazing well to generate text.
I came across your post  about how could I train new language by using transformer.
Based on that, I have a question that I have already bunch of tokens available in text file (.txt) of programming language gathered from many repositories, separated with space character. I would like to first train tokenizer model as recommended by you, and then use transformer code run_lm_finetuning to fine tune the model as you have suggested.
For this purpose, what changes do I need to make in the code and how could I achieve best model?
Please advise.

Hello,
Have you tried to follow the readme?


revert #96

so that we don't get akka.http.scaladsl.server.RejectionError: null when something goes wrong

@leonardehrenfried as the author of #96, what do you think about #202 and this PR?

I must admit that this was a while ago but isn't a RejectionError the correct type for when the client JSON cannot be deserialised properly? It's useful to tell two cases apart:

the client's JSON is not valid: HTTP 400
an exception was thrown during processing of the request: HTTP 503

Again, I haven't kept up with the development of this repo so I don't exactly know how things are handled these days, but as long as I can know what type of HTTP status code to send to the client, I'd be happy with the solution.
If the problem is the missing error message, then throwing a IllegalArgumentException(JsError.toJson(e).toString) isn't going to help, is it? In such a case I would argue that it's better to improve the error message rather than throwing a generic exception. Perhaps it would be enough to implement getMessage.

@leonardehrenfried I think the problem is that one can use this library on the client side, too, where a rejection is undefined. See #202.

I see.
I don't use akka-http or play-json anymore so I don't want to block this change but since the error message is contained in PlayJsonError wouldn't it be enough to implement getMessage in RejectionError? The ultimate goal to give a meaningful error message, isn't it?

The point here is that the concept of a rejection is only meaningful on the server. Marshalling and unmarshalling – as supported by this library – are not restricted to the server.

@dhoss Thanks!


Fix numeric promotion rules

@gaurav-arya this should address your comment in #78.
Now you can do
[3.0, 1u"m"]

and it will be an array of Quantity{Float64,...}.

Sounds good. Yeah I just have no idea how to figure out the ambiguity for things like
julia> using DynamicQuantities, Measurements

julia> [0.3±0.1, 3u"km/s"]
2-element Vector{Number}:
        0.3 ± 0.1
 3000.0 m s⁻¹

i.e., should this be a Measurement{Quantity} or a Quantity{Measurement}? If we define a promotion rule over all of Number we would effectively be choosing Quantity{Measurement} which seems like undesired behavior. Wdyt?


Share new keys with connected dApps

Chore
When a user adds a key to their wallet, we need to "tell" dapps about it so that they can reflect the new key in their UIs.
Tasks

[ ] There is a way tell the dapp someone has added keys because someone has added keys
[ ] If Console is open and connected and then someone creates a new key on the wallet, Console should reflect that immediately and not need a refresh
[ ] The event should be app agnostic, it shoudl work for console and any other dapp that wants to connect.

Notes

I think this is already done?  When I create a new key in the wallet and I'm connected to Console it is displayed immediately ... I dont have to refresh or anything?


Prevent double run of checks with same UUID, improve logging.

Please provide a description @xlab

DO NOT MERGE.

Closing PR (DEV-928)


Disabling opacity component causes issues with swatches

Do you want to request a feature or report a bug?
Bug
What is the current behavior?
Disabling opacity component causes swatches to no longer work properly. It seems to select the incorrect swatch and only gets the correct one on the second selection. Happens consistently in my software, fiddle seems intermittent.
https://jsfiddle.net/e7o98g3c/
What is the expected behavior?
Swatch selection choses proper color upon click.
Your environment:
Pickr-version (see Pickr.version): 0.6.1
Used Pickr-bundle (es5 or normal one): normal
Browser-version: Firefox 67
Operating-system: MacOS Mojave

Fixed in fe0264ed92091ba6b03d3947975851b4955e2a60 :)


What is proper way to preserve/refresh login state, when redirecting back from other app after refresh_token exp time?

hi,
Describe the bug
Its not a bug, but general/support question (so please forgive me clearing the default post headers).
Support request
I have two angular apps: AppA and AppB. Both use angular-oauth2-oidc. Keycloak is the IDP. Here is the scenario: User logs in in AppA (code flow). At some point of time User (because of business logic) from AppA redirects to AppB. AppB logs in too thruu code flow. User works on AppB longer then AppA refresh_token exp. time. App B still has valid refresh_token thru silent refresh, and of course valid session exists on Keycloak. Now: User wants to redirect back to AppA.
The question: What is a proper way to preserve/refresh login state on AppA?
I managed it to work but in a bit weird/cumbersome way:
  const authConfig: AuthConfig = {
    issuer: [some issuer from config],
    redirectUri: window.location.origin + '/appContext/',
    clientId: 'the_client',
    responseType: 'code',
    scope: 'openid',
    showDebugInformation: true,
    waitForTokenInMsec: 300,
  };

  const isRedirect = funcToRecognizeRedirectFromAppB();

  oauthService.configure(authConfig);
  oauthService.setupAutomaticSilentRefresh();
  return from(oauthService.loadDiscoveryDocumentAndTryLogin()
    .then((_) => {
      if (oauthService.getRefreshToken()) {
        return oauthService.refreshToken()
          .then(() => {
            return Promise.resolve(true)
          } )
          .catch(() => { //so here I know that there was trouble with refresh_token
            if (isRedirect) { //here I know that i am currently redirecting from AppB
              sessionStorage.clear() //I need to clear it because if not "loadDiscoveryDocumentAndLogin" will try refresh access token using invalid refresh token
              return oauthService.loadDiscoveryDocumentAndLogin() //login automatically (I know that keycloak session exists)
              .then(() => {
                return Promise.resolve(true);
              })
              .catch(() => {
                return Promise.resolve(false);
              })
            }
            else {
              return Promise.resolve(false);
            }
          });
      }
      else {
        return Promise.resolve(false);
      }
    })
    .catch((err) => {
      return Promise.resolve(false);
    })).pipe(
      switchMap((flag) => {
        return someOtherInitOperations();
      }),
    )```

Is there any simpler way to check if session exists on keycloak and reauthenticate when no valid refresh_token (and without, for example, that ugly storage clearance?)
Thanks in advance for help.

Hi I figured out that when AppA and AppB are put to the same domain things are much more simpler. Both apps share storage (session storage) when is same domain, so refreshed tokens from AppB are visible by AppA and vice versa. I can use silent refresh and my code from previouse example shrinks to:
  const authConfig: AuthConfig = {
    issuer: [some issuer from config],
    redirectUri: window.location.origin + '/appContext/',
    clientId: 'the_client',
    responseType: 'code',
    scope: 'openid',
    showDebugInformation: true,
    waitForTokenInMsec: 300,
  };

  oauthService.configure(authConfig);
  oauthService.setupAutomaticSilentRefresh();
  return from(oauthService.loadDiscoveryDocumentAndTryLogin()).pipe(
      switchMap((flag) => {
        return someOtherInitOperations();
      }),
    )


Orca doesn't announce default value in drop down

Testing #107610

ubuntu20 w/ orca
navigate into "Editor: Render Whitespace"
go through the list of options
:bug: is option is read out expect for the default option

Also, In Mac, voice over does not announce that the option is default.


impossible to type '{' on french keyboard with OS X

VSCode Version: 0.10.11
OS Version: OS X 10.11.3

Steps to Reproduce:

type alt-(
Nothing happen

My keyboard is a french azerty (Apple style)
It works in terminal and other editors like Emacs, but I have the same problem with Atom.
I guess it might be related to https://github.com/atom/atom-keymap/issues/35
Without this key, the editor is useless to me.

@jbpotonnier I have just tried on a fresh install of VSCode 0.10.11 on the Mac with the French azerty keyboard layout. Since I have a physical keyboard in English I type Alt+5 and I get a {.
Is it possible that you have installed some extensions that bind alt+5. Does this reproduce if you run VSCode without extensions (the --disable-extensions flag)?

@alexandrudima I don't think I have a special extension. I'll check tonight.

@jbpotonnier Do you still have this issue?

@alexandrudima Yes it is still here.
I'm now using vscode mostly on Linux and sometime with osx, both with dvorak mapping, so I'm not really affected, but the bug is still there.

@jbpotonnier
To clear this, I believe you mean AltGr+5 is not working for you (AltGr as in the Alt key to the right of the spacebar). I am also assuming you are on osx with the french azerty keyboard layout.
May I ask you to try the following:
Check what Chrome sends our way

Open in Chrome https://www.w3.org/2002/09/tests/keys.html
Press AltGr+5
Provide a screenshot
Here I am doing AltGr+5 on a Windows machine. Windows a slightly different kb layout for French, and AltGr+5 produces [, but the principle is the same:

keydown (0): [keyCode: 17][shift: false][ctrl: true][alt: false][meta: false]
keydown (1): [keyCode: 17][shift: false][ctrl: true][alt: false][meta: false]
keydown (2): [keyCode: 18][shift: false][ctrl: true][alt: true][meta: false]
keydown (3): [keyCode: 18][shift: false][ctrl: true][alt: true][meta: false]
keydown (4): [keyCode: 53][shift: false][ctrl: true][alt: true][meta: false]
keydown (5): [keyCode: 53][shift: false][ctrl: true][alt: true][meta: false]
keypress (6): [keyCode: 91][charCode: 91][character: [][shift: false][ctrl: true][alt: true][meta: false]
keypress (7): [keyCode: 91][charCode: 91][character: [][shift: false][ctrl: true][alt: true][meta: false]
keyup (8): [keyCode: 53][shift: false][ctrl: true][alt: true][meta: false]
keyup (9): [keyCode: 53][shift: false][ctrl: true][alt: true][meta: false]
keyup (10): [keyCode: 17][shift: false][ctrl: false][alt: true][meta: false]
keyup (11): [keyCode: 17][shift: false][ctrl: false][alt: true][meta: false]
keyup (12): [keyCode: 18][shift: false][ctrl: false][alt: false][meta: false]
keyup (13): [keyCode: 18][shift: false][ctrl: false][alt: false][meta: false]

Check what we detect

Note: Please restart or reload window in VSCode after changing keyboard layout and make sure you're on the latest version

Go to Preferences > Keyboard Shortcuts
Click on the "Define Keybinding"
Press AltGr+5
We should be detecting it as ctrl+alt+5

Check who binds this keybinding

In the Default Settings on the left, search for "ctrl+alt+5"
In the User Settings on the right, search for "ctrl+alt+5"
Please let me know if you find a keybinding bound to that key combination

Please remember to do all of the above on OSX, in the French azerty kb layout (so we're talking about the same things :))
Thanks!

@alexandrudima
Here is a screenshot of the keyboard events page after pressing altGr + 5 :

Here is another one in vscode, after pressing altGr + 5

With altGr pressed, the keys from 1 to 5 look dead, no event.

@jbpotonnier Given your first screenshot, it looks like this is a Chromium issue. i.e. Chromium gives a keydown and keyup event only for keyCode: 18 (Alt).
In other words, we are not receiving AltGr+5 because Chromium is not giving it to us.
You might have some software installed on your system that eats up these key combinations at the OS level or this might be an issue in Chromium. Please create an issue on Chromium at https://bugs.chromium.org/p/chromium/issues/list and link to it here.

It's caused by VS Code's attempt to 're-map' the keys codes so the shortcuts map to the QWERTY key positions rather than the characters. Try the hack in https://github.com/Microsoft/vscode/issues/15624#issuecomment-261412779, and if that helps, perhaps comment on the PR https://github.com/Microsoft/vscode/pull/15687.
I can use a French keyboard (just tested it) with the 're-mapping' removed.

@HookyQR That finally fixes the issue for me!

I have validated that we now (i.e. after PR #22894 aka #17521 -- in today's upcoming Insiders build) appear to behave correctly for this keyboard layout

I pressed alt+[Digit5] (aka alt+( and I correctly got { typed in the editor.

This makes me believe the fix in PR #22894 aka #17521 resolves this issue.


[CsvIO] Create CsvIOSplitFile Class

This PR closes #32016.

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[x] Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
[ ] Update CHANGES.md with noteworthy changes.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.
To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md
GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI or the workflows README to see a list of phrases to trigger workflows.

Run Java_Examples_Dataflow PreCommit

Run Xlang_Generated_Transforms PreCommit 3.8

Run Xlang_Generated_Transforms PreCommit 3.8

@damondouglas @lahariguduru what are the next steps here? Are we going to take this PR forward somehow or should we close it?


Rebond problem with iOS

Dear Espressif team
Can you tell me how to handle the following use case:
iOS device and ESP32 are bonded over BLE (just works), ESP32 makes factory reset (AT+RESTORE), then iOS want's to reconnect to device. Connecting / pairing fails always unless I remove the ESP32 device manualy from iOS device list.
When do I have to send a slave security request message (AT+BLEENC)?
At the end I have the following use cases:
Android
->Phone and ESP32 bonded, Phone removes ESP32 BT device, connect again
->Phone and ESP32 bonded, ESP32 removes Phone from pairing list, connect again
iOS
->Phone and ESP32 bonded, Phone removes ESP32 BT device, connect again
->Phone and ESP32 bonded, ESP32 removes Phone from pairing list, connect again
As of now I'm not able to go through all of this use cases without having the end user to do a manual remove of BLE device (mainly in iOS), which is a very bad user experience. Please advise.
Thank you in advance.

If ESP32 bonded with phone, No matter which party is clear the bonded information, The other end also needs to be cleared.
You can use AT+RST to restart ESP32.


Update documentation to include Go SDK (backport #2377)

A backport of pull request #2377

Why did I have been considered the author of the commit while there is a
Signed-off-by: pama-ibm<EMAIL_ADDRESS>line?
I have not changed any thing in the commit message except appending (cherry picked from commit https://github.com/hyperledger/fabric/commit/c03222079a90f5ff9dc949bfa45a7047e9bcc33a) line (The same as I had done for other accepted commits).
Is there any format error or something in the commit message?

@ryjones Do you know if the person cherry picking a fix to another branch needs to also sign the commit? Or is the original signature sufficient?
Maybe the DCO check only checks the very last line, and the cherry pick message interferes with the check?
For example in this case the commit says:
Signed-off-by: pama-ibm<EMAIL_ADDRESS>(cherry picked from commit https://github.com/hyperledger/fabric/commit/c03222079a90f5ff9dc949bfa45a7047e9bcc33a)

I'd move the cherry-pick decoration above the SoB line, @denyeart @WaleedMortaja

@denyeart @ryjones I had actually been trying to do backporting the same way the bot Mergifyio does it.
I do not think the line of cherry-pick is interfereing with the check, because both the bot and I had previous commits with the same message format (i.e., a cherry-pick line being the last line. See this for an example) and they were accepted.
I do not think it would be the cause of the problem but It may help to tell that I think I had used the command git cherry-pick <sha> in previous (accepted) commits. While I had git cherry-pick -n <sha> followed by git commit in this commit (So I would be able to change the message instead of committing and then amending).
In the commit in the example, the author of backported commit was show to be the same author of the original commit, and his sign is the only sign in the commit message. However, in this commit, the original author was dropped. I do not know why yet!
I will look into this and update you.

@WaleedMortaja if you enable "maintainers can edit PR" I will fix it up

It is already enabled

@ryjones Thank you. The DCO worked. What do yo think was the problem?
+ Can you apply the above requested edit before merging?

@denyeart I think I've fixed it

It should be main not master

@WaleedMortaja done

According to GitHub note: WaleedMortaja authored and ryjones committed. So I think pama-ibm<EMAIL_ADDRESS>is not taking any credit even though being the original author?! (By the way, I am not the author nor co-author. I have just cherry-picked a commit that I had found missing in release-2.2 branch)


Update Data Science Studio to 2.2.2 and add gratis license

Thank you for the contribution. It was merged directly as bf77f4915c72dd35df1a26348f421c739ba608d5 to keep commit history cleaner. Your contribution is still credited to you.


Support Deltalake

Which issue does this PR close?
Closes #456.
Described in issue
What changes are included in this PR?

New delta feature that allows registration of delta tables

Are there any user-facing changes?
They can use deltalake formatted tables.

:wave: I stumbled into this pull request and I'm curious what it takes to move this pul l request forward.
Also I'm not terribly familiar, yet, with ballista configuration, how would things like AWS access keys be accessed or provided to the deltalake crate on the executors when they access delta tables.

what it takes to move this pul l request forward

It was working internally for my old company. It basically just "died on the vine", because it was waiting on a DeltaLake release I think. Everything should basically just work.

AWS access keys be accessed or provided to the deltalake

The environment variables are defined in the object-store crate, and if you set them it magically just works.

@avantgardnerio Yeah I figured as such. As a delta-rs maintainer I can assure you we're having more regular releases :smile:
In some experimentation from last night it looks like I have to make sure that the scheduler and all executors are going to have the same credentials in environments.


Installing third-party software on alphafold colab not working

This error pops up when I try to install third-party software on colab:

How can I fix this issue?
Thank you so much for your time in advance.

Sorry about that! Fixed in https://github.com/deepmind/alphafold/commit/6cb85e96845ef32a888b1af0f0d3caf8e2501bc2 and https://github.com/deepmind/alphafold/commit/69afc4df91d6174d1d09f8c736c0b6d9854434ab.


Add Freecam mod

Freecam would be useful in ScumCo for inspecting builds without giving everyone ops to switch to spectator mode, but the Forge version for Minecraft 1.19.2 was pulled because it's buggy. We'll need to try with 1.19.3.

If ScumCo is ever revived for a newer version of Minecraft, perhaps it'll feature Freecam! Closing for now, though.


pythonPackages.fastpair : Updated version and pytest enabled

pythonPackages.fastpair : Updated version and pytest enabled

Motivation for this change
bug fixes and updated pytest support
https://github.com/carsonfarmer/fastpair/pull/16
https://github.com/carsonfarmer/fastpair/pull/17
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Looks good.


Link Tiles Group

Editorially managed
https://www.figma.com/file/oSetT4LbatRmXlcB2A7V8Z/Content-Hubs-2024?type=design&node-id=3454-105400&mode=design&t=glKXo7mfv14np2pL-4
Block:
Icon + Link in each row

Potential Variation:

We already have this block


Official Twitter bug affects twarc users too (error 404)

There is an official bug since a couple of week (Twitter API calls on all major platform but their apps too) get frequently 404 with unknown state. It's discussed too here:
https://twittercommunity.com/t/intermittent-404-responses-from-rest-api/46712
Despite apparent resolution by Twitter it started to raise again.
Probably users of Twarc too got it recently (requests.exceptions.HTTPError: 404 Client Error: Not Found), it looks like this:
2015-07-18 16:48:49,156 INFO archived<PHONE_NUMBER>08593152
Traceback (most recent call last):
  File "../../twarc/utils/archive.py", line 141, in <module>
    main()
  File "../../twarc/utils/archive.py", line 107, in main
    for tweet in tweets:
  File "build/bdist.macosx-10.6-intel/egg/twarc.py", line 235, in search
  File "build/bdist.macosx-10.6-intel/egg/twarc.py", line 188, in new_f
    return None
  File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/requests/models.py", line 851, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found

If it happens retry your search again till you you get it without errors. It's not a permanent failure but an intermittent failure by Twitter.
@edsu proposed to introduce a catch&retry. I share this because my opinion is that it'll happen in the future too since they killed the Whale.

@remagio do you want to give the catch-404s branch a try and see if it helps?

Yes, I'm ready with it for next scheduled jobs keeping log traces of https://github.com/edsu/twarc/compare/catch-404s#diff-22aabc32493075291fbea730860bc3dbR340

Updates @edsu: I'm still running two VM, a catch-404s and a current, both work fine during last 24h on same searches and archive.py without getting 404. Looks like Twitter is solving with tricks till they solve their infrastructures.

Ok. I guess I'd rather not add this 404 catching unless it's necessary.

I agree, better waiting official feedbacks about how they'll manage same or new return status code

FYI @edsu 404 raised up again, obviously not with the catch-404 branch

Ok, I'll merge it in.


Updating contributing.md

Missing functionality
We need to thank the contributors who've contributed to our repository.
Proposed feature
So, In the end of contributing.md can I add something like "thanks to our contributors" and show their GitHub profiles. If you are ok with this. Please assign me. Thanks.
Alternatives considered
No response
Additional context
No response

Hi @prjailani that can be found in the [Acknowledgments ](section: https://github.com/ydataai/pandas-profiling/blob/master/CONTRIBUTING.md)
Furthermore, for each and every release, we ensure that the contributors are tagged in the changelog. https://pandas-profiling.ydata.ai/docs/master/pages/reference/changelog.html?highlight=release


[NEMO-361] Consistency on indentations

JIRA: NEMO-361: Consistency on indentations
Major changes:

Runs the 'Reformat code' command on IntelliJ to auto-indent files.

Minor changes to note:

None

Tests for the changes:

None, it simply fixes the indentations and imports

Other comments:

None

Closes #207

I think using this functionality will save you time from skimming through whitespace changes.


build.rustflags is ignored

via reddit:
I'm using special flags, like:
$ cat .cargo/config.toml
[build]
rustflags = ["--cfg", "tokio_unstable"]

cargo careful does not seem to use this flag.
This is probably because we are setting rustflags ourselves, cargo stops using the flags from the toml file.

It seems like the RUSTFLAGS environment variable is ignored too, so currently this can't be used with a sanitizer.
Would fixing this require handling escaped and quoted whitespace?

Sanitizer support is being worked on in https://github.com/RalfJung/cargo-careful/pull/5, seems to be blocked on some macOS trouble.
RUSTFLAGS does not support escaping or quoting whitespace, we have to parse it the same way cargo does, or how Miri parses MIRIFLAGS:
    if let Ok(a) = env::var("MIRIFLAGS") {
        // This code is taken from `RUSTFLAGS` handling in cargo.
        let args = a.split(' ').map(str::trim).filter(|s| !s.is_empty()).map(str::to_string);

Once this is possible we probably want to revert https://github.com/RalfJung/cargo-careful/pull/11.

One interesting question here is whether RUSTFLAGS should also be applied to the stdlib build. Usually of course that is not the case, and Miri also deliberately does not apply MIRIFLAGS to the stdlib build. If we want to allow setting stdlib flags, that should probably be a separate flag?

They should apply to the stdlib build. Not applying them would diverge from the behavior of -Zbuild-std, and if people are using RUSTFLAGS to turn on sanitizers, they will always want that option applied to the standard library as well.

We have -Zcareful-sanitizer for sanitizers.
But yeah we can only be consistent with regular builds or build-std.


allow list fields as metadata in Marqo (#277)

What kind of change does this PR introduce? (Bug fix, feature, docs update, ...)
This change means that marqo is able to accept non-tensor list fields. This is useful so that users can do "contains" operations on list metadata. https://github.com/marqo-ai/marqo/issues/277

What is the current behavior? (You can also link to an open issue here)
Currently, marqo does not allow users to add lists as metadata.

What is the new behavior (if this is a feature change)?
Marqo allows users to add metadata as non_tensor fields, meaning they are available for filtering and lexical search

Does this PR introduce a breaking change? (What changes might users need to make in their application due to this PR?)
no

Have unit tests been run against this PR? (Has there also been any additional testing?)
pending succesful unit test run, handing this off for completion for now by @pandu-k

Related Python client changes (link commit/PR here)
none

Related documentation changes (link commit/PR here)
pending

Other information:

Please check if the PR fulfills these requirements

[x] The commit message follows our guidelines
[x] Tests for the changes have been added (for bug fixes/features)
[x] Docs have been added / updated (for bug fixes / features)

There is no explicit Array type, in OS: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/array.html

To test:
- Lexical search of fields (as a searchable and non searchable attr)
- Filtering (lexical and non lexical search)
- Image index

py-marqo PR: https://github.com/marqo-ai/py-marqo/pull/58
docs preview: https://gh-previews.marqo.pages.dev/0.0.13/Advanced-Usage/document_fields/#array

Unit tests passed: https://github.com/marqo-ai/marqo/actions/runs/4154756600


Group8 cpu period test

Ⅰ. Describe what this PR did
Ⅱ. Does this pull request fix one issue?

Ⅲ. Describe how you did it
Ⅳ. Describe how to verify it
Ⅴ. Special notes for reviews

Codecov Report

Merging #1681 into master will decrease coverage by 22.93%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##           master    #1681       +/-   ##
===========================================
- Coverage   41.16%   18.22%   -22.94%
===========================================
  Files         274      226       -48
  Lines       18091    14981     -3110
===========================================
- Hits         7447     2731     -4716
- Misses       9729    12068     +2339
+ Partials      915      182      -733

Impacted Files
Coverage Δ

pkg/httputils/http_error.go
0% <0%> (-100%)
:arrow_down:

pkg/httputils/http_utils.go
0% <0%> (-100%)
:arrow_down:

apis/server/router.go
0% <0%> (-91.37%)
:arrow_down:

daemon/mgr/container_state.go
0% <0%> (-87.24%)
:arrow_down:

apis/server/volume_bridge.go
0% <0%> (-86.67%)
:arrow_down:

daemon/containerio/hijack_conn.go
2.85% <0%> (-85.72%)
:arrow_down:

daemon/mgr/container_monitor.go
0% <0%> (-85.19%)
:arrow_down:

daemon/mgr/container_logger.go
0% <0%> (-84%)
:arrow_down:

daemon/mgr/spec_annotations.go
0% <0%> (-82.36%)
:arrow_down:

apis/server/container_bridge.go
0% <0%> (-82.02%)
:arrow_down:

... and 138 more

issue #1637

I am afraid in unit tests we prefer table driven test format. @faremax1992
Also it adds some extra files there. Closing this. And please feel free to reopen this if any help needed.


Hidden information visible to players

I cannot find any information about player visibility but I am assuming that items with permission set to GM/Admin only are not visible to players after importing to Foundry. In the screenshot below Teara and Anadea are not visible to players (I guess the crossed eye icon suggests that).  When I check while logged in as a player it works perfectly fine
GM view:

Player view:

But then I noticed in the Members section all information is visible to players.
GM view:

Player view:

Is this a bug? Intentional? Software limitation? Some information on how it works would be great.

Did you check the box at the bottom of the form under configuration settings?

I have it to set permissions on every update. Should I change it?

Hey, I've had a lot of stuff on my plate recently. I'll see if I can find some time to look into it soon and see if I can reproduce this!

No rush, thanks for help


Symlink is failing finding the src

Maybe I'm missing something
TASK [carlosbuenosvinos.ansistrano-deploy : ANSISTRANO | Ensure shared paths targets are absent] ***
changed: [webserver] => (item=app/data/)

TASK [carlosbuenosvinos.ansistrano-deploy : ANSISTRANO | Create softlinks for shared paths 2] ***
failed: [webserver] => (item=app/data/) => {"failed": true, "item": "app/data/", "msg": "src file does not exist, use \"force=yes\" if you really want to create the link: /var/www/vhosts/adrobot/releases/20160504204058Z/app/data/../../../../shared/app/data/", "path": "/var/www/vhosts/adrobot/releases/20160504204058Z/app/data/", "src": "../../../../shared/app/data/", "state": "absent"}

I have app/data/ as a shared. First app/data in release is removed
# Ensure symlinks target paths is absent
- name: ANSISTRANO | Ensure shared paths targets are absent
  file:
    state: absent
    path: "{{ ansistrano_release_path.stdout }}/{{ item }}"
  with_items: "{{ ansistrano_shared_paths }}"

Just next is trying to create a symlink using the path that has been removed previously.
# Symlinks shared paths
- name: ANSISTRANO | Create softlinks for shared paths
  file:
    state: link
    path: "{{ ansistrano_release_path.stdout }}/{{ item }}"
    src: "{{ item | regex_replace('[^\\/]*', '..') }}/../shared/{{ item }}"
  with_items: "{{ ansistrano_shared_paths }}"

But looks that it doesn't find the src apparently
This is my setup
---
- name: Deploys Application
  hosts: webserver
  user: deploy

  vars:
    ansistrano_allow_anonymous_stats: no
    ansistrano_deploy_from: "{{ playbook_dir}}/../"
    ansistrano_deploy_to: /var/www/vhosts/adrobot
    ansistrano_keep_releases: 4
    ansistrano_after_cleanup_tasks_file: "{{ playbook_dir}}/hooks//after-cleanup.yml"
    ansistrano_shared_paths:
      - app/data/

  roles:
    - carlosbuenosvinos.ansistrano-deploy

The file structure
app
  - data\
deployer
  - deploy.yml
  ...

Thanks a lot.

Ok
it's the trailing slash. It should be:
    ansistrano_shared_paths:
      - app/data

Closing this… sorry


Add bash file help and split step from json set up

I got a bit confused at these points and want to help people who might also get confused there

:+1:

Thanks 👌


Upgrade Cluster Autoscaler 1.27 to Latest

Issue #, if available:
Upgrade Cluster Autoscaler 1.27 to Latest
Description of changes:
Tested that the image builds locally with the updated autoscaler version.
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

/lgtm

/approve


Problem with running csg_stat on IBI simulation of polymer

I am running an IBI-based simulation of PNIPAM with 40 monomer segments. The monomer ssegment has 3 types of beads, two at the termini (TTA, TTB) and all the beads in the middle are one type of bead (TM). The molecule is PNM, and each monomer is a residue inside the molecule. The solvent is a single coarse-grained bead of water SOL, of type TW.
When I run the, ibi simulation, it stops after step_002, when it is trying to develop new potentials using the IBI framework.
My bonded distribution between TTA and TM, BOTA.dist.new, is just a bunch of zeros, and as a result, BOTA.dpot.pure_ibi is also just zeros.
I have provided all of my files in this public git repo.
The traj.xtc file I use for the csgstat command here is a large file (117 MB). I have placed it here. Please send a request for access, I will approve it instantly.
How should I go about figuring out what is wrong here? I tried csg_dump to check the topology, and from what I see, it looks to be fine...

Can you add the conf.gro to the repo? That can serve as an replacement for traj.xtc.

And you forget the water_cg.xml as well.

Added both files

If I increase the max for the BOTA bond, run csg_stat --options settings.xml --top topol.tpr --trj conf.gro --begin 0 --first-frame 0 --cg "fortynipam_cg.xml;water_cg.xml", I get an entry at 0.613, which is what I would see from the conf.gro file as well:
    1PNM    BTA    1   3.468   4.137   6.790
    1PNM    BM2    2   3.514   3.782   6.292

i.e. sqrt((3.468-3.514)^2+(4.137-3.782)^2+(6.790-6.292)^2)=0.613307.
So my guess is that the bond got overstretched, in step_001.

I would try to do IBI for the non-bonded interactions only first using an harmonic potential for the bonds that you get from fitting the distributions. Once the non-bonded interactions are converged through the bonded interactions in the mix.

I understand. The reason I picked those bond lengths is because that is what I saw from the target distributions (.tgt), which I have now added to the git repo.

Yeah, I have seen a similar things before where bonds got overstretched from too strong non-bonded interactions hence I would try to first do IBI on the non-bonded interactions and then do the bonded interactions later.
However, as you cannot do non-bonded IBI with at least some bonded interactions you will need do a harmonic fit from the target distributions.

I have two questions:

What is the difference between conf.gro and confout.gro in this case? from grep-ing "confout" and "conf" in inverse.log, mdrun seems to use confout.gro, while grompp uses conf.gro.
So I should first optimize non-bonded interactions, and then start optimizing bonded interactions. When you say performing a harmonic fit for the target distributions, do you mean finding the optimum k value for U = -kr^2 fitted on U = -kbT*log P(r)?

I am very grateful for your time and help!!

Looking at BOTA.dist.tgt, I have two observations:

the distributions is very rough, doing IBI on that is not going work, you will either need to run your all-atom simulation longer or increase the bin size.
a fit with a single harmonic might not cut it, but I would still try, r_0=0.6nm.

Got it. I will get on this right away.

I have two questions:

What is the difference between conf.gro and confout.gro in this case? from grep-ing "confout" and "conf" in inverse.log, mdrun seems to use confout.gro, while grompp uses conf.gro.

conf.gro are the initial coordinates, while confout.gro are the final coordinates after mdrun ran.

So I should first optimize non-bonded interactions, and then start optimizing bonded interactions. When you say performing a harmonic fit for the target distributions, do you mean finding the optimum k value for U = -kr^2 fitted on U = -kbT*log P(r)?

Yes, I meant a simple harmonics spring potential, .e.g U=k/2*(r-r_0)**2, gromacs has that built-in, you just need to determine the two missing numbers from the fit.

Got it. I will get on this right away.

Good luck!


Idea - Subtitles/VLC

Subtitle support?
or allow the client to stream to VLC player perhaps? to work like an ancre

Did you meant to open this on https://github.com/feross/webtorrent-desktop ?
Otherwise https://github.com/feross/webtorrent-cli already supports opening to vlc.

my bad :( the sleep deprived me didn't realize I was posting on the wrong repo

https://github.com/feross/webtorrent-desktop/issues/281


??? Performance when trained sfm-120k

Hi~
Are there any experimental results using the sfm-120k train set?
There are signs in your code that you want to use sfm-120k as the train set.
(https://github.com/tonyngjichun/SOLAR/blob/master/solar_global/examples/train.py#L40)
In my purely personal opinion, I'm noticing that many studies in this field have different train sets and same evaluation sets. I don't think this is fair.
I think both should be evaluated comparatively in the same case.
So, I'd like to know for a fair comparison.
By any chance, do you have any experimental results?
thanks~
@tonyngjichun

Hi,
Yes, I have configured the code of training on GLDv1 to be compatible with the original training script from GeM (https://github.com/filipradenovic/cnnimageretrieval-pytorch) so if you download the SfM120k dataset and the corresponding pickle files you should be able to train on it directly.
I totally agree with the inconsistencies of training sets in this field, which is a well-known problem for years. Therefore, in the paper, I did compare with GeM trained on GLDv1 as the baseline rather than the original results on SfM120k. However, I see a trend of recent image retrieval papers converging to using GLDv2-clean as the default training set, which is a good sign for the community as both SfM120k and GLDv1 suffer from quite a lot of mislabelling and noisy data,
Unfortunately, GLDv2 was not made public yet at the time of this work's submission and there is no plan to re-train or improve SOLAR models. I would highly encourage you to use the new GLDv2-clean set rather than SfM120k, which has frankly become sort of a relic of the past as the field is still progressing at an exponential rate.

Thank you for answer.
In a situation where various algorithms exist, if I have to reproudce them, the google landmark series dataset has too much data, so it takes a long time to learn.
So, I am going with sfm-120k as the default, and if I have time, I am considering the gdv2 clean version.
thank you.

I completely understand your concern as I've been in the same situation as well, GLD simply takes too long to train without industry-grade resources, so it's impossible to replicate all baselines with the same data. We could only hope that from now on all subsequent work would be converging to the same data (whether it's GLDv2 or not, only time could tell).
Good luck with your work, looking forward to seeing it soon!
Closing the issue for now.


Cannot find module './docblock'

Hi I just tried upgrade from 0.4.1 to 0.4.4 and got error described below.
{ [SyntaxError: TransformError: /path/to/project/node_modules/react-native/Libraries/vendor/emitter/EventEmitter.js: Cannot find module './docblock']
  message: 'TransformError: /path/to/project/node_modules/react-native/Libraries/vendor/emitter/EventEmitter.js: Cannot find module \'./docblock\'',
  type: 'TransformError',
  errors:
   [ { description: undefined,
       filename: undefined,
       lineNumber: undefined } ] }

Do you have any lead to solve this.
Thank you.

Resolved by killalll node


Improve Icon Search Keywords

Hi!

But at the moment, we don't have a good automatic method to complete the keywords for each icon.

You can use Thesaurus. It is a reference work that lists words grouped together according to similarity of meaning. For example try to find similar words for building: https://www.thesaurus.com/browse/building
In the search result you can see:

architecture
construction
home
house
hut

Wow, that is awesome~ We'll check if there's a way to make our keywords better with Thesaurus.
We should ensure that the search results are as accurate as possible when we add more keywords to icons.

Also you can use the semantic network like WordNet (see building) It is more complicated and high cost thing but result will be more accuracy and wider. Long time ago I used it for build index for the search suggest.


⚠ Jerry Savelle Ministries International Australia has degraded performance

In ec01bbd, Jerry Savelle Ministries International Australia (https://jsmiaustralia.org) experienced degraded performance:

HTTP code: 200
Response time: 9098 ms

Resolved: Jerry Savelle Ministries International Australia performance has improved in a511ea0 after 23 minutes.


How to get start

Hello, I have a problem in the example. My operating system is Ubuntu 20.04, but I can not find the order pacstrap. Would you please help me?

Howdy! It's been a while since I last worked on this project. But for your
question, try using debootstrap instead
On Sat, Apr 16, 2022, 01:21 Bruce @.***> wrote:

Hello, I have a problem in the example. My operating system is Ubuntu
20.04, but I can not find the order pacstrap. Would you please help me?
—
Reply to this email directly, view it on GitHub
https://github.com/waneck/openjail/issues/1, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AABLP66NA2DRJKQ2MXTBCADVFI55DANCNFSM5TR2BCZQ
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

O

Howdy! It's been a while since I last worked on this project. But for your
question, try using debootstrap instead
…
On Sat, Apr 16, 2022, 01:21 Bruce @.***> wrote:
Hello, I have a problem in the example. My operating system is Ubuntu
20.04, but I can not find the order pacstrap. Would you please help me?
—
Reply to this email directly, view it on GitHub
<#1>, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AABLP66NA2DRJKQ2MXTBCADVFI55DANCNFSM5TR2BCZQ
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

Howdy! It's been a while since I last worked on this project. But for your question, try using debootstrap instead
…
On Sat, Apr 16, 2022, 01:21 Bruce @.> wrote: Hello, I have a problem in the example. My operating system is Ubuntu 20.04, but I can not find the order pacstrap. Would you please help me? — Reply to this email directly, view it on GitHub <#1>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AABLP66NA2DRJKQ2MXTBCADVFI55DANCNFSM5TR2BCZQ . You are receiving this because you are subscribed to this thread.Message ID: @.>

Oh, thanks for your reply. I ignored your comment which is my fault.


[Feature Request:] ability to add labels to all resources generated by kubeshark

Contact Details
<EMAIL_ADDRESS>Is your feature request related to a problem? Please describe.
Currently we cannot use this  tool in our kubernetes clusters because we have web hooks in place now that require certain labels to be added or else the resource being created will be denied / not created.
Original Thread
No response
Describe the solution you'd like to see
the ability from the config file to add labels for each resources that kubeshark will create, and/or just one new location that will add labels to all.
config.yaml
//default labels for all resources to be added to anything additional added by kubeshark
labels:
       [list of labels]

//more fine grain labels ability to add labels only to certain resources generated
resources:
   worker:
       labels:
              [list of labels]
   hub:
         labels:
              [list of labels]

  etc ....

Provide additional context
No response
Code of Conduct

[X] I agree to follow this project's Code of Conduct

@mbristol580 implemented with:

https://github.com/kubeshark/kubeshark/commit/d9ec538aff2d4813ab6950bdb923ddd4a6d07e53
https://github.com/kubeshark/kubeshark/commit/b7f0dd7f3cbf54789f4bd6997a4387ea6e91b13f

You can use resourceLabels field in the config.yaml to set the required labels.

have confirmed labels are working ! and can add what i need ! Thanks


Fixed logo on welcome screen

See http://d.pr/v/15CO6
This is part of "Improved keyboard navigation"

should be single commit

codewise LGTM

and changelog entry please :)

nvm since it's part of the keyboard thing introduced here..

Coverage remained the same at 89.106% when pulling 153b3d5625117769354918fb28ae73c48b417a4d on FinalAngel:develop into 365e503f7e21e924cfae13bf7a0f8364b2e98d4c on divio:develop.

Coverage remained the same at 89.106% when pulling 153b3d5625117769354918fb28ae73c48b417a4d on FinalAngel:develop into 365e503f7e21e924cfae13bf7a0f8364b2e98d4c on divio:develop.

Coverage remained the same at 89.106% when pulling 153b3d5625117769354918fb28ae73c48b417a4d on FinalAngel:develop into 365e503f7e21e924cfae13bf7a0f8364b2e98d4c on divio:develop.

Coverage remained the same at 89.106% when pulling 153b3d5625117769354918fb28ae73c48b417a4d on FinalAngel:develop into 365e503f7e21e924cfae13bf7a0f8364b2e98d4c on divio:develop.

Coverage remained the same at 89.106% when pulling 153b3d5625117769354918fb28ae73c48b417a4d on FinalAngel:develop into 365e503f7e21e924cfae13bf7a0f8364b2e98d4c on divio:develop.

Coverage remained the same at 89.106% when pulling 153b3d5625117769354918fb28ae73c48b417a4d on FinalAngel:develop into 365e503f7e21e924cfae13bf7a0f8364b2e98d4c on divio:develop.

Coverage remained the same at 89.106% when pulling 153b3d5625117769354918fb28ae73c48b417a4d on FinalAngel:develop into 365e503f7e21e924cfae13bf7a0f8364b2e98d4c on divio:develop.

Coverage remained the same at 89.106% when pulling 153b3d5625117769354918fb28ae73c48b417a4d on FinalAngel:develop into 365e503f7e21e924cfae13bf7a0f8364b2e98d4c on divio:develop.

Coverage remained the same at 89.106% when pulling 153b3d5625117769354918fb28ae73c48b417a4d on FinalAngel:develop into 365e503f7e21e924cfae13bf7a0f8364b2e98d4c on divio:develop.

Coverage remained the same at 89.106% when pulling 153b3d5625117769354918fb28ae73c48b417a4d on FinalAngel:develop into 365e503f7e21e924cfae13bf7a0f8364b2e98d4c on divio:develop.

Coverage remained the same at 89.106% when pulling 153b3d5625117769354918fb28ae73c48b417a4d on FinalAngel:develop into 365e503f7e21e924cfae13bf7a0f8364b2e98d4c on divio:develop.

Coverage remained the same at 89.106% when pulling 153b3d5625117769354918fb28ae73c48b417a4d on FinalAngel:develop into 365e503f7e21e924cfae13bf7a0f8364b2e98d4c on divio:develop.

Coverage remained the same at 89.106% when pulling 153b3d5625117769354918fb28ae73c48b417a4d on FinalAngel:develop into 365e503f7e21e924cfae13bf7a0f8364b2e98d4c on divio:develop.

Coverage remained the same at 89.106% when pulling 153b3d5625117769354918fb28ae73c48b417a4d on FinalAngel:develop into 365e503f7e21e924cfae13bf7a0f8364b2e98d4c on divio:develop.

Coverage remained the same at 89.106% when pulling 153b3d5625117769354918fb28ae73c48b417a4d on FinalAngel:develop into 365e503f7e21e924cfae13bf7a0f8364b2e98d4c on divio:develop.

Coverage remained the same at 89.106% when pulling 153b3d5625117769354918fb28ae73c48b417a4d on FinalAngel:develop into 365e503f7e21e924cfae13bf7a0f8364b2e98d4c on divio:develop.

Coverage remained the same at 89.106% when pulling 153b3d5625117769354918fb28ae73c48b417a4d on FinalAngel:develop into 365e503f7e21e924cfae13bf7a0f8364b2e98d4c on divio:develop.

Coverage remained the same at 89.106% when pulling 153b3d5625117769354918fb28ae73c48b417a4d on FinalAngel:develop into 365e503f7e21e924cfae13bf7a0f8364b2e98d4c on divio:develop.

Coverage remained the same at 89.106% when pulling 153b3d5625117769354918fb28ae73c48b417a4d on FinalAngel:develop into 365e503f7e21e924cfae13bf7a0f8364b2e98d4c on divio:develop.


latest update not compatible with Xbox Series X?

after the latest update I can't add my series X.  I've tried renaming it and using default settings but it doesn't ask for authentication.  i have multiple xbox ones that i was able to add one by one. it's only the series X that now will not cooperate.  any ideas?
homebridge v. 1.3.4
xbox tv v. 1.6.1

I have both One X and Series X and both working correct. Try remove cashe in Homebridge.

I tried that as well.  it's showing up as loading by xboxtv but that's about it.  no auth and not showing up in homekit

nevermind me... at one point i set my IP to auto and it changed...  I updated the IP and now it's fine.  sorry for the bother.  thanks for the awesome plugin.  Also I've been waiting for this update!


Virtualdirectory listing cannot list non-ascii directories

Originally opened as dart-lang/sdk#15157
This issue was originally filed by<EMAIL_ADDRESS>
What steps will reproduce the problem?
HttpServer.bind('<IP_ADDRESS>', 8080).then((HttpServer server)
   {
      var virtualDirectory = new VirtualDirectory('path_to_root_dir');
      virtualDirectory.allowDirectoryListing = true;
      virtualDirectory.serve(server);
   });
What is the expected output? What do you see instead?
Going to a directory lists the folders as expected, but if it has a folder containing unicode characters the server crashes with "Illegal argument(s): String contains invalid characters"
What version of the product are you using? On what operating system?
1.0, Windows 8

This comment was originally written by<EMAIL_ADDRESS>
Still a problem in 1.5.1.

 Comment by sethladd

cc @skabet.
Added Area-Pkg, Pkg-HttpServer, Triaged labels.

 Comment by skabet

http_server 0.9.2+1 is now published.

Added Fixed label.

 Comment by skabet

Fix landed in dart-lang/sdk@4c9f0be0fcba89212867d92cda15af30b37776a6. It should be available in http_server 0.9.2+1, as soon as the buildbot is happy and I have someone publish it for me.

Set owner to @skabet.
Added Started label.


phoenix can't input the port

System information:

ubuntu18.04
DBeaver 6.20
Additional extensions

Connection specification:

Phoenix-hbase   4.14.1-HBase-1.2
Driver name  org.apache.phoenix.jdbc.PhoenixDriver
Do you use tunnels or proxies (SSH, SOCKS, etc)?  ssh

Describe the problem you're observing:
Database port not specified and no default port number for driver 'Apache Phoenix'
I can't join the port with the jdbc-url address.
when i input the port, the jdbc-url address is not change.

Steps to reproduce, if exist:
Include any warning/errors/backtraces from the logs

Click on "Edit driver" then change URL pattern to jdbc:phoenix:{host}[:{port}] then change port number.
I'll fix default Phoenix driver configuration.
Thanks for the bug report

verified


Hover group

Is your feature request related to a problem? Please describe.

Describe the solution you'd like

Describe alternatives you've considered, if relevant

Additional context

Attached to all surround arguments while maintaining coverts


calib_shape = [calib_batch_size] + list(inputs[0].shape[1:])

当多输入的时候，int8这句话 需要修改吗？怎么修改？感谢

Hi, will study your question and come back to you in a few hours ! :)

tks,

trt int8 ,but i have many inputs, how ?


Redirect fra koder (253MB meta)

A picture tells a thousand words
After this PR

Coverage decreased (-0.1%) to 40.191% when pulling 332c25c0e5a78b937ade47541612479cf45d72e3 on bjornreppen:redirects into 4bb45f26e6165de61f04ebd28cd245455cabf20b on Artsdatabanken:master.


Initial setup user-friendly software/documentation website

Done, see https://docs.theairlab.org. Using https://squidfunk.github.io/mkdocs-material/


[DRAFT][CUDA][Schedule] Better Layout Transform Schedules

CUDA: Improved Layout Transform Schedule
Summary
This PR does the following

Adds a scheduling rule for layout transform operator CUDA target
Forwards this information by adding "schedule_rule" attribute to layout transform topi
Annotates the layout transform topi with some information needed during scheduling.

Note: All numbers are on an RTX 3070 unless stated otherwise.
Motivation
The default implementation of layout transform has poor performance in some scenarios. A motivating factor behind all of this were layout transform operators taking up significant time in some stable diffusion models I tried.
NHWC layout is required for tensor-core use so we had to convert the layout of conv. operators. These introduced layout transform operators and their fused and unfused versions were extremely slow.
I ended up improving latency by at least 2x for all these operators in this PR:

Shape
src_layout
dst_layout
dtype
default (ms)
new_sch (ms)

1, 384, 512, 128
NHWC
NCHW
float16
2.32
0.247

1, 128, 384, 512
NCHW
NHWC
float16
0.521
0.25

1, 576, 384, 256
NHWC
NCHW
float16
6.14
0.556

2, 72, 48, 960
NHWC
NCHW
float16
0.217
0.067

16, 3456, 3456
ABC
ACB
float16
36.84
1.88

Algorithm
Currently, layout transform relies on the AutoBind schedule rule which seems to guarantee contiguous writes to the output buffer when assigning thread and block indices to loops. However in the case of layout transforms where the inner dimensions of src_layout and dst_layout do not match, it is impossible to have contiguous writes and contiguous reads in the same operation.
We ignore the case where the inner dimension matches (though I believe the new schedule might be faster in some scenarios).
Simple Case: Transpose
The way around this is to use a small amount of shared memory and tile loads so that reads from global memory -> shared can be coalesced. We carefully load elements so writing from shared —> global memory also have coalesced access. An example is taking the transpose of the matrix [2048, 1024] —> [1024, 2048]. We can read 32 x 32 tiles of the src matrix. We might make rows of our tile of shared memory correspond to coalesced accesses of the src matrix, then columns of our shared memory tile correspond to coalesced accesses of the dst matrix. By doing this, we can maximize memory throughput of our operations.

(src: https://developer.nvidia.com/blog/efficient-matrix-transpose-cuda-cc/)
General Case
While a simple transpose is easy to read about, how do we guarantee this behavior for general layout transforms where dimensions can be arbitrarily rearranged?
We can have a similar analogue for the general case. Consider the 32 x 32 tile in the previous example. Now we simply want the inner dimension of our title to correspond to the dimensions of src_layout and the outer dimension to correspond to the dimensions of dst_layout. Then, in the best case both reads and writes to global memory from/to the tile will be coalesced.
We factor and split our loops to obtain this desired structure for reads, and then use the loop analysis to guarantee compatible writes automatically.
An example is probably best to show this idea:
Let's say we want a layout transform of ABCD --> DCAB. With shape
[1024_a, 2_b, 32_c, 8_d] --> [8_d, 32_c, 1024_a, 2_b]
And tile size 32.
Then we initially have a coalesced-read loop pattern of:
T.grid(1024_a, 2_b, 32_c, 8_d)
To obtain an inner tile of 32, we factor 4 from 32_c and 8 from 8_d:
T.grid(1024_a, 2_b, 8_c1, 1_d1, 4_c2t, 8_d2t)
T.grid(1024_a, 2_b, 8_cr, 1_dr, 32_dim1)
To obtain an outer tile of 32, we factor from B then A to follow contiguous write
pattern:
T.grid(64_a1, 1_b1, 8_cr, 1_dr, 16_a2t, 2_b2t, 32_dim1)
T.grid(64_ar, 1_br, 8_cr, 1_dr, 32_dim0, 32_dim1)
Which allows us to read a tile with our wanted properties.
We now have our read and write dimension tiled to get those constraints as close as possible. To handle weirder shapes which don’t divide nicely into tile_size, we pad some dimensions until it divides into tile_size.
Choice of search space
Coalesced global memory transactions happen within a warp of which we have a limit of 32 threads. An upper limit of 32 for our tile size is therefore appropriate which is the maximum coalescing possible. In practice we try them all since some tile sizes will divide our dimensions more nicely.
Results:
We present two results in this spreadsheet: https://docs.google.com/spreadsheets/d/1O7GV50KlJTZ5G7mt9b9qDK2LKoBrImOZRV5Bd8O19p0/edit#gid=937927204
One is obtained by manually invoking the schedule rule and comparing against the default implementation across a variety of tile sizes (8, 16, 32, 64) and shapes + layouts:

Speedup: |
-- | --
Geometric Mean: | 3.042796464
Min speedup: | 0.8902785674
Max speedup: | 35.51726767
Median speedup: | 2.202399163

The other is done similarly but by using the existing autotuning pipeline:

Speedup |
-- | --
Geometric Mean | 2.878796875
Mean | 4.891142682
Median | 2.086229845
Min | 0.9820139531
Max | 26.20509112

Known defects:
High Shared Memory From Some Tile Sizes
Analysis when using compute_at seems to fail (or I am missing something) if we sample factors for our inner or outer tile dimension from only the same dimensions for both dim0 and dim1 tiling. This leads to excessive shared memory use in some scenarios which can cause failure or lead to performance issues. A lot of times these are still faster than the default schedules but do use more shared memory than needed. These are a very tiny amount of tested cases however and we always try both the new schedule and AutoBind so it should be ok for now.
I am not sure why this happens and would need more investigation. An example is transposing [1209, 9] of any type and 32 tile size.
Shared memory — Bank Conflicts:
Shared memory bank conflicts exist and are common for the strategy used. Consider a simple transpose of a [2048, 1024] matrix to [1024, 2048]. Then with a tile size of 32, the shared memory buffer will be of shape [32, 32]. We might read from global memory into rows of shared memory, and then write columns of shared memory to global memory for contiguous access. However, note the columns of this shared memory buffer lie on the same memory bank!
A common solution is to simply pad the innermost dimension of shared memory. E.g. [32, 33]. Which now makes accesses along columns be bank-conflict free.
This is planned to be done in a future PR via a new scheduling rule and is a general problem throughout all CUDA generated schedules. To give an idea of impact a [1024, 2048] transpose went from 14.34us —> 12.35us after this change basing off the optimized layout transform described in this PR.
Non-aligned inner dimensions:
This is an issue I did not think of when writing this schedule. The schedule is done from the viewpoint of trying to maximize coalesced memory access in global memory. However, one small detail is coalesced memory access must be aligned to the size of the transaction. That is, if we have a coalesced access of 64 bytes (e.g. 32 float16’s), then the each address accessed must be on the same 64 byte line (e.g. only the last 6 bits of address may be different).
Consider a layout transform where dimensions are prime numbers. E.g. [3, 1024, 1024, 7] -> [7, 1024, 1024, 3]. Then the current strategy will read 7 element-wide chunks at a time. However, most accesses will occur across coalesced memory boundaries, resulting in two coalesced memory requests instead of just 1. E.g. let’s say coalesced memory must be 8 byte aligned and we are dealing with one-byte datatype. The first read of 7 elements might be 0x00, 0x01 … 0x07 and the next will be 0x08, 0x09 … 0x0E. For the second access, 0x08 belongs to the first 8-byte line, while 0x09…0x0E belong to the second 8-byte line, requiring two memory transactions.
One possible way to get around this is to treat the array as flattened and just access stuff coalesced, though I am not sure about the details, to guarantee good access for src and dst will require some thinking, though it might be possible.
E.g.
An interesting thing in this case is if we do the no-op reshape into [3, 1024, 32, 32, 7] and then into [3, 1024, 32, 32 * 7], then [3, 1024, 32, 7, 32]. Then things become obvious. However, trying something like this initially leads to weird calculated bounds in the compute_at step and excessive shared memory usage as we must also consider the dst_layout.

This is now ready for review. cc @tkonolige @masahi

Shared memory — Bank Conflicts

Have you tried using storage_align sch primitive? It achieves similar things for shmem padding for power of two size shmem.

Shared memory — Bank Conflicts

Have you tried using storage_align sch primitive? It achieves similar things as shmem padding for power of two size shmem.

Ah yes, this might be exactly what I am looking for, thanks for bringing it to my attention.

cc @tkonolige @vinx13
This is now ready for re-review.
There is a lint error because our version of black is out of date which might take a while to fix unfortunately (since have to update CI).
Main thing was handling implicit reshapes in the layout transform (e.g. NCHW --> NCHW4c) and adding tests.  Tests are composed off some manual cases + some autogenerated cases.  The autogenerated cases also try to fuse compatible ops into layout transform task and mainly checks things for correctness.
I offline tested ~8000 autogenerated cases for correctness of the schedule, for normal runs it tests ~9 autogenerated cases which takes about a minute on my computer.

Will depend on https://github.com/apache/tvm/pull/14346 before merge.
Will keep it open a few more days for additional comments.


Add Spanish licenses

Linked to #3.
I finished converting the Spanish translations of the licenses and I already added the badge for Spanish.
The README has to do someone else.
I hope this time I did it the right way...

Thanks again @cyb3rko.
I'm curious, where did you find the translated plain text version of the license?
Does Creative Commons serves it as they serve the English version?
Or did you copied the text in https://creativecommons.org/licenses/by-sa/4.0/legalcode.es and reformatted it?

Where have you found the link to the formatted English version??
I just reformatted the text from here https://creativecommons.org/licenses/by-sa/4.0/legalcode.es into plain text.
Did I do everything correct with the fork etc.?

Where have you found the link to the formatted English version??

I think I found a very hidden link to it.

I just reformatted the text from here https://creativecommons.org/licenses/by-sa/4.0/legalcode.es into plain text.

I imagined... Maybe would be nice to reach them out so they can make all license texts available in plain text.
It would be much better if our links just point to Creative Commons files rather than hosting our own (which by the way may not get updates or typo fixes).

Have I done everything correct with the fork etc.?

Yes! Now the PR is opened from your spanish branch. Congrats!

I found this blog entry: https://creativecommons.org/2014/01/07/plaintext-versions-of-creative-commons-4-0-licenses/

Oh, I see.

...
Maybe would be nice to reach them out so they can make all license texts available in plain text.
It would be much better if our links just point to Creative Commons files rather than hosting our own (which by the way may not get updates or typo fixes).

Maybe this is a good idea, do you wanna contact them?

Yes! Now the PR is opened from your spanish branch. Congrats!

Nice, finally.

Ok, I just opened an Issue to contact them: https://github.com/creativecommons/creativecommons.org/issues/1130

I think the response will be late or never come, so maybe we should include our versions first and then, if someday they publish official plain texts, we can replace ours in the future, right?

Sure! We don't need to wait for the plain text to be available at their repo. In fact, it's very likely we might need to tackle down that issue that I opened on their repository. So having some translations already in plain text is just working in advance.
Although, the translations are too many to do it manually. I'll check if there's a way to convert them automatically. I'm thinking of using pandoc to convert it to Markdown, and then doing some minor text formatting... any ideas are welcome!

This PR is ready to be merged. I'll wait until #6 is ready, and then merge both together.
Thanks again for taking the effort of formatting the HTML versions!

I use Visual Studio Code to automatically wrap the licenses to colum 72, so this makes it a lot easier to format.
I can copy the texts, adjust the indents etc. and then I'm already finished.
I never used pandoc and it seems like it could be used for it but I have no experience until now...


Non-English characters are not represented properly

Characters commonly used in languages like Spanish or French are not stored nor shown properly because the use of a deprecated method in IOUtils.
The fix is rather simple, just change the following line from nlp/FrequencyAnalizer.java:
public List<WordFrequency> load(InputStream fileInputStream) throws IOException {
        return load(IOUtils.readLines(fileInputStream));
    }
}

to
public List<WordFrequency> load(InputStream fileInputStream) throws IOException {
        return load(IOUtils.readLines(fileInputStream,"utf-8"));
    }

or add an overload method which let you choose your encoding.

thanks! I'll update it and make it configurable, utf8 by default :)

Making a lot of other configuration updates as well.

I will be doing a re-release tomorrow after more testing/refactoring.


Adding HITS algorithm to completed table

I implemented the HITS algorithms a while back and yesterday noticed it's not marked as completed in README.md so I'm amending in this PR.

@ctjoreilly Any movement for this update? Cheers.


go helpers out of a sync

The golang helpers in code/go/sdk are not in sync with the headers used by the datastar javascript lib.
In signals.go, line 100 in v0.20.1 is datastar-request but the library on the browser-side sends datastar_request.

Ok, this was a symptom of (I guess) mismatched client side and go helpers. It mysteriously disappeared.

Disappeared.


deezer api - Create fetch functions

getPlaylists -> get playlists based on search term

https://api.deezer.com/search/playlist?limit=${maxPlaylists}&q=${searchTerm}

getPlaylistTracks -> get the tracks list of a playlist

https://api.deezer.com/playlist/${playlistId}/tracks

getSimilarArtists -> get the similar artists of an artist

https://api.deezer.com/artist/${artistId}/related

Done


Achievement "A Lingering Fragrance" tracking

Hi, i got a commission related to the above achievement today for the first time and it seems there a series of prerequisites required:
First, there's 3 versions of the daily commission Desert Bloom:

[ ] Watering Version
[ ] Kitten Version
[ ] Zaytun Peach Version

After that, the commission Blooming Sands: Lasting Scent, which grants the achievement, will be unlocked.
It would be nice if all of this would be trackable!

Hello, did you get the achievement? (A Lingering Fragrance)

No, not yet. I'm going by several comments re the prerequisites, e.g. this one.

I got the "Lasting Scent" commission and the related achievement today. I did all 3 of the mentioned prerequisite quests before.


Driver/python (rebased)

Note that this PR is copied from #220 and has removed some unwanted commits from early in the branch
This is a first go at set of Python bindings to vic_run.
There are a few things that need to be done before a merge is considered:

[x] remove hard coded path to shared object in vic
[x] automate generation of ctypes wrapper when ctypesgen is installed (otherwise, use the cached version in drivers/python/vic/vic_run_lib.py
[x] automate formatting of drivers/python/vic/vic_run_lib.py using autopep8 when available. Using autopep8 makes it possible to read the code in drivers/python/vic/vic_run_lib.py.
[x] write basic tests that cover generation of bindings and usage of functions/structures.

Down the road (move to new issue when discussion here is done):

write unit tests for functions in vic_run.
include separate bindings for other drivers for testing purposes.
who knows, maybe this works really well and we can migrate some of the other VIC driver features to Python...?

Note that ctypesgen is not ready for python3 yet so must be used from python2.7 and creates ctypes bindings that are not python3 compatible.  I'm hopeful this will be addressed soon:  https://github.com/davidjamesca/ctypesgen/issues/51
This is fine for now but we will certainly want to include python3 compatibility at some point.
cc @bartnijssen, @djlampert
@bartnijssen and others. This is ready for a code review.

Someone just sent me this last night so I'm posting here and will think about it when I get back.  There is a new way to do Python-C bindings called CFFI: https://cffi.readthedocs.org/
I spent 5 minutes playing around with it and was able to get it to work.  It may be a much more sustainable way to wrap the core vic functionality in Python.

So - should I still look at this pull request or is CFFI something for the future.  We do want to avoid whiplash on the part of VIC users who are interested in using VIC python drivers and once we accept the PR, we don't want to change the interface too often.

Go ahead and hold off from reviewing the PR until I have a bit more time to look into the CFFI. I get the impression, the user API would remain the same but, most of this PR is just the low level bindings so most of that would change.


Split storage_access and contract_address in corelib

Put all ContractAddress related stuff within its own file
Same for StorageAddress related stuff

This change is

To make sure I understand correctly, you want me to move the type
StorageBaseAddress
back to starknet.cairo?

No, I mean to add "use" in starknet.core, so that the rest of the uses remain as they were.

And thus reverting all places I used
storage_access::StorageBaseAddress
to use
starknet::StorageBaseAddress
?

@spapinistarkware could you let me know if this is what you meant?
If yes, I'll proceed and fix the failing tests.

@spapinistarkware is this what you meant?

@spapinistarkware
Is there a way to automatically generate those files (check https://github.com/starkware-libs/cairo/actions/runs/4210956789/jobs/7308977599) or should I update them manually?

Run the tests with CAIRO_FOX_TESTS=1 env var


Bootstrap Modal JS conflicting with ASP.NET button postback

It's not throwing any errors in the console, but commenting out the Bootstrap-modal.js and modal manager fixes the issue.
Any idea why this would happen and any setting I can toggle to prevent this from occurring?
Any button I have in a modal that causes a Post Back to ASP.NET will not fire as long as I have Bootstrap-Modal.JS in the page.

any other workaround for this?


Jupyter UnicodeDecodeError generating Open-end sheets in Excel

Force-applying series.map(unicoder) to all string variables at both Dimensions conversion and ExcelPainter Open-ended sheet creation stages.

This PR resolves #155.


Fix DuckDb.NET not compiling on shallow clone

Issue
can't compile repo when doing a shallow clone (git clone --depth 1) because of the reference to GitVersion.MsBuild
solution
this is of like a temporary solution, but the reference is not needed for the project to function so it can be disabled for development.
errors:

when running dotnet run and dotnet build:
/home/melty/.nuget/packages/gitversion.msbuild/5.11.1/tools/GitVersion.MsBuild.targets(9,9): error MSB3073: The command "dotnet --roll-forward Major "/home/melty/.nuget/packages/gitversion.msbuild/5.11.1/tools/netcoreapp3.1/gitversion.dll" "/home/melty/Documents/DuckDB.NET/DuckDB.NET.Bindings"  -output file -outputfile obj/gitversion.json" exited with code 1. [/home/melty/Documents/DuckDB.NET/DuckDB.NET.Bindings/Bindings.csproj::TargetFramework=net8.0]

Pull Request Test Coverage Report for Build<PHONE_NUMBER>9
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 89.937%

Totals

Change from base Build<PHONE_NUMBER>3:
0.0%

Covered Lines:
2083

Relevant Lines:
2282

💛  - Coveralls

BuildType is used to control whether the DuckDB native libraries should be included in the package or not. It's not the right condition to use for deciding whether to include GitVersion or not.

I'm aware, but it's also what's used when publishing
https://github.com/Giorgi/DuckDB.NET/blob/c4fd303a3ad68e467c53215de511e50b35870fa8/.github/workflows/ci.yml#L65
And as i wrote in the Pr the GitVersion.MsBuild is only needed when publishing.
I read the Microsoft docs about msbuild conditions and none of them seemed to allow me to run the git command to check if the repo is shallow or not.
Another solution i assume is passing another variable ShallowClone=true maybe?

It publishes four Nuggets, two with DuckDB embedded and two without it so it can't be used. Out of curiosity what issue do you have with shallow clones? Any specific reason you need it?

The easiest workaround is probably to determine if the build is running in GA or not: https://github.com/kzu/til/blob/master/msbuild/detect-ci-builds-for-every-ci-system.md

By default i shallow clone repos if i want to quickly try them out.

It publishes four Nuggets, two with DuckDB embedded and two without it so it can't be used.

I'm sorry i didn't notice that, would you recommend another way of doing it then? or maybe at least add a note on the readme that you need a full clone to compile it?

The easiest workaround is probably to determine if the build is running in GA or not: https://github.com/kzu/til/blob/master/msbuild/detect-ci-builds-for-every-ci-system.md

that sounds good, should I open a new PR?

Just update this PR with the new implementation instead of the current one.

thanks a lot

I guess you verified that now you can build it from a shallow clone right?

yeah it does, thanks


Review subgraph for Protocol TVL, notational volume, fees

What: We need to keep track of

all the tokens locked in the protocol
the total token volumes of options written and exercised
the fees accrued and then swept from the protocol
Why: Support metrics and reporting

will look into this tomorrow. guessing either bad/outdated math wrt contract changes, or testnet shenanigans on uniswap pool.

I introduced hardcoded values in PR for #34 (goerli metrics).
The hardcoded values should be reverted for mainnet release.
Once we are on mainnet, the existing code should work the same as it was before, and show accurate numbers.

off the top of my head from WIP:

missing data: notional Volumes; totalSupply of options for an OptionType
unnecessary data: ERC1155-XXX + DecimalValues entities + Event interface in schema; Lifetime USD metrics (USD values should just be in daily metrics)
bugs: not handling a claim's optionsExercised value when options are exercised; unsure if URI is being set properly needs investigation; options and the OptionType should be different entities


update packages

:white_check_mark: Build TheIdServer 8.0.0-fix-dependencies1-0307 completed (commit https://github.com/Aguafrommars/TheIdServer/commit/ce1b5f25e0 by @invalid-email-address)


Add menus for roster

Idk how reaction predicate works, but I'd say probably use that or DEFAULT_CONTROLS because otherwise roster will just run down eternally.

Thanks. I've looked into it this evening but haven't used the redbot.core.utils.menu module before. Feel free to create a PR if needbe, Jojo or I shall look at this over the next couple of days.

Cool cool. I'm not familiar with any of the redbot utils so its probably something I can't contribute towards. I see that DC was used in awbadge so I guess you could just replicate and modify that chunk of code and move it into the roster section. But again that may be completely different due to that awbadge embeds are already defined separately, so you can append them together; I assume it wouldn't work like that from user data from the dict inside an embed field. Eitherway, see what you can do, idk if it would come under predicate or default controls.

Predicates wouldn't work because they're designed for yes or no type reactions. They would make decisions but would do it a lot less efficiently than just using default controls. I'm sure it would be fairly simple to pagify the list for roster and as I said I will look into this, tomorrow.

I can work on getting a menus system for the Roster. Shouldn't take too long as menus are pretty easy to make 😅

Will do!

okay, looks like i will be looking at this then

Due to the fact that MCOC and Alliance cogs have been pushed over to a different repository, I am not going to be making any changes here. I will keep this open for a while if there are additional questions/statements.
Seeing as Jojo was assigned to this, he could do some work on this issue in his own repo. Andreas, I suggest opening an issue at his repo.


Create DOC-ISSUES.md

You're correct, @todd-mystenlabs should have followed the methodology for plugging the issue template in the github tooling.

@huitseeker Yep sounds like I missed something for lack of awareness that there was something automated there.  I'm running off the LLVM, pre-github methodology.  Do I need to fix something there?  Or has somebody already done it?

I see the link. I will look at it at some point if it hasn't already been done.

@todd-mystenlabs Clay is fixing the doc template in #2217 which should probably supersede the present PR. But that's only a fix for opening documentation issues. We should also convert https://github.com/MystenLabs/sui/blob/main/ISSUES.md to a proper Github template for regular issue.

Yes, I will close this in favor of #2217. (Sorry, should have mentioned that here already for tracking - just finished it yesterday afternoon.)
Todd, thanks to Francois you can see this in action at:
https://github.com/MystenLabs/narwhal/issues/new/choose
Instantiated by:
https://github.com/MystenLabs/narwhal/pull/73
I'm following that same model, and you might wanna do the same. It's drop-dead simple. Frankly, I think all of us should consider implementing

@todd-mystenlabs Clay is fixing the doc template in #2217 which should probably supersede the present PR. But that's only a fix for opening documentation issues. We should also convert https://github.com/MystenLabs/sui/blob/main/ISSUES.md to a proper Github template for regular issue.

Yes, see my response in:
https://github.com/MystenLabs/sui/pull/2217#issuecomment-1137534379
Since I will now close this out.


Filter performance and UI touchups

use pre-processing, maps, sets and restructuring to improve filtering performance at scale, and add a few cosmetic changes

i think these look not great

proposing to change to these

thoughts? i can just commit the update here.

thoughts? i can just commit the update here.

yes, looks good to me, thanks!


gscam: 0.2.0-0 in 'indigo/distribution.yaml' [bloom]

Increasing version of package(s) in repository gscam to 0.2.0-0:

upstream repository: https://github.com/tork-a/gscam.git
release repository: https://github.com/tork-a/gscam-release.git
distro file: indigo/distribution.yaml
bloom version: 0.5.25
previous version for package: null

gscam
* Merge remote-tracking branch 'dhood/master'
* Merge remote-tracking branch 'blutack/master'
* gscam_nodelet.h: include scoped_ptr.hpp to compile with boost 1.57
  When compiling gscam with the currently latest boost version 1.57,
  it fails with:
  In file included from [...]/src/gscam_nodelet.cpp:5:0:
  [...]/include/gscam/gscam_nodelet.h:20:12: error: 'scoped_ptr' in namespace 'boost' does not name a template type
  boost::scoped_ptr<GSCam> gscam_driver_;
  ^
  [...]/include/gscam/gscam_nodelet.h:21:12: error: 'scoped_ptr' in namespace 'boost' does not name a template type
  boost::scoped_ptr<boost::thread> stream_thread_;
  ^
  It seems that the dependencies of boost/thread.hpp have changed
  and boost/scoped_ptr.hpp is not included anymore with
  boost/thread.hpp. Hence, the scoped_ptr is not defined in the
  gscam_nodelet header. After scanning quickly through the release
  notes of version 1.57, the boost bug tracker and a few changesets,
  I could not find not a hint what has changed in the thread library
  that gscam must include scoped_ptr itself.
  This commit simply addresses the compiler error by explicitly
  adding boost's scoped_ptr header in the gscam_nodelet header.
  As this commit also compiles with boost version 1.56, the commit
  is not expected to cause any problems with other build
  configurations.
  Signed-off-by: Lukas Bulwahn<EMAIL_ADDRESS>* Remove dependency on opencv2 to fix under indigo
  Packages can no longer depend on opencv2 as of indigo.
  I've updated the package to depend instead on cv_bridge as suggested by http://wiki.ros.org/indigo/Migration#OpenCV.
* Install the parameters file refered to in v4l.launch
* Update package.xml
* Merge pull request #15 <https://github.com/tork-a/gscam/issues/15> from kubark42/osx_camera_launch
  Examples: Added standard launch file for OSX
* Examples: Added example for OSX
  Add a simple launch configuration for OSX. The camera can be selected by
  changing the default="0" to the appropriate integer.
* Adding libraries to gscam target
  Fixes #13 <https://github.com/tork-a/gscam/issues/13>, now builds on stricter linkers
* adding proper depends to catkin package call
* Update minoru.launch
* Contributors: CHILI Demo Corner, Jonathan Bohren, Kenn Sebesta, Lukas Bulwahn, Russell Toris, blutack

Please request ownership to the existing repos (see https://discourse.ros.org/t/releasing-repositories-form-other-people/1797/10).


Proactive error messages for EasyAuth blocked capabilities

See http://stackoverflow.com/questions/41947833/azure-function-logging-doesnt-appear-to-be-working/41964345?noredirect=1#comment71115227_41964345
It would be better to disable the monitoring tab due to enabled easy auth, at present it will stay 'loading'.

Error message should read: "Authentication/Authorization is enabled for this Function App. Currently, the Monitor tab is not compatible with Authentication/Authorization."
@mattchenderson Could you tell us the plan for the real fix to this issue in the API layer?

@ahmelsayed, should I close this one as duplicate?https://github.com/projectkudu/AzureFunctionsPortal/issues/932

@alrod This isn't exactly the same. As far as I'm aware, the monitor tab won't work if easy auth is enabled, but perhaps that is fixed now.

I'm taking this one

@ahmelsayed Awesome!  Feel free to move to March if the fix is longer.

This was actually fixed in 7d908d73fcdbde9a6e8a9e3f43bd6adc3708ea34


Add Option to send data to BigQuery

We should have a function that allows sending data to bq
logly.Bq(struct {
...
BQ Schema
...
}

data is sent over to BQ via s32bq


Added Homepage

Issue: 8
Designed a HomePage for the project SaveMyForm

@hargunkaur286  The design is not upto what we expect for 50 points.  The deadline for the issue by tomorrow. Either update your design or we will assign you 30 points for the efforts.


add Alpha Chane before extend imaging

add alpha channel if source has no alpha channel before extending image.
Issue 437 [https://github.com/lovell/sharp/issues/437]

Coverage remained the same at 98.876% when pulling f6ec99af6eae30270e2581344e2ae930bc2c96ad on frulo:addAlphaChanelBeforeExtend into 331926dc3c3688ddf10fa320fa2fa3dcc358c8c6 on lovell:master.

Excellent, thank you very much for this. It's always a pleasure to see tests in a PR :)


Verb commands with only one verb

I got an issue with using verb commands with only one option, see the following excerpts:
Definition of verb with supported parameters:
    [Verb("cp", HelpText = "Copy files and directories to another location")]
    internal class CopyOptions
    {
        [Option('f', "force")]
        internal bool Force { get; set; }
        [Option('l', "LoadRequest")]
        internal bool LoadRequest { get; set; }
        [Value(0, Min = 2, Max = 2)]
        internal IEnumerable<String> SourceTarget { get; set; }
    }

I was calling the parser with
var result =  Parser.Default.ParseArguments<CopyOptions>(args);

This left me with the parser not parsing any arguments I passed to the command line after the
As @gsscoder pointed out to me in an e-mail:

The overload with just one type, that you're using, handles normal options, since by design library assumes that you'll use this feature whit at least two or more verbs.

To handle only one verb, the following parser overload should be used:
public ParserResult<object> ParseArguments(string[] args, params Type[] types)

Therefore, I changed my implementation to the following
 ParserResult<Object> result = Parser.Default.ParseArguments(args, typeof(CopyOptions));

However, this still didn't do the trick as Force and  LoadRequest are still always false and SourceTarget is always null.
Additional Info: I'm not using only a copy verb option, but several verb options. The issue is the same and doesn't change if I invoke the parser with
ParserResult<Object> result = Parser.Default.ParseArguments(args, typeof(CopyOptions), typeof(option2), typeof(option3), [...]);

Thanks already @gsscoder for the fast answer to my initial e-mail, I hope you can help me further.

Hi @mauricemeyer,
can you post also at least a second class you use as verb command?
In such case you can use standard ParseArguments<T1,T2...> verb overload.
var result =  Parser.Default.ParseArguments<CopyOptions, Options2, ...>(args)

You must define properties as public:
[Verb("cp", HelpText = "Copy files and directories to another location")]
internal class CopyOptions {
    [Option('f', "force")]
    public bool Force { get; set; }
    [Option('l', "LoadRequest")]
    public bool LoadRequest { get; set; }
    [Value(0, Min = 2, Max = 2)]
    public IEnumerable<String> SourceTarget { get; set; }
}

This is semantically equal to your version, but the Parser operates on public properties and reflection API doesn't reason semantically but "literally".
Then use this overload with one verb:
var result = Parser.Default.ParseArguments(args, typeof(CopyOptions));
if (result.Value.GetType() == typeof(CopyOptions)) {
    var casted = (CopyOptions)result.Value;
    // consume value here
}

Or the overload with more type parameters for 2+ verb commands.
Note:
It still exists an issue, since you can specify more than one 2 SourceTargets, but should be filed as another issue (anyway I'll write a unit test for it right now).
Please check if other things work (excluded what stated in the note).

Opened an issue for lack check of Max constraint in such case: https://github.com/gsscoder/commandline/issues/172.

Setting the accessibility for all properties to public solved the issue I encountered, thank you very much!

You're wellcome. I've solved also #172 (in a dev branch), I'm waiting a PR from a collaborator than I'll merge it...

As a side note, #172 merged. Build from source to benefit from latest changes.
PS> git clone https://github.com/gsscoder/commandline CommandLine
# output omitted
PS> cd CommandLine
PS> .\packages\FAKE.3.35.1\tools\Fake
# output omitted
PS> dir .\build
    Directory: P:\CommandLine\build
Mode                LastWriteTime     Length Name
----                -------------     ------ ----
d----        23/06/2015     04:56            test
-----        23/06/2015     04:56      91648 CommandLine.dll
-----        23/06/2015     04:56     312832 CommandLine.pdb
-----        23/06/2015     04:56      94730 CommandLine.XML


MergeTree:RegeneratePendingOp

union Office_Fluid_FluidRuntime_*
| summarize count() by Data_eventName
Top event:
fluid:telemetry:SharedSegmentSequence.MergeTreeClient:MergeTree:RegeneratePendingOp	2315828
This does not look healthy - that's over 6% of all events from FF!

The code is only invoked and reSubmitCore is invoked, which i thought was only on reconnect, but it doesn't look like there is much logging on that path. I also see some things that are suspicious.
I don't understand why we replaypendingstates when transitioning readonly, from readonly might make sense, but i think this will do both too and from:
https://github.com/microsoft/FluidFramework/blob/72a22b97ea7dcaaa5f6c3f49c13b5408bfa2d7ab/packages/runtime/container-runtime/src/containerRuntime.ts#L1046
It also looks like we call it for all connection state transitions, which also seems quite strange to me, and i thought we should only call it on connected:
https://github.com/microsoft/FluidFramework/blob/72a22b97ea7dcaaa5f6c3f49c13b5408bfa2d7ab/packages/runtime/container-runtime/src/containerRuntime.ts#L1342

@anthony-murphy, the code likely can be clearer in intentions, but I think the code you referenced does not cause directly problems, because of this:
    private canSendOps() {
        return this.connected && !this.deltaManager.readonly;
    }

    private replayPendingStates() {
        // We need to be able to send ops to replay states
        if (!this.canSendOps()) { return; }

@vladsud  the problem it causes is this issue. it causes us to over regenerate pending ops, and at least has logging side effect, but also wastes client resources. i guess we could just remove the logging, but then we are basically blind on the regenerate path, so i don't think that is a good option.

ahhh. ok. i figured it out. basically, the number of log entries in proportional to the number of changes in the merge tree, due to our change a while ago from all at once regenerate to per op regenerate. i can easily reduce this logging.


Glitches on going back and forth between SceneViewer and model-viewer

Description
As outlined here, I have some issues with SceneViewer launching from model-viewer and glitches around that.
First launch after website reload usually works, but subsequent clicks on the "go to scene viewer" button sometimes do weird things.
Glitches are different - I have seen:

SceneViewer showing "looks like there's something wrong with this object" on objects that were launching just fine a second ago

SceneViewer loading on a black background instead of white and quickly quitting / going back to webpage
(wasn't able to take a screenshot of this, most of the times it's just for a few frames, sometimes it's stuck on black)

SceneViewer AR Mode getting no camera image, after switching to regular camera it worked again (link to video of the behaviour)

SceneViewer loading screen alternating between black and white background every frame (link to video of the behaviour)

canvasses showing the background color + AR button after going back from scene viewer (wasn't able to take a screenshot but I think this is #619 anyways)

some canvasses completely blank after going back from scene viewer

Live Demo
https://near-singularity.glitch.me/
Only way to reproduce that I know of is to repeatedly click that button, go to AR view, go back, click the button on the same model or the second model, repeat until something glitches, but ultimately it will glitch. It seems to glitch faster/more often on Xiaomi Mi 9 and less often (but still ultimately) on Samsung Galaxy S9+.
Also, the issue seems to get worse after switching away from Chrome and coming back at a later point on both devices when not reloading the webpage (memory related?), but that could just be a feeling.
Browser Affected

[X] Chrome
[ ] Edge
[ ] Firefox
[ ] Helios
[ ] IE
[ ] Safari

OS

[X] Android
[ ] iOS
[ ] Linux
[ ] MacOS
[ ] Windows

Versions

model-viewer: v0.5.1
Device: Xiaomi Mi 9 and Samsung Galaxy S9+

Just noting per conversation in #693 that I believe that these issues will be fixed in #619


fix: Generate correct OpenAPI response for ResponseSpec(None) (#3069)

Fixes #3069
Explicitly declaring responses={...: ResponseSpec(None)} used to generate OpenAPI content, when it should be omitted.

@all-contributors please add @tuukkamustonen for code

@tuukkamustonen just to confirm because it has been confusing me a bit: @mtvx is also you, right? :eyes:

@provinzkraut Ha, yeah.
I got two accounts (one for personal, one for work) so it can be a bit confusing (also for me 😄) sometimes.

@provinzkraut Oh yeah I see the commits refer to my work account (@mtvx). I'll change those to use this one @tuukkamustonen, too.

@provinzkraut Oh yeah I see the commits refer to my work account (@mtvx). I'll change those to use this one @tuukkamustonen, too.

Thanks! That makes it a bit easier to associate your commits with.. You :upside_down_face:

Did them again, even resetting and re-creating the commit all over again, but Github regards them as co-authored now... 😞

Did them again, even resetting and re-creating the commit all over again, but Github regards them as co-authored now... 😞

I think that's okay, as long as you're in there somewhere

@all-contributors add @tuukkamustonen for code


Add Navbar Tablet and Mobile (Resolves #90)

Currently, the site's bootstrap-based navbar disappears at tablet width and below. This update fixes that.

This PR is almost ready for review. I've just got one persnickety issue that I need to resolve first!

OK, this should be ready to go now. As I mention in the latest commit, this isn't absolute perfection, but I think it's good enough. @leesharma, please do let me know if you think I should try harder! :)

Hooray, PR! I'll take a look at this tomorrow.

Hmmm... Thanks for these screenshots. This is not what I was seeing in the "responsive" views in Dev Tools on Chrome. But when I look in a regular desktop browser, pulled to small width, I'm also seeing some jankiness.
Let me take a look at the bootstrap resource you shared and see what I can do.

OK, I think this update should resolve the concerns you raised. Let me know if I missed something. Thanks!

Awesome! :tada: I'll take a look in the morning.

The small screen look really nice!

Unfortunately, the normal navbar looks wonky now (on Safari/Firefox)–the menu items are no longer lined up:

You can see this live on the PR app: https://project-playtime-stagin-pr-105.herokuapp.com/
Is this an intentional look?

I'm really confused. That's not what I had locally.

Hey, @leesharma. I am learning that Firefox is often giving me very different results than what I see in Chrome (which I've been developing in). In Chrome it looks great, but Firefox gives the view from your screen shot. I figure I need to do some prefixing?

OK, it took me a minute to realize it, but I didn't test my styles when the user is logged out. Because of the changed list of displayed options, this made a difference. It should look as expected now!

Nice! 🎉 I'd feel comfortable merging this in now.
A stylistic question first though: the position of the drop-down menus on normal screens (how low they are) seems a bit strange to me. Is that an intentional choice, or are they being stubborn?


Use full TipSet object as map key, avoid using CIDs

The existing code has a subtle bug where some participants could disagree about which epoch a tipset is for, and the correspondence between CID and epoch never checked. We now use the full TipSet object as a map key and for all other uses, and never look at either the CID or Epoch individually. Two nodes are only proposing the same thing if the TipSet fields fully match.
Closes #10

Rebased, confirmed diffs side by side.


Add custom linker args and custom compiler args.

Add the ability to do something like this
[[bin]]
default = true
name = "Test"
cargs = "-O2 -Wall -Wextra" # This should also be the default value if not provided
largs = "-B gcc" # This should also be the default value if not provided

begone, issue... solved by #13


Create SECURITY.md

new install security start on 1/16/24

At this point in time, this repository doesn't have any versioning. Closing this pull request.


ast,parser: added several expression types to represent keyword arguments

pingcap/tidb#8891

Added TimeUnitExpr to represent time and timestamp units like SECOND in DATE_ADD(time, INTERVAL x SECOND).
Added GetFormatSelectorExpr to represent the selectors like DATETIME in GET_FORMAT(DATETIME, locale).
Added TrimDirectionExpr to represent the direction like BOTH in TRIM(BOTH 'x' FROM 'xyz').
Changed FrameBound's Unit to use TimeUnitType directly.
Previously these were all converted into a string or integer ValueExpr, which made Restore() implementation very ugly.

LGTM
Please address conflicts @kennytm

PTAL @leoppro

i am sorry for blocking this pr

PTAL again @leoppro @tiancaiamao thanks.
The integration test will be broken until pingcap/tidb#8891 is merged.

PTAL https://github.com/pingcap/tidb/pull/8891 @zz-jason


:bug: Fix very rare case of ?bad? bytes payload that cause decode/encode errors

Linked to https://github.com/psf/requests/pull/5797#issuecomment-840362338

Codecov Report

Merging #40 (702735d) into master (523c71b) will not change coverage.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##           master      #40   +/-   ##
=======================================
  Coverage   84.56%   84.56%
=======================================
  Files          13       13
  Lines         920      920
=======================================
  Hits          778      778
  Misses        142      142

Impacted Files
Coverage Δ

charset_normalizer/normalizer.py
85.60% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 523c71b...702735d. Read the comment docs.

Cool

So I can herbally confirm that this patch fixes the issue. The websites that raise that are behind the Cloudflare app-firewall I noticed.

I am merging this now as it does not interfere with everything else. This 'bug' is a very edge case and seems related to errors in TX.

Cool. I can re-run the test tomorrow for all 33.000 sites - it was pretty repeatable with 16-18 cases per run.