list index out of range while converting model

1. OS : WIndows10,
2. OS Architecture e.g. x86_64,
3.  OpenVINO version 2021.2.185
4. Version of TensorFlow 2.3.1, but tried also with 2.4.1
####5 python version 3.7
####6 openvino model to convert: https://download.01.org/opencv/2021/openvinotoolkit/2021.2/open_model_zoo/models_bin/3/gaze-estimation-adas-0002/FP32/
I get this error while trying conversion:
(py_3_7) D:\work\openvino2tensorflow\openvino2tensorflow-main\openvino2tensorflow>python openvino2tensorflow.py --model_path D:\Librerie\Openvino\openvino_2021.2.185\deployment_tools\open_model_zoo\models\download\intel\gaze-estimation-adas-0002\FP16\gaze-estimation-adas-0002.xml --model_output_path . --output_pb 1
TensorFlow/Keras model building process starts ======================================
D:\work\openvino2tensorflow\py_3_7\lib\site-packages\tensorflow\python\autograph\utils\testing.py:21: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
  import imp
Traceback (most recent call last):
  File "openvino2tensorflow.py", line 2204, in <module>
    main()
  File "openvino2tensorflow.py", line 2200, in main
    yolact, debug, debug_layer_number)
  File "openvino2tensorflow.py", line 305, in convert
    tf_layers_dict[layer_id] = Input(shape=(shape[2], shape[3], shape[1]), batch_size=shape[0], name=layer_name)
IndexError: list index out of range

Added support for input values other than 4D tensor and fixed some bugs. If you update to the latest package, you will be able to convert correctly. commit: fc68f0e58c37bda624b5bf7161a42fc41a8d9cf7

Converted Model
https://github.com/PINTO0309/PINTO_model_zoo/tree/main/091_gaze-estimation-adas-0002

thanks a lot man!
Do you have some paypal link for donation?. I would like to send a couple of bucks

I don't want that. I'm just playing as a hobby.

Thanks anyway. I will be sponsoring you just for this very month.
I also hope you will be willing to accept some tasks in the future for money. We could make good use of a guy like you.

Whoa! Unbelievable! Thank you so much. :smiley:


B 18645 move grade to orders from allowances main

Integration PR
Agility ticket
Summary
As part of previous work on the customer view, we moved the Grade and Current Duty Location fields to be associated with the Orders for all customer facing pages.
For the TOO/Services Counselor view, the pay grade is currently displayed under the Allowances section and edited by clicking the "Edit Allowances" button.
This work will be moving the pay grade to be under the Orders section rather than the Allowances section, as well as editing the pay grade by using the "View and edit orders" button.
Changes to be made for TOO/Services Counselor screens:

Update the pay grade to be shown under the Orders section.

Remove the pay grade from the Allowances section.

Update the "View and edit orders" button to allow editing of the pay grade.

Remove the editing of the pay grade from the "Edit Allowances" section.

How to test
TOO

Access the office app as a TOO
Make sure pay grade is under the Orders section
Make sure you can edit the pay grade
When you edit the pay grade, check that the Allowances -> Weight allowance was updated

Services counselor

Access the office app as a TOO
Make sure pay grade is under the Orders section
Make sure you can edit the pay grade
When you edit the pay grade, check that the Allowances -> Weight allowance was updated

Screenshots
Previous view:

Current view:

This branch will likely fail until 18457 gets to main.

Just happo check failing


New Program Templates based off previous exploits idea.

I have some Program Templates based off previous and rare bug path types, I only tested these templates to about 1M executions on macOS, and the correctness rate out of 4 jobs fell between 30% -45% correctness rates. I would love to drop them for you to review and tamper with to add with fuzzilli :),
Also side note this these templates I've built around these rare JavaScriptCore bug paths seem to do horrible on Ubuntu 20.04 VM with only around 6-14% correctness rate at 300K executions with 4 jobs running against v8 which is probably understandable considering this was specifically meant to target JSC only, with that in mind I have a feature request for people such as myself that adds new templates but fuzz majority all targets is to add a way to disable Program Templates per Profile, in a way such that you have an option to disableCodeGenerators.
Last closing statement as well is The webkit.patch is confirmed to work (as of writing the latest WebKit source code)
Commit hash ~https://github.com/WebKit/WebKit/commit/46714502452254ee3d032e00b070d267fb6823ea~
Proof :
"====================================================================
JavaScriptCore is now built (00m:15s).
./Tools/Scripts/build-jsc --jsc-only --debug   14.374 user 0.700 system 95% cpu (15.779 wasted time).
turnerrocks1@turnerrocks1-mac:~/Desktop/WebKit:no-branch -$ /home/turnerrocks1/Desktop/WebKit/WebKitBuild/Debug/bin/jsc
[COV] no shared memory bitmap available, skipping
[COV] edge counters initialized. Shared memory: (null) with 692176 edges

^C
turnerrocks1@turnerrocks1-mac:~/Desktop/WebKit:no-branch 130$ git branch

(HEAD detached at<PHONE_NUMBER>22)
main
turnerrocks1@turnerrocks1-mac:~/Desktop/WebKit:no-branch -$ lsb_release -a
zsh: command not found: lsb_release
turnerrocks1@turnerrocks1-mac:~/Desktop/WebKit:no-branch 127$ hostnamectl
Static hostname: turnerrocks1-mac
Icon name: computer
Machine ID: [redacted]
Boot ID:[redacted]
Operating System: Arch Linux ARM
Kernel: Linux 5.19.0-asahi-5-1-ARCH
Architecture: arm64
turnerrocks1@turnerrocks1-mac:~/Desktop/WebKit:no-branch -$
" on Asahi Linux arm64

So for new features like ProgramTemplates it's important to have some data that shows that the templates can find bugs that couldn't be found before. For example, this template here: https://github.com/googleprojectzero/fuzzilli/blob/80a26592dde3e861b6102780590d8a9c9c2e9731/Sources/FuzzilliCli/Profiles/V8Profile.swift#L77 can find this bug https://googleprojectzero.github.io/0days-in-the-wild/0day-RCAs/2020/CVE-2020-16009.html which could not be found previously.
Having this information is important to keep the list of ProgramTemplates as small as possible, so the templates that do find new bugs get the most CPU cycles.
If you have specific bugs in mind, I'd recommend running the fuzzer with and without the new changes and see if, with the new changes, it can (ideally) find new bugs, or alternatively re-discover the old ones.

@saelo I have ranned the results each 1M execution one without the new templates and one with them, and each template has a "//link to exploit" that it supposed to be targeting, as such a prime example is A LICM exploit, it targets the LICM portion of JavaScriptCore JIT Compilation their is only 1-2 bugs related to it and I took the outline of the exploit to match the template, the correctness rate is moderate which is important to not have a too low of a such correctness rate, I will drop the template here in the form of a PR request for you to review and critique and etc.

But I guess the important question here is: can Fuzzilli with the new template find these bugs, and was it unable to find them previously (e.g. Fuzzilli did find a couple of LICM bugs in the past). This really is the only way to evaluate "special-purpose" templates like the one you're describing, and is what I did for that template I linked above.
To show that you'll probably want to run multiple instances of Fuzzilli with and without the template, then check if the instances with the new template can trigger these kinds of bugs, and how long that took. You can try to run Fuzzilli against an older version of the target engine with some known bugs. In that case you just need to be very careful not to "overfit" the template to one specific bug (as in, you could hardcode a PoC for a bug in a template. That would quickly find the bug, but isn't actually useful).

@saelo Ok will do closing issue until I run a more specific stat testing one day when I have time :)


Added validation each N epochs in _non_dist_train

This does not work anymore... seems like get_dataset was removed and instead there is some kind of strange registry class. Can anyone help me validate the old fashion way again?

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

This feature is already supported in the current MMDet here, so this PR is closed.

Hi @canorbal ！We are grateful for your efforts in helping improve mmdetection open-source project during your personal time.
Welcome to join OpenMMLab Special Interest Group (SIG) private channel on Discord, where you can share your experiences, ideas, and build connections with like-minded peers. To join the SIG channel, simply message moderator— OpenMMLab on Discord or briefly share your open-source contributions in the #introductions channel and we will assist you. Look forward to seeing you there! Join us ：https://discord.gg/UjgXkPWNqA
If you have a WeChat account，welcome to join our community on WeChat. You can add our assistant ：openmmlabwx. Please add "mmsig + Github ID" as a remark when adding friends：）
Thank you again for your contribution❤


Can you also add the new features with server wipe and all kind of things that they bring to the settings?
Thank you :D

Added in latest release.


Add previously available system colors (like systemGreen), as they don't work as tintColor

It looks like the previously available system colors (like systemGreen, systemGray, systemBlue etc), which have been available before iOS 13, don't work when you specify them as tintColor of a UIButton. Therefore it seems it would make sense to include these colors in this library's enum.

Sorry, this is not true, I had another problem in my code.


Add validation of DirectoryService/AdditionalSssdConfigs: emitting a failure when the customer is overriding protected properties

Description of changes

Added a validator for DirectoryService/AdditionalSssdConfigs that fails when additional properties contain protected properties ("id_provider", "access_provider", "ldap_schema"), i.e. those that pcluster is in charge to set to a specific value and that are not meant to be overridden.

Tests

Manually tested cluster creation and update triggering some critical configurations leveraging AdditionalSssdConfigs (e.g. switching from LdapAccessFilter to a simple access filter)
Integ test (SimpleAD/MsAD with LDAPS) locally launched
[ONGOING] Build&Test

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
Signed-off-by: Giacomo Marciani<EMAIL_ADDRESS>

Should we validate if they are inserting ldap_access_filter but passing a access_provider other than ldap?


WinUI implementation

In the TODO list you mentioned that the WinUI implementation should be quiete easy. I was wondering what's your idea to do that.
I'm working in a little project and having a MPV player would be awesome.

See the Avalonia implementation and adapt it. There are 3 rendering methods supported by SVP: Software, OpenGL (best for Linux and MacOS) or Native (best for Windows).
Your implementation depends on your target platform. For Windows, you need to create a hwnd handle and pass it to MPV.
For MacOS, you'll need OpenGL. A quick search gave this.
Once you have an implementation working, you can submit a pull request with your renderer.

Unfortunately, I don't believe it's possible to use the Native method to achieve something truly usable on WinUI. It's easy to obtain the hwnd of the window and make mpv use it, but I don't think it's possible to add anything else on top of mpv with WinUI.
I think the only good solution is to use SwapChainPanel but works only with d3d11 and at the moment mpv doesn't support it https://github.com/mpv-player/mpv/issues/5979

You need to display something on top of the player?
See these comments, he mentions necessary upgrades on the Native implementation to be able to display on top.


test/java unit tests

feat(java): Initialize Java SDK
fix(java): Fix incorrect license url
fix(java): Fix mustache generation by moving files out of a 'Java' directory
clean(java): Remove base template files also present in libraries/native
clean(java): Remove more unneeded or unused templates
test(java): Add Java integration tests (#160)
chore(java): Update to JUnit 5
test(java): Move generated OpenFgaApiTest to a template
test(java): Unit test the Check API, introduce Mockito, update javadocs

Description

References

Review Checklist

[ ] I have clicked on "allow edits by maintainers".
[ ] I have added documentation for new/changed functionality in this PR or in a PR to openfga.dev [Provide a link to any relevant PRs in the references section above]
[ ] The correct base branch is being used, if not main
[ ] I have added tests to validate that the change in functionality is working as expected

Created with wrong upstream branch


Adding Customer 360 schema example

What is the goal of this PR?
Add the additional example schema files to examples repo for download from example schema docs page (created today by daniel)
What are the changes implemented in this PR?
Added new .gql file

This schema is quite out of date and bringing it up to date will take a while. As such, we're closing this.


npm run flow-typed fails on npm install

Don't know what this means, but it happened when I tried npm install. I'm running OSX El Capitan. My Node and NPM are up-to-date.
[1] WARNING in ./~/ajv/lib/async.js [1] 96:20-33 Critical dependency: the request of a dependency is an expression [1]  [1] WARNING in ./~/ajv/lib/async.js [1] 119:15-28 Critical dependency: the request of a dependency is an expression [1]  [1] WARNING in ./~/ajv/lib/compile/index.js [1] 13:21-34 Critical dependency: the request of a dependency is an expression [0]   •<EMAIL_ADDRESS>[0]     └> flow-typed/npm/babel-plugin-flow-runtime_vx.x.x.js [0]   •<EMAIL_ADDRESS>[0]     └> flow-typed/npm/node-sass_vx.x.x.js [0]   •<EMAIL_ADDRESS>[0]     └> flow-typed/npm/electron_vx.x.x.js [0]  [0] !! No<EMAIL_ADDRESS>libdefs found in flow-typed for the above untyped dependencies !! [0]  [0] I've generated any-typed stubs for these packages, but consider submitting  [0] libdefs for them to https://github.com/flowtype/flow-typed/ [0]  [1] npm run build-dll exited with code 0 [0] npm [0]  ERR! code ELIFECYCLE [0] npm ERR! errno 1 [0] npm ERR<EMAIL_ADDRESS>flow-typed: flow-typed install --overwrite[0] npm ERR! [0]  Exit status 1
npm ERR! Tell the author that this fails on your system: npm ERR!     concurrently "npm run flow-typed" "npm run build-dll" "install-app-deps" "node node_modules/fbjs-scripts/node/check-dev-engines.js package.json"

Does it work if you rm -rf flow-typed first?

It does (at least for me), but it seems like in this version it is trying to rebuild the contents of the flow-typed folder when I add new packages, and fails unless I manually remove it again. I am not 100% sure about this yet.

Running into this issue too.   Reseting to this commit seems to eliminate the issue.  https://github.com/chentsulin/electron-react-boilerplate/commit/2b0f7606bb06397e87078bb4f00c357efc778e65

@JohnBain @MarkDavidGoddard would be great if you could test out this PR with npm to see if this was resolved

Still failing for me.  I get the following error if I run 'npm run flow-typed':
0 info it worked if it ends with ok
1 verbose cli [ '/usr/local/Cellar/node/7.9.0/bin/node',
1 verbose cli   '/usr/local/bin/npm',
1 verbose cli   'run',
1 verbose cli   'flow-typed' ]
2 info using<EMAIL_ADDRESS>3 info using<EMAIL_ADDRESS>4 verbose run-script [ 'preflow-typed', 'flow-typed', 'postflow-typed' ]
5 info lifecycle<EMAIL_ADDRESS><EMAIL_ADDRESS>6 silly lifecycle<EMAIL_ADDRESS>no script for preflow-typed, continuing
7 info lifecycle<EMAIL_ADDRESS><EMAIL_ADDRESS>8 verbose lifecycle<EMAIL_ADDRESS>unsafe-perm in lifecycle true
9 verbose lifecycle<EMAIL_ADDRESS>PATH: /usr/local/lib/node_modules/npm/bin/node-gyp-bin:/Users/mark/electron-react-test/node_modules/.bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/Applications/Wireshark.app/Contents/MacOS:/Users/mark/go/bin
10 verbose lifecycle<EMAIL_ADDRESS>CWD: /Users/mark/electron-react-test
11 silly lifecycle<EMAIL_ADDRESS>Args: [ '-c', 'rm -rf flow-typed && flow-typed install --overwrite' ]
12 silly lifecycle<EMAIL_ADDRESS>Returned: code: 1  signal: null
13 info lifecycle<EMAIL_ADDRESS>Failed to exec flow-typed script
14 verbose stack Error<EMAIL_ADDRESS>flow-typed: rm -rf flow-typed && flow-typed install --overwrite
14 verbose stack Exit status 1
14 verbose stack     at EventEmitter. (/usr/local/lib/node_modules/npm/lib/utils/lifecycle.js:279:16)
14 verbose stack     at emitTwo (events.js:106:13)
14 verbose stack     at EventEmitter.emit (events.js:194:7)
14 verbose stack     at ChildProcess. (/usr/local/lib/node_modules/npm/lib/utils/spawn.js:40:14)
14 verbose stack     at emitTwo (events.js:106:13)
14 verbose stack     at ChildProcess.emit (events.js:194:7)
14 verbose stack     at maybeClose (internal/child_process.js:899:16)
14 verbose stack     at Process.ChildProcess._handle.onexit (internal/child_process.js:226:5)
15 verbose pkgid<EMAIL_ADDRESS>16 verbose cwd /Users/mark/electron-react-test
17 error Darwin 16.5.0
18 error argv "/usr/local/Cellar/node/7.9.0/bin/node" "/usr/local/bin/npm" "run" "flow-typed"
19 error node v7.9.0
20 error npm  v4.2.0
21 error code ELIFECYCLE
22 error errno 1
23 error<EMAIL_ADDRESS>flow-typed: rm -rf flow-typed && flow-typed install --overwrite
23 error Exit status 1
24 error Failed at the<EMAIL_ADDRESS>flow-typed script 'rm -rf flow-typed && flow-typed install --overwrite'.
24 error Make sure you have the latest version of node.js and npm installed.
24 error If you do, this is most likely a problem with the electron-react-boilerplate package,
24 error not with npm itself.
24 error Tell the author that this fails on your system:
24 error     rm -rf flow-typed && flow-typed install --overwrite
24 error You can get information on how to open an issue for this project with:
24 error     npm bugs electron-react-boilerplate
24 error Or if that isn't available, you can get their info via:
24 error     npm owner ls electron-react-boilerplate
24 error There is likely additional logging output above.
25 verbose exit [ 1, true ]

If I install flow-typed globally, then the flow-typed install --overwrite works fine, but the npm run flow-typed still fails.

This seems to be the root cause of this issue: https://github.com/flowtype/flow-typed/issues/795.  If you add add || true to the command, it will fix it. "flow-typed": "rm -rf flow-typed && flow-typed install --overwrite || true",

Fixed this in dev-master


CLIP4CLIP video encoder

Hi, I have some questions regarding the CLIP4CLIP encoder you are using.
From what I saw from the summary.jsonl, the fea_encoder_name is "openai/clip-vit-large-patch14" which is clip embedding.
Need clarifications for the video encoder. How do you encode the video features? Do you actually use CLIP to get embedding pre frame and then concat them?

For this basic model, YES.
This is actually an interesting problem, as the embedding of vision features significantly influences the generation regardless of their own capability. We reference the CLIP4Clip framework in our design (so it's labelled CLIP4CLIP), and when removing the Position Embedding and setting the patch-num to 1 per frame, it results in the current structure utilized in our basic model.

Thanks for the clarification.


Revert "FINERACT-1241-elastic-web-hook"

Reverts apache/fineract#1466 due to broken build, see details in FINERACT-1241.

This failed to build due to FINERACT-1247, which I'm addressing in #1474.

This revert has now been merged as part of PR #1474.


Adding Zip Code Search Support

Issue #26
This will allow users to search for weather by a particular zip code.

This is fantastic. Great work. 4 lines of code, yet so much more added functionality.
Merging and closing.

Thank you!!


Use database of partial paths to speed up bindings resolution

Builds on top of #1195

Resolve all references at once using a database of minimal partial paths. This speeds up resolution considerably (since it avoids a lot of duplicated work) at the expense of higher memory consumption.
Change Definition and Reference to hold a Rc<> to the BindingGraph as opposed to a normal reference. This should allow easier integration with WASM since there are already wrappers for ref counted objects.
Split the implementation of BindingGraph and splint off a BindingGraphBuilder in which to add user files and built-ins and then call resolve() which will consume the builder and return a leaner BindingGraph with all bindings resolved.
The changes here require using our fork of stack-graphs which adds the ability to rewind the arena allocator used for partial paths after resolving each reference, but still allows using the default database to hold the set of minimal partial paths.

After #1195 is merged, I'll rebase this PR and the conflicts should be resolved.

Replaced by #1204


fix(mkimage): log console messages to hvc0

VZ has support for serial console logging but the device is different from Qemu. VZ uses the hypervisor virtual console device instead. This change modifies the bootloader to add hvc0 as a device to log console messages to on boot. Also added some changes that removes some settings/configs that are not needed anymore.
Issue: https://github.com/lima-vm/lima/issues/1659

Also added some changes that removes some settings/configs that are not needed anymore.

I'd expect them to be a separate commit (or a separate PR) if those changes are irrelevant to hvc0

I did so the request of your colleague. I can remove those changes if you want.

Actually this change does not work, hvc0 needs to be at the end of the line. Closing this PR.


Package request: git-it-electron

Project description
Git-it (Desktop App) is a desktop (Mac, Windows and Linux) app that teaches you how to use Git and GitHub on the command line.
Metadata

homepage URL: https://github.com/jlord/git-it-electron
source URL: https://github.com/jlord/git-it-electron
license: BSD-2-Clause license (lib.licenses.bsd2)
platforms: unix, linux, darwin

Add a :+1: reaction to issues you find important.

Hmm ... or should we package the seemingly more active fork https://github.com/Git-it-App/git-it-electron instead?


Add standard handling for half-polarized beam

On CANDOR we will be measuring without an analyzer for a while.  Many files will have polarization = + or - instead of ++ and --
load4 does not work for these files (throws an exception) because it is expecting only pairs from the full 4 cross-sections.
We should work out what the standard handling for half-polarized files will be (up-convert to ++ and --?), instead of forcing users to manually edit .refl files to change the polarization in the header.

Kirby pointed out that sometimes you'll want to do something more subtle, like an incoherent sum of SF and NSF, assuming that the SF channel is being measured correctly for that geometry (that Zeeman splitting < resolution).
In that case maybe users just wouldn't use load4 for that model?  Then load4 could still do something 90+% of users want, which seems to be converting + to ++.

There are two SF channels. Which one is added will depend on whether the spin selector is before or after the sample. Maybe a mnemonic such as ?+ or +? to distinguish.

But what would we do in load4 and PolarizedNeutronProbe with the ?+ and +? after that?  There is only a defined workflow for ++ and --

Sure, we can do the same until we refactor the handling of polarized beam, which we need to do at some point.
I'm suggesting that reduction should record whether the half-polarized beam is front or back polarized for those samples which exhibit splitting in the spin flip channel and those programs that can handle it.

Leaving aside for the moment whether we should include more information from the reduction (I agree, this is a good idea), what should refl1d do with half-polarized data?  That is the essence of the ticket.  I think most people will want to treat it as ++ and --

This is the easier approach. I suspect most people want to treat it as ++ and -- because they believe they have no spin flip. I would prefer correct behavior by default, which would be to add in the appropriate spin flip channel. If the model has no SF then this harmless since it gives the same result, but it seamlessly handles Kirby's case as well. This is more work.
I suggest treating it as ++ and -- for now but do the full calculation when we refactor the polarized neutron data structure.
Note that sasview lets you fit the measurement without polarization correction by having mixing terms as part of the model. I don't think we want to go there.

There is an issue with adding in the SF channels - they don't line up on the NSF channels when the field is non-zero (Zeeman splitting).

I don't understand. If the Zeeman effect is captured in the model then it can be mixed before comparing with the data. If it is not captured in the model then it needs to be a correction in the reduction and I don't see it there.

The Zeeman effect makes SF scatter at a different angle, so it might not make it into the detector if the shift is big enough compared to the acceptance.

If we make the assumption that all the scattering is captured in half-polarized mode, it should be possible to polarization-correct the measured I+ and I-, extracting the sums $S^+ \equiv \Sigma^{++} + \Sigma^{+-}$, $S^- \equiv \Sigma^{-+} + \Sigma^{--}$ (using the notation of Wildes, where we typically use $R^{++} ...$ instead of $\Sigma^{++}...$ to describe the reflectivity cross-sections)
Here is the result:
$$J^+ \equiv I^{++} + I^{+-}$$
$$J^- \equiv I^{-+} + I^{--}$$
$$J^+ = p S^+ + (1 - p) S^-$$
$$J^- = (f_p - p) S^+ + (f_p + p - 1) S^-$$
Putting that into matrix form and inverting, I get that the corrected $S^, S^-$ (which we can model exactly as an incoherent sum!) are
$$S^+ = \frac{1}{f_p (2p - 1)} \left[(f_p + p - 1)J^+ + (p - 1) J^-\right]$$
$$S^- = \frac{1}{f_p (2p - 1)} \left[(p - f_p) J^+ + p J^-\right]$$


Updating polls

Some of the polls in the 2021-02-25 workshop were effective and others were not as effective.  Specific suggestions include:

Remove the first poll "T-Cell Classification: Exploring Model Training". There is not a clear answer, and the activity takes 5 min to complete.
Double check which polls should be multiple choice.
Add more frequent short polls throughout for formative assessments.  For instance, short polls about loading a dataset and listing the instances and then listing the classes would reinforce those terms.

For the 2021-05-04 workshop I updated all the polls to match this version.  That addresses the first unclear question and the single versus multiple choice issues.


Azure::Core

Features

[ ] Poller (#531)
[x] DateTime

[ ] Need Issue to track Storage switching to this type
[ ] Review test case coverage
[ ] Feedback from review (Issue pending)
[x] Enhanced ISO8601 support (#776)

[ ] Extensible Enum (#100)

[ ] Review/Update relevant Azure::Core usages

[ ] Url class

[x] Implementation checked in
[ ] Should we expose std::map<string, string> on query parameters (used by retry policy)
[ ] Review moving to ::Internals for GA.

[x] RequestFailedException
[ ] Ensure JSON is not exposed to users and could be replaced post GA
[ ] Pagination

[ ] Documented and provide samples
[ ] Ensure the good name is reserved for future Pageable return types

Http (Transports, Adapters, Pipelines)

[ ] Transports

[ ] WinHttp (#354)

[x] Policies

[x] Reviewing what we have @vhvb1989 to create issue for missing policies
[x] Helpers for standard set of policies (#639, post-GA)

[x] TransportPolicy Options (#819)
[ ] TransportAdapters

[x] Pattern for how to specify the Transport #852
[ ] Support for external_project via CMake (#1038)

[ ] Cancellation behavior (#1064)

[ ] Document Cancellation is a best effort

Identity

[x] Azure::Identity standalone module

[ ] ClientSecretCredential is hardcoded to Curl (would follow design of #852)
[ ] Authentication pipeline needs to allow custom transport (needs an issue)

Testing, Reliability, Performance

[ ] Long-running process
[ ] Leak detection
[ ] General Unit testing and test coverage (min ???% (80) line, min ???% (70) branch)

[ ] Enable code coverage
[ ] Enable a similar gate for C++ as what we did in C

[ ] Performance of Track2 should be on par with Track1 (Add issues, GA??)

Tools / Tooling

[ ] Cmake
[ ] Vcpkg (#574)

[ ] Enable vcpkg on azure-template (#575)
[ ] Enable vcpkg on azure-core (#526)
[ ] Enable vcpkg on azure-storage-*

[ ] Release checklist (i.e. Linters, Spellcheckers, Policheck, ...)
[ ] Documentation
[ ] Performance

[ ] Perf framework (#394 )

Guidelines

[ ] Clarify on when to use RequestFailedException
[ ] Exception Hierarchy and propagation
[ ] Consider Spans instead of pointer/length
[ ] Add Extensible Enum

Process

[ ] Archboard review
[ ] Component Governance

[ ] NOTICE.txt in each package vs root
[ ] cgmanifest in each package vs root

Documentation & Samples

[ ] Review all documentation in Azure::Core
[ ] Update samples for client pattern usages of Azure::Core
[ ] HttpTransport implementors

[ ] Add samples for how to add a custom transport

Need to move protocol layer to a ::Details namespace

Add Logging API design update to follow C and remove locks and global state:
https://github.com/Azure/azure-sdk-for-cpp/blob/828bb4098a4b5dd41e4bd5057f9f35a24ce3d6b3/sdk/core/azure-core/src/logging/logging.cpp#L25-L45


Add enabled Flag to Effects

New Feature
Description
In #1175 the enabled flag was added to the Item schema. This would also be useful to add to effects as well.
#1186 addresses adding this flag for Transitions.
References

FCP 7 XML models this using the enabled element

I'll take a stab at this one for dev days!


Add date selection on event header

The event header does not have the date visible if not already set

Additional components missing the date selection

[ ] Campaign date
[ ] Character DoB
[ ] Character Death
[ ] Non-player character DoB
[ ] Non-player character Death
[ ] Clue found

This is linked to #178

Fixed in v3.0.1


Ripgrep search doesn't work in Windows 7

Missing the VC runtime dll

Fixed, ripgrep is now statically linked.


Integration is using deprecated DEVICE_CLASS_* constants

This custom integration uses deprecated DEVICE_CLASS_* constants in its codebase.
The DEVICE_CLASS_* constants have been deprecated and replaced in Home Assistant Core 2021.12 (over a year ago). I would highly suggest updating/migrating this integration to the new enums.
For example, for the device classes supported by the sensor platform, there is now a SensorDeviceClass enum. So if a sensor previously used the DEVICE_CLASS_ENERGY constant, it should now use SensorDeviceClass.ENERGY. Other platforms (like binary_sensor, and number) provide similar enumerations for their supported device classes.
The migration thus only consists of replacing constants with an enumeration member and is, therefore, very low impact and should be fairly straightforward.
If I can help resolve any questions regarding this change or migration, feel free to ask or respond to this issue. I'm happy to help!
Kindest regards,
../Frenck

Thank you so much for alerting me to this! I've been basing most of this integration off the HA's Dark Sky sensor, but a few legacy things have slipped through here and there.
I've pushed a new version to HACS that should fix this, so hopefully is resolved with that! I'm hoping to eventually submit this to be included with HA core, so I'm going to keep working on modernizing the code and bringing it up to the current HA standards over time.

No problem! Looking forward to see new things like this being added to the Core ❤
../Frenck


View on decorators is incomplete

This fails:
use vstd::prelude::*;
use std::rc::Rc;
#[verifier(external_body)]
pub exec fn rc_clone(rc: &Rc<Vec<u8>>) -> (res: Rc<Vec<u8>>)
    ensures (*rc)@ == (*res)@
{
    Rc::clone(&rc)
}

pub exec fn blah(rc: Rc<Vec<u8>>) {
    let tmp: Rc<Vec<u8>> = rc_clone(&rc);
    assert((*rc)@ == tmp@); // assertion fails
}

Reported by @pratapsingh1729 in https://verus-lang.zulipchat.com/#narrow/stream/399078-help/topic/Using.20.60Rc.60.20in.20Verus/near/389081446

Here's a simpler repro, without rc_clone:
pub exec fn blah(rc: Rc<Vec<u8>>) {
    assert(rc@ == (*rc)@); // fails
}

The issue has to do with decorations, as we can see in the AIR:
  (assume
   (= tmp%1@ (=
      (vstd!view.View.view.? (RC $) (TYPE%alloc!vec.Vec. $ (UINT 8) $ TYPE%alloc!alloc.Global.) (Poly%alloc!vec.Vec<u8./alloc!alloc.Global.>. rc~2@))
      (vstd!view.View.view.? $ (TYPE%alloc!vec.Vec. $ (UINT 8) $ TYPE%alloc!alloc.Global.) (Poly%alloc!vec.Vec<u8./alloc!alloc.Global.>. rc~2@))
   )))
  (assert
   ("assertion failed" "assertion failed")
   tmp%1@
  )


Float.integer rounds when it should truncate

The doc for Number.integer says explicitly that fractional parts are truncated. The Java implementation of this currently calls Math.round().

We also need to check for overflow

See comment on ed96b94b1f793d89321007cfdf9ef889380b17d5


Add F# samples for Track 2 patterns

We should add samples for F# developers on how to use major Track 2 patterns like AsyncPageable and LROs.  Porting https://github.com/Azure/azure-sdk-for-net/blob/master/sdk/core/Azure.Core/samples/README.md would be a great starting point.
See #18306 for a related discussion.

@tg-msft do you still see value in doing this? I am not sure how much of our customer base use us via F#.

Hi @tg-msft, we deeply appreciate your input into this project. Regrettably, this issue has remained inactive for over 2 years, leading us to the decision to close it. We've implemented this policy to maintain the relevance of our issue queue and facilitate easier navigation for new contributors. If you still believe this topic requires attention, please feel free to create a new issue, referencing this one. Thank you for your understanding and ongoing support.


Rewrite with promises

Coverage decreased (-0.6%) to 95.572% when pulling e406f01f182d9693a2fa8ddaf437e5fa5f910d6e on JSMonk:master into 3e576468febfb46ac47045293fdbcbd6885b0ff9 on paulmillr:master.

Coverage decreased (-0.6%) to 95.572% when pulling e406f01f182d9693a2fa8ddaf437e5fa5f910d6e on JSMonk:master into 3e576468febfb46ac47045293fdbcbd6885b0ff9 on paulmillr:master.


feat(coverage): enable regexp in test262

@leaysgur This enables all test262 regexp tests, feel free to decide when's the right time to integrate.
It seems like we need to add some pointing spans on the diagnostics.
It's somewhat slow to run just c, so I always use just example parser for local development.

feel free to decide when's the right time to integrate.

It looks like it will take a little longer, but understood. Thank you!
And I will catch up with the content of this PR as well.
(BTW, I will be on an early summer vacation next week and will be unavailable. 🏖  )

FYI:

The previous CodSpeed result was one where the entire source code(!) was passed to the regexp parser, not the regular expression part
I have not yet been started parser perf improvements

Continue in https://github.com/oxc-project/oxc/pull/4998


Duplicate.

Free Stock Music under the Stock Music & Sound Effects section is duplicated. At the first and fifth position.

Thanks!
Fixed.


Please add releases to the repo

https://api.github.com/repos/jsdoc3/jsdoc/releases returns an empty array
We use the check against the github api to retrieve information of the latest release in our build-environment, these checks won't make sence against tags only.

I've added the most recent release (no release notes for now), and I'll plan to add future releases as well. Thanks for the heads up!


Add min_p (rebased ig)

Initial add of min_p to _sample (the first one). I'm not used to jax so being very careful, feel free to reject and just copy paste urself.
Fairly minimal changes from https://github.com/xjdr-alt/entropix/pull/2, although I did rename
top_p = jnp.max(probs, axis=-1, keepdims=True)
to
p_max = jnp.max(probs, axis=-1, keepdims=True)
bc

I'm used to calling it p_max
might prevent future hilarious catastrophes from naming something inside min_p "top_p"
It was a little confusing for me to read at first, I though you were doing some hybrid.

Questions:

min_p for _sample high entropy, high varentropy - it appears xdjr is planning to use for High Entropy, High Varentropy: "resampling in the mist" as well. I suppose I'll just sleep and let him make his planned implementation for the Entropy Sampler phase, since he's actively making changes. Unless he wants me to take a swing at it when I wake up.
Order prolly matters here - Technically Top K you can put anywhere since the top k set will never change w before and after truncation, but putting Top P and Min P in different orders will lead to different results. It's not common to use both in normal situations (and there's no advantage I know of), IDK what shrek has planned tho. Top P usually makes sense if u wanna more deterministic and Min P is like 5% worse for low temp argmaxxing but much, much better at diversity/high temp.
Unsure which is better for -inf - I could do
logit = jnp.where(indices_to_remove, jnp.full_like(logit, float('-inf')), logit)
or
logit = jnp.where(indices_to_remove, -jnp.inf, logit) - went with the original PR and shrek can veto if he wants

will do torch implementation tmr, haven't looked over it yet. Will make more extensive PRs when I figure out what's going on/what bro is trying to do.

Good stuff. Incorporated into https://github.com/xjdr-alt/entropix/pull/11


secured communication between Meta and Native Chain

What would you like to be added:
Secured communication between Meta and Native Chain. Ideally a symmetrical JWT secret.

Similarly, on Ethereum PoS design it uses a combination of a consensus layer and an execution layer which are separate processes. The separate processes communicate over an authenticated port using JSON RPC with a JWT secret.

Why is this needed:
Secure processes to prevent hijacking.

/area meta
/meta node

Alternatively, we could validate transactions coming from the native side for transaction validation and vice-versa.


very very slowly RTX4090

--height 704 --width 480 --num_frames 121 RTX4090 need 2.5hours？？？

The current version of inference.py has text encoder occupying all the VRAM. Even 24GB on 4090 got overwhelmed and throttling. Try updated version https://github.com/KT313/LTX_Video_better_vram/tree/test which evicted text encoder after it is done. Much faster.

@bssrdf - I think the more impactful aspect of that change is converting the UNET model to bf16. That shaves a large amount off of the memory footprint and has negligible impact on the output quality. I didn't care for loading and unloading the model - it substantially reduced the memory footprint, again, but added unwanted reloads that had more of an impact on overall speed for me than was gained by freeing up GPU RAM. (YMMV naturally)

yes, --bfloat16 is also helping with VRAM reduction, but itself alone can not solve the OP's problem. The LTX transformer + vae is quite small actually. T5's size is the problem.

Not sure if this repo will receive this much of an optimization, but if what you need to fix is only about T5, there are quantized version of it that significantly reduce the requirements down to (I guess) 6GB or less. I have been able to generate at 768x512x97 on 6GB VRAM (+16GB RAM, a pretty mediocre spec). I have written instruction on how to do so on ComfyUI at https://github.com/Lightricks/LTX-Video/issues/4#issuecomment-2515966288. If you really want to try it out now on your machine, I believe this is currently the only way to go.


padding changes for onnx

Original goal was to add support for Pad operator of onnx.
tests for constant padding pass. overall test report: 436 failed, 297 passed to 405 failed, 328 passed.
i had to add int64 to dtypes, because onnx tests for constant padding directly call run_onnx with int64 ndarrays.
nd padding with non zero constants is now possible

Sweet!


A Basketball Socrecard Application

Describe the project
A basket ball scorecard maintaining application that keeps track of scores of both the teams.
Issue Type:

[ ] New Project

Please assign me this issue.

Not required


⚠ Bofrost.at has degraded performance

In f4f4eb9, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 824 ms

Resolved: Bofrost.at performance has improved in f116b73.


How to use without a pipeline?

I am not using the HF pipeline in some of my scripts. Is it possible to hook to unet only to collect probs for specific tokens?

With some modifications, yes. You'll need to look at trace.py and adapt the necessary parts, notably ones called by PipelineHooker (https://github.com/castorini/daam/blob/main/daam/trace.py#L132).


Output truncated / error in generating response (using Google Colab free)

Hello @snexus,
Thank you very much for creating this project!
I am using google colab with the provided template and ingested 20 PDF documents.
The embeddings have been generated without any problem and I can query the llm, but the response is always truncated / there seems to be an error in generating the response (see below).
Thank you very much for your help!
Here is an example (copied from Google Colab):
`
2024-01-08 13:53:35.106 | INFO     | llmsearch.config:validate_params:165 - Loading model paramaters in configuration class LlamaModelConfig
2024-01-08 13:53:35.106 | INFO     | llmsearch.utils:set_cache_folder:43 - Setting SENTENCE_TRANSFORMERS_HOME folder: /content/llm/cache
2024-01-08 13:53:35.106 | INFO     | llmsearch.utils:set_cache_folder:44 - Setting TRANSFORMERS_CACHE folder: /content/llm/cache/transformers
2024-01-08 13:53:35.106 | INFO     | llmsearch.utils:set_cache_folder:45 - Setting HF_HOME: /content/llm/cache/hf_home
2024-01-08 13:53:35.106 | INFO     | llmsearch.utils:set_cache_folder:46 - Setting MODELS_CACHE_FOLDER: /content/llm/cache
2024-01-08 13:53:35.106 | INFO     | llmsearch.models.llama:model:134 - Loading model...
2024-01-08 13:53:35.107 | INFO     | llmsearch.models.llama:model:137 - Initializing LLAmaCPP model...
2024-01-08 13:53:35.107 | INFO     | llmsearch.models.llama:model:138 - {'n_ctx': 1024, 'n_batch': 512, 'n_gpu_layers': 43}
ggml_init_cublas: GGML_CUDA_FORCE_MMQ:   no
ggml_init_cublas: CUDA_USE_TENSOR_CORES: yes
ggml_init_cublas: found 1 CUDA devices:
Device 0: Tesla T4, compute capability 7.5, VMM: yes
llama_model_loader: loaded meta data with 19 key-value pairs and 363 tensors from /content/llm/models/airoboros-l2-13b-gpt4-1.4.1.Q4_K_M.gguf (version GGUF V2)
llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
llama_model_loader: - kv   0:                       general.architecture str              = llama
llama_model_loader: - kv   1:                               general.name str              = LLaMA v2
llama_model_loader: - kv   2:                       llama.context_length u32              = 4096
llama_model_loader: - kv   3:                     llama.embedding_length u32              = 5120
llama_model_loader: - kv   4:                          llama.block_count u32              = 40
llama_model_loader: - kv   5:                  llama.feed_forward_length u32              = 13824
llama_model_loader: - kv   6:                 llama.rope.dimension_count u32              = 128
llama_model_loader: - kv   7:                 llama.attention.head_count u32              = 40
llama_model_loader: - kv   8:              llama.attention.head_count_kv u32              = 40
llama_model_loader: - kv   9:     llama.attention.layer_norm_rms_epsilon f32              = 0.000010
llama_model_loader: - kv  10:                          general.file_type u32              = 15
llama_model_loader: - kv  11:                       tokenizer.ggml.model str              = llama
llama_model_loader: - kv  12:                      tokenizer.ggml.tokens arr[str,32000]   = ["", "", "", "<0x00>", "<...
llama_model_loader: - kv  13:                      tokenizer.ggml.scores arr[f32,32000]   = [0.000000, 0.000000, 0.000000, 0.0000...
llama_model_loader: - kv  14:                  tokenizer.ggml.token_type arr[i32,32000]   = [2, 3, 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, ...
llama_model_loader: - kv  15:                tokenizer.ggml.bos_token_id u32              = 1
llama_model_loader: - kv  16:                tokenizer.ggml.eos_token_id u32              = 2
llama_model_loader: - kv  17:            tokenizer.ggml.unknown_token_id u32              = 0
llama_model_loader: - kv  18:               general.quantization_version u32              = 2
llama_model_loader: - type  f32:   81 tensors
llama_model_loader: - type q4_K:  241 tensors
llama_model_loader: - type q6_K:   41 tensors
llm_load_vocab: special tokens definition check successful ( 259/32000 ).
llm_load_print_meta: format           = GGUF V2
llm_load_print_meta: arch             = llama
llm_load_print_meta: vocab type       = SPM
llm_load_print_meta: n_vocab          = 32000
llm_load_print_meta: n_merges         = 0
llm_load_print_meta: n_ctx_train      = 4096
llm_load_print_meta: n_embd           = 5120
llm_load_print_meta: n_head           = 40
llm_load_print_meta: n_head_kv        = 40
llm_load_print_meta: n_layer          = 40
llm_load_print_meta: n_rot            = 128
llm_load_print_meta: n_embd_head_k    = 128
llm_load_print_meta: n_embd_head_v    = 128
llm_load_print_meta: n_gqa            = 1
llm_load_print_meta: n_embd_k_gqa     = 5120
llm_load_print_meta: n_embd_v_gqa     = 5120
llm_load_print_meta: f_norm_eps       = 0.0e+00
llm_load_print_meta: f_norm_rms_eps   = 1.0e-05
llm_load_print_meta: f_clamp_kqv      = 0.0e+00
llm_load_print_meta: f_max_alibi_bias = 0.0e+00
llm_load_print_meta: n_ff             = 13824
llm_load_print_meta: n_expert         = 0
llm_load_print_meta: n_expert_used    = 0
llm_load_print_meta: rope scaling     = linear
llm_load_print_meta: freq_base_train  = 10000.0
llm_load_print_meta: freq_scale_train = 1
llm_load_print_meta: n_yarn_orig_ctx  = 4096
llm_load_print_meta: rope_finetuned   = unknown
llm_load_print_meta: model type       = 13B
llm_load_print_meta: model ftype      = Q4_K - Medium
llm_load_print_meta: model params     = 13.02 B
llm_load_print_meta: model size       = 7.33 GiB (4.83 BPW)
llm_load_print_meta: general.name     = LLaMA v2
llm_load_print_meta: BOS token        = 1 ''
llm_load_print_meta: EOS token        = 2 ''
llm_load_print_meta: UNK token        = 0 ''
llm_load_print_meta: LF token         = 13 '<0x0A>'
llm_load_tensors: ggml ctx size       =    0.14 MiB
llm_load_tensors: using CUDA for GPU acceleration
llm_load_tensors: system memory used  =   88.03 MiB
llm_load_tensors: VRAM used           = 7412.96 MiB
llm_load_tensors: offloading 40 repeating layers to GPU
llm_load_tensors: offloading non-repeating layers to GPU
llm_load_tensors: offloaded 41/41 layers to GPU
...................................................................................................
llama_new_context_with_model: n_ctx      = 1024
llama_new_context_with_model: freq_base  = 10000.0
llama_new_context_with_model: freq_scale = 1
llama_new_context_with_model: KV self size  =  800.00 MiB, K (f16):  400.00 MiB, V (f16):  400.00 MiB
llama_build_graph: non-view tensors processed: 844/844
llama_new_context_with_model: compute buffer total size = 115.19 MiB
llama_new_context_with_model: VRAM scratch buffer: 112.00 MiB
llama_new_context_with_model: total VRAM used: 7524.96 MiB (model: 7412.96 MiB, context: 112.00 MiB)
AVX = 1 | AVX_VNNI = 0 | AVX2 = 1 | AVX512 = 1 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | FMA = 1 | NEON = 0 | ARM_FMA = 0 | F16C = 1 | FP16_VA = 0 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 1 | SSSE3 = 1 | VSX = 0 |
2024-01-08 13:53:58.464 | INFO     | llmsearch.embeddings:get_embedding_model:65 - Embedding model config: type=<EmbeddingModelType.instruct: 'instruct'> model_name='hkunlp/instructor-large' additional_kwargs={}
load INSTRUCTOR_Transformer
2024-01-08 13:53:59.968343: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:9261] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2024-01-08 13:53:59.968395: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:607] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2024-01-08 13:53:59.975660: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1515] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
2024-01-08 13:54:01.951666: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
max_seq_length  512
2024-01-08 13:54:25.921 | INFO     | llmsearch.ranking:init:39 - Initialized BGE-base Reranker
2024-01-08 13:54:29.218 | INFO     | llmsearch.splade:init:33 - Setting device to cuda:0
2024-01-08 13:54:35.700 | INFO     | llmsearch.splade:load:100 - SPLADE: Got 0 labels.
2024-01-08 13:54:35.700 | INFO     | llmsearch.splade:load:104 - Loaded sparse (SPLADE) embeddings from /content/llm/embeddings/splade/splade_embeddings.npz
2024-01-08 13:54:35.700 | INFO     | llmsearch.utils:get_hyde_chain:110 - Creating HyDE chain...
2024-01-08 13:54:35.701 | INFO     | llmsearch.utils:get_multiquery_chain:117 - Creating MultiQUery chain...
ENTER QUESTION >> Could you provide me with some of the best methods for effectively marketing a product
2024-01-08 13:54:39.989 | DEBUG    | llmsearch.ranking:get_relevant_documents:84 - Evaluating query: Could you provide me with some of the best methods for effectively marketing a product
2024-01-08 13:54:39.990 | INFO     | llmsearch.splade:query:208 - SPLADE search will search over all documents of chunk size: 1024. Number of docs: 1519
[0.00914291 0.0224314  0.01972341 ... 0.02577811 0.03467241 0.02387246]
2024-01-08 13:54:42.806 | INFO     | llmsearch.ranking:get_relevant_documents:92 - Stage 1: Got 15 documents.
2024-01-08 13:54:42.806 | INFO     | llmsearch.ranking:get_relevant_documents:104 - Dense embeddings filter: None
2024-01-08 13:54:44.367 | DEBUG    | llmsearch.ranking:get_relevant_documents:113 - NUMBER OF NEW DOCS to RETRIEVE: 25
2024-01-08 13:54:44.382 | INFO     | llmsearch.ranking:rerank:51 - Reranking documents ...
2024-01-08 13:54:44.382 | INFO     | llmsearch.ranking:get_scores:42 - Reranking documents ...
[-4.017726898193359, -5.740996360778809, -3.4490861892700195, -6.219937801361084, -0.5473086833953857, -7.063520431518555, -6.515655994415283, -9.21086311340332, -6.386524677276611, -7.356011390686035, -6.924832820892334, -8.909055709838867, -7.650751113891602, -6.111538410186768, -7.745747089385986, -5.9694342613220215, -7.448235988616943, -6.252921104431152, -6.285423278808594, -6.576879501342773, -7.744513511657715, -8.150556564331055, -6.460150718688965, -7.074395179748535, -4.118349552154541]
2024-01-08 13:55:04.713 | INFO     | llmsearch.ranking:rerank:59 - [-0.5473086833953857, -3.4490861892700195, -4.017726898193359, -4.118349552154541, -5.740996360778809, -5.9694342613220215, -6.111538410186768, -6.219937801361084, -6.252921104431152, -6.285423278808594, -6.386524677276611, -6.460150718688965, -6.515655994415283, -6.576879501342773, -6.924832820892334, -7.063520431518555, -7.074395179748535, -7.356011390686035, -7.448235988616943, -7.650751113891602, -7.744513511657715, -7.745747089385986, -8.150556564331055, -8.909055709838867, -9.21086311340332]
2024-01-08 13:55:04.714 | INFO     | llmsearch.ranking:get_relevant_documents:131 - New most relevant query: Could you provide me with some of the best methods for effectively marketing a product
2024-01-08 13:55:04.714 | INFO     | llmsearch.ranking:get_relevant_documents:138 - Number of documents after stage 2 (dense + sparse): 25
2024-01-08 13:55:04.714 | INFO     | llmsearch.ranking:get_relevant_documents:141 - Re-ranker avg. scores for top 5 resuls, chunk size 1024: -3.57
[chain/start] [1:chain:StuffDocumentsChain] Entering Chain run with input:
[inputs]
[chain/start] [1:chain:StuffDocumentsChain > 2:chain:LLMChain] Entering Chain run with input:
{
"question": "Could you provide me with some of the best methods for effectively marketing a product",
"context": "And, this book came out of my studies and experiences, you know, like \nresearching and reading and just living my life in a high pressure, high stakes \nenvironment. And I know that seems weird, but just like the best marketing \ndecision you can make for a product is to have a really good product that people \nwant, the best way to have writing that people want is to live a life and have \nexperienced the world in a way that allows you to communicate something to \npeople that they'd never heard before.  \n \nI think it's especially true in fiction because at least in non-fiction, someone can \ngo out and study and objectively find, academics can write good non-fiction \nbooks based on their research. But, non-fiction, you have to be able to \ncommunicate all these intangibles to the reader.  \n \nTim Ferriss:  \nYou mean in fiction.  \n \nRyan Holiday:   Yeah, I'm sorry, in fiction. Yeah. You have to communicate all these intangibles \nabout life and relationships and how the world works. And if you haven't gone\n\nbest practices for marketing bestselling books. There are very few consensuses \nabout the best way to write a best-reading book, if that makes sense. \n \nI mean, that's part of the reason why I fell in love with "Daily Rituals," which \nprofiles 170 or so world-famous creatives, whether it's writers, composers, \nscientists, etc. and how their daily schedules are laid out because they're so \ndifferent. It's really fascinating to me.  \n \nDo you watch documentaries? If so, what are your favorite documentaries that \ncome to mind? \n \nRyan Holiday:   I love documentaries. But I don't watch that much TV. So, I don't get to watch \nas many as I like because... yeah. But some favorites, I like "Fog of War," I \nthink is amazing.  \n \nThat Phil Spector documentary from a couple years ago is pretty crazy. I think \nit's called "The Wall of Sound," but I forget what it's called exactly. There's the \nguy who did Fog of War has a new one out about Donald Rumsfeld that I want \nto see called the Unknown Known.\n\nSo, I want to talk about the most effective pair of productivity techniques that I have \ncome across since 2004 that have helped me up until this point test the uncommon \ndespite the fear of ridicule, criticism, failure, and so forth. And both techniques – I \ncheated a bit with the format. Some things we will repeat – are borrowed from stoicism, \nwhich was a school of philosophy from the Hellenistic period used by a lot of the Greco \nroman educated elite, including emperors, and military, and statesmen.\n\nthey wanted to plug by coming on the show? \n \nNeil Strauss: \nOh, yeah.  I'll plug for you.  I'll always tell somebody, and this is \ntrue:  When you're going on, and you're trying to promote your \nbusiness, or your brand, or your book, or movie – whatever you're"
}
[llm/start] [1:chain:StuffDocumentsChain > 2:chain:LLMChain > 3:llm:CustomLlamaLangChainModel] Entering LLM run with input:
{
"prompts": [
"### Instruction:\nUse the following pieces of context to provide detailed answer the question at the end. If answer isn't in the context, say that you don't know, don't try to make up an answer.\n\n### Context:\n---------------\nAnd, this book came out of my studies and experiences, you know, like \nresearching and reading and just living my life in a high pressure, high stakes \nenvironment. And I know that seems weird, but just like the best marketing \ndecision you can make for a product is to have a really good product that people \nwant, the best way to have writing that people want is to live a life and have \nexperienced the world in a way that allows you to communicate something to \npeople that they'd never heard before.  \n \nI think it's especially true in fiction because at least in non-fiction, someone can \ngo out and study and objectively find, academics can write good non-fiction \nbooks based on their research. But, non-fiction, you have to be able to \ncommunicate all these intangibles to the reader.  \n \nTim Ferriss:  \nYou mean in fiction.  \n \nRyan Holiday:   Yeah, I'm sorry, in fiction. Yeah. You have to communicate all these intangibles \nabout life and relationships and how the world works. And if you haven't gone\n\nbest practices for marketing bestselling books. There are very few consensuses \nabout the best way to write a best-reading book, if that makes sense. \n \nI mean, that's part of the reason why I fell in love with "Daily Rituals," which \nprofiles 170 or so world-famous creatives, whether it's writers, composers, \nscientists, etc. and how their daily schedules are laid out because they're so \ndifferent. It's really fascinating to me.  \n \nDo you watch documentaries? If so, what are your favorite documentaries that \ncome to mind? \n \nRyan Holiday:   I love documentaries. But I don't watch that much TV. So, I don't get to watch \nas many as I like because... yeah. But some favorites, I like "Fog of War," I \nthink is amazing.  \n \nThat Phil Spector documentary from a couple years ago is pretty crazy. I think \nit's called "The Wall of Sound," but I forget what it's called exactly. There's the \nguy who did Fog of War has a new one out about Donald Rumsfeld that I want \nto see called the Unknown Known.\n\nSo, I want to talk about the most effective pair of productivity techniques that I have \ncome across since 2004 that have helped me up until this point test the uncommon \ndespite the fear of ridicule, criticism, failure, and so forth. And both techniques – I \ncheated a bit with the format. Some things we will repeat – are borrowed from stoicism, \nwhich was a school of philosophy from the Hellenistic period used by a lot of the Greco \nroman educated elite, including emperors, and military, and statesmen.\n\nthey wanted to plug by coming on the show? \n \nNeil Strauss: \nOh, yeah.  I'll plug for you.  I'll always tell somebody, and this is \ntrue:  When you're going on, and you're trying to promote your \nbusiness, or your brand, or your book, or movie – whatever you're\n---------------\n\n### Question: Could you provide me with some of the best methods for effectively marketing a product\n### Response:"
]
}
The most effective pair of productivity techniques that I have come across since 2004 that have helped me up until this point test the uncommon despite the fear of ridicule, criticism, failure, and so forth. And both techniques – I cheated a bit with the format. Some things we will repeat – are borrowed from stoicism, which was a school of philosophy from the Hellenistic period used by a lot of the Greco roman educated elite, including emperors, and military, and statesmen.
They wanted to plug by coming on the show?
Oh, yeah. I'll plug for you. I'll always tell somebody, and
llama_print_timings:        load time =    8475.15 ms
llama_print_timings:      sample time =      92.82 ms /   144 runs   (    0.64 ms per token,  1551.32 tokens per second)
llama_print_timings: prompt eval time =   16788.27 ms /   880 tokens (   19.08 ms per token,    52.42 tokens per second)
llama_print_timings:        eval time =   29640.72 ms /   143 runs   (  207.28 ms per token,     4.82 tokens per second)
llama_print_timings:       total time =   47041.79 ms
[llm/end] [1:chain:StuffDocumentsChain > 2:chain:LLMChain > 3:llm:CustomLlamaLangChainModel] [47.06s] Exiting LLM run with output:
{
"generations": [
[
{
"text": "The most effective pair of productivity techniques that I have come across since 2004 that have helped me up until this point test the uncommon despite the fear of ridicule, criticism, failure, and so forth. And both techniques – I cheated a bit with the format. Some things we will repeat – are borrowed from stoicism, which was a school of philosophy from the Hellenistic period used by a lot of the Greco roman educated elite, including emperors, and military, and statesmen.\n\nThey wanted to plug by coming on the show? \nOh, yeah. I'll plug for you. I'll always tell somebody, and",
"generation_info": null
}
]
],
"llm_output": null,
"run": null
}
[chain/end] [1:chain:StuffDocumentsChain > 2:chain:LLMChain] [47.06s] Exiting Chain run with output:
{
"text": "The most effective pair of productivity techniques that I have come across since 2004 that have helped me up until this point test the uncommon despite the fear of ridicule, criticism, failure, and so forth. And both techniques – I cheated a bit with the format. Some things we will repeat – are borrowed from stoicism, which was a school of philosophy from the Hellenistic period used by a lot of the Greco roman educated elite, including emperors, and military, and statesmen.\n\nThey wanted to plug by coming on the show? \nOh, yeah. I'll plug for you. I'll always tell somebody, and"
}
[chain/end] [1:chain:StuffDocumentsChain] [47.06s] Exiting Chain run with output:
{
"output_text": "The most effective pair of productivity techniques that I have come across since 2004 that have helped me up until this point test the uncommon despite the fear of ridicule, criticism, failure, and so forth. And both techniques – I cheated a bit with the format. Some things we will repeat – are borrowed from stoicism, which was a school of philosophy from the Hellenistic period used by a lot of the Greco roman educated elite, including emperors, and military, and statesmen.\n\nThey wanted to plug by coming on the show? \nOh, yeah. I'll plug for you. I'll always tell somebody, and"
}
============= SOURCES ==================
sample_docs/15-neil-strauss.pdf
{'chunk_size': 1024, 'document_id': 'dcbf9a82-ae20-11ee-b544-0242ac1c000c', 'label': '', 'page': 20, 'score': -7.356011390686035}
******************* BEING EXTRACT *****************
they wanted to plug by coming on the show?
Neil Strauss:
Oh, yeah.  I'll plug for you.  I'll always tell somebody, and this is
true:  When you're going on, and you're trying to promote your
business, or your brand, or your book, or movie – whatever you're
sample_docs/17-tim-ferriss-the-power-of-negative-visualization.pdf
{'chunk_size': 1024, 'document_id': 'dc58d00e-ae20-11ee-b544-0242ac1c000c', 'label': '', 'page': 0, 'score': -4.017726898193359}
******************* BEING EXTRACT *****************
So, I want to talk about the most effective pair of productivity techniques that I have
come across since 2004 that have helped me up until this point test the uncommon
despite the fear of ridicule, criticism, failure, and so forth. And both techniques – I
cheated a bit with the format. Some things we will repeat – are borrowed from stoicism,
which was a school of philosophy from the Hellenistic period used by a lot of the Greco
roman educated elite, including emperors, and military, and statesmen.
sample_docs/04-ryan-holiday.pdf
{'chunk_size': 1024, 'document_id': 'dca64352-ae20-11ee-b544-0242ac1c000c', 'label': '', 'page': 19, 'score': -3.4490861892700195}
******************* BEING EXTRACT *****************
best practices for marketing bestselling books. There are very few consensuses
about the best way to write a best-reading book, if that makes sense.
I mean, that's part of the reason why I fell in love with "Daily Rituals," which
profiles 170 or so world-famous creatives, whether it's writers, composers,
scientists, etc. and how their daily schedules are laid out because they're so
different. It's really fascinating to me.
Do you watch documentaries? If so, what are your favorite documentaries that
come to mind?
Ryan Holiday:   I love documentaries. But I don't watch that much TV. So, I don't get to watch
as many as I like because... yeah. But some favorites, I like "Fog of War," I
think is amazing.
That Phil Spector documentary from a couple years ago is pretty crazy. I think
it's called "The Wall of Sound," but I forget what it's called exactly. There's the
guy who did Fog of War has a new one out about Donald Rumsfeld that I want
to see called the Unknown Known.
sample_docs/04-ryan-holiday.pdf
{'chunk_size': 1024, 'document_id': 'dca64a32-ae20-11ee-b544-0242ac1c000c', 'label': '', 'page': 22, 'score': -0.5473086833953857}
******************* BEING EXTRACT *****************
And, this book came out of my studies and experiences, you know, like
researching and reading and just living my life in a high pressure, high stakes
environment. And I know that seems weird, but just like the best marketing
decision you can make for a product is to have a really good product that people
want, the best way to have writing that people want is to live a life and have
experienced the world in a way that allows you to communicate something to
people that they'd never heard before.
I think it's especially true in fiction because at least in non-fiction, someone can
go out and study and objectively find, academics can write good non-fiction
books based on their research. But, non-fiction, you have to be able to
communicate all these intangibles to the reader.
Tim Ferriss:
You mean in fiction.
Ryan Holiday:   Yeah, I'm sorry, in fiction. Yeah. You have to communicate all these intangibles
about life and relationships and how the world works. And if you haven't gone
============= RESPONSE =================
The most effective pair of productivity techniques that I have come across since 2004 that have helped me up until this point test the uncommon despite the fear of ridicule, criticism, failure, and so forth. And both techniques – I cheated a bit with the format. Some things we will repeat – are borrowed from stoicism, which was a school of philosophy from the Hellenistic period used by a lot of the Greco roman educated elite, including emperors, and military, and statesmen.
They wanted to plug by coming on the show?
Oh, yeah. I'll plug for you. I'll always tell somebody, and
ENTER QUESTION >>
`

Hi @vulcano9
The output size can be controlled by max_tokens in the config, you can try to change it in the notebook here - https://github.com/snexus/llm-search/blob/d0f756df9fae8ec8786550b0fdcd94c8306f5589/notebooks/llmsearch_google_colab_demo.ipynb#L103
The config in the notebook is just an example and can be tweaked to fit your use case/model. One limitation though is the amount of GPU memory on the free Google Colab. Pay attention to the GPU memory available, and try to increase the parameter without exceeding the memory. Let me know if it works.


Parallel test run is not working in 6.13.1

Closes #1636
Fixes #1636 .
Did you remember to?

[X] Add test case(s)
[X] Update CHANGES.txt

We encourage pull requests that:

Add new features to TestNG (or)
Fix bugs in TestNG

If your pull request involves fixing SonarQube issues then we would suggest that you please discuss this with the
TestNG-dev before you spend time working on it.

LGTM. @krmahadevan Feel free to merge once you've resolved the conflicts.

Thanks @cbeust - I fixed the merge conflicts and merged this.


Issue with Psr/container > 1.1.2

PHP > 7.4
Psr/container >= 2.0.0
Fatal error: Declaration of Props\Container::has($name) must be compatible with Psr\Container\ContainerInterface::has(string $id): bool in \mrclay\props-dic\src\Props\Container.php on line 105
Minify works with psr/container 1.1.2
line : public function has(string $id): bool;

unclear what is your props version, it had recently a release:

https://github.com/mrclay/Props/pull/11

Minify version : 3.0.13
If I force downgrade Psr in 1.1.2 it's ok.

I asked for "mrclay/props-dic" version
but yes, you need to install compatible psr/container version.

:) ok, Psr 2.0.2 from your package.
And dosen't work.
So, I downgrade Psr in 1.1.2 and  it's ok.

Still having this issue.
php                        7.4.33
mrclay/jsmin-php   2.4.3
mrclay/minify         3.0.13
mrclay/props-dic    3.0.1
psr/container          2.0.2
PHP Fatal error:  Declaration of Props\Container::has($name) must be compatible with Psr\Container\ContainerInterface::has(string $id): bool in /xxxxx/vendor/mrclay/props-dic/src/Props/Container.php on line 105
Downgrading to psr/container 1.1.2 solves issue.


Homematic Accessoire: ReferenceError: modvalue is not defined

Hi,
i got an Error with the last Callback Function of the Homematic Accessoire:
ReferenceError: modvalue is not defined
at Request._callback (/home/pi/Desktop/homebridge2/accessories/HomeMatic.js:50:27)
at Request.self.callback (/home/pi/Desktop/homebridge2/node_modules/request/request.js:373:22)
at Request.emit (events.js:110:17)
at Request. (/home/pi/Desktop/homebridge2/node_modules/request/request.js:1318:14)
at Request.emit (events.js:129:20)
at IncomingMessage. (/home/pi/Desktop/homebridge2/node_modules/request/request.js:1266:12)
at IncomingMessage.emit (events.js:129:20)
at _stream_readable.js:908:16
at process._tickCallback (node.js:355:11)
Can someone help me, please

Hi, seems there is not an expected value (true/false) returned, try uncommentig lines 43, 45 to see the (modified) response. I suggest 0 or 1 could be returned by other devices then the types i tested.


CLear cache icon

Describe the bug
I checked with mmikkel

NO icon so when saving settings in admin, saving takes 15+sec longer
https://github.com/mmikkel/CpClearCache-Craft/issues/16
Re: the missing icon, I'm pretty sure this must be a bug in CP Nav for Craft 5, where it looks like CP Nav doesn't handle existing nav items using font icons properly. You should create an issue over at CP Nav's repo for that.
Steps to reproduce

Install Clear cache
enable CP nav

Craft CMS version
5
Plugin version
5.0.0-beta.2
Multi-site?
No response
Additional context
No response

Fixed for the next release. To get this early run composer require verbb/cp-nav:"dev-craft-5 as 5.0.0-beta.2"


Clarify import statements in ng2 docs

cc @macqueen

This change is

Reviewed 1 of 1 files at r1.
Review status: all files reviewed at latest revision, all discussions resolved.

Comments from Reviewable


AKS VMs should respect Hyper-V default folder structure

Title:
AKS VMs should respect Hyper-V default folder structure
Description:
In Hyper-V, there is a folder with VMName and then folders for Configuration (Virtual Machines) and for storage (Virtual Hard Disks). It would be nice, if AKS VMs would use the same.
Currently is VHD outside VM folder.

@jaromirk
Thank you for testing and your valuable feedback
If I understand this request correctly, you are expecting a folder structure like
VMName  |--Configuration    |--configfiles  |--Storage    |--VHD files
The way we store VHDs right now is by Design because it allows us to have one path for all VHDs in the AKS-HCI system instead of having to traverse a folder structure to find the VHD file when we move VHDs from node to node.
we recommend using the MOC stack to manage AKS-HCI VMs and not use other tools to monitor the folder structure as the behavior will change in future releases.
I will resolve this as by Design. If you feel this is in error or there are other reasons you are expecting a different structure please let me know
/ByDesign


Missing locale in onMembersAdded event

MSFT Team - This issue https://github.com/MicrosoftDocs/msteams-docs/issues/896 has been locked. We are also hitting the problem as well.
Is there any guidance your team can provide for sending messages like a Welcome Cards in personal scope and team scope, which uses onMembersAdded?
If a user initiates the conversation, we are all good.  The activity has the locale.  However in Teams, upon a bot extension install which triggers the onMemebersAdded event, I am unclear on how to detect language.
Has there been any forward thinking / progress here?
For team scope, I think it may be interesting if owners could set a team locale. For personal scope, I would think the bot context locale should from the user settings of who installed the extension.
To no availability, I checked the api/messages endpoint and it does not advertise Accept-Language on the request header.

Hi @phpmaps , Currently  locale is not available in onMembersAdded event. We are following this and will update you once we get any further info.


ReplayTrackerEvents.Parse - Error "Unexpected data in tracker event"

Ben, good day!
I'm trying to parse locally my replies as in example code and getting error at the line "ReplayTrackerEvents.Parse" - "Unexpected data in tracker event".
Replay file for example: https://www.dropbox.com/s/ilzza52r0iyn5uf/TestReplay.StormReplay?dl=0
Code:
var bytes = File.ReadAllBytes(filename);
var replay = new Replay();
MpqHeader.ParseHeader(replay, filename);
ReplayInitData.Parse(replay, bytes);
ReplayTrackerEvents.Parse(replay, bytes);

Can you help me please, what am I doing wrong?
P.S.
And maybe I found in "Example Code" minor misprint:
MpqHeader.ParseHeader(replay, bytes); , second parameter should be "filename"?

Hello!
The .StormReplay file is actually a file archive, in Blizzard's 'MPQ' format.  You will need to extract the files in the .StormReplay archive first, and then pass the bytes of these inner files to the appropriate functions.
You can use this editor outside of code to see the files contained in a .StormReplay file, extract them, and then pass the appropriate file bytes to each function: http://www.zezula.net/en/mpq/download.html
There are a couple libraries you can use to extract these files in code.  The most common one used is probably MpqLib.dll, which you can see uses and download in this Starcraft 2 replay project: https://github.com/ascendedguard/sc2replay-csharp/blob/master/Starcraft2.ReplayParser/Replay.cs
Here's more pseudo code using MpqLib.dll:
var archive = new CArchive(tmpPath); // The .StormReplay file
var files = archive.FindFiles("replay.*"); // Find files within the .StormReplay archive
const string CurFile = "replay.initData"; // The inner file 'replay.initData', which Heroes.ReplayParser can extract information from
var fileSize = (from f in files where f.FileName.Equals(CurFile) select f).Single().Size; // Size of inner 'replay.initData' file
var buffer = new byte[fileSize];
archive.ExportFile(CurFile, buffer); // Extract inner 'replay.initData' file to buffer
ReplayInitData.Parse(replay, buffer); // Heroes.ReplayParser will parse this file

Thanks!
Sorry, I skipped phrase in documentation: "Requirements: An external tool to extract files from the .StormReplay container, such as MpqLib.dll". It solved my error.

There are a couple libraries you can use to extract these files in code. The most common one used is probably MpqLib.dll, which you can see uses and download in this Starcraft 2 replay project: https://github.com/ascendedguard/sc2replay-csharp/blob/master/Starcraft2.ReplayParser/Replay.cs

Hm, interesting, for "MpqLib.dll" required full access for directory where are placed replays.
Without this we get an error:

An unhandled exception of type 'System.IO.IOException' occurred in MpqLib.dll
Additional information: Unable to open "TestReplay.StormReplay"!

For solve it, we can run application under administrator role or use TEMP-directory in Windows.
Below are sample code, maybe will be helpfull for others, spied from "Starcraft2.ReplayParser":
var tmpPath = Path.GetTempFileName();
File.Copy(replayFileName, tmpPath, true);
var archive = new CArchive(replayFileName);


[Bug]: The app is reloading on changing pages.

What happened?
When we try to navigate through the navbar, the app is reloading.
I would like to fix this bug.
Add screenshots
Add screenshots
What browsers are you seeing the problem on?
No response
Code of Conduct

[X] I agree to follow this project's Code of Conduct

There are two navbars: one for the About page and the other for the rest of the pages. I think that's why you are experiencing the page load issue. If what I mentioned is not the problem causing it,  let me know so that I can assign this issue to you.

There are two navbars: one for the About page and the other for the rest of the pages. I think that's why you are experiencing the page load issue. If what I mentioned is not the problem causing it, let me know so that I can assign this issue to you.

Not it is not because of what you mentioned. The pages are reloading because we're using anchor tags to navigate in the navbar. One of the main purposes of React is to avoid refreshing the site. We can use the NavLink component to achieve this.

Do you want to work on this @kailashchoudhary11

Yeah, I will fix #339 first and then this. You can assign it to me.

I have assigned this issue to you


Request path contains unescaped characters.

I always get Request path contains unescaped characters.
while sending a request? I just use the default example

I had a similar problem:
TypeError: Request path contains unescaped characters.
    at new ClientRequest (_http_client.js:51:11)
    at TunnelingAgent.exports.request (http.js:31:10)
    at TunnelingAgent.createSocket (C:\Dev\node\node_modules\global-tunnel\node_modules\tunnel\lib\tunnel.js:117:24)
    at TunnelingAgent.createSecureSocket [as createSocket] (C:\Dev\node\node_modules\global-tunnel\node_modules\tunnel\lib\tunnel
.js:189:40)
    at TunnelingAgent.addRequest (C:\Dev\node\node_modules\global-tunnel\node_modules\tunnel\lib\tunnel.js:80:7)
    at new ClientRequest (_http_client.js:133:16)
    at Object.exports.request (http.js:31:10)
    at Object.globalTunnel._defaultedAgentRequest (C:\Dev\node\node_modules\global-tunnel\index.js:213:37)
    at Object.exports.request (https.js:163:15)
    at Object.globalTunnel._defaultedAgentRequest (C:\Dev\node\node_modules\global-tunnel\index.js:213:37)

I tried to figure out the problem and think I found it in tunnel.js around line 106:
	var connectOptions = mergeOptions({}, self.proxyOptions, {
		method: 'CONNECT',
		path: options.host + ':' + options.port,
		agent: false
	});

I changed it to:
	var connectOptions = mergeOptions({}, self.proxyOptions, {
		method: 'CONNECT',
		path: options.host.host + ':' + options.host.port,
		agent: false
	});

This fixes the issue for me. Is it a feasible fix? Shall I submit a Pull request for this?

oh nice! Would be great thanks :)

@koichik What do you think?

@waynejuckts Thanks for the report.
@simonbernard Can you explain the problem in detail?
I can't understand where options.host.{host,port} come from.

Hi @koichik
Well, I try.
I am using global-tunnel. This replaces addRequest and createSocket methods from request library. Code looks like this:
/**
 * Override createConnection and addRequest methods on the supplied agent.
 * http.Agent and https.Agent will set up createConnection in the constructor.
 */
function mixinProxying(agent, proxyOpts) {
	agent.proxy = proxyOpts;

	var orig = _.pick(agent, 'createConnection', 'addRequest');

	// Make the tcp or tls connection go to the proxy, ignoring the
	// destination host:port arguments.
	agent.createConnection = function (port, host, options) {
		return orig.createConnection.call(this,
			this.proxy.port, this.proxy.host, options);
	};

	// tell the proxy where we really want to go by fully-qualifying the path
	// part. Force a localAddress if one was configured
	agent.addRequest = function (req, host, port, localAddress) {
		req.path = this.proxy.innerProtocol + '//' + host + ':' + port + req.path;

		if (this.proxy.localAddress) {
			localAddress = this.proxy.localAddress;
		}
		return orig.addRequest.call(this, req, host, port, localAddress);
	};
}

So, if I get it right, this calls addRequest from tunnel library with some objects req, host and port.
host object looks like this:
{ _defaultAgent:
   Agent {
     domain: null,
     _events: { free: [Function] },
     _eventsCount: 1,
     _maxListeners: undefined,
     defaultPort: 443,
     protocol: 'https:',
     options: { path: null },
     requests: {},
     sockets: {},
     freeSockets: {},
     keepAliveMsecs: 1000,
     keepAlive: false,
     maxSockets: Infinity,
     maxFreeSockets: 256,
     maxCachedSessions: 100,
     _sessionCache: { map: {}, list: [] } },
  host: 'my.host.com',
  port: '443',
  method: 'POST',
  path: '/the/path/i/want/to/request',
  headers:
   { Authorization: 'Basic zE1NjVkMzFiZmIxZGU5YWEzZjQ5YTZmZjI2ZA==',
     'X-ApiVersion': '4',
     Accept: 'application/xml',
     'Content-Type': 'application/json',
     'Content-Length': '30' },
  agent:
   TunnelingAgent {
     options: { proxy: [Object], maxSockets: undefined },
     proxyOptions:
      { host: 'my.proxy.com',
        port: 3129,
        protocol: 'http:',
        innerProtocol: 'https:' },
     maxSockets: Infinity,
     requests: [],
     sockets: [],
     _events: { free: [Function: onFree] },
     _eventsCount: 1,
     request: [Function],
     createSocket: [Function: createSecureSocket] } }

Port is undefined.
So, in createSocket, connectOptions set's up the path as follows:
var connectOptions = mergeOptions({}, self.proxyOptions, {
	method: 'CONNECT',
	path: options.host + ':' + options.port,
	agent: false
});

But port is undefined here and the actual proxy port is part of the host object.
What do you think?

@simonbernard Thanks.
<EMAIL_ADDRESS>depends on<EMAIL_ADDRESS>but it doesn't support node v0.12 or later.
If you use node v0.12 or later, please try<EMAIL_ADDRESS>

OK, got it.
So in my case it seems a problem of global-tunnel. I will check their issues and ask to update the dependency.

I guess this is an issue of global-tunnel and should be closed? I stumble on this issue and first thought that node-tunnel was broken. WDYT?

@vvo : Thanks, closing.


Make WeightOnlyInt8QuantLinear more compatible with torch.compile

may be good to align the forward method with the tensor subclass as well.


Document MySQL lack of rate limiting support

The lack of support for time-based rate limiting for a MySQL-backed Conductor seems completely undocumented. If it's documented, it's fairly hidden (I was not able to find it by specifically Googling "conductor rate limit"). It should be clearly documented in context.

Pull Request Test Coverage Report for Build 3838

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.1%) to 69.928%

Totals

Change from base Build 3826:
0.1%

Covered Lines:
11485

Relevant Lines:
16424

💛  - Coveralls


[2.2.1exp] [Forge 36.2.8] Failures to initialize certain features

Tried the new version in a clean 1.16.5 instance with only Forge and Forgery. The following features failed to initialize despite that:
Mobs Drop Less Metal
Dropped Items Don't Stack
Full Enchanting Cost
https://gist.github.com/IdrisQe/f2c426d3960558579bc475b601c23610

Known, actually. I was putting off fixing these as it was 4 AM.


chore(deps): update common-dev-assets digest to 96f7642

This PR contains the following updates:

Package
Update
Change

common-dev-assets
digest
dfefa07 -> 96f7642

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

/run pipeline

/run pipeline

Pipeline blocking issues are fixed in latest version of common-dev-assets. Renovate is pushing that out now and will auto update this PR

/run pipeline

:tada: This PR is included in version 1.0.3 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Enhancing architecture docs

Many of the folders in the /src directory are not mentioned in the architecture.md file such as lightbox. It would help beginners understand the structure more easily if this was done.

I see that this hasn’t attracted much activity, which is fine — @gnprice mentioned today that the maintenance burden of documenting everything in the /src directory is quite large, considering each file should have its own code comments anyway, and I agree. So, I’m closing this. 🙂


Consolidate rather than duplicate common configuration policies

See https://github.com/Agoric/SES-shim/pull/447#discussion_r481530131 where @kriskowal suggests for a change to .prettierrc.json

This is a change we can and should apply to the entire repository, perhaps piecemeal and then holistically.

Between our main monorepos (SES-shim and agoric-sdk) there are many such duplicated policy files, or almost duplicated policy files with unintended drift apart. This is a maintenance headache.

@kriskowal I take it that this is what your scripts/repackage.sh is designed to do. So can I assign this to you?

I believe we’ve taken this as far as necessary for the purposes of lint, prettier, and jsconfig.json. We can continue to evolve scripts/repackage.sh as is helpful going forward.


Question about multi-machine training

Hi My name is Nathan and I am using Wenet for asr training.
I am very appreciate your work. Thank you.
These days, I try to work by multi-machine training based on "wenet-main/examples/aishell/rnnt/run.sh"
I checked single node training and it works fine.
Error occurred during num_nodes=2
My environment.

There are two ip {xx.xxx.xx.110, xx.xxx.xx.111}

I call them as host 'asrA', 'asrB'

some open port(ex : 2376)
-using firewall-cmd    #Centos 7
Both nodes have [a100 gpu x 8]

torch 1.10.0
nccl-2.7.8
cuda 11.1

run-1.sh
num_nodes=2
node_rank=0
init_method=tcp://xx.xxx.xx.110:2376
dist_backend="nccl"

run-2.sh
num_nodes=2
node_rank=1
init_method=tcp://xx.xxx.xx.110:2376
dist_backend="nccl"

start&stop stage = 4
Run as below respectively(hosts)
[woker@asrA]$ nohup bash ./run-1.sh > Multi_1.txt &
[woker@asrB]$ nohup bash ./run-2.sh > Multi_2.txt &
$cat Multi_1.txt
total gpus is: 16
2022-10-12 01:39:20,998 INFO training on multiple gpus, this gpu 5
2022-10-12 01:39:21,014 INFO training on multiple gpus, this gpu 3
2022-10-12 01:39:21,020 INFO training on multiple gpus, this gpu 0
2022-10-12 01:39:21,041 INFO training on multiple gpus, this gpu 7
2022-10-12 01:39:21,046 INFO training on multiple gpus, this gpu 2
2022-10-12 01:39:21,086 INFO training on multiple gpus, this gpu 6
2022-10-12 01:39:21,119 INFO training on multiple gpus, this gpu 1
2022-10-12 01:39:21,123 INFO training on multiple gpus, this gpu 4
2022-10-12 01:39:34,988 INFO Added key: store_based_barrier_key:1 to store for rank: 5
2022-10-12 01:39:35,038 INFO Added key: store_based_barrier_key:1 to store for rank: 7
2022-10-12 01:39:35,087 INFO Added key: store_based_barrier_key:1 to store for rank: 6
2022-10-12 01:39:35,143 INFO Added key: store_based_barrier_key:1 to store for rank: 2
2022-10-12 01:39:35,213 INFO Added key: store_based_barrier_key:1 to store for rank: 1
2022-10-12 01:39:35,267 INFO Added key: store_based_barrier_key:1 to store for rank: 3
2022-10-12 01:39:35,324 INFO Added key: store_based_barrier_key:1 to store for rank: 4
2022-10-12 01:39:35,398 INFO Added key: store_based_barrier_key:1 to store for rank: 0
2022-10-12 01:39:39,224 INFO Rank 7: Completed store-based barrier for key:store_based_barrier_key:1 with 16 nodes.
2022-10-12 01:39:39,224 INFO Rank 0: Completed store-based barrier for key:store_based_barrier_key:1 with 16 nodes.
2022-10-12 01:39:39,224 INFO Rank 6: Completed store-based barrier for key:store_based_barrier_key:1 with 16 nodes.
2022-10-12 01:39:39,224 INFO Rank 2: Completed store-based barrier for key:store_based_barrier_key:1 with 16 nodes.
2022-10-12 01:39:39,224 INFO Rank 4: Completed store-based barrier for key:store_based_barrier_key:1 with 16 nodes.
2022-10-12 01:39:39,224 INFO Rank 5: Completed store-based barrier for key:store_based_barrier_key:1 with 16 nodes.
2022-10-12 01:39:39,224 INFO Rank 1: Completed store-based barrier for key:store_based_barrier_key:1 with 16 nodes.
2022-10-12 01:39:39,224 INFO Rank 3: Completed store-based barrier for key:store_based_barrier_key:1 with 16 nodes.
2022-10-12 01:39:40,378 INFO Checkpoint: loading from checkpoint exp/conformer_rnnt/30.pt for GPU
2022-10-12 01:39:40,386 INFO Checkpoint: loading from checkpoint exp/conformer_rnnt/30.pt for GPU
2022-10-12 01:39:40,386 INFO Checkpoint: loading from checkpoint exp/conformer_rnnt/30.pt for GPU
2022-10-12 01:39:40,392 INFO Checkpoint: loading from checkpoint exp/conformer_rnnt/30.pt for GPU
2022-10-12 01:39:40,419 INFO Checkpoint: loading from checkpoint exp/conformer_rnnt/30.pt for GPU
2022-10-12 01:39:40,421 INFO Checkpoint: loading from checkpoint exp/conformer_rnnt/30.pt for GPU
2022-10-12 01:39:40,457 INFO Checkpoint: loading from checkpoint exp/conformer_rnnt/30.pt for GPU
2022-10-12 01:39:42,899 INFO Checkpoint: loading from checkpoint exp/conformer_rnnt/30.pt for GPU
$cat Multi_2.txt
total gpus is: 16
2022-10-12 01:37:15,429 INFO training on multiple gpus, this gpu 0
2022-10-12 01:37:15,429 INFO training on multiple gpus, this gpu 1
2022-10-12 01:37:15,429 INFO training on multiple gpus, this gpu 3
2022-10-12 01:37:15,438 INFO training on multiple gpus, this gpu 4
2022-10-12 01:37:15,449 INFO training on multiple gpus, this gpu 2
2022-10-12 01:37:15,494 INFO training on multiple gpus, this gpu 7
2022-10-12 01:37:15,500 INFO training on multiple gpus, this gpu 5
2022-10-12 01:37:15,566 INFO training on multiple gpus, this gpu 6
2022-10-12 01:37:29,441 INFO Added key: store_based_barrier_key:1 to store for rank: 9
2022-10-12 01:37:29,491 INFO Added key: store_based_barrier_key:1 to store for rank: 14
2022-10-12 01:37:29,559 INFO Added key: store_based_barrier_key:1 to store for rank: 8
2022-10-12 01:37:29,611 INFO Added key: store_based_barrier_key:1 to store for rank: 10
2022-10-12 01:37:29,666 INFO Added key: store_based_barrier_key:1 to store for rank: 11
2022-10-12 01:37:29,719 INFO Added key: store_based_barrier_key:1 to store for rank: 15
2022-10-12 01:37:29,774 INFO Added key: store_based_barrier_key:1 to store for rank: 13
2022-10-12 01:37:29,830 INFO Added key: store_based_barrier_key:1 to store for rank: 12
2022-10-12 01:37:29,831 INFO Rank 12: Completed store-based barrier for key:store_based_barrier_key:1 with 16 nodes.
2022-10-12 01:37:29,831 INFO Rank 8: Completed store-based barrier for key:store_based_barrier_key:1 with 16 nodes.
2022-10-12 01:37:29,831 INFO Rank 10: Completed store-based barrier for key:store_based_barrier_key:1 with 16 nodes.
2022-10-12 01:37:29,834 INFO Rank 11: Completed store-based barrier for key:store_based_barrier_key:1 with 16 nodes.
2022-10-12 01:37:29,835 INFO Rank 15: Completed store-based barrier for key:store_based_barrier_key:1 with 16 nodes.
2022-10-12 01:37:29,837 INFO Rank 13: Completed store-based barrier for key:store_based_barrier_key:1 with 16 nodes.
2022-10-12 01:37:29,837 INFO Rank 9: Completed store-based barrier for key:store_based_barrier_key:1 with 16 nodes.
2022-10-12 01:37:29,837 INFO Rank 14: Completed store-based barrier for key:store_based_barrier_key:1 with 16 nodes.
2022-10-12 01:37:30,758 INFO Checkpoint: loading from checkpoint exp/conformer_rnnt/30.pt for GPU
2022-10-12 01:37:31,029 INFO Checkpoint: loading from checkpoint exp/conformer_rnnt/30.pt for GPU
2022-10-12 01:37:31,030 INFO Checkpoint: loading from checkpoint exp/conformer_rnnt/30.pt for GPU
2022-10-12 01:37:31,034 INFO Checkpoint: loading from checkpoint exp/conformer_rnnt/30.pt for GPU
2022-10-12 01:37:31,039 INFO Checkpoint: loading from checkpoint exp/conformer_rnnt/30.pt for GPU
2022-10-12 01:37:31,039 INFO Checkpoint: loading from checkpoint exp/conformer_rnnt/30.pt for GPU
2022-10-12 01:37:31,040 INFO Checkpoint: loading from checkpoint exp/conformer_rnnt/30.pt for GPU
2022-10-12 01:37:31,049 INFO Checkpoint: loading from checkpoint exp/conformer_rnnt/30.pt for GPU
Transducer(
(encoder): ConformerEncoder(
{.....model description......}
the number of model params: 52984612
Traceback (most recent call last):
File "wenet/bin/train.py", line 297, in
main()
File "wenet/bin/train.py", line 232, in main
model, find_unused_parameters=True)
File "/usr/local/lib64/python3.6/site-packages/torch/nn/parallel/distributed.py", line 578, in init
dist._verify_model_across_ranks(self.process_group, parameters)
RuntimeError: NCCL error in: ../torch/csrc/distributed/c10d/ProcessGroupNCCL.cpp:957, unhandled system error, NCCL version 21.0.3
ncclSystemError: System call (socket, malloc, munmap, etc) failed.
I don't understand 'NCCL version 21.0.3' which belongs to second host's log
Please check this issue. Thank you.

I added 'os.environ['NCCL_DEBUG'] = 'INFO' to train.py
and checked nccl log.
Finally, solved problem.
It's because of port range.
Thank you.


calicoctl delete doing weird stuff

macncheese:client casey$ calicoctl get nodes
NAME

macncheese:client casey$ calicoctl delete node
Successfully deleted 1 'node' resource(s)

I'd expect the second command to be an error, but it returns successfully!

Note: This was performed with DATASTORE_TYPE=kubernetes.
Note sure how it behaves with etcdv2

I think if the command is misbehaving this should be a P1 no?

This is what I see with my setup (etcd backend):
vagrant@calico-01:~$ calicoctl delete node
Failed to delete 'node' resource: insufficient identifiers, missing 'node'

@gunjan5 I think this is a bug in the k8s backend code, since it doesn't handle the node resource.
It should be returning an error for any delete commands, I think.

@caseydavenport

It should be returning an error for any delete commands, I think.
then how would anyone delete an ipPool for example?

Seems like any delete command is being ignored for k8s backend right now:
// Delete an entry in the datastore. This is a no-op when using the k8s backend.
func (c *KubeClient) Delete(d *model.KVPair) error {
	log.Warn("Attempt to 'Delete' using kubernetes backend is not supported.")
	return nil
}

@gunjan5 d'oh, yeah I forgot about that.
That's the right behavior for it right now.  I think we want to pull out the ipPool support in the backend anyway for now - it's not done correctly.

Fixed.


Brace based formatting

It would be great to have a button that would format white space based on braces and parens.

have you tried https://github.com/Hirse/brackets-beautify

Aaah!  It's just what I was looking for!  Thanks!

Closing as extension available.


refactor tests for stripProjectPackages

This refactors the tests for Config.ProjectPackages to use an array of test cases.
I've added tests for ProjectPackages with multiple wildcards.
It does not change existing behaviour.

Hi @levinalex, Thank you for the contribution! I just merged #25, which fixes #23 and appears to incorporate your test improvements. Cheers!