CMake warning and Erros while launching

Is it expected to get this warning during CMake? or am i missing anything?
CMake Warning at ndt_omp/CMakeLists.txt:53 (add_executable):
  Cannot generate a safe linker search path for target align because files in
  some directories may conflict with libraries in implicit directories:

    link library [libpcl_kdtree.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_search.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_features.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_sample_consensus.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_filters.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_ml.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_segmentation.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_surface.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_common.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_octree.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_io.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib

  Some of these libraries may not be found correctly.

CMake Warning at hdl_graph_slam/CMakeLists.txt:90 (add_library):
  Cannot generate a safe linker search path for target
  scan_matching_odometry_nodelet because files in some directories may
  conflict with libraries in implicit directories:

    link library [libpcl_kdtree.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_search.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_features.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_sample_consensus.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_filters.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_ml.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_segmentation.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_surface.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_common.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_octree.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_io.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib

  Some of these libraries may not be found correctly.

CMake Warning at hdl_graph_slam/CMakeLists.txt:75 (add_library):
  Cannot generate a safe linker search path for target prefiltering_nodelet
  because files in some directories may conflict with libraries in implicit
  directories:

    link library [libpcl_kdtree.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_search.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_features.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_sample_consensus.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_filters.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_ml.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_segmentation.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_surface.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_common.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_octree.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_io.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib

  Some of these libraries may not be found correctly.

CMake Warning at hdl_graph_slam/CMakeLists.txt:82 (add_library):
  Cannot generate a safe linker search path for target
  floor_detection_nodelet because files in some directories may conflict with
  libraries in implicit directories:

    link library [libpcl_kdtree.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_search.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_features.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_sample_consensus.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_filters.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_ml.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_segmentation.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_surface.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_common.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_octree.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_io.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib

  Some of these libraries may not be found correctly.

CMake Warning at hdl_graph_slam/CMakeLists.txt:100 (add_library):
  Cannot generate a safe linker search path for target hdl_graph_slam_nodelet
  because files in some directories may conflict with libraries in implicit
  directories:

    link library [libpcl_kdtree.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_search.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_features.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_sample_consensus.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_filters.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_ml.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_segmentation.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_surface.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_common.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_octree.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib
    link library [libpcl_io.so] in /usr/lib/x86_64-linux-gnu may be hidden by files in:
      /usr/local/lib

  Some of these libraries may not be found correctly.

Just like I expected, when I tried to launch, I got following error.

[ERROR] [1555302950.666921474]: Failed to load nodelet [/floor_detection_nodelet] of type [hdl_graph_slam/FloorDetectionNodelet] even after refreshing the cache: Failed to load library /home/aravinddoss/hhdl/devel/lib//libfloor_detection_nodelet.so. Make sure that you are calling the PLUGINLIB_EXPORT_CLASS macro in the library code, and that names are consistent between this macro and your XML. Error string: Could not load library (Poco exception = /home/aravinddoss/hhdl/devel/lib//libfloor_detection_nodelet.so: undefined symbol: _ZN3pcl25SampleConsensusModelPlaneINS_9PointXYZIEE24computeModelCoefficientsERKSt6vectorIiSaIiEERN5Eigen6MatrixIfLin1ELi1ELi0ELin1ELi1EEE)
[ERROR] [1555302950.666975082]: The error before refreshing the cache was: Failed to load library /home/aravinddoss/hhdl/devel/lib//libfloor_detection_nodelet.so. Make sure that you are calling the PLUGINLIB_EXPORT_CLASS macro in the library code, and that names are consistent between this macro and your XML. Error string: Could not load library (Poco exception = /home/aravinddoss/hhdl/devel/lib//libfloor_detection_nodelet.so: undefined symbol: _ZN3pcl25SampleConsensusModelPlaneINS_9PointXYZIEE24computeModelCoefficientsERKSt6vectorIiSaIiEERN5Eigen6MatrixIfLin1ELi1ELi0ELin1ELi1EEE)
[FATAL] [1555302950.667196565]: Failed to load nodelet '/floor_detection_nodelet` of type `hdl_graph_slam/FloorDetectionNodelet` to manager `velodyne_nodelet_manager'
[floor_detection_nodelet-5] process has died [pid 15140, exit code 255, cmd /opt/ros/melodic/lib/nodelet/nodelet load hdl_graph_slam/FloorDetectionNodelet velodyne_nodelet_manager __name:=floor_detection_nodelet __log:=/home/aravinddoss/.ros/log/ed2338da-5f37-11e9-b41d-34e6ad887d40/floor_detection_nodelet-5.log].
log file: /home/aravinddoss/.ros/log/ed2338da-5f37-11e9-b41d-34e6ad887d40/floor_detection_nodelet-5*.log

Am i missing anything?
I am using ROS Melodic, Ubuntu 18.04, Intel i7.
Thanks!

This warning sometimes happens when you have two difference versions of PCL. I recommend to use the official apt binary of PCL, and remove the other (maybe manually installed) one.


Dependency on Cowboy 1.0.0

Hi,
I was playing around with Coherence and it has a dependency on Swoosh. However, the dependencies are not resolved because swoosh has a strict dependence on Cowboy 1.0.0.
Running dependency resolution...

Failed to use "cowboy" (version 1.1.2) because
  phoenix (version 1.2.1) requires ~> 1.0
  plug (version 1.3.0) requires ~> 1.0.1 or ~> 1.1
  swoosh (versions 0.1.0 to 0.5.0) requires ~> 1.0.0
  mix.exs specifies ~> 1.1.2

** (Mix) Hex dependency resolution failed, relax the version requirements of your dependencies or unlock them (by using mix deps.update or mix deps.unlock). If you are unable to resolve the conflicts you can try overriding with {:dependency, "~> 1.0", override: true}

Perhaps it should be ~> 1.0 ?

I have a similar problem an also wonder why the version requirement for cowboy is so very specific.

It doesn't need to be that specific, fixing now.

0.6 on its way


refactor(settings): remove RwLock

It seems I do need a lock, not a RwLock, but a write lock, to make sure I don't do two updates (or two inserts) simultaneously.


Add a note about advanced multi column features.

Multicolumn is still a pretty janky feature if you're doing anything beyond the bare minimum. Perhaps this should reflect that?

sgtm


window.open - mount the Popup to the relevant document.body

When you open a new window with window.open and try to open a Popup there, the Popup gets shown at the correct position but in the wrong window. The culprit is this line in the PortalInner.js where document.body of the initial window gets assigned to the mountNode property which is then passed to ReactDOM.createPortal.
I have made the change in Popup.js so that the correct mountNode gets extracted from the Popup's referenceElement (either context or trigger) through the DOM's .ownerDocument property.
The fix also needs to be made for Modal (use trigger's .ownerDocument if mountNode is not provided), Dimmer and TransitionablePortal components that all use Portal component.
For an example of using window.open with  React see Using a React 16 Portal to do something cool and Popout Windows in React.

Codecov Report

Merging #4219 (210667e) into master (bb2db59) will increase coverage by 0.00%.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##           master    #4219   +/-   ##
=======================================
  Coverage   99.75%   99.75%
=======================================
  Files         180      180
  Lines        3241     3242    +1
=======================================
+ Hits         3233     3234    +1
  Misses          8        8

Impacted Files
Coverage Δ

src/modules/Popup/Popup.js
98.91% <100.00%> (+0.01%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ff70355...210667e. Read the comment docs.


Adding SQLite Engine. Using PDO

All tested, but please test too :+1:
Also added sample config, and adding constant for using with the factory.

@tomvlk I propose to move the common methods from:
\Smvc\Database\Engine\MySQLEngine and
\Smvc\Database\Engine\SQLiteEngine
In a Trait called, for example:
\Smvc\Database\Engine\CommonLayerTrait
then, to use it in both engines.
This way, you can avoid the code duplication and simplify the maintenance... :smirk:

@LuckyCyborg
The trait idea, great, but for some operations sqlite is a bit different than mysql. And to be fair I have to experiment with it first. I could do some refactor and make the engines better and generic as possible. So less code is required.
Maybe have few interfaces or something, at least It can be better indeed. But requires more classes/traits/interfaces etc, harder to understand. I think the new engines should be very well documented on release.
Btw, the storage of the database is just a full path. You can see in the config that you are required to put the full path. But default it's using the app path.
(Please wait with merging, I will improve it futher).

@tomvlk I added for you, the usual file storage path, for non-temporary one, in my current pull-request.
It is: /storage, as usual
Let's do not suggest to end-users to do naughty things... :smirk:

@LuckyCyborg Did you add another folder? Use that for strorage?

@tomvlk In the /storage are preserved files who are not temporary. For example,your SQLite database file.

Ahh ok, but its still in the unaccepted pull, I see. Better that indeed. Force to storage is best option.

@LuckyCyborg I think I will make an interface that every engine will implement, and will have the basic things like read($sql) or something. Will look into it later.

@tomvlk OKay. :smirk:


DEP Upgrade frontend build stack

See https://github.com/silverstripe/silverstripe-admin/pull/1389 for a wider discussion on most of the changes
Parent issue

https://github.com/silverstripeltd/product-issues/issues/644

Behat failures in this PR are expected - it relies on various other PRs. Refer to the overall kitchen sink CI in the issue card

Was tested manually


install from Tarball

I have run the install process on a raspberry pi to have a play before looking at work, but have hit some issues.

Configuring Sources - needs to have where to install unit to with --prefix
missing any sort of example config to work from
missing any init script for ether initd for systemd

Without #1 I cant get the make install to complete
Without #3 I dont know how to start unit and what options to fill in
Could the documents be updated to help?

Thank you. The documentation needs to be improved.
All configuration examples are in the Configuration section.

By the way, both ./configure script and unitd binary have a --help option that provides some basic information about available parameters.

Hello,

http://unit.nginx.org/installation/#configuring-sources
http://unit.nginx.org/installation/#building-and-installing-unit
http://unit.nginx.org/configuration/#full-example (a bit outdated, updates are coming)
On its way.

Thanks @artemkonev
I have used point 1 and 3 to get 3 of my web apps running with unit, the web app I want to make work is still proving difficult. But if you have any ideas on how to make Nextcloud work that would help.

Follow this thread for updates:
https://github.com/nginx/unit-docs/issues/8#issuecomment-505048472

Hi,
The [NextCloud] doc is almost ready and will be published soon, stay tuned.

http://unit.nginx.org/howto/nextcloud/


participant address is not P2PKH

Description
when I use bitcoin-cli -testnet getnewaddress to get an address  2N5ioPyiLdGDhHDXDwLj3XzeLvfmE156dgc,
and use this bitcoin address to do the autoswap,
ubuntu@ip-172-31-15-69:~$ btcatomicswap --testnet --rpcuser=eigen --rpcpass=eigencapital initiate 2N5ioPyiLdGDhHDXDwLj3XzeLvfmE156dgc 1.0
participant address is not P2PKH

what should I do ?

I know something ,ubuntu@ip-172-31-15-69:~$ bitcoin-cli -testnet getnewaddress "" "legacy" is ok. The first character of the address must be m or n like n1Sp6GY2CWVy51EHtBoeSNPYHB7zfXoHAd


fix: correctly manage plpgsql in database import

Limit the extensions to be removed in the logical import bootstrap phase to the user-defined ones. This way, the default provided plpgsql extension is not dropped before the restore phase is started.
Closes #869
Closes #970
Signed-off-by: Gabriele Bartolini<EMAIL_ADDRESS>

/ready-to-test


Rename wasi_llm -> wasmedge_llmc

Depends on https://github.com/WasmEdge/WasmEdge/pull/3731

Hi @junaire
I just merged a PR to disable the WasmEdge AOT feature and remove the lld related dependencies to reduce the CI cost. Please fix the conflict in build.yml. Thanks.

Hi @junaire I just merged a PR to disable the WasmEdge AOT feature and remove the lld related dependencies to reduce the CI cost. Please fix the conflict in build.yml. Thanks.

done


squid:S00116 - Field names should comply with a naming convention

This pull request is focused on resolving occurrences of Sonar rule squid:S00116 - Field names should comply with a naming convention
You can find more information about the issue here: https://dev.eclipse.org/sonar/coding_rules#q=squid:S00116
Please let me know if you have any questions.
M-Ezzat

Hi,
I appreciate your changes. I would like encourage you suggest more changes/features for easyfonts.


W-13772847-Update-Flex-prerequisites-CP

Writer's Quality Checklist
Before merging your PR, did you:

[ ] Run spell checker
[ ] Run link checker to check for broken xrefs
[ ] Check for orphan files
[ ] Perform a local build and do a final visual check of your content, including checking for:

Broken images
Dead links
Correct rendering of partials if they are used in your content
Formatting issues, such as:

Misnumbered ordered lists (steps) or incorrectly nested unordered lists
Messed up tables
Proper indentation
Correct header levels

[ ] Receive final review and signoff from:

Technical SME
Product Manager
Editor or peer reviewer
Reporter, if this content is in response to a reported issue (internal or external feedback)

[ ] If applicable, verify that the software actually got released

Including the changes of this PR in the following PR: https://github.com/mulesoft/docs-gateway/pull/428
Closing this PR.


view referencing

From @keighrim on July 5, 2018 14:23
originally from @elahi123 via an e-mail

After TCF to LIF converter, the token layer is referring by view ID
{
                        "id": "c_0_10",
                        "label": "VBD",
                        "features": {
                            "parent": "c_0_6",
                            "children": "[**token-view:t_1**]"
                        }

I am not trying this case in my converter. That is to convert from LIF to TCF when one view refer other.
However, The example file I have presents list as a string.
{
                        "id": "c_0_3",
                        "label": "VP",
                        "features": {
                            "parent": "c_0_1",
                            "children": "[**c_0_6, c_0_7**]"      **should be ["c_0_6, c_0_7"]**
                        }
                    }

I remember talking about this issue before Tübingen meeting and you fixed it.
Can you please give an example file with all layer (after TCF to LIF) converter where view reference exist?
Copied from original issue: lapps-clarin/converter-issues#2

It seems to me the issue is resolved.


feat: optimize the initial states of charts

only show live cell count by default;
unify selection of avg-block-time of its thumnail and large chart;
offset 1% start point of uncle rate because its initial value makes the chart obsure, similar to an outlier at the start point.

Before:

After:

Change in uncle rate chart is not obvious until https://github.com/Magickbase/ckb-explorer-frontend/pull/172 is merged

2.5% is not fully displayed on the mobile terminal, but is displayed normally on the PC terminal.

2.5% is not fully displayed on the mobile terminal, but is displayed normally on the PC terminal.

It's a layout issue so I will open another PR to fix it.


Can't Search from Chrome Web Store

https://chrome.google.com/webstore/search/vb4c?hl=en

Dup of issue #5
I has not been approved by Google yet to appear on the Chrome Web Store. You must install it manually from chrome://extensions.
From the README:

Install

vb4c is a Chrome Extension and can be installed from the Chrome Web Store.

This is a brand new release and it is currently pending review from Google. I will update the link here once it is available!
In the mean time you can manually install the extension from the releases page on GitHub.

Download the .zip file, extract it, and then manually load the
extension in chrome.

Go to chrome://extensions
Enable the developer mode toggle.
Select 'Load Unpacked Extension'
Navigate to the directory that you unzipped above.
That's it!

@LemonJuiz
This is a brand new release and it is currently pending review from Google.
I didn't see this sentence. Thank you!


Fall back to iterative topological sort with function IRs with large numbers of basic blocks

Feature request
While it's very rare, I have created situations when automatically generating JIT code where find_topo_order can lead to a maximum recursion error when attempting to sort the IR. For robustness it would be ideal if when an IR is "highly-complex" we could fall back to an iterative implementation to avoid this error.

I'm happy to submit a PR with this support as I've already needed to provide an equivalent workaround.

Converting a recursive algorithm to an iterative one should not impact the runtime, so if this is done well, it could be used as a default.


Upgrade to coola 0.0.12

Codecov Report
Patch coverage: 100.00% and no project coverage change.

Comparison is base (28c5405) 100.00% compared to head (a6c9395) 100.00%.

Additional details and impacted files
@@            Coverage Diff            @@
##              main      #263   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files          318       318
  Lines         9835      9851   +16
  Branches       951       951
=========================================
+ Hits          9835      9851   +16

Impacted Files
Coverage Δ

src/gravitorch/utils/history/base.py
100.00% <100.00%> (ø)

src/gravitorch/utils/history/comparator.py
100.00% <100.00%> (ø)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


checkout flow

back buttons
dont need Paper on first page
only need ice cream on first page
for second page, show them order details
third page, big qr code + invoice, copy button, how much they are paying
last page, confirmation animation that their order was received

Move info to modal


Upgraded some dependencies

Upgraded the mongo and json dependencies.

Appears as if this code is not available for merging.  Closing this PR


Crash in kegbot_core.py

I've seen a crash similar to this 3 times now.  I grabbed the output this time.  This is with code pulled and installed from git repo this morning.
2011-12-20 10:59:45,473 ERROR    (service-thread) Uncaught exception in thread service-thread. Stack trace:
2011-12-20 10:59:45,502 ERROR    (service-thread)     File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/core/util.py", line 113, in run
2011-12-20 10:59:45,503 ERROR    (service-thread)     self.ThreadMain()
2011-12-20 10:59:45,504 ERROR    (service-thread)
2011-12-20 10:59:45,504 ERROR    (service-thread)     File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/core/kb_threads.py", line 124, in ThreadMain
2011-12-20 10:59:45,505 ERROR    (service-thread)     self._Step(timeout=0.5)
2011-12-20 10:59:45,506 ERROR    (service-thread)
2011-12-20 10:59:45,507 ERROR    (service-thread)     File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/core/kb_threads.py", line 129, in _Step
2011-12-20 10:59:45,508 ERROR    (service-thread)     self._ProcessEvent(event)
2011-12-20 10:59:45,509 ERROR    (service-thread)
2011-12-20 10:59:45,509 ERROR    (service-thread)     File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/core/kb_threads.py", line 156, in _ProcessEvent
2011-12-20 10:59:45,510 ERROR    (service-thread)     cb(event)
2011-12-20 10:59:45,511 ERROR    (service-thread)
2011-12-20 10:59:45,512 ERROR    (service-thread)     File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/core/manager.py", line 462, in HandleFlowUpdateEvent
2011-12-20 10:59:45,513 ERROR    (service-thread)     self._HandleFlowEnded(event)
2011-12-20 10:59:45,513 ERROR    (service-thread)
2011-12-20 10:59:45,515 ERROR    (service-thread)     File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/core/manager.py", line 491, in _HandleFlowEnded
2011-12-20 10:59:45,515 ERROR    (service-thread)     spilled=spilled)
2011-12-20 10:59:45,516 ERROR    (service-thread)
2011-12-20 10:59:45,517 ERROR    (service-thread)     File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/core/backend.py", line 302, in RecordDrink
2011-12-20 10:59:45,518 ERROR    (service-thread)     duration=duration, auth_token=auth_token, spilled=spilled)
2011-12-20 10:59:45,518 ERROR    (service-thread)
2011-12-20 10:59:45,519 ERROR    (service-thread)     File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/web/api/krest.py", line 251, in RecordDrink
2011-12-20 10:59:45,520 ERROR    (service-thread)     return self.DoPOST(endpoint, models_pb2.Drink(), post_data=post_data)
2011-12-20 10:59:45,521 ERROR    (service-thread)
2011-12-20 10:59:45,521 ERROR    (service-thread)     File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/web/api/krest.py", line 173, in DoPOST
2011-12-20 10:59:45,522 ERROR    (service-thread)     return self._FetchResponse(endpoint, out_msg, params=params, post_data=post_data)
2011-12-20 10:59:45,523 ERROR    (service-thread)
2011-12-20 10:59:45,524 ERROR    (service-thread)     File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/web/api/krest.py", line 195, in _FetchResponse
2011-12-20 10:59:45,525 ERROR    (service-thread)     response_data = urlopen(url, data=encoded_post_data, timeout=FLAGS.krest_timeout).read()
2011-12-20 10:59:45,525 ERROR    (service-thread)
2011-12-20 10:59:45,526 ERROR    (service-thread)     File "/usr/lib/python2.7/urllib2.py", line 126, in urlopen
2011-12-20 10:59:45,526 ERROR    (service-thread)     return _opener.open(url, data, timeout)
2011-12-20 10:59:45,527 ERROR    (service-thread)
2011-12-20 10:59:45,527 ERROR    (service-thread)     File "/usr/lib/python2.7/urllib2.py", line 394, in open
2011-12-20 10:59:45,527 ERROR    (service-thread)     response = self._open(req, data)
2011-12-20 10:59:45,528 ERROR    (service-thread)
2011-12-20 10:59:45,528 ERROR    (service-thread)     File "/usr/lib/python2.7/urllib2.py", line 412, in _open
2011-12-20 10:59:45,529 ERROR    (service-thread)     '_open', req)
2011-12-20 10:59:45,529 ERROR    (service-thread)
2011-12-20 10:59:45,529 ERROR    (service-thread)     File "/usr/lib/python2.7/urllib2.py", line 372, in _call_chain
2011-12-20 10:59:45,530 ERROR    (service-thread)     result = func(*args)
2011-12-20 10:59:45,530 ERROR    (service-thread)
2011-12-20 10:59:45,530 ERROR    (service-thread)     File "/usr/lib/python2.7/urllib2.py", line 1201, in http_open
2011-12-20 10:59:45,531 ERROR    (service-thread)     return self.do_open(httplib.HTTPConnection, req)
2011-12-20 10:59:45,531 ERROR    (service-thread)
2011-12-20 10:59:45,531 ERROR    (service-thread)     File "/usr/lib/python2.7/urllib2.py", line 1174, in do_open
2011-12-20 10:59:45,531 ERROR    (service-thread)     r = h.getresponse(buffering=True)
2011-12-20 10:59:45,532 ERROR    (service-thread)
2011-12-20 10:59:45,532 ERROR    (service-thread)     File "/usr/lib/python2.7/httplib.py", line 1027, in getresponse
2011-12-20 10:59:45,533 ERROR    (service-thread)     response.begin()
2011-12-20 10:59:45,533 ERROR    (service-thread)
2011-12-20 10:59:45,534 ERROR    (service-thread)     File "/usr/lib/python2.7/httplib.py", line 407, in begin
2011-12-20 10:59:45,534 ERROR    (service-thread)     version, status, reason = self._read_status()
2011-12-20 10:59:45,535 ERROR    (service-thread)
2011-12-20 10:59:45,535 ERROR    (service-thread)     File "/usr/lib/python2.7/httplib.py", line 365, in _read_status
2011-12-20 10:59:45,535 ERROR    (service-thread)     line = self.fp.readline()
2011-12-20 10:59:45,536 ERROR    (service-thread)
2011-12-20 10:59:45,536 ERROR    (service-thread)     File "/usr/lib/python2.7/socket.py", line 447, in readline
2011-12-20 10:59:45,537 ERROR    (service-thread)     data = self._sock.recv(self._rbufsize)
2011-12-20 10:59:45,537 ERROR    (service-thread)
2011-12-20 10:59:45,537 ERROR    (service-thread) Error was: <class 'socket.timeout'>: timed out
2011-12-20 10:59:45,538 ERROR    (service-thread) Exiting thread.
2011-12-20 10:59:46,533 ERROR    (watchdog-thread) Thread service-thread died unexpectedly
2011-12-20 10:59:46,563 INFO     (alarmmanager-thread) got quit event, quitting
2011-12-20 10:59:46,564 INFO     (net-thread) got quit event, quitting
2011-12-20 10:59:46,564 INFO     (eventhub-thread) got quit event, quitting
2011-12-20 10:59:46,565 INFO     (watchdog-thread) got quit event, quitting
2011-12-20 10:59:46,565 INFO     (heartbeat-thread) got quit event, quitting
2011-12-20 10:59:46,633 INFO     (kegnet) Stopping server
2011-12-20 10:59:47,535 ERROR    (main) Watchdog thread exited, quitting
2011-12-20 10:59:48,537 INFO     (main) Stopping any remaining threads
2011-12-20 10:59:48,538 INFO     (main) Stopping all service threads.
2011-12-20 10:59:48,538 INFO     (main) All service threads stopped.
2011-12-20 10:59:48,538 INFO     (main) Kegbot stopped.
If I was more familiar with python I would take a crack at figuring it out, may look through the code later if I have time.
Thanks
-ray

Hi ray,
Some recent changes may be at issue here.
First, please do a git pull and update to the latest version.
Then, you please do the following in a shell:
$ kegbot-admin.py migrate

Then, try again.  Do you still get the error? If so, navigate to http://you-kegbot-site/sentry/ and see if there are any log entries being generated there.  Thanks!

Thanks.  I'll do that as soon as I get into the office.  It usually took a few hours before I noticed a crash, so if it runs without crashing till the end of the day I'll consider it fixed and close this issue.
Thanks.

FYI I just submitted an unrelated fix that you'll also need -- pull again if you have already done so!

Haven't fully tested this yet as kegbot hasn't been fully operational since the site update stuff.  Once its back online I should have a good indication if this is fixed yet.

Can you run the core with something like --krest_timeout=10?  The default settings are a bit aggressive and it is possible that the crash is because of this.
Pykeg should also handle this situation gracefully, which I'll fix.  (pykeg itself isn't receiving much love since it is about to be replaced with the android core, which does much better in "offline"/server error situations.)

So I tried a --krest_timeout=30 along with a pull of the latest code (a few hours ago) and it all seems good.  have been logging several different drinkers and having a blast.
So does the stats get generated every few web requests?
It seems like something that should happen out of a web request cycle.
-ray

Great! Yep, stats and session information is calculated during a drink save operation
Moving this offline has been on my todo list for a while., might get to it soon. That said, these operations should not be too time consuming; stats are calculated progressively


Allow manual selection of "JSON"/"JSONC" language options in VSCode

If I have an ARM template open in VSCode, the ARM VSCode extension automatically detects that it's an ARM template, based on the fact that it's a JSON file, with a known ARM template schema.
Occasionally I'd like to have the ability to use the JSON/JSONC language service with the ARM features disabled, but when I manually set the language in VSCode to "JSON", it immediately gets reverted to "Azure Resource Manager Template".
To repro:

Open an ARM template JSON file in VSCode. VSCode automatically sets the language mode to "Azure Resource Manager Template".
Select "Change Language Mode" in the command palette, and select "JSON" or "JSONC".
The language mode (displayed in the bottom right of the window) is temporarily changed, but then reverted back to "Azure Resource Manager Template".

AFAIK this generally works with the other language options - if I try to manually override a .cs to "TypeScript", I'm able to.

This has been a long-standing known issue, but you're the first to complain, so we haven't spent time on the fix.  As a work-around, you can temporarily turn off this setting:

This has been a long-standing known issue, but you're the first to complain, so we haven't spent time on the fix.  As a work-around, you can temporarily turn off this setting:


Custom lagging values for data_hosts are reset to the default value

Hi,
I'm running the app on a single Search Head with Splunk <IP_ADDRESS>. I'm using the latest version of the TrackMe app (1.2.53).
I'm trying to set custom lagging values per data_host.
Click on data_host -> modify -> enter custom lag -> apply manual lagging rule
First it seems to work and my custom value is displayed, but after some minutes it is reset to the default of 3600. This also instantly when I run the ShortTermTracker, so maybe this the reason. Am I doing or understanding something wrong, or is this a bug?
Cheers :)
Tony

That did the trick, thanks :)


Improve input

Keyboard as a joystick. It simulate also the left stick
Mapping for different joystick models: not great, but it works. To add a new mapping a code change is necessary
The input example is now a game controller test

Yes, the controller example should be probably reduced to a bit of text on the screen.
I would probably need to move the whole joystick out and maybe create a test app(?)

Several other things to support hotplugging. I'm happy with how things are right now and I wouldn't touch this anymore.
The only thing is that example which 'exploded', I'll create a ticket for that.


remove extra backslash in "Limits per Stage" section

remove extra backslash in "Limits per Stage" section

Also found more in R&D > Stable Credit and Resources > DeFi Glossary

fixed by #77


Fix dartdoc

added ')'
is this right position? I'm not good at English.
Checklist
Before you create this PR confirm that it meets all requirements listed below by checking the relevant checkboxes ([x]). This will ensure a smooth and quick review process.

[x] I read the [Contributor Guide] and followed the process outlined there for submitting PRs.
[x] I signed the [CLA].
[x] I read and followed the [Flutter Style Guide], including [Features we expect every widget to implement].
[x] I updated/added relevant documentation (doc comments with ///).
[x] All existing and new tests are passing.
[x] The analyzer (flutter analyze --flutter-repo) does not report any problems on my PR.
[x] I am willing to follow-up on review comments in a timely manner.

Breaking Change
Does your PR require Flutter developers to manually update their apps to accommodate your change?

[ ] Yes, this is a breaking change (Please read [Handling breaking changes]). Replace this with a link to the e-mail where you asked for input on this proposed change.
[x] No, this is not a breaking change.

Thanks for the contribution and good catch!
I actually have a fix out for this doc in https://github.com/flutter/flutter/pull/30276 that improves the sentence.


orbiter document command

Command to emit a single-page HTML document for a translation module.
Reuses mkdocs and plugins that generate other orbiter docs

Codecov Report
Attention: Patch coverage is 16.12903% with 26 lines in your changes missing coverage. Please review.

Project coverage is 80.62%. Comparing base (b3ee237) to head (4fec3de).
Report is 12 commits behind head on main.

Files with missing lines
Patch %
Lines

orbiter/__main__.py
16.12%
26 Missing :warning:

Additional details and impacted files
@@            Coverage Diff             @@
##             main      #38      +/-   ##
==========================================
+ Coverage   78.92%   80.62%   +1.69%
==========================================
  Files          35       35
  Lines        1362     1466     +104
==========================================
+ Hits         1075     1182     +107
+ Misses        287      284       -3

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Would you like flash attention?

I implemented support for flash attention via xformers:
https://github.com/Sygil-Dev/muse-maskgit-pytorch/compare/main...Birch-san:muse-maskgit-pytorch:sdp-attn
It gets the same result, confirmed via allclose() (I had to make the absolute tolerance a bit more forgiving, to pass that check, but it's still a very small tolerance).
I also implemented support for torch.nn.functional.scaled_dot_product_attention. it'll use flash attention when mask is None, but I guess your mask is usually defined.
even without flash attention: scaled_dot_product_attention should still be faster than the einsum() * scale approach, because (IIRC) its math fallback is based on baddbmm, which fuses the scale factor into the matmul.
in stable-diffusion inference for example: we measured end-to-end image generation via baddbmm to be ~11% faster  than einsum() * scale on CUDA (and 18% faster on Mac).
@lucidrains is this a contribution you would be interested in receiving as a PR?

@Birch-san omg, yes! thank you Birch-san!

@Birch-san make sure to give Tri Dao another cite too! god knows he isn't being cited enough for this impactful work

@Birch-san hey, decided to take care of it this morning, happy training! (just set flash = True on the transformer)

@lucidrains
hmm does this actually run with flash attention, or does it fallback to math mode? I thought none of the torch sdp kernels supported masks.
In my diff, where I demonstrated it working with torch sdp: I tried disabling math fallback and it said there was no eligible kernel.
That’s why I also demonstrated how to do it via xformers, which supports masks.

@Birch-san yea it should, as they actually just ended up use Tri's flash attention (with the correct hardware), which supports masking

https://pytorch.org/docs/stable/generated/torch.nn.functional.scaled_dot_product_attention.html does 'math' mode not support attention masks? i see attn_mask in the argument, so that would be strange

math mode supports masks. but it's not flash attention. it's just a baddbmm followed by a softmax and a bmm. no memory efficiency, no IO awareness. that's why it's supported on non-CUDA platforms.
if you disable math sdp attn with the context manager:

you get this:

that's why I showed how to implement flash attention via xformers instead: to get flash attention with support for masking.

ah, if math is not following the tiled memory efficient algorithm, that is news to me, and maybe i should fall back to the naive implementation here
xformers uses the 'mem_efficient_attention` which is basically a variant of flash attention. but pytorch 2.0 should detect and use it with the right hardware?

anyways, this is all more confusing than it should be. perhaps a meta-library is in order that can optimally select between all these libraries (including triton's impl)

you can see the implementation of math attention in pytorch's attention.cpp.
it actually looks like it doesn't even use baddbmm optimizations (fusing the scale factor and the mask bias), and there's no explicit attempt to describe it as a 3D batched matmul. I wonder if a naïve implementation could actually go faster.
I think there must be some subtlety other than hardware, because for me: xformers 0.0.20 supports masks but we can see torch sdp didn't. perhaps xformers hasn't upstreamed all their capabilities into pytorch sdp?
I also did a naïve implementation of memory-efficient attention, with baddbmm optimizations:
https://github.com/huggingface/diffusers/issues/1892

@Birch-san yea, makes sense, decided to fallback to my own naive implementation
if they don't have masking support for mem-efficient version, they should def upstream xformers version. masking is very basic.


fix(low-code CDK): fix checkpointing for declarative streams

What
With this PR, the get_checkpointing method has been modified so that the state will be emitted only if the state value is not equal to the previous state value. However, declarative streams do not support record-level checkpointing and instead perform slice checkpointing. In cases where a slice ends with multiple records having the same cursor value, the state message will not be emitted because _previous_state in the checkpoint reader is already updated and matches the current state.
How
Moved the record checkpoint definition after the condition that checks if checkpointing is needed, ensuring that checkpoint_interval exists and record_counter % checkpoint_interval == 0.

Summary by CodeRabbit

Bug Fixes

Improved checkpointing logic during stream data reading to reduce redundancy and enhance clarity.
Refined error handling for state management to ensure correct state observation.

New Features

Streamlined state management process in the reading logic for better efficiency.

Should there be a test that is being updated if we change the behavior?


Modify "Insert/Edit Link" Dialog in WYSIWYG edit mode

Describe the feature you'd like
I suggest a change to the current "Insert/Edit Link" dialog in the WYSIWYG editor.
Currently, the steps are like this (Firefox):

click button for inserting link in the menu bar
the cursor is automatically in the first input field for the URL, so I just do Ctrl+v for pasting the URL from the clipboard, which will automatically insert the same URL to the input field for the display text
Press Tab
Press Tab again to get to the input field for the display text
Press Ctrl+a to select all text in this input field
start typing the actual text to display, overwriting the selected text

I wonder if one could shortcut the whole process to

click Button for inserting link
the cursor is automatically in the first input field for the URL, so I just do Ctrl+V for pasting the URL from the clipboard, without adding the URL to the next input
Press Tab once and directly go to the next input, skipping the button next to the URL input field
start typing the actual text to display

Describe the benefits this would bring to existing BookStack users
save precious keystrokes!
Can the goal of this request already be achieved via other means?
no
Have you searched for an existing open/closed issue?

[X] I have searched for existing issues and none cover my fundemental request

How long have you been using BookStack?
0 to 6 months
Additional context
No response

In addition to this, is it possible to change the defaults?
For example, I always want the Title to default to the URL (so I can view the URL when hovering over the link) and default 'Open link in new window'. Currently I have to manually set these even though it will be the same in nearly every single link I add.


upgrade plugin

Coverage remained the same at 24.561% when pulling 9458bdb945b6abb21b162e98399b293ea102ca3d on ryan-williams:ug into 548aaaad01a46c4b70e5513e46a61a800cd50ca2 on hammerlab:master.


issues in the installation guides

Formatting error of URLs. []() may not have  a line break inbetween.
Path not always consistently set and displayed.
Raspbian OS bullseye has ntp installed as systemd-timesyn, not as ntpd.
Describe how to verify ntp is running.
venv installation doesn't work neither with Raspbian OS nor with Ubuntu.
sudo python3 -m pip install venv should read as
sudo python3 -m pip install virtualenv.
Chapter 3.1
python -m pip install -U pip wheel setuptools   should read as
python3 -m pip install -U pip wheel setuptools

ready for merge with https://github.com/sberl/supersid/pull/81


Allow inverse to default to owner if not passed

@zacharygolba looking for your thoughts on a change like this. This is a pretty small change to allow for default inverses. I found in most places I'm writing models that aren't aliasing the model to another name, so the inverse property is almost always the owner model.
Example:
import { Model } from 'lux-framework';

class Job extends Model {
  static belongsTo = {
    configurationName: {
      model: 'configuration-name',
      inverse: 'jobs'
    },
    operatingSystem: {
      model: 'operating-system',
      inverse: 'jobs'
    },
    testSuite: {
      model: 'test-suite',
      inverse: 'jobs'
    },
    product: {
      model: 'product',
      inverse: 'jobs'
    },
    applicationStack: {
      model: 'application-stack',
      inverse: 'jobs'
    }
  };
}

export default Job;

This change would allow you to omit the inverse property if it's just the owner model, which would allow:
import { Model } from 'lux-framework';

class Job extends Model {
  static belongsTo = {
    configurationName: {
      model: 'configuration-name'
    },
    operatingSystem: {
      model: 'operating-system'
    },
    testSuite: {
      model: 'test-suite'
    },
    product: {
      model: 'product'
    },
    applicationStack: {
      model: 'application-stack'
    }
  };
}

export default Job;

Or even with your fix to model casing (which I had not updated to yet), it would be even simpler for defaults (while still allowing you to specify model and inverse if your schema requires it):
import { Model } from 'lux-framework';

class Job extends Model {
  static belongsTo = {
    configurationName: {},
    operatingSystem: {},
    testSuite: {},
    product: {},
    applicationStack: {}
  };
}

export default Job;

:clap: Nice work! Your contribution is very much appreciated!
After discussing this over with some team, members I'm unfortunately going to have to close this. It is a good idea and definitely is nice to not have to specify the inverse of all relationships however, we believe it is better to have the Model and relationship declarations follow a more "self-documenting" approach.
If you have an idea for a feature in the future, it may be a good idea to bounce it off a few people in the Gitter room or create an issue before submitting a PR.
Thanks a ton for your contribution! 😃

No worries, was a quick 3 line change to foster some conversation. A little bummed to not support it, but understand the reasoning so it's all good. Thanks for being open to discussion


Ort.jar is not present after build

we are using  ./gradlew --no-daemon --stacktrace cli:installDist build ort, ort build is successful,

but we are not getting the ort.jar file in the build output in ls -al cli/build/install/ort/lib/ folder ( we see several other jar)
Please let us know when can we find the same

There is no single (fat) JAR for ORT anymore as of https://github.com/oss-review-toolkit/ort/pull/6322. Instead, the whole directory at ./cli/build/install/ort contains the ORT distribution, and you can run ORT like ./cli/build/install/ort/bin/ort --help. If you want to bundle the ORT distribution (e.g. in order to install it on another machine), use the :cli:distTar or :cli:distZip task to create an archive containing the distribution.

Meanwhile also https://github.com/oss-review-toolkit/ort/pull/6514 has been merged, which should address the confusion.

Hi, Could please let us know where the archive will be generated, cli:distTar  (in which folder zip file is present )

Could please let us know where the archive will be generated,

It's being generated at cli/build/distributions/ort-<sha1>.tar, where <sha1> is a placeholder for the Git revision from which the distribution was built.

Hi @sschuberth,can you pls let me know how can we use this build result  and do ort scan

@AnishaM7 it's described in the README: https://github.com/oss-review-toolkit/ort#basic-usage
So, you need to untar ort-<sha1>.tar to your desired installation directory and then run the comntained shell script / batch file like
./cli/build/install/ort/bin/ort --help

(If ./cli/build/install/ort was youo installation directory.)

Hi @sschuberth,
We got the resulting build output, when we untar  and execute ort --help , we get below error,

when we untar and execute ort --help , we get below error

I just tried, and I cannot reproduce this. These were my steps:

./gradlew :cli:distTar
tar -xf cli/build/distributions/ort-5692ae1f88.tar
ort-5692ae1f88/bin/ort --help

Which did output the help as expected.


SUBMARINE-608. [WEB] Create environment through UI

What is this PR for?
Complete creation environment through UI.
What type of PR is it?
[Feature]
Todos
What is the Jira issue?
https://issues.apache.org/jira/browse/SUBMARINE-608
How should this be tested?
https://travis-ci.org/github/kobe860219/submarine/builds/727321947
Screenshots (if appropriate)

Questions:

Does the licenses files need update? No
Is there breaking changes for older versions? No
Does this needs documentation? No

@pingsutw  @xunliu  @jiwq  Please help me review this pr. Thanks !


Invite you to try FslexFsyacc

compiler/parser programming enthusiasts, I am very pleased to invite you to try a new series of lex/yacc tools.
Fslex is a code generator that uses regular expression syntax as a rule to generate a function, which divides the input token sequence into groups at a higher level. The Fslex is often used to remove redundant delimiters, add omitted delimiters or other syntax components, and so on. The Fslex is also used to determine context somewhere in the stream.
Fsyacc is a code generator that use BNF productions and precedences as a rule to generate a function, which resolves the input token sequence to an abstract syntax tree.
Why use this package?

You can use your existing handwriting tokenizer.

This package uses standard lex/yacc syntax to minimize your learning costs.

fslex/fsyacc generates respectively an independent, side-effect-free function that can be called flexibly.

The method of generating code is simple, without command lines and without the need to configure projects.

The result code is data-driven and highly readable.

Flexiblely compose of tokenize, regular expressions, BNF technology.

You can check it by following the link: https://github.com/xp44mm/FslexFsyacc

Thanks for the proposal. Though, Markdown is not a good candidate for a lex/yacc parsing, as its grammar is ambiguous in multiple places and thus is not express-able in BNF form.


so what should the test dataset config be like without ground-truth annotations

you see if I create a empty json file,I would get an eroor below...

I‘m confused right now, should I make the json file not empty and hold some essential information in coco format,or its wrong in other ways

Same to my question. https://github.com/open-mmlab/mmdetection/issues/5442

和我的问题一样。#5442

so I should write a json file without annotations but contain other essential information of the testset?

yes, you need use a script to get the json file.

yes, you need use a script to get the json file.

I get you. and what would the test result be like, I get a pkl file for it. Is there a way to automatically generate the json file with annotations result, or should I generate it manually?

Manually

Thank you all for your feedback. Considering that this demand is more common, we will provide a conversion script as soon as possible.


Updated validations.py python script

Updated validations.py python script.
Fixed the behavior of validate_user function in validations.py.
Fixes #<issue_number_goes_here>

It's a good idea to open an issue first for discussion.

[ ] Tests pass
[ ] Appropriate changes to README are included in PR

@googlebot I signed it!
Sent from Mailhttps://go.microsoft.com/fwlink/?LinkId=550986 for Windows 10
From<EMAIL_ADDRESS>Sent: Monday, September 7, 2020 1:30 AM
To<EMAIL_ADDRESS>Cc: Samuel<EMAIL_ADDRESS><EMAIL_ADDRESS>Subject: Re: [google/it-cert-automation-practice] Updated validations.py python script (#7182)
Thanks for your pull request. It looks like this may be your first contribution to a Google open source project (if not, look below for help). Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).
📝 Please visit https://cla.developers.google.com/https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcla.developers.google.com%2F&data=02|01||e7b4d41305614a725d6a08d852ef3275|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637350534574190476&sdata=FTJXVuORBqzspWGkAaygoXQVNSrT%2BOVXsL61bQIV8ZQ%3D&reserved=0 to sign.
Once you've signed (or fixed any issues), please reply here with @googlebot I signed it! and we'll verify it.
What to do if you already signed the CLA
Individual signers

It's possible we don't have your GitHub username or you're using a different email address on your commit. Check your existing CLA datahttps://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcla.developers.google.com%2Fclas&data=02|01||e7b4d41305614a725d6a08d852ef3275|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637350534574200471&sdata=UvgiKxFuouTvjgucwUQec59oZ%2FBz7rfHrkRVPP0ieu0%3D&reserved=0 and verify that your email is set on your git commitshttps://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fhelp.github.com%2Farticles%2Fsetting-your-email-in-git%2F&data=02|01||e7b4d41305614a725d6a08d852ef3275|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637350534574200471&sdata=mxJQIdBK7JElKQccRv97T0R4%2FWIKvBdRxQusdimWGCI%3D&reserved=0.

Corporate signers

Your company has a Point of Contact who decides which employees are authorized to participate. Ask your POC to be added to the group of authorized contributors. If you don't know who your Point of Contact is, direct the Google project maintainer to go/cla#troubleshoothttp://go/cla#troubleshoot (Public versionhttps://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fopensource.google%2Fdocs%2Fcla%2F%23troubleshoot&data=02|01||e7b4d41305614a725d6a08d852ef3275|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637350534574210467&sdata=%2BydG59%2BLBLH2cpKVjWo1g%2FEkxAEBvRy2KjaA8RmveO8%3D&reserved=0).
The email used to register you as an authorized contributor must be the email used for the Git commit. Check your existing CLA datahttps://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcla.developers.google.com%2Fclas&data=02|01||e7b4d41305614a725d6a08d852ef3275|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637350534574220462&sdata=mzPVZlNgpnlPyC2CrQT5vV8PMCbbfDAkDPdzj42%2FI6U%3D&reserved=0 and verify that your email is set on your git commitshttps://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fhelp.github.com%2Farticles%2Fsetting-your-email-in-git%2F&data=02|01||e7b4d41305614a725d6a08d852ef3275|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637350534574220462&sdata=QRNyoFhtrCocroxhsrSvbitmwVapQCdgIADgubLAK%2Fk%3D&reserved=0.
The email used to register you as an authorized contributor must also be attached to your GitHub accounthttps://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fsettings%2Femails&data=02|01||e7b4d41305614a725d6a08d852ef3275|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637350534574230456&sdata=Qh06pcRt3oVYsQ3pIP16WNUnBwbm%2FKqhWgZXkGufshg%3D&reserved=0.

ℹ Googlers: Go herehttps://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgoto.google.com%2Fprinfo%2Fhttps%253A%252F%252Fgithub.com%252Fgoogle%252Fit-cert-automation-practice%252Fpull%252F7182&data=02|01||e7b4d41305614a725d6a08d852ef3275|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637350534574230456&sdata=yBlA6Co7ZYsxNznYUIQzG3LMlEAUXsez5lPyCYpti%2Fk%3D&reserved=0 for more info.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fit-cert-automation-practice%2Fpull%2F7182%23issuecomment-688045485&data=02|01||e7b4d41305614a725d6a08d852ef3275|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637350534574240458&sdata=ytkNGCEZNiJFxfb3%2BwXz1bMvjCWXGNrZJl%2B7JWKIss8%3D&reserved=0, or unsubscribehttps://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FABU7DWNYHPCVTV6BSBXIMSTSERVZBANCNFSM4Q5PUUZA&data=02|01||e7b4d41305614a725d6a08d852ef3275|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637350534574240458&sdata=KNPYJOUx0Y7HEMxMpUmf3BpGhYT0G0FWcetgaaZYdhA%3D&reserved=0.


gitignore: more specific pattern for excluding nix output dirs

Description
Otherwise, in setups with case insensitivity, new golden test files (starting
with Result_) are ignored by git, which can easily cause confusion.
To test this, run git config core.ignoreCase true. Then, create a file called
Result_foo and compare git status before and after this change.
Checklist

Branch

[x] Commit sequence broadly makes sense
[x] Commits have useful messages
[x] New tests are added if needed and existing tests are updated
[x] If this branch changes Consensus and has any consequences for downstream repositories or end users, said changes must be documented in interface-CHANGELOG.md
[x] If this branch changes Network and has any consequences for downstream repositories or end users, said changes must be documented in interface-CHANGELOG.md
[x] If serialization changes, user-facing consequences (e.g. replay from genesis) are confirmed to be intentional.

Pull Request

[x] Self-reviewed the diff
[x] Useful pull request description at least containing the following information:

What does this PR change?
Why these changes were needed?
How does this affect downstream repositories and/or end-users?
Which ticket does this PR close (if any)? If it does, is it linked?

[x] Reviewer requested

bors merge


Input_ids not automatically convert to device

Hi, when trying to run and tweak a little bit the examples from the doc with a MacBook m1 I met some problems.
I had the following error :
---------------------------------------------------------------------------
RuntimeError                              Traceback (most recent call last)
Cell In[8], line 26
     21 query_tensor = tokenizer.encode(query_txt, return_tensors="pt")
     23 while True:
     24
     25     # get model response
---> 26     response_tensor  = respond_to_batch(model, query_tensor)
     28     # create a ppo trainer
     29     ppo_trainer = PPOTrainer(ppo_config, model, model_ref, tokenizer)

File [/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/trl/core.py:212](https://file+.vscode-resource.vscode-cdn.net/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/trl/core.py:212), in respond_to_batch(model, queries, txt_len, top_k, top_p)
    209 input_ids = queries
    210 for i in range(txt_len):
    211     # Get Logits
--> 212     outputs = model(input_ids)
    213     next_token_logits = outputs[0][:, -1, :]
    214     next_token_logits = top_k_top_p_filtering(next_token_logits, top_k=top_k, top_p=top_p)

File [/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/module.py:1501](https://file+.vscode-resource.vscode-cdn.net/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/module.py:1501), in Module._call_impl(self, *args, **kwargs)
   1496 # If we don't have any hooks, we want to skip the rest of the logic in
   1497 # this function, and just call forward.
   1498 if not (self._backward_hooks or self._backward_pre_hooks or self._forward_hooks or self._forward_pre_hooks
   1499         or _global_backward_pre_hooks or _global_backward_hooks
   1500         or _global_forward_hooks or _global_forward_pre_hooks):
-> 1501     return forward_call(*args, **kwargs)
   1502 # Do not call functions when jit is used
   1503 full_backward_hooks, non_full_backward_hooks = [], []

File [/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/trl/models/modeling_value_head.py:161](https://file+.vscode-resource.vscode-cdn.net/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/trl/models/modeling_value_head.py:161), in AutoModelForCausalLMWithValueHead.forward(self, input_ids, past_key_values, attention_mask, **kwargs)
    143 r"""
    144 Applies a forward pass to the wrapped model and returns the logits of the value head.
    145
   (...)
    157         Additional keyword arguments, that are passed to the wrapped model.
    158 """
    159 kwargs["output_hidden_states"] = True  # this had already been set in the LORA [/](https://file+.vscode-resource.vscode-cdn.net/) PEFT examples
--> 161 base_model_output = self.pretrained_model(
    162     input_ids=input_ids,
    163     past_key_values=past_key_values,
    164     attention_mask=attention_mask,
    165     **kwargs,
    166 )
    168 last_hidden_state = base_model_output.hidden_states[-1]
    169 lm_logits = base_model_output.logits

File [/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/module.py:1501](https://file+.vscode-resource.vscode-cdn.net/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/module.py:1501), in Module._call_impl(self, *args, **kwargs)
   1496 # If we don't have any hooks, we want to skip the rest of the logic in
   1497 # this function, and just call forward.
   1498 if not (self._backward_hooks or self._backward_pre_hooks or self._forward_hooks or self._forward_pre_hooks
   1499         or _global_backward_pre_hooks or _global_backward_hooks
   1500         or _global_forward_hooks or _global_forward_pre_hooks):
-> 1501     return forward_call(*args, **kwargs)
   1502 # Do not call functions when jit is used
   1503 full_backward_hooks, non_full_backward_hooks = [], []

File [/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/transformers/models/gpt2/modeling_gpt2.py:1080](https://file+.vscode-resource.vscode-cdn.net/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/transformers/models/gpt2/modeling_gpt2.py:1080), in GPT2LMHeadModel.forward(self, input_ids, past_key_values, attention_mask, token_type_ids, position_ids, head_mask, inputs_embeds, encoder_hidden_states, encoder_attention_mask, labels, use_cache, output_attentions, output_hidden_states, return_dict)
   1072 r"""
   1073 labels (`torch.LongTensor` of shape `(batch_size, sequence_length)`, *optional*):
   1074     Labels for language modeling. Note that the labels **are shifted** inside the model, i.e. you can set
   1075     `labels = input_ids` Indices are selected in `[-100, 0, ..., config.vocab_size]` All labels set to `-100`
   1076     are ignored (masked), the loss is only computed for labels in `[0, ..., config.vocab_size]`
   1077 """
   1078 return_dict = return_dict if return_dict is not None else self.config.use_return_dict
-> 1080 transformer_outputs = self.transformer(
   1081     input_ids,
   1082     past_key_values=past_key_values,
   1083     attention_mask=attention_mask,
   1084     token_type_ids=token_type_ids,
   1085     position_ids=position_ids,
   1086     head_mask=head_mask,
   1087     inputs_embeds=inputs_embeds,
   1088     encoder_hidden_states=encoder_hidden_states,
   1089     encoder_attention_mask=encoder_attention_mask,
   1090     use_cache=use_cache,
   1091     output_attentions=output_attentions,
   1092     output_hidden_states=output_hidden_states,
   1093     return_dict=return_dict,
   1094 )
   1095 hidden_states = transformer_outputs[0]
   1097 # Set device for model parallelism

File [/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/module.py:1501](https://file+.vscode-resource.vscode-cdn.net/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/module.py:1501), in Module._call_impl(self, *args, **kwargs)
   1496 # If we don't have any hooks, we want to skip the rest of the logic in
   1497 # this function, and just call forward.
   1498 if not (self._backward_hooks or self._backward_pre_hooks or self._forward_hooks or self._forward_pre_hooks
   1499         or _global_backward_pre_hooks or _global_backward_hooks
   1500         or _global_forward_hooks or _global_forward_pre_hooks):
-> 1501     return forward_call(*args, **kwargs)
   1502 # Do not call functions when jit is used
   1503 full_backward_hooks, non_full_backward_hooks = [], []

File [/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/transformers/models/gpt2/modeling_gpt2.py:846](https://file+.vscode-resource.vscode-cdn.net/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/transformers/models/gpt2/modeling_gpt2.py:846), in GPT2Model.forward(self, input_ids, past_key_values, attention_mask, token_type_ids, position_ids, head_mask, inputs_embeds, encoder_hidden_states, encoder_attention_mask, use_cache, output_attentions, output_hidden_states, return_dict)
    843 head_mask = self.get_head_mask(head_mask, self.config.n_layer)
    845 if inputs_embeds is None:
--> 846     inputs_embeds = self.wte(input_ids)
    847 position_embeds = self.wpe(position_ids)
    848 hidden_states = inputs_embeds + position_embeds

File [/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/module.py:1501](https://file+.vscode-resource.vscode-cdn.net/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/module.py:1501), in Module._call_impl(self, *args, **kwargs)
   1496 # If we don't have any hooks, we want to skip the rest of the logic in
   1497 # this function, and just call forward.
   1498 if not (self._backward_hooks or self._backward_pre_hooks or self._forward_hooks or self._forward_pre_hooks
   1499         or _global_backward_pre_hooks or _global_backward_hooks
   1500         or _global_forward_hooks or _global_forward_pre_hooks):
-> 1501     return forward_call(*args, **kwargs)
   1502 # Do not call functions when jit is used
   1503 full_backward_hooks, non_full_backward_hooks = [], []

File [/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/sparse.py:162](https://file+.vscode-resource.vscode-cdn.net/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/sparse.py:162), in Embedding.forward(self, input)
    161 def forward(self, input: Tensor) -> Tensor:
--> 162     return F.embedding(
    163         input, self.weight, self.padding_idx, self.max_norm,
    164         self.norm_type, self.scale_grad_by_freq, self.sparse)

File [/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/functional.py:2210](https://file+.vscode-resource.vscode-cdn.net/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/functional.py:2210), in embedding(input, weight, padding_idx, max_norm, norm_type, scale_grad_by_freq, sparse)
   2204     # Note [embedding_renorm set_grad_enabled]
   2205     # XXX: equivalent to
   2206     # with torch.no_grad():
   2207     #   torch.embedding_renorm_
   2208     # remove once script supports set_grad_enabled
   2209     _no_grad_embedding_renorm_(weight, input, max_norm, norm_type)
-> 2210 return torch.embedding(weight, input, padding_idx, scale_grad_by_freq, sparse)

RuntimeError: Placeholder storage has not been allocated on MPS device!

Here is the code I ran to get this error :
# imports
import torch
from transformers import AutoTokenizer
from trl import PPOTrainer, PPOConfig, AutoModelForCausalLMWithValueHead, create_reference_model
from trl.core import respond_to_batch

# get models
model = AutoModelForCausalLMWithValueHead.from_pretrained('gpt2')
model_ref = create_reference_model(model)

tokenizer = AutoTokenizer.from_pretrained('gpt2')
tokenizer.pad_token = tokenizer.eos_token

# initialize trainer
ppo_config = PPOConfig(
    batch_size=1,
)

# create a ppo trainer
ppo_trainer = PPOTrainer(ppo_config, model, model_ref, tokenizer)

# encode a query
query_txt = "This morning I went to the "
query_tensor = tokenizer.encode(query_txt, return_tensors="pt").to("mps:0")

while True:

    # get model response
    response_tensor  = respond_to_batch(model, query_tensor)

    # define a reward for response
    # (this could be any reward such as human feedback or output from another model)
    reward = [torch.tensor(1.0)]

    # train model for one step with ppo
    train_stats = ppo_trainer.step([query_tensor[0]], [response_tensor[0]], reward)

The funny thing is that if the PPOTrainer is create after the respond_to_batch, it works on the first iteration of the loop but not the second :
# imports
import torch
from transformers import AutoTokenizer
from trl import PPOTrainer, PPOConfig, AutoModelForCausalLMWithValueHead, create_reference_model
from trl.core import respond_to_batch

# get models
model = AutoModelForCausalLMWithValueHead.from_pretrained('gpt2')
model_ref = create_reference_model(model)

tokenizer = AutoTokenizer.from_pretrained('gpt2')
tokenizer.pad_token = tokenizer.eos_token

# initialize trainer
ppo_config = PPOConfig(
    batch_size=1,
)

# encode a query
query_txt = "This morning I went to the "
query_tensor = tokenizer.encode(query_txt, return_tensors="pt")

while True:

    print('hello')

    # get model response
    response_tensor  = respond_to_batch(model, query_tensor)

    # create a ppo trainer
    ppo_trainer = PPOTrainer(ppo_config, model, model_ref, tokenizer)

    # define a reward for response
    # (this could be any reward such as human feedback or output from another model)
    reward = [torch.tensor(1.0)]

    # train model for one step with ppo
    train_stats = ppo_trainer.step([query_tensor[0]], [response_tensor[0]], reward)

I figured out that inputs_ids where on device cpu and the model on mps:0.
So I updated the PPOTrainer example like this :
query_tensor = tokenizer.encode(query_txt, return_tensors="pt")
to
query_tensor = tokenizer.encode(query_txt, return_tensors="pt").to("mps:0")
It fixes my issue and now everything works as expected with the PPOTrainer, but the issue persist with the SFTTrainer example, and I didn't test the RewardTrainer.
I investigate a little bit, but I didn't find a relevant place to make a modification in the package so that the input_ids are converted  automatically.
I hope everything I said was clear :)
Have a good day and thanks for maintaining this package !

Hi @Naowak
Thanks for the message !
Just to make sure I have the entire context, how do you run the script? python xxxx.py or with something else? Can you try to run the script with accelerate launch xxxx.py after making sure you have selected MPS when running accelerate config

I ran the script in a notebook in vscode. I just change facebook/opt-350m to gpt2 :
# imports
from datasets import load_dataset
from trl import SFTTrainer

# get dataset
dataset = load_dataset("imdb", split="train")

# get trainer
trainer = SFTTrainer(
    "facebook/opt-350m",
    train_dataset=dataset,
    dataset_text_field="text",
    max_seq_length=512,
)

# train
trainer.train()

Ok so I made that config with accelerate config (no everywhere) :
------------------------------------------------------------------------------------------------------------------------In which compute environment are you running?
This machine
------------------------------------------------------------------------------------------------------------------------Which type of machine are you using?
No distributed training
Do you want to run your training on CPU only (even if a GPU / Apple Silicon device is available)? [yes/NO]:
Do you wish to optimize your script with torch dynamo?[yes/NO]:
------------------------------------------------------------------------------------------------------------------------Do you wish to use FP16 or BF16 (mixed precision)?
no
accelerate configuration saved at /Users/naowak/.cache/huggingface/accelerate/default_config.yaml

I created a file called sfftrainer.py and copy the script from above in it. And get :
$ accelerate launch sfttrainer.py
Found cached dataset imdb (/Users/naowak/.cache/huggingface/datasets/imdb/plain_text/1.0.0/d613c88cf8fa3bab83b4ded3713f1f74830d1100e171db75bbddb80b3345c9c0)
/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/trl/trainer/sft_trainer.py:117: UserWarning: You passed a model_id to the SFTTrainer. This will automatically create an `AutoModelForCausalLM` or a `PeftModel` (if you passed a `peft_config`) for you.
  warnings.warn(
Using pad_token, but it is not set yet.
Loading cached processed dataset at /Users/naowak/.cache/huggingface/datasets/imdb/plain_text/1.0.0/d613c88cf8fa3bab83b4ded3713f1f74830d1100e171db75bbddb80b3345c9c0/cache-6625bfcc4ca80be1.arrow
/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/transformers/optimization.py:411: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set `no_deprecation_warning=True` to disable this warning
  warnings.warn(
  0%|                                                                                | 0/9375 [00:00<?, ?it/s]You're using a GPT2TokenizerFast tokenizer. Please note that with a fast tokenizer, using the `__call__` method is faster than using a method to encode the text followed by a call to the `pad` method to get a padded encoding.
Traceback (most recent call last):
  File "/Users/naowak/Work/BattleFieldAgents/api/sfttrainer.py", line 17, in <module>
    trainer.train()
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/transformers/trainer.py", line 1645, in train
    return inner_training_loop(
           ^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/transformers/trainer.py", line 1938, in _inner_training_loop
    tr_loss_step = self.training_step(model, inputs)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/transformers/trainer.py", line 2759, in training_step
    loss = self.compute_loss(model, inputs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/transformers/trainer.py", line 2784, in compute_loss
    outputs = model(**inputs)
              ^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/transformers/models/gpt2/modeling_gpt2.py", line 1080, in forward
    transformer_outputs = self.transformer(
                          ^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/transformers/models/gpt2/modeling_gpt2.py", line 846, in forward
    inputs_embeds = self.wte(input_ids)
                    ^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/sparse.py", line 162, in forward
    return F.embedding(
           ^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/functional.py", line 2211, in embedding
    return torch.embedding(weight, input, padding_idx, scale_grad_by_freq, sparse)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: Placeholder storage has not been allocated on MPS device!
  0%|                                                                                | 0/9375 [00:00<?, ?it/s]
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.11/bin/accelerate", line 8, in <module>
    sys.exit(main())
             ^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/accelerate/commands/accelerate_cli.py", line 45, in main
    args.func(args)
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/accelerate/commands/launch.py", line 941, in launch_command
    simple_launcher(args)
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/accelerate/commands/launch.py", line 603, in simple_launcher
    raise subprocess.CalledProcessError(returncode=process.returncode, cmd=cmd)
subprocess.CalledProcessError: Command '['/usr/local/bin/python', 'sfttrainer.py']' returned non-zero exit status 1.

It seems to be the same error. :/

what version of transformers are you using?

Python 3.11.4 (v3.11.4:d2340ef257, Jun  6 2023, 19:15:51) [Clang 13.0.0 (clang-13<IP_ADDRESS>)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import transformers
>>> transformers.__version__
'4.30.2'

Version 4.30.2


Latest revision build fails

Building the latest revision 9c8aa559a21ce4a367f7d6f2e1e64ce0099421c4 fails at the cmake .. command.
The complete list of commands to compile is given below
cd ./lib
cargo build
cargo test
cargo doc
cd ..

cargo install --force cbindgen
python -m pip install -e ./python[dev]

cd build
cmake -DCMAKE_C_COMPILER=gcc ..      # <- FAILURE
make
make check
cd ..

And the full error message can be found attached.
cmake-error.txt

Some info about my system:
OS AV MX-Linux 21
CMake 3.18.4
GCC 10.2.1
Python 3.9.2
Cargo 1.61.0

@ngeiswei, thank you for reporting! I have checked this on Ubuntu 18.04 with CMake 3.12 but it looks like I missed these error messages because app was built successfully anyway. Now I see that the `$CONFIG:... expression syntax I used was introduced only in latest versions of CMake. So, I will rewrite it using syntax which works for CMake 3.12.


Bookstore: initialize project with components

Hi,
I have implemented the following project requirements:
Project requirements

Initialise React app.
The building blocks of your app should be set as re-usable components. Create a directory  for your components.
Add React Router and set two <Route>s and <Link>s for the app's navigation:

Books - the default view:

Should display the list of books (empty at this point but it should be ready for the data) with the Remove button (no funcionality yet).

Create a component called Book for displaying a single book (receive a title and an author as prop) and reuse it in a component that displays a list of books.

Should have a form for adding a book (no functionality yet).

Create a separate component for this form (with inputs for a title and an author [IMPORTANT in the design you can see an input for a category - please replace it with an author.]).

Categories:

Should display a button "Check status" only.

Styling is not required at this point.

Ref: https://github.com/microverseinc/curriculum-react-redux/blob/main/bookstore/project_init_project_wth_comps_v2_0.md

Live Demo
https://bookstore-cms-nayankaran.netlify.app/
https://bookstore-cms-nayankaran.herokuapp.com/


Bidding strategy update does not apply when mutating campaign

Client library version 6.0.0

.NET Core 3.1

Windows

Actions taken
Mutate a campaign assigning it a bidding strategy.
var campaignToUpdate = new GoogleAdsResources.Campaign
{
	ResourceName = ResourceNames.Campaign(request.UserRequest.ClientCustomerId, request.Campaign.Id)
};

if (requestedCampaign.StandardBiddingStrategy != null)
{
	switch (biddingStrategyType)
	{
                { ... }
		case BiddingStrategyType.ManualCpc:
			campaignToUpdate.ManualCpc = new ManualCpc();
			if (requestedCampaign.StandardBiddingStrategy.EnhancedCpcEnabled.HasValue)
			{
				targetCampaign.ManualCpc.EnhancedCpcEnabled =
					requestedCampaign.StandardBiddingStrategy.EnhancedCpcEnabled.Value;
			}
			break;
		case BiddingStrategyType.ManualCpm:
			campaignToUpdate.ManualCpm = new ManualCpm();
			break;
		case BiddingStrategyType.ManualCpv:
			campaignToUpdate.ManualCpv = new ManualCpv();
			break;
		case BiddingStrategyType.MaximizeConversions:
			campaignToUpdate.MaximizeConversions = new MaximizeConversions();
			break;
		case BiddingStrategyType.TargetCpa:
			campaignToUpdate.TargetCpa = new TargetCpa();
			if (requestedCampaign.StandardBiddingStrategy.Common.TargetCpa.HasValue)
			{
				campaignToUpdate.TargetCpa.TargetCpaMicros =
					requestedCampaign.StandardBiddingStrategy.Common.TargetCpa.Value;
			}
			break;
	}
}

var campaignOperation = new CampaignOperation
{
	Update = campaignToUpdate,
	UpdateMask = FieldMasks.AllSetFieldsOf(campaignToUpdate) // fields mask gets updated properly
};

Expected result
Campaign has the newly assigned bidding strategy
Actual result
Mutation succeeds but campaign still has the old bidding strategy. No change is logged in change history.
Mutation with bidding strategies that have additional properties works fine though. This issue is for bidding strategies without extra properties such as ManualCpm, ManualCpv and MaximizeConversions. The field mask seems to pick the change though: {"resourceName":"...", "maximizeConversions": { } }
There are a couple of related posts in the group, but one of them redirects the issue to the java lib, so I thought of posting this here instead.

https://groups.google.com/g/adwords-api/c/GB4sReLzky4/m/Lw85VbDeAAAJ
https://groups.google.com/u/3/g/adwords-api/c/6AyogtFnN1c

@almamouz This seems more an issue with the API itself rather than the client library, but I'll keep this open for now just to make sure that the server issue isn't masking another client library issue.

@almamouz Was this issue fixed for you? Did you get a resolution from the forum threads?

@AnashOommen Not yet. There haven't been any updates in the forum either

Hi @almamouz
Could you give it another try? I looked up the internal issue, and it seems to be fixed. So something like this would work:
maximize_conversions

Works fine now, I didn't have to change anything. Thanks!


Manifest.json is loaded without Auth in Chrome | Add crossorigin="use-credentials" to  in index.html

Describe the bug
The public/manifest.json is loaded without Auth-Header in google chrome. Therefore we get a 401 error for this request.
Which terms did you search for in User Guide?
I looked for manifest in create-react-app.dev and also looked if there is a suitable open issue here.
Environment
npx: installed 98 in 6.391s

Environment Info:

  current version of create-react-app: 3.4.1
  running from /home/user/.npm/_npx/24237/lib/node_modules/create-react-app

  System:
    OS: Linux 4.19 Debian GNU/Linux 10 (buster) 10 (buster)
    CPU: (4) x64 Intel(R) Core(TM) i7-8665U CPU @ 1.90GHz
  Binaries:
    Node: 12.18.2 - /usr/bin/node
    Yarn: Not Found
    npm: 6.14.5 - /usr/bin/npm
  Browsers:
    Chrome: Not Found
    Firefox: 68.10.0esr
  npmPackages:
    react: ^16.13.1 => 16.13.1
    react-dom: ^16.13.1 => 16.13.1
    react-scripts: 3.4.1 => 3.4.1
  npmGlobalPackages:
    create-react-app: Not Found

Expected behavior
Loading with Auth-Header.
Soloution
I added crossorigin="use-credetials" to the >-Tag in public/index.html and this works now with chrome. Maybe it would be good to add this per default, or document this in the offical docs.
I found these to issues with similar problemes:

https://github.com/koajs/basic-auth/issues/19
https://github.com/jantimon/favicons-webpack-plugin/issues/212

Did you set the PUBLIC_URL in the environment file or the homepage property in package.json?

Yes, i set my homepage-Property to "." in package.json.

If you running dev build (i.e. yarn start), remove that property and try again.

The problem only occurs with the deployed app on our server with production build. When using dev build on localhost, the problem doesn't happen.


An error occurred when adding the azureOpenAI component

Describe the bug
Add the azureOpenAI component, enter a dialog, and report an error
Browser and Version

Browser [chrome,]
Version [v1.0.5]

To Reproduce
Steps to reproduce the behavior:

Add a chatinput
add a AzureOpenAI
add  chat output
See error

Screenshots
Additional context
Error Building Component
Error building Component Azure OpenAI: build_model not found in AzureChatOpenAIComponent

Duplicates of #2331


add support for pretty qr code

hi
its possible to impalement/enhance current qr code widget to support pretty qr code
where icon in middle of qr code

Isn't it 'embeddedImage'?

Isn't it 'embeddedImage'?

it's not. Currently the image is only drawn over the QR and if it's too large the QR won't be readable

5.0 will support the exclusion of the pixels behind the image. However, you need to use sensible image sizes and data quality / error check values. If you don't the code will not be readable.


Update for 9.5

Changed variable to enumerate Backup Jobs from $.BackupPlatform to $.SourceType

Well can't pull it anymore but seems good to me

@tdewin Are you entirely unable to pull the repository, or do you mean unable to merge the PR? Just want to ensure there isn’t an issue with the repository itself.

As an aside, I couldn’t find any documentation referencing this change, so feel free to correct me, however through some trial and error, this is the change that got it working again for me.

Not able to do the pull request anymore
On Dec 28, 2017 20:31, "Preben Uhrskov Berg"<EMAIL_ADDRESS>wrote:
@tdewin https://github.com/tdewin Are you entirely unable to pull the
repository, or do you mean unable to merge the PR? Just want to ensure
there isn’t an issue with the repository itself.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/VeeamHub/SuperEdit/pull/3#issuecomment-354344074, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ALAKEl1Lx8FZkdWDuGZdvqXwTXwmf4Z0ks5tE-yCgaJpZM4ROLy8
.

Sorry if I shouldn't have merged it. Are you able to clone a new version of the repository, make the change and create a new pull request?
On Fri, Dec 29, 2017 at 4:32 PM +0700, "tdewin" <notifications<EMAIL_ADDRESS>wrote:
Not able to do the pull request anymore
On Dec 28, 2017 20:31, "Preben Uhrskov Berg"<EMAIL_ADDRESS>wrote:
@tdewin https://github.com/tdewin Are you entirely unable to pull the
repository, or do you mean unable to merge the PR? Just want to ensure
there isn't an issue with the repository itself.

You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/VeeamHub/SuperEdit/pull/3#issuecomment-354344074, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ALAKEl1Lx8FZkdWDuGZdvqXwTXwmf4Z0ks5tE-yCgaJpZM4ROLy8
.

You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHubhttps://github.com/VeeamHub/SuperEdit/pull/3#issuecomment-354421829, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ASg60RNvN7yz89YZZ5p2zkTvwismQPb1ks5tFLGhgaJpZM4ROLy8.


Resulted prediction cannot be opened in Slicer

Hello, I tried to predict labels on my custom dataset and Dice score looks normal however resulted mask cannot be open in Slicer and it is not showing some mask. Can you help me ?

Maybe you should upload the results to help the debug? Currently, the output should be a 128128128 nifti file that can be opened with any software which supports .nii.gz.


Discovering the position id of a new LP position created with pcli is high friction

When creating an lp position with pcli tx lp order buy, you get a transaction_hex back but a more typical workflow would be to either monitor the position with pcli query dex position or with the dex explorer.
To do that step, you need your position id. My current workflow is to call pcli view balance and look all my open position_nfts to find the one that was created.
Describe the solution you'd like
It would be useful to either have a position specific view that would basically show richer information about all open positions and/or it would be useful to have the pcli tx lp order buy/sell commands return a position_id.

One very low effort improvement is that the command should print out the position ID before submitting the TX

Resolved in https://github.com/penumbra-zone/penumbra/pull/4798, for now


Feature: Custom names for tools installed via backends

I have installed various go packages via the fantastic mise backends feature. I love it.
But the one thing that is annoying about it is the name that the tools receive.
e.g. mise install go:github.com/go-task/task/v3/cmd/task@latest results in it being installed to .local/share/mise/installs/go-github-com-go-task-task-v3-cmd-task, which I suppose is fine.
More annoying is that we have to use mise use go:github.com/go-task/task/v3/cmd/task. Extremely verbose.
Yet, once it has been mise use'd, we can just run task --help in the CLI.
So, it would be great if there were a name option, such as mise install --name <NAME> [tool@version] or even requirement mise install [NAME] [tool@version]
which would result in something like mise use go:task rather than mise use go:github.com/go-task/task/v3/cmd/task. Even better would be if we could omit the backend prefix so that it is just mise use task.
A rename mechanism/command would be good as well, in case we want to change it later. It should also work if we manually rename the tool's directory, entry in .mise.backend.json and use in mise.toml files
Or, best of all, if the tool could just automatically take the name of the binary - as is the case with built-in and asdf plugins - then perhaps none of this would be necessary (but still might be useful)!

aliases handle this use-case now

I would just do the reverse, add the alias then do mise use -g stringer. I should soon have support for modifying the aliases via the CLI but that's not here yet.


Translate tasks/debug-application-cluster/debug-stateful-set/ in Japanese

This is a Feature Request

What would you like to be added

Translate tasks/debug-application-cluster/debug-stateful-set/ in Japanese.
Why is this needed
This document is not translated in Japanese.
Comments

Copy a file from en contents to content/ja/docs/tasks/debug-application-cluster/debug-stateful-set.md and translate it into Japanese.
/language ja

/assign

/close


Implementation of Credential Status List 2021

Fixes #51
also normalized import statements

There is an error in the revocation list spec, it's non-blocking and I've opened up an issue + corresponding PR: https://github.com/w3c-ccg/vc-status-list-2021/issues/27


[iOS] Image picker's pickVideo with ImageSource.gallery crashes on flutter 3.13.

Is there an existing issue for this?

[X] I have searched the existing issues
[X] I have read the guide to filing a bug

Steps to reproduce
This template does not have a place to put some description so I'll do it here instead.
Since updating to stable 3.13 we started getting reports of people not being able to upload videos because the app would crash. It only started happening in version 3.13.
Tried downgrading to 3.10.6 and there's no issue there.
Running 3.13 with --no-enable-impeller works fine and app does not crash so it seems to be related to impeller.
Tried latest master 3.14.0-13.0.pre.71 and no crash either. Meaning it was probably fixed in 3.14 and I think it should be cherry picked into stable as it's pretty important.

Setup image picker package
Call ImagePicker().pickVideo(source: ImageSource.gallery)

Expected results
Video picker is shown
Actual results
App crashes
Code sample
Code sample
import 'package:flutter/material.dart';
import 'package:image_picker/image_picker.dart';

void main() {
  runApp(const MyApp());
}

class MyApp extends StatelessWidget {
  const MyApp({super.key});

  @override
  Widget build(BuildContext context) {
    return MaterialApp(
      home: Scaffold(
        appBar: AppBar(title: const Text('Image picker crash')),
        body: Center(
          child: TextButton(
            child: const Text('Open picker'),
            onPressed: () {
              ImagePicker().pickVideo(source: ImageSource.gallery);
            },
          ),
        ),
      ),
    );
  }
}

Screenshots or Video
No response
Logs
Logs
*** Terminating app due to uncaught exception 'NSInternalInconsistencyException', reason: 'Modifications to the layout engine must not be performed from a background thread after it has been accessed from the main thread.'
*** First throw call stack:
(0x1a3dd05e0 0x19c12bc00 0x1c3ff07ac 0x1c3ff6bc0 0x1c3ff68d4 0x1c3ff6660 0x1a5f293f0 0x1a5f27b40 0x1a5340924 0x1a53404ac 0x1a53469e8 0x1a533fcd8 0x1a533f980 0x1a3d191dc 0x1a3d17be4 0x1a3d17300 0x1a3d16e18 0x104394134 0x104392cd8 0x20bc124d4 0x20bc11a10)
libc++abi: terminating due to uncaught exception of type NSException
Unsupported layout off the main thread for UITextEffectsWindow with no associated or ancestor view controller

Flutter Doctor output
Doctor output
Doctor summary (to see all details, run flutter doctor -v):
[✓] Flutter (Channel stable, 3.13.2, on macOS 14.0 23A5328b darwin-arm64, locale en-US)
[✓] Android toolchain - develop for Android devices (Android SDK version 33.0.2)
[✓] Xcode - develop for iOS and macOS (Xcode 15.0)
[✓] Chrome - develop for the web
[!] Android Studio (version unknown)
    ✗ Unable to determine Android Studio version.
[✓] Android Studio (version 2022.2)
[✓] VS Code (version 1.81.1)
[✓] VS Code (version 1.82.0-insider)
[✓] Connected device (3 available)
[✓] Network resources

Hi @mattermoran. Thanks for filing this. This has been fixed on the master channel, you can follow up on the replies here https://github.com/flutter/flutter/issues/133147#issuecomment-1699539686 for updates.
Closing this as fixed. Thank you!

Ah I must be pretty bad at searching existing issues, sorry and cheers!


feat(RELEASE-1191): diferentiate pyxis and umb in signing part1

This commit modifies the simple-signing-pipeline and its tasks to use separate credentials for Pyxis and UMB authentication. Prior to this commit, both were pulled from the same configMap values so it was impossible to use stage for one system and prod for the other.
Because e2e uses the simple-signing-pipeline on the stage sre cluster vs a git resolver (for now), the request-and-upload-signature changes can't be part of this commit, nor can the older parameters be removed from the simple-signing-pipeline just yet.

/retest

This will break e2e until https://github.com/konflux-ci/release-service-catalog/pull/729 is merged, but this has to be merged first, so it kind of have to be merge this, rebase 729, merge 729, all in as short a time as possible

/retest

OK, so it seems it did break e2e. From Jing:
ERROR: At least one InternalRequest failed Conditions: simple-signing-pipeline-5tbvw: [{"lastTransitionTime":"2024-12-10T03:18:05Z","message":"[User error] Validation failed for pipelinerun internalrequest-dcl8h with error invalid input params for task request-and-upload-signature: missing values for these params which have no default values: [ssl_cert_secret_name ssl_cert_file_name ssl_key_file_name]","reason":"Failed","status":"False","type":"Succeeded"}] Result: failure [FAILED] in [It] - /tmp/tmp.zyYX5RnobX/tests/release/pipelines/fbc_release.go:304 @ 12/10/24 03:19:18.781

The followup PR https://github.com/konflux-ci/release-service-catalog/pull/729 does fix this.


Too bad save all files, it made another each file incorrect content

VSCode Version: Code 1.9.1 (f9d0c687ff2ea7aabd85fb9a43129117c0ecf519, 2017-02-09T00:26:45.394Z)
OS Version: Windows_NT ia32 6.3.9600
Extensions:

Extension
Author
Version

angular-material-snippets
4tron
0.3.1

html-snippets
abusaidm
0.0.18

vscode-javascript-snippet-pack
akamud
0.1.5

angular1-code-snippets
alexandersage
0.0.3

html-class-suggestions
AndersEAndersen
1.0.3

jsrefactor
cmstead
0.5.3

Angular1
johnpapa
0.1.16

goto-last-edit-location
krizzdewizz
0.2.1

vscode-JS-CSS-HTML-formatter
lonefy
0.2.2

vscode-duplicate
mrmlnc
1.0.2

js-atom-grammar
ms-vscode
0.1.12

joinlines
webdokkeren
1.1.1

change-case
wmaurer
1.0.0

too bad save all files,it made another each file incorrect content

Steps to Reproduce:
1.open file more than one file, make some content has change each file
2. Click File > Save All ..

@bunditng I would appreciate if you could answer my comment in https://github.com/Microsoft/vscode/issues/19356


Vickel: Watch pixaflip.com

Vickel requests the watch of the watch_keyword pixaflip\.com. See the MS search here and the Stack Exchange search in text, in URLs, and in code.

pixaflip\.com has been seen in 0 true positives, 0 false positives, and 0 NAAs.

Approved by Spevacus in Charcoal HQ


Move required-tasks to their own file

Marked as draft until https://github.com/hacbs-contract/ec-cli/pull/522 is merged and there's a snapshot release from it.

Codecov Report

Merging #388 (c961322) into main (8ae78cb) will not change coverage.
The diff coverage is 100.00%.

Additional details and impacted files

@@            Coverage Diff            @@
##              main      #388   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files           67        67
  Lines         1831      1838    +7
=========================================
+ Hits          1831      1838    +7

Impacted Files
Coverage Δ

policy/lib/tekton/pipeline.rego
100.00% <ø> (ø)

policy/pipeline/required_tasks.rego
100.00% <100.00%> (ø)

policy/pipeline/required_tasks_test.rego
100.00% <100.00%> (ø)