IBMApiErrors when running Batch/Parallel experiments with auto saving

Informations

Qiskit Experiments version: 6a732f4
qiskit-ibm-experiment version: 0.3.1
Python version: 3.10.10
Operating system: Mac OS

What is the current behavior?
Many IBMApiErrors show up when running a Batch experiment of T1 and T2Hahn with auto_save=True.
Example error message:
qiskit_ibm_experiment.exceptions.IBMApiError: 'Failed to process the request: The server responded with \'400 Client Error: Bad Request for url: https://resultsdb.quantum-computing.ibm.com/experiments/ec72a8b6-1865-4439-8f69-a2b24cc9c0b0. {"errors":["Invalid fields: parent_experiment_uuid"]}\''

Strangely, the experiment data seems to be stored correctly even though we see the above errors. That means I succeeded to load the experiment from sever data by ExperimentData.load(exp_data.experiment_id, provider=provider).
Steps to reproduce the problem
Run the code below.
import numpy as np
from qiskit_experiments.framework import ExperimentData, BatchExperiment
from qiskit_experiments.library import T1, T2Hahn
from qiskit_ibm_provider import IBMProvider

provider = IBMProvider()
backend = provider.get_backend("ibm_wellington")
exp1 = T1(physical_qubits=[2], delays=np.arange(1e-6, 6e-4, 5e-5))
exp2 = T2Hahn(physical_qubits=[2], delays=np.arange(1e-6, 6e-4, 5e-5))
exp = BatchExperiment([exp1, exp2])
exp_data = exp.run(backend, shots=1000)
exp_data.auto_save = True
exp_data.block_for_results()

I saw the same errors with ParallelExperiment with T1s as well.
What is the expected behavior?
No errors should show up with the above code.
Note: This might be a bug in qiskit-ibm-experiment.

This is a harmless bug resulting from a potentially serious issue in qiskit-ibm-experiment that I just fixed, and a problematic behavior in qiskit-experiment of setting auto saves:

When qiskit-ibm-experiment filters out unused keywords when doing an update API request, it should remove the parent_experiment_uuid field, if present. Up until now, it did not do it; I fixed it now in here.
When setting auto_save from False to True, the experiment saves itself (and so it saves its sub-experiments). Afterwards it sets the auto_save of its children to True, triggering another save. This additional save caused the update error, which explains why everything was stored correctly.

We should decide on how to fix the auto_save behavior before closing this issue.

Originally setting auto_save to True didn't affect the children. We counted on it. This was changed in #812.

The situation that was in the past is actually not clear to me. The old code seems to indicate that auto_save of children was set, only without re-saving; while Chris' comment implies that it was not.

This should be fixed by #1187.


Intern entity ID strings and Identifiers, log more

Intern them so that we don't end up with many instances of entity IDs and identifiers that actually have the same value.

Simply limiting the number of candidates we keep is a much more effective way to bound memory usage


Add a blog/docs about supported iso's / direction to release note documentation

ISO distributions --- boot2docker based on Debian (sic)
ping @ehazlett can you make sure this issue description is correct.   We should add this statement to the release notes as well

@moxiegirl Not sure about this one.
Seems probably too old, but I don't want to close it without your opinion.


Add link to ETCD/JDBC Registry Guideline

Purpose of the pull request
Add link to ETCD/JDBC Registry Guideline
fix https://github.com/apache/dolphinscheduler/issues/15591
Brief change log

Verify this pull request

This pull request is code cleanup without any test coverage.
(or)
This pull request is already covered by existing tests, such as (please describe tests).
(or)
This change added tests and can be verified as follows:

(or)
If your pull request contain incompatible change, you should also add it to docs/docs/en/guide/upgrede/incompatible.md

Thanks, Done.

I change the milestone to 3.2.2.


📰 add winston to enable improved logging (#27)

This PR adds the winston logger to Malcolm. For now, it only logs to the terminal, but we should add file loggers for network traffic and errors for improved debugging.
I chose winston instead of pino because pino appears to queue up logs which can be displayed out of order. For example, logs describing sudo prompt input would be displayed after the password prompt.

Explicit list of changes:

ℹ added note in README about not using turbo for running malcolm
🆕 added winston for logging
🆕 created Logger "instance" which mimics singleton pattern

🤩 switched all console.log statements to logger.info

NOOOOOOOO MY QUALITY FAILED!

Example output:

Actually when I first thought about this it was according to spec and the spec is wrong but Chrome and Firefox do it differently, should we use a compat flag?


Update highlight.js example to latest version

Highlight.js has evolved quite a bit since it this doc was written. Updating the example to the latest 9.6 version of Highlight JS hosted by cloudflare

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.

Hello @
thank you for submitting this update. I've merged your contribution as 6eff9e501534dfa952b059f446faf9eff097aef7 (master) and 1d97723e77a3d522768629b44a6073e8790bd7b7 (v0.16.docs).
Cheers,
Digitalcraftsman

@digitalcraftsman thank you appreciated,


How to solve this problem

E/flutter ( 8322): [ERROR:flutter/runtime/dart_vm_initializer.cc(41)] Unhandled Exception: Connection timed out
E/flutter ( 8322): #0      IOClient.send (package:http/src/io_client.dart:94:7)
E/flutter ( 8322):
E/flutter ( 8322): #1      BaseClient._sendUnstreamed (package:http/src/base_client.dart:93:32)
E/flutter ( 8322):
E/flutter ( 8322): #2      RemotePopularCategoryService.get (package:my_grocery/service/remote_service/remote_popular_category_service.dart:9:20)
E/flutter ( 8322):
E/flutter ( 8322): #3      HomeController.getPopularCategories (package:my_grocery/controller/home_controller.dart:40:20)
E/flutter ( 8322):
E/flutter ( 8322):
E/flutter ( 8322): [ERROR:flutter/runtime/dart_vm_initializer.cc(41)] Unhandled Exception: Connection timed out
E/flutter ( 8322): #0      IOClient.send (package:http/src/io_client.dart:94:7)
E/flutter ( 8322):
E/flutter ( 8322): #1      BaseClient._sendUnstreamed (package:http/src/base_client.dart:93:32)
E/flutter ( 8322):
E/flutter ( 8322): #2      RemoteBannerService.get (package:my_grocery/service/remote_service/remote_banner_service.dart:9:20)
E/flutter ( 8322):
E/flutter ( 8322): #3      HomeController.getAdBanners (package:my_grocery/controller/home_controller.dart:28:20)
E/flutter ( 8322):
E/flutter ( 8322):

@manimal001 it appears that the server you are trying to connect to from the application is not responding to your request. You need to first figure if the server is up and functional, you could do that by pinging the server or trying the same http request from a browser to see if that is functional.
From the exception trace you have provided it does not appear to be a problem with Flutter or Dart.


cleanup: Drop labels from containerdisks

What this PR does / why we need it:
Since ENV variables were chosen as the way forward to decorate containerdisks with appropriate default instancetypes and preferences the labels are dropped from the built containerdisks.
Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #
Special notes for your reviewer:
Release note:

Labels are dropped from containerdisks, only env variables are kept to decorate images.

@codingben Right, renamed it to just EnvVariables.

/approve


Add InfluxDB v2 Compatibility

I've created a secondary script does exactly the same as veeam_enterprisemanager.sh except it authenticates with and POSTs to InfluxBD v2's /api/v2/write endpoint instead of InfluxDB v1's /write endpoint.
I'd also be happy to merge this functionality into the main script and simple add a switch to use the v1 or v2 API, but I felt this kept it somewhat more simple.
Let me know what you think!

Thank you so much for this amazing work! It will help a lot of people who transitioned to InfluxDB v2.0. Would you mind pushing it as well to the VeeamHub?

Thank you so much for this amazing work! It will help a lot of people who transitioned to InfluxDB v2.0.

No problem. I moved this morning and suddenly realised Veeam wasn't updating, so I set to work 😀

Would you mind pushing it as well to the VeeamHub?

No problem, will do shortly 👍


install extension is slow (needs caching?)

Invoking the command ext install repeatedly is really slow.
When you invoke the command, a little blue line scrolls horizontally to show it's doing something (fetching the extension database?), and eventually displays a list of extensions you can install. Repeatedly invoking the command should cache this work from last time, but it seems to re-fetch (or whatever it's doing) every time, which is fairly annoying when I want to install a few extensions at once.

We improved this for 0.10.5. @joaomoreno fyi

I'm on 0.10.5. Can't comment on whether it's improved from prior versions, but it's still not 'fast'.

Duplicate of #439

Umm, was this actually fixed? That other big was closed before I reported this one.
That fix was already made available in 0.10.5, I'm reporting on the state post-release of that prior fix. This bug is intended to represent that further work is required.

Note that #439 is not closed.


update Ingress API version in the examples.

There are a few code examples (i.e here) in the cert-manager website that use the extensions/v1beta1 API which is deprecated.
We should update the examples to use networking.k8s.io/v1 instead and make sure they work with the new API (for example ingress.spec.rules.http.paths.backend.serviceName is now ingress.spec.rules.http.paths.backend.service.name)
Could check for other deprecated APIs too.

/good-first-issue

I would like to try this Issue.

Hi @adedejisalim ,
Glad you are interested in contributing!
Let us know if you have any questions and feel free to /assign yourself to this 😄

This has now been implemented by #472  and #476.


Downloading Feature group does not download all features.

I have a feature group with 64 features, but when I try and download it, excel only shows 24 features.

PATRIC_genome_feature-45.xlsx

I was trying to download 2 feature groups in succession and it keeps giving me the first one over and over again.


same ksql_streams_state_dir set two diffrent mode

ksql task conflict
same ksql_streams_state_dir set two diffrent mode, the first is line38 mode=0755, the second is line68 mode=0750

name: Set Ksql streams dir permissions
file:
path: "{{ksql.properties['ksql.streams.state.dir']}}"
owner: "{{ksql_user}}"
group: "{{ksql_group}}"
state: directory
mode: 0755  #line38

name: Change streams directory ownership
file:
path: "{{ksql_streams_state_dir}}"
owner: "{{ksql_user}}"
group: "{{ksql_group}}"
state: directory
mode: 0750

@xiaobao623 Thanks for the report, will investigate this.  Can you confirm the exact impact it's having on your installation?  Are you seeing any undesired behaviour?  This will help us prioritise.
Thanks again for the feedback!

I'm not sure this would cause an error as the higher-order bits are the same... Does seem redundant, though, and 750 makes sense if you don't want others to be able to read that dir

There no impact install, and work fine. Only show changed info every time when I run the playbook.

Hi @xiaobao623  we have now resolved this in the following PR, on the 5.5.0-post branch.  It was redundant so we removed the second file permission setting task.
https://github.com/confluentinc/cp-ansible/pull/265

This can be closed because pr 265 has been merged


what language are the released zip/tgz files in ?

Am I missing something?
zstr.zip/tgz  doesn't seem to be cpp since some if not most the logical operators have been translated to their lexical counterparts, thus rendering the lib useless for use in e.g. vcpkg:
Example from near the beginning of strict_fstream.hpp
.....
line 63                res += (not res.empty()? "|" : "");
line 72        if ((mode & std::ios_base::trunc) and not (mode & std::ios_base::out))
...
and lot's more

As far as I see, this is still valid C++ code. The keyword-like forms of these operators (their "lexical" form) is totally fine: https://en.cppreference.com/w/cpp/language/operator_logical
So, the issue then might be that vcpkg does not implement the standard correctly, it seems.

Seriously?, Which c++ compiler compiles that? maybe you could give me an example?
And why is the actual source code (not the one in the zip package) proper c++?
Thx,

These alternative keywords actually come from ancient C, when not all keyboards were guaranteed to have &, |, etc. See this discussion: https://stackoverflow.com/questions/2376448/the-written-versions-of-the-logical-operators
So, it should work with all compilers. I just tested the zlib code with gcc and clang, works fine.
As for why that is used in the zip package - I don't know, not my code. We'd have to wait for response from @mateidavid
Fun side note: Because these tokens are absolutely identical to their normal counterparts, you can also use and instead of && as an r-value reference:
void my_weird_function( std::vector<std::string> and vec )
{
    std::cout << vec.size() << "\n";
}

But please don't do this ;-)

Wow
This is creepy and unreadable and at least msvc doesn't like it.
have to stop using that.

Latest release seems to have this issue fixed:
res += (! res.empty()? "|" : "");
if ((mode & std::ios_base::trunc) && ! (mode & std::ios_base::out))


Source of repackaged code

When someone is publishing a NuGet package that contains code from other sources for the sole purpose of making it publicly available on NuGet.org, should the source be the repo where the NuGet package comes from or the source of the package contents?
A recent example is some packages that were published from http://nugetpackages.codeplex.com. Some do include custom scripts (e.g. jQuery), but others are just copies of other libraries (e.g. yepnope, gRaphael).

@capfei Is this case covered in our curation principles document? https://docs.google.com/document/d/13o45CNtxo_Ca234x0NvyIVHiYQu_di1dJtmqQp769mU/edit#heading=h.x5ywe85q0ycj
If not, can we plan to put this on the agenda to discuss in the meeting next week?

@capfei - is this ready to close?


Add support for argon2id digest

Add support for argon2id digest, if libsodium >= 1.0.13.
Note: for libsodium >= 1.0.15, the default digest algorithm for argon2
changed from argon2i to argon2id.
This means RbNaCl::PasswordHash.argon2() will produce different results
depending on which libsodium you have installed.
You should now use RbNaCl::PasswordHash.argon2i() or
RbNaCl::PasswordHash.argon2id() instead.
RbNaCl::PasswordHash.argon_str() is unaffected.

bump

Sorry, I have been very busy lately and have not had time to review these

slow and steady wins the race

bump :man_shrugging:

Will review soon, sorry

@elijh this looks good to me... mind rebasing your branch?

@tarcieri done, thanks :tada:

Will try to do another release relatively soon. There are a few changes in the works.
It might be a good opportunity to also completely revamp the way how rbnacl-libsodium works.


Create Woman_info model and serializers

This help doctors to fill pregnant women information. The table has the following fields: user, pregnant_times, children_number, pregnant_date, expected_birth_date and status with 2 choice(not pregnant and pregnant).

 Woman_info Model


@autobind in src/components/todoItem throws errror

Please provide a description when you file issues

Glad to hear it's fixed :)


[SR-1901] Use final to prevent linker errors

In the discussion on SR-1901, one potential workaround was mentioned: mark internal variables as final. This works for attributes that are not "public get, private set" -- let's try it out.

@swift-ci please test

@swift-ci please test Linux

Wow, it worked! @briancroom, @mike-ferris-apple how about we merge this to reduce the amount of "overexposed" API in XCTest, at least until SR-1901 is resolved?

Definitely good to not have to mark stuff public that is not. I'd say merge it.

Very nice, I wish we had been aware of this workaround sooner! Thanks for putting this out there, @modocache.


Introduce 'exclude_tags'

What does this PR do?
Adds the skip_tags option to be used in the same manner as filter_tags.
How should this be tested?
Specify the skip_tags variable when running openshift_applier against an inventory which has tags set, verify that no objects with the given tag were applied. You can also verify that the filter_tags option still works along with neither option.
Is there a relevant Issue open for this?
resolves #118
Who would you like to review this?
cc: @redhat-cop/openshift-applier

+1 to both things that @oybed said, also i created #127 to change that variable name from filter_tags to include_tags :smile:

Also, please fix the error found by the CI job:
--> Executing Yamllint on files found in /home/travis/build/redhat-cop/openshift-applier/...
    /home/travis/build/redhat-cop/openshift-applier/roles/openshift-applier/tasks/error-on-unsupported.yml
      26:39     error    no new line character at the end of file  (new-line-at-end-of-file)

@oybed where are we with this?

@etsauer I'll sync with @bvkin to check status and get it done

@oybed @etsauer I think it's done, but could probably use another review as I made a lot of changes to handle overlapping include_tags  and exclude_tags.

Yes, let's do a (final) review today when we get a chance to sync. Noticed a few things that still need some work, but we should be able to get it done quickly.

CI passed - merging.


Constructor arguments and function names can clash

actor Foo
  var _offset: U64

  new create(offset: U64) =>
    _offset = offset

  fun offset(): U64 =>
    _offset

should compile but instead produces the error
/private/tmp/foo.pony:4:14: can't reuse name 'offset'
  new create(offset: U64) =>
             ^
/private/tmp/foo.pony:7:3: previous use of 'offset'
  fun offset(): U64 =>

This is not a bug, but deliberate behaviour.
Most languages allow name shadowing, but Pony does not because shadowing leads to bugs. If a name in a given context could be interpreted as 2 different things then it's very easy for the programmer to accidentally think it's the wrong one. That causes bugs.
So in Pony you can't declare something to be a name that is already in scope. This includes local variables and parameters.
In your example, create could legitimately call the function offset, so also using that as the name of a parameter is a clash and hence illegal.


ERROR: Could not consume arg: val

Describe the issue
While running: https://colab.research.google.com/drive/1z_0zpvcJ11AaClAgRUcytzFYHy237fog?usp=sharing
i am getting error:
!python /content/BakLLaVA/scripts/convert_sqa_to_llava.py \
    convert_to_llava \
    --base-dir /content/ScienceQA/tools/ScienceQA/data/scienceqa \
    --prompt-format "QCM-LEA" \
    --split {train,val,minival,test,minitest}

gives me:

Number of samples: 12726
ERROR: Could not consume arg: val
Usage: convert_sqa_to_llava.py convert_to_llava --base-dir /content/ScienceQA/tools/ScienceQA/data/scienceqa --prompt-format QCM-LEA --split train -
For detailed information on this command, run:
convert_sqa_to_llava.py convert_to_llava --base-dir /content/ScienceQA/tools/ScienceQA/data/scienceqa --prompt-format QCM-LEA --split train - --help

I meet the same error, how you solve it?

+1

Instead of the original one-time split all kinds of data (--split{train,val,minival,test,minitest}) command line, try split one kind of data at a time (--split train, --split val.....) And in this case, you should enter the command line 5 times.

+1

Instead of the original one-time split all kinds of data (--split{train,val,minival,test,minitest}) command line, try split one kind of data at a time (--split train, --split val.....) And in this case, you should enter the command line 5 times.


loadgen: Pre-allocate logging entries.

Pre-allocates 1024 logging entries per thread.
Adds warning mechanism to Logger.
Prints warning if a thread exceeds the pre-allocated
entries.
Clang-format and small clean ups.

@guschmue : Can you take a look at this patch?
It passes the existing unit tests on my machine and properly logs logging allocations when I force the pre-allocated size to be very small.

getting to in today.


Determine how client upgradability should be handled

Summary
We need to determine how client upgradability should be handled on the Sovereign SDK rollups. Currently, there is no consensus or governance mechanism with the rollup. We must decide who should have the upgrade authority. Is it acceptable to have a centralized mechanism for this, or should a decentralized mechanism be considered?

Reply we got:
"Currently, Sovereign SDK does not support any upgrade mechanism. They may add an on-chain governance module at some point - but probably not in the short term. "


Remove - in module name

current workaround:
https://stackoverflow.com/questions/7583652/python-module-with-a-dash-or-hyphen-in-its-name

Thanks. Well spotted.

Thanks. Well spotted.


Implement converting to map with two functions (key and value mappers)

Fix #1445

TravisCI stuck again

That looks very nice, thank you!


Global Variable used in Custom Script doesn't show up in Variable Uses list

Describe the bug
When you check where a global variable is used in your project, by clicking on the variable and looking at the Variable Uses list, you won't see any variable use from Custom Scripts.
To Reproduce
Steps to reproduce the behavior:

Create a global variable foo.
Create a Custom Script set foo that sets foo to a value.
Click on the foo variable and look on the right side at the Variable Uses list.

Observed behavior
The Variable Uses list says "Variable hasn't been used in project".
Expected behavior
The set foo Custom Script should be listed in the Variable Uses list.
Platform (please complete the following information):

OS: macOS 14.6.1 (23G93)
App version 4.0.2

Confirmed that this bug was fixed in v4.1.


ARROW-5274: [JavaScript] Wrong array type for countBy

Counting array type by size of indices, not dictionary.
JIRA link:

Codecov Report

Merging #4265 into master will increase coverage by 1.91%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master    #4265      +/-   ##
==========================================
+ Coverage   88.43%   90.34%   +1.91%
==========================================
  Files         765       74     -691
  Lines       94838     5456   -89382
  Branches     1251     1251
==========================================
- Hits        83866     4929   -78937
+ Misses      10736      519   -10217
+ Partials      236        8     -228

Impacted Files
Coverage Δ

js/src/compute/dataframe.ts
92.15% <100%> (ø)
:arrow_up:

js/src/ipc/metadata/message.ts
92.99% <0%> (-1.28%)
:arrow_down:

js/src/schema.ts
88.77% <0%> (-1.03%)
:arrow_down:

js/src/data.ts
87.87% <0%> (ø)
:arrow_up:

python/pyarrow/ipc.pxi

cpp/src/arrow/csv/chunker-test.cc

cpp/src/parquet/column_page.h

cpp/src/parquet/bloom_filter-test.cc

cpp/src/arrow/array/builder_decimal.cc

cpp/src/plasma/client.cc

... and 685 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update eef5857...3d6f341. Read the comment docs.

@TheNeuralBit @trxcllnt can one of you take a look?

LGTM :+1:

Thanks for the fix @yngve-sk! This does indeed look like a nasty bug. The intention of this code is to use a bit width wide enough to not overflow even if all the elements in the vector have the same value.


Travis deploy step broken with 401

Impact: Distribution is not attached to the release automatically. Does not impact upload to bintray or release process itself.
https://travis-ci.org/github/qaware/majx/jobs/681611159

Tool used: travis setup releases see https://docs.travis-ci.com/user/deployment/releases/#using-travis-ci-client-to-populate-initial-deployment-configuration


Invalid index file

Hi!
I am currently trying to upload my .bam and .bai mapping files and .fa file on the web app. I keep getting errors saying that the mapping files are invalid. The mapping files have the same name but have a different name than the genome fasta file. I hope to upload more read mapping files from other samples that have mapped to this genome but am unable to because of the invalid file error.
I also wanted to note that the stand alone IGV version is able to upload and view the mapping and fasta files but due to RAM conflicts I am unable to view 2 samples (2.bam files) at a time.
I am happy to send an email containing a .zip file of the mapping and fasta files. (I am unable to upload them here as the file size is large).
Best,
Clarisse

Yes I will need a zip example to look into this, along with a step by step
description of what you are doing.  Be as specific as possible.
BTW technically you are not uploading anything,  the files are loaded
directly into your browser.
On Tue, May 26, 2020 at 4:48 PM cssulliv<EMAIL_ADDRESS>wrote:

Hi!
I am currently trying to upload my .bam and .bai mapping files and .fa
file on the web app. I keep getting errors saying that the mapping files
are invalid. The mapping files have the same name but have a different name
than the genome fasta file. I hope to upload more read mapping files from
other samples that have mapped to this genome but am unable to because of
the invalid file error.
I am happy to send along a .zip of my mapping and fasta files if needed.
Best,
Clarisse
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/igvteam/igv-webapp/issues/141, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAHD2HE7WDNS7JO4R6ULEJLRTRIOBANCNFSM4NLMWQGQ
.


fix(app): home all axes after lw calibration to allow deck access

Overview
After returning the tip used in lw calibration, the gantry remains above the tiprack. This makes
accessing the items on the deck difficult if need be before the run. It is especially confusing in
the case of a TC protocol, as the user is prompted to place the PCR seal on the module, while the
gantry may be physically blocking it. This appends the behavior of the final "return tip" command of
lw calibration to include a "home all axes" command as well.
Closes #4034
Review Requests

[ ] gantry should home when "Return Tip and Proceed to Run" is pressed at the end of lw calibration for basic protocol

[ ] gantry should home when "Return Tip and Proceed to Run" is pressed at the end of lw calibration for protocol that involves the Thermocycler, and you should be prompted to place PCR seal on the TC lid after the home is complete.

The OT-2 also homes at the start of the actual protocol run. Can we skip that now, now that homing is done here? (As long as labware calibration isn't skipped.)

@SyntaxColoring, you're right in saying that homing already occurs at the beginning of the protocol.  We can't assume that users have performed labware calibration so we can't remove that home call. In the case of a user running the protocol right after calibration, the second home will be much quicker as axes will already be near the end stop. Though this is not the ideal sequence of events for the UI, until the RPC session management is rewritten and the calibration UI is updated, this is the least invasive and most secure solution.


0.10 release

What issues need to be resolved before a 0.10 release compatible with ipywidgets 7?
CC @dmadeka, @ssunkara1, @SylvainCorlay.
Also CC @stonebig, who I think is interested in a release soon.

I fail to have bqplot-0.10.0a5 working, so an official 0.10.0 would allow me to know if I'm the problem.
(https://github.com/bloomberg/bqplot/pull/516#issuecomment-326825601 )

I want to get #525, #537 in.

I'd like to get in #480 as well @madridnick

I'd also like to do a review of selectors, I've been seeing some funky behavior with multiple lines and a date scale

hope for a release before september ends ?

Let's hold off on #537 to figure out the design there (whether to use the ipywidgets image widget, or do a new one that integrates possibly better). That leaves #525 and #480.
It looks like #480 is practically done, except for one comment. @madridnick or @ssunkara1 - can one of you make whatever changes needed to merge it, or make a decision that it needs more work and won't be in 0.10?
@rmenegaux - it looks like #525 is about done? @ssunkara1 and @rmenegaux - can you guys look at it if needs any more work, or if we can merge and move on with 0.10?
Otherwise, I think we should just release a 0.10 with what we have, which brings us up to date with ipywidgets 7.0 and solves the tooltip issues. We can always follow up with an 0.11.

in the mean time, still failing to make it work even with  a jupyter.exe  labextension install bqplot-jupyterlab

Otherwise, I think we should just release a 0.10 with what we have, which brings us up to date with ipywidgets 7.0 and solves the tooltip issues.

Talked with @ssunkara1 yesterday, and we decided to move forward with 0.10 to get widgets 7 compatibility, and we can always cut a 0.11 next week with any new merged PRs.

I just released 0.10.0...and realized the release instructions say nothing about checking to make sure the examples have the widgets saved :(. 0.10.1 coming up with that.

Is this the valid procedure to have it working on jupyterlab ?
pip install bqplot
jupyter nbextension enable --py --sys-prefix bqplot

pip install bqplot
jupyter labextension install bqplot-jupyterlab

I'm checking it right now too.

(don't forget to also install the widgets package: jupyter labextension install @jupyter-widgets/jupyterlab-manager)

ah, this one is not on your main github readme

JupyterLab instructions are not in there, right?

apparently, unless I miss my glasses

by the way, shall I do a similar "jupyter.exe nbextension enable --py --sys-prefix bokeh" for bokeh ?

I have no idea about bokeh

@stonebig: https://github.com/bloomberg/bqplot/pull/551

cries of joy: bqplot-0.10.0 works  in jupyterlab !

Me too!


Feature Request: Force Wi-Fi on option or Wi-Fi on/off switch in "Configure Wi-Fi"

Request Summary: Add setting to turn Wi-Fi "on" if "off" when "Configure Wi-Fi" is selected or ad a Wi-Fi on/off switch to "Configure WiFi".
Existing behavior:  "Configure Wi-Fi" does not report the state of the Wi-Fi adapter. If it's off, the UI looks as though it's on, but no SSID's can be discovered. There's no mechanism to turn it on, or ensure it's on.
Feature Request:  First, UI provide feedback that Wi-Fi is "off". But the feature could be addressed in multiple ways.

A setting that automatically turns the Wi-Fi interface "on" if off when accessing "Configure Wi-Fi".
A toggle switch within "Configure Wi-Fi" to turn the WI-Fi interface on/off.
Auto-Enable Wi-Fi when "Configure Wi-Fi" and no wan connected interface are detected.

Any one or a combination of the above would solve the issue of needing an SSO login, but Wi-Fi is off.

I'd like to also request this feature!


Can't create internal route in k8s

Steps:

Create an internal domain cf create-shared-domain apps.internal --internal, see success
Create a route on that domain cf create-route apps.internal --hostname myapp

Observed:
$ cf create-route apps.internal --hostname myapp
Creating route myapp.apps.internal for org o / space s as admin...
Unexpected Response
Response Code: 500
Request ID:    0fc071d8-18f9-4097-8242-cd82ddd85cda::2c438cbb-f9ac-4c20-984a-4eedc518ce50
Code: 0, Title: , Detail: {
  "errors": [
    {
      "title": "UnknownError",
      "detail": "An unknown error occurred.",
      "code": 10001
    }
  ]
}
FAILED

With the following error in the api server:

Click to expand!
{
  "timestamp": "2020-10-23T17:04:02.322706673Z",
  "message": "Started POST \"/v3/routes\" for user: 5c9e857c-3b63-4c16-8850-1b6425c3fff8, ip: <IP_ADDRESS> with vcap-request-id: 233082bb-6b33-49f6-8e3e-c3090b85f603::aeb519d0-5baf-483c-9ce0-35751153da1a at 2020-10-23 17:04:02 UTC",
  "log_level": "info",
  "source": "cc.api",
  "data": {
    "request_guid": "233082bb-6b33-49f6-8e3e-c3090b85f603::aeb519d0-5baf-483c-9ce0-35751153da1a"
  },
  "thread_id":<PHONE_NUMBER>2620,
  "fiber_id":<PHONE_NUMBER>6160,
  "process_id": 1,
  "file": "/workspace/middleware/request_logs.rb",
  "lineno": 28,
  "method": "call"
}
{
  "timestamp": "2020-10-23T17:04:02.343653789Z",
  "message": "Request failed: 500: {\"errors\"=>[{\"title\"=>\"UnknownError\", \"detail\"=>\"An unknown error occurred.\", \"code\"=>10001, \"test_mode_info\"=>{\"detail\"=>\"IPv4 requires (4) octets.\", \"title\"=>\"CF-ValidationError\", \"backtrace\"=>[\"/layers/paketo-buildpacks_bundle-install/gems/gems/netaddr-2.0.4/lib/util.rb:169:in `parse_IPv4'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/netaddr-2.0.4/lib/ipv4.rb:23:in `parse'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/netaddr-2.0.4/lib/ipv4net.rb:37:in `parse'\", \"/workspace/app/models/runtime/route.rb:236:in `internal_route_vip_range'\", \"/workspace/app/models/runtime/route.rb:230:in `internal_route_vip_range_len'\", \"/workspace/app/models/runtime/route.rb:222:in `before_save'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/sequel-5.35.0/lib/sequel/model/base.rb:1759:in `block in _save'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/sequel-5.35.0/lib/sequel/model/base.rb:1019:in `around_save'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/sequel-5.35.0/lib/sequel/model/base.rb:1757:in `_save'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/sequel-5.35.0/lib/sequel/model/base.rb:1469:in `block (2 levels) in save'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/sequel-5.35.0/lib/sequel/model/base.rb:1923:in `block in checked_transaction'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/sequel-5.35.0/lib/sequel/database/transactions.rb:229:in `block in transaction'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/sequel-5.35.0/lib/sequel/connection_pool/threaded.rb:88:in `hold'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/sequel-5.35.0/lib/sequel/database/connecting.rb:270:in `synchronize'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/sequel-5.35.0/lib/sequel/database/transactions.rb:195:in `transaction'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/sequel-5.35.0/lib/sequel/model/base.rb:1923:in `checked_transaction'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/sequel-5.35.0/lib/sequel/model/base.rb:1469:in `block in save'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/sequel-5.35.0/lib/sequel/model/base.rb:1911:in `checked_save_failure'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/sequel-5.35.0/lib/sequel/model/base.rb:1469:in `save'\", \"/workspace/app/actions/route_create.rb:22:in `block in create'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/sequel-5.35.0/lib/sequel/database/transactions.rb:258:in `_transaction'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/sequel-5.35.0/lib/sequel/database/transactions.rb:233:in `block in transaction'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/sequel-5.35.0/lib/sequel/connection_pool/threaded.rb:92:in `hold'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/sequel-5.35.0/lib/sequel/database/connecting.rb:270:in `synchronize'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/sequel-5.35.0/lib/sequel/database/transactions.rb:195:in `transaction'\", \"/workspace/app/actions/route_create.rb:21:in `create'\", \"/workspace/app/controllers/v3/routes_controller.rb:76:in `create'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_controller/metal/basic_implicit_render.rb:6:in `send_action'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/abstract_controller/base.rb:194:in `process_action'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_controller/metal/rendering.rb:30:in `process_action'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/abstract_controller/callbacks.rb:42:in `block in process_action'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/activesupport-<IP_ADDRESS>/lib/active_support/callbacks.rb:132:in `run_callbacks'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/abstract_controller/callbacks.rb:41:in `process_action'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_controller/metal/rescue.rb:22:in `process_action'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_controller/metal/instrumentation.rb:34:in `block in process_action'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/activesupport-<IP_ADDRESS>/lib/active_support/notifications.rb:168:in `block in instrument'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/activesupport-<IP_ADDRESS>/lib/active_support/notifications/instrumenter.rb:23:in `instrument'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/activesupport-<IP_ADDRESS>/lib/active_support/notifications.rb:168:in `instrument'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_controller/metal/instrumentation.rb:32:in `process_action'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_controller/metal/params_wrapper.rb:256:in `process_action'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/abstract_controller/base.rb:134:in `process'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionview-<IP_ADDRESS>/lib/action_view/rendering.rb:32:in `process'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_controller/metal.rb:191:in `dispatch'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_controller/metal.rb:252:in `dispatch'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_dispatch/routing/route_set.rb:52:in `dispatch'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_dispatch/routing/route_set.rb:34:in `serve'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_dispatch/journey/router.rb:52:in `block in serve'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_dispatch/journey/router.rb:35:in `each'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_dispatch/journey/router.rb:35:in `serve'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_dispatch/routing/route_set.rb:840:in `call'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/rack-2.2.3/lib/rack/tempfile_reaper.rb:15:in `call'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_dispatch/http/content_security_policy.rb:18:in `call'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_dispatch/middleware/callbacks.rb:28:in `block in call'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/activesupport-<IP_ADDRESS>/lib/active_support/callbacks.rb:98:in `run_callbacks'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_dispatch/middleware/callbacks.rb:26:in `call'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_dispatch/middleware/debug_exceptions.rb:61:in `call'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_dispatch/middleware/show_exceptions.rb:33:in `call'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_dispatch/middleware/remote_ip.rb:81:in `call'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/rack-2.2.3/lib/rack/runtime.rb:22:in `call'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/activesupport-<IP_ADDRESS>/lib/active_support/cache/strategy/local_cache_middleware.rb:29:in `call'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/actionpack-<IP_ADDRESS>/lib/action_dispatch/middleware/executor.rb:14:in `call'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/rack-2.2.3/lib/rack/sendfile.rb:110:in `call'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/rack-2.2.3/lib/rack/urlmap.rb:74:in `block in call'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/rack-2.2.3/lib/rack/urlmap.rb:58:in `each'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/rack-2.2.3/lib/rack/urlmap.rb:58:in `call'\", \"/workspace/middleware/request_logs.rb:38:in `call'\", \"/workspace/middleware/security_context_setter.rb:19:in `call'\", \"/workspace/middleware/vcap_request_id.rb:15:in `call'\", \"/workspace/middleware/cors.rb:49:in `call_app'\", \"/workspace/middleware/cors.rb:14:in `call'\", \"/workspace/middleware/request_metrics.rb:12:in `call'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/rack-2.2.3/lib/rack/builder.rb:244:in `call'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/thin-1.7.2/lib/thin/connection.rb:86:in `block in pre_process'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/thin-1.7.2/lib/thin/connection.rb:84:in `catch'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/thin-1.7.2/lib/thin/connection.rb:84:in `pre_process'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/thin-1.7.2/lib/thin/connection.rb:50:in `block in process'\", \"/layers/paketo-buildpacks_bundle-install/gems/gems/eventmachine-<IP_ADDRESS>/lib/eventmachine.rb:1067:in `block in spawn_threadpool'\"]}}]}",
  "log_level": "error",
  "source": "cc.api",
  "data": {
    "request_guid": "233082bb-6b33-49f6-8e3e-c3090b85f603::aeb519d0-5baf-483c-9ce0-35751153da1a"
  },
  "thread_id":<PHONE_NUMBER>2620,
  "fiber_id":<PHONE_NUMBER>6160,
  "process_id": 1,
  "file": "/workspace/app/controllers/v3/errors_controller.rb",
  "lineno": 11,
  "method": "internal_error"
}

Expected
The Route resource is written to the kubernetes apiserver. The internal machinery needed to correctly process that resource doesn't exist yet, but it'd be nice to be able to create them 😄
Additional info
@tcdowney says its my fault.

Superficially the error is because we don't configure the internal_route_vip_range property correctly in capi-k8s-release:
https://github.com/cloudfoundry/capi-k8s-release/blob/10aca7a81d08a88df10797608c6a0afd16a10b50/templates/ccng-config.lib.yml#L117
However, since we don't need to reserve and specify a virtual IP for internal routes on Kubernetes, the correct fix is to figure out how to not attempt to reserve one at all. The code pertaining to vips in the route model is what we'd need to take a look at (thank you @XanderStrike for contributing it 🤗 ):
https://github.com/cloudfoundry/cloud_controller_ng/blob/8ee3e0f9a7562a6f12260cd9f33b65262a850733/app/models/runtime/route.rb#L187-L238

closing since cf-for-k8s is no longer under active development


There is a question about MapImageToEngine which is similar to the previous

(My English is not well, please forgive me)
I tried to running uncorn_pe as "uncorn_pe.exe  test.exe -disasm" under the DEBUG mode，but when I step to
ctx->MapImageToEngine(modInfo.name, (PVOID)modInfo.baseAddress, modInfo.size, modInfo.baseAddress, ((LDR_DATA_TABLE_ENTRY_BASE_T*)(modInfo.ldrPtr))->EntryPoint); (uncorn_pe.cpp ; line: 60)
it crashed. I checked the "watches" and found that the error appeared in "ldrPtr"，because it is a "nullptr".
Is my operation wrong and how could I fix it?
Looking forward to your reply, thanks.

Should be fixed with latest commit e7526f9.


Fail to use zero_init to construct llama2 with deepspeed zero3 and bnb!

System Info
bitsandbytes==0.43.1
sentencepiece==0.1.97
huggingface_hub==0.23.2
accelerate==0.30.1
tokenizers==0.19.1
transformers==4.41.1
trl==0.8.6
peft==0.11.1
datasets==2.14.6

Reproduction
When I run the code, parameters first be fully loaded to each GPU and then be sharded. But after I try to use zero3+lora instead zero3+qlora (just remove bnb_config = BitsAndBytesConfig(...) ), it magically worked! Parameters first shard then load to each GPU!
So I am confused if bitsandbytes doesn't support zero3_init, or there are some errors in my code. I'll really appreciate if someone can help me!
Here is my code refer to https://huggingface.co/docs/peft/accelerate/deepspeed#use-peft-qlora-and-deepspeed-with-zero3-for-finetuning-large-models-on-multiple-gpus and https://huggingface.co/docs/transformers/v4.18.0/en/main_classes/deepspeed#constructing-massive-models:~:text=If you want to use a,is how example scripts are written.:
import os
os.environ['CUDA_VISIBLE_DEVICES'] = '0,1,2,3,4,5,6,7'

from datasets import load_dataset
import torch
from transformers import AutoModelForCausalLM, BitsAndBytesConfig, AutoTokenizer, TrainingArguments
import bitsandbytes as bnb
from peft import LoraConfig
from trl import SFTTrainer

from accelerate import Accelerator
accelerator = Accelerator()

base_model_name ="/home/yangtong/data/llama2-hf/llama2-13b-chat_hf"

dataset = load_dataset("json",data_files="Belle_open_source_0.5M_changed.json",split="train")

result_dir = "tmp"
training_args = TrainingArguments(
    report_to="wandb",
    output_dir=result_dir,
    per_device_train_batch_size=1,
    gradient_accumulation_steps=16,
    learning_rate=2e-4,
    logging_steps=10,
    # max_steps=520,
    num_train_epochs=0.037,
    save_steps=500,
    bf16 = True,
    gradient_checkpointing=True
)

bnb_config = BitsAndBytesConfig(
    load_in_4bit=True,
    bnb_4bit_use_double_quant=True,
    bnb_4bit_quant_type="nf4",
    bnb_4bit_compute_dtype=torch.bfloat16,
    bnb_4bit_quant_storage=torch.bfloat16
)

base_model = AutoModelForCausalLM.from_pretrained(
    base_model_name,
    quantization_config=bnb_config,
    torch_dtype=torch.bfloat16
)
base_model.config.use_cache = False
base_model.config.pretraining_tp = 1

models = ['v_proj', 'gate_proj', 'down_proj', 'k_proj', 'q_proj', 'o_proj', 'up_proj']

peft_config = LoraConfig(
    lora_alpha=16,
    lora_dropout=0.1,
    r=64,
    bias="none",
    task_type="CAUSAL_LM",
    target_modules=models
)

tokenizer = AutoTokenizer.from_pretrained(base_model_name, trust_remote_code=True)
tokenizer.deprecation_warnings["Asking-to-pad-a-fast-tokenizer"] = True
tokenizer.pad_token = tokenizer.eos_token

max_seq_length = 512
trainer = SFTTrainer(
    model=base_model,
    train_dataset=dataset,
    peft_config=peft_config,
    dataset_text_field="text",
    max_seq_length=max_seq_length,
    tokenizer=tokenizer,
    args=training_args
)

trainer.train()

output_dir = os.path.join(result_dir, "final_checkpoint")
trainer.model.save_pretrained(output_dir)
# trainer.save_model(output_dir)  # Stage-3

Here is my accelerate config:
compute_environment: LOCAL_MACHINE
debug: false
deepspeed_config:
  deepspeed_config_file: /home/yangtong/ft_dis/ds_config/3.json
  zero3_init_flag: true
distributed_type: DEEPSPEED
downcast_bf16: 'no'
enable_cpu_affinity: false
machine_rank: 0
main_training_function: main
num_machines: 1
num_processes: 4
rdzv_backend: 'c10d'
same_network: true
tpu_env: []
tpu_use_cluster: false
tpu_use_sudo: false
use_cpu: false

Here is my deepspeedzero3 config:
{
  "optimizer": {
    "type": "AdamW",
    "params": {
        "lr": 2e-4,
        "betas": [
          0.9,
          0.999
        ],
        "eps": "auto",
        "weight_decay": "auto",
        "adam_w_mode": true,
        "torch_adam": true
    }
  },

  "scheduler": {
    "type": "WarmupDecayLR",
    "params": {
        "warmup_min_lr": "auto",
        "warmup_max_lr": "auto",
        "warmup_num_steps": "auto",
        "total_num_steps": "auto"
    }
  },

  "zero_optimization": {
    "stage": 3,
    "allgather_partitions": true,
    "allgather_bucket_size": 2e8,
    "reduce_scatter": true,
    "reduce_bucket_size": 2e8,
    "contiguous_gradients": true,
    "overlap_comm": true,
    "offload_optimizer": {
      "device": "none",
      "pin_memory": true
    },
    "offload_param": {
      "device": "cpu",
      "pin_memory": true
    },
    "sub_group_size": 1e9,
    "stage3_prefetch_bucket_size": "auto",
    "stage3_param_persistence_threshold": "auto",
    "stage3_max_live_parameters": 1e9,
    "stage3_max_reuse_distance": 1e9,
    "stage3_gather_16bit_weights_on_model_save": true
  },
  "bf16": {
    "enabled": true
  },
  "gradient_clipping": "auto",
  "train_batch_size": "auto",
  "train_micro_batch_size_per_gpu": 1,
  "gradient_accumulation_steps": 16,
  "wall_clock_breakdown": false
}

Here is my launcher context:
accelerate launch \
--config_file "config/z3_3.yaml" \
--num_processes 1 \
ft_acc.py

One thing I want to say is in the case of qlora, parameters just be loaded to CPU memory and GPU memory just rise less than 1GB (I also want to know what is it, maybe is the quantization constant?) during from_pretrained(). And when run trainer.train() the parameters fully loaded to each GPU then sharded.
I use the following code and torch.cuda.memory_reserved() added in the source code to measure memory usage. It changes as the size of the model size changes(llama2_7B will take about 0.58GB and llama2_13B will take about 0.80GB).
import os
os.environ['CUDA_VISIBLE_DEVICES'] = '0,1,2,3,4,5,6,7'

from datasets import load_dataset
import torch
from transformers import AutoModelForCausalLM, BitsAndBytesConfig, AutoTokenizer, TrainingArguments
import bitsandbytes as bnb
from peft import LoraConfig
from trl import SFTTrainer

from accelerate import Accelerator
accelerator = Accelerator()

base_model_name ="/home/yangtong/data/llama2-hf/llama2-7b-chat_hf"

dataset = load_dataset("json",data_files="Belle_open_source_0.5M_changed.json",split="train")

result_dir = "tmp"
training_args = TrainingArguments(
    report_to="wandb",
    output_dir=result_dir,
    per_device_train_batch_size=1,
    gradient_accumulation_steps=16,
    learning_rate=2e-4,
    logging_steps=10,
    # max_steps=520,
    num_train_epochs=0.037,
    save_steps=500,
    bf16 = True,
    gradient_checkpointing=True
)

bnb_config = BitsAndBytesConfig(
    load_in_4bit=True,
    bnb_4bit_use_double_quant=True,
    bnb_4bit_quant_type="nf4",
    bnb_4bit_compute_dtype=torch.bfloat16,
    bnb_4bit_quant_storage=torch.bfloat16
)

base_model = AutoModelForCausalLM.from_pretrained(
    base_model_name,
    quantization_config=bnb_config,
    torch_dtype=torch.bfloat16
)
base_model.config.use_cache = False
base_model.config.pretraining_tp = 1

And I also use above code to measure memory used to check if zero_init run successfully. When I use the entire above code, there is only "extra memory" loaded to GPU like the picture below:

When I use the code removing bnb_config, there is correct result(7B sharded to 8 GPUs):

Now the situation is whether with or without lora, bnb will contribute to incorrect result with zero_init but without bnb it will be success. So maybe the fact is bnb prevent zero_init.
@younesbelkada @matthewdouglas @Titus-von-Koeller
Expected behavior
Successfully using zero3_init to construct llama2: parameters first sharded and then loaded to GPUs.

zero3 init doesn't seem to be supported with quantized weights. https://github.com/huggingface/transformers/blob/main/src/transformers/modeling_utils.py#L3773


Update Leap tests to match canonical data in v1.4.0

New test case added as specified in exercism/problem-specifications#1359

Good idea!


Possible incorrect description of the document for Container App with Consumption only.

According to MS official document, it mentioned that Consumption only environment doesn't support user defined routes (UDR).

But I can find out a workaround to support UDR on Consumption only environment by referring to GitHub discussion below,
-https://github.com/microsoft/azure-container-apps/issues/227
if you want to use UDR, you can add a route like this one to bypass Azure cloud traffic, and it works too.

[ASK]
Will Microsoft team update the official documentation to show that certain UDRs are actually supported?
Thank you.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: c1f36e76-357b-28f7-2b59-3e30ca1b2418
Version Independent ID: e724e5f5-0e9b-e99d-3252-42932507984c
Content: Networking in Azure Container Apps environment
Content Source: articles/container-apps/networking.md
Service: container-apps
GitHub Login: @cachai
Microsoft Alias: cachai

@nusliew
Thanks for your feedback! We will investigate and update as appropriate.

Thanks for your feedback and your contribution to Azure docs.
Feedback for this repository is moving away from GitHub to a system specific to the Microsoft Learn platform. Issues for this repository will soon be disabled, and additional comments from GitHub will no longer be possible. However, we are now tracking and triaging this issue in the new feedback system.
To learn more about our feedback systems, please see Provide feedback for Microsoft Learn content.
#please-close


Invalid link?

https://play.golang.org/p/MGbeDwtXN3

Unavailable For Legal Reasons

If you believe this is in error, please file an issue.

Go playground is running on Google's appspot and appspot is blocked by a the firewall of China.
I'll place code directly into text.
Sorry :(

THX!
PS: I get access to this link via VPN in Hong Kong... Everything is fine except this, that's weird...

¯_(ツ)_/¯


I might just be dumb but where do I find the repo

Title says it all x.x

https://raw.githubusercontent.com/FFXIV-CombatReborn/CombatRebornRepo/main/pluginmaster.json

I am dumb and posted this to the wrong thing, I meant for uh, the navmesh

https://puni.sh/api/repository/veyn


Duplicate Files finder using Hashing.

Aim

A script that can find duplicates of a file using its hash value. Then can identify if the files are actually duplicates or not by going through the contents, and then additionally provides a means to delete the duplicate file while keeping the original intact.

Details

Find the hash value.
Find duplicates of files.
Check the content.
Delete the Duplicates.

Go Ahead @vybhav72954


How to register the VirtualCameraMediaSource DLL without the MSI?

I'm trying to register the VirtualCameraMediaSource.dll without using the MSI installer.
Using the MSI, the sample worked very well, but I don't want to use this installer.
I tried to call the regsvr32.exe to register the DLL, but it failed.
Also, based on the README, I tried to add the registry entries manually and it didn't work too.
I created a .reg file exporting the registry entries created by the installer and changed the DLL path to a different path and it also didn't work.
This is my .reg file:
Windows Registry Editor Version 5.00

[HKEY_LOCAL_MACHINE\SOFTWARE\Classes\CLSID\{7B89B92E-FE71-42D0-8A41-E137D06EA184}]
@="VirtualCameraMediaSource"

[HKEY_LOCAL_MACHINE\SOFTWARE\Classes\CLSID\{7B89B92E-FE71-42D0-8A41-E137D06EA184}\InProcServer32]
"ThreadingModel"="Both"
@=""C:\\VirtualCamera\\VirtualCameraMediaSource.dll""

After adding these registry entries, the DLL isn't being loaded. I really don't know the difference between adding from the MSI and manually.
Anyone know how to do it without the MSI? Thanks :)

Hi,
I think following is needed, allow "LOCAL SERVICE" to read & execute the c:\VirtualCamera folder and its content as as this dll is loaded by a Windows service that's running as "LOCAL SERVICE" account. This can be done by right clicking the folder/file -> properties ->security tab -> Edit -> add
Let us know if this works, thanks.

It still doesn't work :(
Before that, I tried to add "everyone" with full control.
I also replaced the child object permissions, so the file has the same permissions:

Ohhh it was my mistake :( I created the .reg file with some extra quotes :( I noticed that after removing the extra quotes in the regedit, it worked:

Sorry about that, I missed an entire day on it :D

Ohhh it was my mistake :( I created the .reg file with some extra quotes :( I noticed that after removing the extra quotes in the regedit, it worked:

Sorry about that, I missed an entire day on it :D

Can you see the virtual camera name in obs after register?

Can you see the virtual camera name in obs after register?

Yes, but after registering the DLL, you need to create at least one virtual camera. To do it, you can run the UWP application that is part of this solution. In the app, you can create one or more virtual cameras, with the name you want. Then, OBS will list all cameras.
OBS: after registering the DLL, it is important to restart the FrameServer service (it usually stops after some minutes of inactivity, so it shouldn't be a problem, unless you are using another camera)

Can you see the virtual camera name in obs after register?

Yes, but after registering the DLL, you need to create at least one virtual camera. To do it, you can run the UWP application that is part of this solution. In the app, you can create one or more virtual cameras, with the name you want. Then, OBS will list all cameras.
OBS: after registering the DLL, it is important to restart the FrameServer service (it usually stops after some minutes of inactivity, so it shouldn't be a problem, unless you are using another camera)

OK,Thank you


html in label?

In version 0.8.4 I can add html to label and it's work fine:
{!! BootForm::text('Price discount','discount_price') !!}
Now (in 0.8.5) it output html with htmlentities as a string.
Any ideas?

Just tagged a release that fixes this:
https://github.com/adamwathan/bootforms/releases/tag/v0.9.0


Could not find the proper steps to setup this repository.

I'm evaluating the capabilities of GENAI in the Robot Framework. Could you provide the steps to set up the repository and an example of how to use the code for generating test data?

Hi @Pratyush2586, what is missing for you in the current readme file to run the library? We are looking to extend our documentation, but it would help us know what exactly is missing. Thanks!

Hello Pratyush, we haven't heard from you in a while so we assume your issue has been fixed. If you are stilling experiencing problems, please create a new issue.


On web : cannot read properties of undefined (reading 'idName')

I use a method to clear my database it works fine on Linux on both (release/debug) builds but on web version (both release/debug) builds it throws an exception (browser: Google Chrome) :
Uncaught (in promise) TypeError: Cannot read properties of undefined (reading 'idName')
    at getId (collection.ts:67:30)
    at Array.map (<anonymous>)
    at query.ts:211:32

Full log :
trace.log
Maybe my code causes this error.
The method :
Future<void> deleteAllItems() async {
    await _isar.writeTxn(
      (isar) async {
        await isar.isarFormFields.buildQuery().deleteAll();
      },
    );
    await _isar.writeTxn(
      (isar) async {
        await isar.isarFormModels.buildQuery().deleteAll();
      },
    );
  }

Field Model :
@Collection()
class IsarFormField extends FormFieldModel with EquatableMixin {
  @override
  @FieldTypeConverter()
  FieldType type;
  IsarFormField({
    required super.id,
    super.key = '',
    required super.index,
    this.type = FieldType.int,
    super.label = '',
    super.hint = '',
    super.error = '',
    super.isValid = '',
  });
}

Form Model :
@Collection()
class IsarFormModel extends FormModel {
  IsarLinks<IsarFormField> isarFields = IsarLinks<IsarFormField>();
  IsarFormModel({
    required super.id,
    required super.index,
    super.title = '',
    super.description = '',
    Set<IsarFormField> fields = const {},
  }) {
    isarFields.addAll(fields);
  }
}

Sorry I forgot to mention the versions
Tested on Isar both ^2.5.0 and ^3.0.0-dev.0

Flutter debug log output (on Isar ^3.0.0):
TypeError: Cannot read properties of undefined (reading 'idName')
    at getId (https://unpkg.com/isar@2.5.0/dist/index.js:1:6644)
    at Array.map (<anonymous>)
    at https://unpkg.com/isar@2.5.0/dist/index.js:1:25878

link to<EMAIL_ADDRESS>

This is the repo if you want to reproduce the error

I've added a branch name independent for you to test I use a local package in main branch

Fixed in 3.0.0-dev.2

still facing the issue with
isar.xModel.buildQuery(
          whereClauses: [
            IdWhereClause.equalTo(value: input.id),
          ],
    ).deleteAll()

deleteFirst() works fine

there is only one item with that id in DB


6 additions plus l.linklyhq.com shortener

Thanks for the PR, @cliffordp
I’ll get it merged into the master this week.
Cheers!

Thanks, @splorp!
FYI: I posted a vid of this in use with Gravity Forms if you're interested: https://tourkick.com/advice-tips-howto/block-gravity-forms-spam-gravity-perks-disallowed-keywords/

Thanks for this. I’ll add a mention to the Read Me about Gravity Forms Blacklist.


Missing yargs dependency

I tried running yarn msw create public/, which resulted in an error:
TypeError: yargs.positional is not a function
    at Object.yargs.usage.command [as builder] (/path/to/node_modules/msw/cli/msw.js:10:13)
    at Object.self.runCommand (/path/to/node_modules/yargs/lib/command.js:193:35)
    at Object.Yargs.self._parseArgs (/path/to/node_modules/yargs/yargs.js:990:30)
    at Object.get [as argv] (/path/to/node_modules/yargs/yargs.js:930:19)
    at Object.<anonymous> (/path/to/node_modules/msw/cli/msw.js:18:10)
    at Module._compile (module.js:653:30)
    at Object.Module._extensions..js (module.js:664:10)
    at Module.load (module.js:566:32)
    at tryModuleLoad (module.js:506:12)
    at Function.Module._load (module.js:498:3)
error Command failed with exit code 1.

It looks like yargs is missing as a dep from package.json in this commit: https://github.com/kettanaito/msw/commit/a8a9854114caa353f6ca45c6a9acdb232f4d0d75

Hello, @dashed. Thank you for reporting the issue.
Indeed, I think yargs must be listed as a save dependency, not a dev dependency of the library.
I will provide the fix and publish in the next patch version.

Seems to work fine. Thanks! 👍


Allow other tutorial filename extensions

[x] Closes #3118
[ ] Tests added
[ ] Fully documented, including whats-new.rst for all changes and api.rst for new API

Together with https://github.com/pydata/xarray-data/pull/15, this allows us to generalize out tutorial datasets to non netCDF files. But it is backwards compatible--if there is no file suffix, it will append .nc.

I will be going offline soon when I board a plane. If any other @pydata/xarray devs want to merge this, it might unblock some ongoing work.

thanks!


Deprecate and remove adapter methods

Feature
Deprecate and remove unused/undesirable adapter methods
Feature description
This is a prerequisite for making adapters-as-plugins. This is in large part just a discussion we need to have where we hammer out what we need and what we don't need adapters to implement, define an abstract base class that adapters use (probably this is mostly DefaultAdapter), and make adapters derive from that class directly instead of the current common chain through the Postgres adapter. There are really two sides to the API that comes out of this:

A list of methods a custom third-party adapter would need to define to be usable by dbt
A list of methods dbt promises are available to materializations/macros/etc

We probably want to wait until at least #961 is implemented before we start on this, if only from a merge conflict management perspective.
Who will this benefit?
dbt developers.

Implemented in #1109


MAINT: remove questionable uses of Py_FatalError in module init

Returning NULL allows the importer to recover (e.g., in out-of-memory situations). Aborting the whole process should only be done as a last resort.
See for example https://stackoverflow.com/questions/46687928/should-a-c-extension-fail-in-module-init-if-a-pymodule-add-function-fails for more context.

This should be good to go now.

This should be good to go now.


Obtaining sudo prompt even if in stdout, fix #604

As described in #604, if sudo prompt is in STDOUT (e.g. when authorizing with fprintd) instead than usual STDERR, the prompt was suppressed.
This PR verifies if pacman requires authentication (see #418, non interactive through -n option and redirecting the output to /dev/null) before asking for generic sudo authentication.
The same modification should not be needed in the privileges preservation routine SudoV at line 1925.

I tested with %wheel ALL=(ALL) ALL or %wheel ALL=(ALL) NOPASSWD: ALL or %wheel ALL=(ALL) NOPASSWD: /usr/bin/pacman in /etc/sudoers

I am not able to test the changes, but the patch looks good to me. Thanks for taking care of this!

I think I added a useless output from the first command STDERR, something like sudo: a password is required.
It is not that annoying but should not be there.
Going to do another PR soon redirecting to /dev/null also STDERR from first command.
Sorry for that.


use base64 credentials instead of hex

generally base64 is used for credentials rather than hex, so using that might be useful.
on the other hand hex is still compatible as input for challenge-response.
the 2 commits with PIN are unrelated and not supposed to be here

github went weird, lol


Segregation of the views

It was segregated all the views and components
Fixed a bug present when the list section load

This is a contribution, your collaboration is valued. thanks @rod6214 🥇 💪


Editing search text in Safari is weird

Describe the bug
When editing the search query, if the insertion carrot isn't at the end of the text, typing appends to the text.
To Reproduce
Steps to reproduce the behavior:

Use macOS Mojave 10.14.6 and Safari 13.0.4.  (May happen on other versions.  I saw it here.)
Go to <docs.microsoft.com>
Click the Search link on the top-left of the page.  A Search input field appears.
Type a search query containing spaces, such as Visual Studio.  Press the [ENTER] key on your keyboard.
You now see search results.
Click the Search link on the top-left of the page.  The input field reappears, with the text entered in (4).
Click on the space in the query from (4), e.g. the space within Visual Studio.  Or, use the keyboard to navigate to the space.
Start typing, e.g. Preview

Expected behavior
Text should appear where the insertion carrot is, e.g. if the insertion carrot is after the space within Visual Studio, and I type Preview , I should see Visual Preview Studio.
Actual behavior
After typing the first character, the remaining text is appended to the query, regardless of where the insertion carrot is.  For example, I see Visual PStudioreview.
Screenshots

Desktop (please complete the following information):

OS: macOS Mojave 10.14.6
Browser: Safari 13.0.4

Additional context
This doesn't happen with Chrome 79.0.3945.117.

This issue should be addressed - thank you for the flag, @jonpryor!


Filter Min = 0 Fix

Filter Min Fix
Description
By updating the if statement to
if (!isNaN(response[minmax])) {
    filter[minmax] = filter.type === 'integer' ? Math.round(response[minmax]) : parseFloat(response[minmax]);
  }

We check that the response is a valid number, which allows 0 to resolve to true here and subsequently set the filter value correctly.
GitHub Issue

#1301

Type of Change
Please delete options that are not relevant, and select all options that apply.

✅ Bug fix (non-breaking change which fixes an issue)

How have you tested this?
Ran this using a field that contained 0 as the minimum field value.
Testing Checklist

✅ Existing Tests still pass
✅ Ran locally on my machine

Code Quality Checklist

✅ My code follows the guidelines of XYZ
✅ My code has been commented
✅ Documentation has been updated
✅ New and existing unit tests pass locally with my changes
✅ Main has been merged into this PR

I have added a new filter_minmax query that returns an array of both min and max values. This removed some of the complexity in the generateMinMax function as you no longer need to pass in a string of "min" or "max".
I have added a new filter.minmax array that gets set to [filter.min, filter.max] initially. The benefit of this is that by extracting the query response from the filter.minandfilter.max` values, we separate providing a specific min or max in the configuration vs getting them from the database.
I have resolved the issue with clear and reload of the filter, it will now update the filter values using the query.
I have added a new message that displays when the min and max are identical.


ReplyKeyboardMarkup selective boolean doesn't seem to be working

Expected Behavior
I have the following code
bot.onText(/regexp/, (msg, match) =>
{
	var options = {
		"reply_to_message_id" : msg.message_id,
		"selective" : true,
		"reply_markup": JSON.stringify({
			"keyboard": keyboardArray
		})
	};
	bot.sendMessage(msg.chat.id, "Some text", options);
});

Whenever the regexp matches, a custom keyboard should only show up only for the person who invoked the command (as the selective boolean indicates).

Use this parameter if you want to show the keyboard to specific users only. Targets: 1) users that are @mentioned in the text of the Message object; 2) if the bot's message is a reply (has reply_to_message_id), sender of the original message.

Actual Behavior
The custom keyboard shows up for everyone in the group.
Steps to reproduce the Behavior
Get a bot with a custom keyboard and selective on true to a group, and send the command that it makes it appear. Everyone in the group will see it.

If your bot print a keyboard in a group, the keyboard will show to everyone, in private it works fine.
I don't think there is a way to avoid it.

@sidelux Well, that's not the intended behavior If the "selective" boolean is on true.

This issue is still present.

Use msg.user.id instead on msg.chat.id


performance improve for DefaultFuture and AsyncToSyncInvoker

What is the purpose of the change
when I do stress testing, I found that the latest of version 3.0-dev with low performance for qps and rt, actually very impressive low compare to 2.7.1.
Brief changelog
the main problem is about those two classes.

个人感觉，这两个pr合并在一起效果是最好的：
https://github.com/apache/incubator-dubbo/pull/4087

个人感觉，这两个pr合并在一起效果是最好的：
#4087

Agree with you. I will merge your patch manually later.


[SPARK-XXXXX][SQL][TEST] Add tests to check if since fields are set correctly in ExpressionInfo

What changes were proposed in this pull request?

This PR intends to add a test to check if since fields are set correctly in ExpressionInfo.
This comes from the discussion in https://github.com/apache/spark/pull/29577#discussion_r479794502.
The credit should be @tanelk.
Why are the changes needed?

To prevent one from forgetting setting a since field when adding a new expression.
Does this PR introduce any user-facing change?

No.
How was this patch tested?

Added tests.

I don't have much time to check the versions (SPARK-32780) expr-by-expr now, but I think its worth adding the test to prevent one from forgetting setting a since field when adding a new expression.  WDYT? @HyukjinKwon
(NOTE: I made this PR instead because @tanelk looks absent)

NOTE: I will file jira later if necessary.

Test build #128280 has started for PR 29646 at commit 21496cc.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/32907/
Test PASSed.

Test build #128280 has finished for PR 29646 at commit 21496cc.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/128280/
Test FAILed.


Develop 508 map reef zoom params support

This branch was created on top of the PR #509. It must be merged after the PR #509 approvment.

@abouillis the implementation was causing a weird behavior because of a conflict between the findMaxAlertReefPosition and the new reefId initialization so I tried another approach. Let me know what you think. Last thing to wrap up is address Ryan's comment and extract the hook and we should be good to go!

@ericboucher ok I understand your approach, it's more clear. I try it but I didn't take that way, because without using setReefOnMap, the reef is not selected into the reefs list at the bottom right. I thought it was important for the screen consistence. setReefOnMap seems to centralize the triggering of the behaviours of all the components. N.B: You still have a strange behaviour I noticed: when the reef_id parameter is used, there is a double data initialization into the "Selected site" block, one to load the featured reef's data, and another to load the reef from the reef_id parameter. It finalize with a delay after the full page display.

@ericboucher I moved the parameters processing into the useQuery hook.

Good catch! Any idea where it could come from? I'll try to track it down.
And good point on the screen consistency. I think it is fine for now to keep things simpler.

I think I got it, we didn't check that the reefList was loaded before loading the featuredReef but we wait for the list to check the existence of the initialReef which is causing a double fetch. I have a fix in progress

@abouillis I think I fixed it but I am not sure this is the most efficient! Any ideas on how to improve the efficiency/speed of the first load?


Returned datetime is not the same to online parse server

After the user login, our server returns a datetime to the client.
var timestamp = new Date(Date.now());
Our client parse the datetime by:
DateTime timeStamp = DateTime.Parse(t.Result["ts"].ToString());
For my local parse server, the datetime format  recieved by client is:
"2016-03-11T04:49:52.507Z"
While for the online parse server, the datetime format recieved by client is:
 "3/11/2016 04:49:52 AM"
If we convert the string to datetime, the 1st string will be converted to local time while the 2nd is utc time.
Debug.Log (DateTime.Parse("2016-03-11T04:49:52.507Z") + "  :  " + DateTime.Parse("3/11/2016 04:49:52 AM"));
the result is:
3/11/2016 12:49:52 PM  :  3/11/2016 4:49:52 AM
Even if we should not use the method DateTime.Parse(), but why online parse-server's datetime is different to local parse-server's?  Shouldn't them be the same?

Parse Cloud Code and parse-server Cloud Code are two different environments, and there are bound to be some small differences between the two. You can use your favorite DateTime string manipulation JavaScript library to work around this.
I'm closing this as we expect that some developers will need to update their Cloud Code when migrating to parse-server, and we are not considering minor differences like these as issues in parse-server.


provider configuration works only via external file

environment
Terraform v1.9.8
on linux_amd64
+ provider registry.terraform.io/hashicorp/google v6.11.2
+ provider registry.terraform.io/hashicorp/random v3.6.3
+ provider registry.terraform.io/thalesgroup/ciphertrust v0.10.6-beta

provider "ciphertrust" {
address      = "https://ciphertrust.dpondemand.io/?tenant=onpier-gmbh-ciphertrustmanager"
username  = "${var.CIPHERTRUST_USER}"
password = "${var.CIPHERTRUST_SECRET}"
}
is not working at all
only via  ~/.ciphertrust/config file

Hi @TomSp ,
you need to follow the provider configuration sample from the docs (https://github.com/ThalesGroup/terraform-provider-ciphertrust?tab=readme-ov-file#for-ciphertrust-data-security-platform-as-a-service-cdspaas). Your configuration misses the parameter "auth_domain" which is mandatory for using the provider with CDSPaaS and holds the tenant id/name (in your case "onpier-gmbh-ciphertrustmanager"). Your provider block should look like this:
provider "ciphertrust" {
  address     = "https://ciphertrust.dpondemand.io"
  username    = "LOCAL_CDSP_USER"
  password    = "LOCAL_CDSP_USER_PASSWORD"
  auth_domain = "onpier-gmbh-ciphertrustmanager"
}

Please update your provider block and/or configuration file and give us a short feedback if this solves your issue.
Thanks and best regards, Martin

Hello @martingegenleitner ,
yes we tried that, but now again,
leads immediately to
Planning failed. Terraform encountered an error while generating this plan.

╷
│ Error: failed to set auth token [NCERRAccountLocked: Account is locked]: User account is temporarily locked. Lockout time remaining '0:01:00'

problem fixed due to using a local (non Data Protection On Demand - User)
provider "ciphertrust" {
  address     = "https://ciphertrust.dpondemand.io"
  username    = "${var.CIPHERTRUST_USER}"
  password    = "${var.CIPHERTRUST_SECRET}"
  auth_domain = "onpier-gmbh-ciphertrustmanager"
}


Inconsistent behavior of [source] block without figure wrapper in v3/v2

The README states that:

sourcecode (v3) and artwork (v2) elements only occur within a figure wrapper; this gem supplies that wrapper if it is not provided explicitly.

However, when I do not supply the figure wrapper like this:
[[id]]
.Source code listing title
[source,asciidoc]
----
= My title
----

It says the reference 'id' is not found. I suspect the gem is not creating the figure wrapper in v2. I know somewhere in a later paragraph it says "v2: explicit wrapper" required", but could we supply the figure wrapper automatically?
Thanks!

Ah. What's happening is, it's supplying the wrapper, but it's not moving the ID of the source code snippet up to be the ID of the figure wrapper; and because RFC XML v2 doesn't support IDs on source code snippets, the ID doesn't show up anywhere.
I considered promoting the ID into the wrapper, and rejected it, because it would be a different level of ID from what the source provide. But that is being pedantic. In v2, I will move the ID from the snippet to the wrapper. I won't in v3, because snippet IDs are supported there.

Got it, once it's fixed could you also help update the README (v2/v3)? Thanks @opoudjis !

Done


This is an awesome library, anything similar in reactjs?

Would of great help if anyone can point me to a library similar to this built in reactJS!. Thanks in advance!

+1

+1

It would be awesome to get a react component for this.
+1

Hi, thank you for the request. Right know we doesn't support react/js, but mybe in near feauture we will add support for the library.