How to start training?

I have downloaded to 05_Horse mp.4 data from the google immersive website. I am completely new to this. I downloaded the data & put it in ~/data folde ras mentioned and tried to launch the training using the following command:
"bash scripts/run_one_immersive.sh"
In the readme file, bash scripts/run_one_immersive.sh <gpu_to_use>  <start_frame> this is the command.
I am not sure what to fill in <gpu_to_use>  and <start_frame>
can you suggest me what an example input would look like?
I am running the model in a AWS EC2 g5.2xlarge server and used the env.yml file to setup my environment.
Looking forward to a quick response from you.

While i am just running, "bash scripts/run_one_immersive.sh start_frame=10"
I am getting the following error, which I am assuming is because i am not passing the launch command properly.
AttributeError: evt
Error executing job with overrides: ['experiment/dataset=immersive', 'experiment/training=immersive_tensorf', 'experiment.training.val_every=5', 'experiment.training.test_every=10', 'experiment.training.ckpt_every=10', 'experiment.training.render_every=30', 'experiment.training.num_epochs=30', 'experiment/model=immersive_sphere', 'experiment.params.print_loss=True', 'experiment.dataset.collection=10', '+experiment/regularizers/tensorf=tv_4000', 'experiment.dataset.start_frame=', 'experiment.params.name=immersive_10_start']
Traceback (most recent call last):
File "main.py", line 209, in main
elastic_run(cfg)
File "main.py", line 204, in elastic_run
run(cfg, "", "", "")
File "main.py", line 98, in run
dm.prepare_data()
File "/home/ubuntu/hyperreel/nlf/init.py", line 148, in prepare_data
self.reload_data()
File "/home/ubuntu/hyperreel/nlf/init.py", line 154, in reload_data
self.train_dataset = dataset_cl(self.cfg, split='train')
File "/home/ubuntu/hyperreel/datasets/immersive.py", line 75, in init
super().init(cfg, split, **kwargs)
File "/home/ubuntu/hyperreel/datasets/base.py", line 531, in init
super().init(cfg, split, **kwargs)
File "/home/ubuntu/hyperreel/datasets/base.py", line 446, in init
super().init(cfg, split, **kwargs)
File "/home/ubuntu/hyperreel/datasets/base.py", line 106, in init
self.prepare_data()
File "/home/ubuntu/hyperreel/datasets/base.py", line 155, in prepare_data
self.read_meta()
File "/home/ubuntu/hyperreel/datasets/immersive.py", line 81, in read_meta
with self.pmgr.open(os.path.join(self.root_dir, "models.json"), "r") as f:
File "/home/ubuntu/anaconda3/envs/hyperreel/lib/python3.8/site-packages/iopath/common/file_io.py", line 1023, in open
bret = handler._open(path, mode, buffering=buffering, **kwargs)  # type: ignore
File "/home/ubuntu/anaconda3/envs/hyperreel/lib/python3.8/site-packages/iopath/common/file_io.py", line 611, in _open
return open(  # type: ignore
FileNotFoundError: [Errno 2] No such file or directory: '/home/ubuntu/data/hyperreel/immersive/05_Horse/10/models.json'
Set the environment variable HYDRA_FULL_ERROR=1 for a complete stack trace.

Hi! Both <gpu_to_use> and <start_frame> should just be numbers -- the first corresponding to the GPU ID (which depends on how many GPUs your machine has), and the second corresponding to the video frame you want to start training the model at (depends on how many frames are in the video sequence, which I believe is 300 for the Horse sequence). You also need to include the name of the scene. As an example, you can invoke the script with:
bash scripts/run_one_immersive.sh 0 05_Horse 0
which will train a model on the horse sequence, starting at frame 0, and using the GPU with ID 0.


create new ceph-install role.

This pulls out most of ceph-common's install process and makes ceph-common
depend on it. This is useful for incorporating ceph installation into VM
images, but for allowing post-start configuration via ceph-common and the other
roles.
We have already done this in volplugin's ansible and it works really, really well. I know this is large, but please consider this patch.
Thank you for your time.
Signed-off-by: Erik Hollensbe<EMAIL_ADDRESS>

Hum not sure to really understand the use case. Can't you simply add an 'install' tag to ceph-common to isolate the installation instead of creating a new role? And then use another tag for post-config?
Thanks!

It partitions the notion of installing the product vs. configuring it. I'm happy to do it the other way, however. I'll need a few days.

As you know, this is a huge change that will impact a lot of users. We don't use tags at all anyway. I think we should, this is a good exercice and a good start I guess.
I can wait a few days :) Thanks!


Creating TestFlight groups using Pilot or Spaceship

New Issue Checklist

[x] Updated fastlane to the latest version
[x] I read the Contribution Guidelines
[x] I read docs.fastlane.tools
[x] I searched for existing GitHub issues

Is it possible to create a new group in TestFlight using either Fastlane or Spaceship? When you create a new app on iTunes Connect, there are no default external groups (there are no groups at all). Therefore, you are not able to add any external testers for the specific app.  When I use the following Fastlane command for a newly created app:
fastlane pilot add emailaddress -a "BundleID" -g "GroupName" (with or without the group flag)
I get the following error:
There are no groups available matching the name passed to the ':groups' option.
I have looked through the documents and the source code, and I can't seem to find anything? Is this possible? Or do you always need to create new groups using iTC?

I have a similar issue when importing.  I imagine its the same issue underneath.  When trying to import a list of testers using the pilot import -c testers.csv, every user that belongs to a group that does not currently exist in ITC spits out an error message, such as Could not add<EMAIL_ADDRESS>to app: App Name.  If I go into ITC and manually create the groups, it works fine.

This is still an issue, no support for this feature has been added with the latest fastlane version

Any news on that? Or any ideas how this can be worked around, e.g. via spaceship?

Yeah, that works fine with spaceship
   context '.create!' do
      it 'returns an existing group with the same name' do
        group = Spaceship::TestFlight::Group.create!(app_id: 'app-id', group_name: 'Group 1')
        expect(group.name).to eq('Group 1')
        expect(group.id).to eq(1)
        expect(group).to be_instance_of(Spaceship::TestFlight::Group)
      end

      it 'creates the group for correct parameters' do
        group = Spaceship::TestFlight::Group.create!(app_id: 'app-id', group_name: 'group-name')
        expect(group.name).to eq('group-name')
        expect(group.id).to eq(3)
        expect(group).to be_instance_of(Spaceship::TestFlight::Group)
      end
    end

    context '.default_external_group' do
      it 'returns the default external group' do
        group = Spaceship::TestFlight::Group.default_external_group(app_id: 'app-id')
        expect(group).to be_instance_of(Spaceship::TestFlight::Group)
        expect(group.id).to eq(1)
      end
    end

    context '.filter_groups' do
      it 'applies block and returns filtered groups' do
        groups = Spaceship::TestFlight::Group.filter_groups(app_id: 'app-id') { |group| group.name == 'Group 1' }
        expect(groups).to be_instance_of(Array)
        expect(groups.size).to eq(1)
        expect(groups.first.id).to eq(1)
      end
    end

Thank you @KrauseFx
That worked, I do know how we missed this when we were searching earlier.
Also thank you for all the work with Fastlane generally!


SecTrust object now is conditionally unwrapped

This PR fixes an issue introduced by https://github.com/daltoniam/Starscream/commit/dbeb1190b8dcbff4f0b797f9e9d9b9b864d1f0d6#diff-b9ab27dc605d36ce558013387d2ba2d5
Now the SecTrust object is conditionally unwrapped and if not found , the pinning will fail*. I was never able to reproduce the scenario where the SecTrust object is null within a wss/https connection, i think this could be related to a failed SSL handshake (maybe due to networking issues) but these are just speculations at this point.

I consider the pinning failed, because if you end up in that code branch it's because:

the url is either wss or https
a security object was provided to perform the certificate pinning
the client is clearly signalling is will for the pinning to be performed, so in absence of a trust that contains the certificates to be checked, i think it's better to reject the connection

Great work and thanks for fixing that issue!

Hey thanks for the quick approval. i see that this is included in 2.1.0, but somehow the spec hasn't been pushed to cocoa pods , because the latest available is still 2.0.4 (and if you try to target directly 2.1.0 you will get an error that the dependency can't be satisfied)
Could you have a look? ah and btw, many thanks for the great library :)

Finally got it done. Had a fair amount of trouble with CocoaPods & SPM working together. Anyway, 2.1.0 has been released!


Update version number for release 1.1.1

Superseded by #2944. The Git tree height was not included in the stable package version number for this pull request.


Handle staking credentials

@etiennejf requested that cooked-validators started dealing with staking credentials.
The main subject of this PR is changing the old PaysPK constraint into:
  PaysPKWithDatum ::
    (Pl.ToData a, Show a) =>
    Pl.PubKeyHash ->
    Maybe Pl.StakePubKeyHash ->
    Maybe a ->
    Pl.Value ->
    Constraint

Yet, we should also make the rest of cooked work well with staking credentials, which raises a few questions that I need help with I'd appreciate the opinions of @etiennejf or @sjoerdvisscher or @ak3n on them, thank you!

What's the interface to staking with the Plutus Contract monad? I'd like to copy that as much as possible to remain as compatible as possible. In particular: does every wallet start with a staking credential from scratch? Maybe it shouldn't. In that case, how is that created? Can the same Credential posses UTxOs with different StakingCredentials?
What should be the semantics of utxosSuchThat? Currently, it has type:  utxosSuchThat ::
    (MonadBlockChain m, Pl.FromData a) =>
    Pl.Address ->
    (Maybe a -> Pl.Value -> Bool) ->
    m [(SpendableOut, Maybe a)]

I'm thinking that perhaps, it should have type:  utxosSuchThat ::
    (MonadBlockChain m, Pl.FromData a) =>
    Pl.Credential ->
    (Maybe Pl.StakingCredential -> Maybe a -> Pl.Value -> Bool) ->
    m [(SpendableOut, Maybe a)]

This way we can select all UTxOs that belong to a given key and use the user-supplied predicate to filter out those
that contain a certain staking credential or not. Would that make sense?
What are the semantics of the ownStakePubKeyHash script lookup? What should we use it for?

"does every wallet start with a staking credential from scratch?"

Looks like it's complicated.
https://docs.cardano.org/core-concepts/cardano-addresses mentions that there are different types of addresses. "Enterprise" does not have a stake key and "BaseAddress" does (payment + stake keys). That's why Stake Key was introduced in #181. PAB might be not ready for staking scenarios yet.
And as a wallet can have several addresses, it seems that it may have an enterprise and base addresses together at the same time (with or without stake keys).
I found HowTos on creating a stake address — https://developers.cardano.org/docs/stake-pool-course/handbook/keys-addresses/ So I suspect that it's up to the wallet to create or not to create an address with a stake key. cardano-wallet doc mentions this (https://input-output-hk.github.io/cardano-wallet/user-guide/common-use-cases/how-to-create-a-wallet):

There are several wallet types available:
random
icarus
trezor
ledger
The basic difference between them is that for a random wallet user needs to create new address manually, whereas for sequential wallets like icarus, trezor and ledger addresses are generated automatically) by the wallet.

Taking in mind the aforementioned things I think yes. Allowing to filter by StakingCredential presence makes sense. To increase user-friendliness you may add a default wrapper utxosSuchThat'  that passes Nothing as StakingCredential for example.

What are the semantics of the ownStakePubKeyHash script lookup? What should we use it for?

As I can see ownStakePubKeyHash  is needed only to build the tx in addMissingValueSpent  ~> processLookupsAndConstraints ~> mkSomeTx. Not sure in what cases it might be used as MustPayToPubKeyAddress constraint sets the TxOut with stake key as well. Maybe there are situations when ownStakePubKeyHash helps but there are not yet covered properly.

Does every wallet start with a staking credential from scratch?

Most of the wallets (e.g., nami, cardano-wallet, etc) out there produces payment public address including both pubKeyHash and stakeKeyHash (e.g., bech32 addresses). The problem is that the current plutus-apps does not offer the possibility to retrieve such addresses form a wallet. For instance, Contract.ownPaymentPubKeyHash will only return the PubKeyHash that's associated with the primary payment address of the wallet when interacting with cardano-wallet (see code in Cardano.Wallet.LocalClient). It can be the case that a wallet interacting with our endpoints does not have the sufficient funds or expected tokens associated to the primary payment address. So we prefer to ask the wallet to provide both PubKeyHash and StakeKeyHash, with StakeKeyHash as optional (i.e., Maybe).
Moreover, we cannot only rely on the PaymentPubKeyHash as we have situations where several transactions are being submitted within one invoked endpoints and if we are submitting and balancing the transaction with the cardano-wallet (via the PAB settings), cardano-wallet will always select one of secondary payment public addresses as change address. So we can end in a situation where all the remaining wallet's funds and minted tokens are transferred to this secondary payment public address. Thus, the building of any succeeding transaction submitted within the same endpoint will failed as there will no more funds associated with the primary payment public address.
To avoid this situation, we prefer to explicit set the change address in the balanced Tx returned by the cardano-wallet before submitting it. To do so, we need to ensure that only the utxo associated with the change address will be added during balancing.
But this works fine.

I reverted my previous attempt and started over; I refined the type of utxosSuchThat exactly as mentioned on question (2) but I realized that this broke the instance MonadBlockChain (Contract w s e), because there is currently no way of getting utxos irrespective of their staking credential, the only way is filtering by Address: https://github.com/input-output-hk/plutus-apps/blob/b84f9a5d1600a772a48b14b0eae6e11cf2139c61/plutus-contract/src/Plutus/Contract/Request.hs#L402

Having had a look at how @etiennejf is using staking credentials; I think the easiest way forward is to really just support the PaysPKWithDatum constraint. I decided to rollback the generalization of utxosSuchThat because I couldn't implement that more general version in plutus-contract. Once plutus-contract adds support for staking credentials we can go ahead and revert https://github.com/tweag/plutus-libs/pull/81/commits/0f992692dd7caf229becbe3e1d57c84da8376088.


Haskell + PureScript module improvements

Hopefully self-explanatory improvements to a couple of modules.
Improvements:

Registers intero-company with company for proper completions in Haskell.
Adds a couple of lookup handlers in PureScript.

Sorry for the late reply! Thanks for your help!


💥 [DevOps] Have gradido node running on docker-compose

💥 DevOps ticket

Have gradido node running on docker-compose.
Currently gradido-node is not running when running docker-compose up, since due to undefined environment variables it does not start and therefore was commented out.

Please make it run without predefined environment variables.
Motive

Have all services running which are required for the full gradido service setup.

Why we don't remove it complete from stage1 and add it in stage2 where it is really used and needed?

I mean, sure go for it - but it would be wise to have stuff running before you remove it.

I remove it from stage1 after it is running in stage2, okay?


TS Server fatal error:  Cannot read property 'indexOf' of undefined

Issue Type: Bug
❗❗❗ Please fill in the sections below to help us diagnose the issue ❗❗❗
TypeScript Version: 4.1.4
Steps to reproduce crash
1.
2.
3.
TS Server Log
❗Server logging disabled. To help us fix crashes like this, please enable logging by setting:
"typescript.tsserver.log": "verbose"

After enabling this setting, future crash reports will include the server log.
TS Server Error Stack
Server: semantic
TypeError: Cannot read property 'indexOf' of undefined
    at Object.parsePackageName (/Applications/Visual Studio Code.app/Contents/Resources/app/extensions/node_modules/typescript/lib/tsserver.js:39472:30)
    at ConfiguredProject.Project.enablePlugin (/Applications/Visual Studio Code.app/Contents/Resources/app/extensions/node_modules/typescript/lib/tsserver.js:151962:24)
    at ConfiguredProject.enablePluginsWithOptions (/Applications/Visual Studio Code.app/Contents/Resources/app/extensions/node_modules/typescript/lib/tsserver.js:152477:30)
    at ProjectService.loadConfiguredProject (/Applications/Visual Studio Code.app/Contents/Resources/app/extensions/node_modules/typescript/lib/tsserver.js:154206:25)
    at ProjectService.createAndLoadConfiguredProject (/Applications/Visual Studio Code.app/Contents/Resources/app/extensions/node_modules/typescript/lib/tsserver.js:154145:22)
    at ProjectService.createLoadAndUpdateConfiguredProject (/Applications/Visual Studio Code.app/Contents/Resources/app/extensions/node_modules/typescript/lib/tsserver.js:154150:36)
    at ProjectService.assignProjectToOpenedScriptInfo (/Applications/Visual Studio Code.app/Contents/Resources/app/extensions/node_modules/typescript/lib/tsserver.js:155055:44)
    at /Applications/Visual Studio Code.app/Contents/Resources/app/extensions/node_modules/typescript/lib/tsserver.js:155395:97
    at Object.flatMap (/Applications/Visual Studio Code.app/Contents/Resources/app/extensions/node_modules/typescript/lib/tsserver.js:513:25)
    at ProjectService.applyChangesInOpenFiles (/Applications/Visual Studio Code.app/Contents/Resources/app/extensions/node_modules/typescript/lib/tsserver.js:155395:41)
    at Session.handlers.ts.Map.ts.getEntries._a.<computed> (/Applications/Visual Studio Code.app/Contents/Resources/app/extensions/node_modules/typescript/lib/tsserver.js:156413:46)
    at /Applications/Visual Studio Code.app/Contents/Resources/app/extensions/node_modules/typescript/lib/tsserver.js:158286:88
    at IOSession.Session.executeWithRequestId (/Applications/Visual Studio Code.app/Contents/Resources/app/extensions/node_modules/typescript/lib/tsserver.js:158277:28)
    at IOSession.Session.executeCommand (/Applications/Visual Studio Code.app/Contents/Resources/app/extensions/node_modules/typescript/lib/tsserver.js:158286:33)
    at IOSession.Session.onMessage (/Applications/Visual Studio Code.app/Contents/Resources/app/extensions/node_modules/typescript/lib/tsserver.js:158310:35)
    at Interface.<anonymous> (/Applications/Visual Studio Code.app/Contents/Resources/app/extensions/node_modules/typescript/lib/tsserver.js:160520:27)
    at Interface.emit (events.js:315:20)
    at Interface._onLine (readline.js:329:10)
    at Interface._normalWrite (readline.js:474:12)
    at Socket.ondata (readline.js:186:10)
    at Socket.emit (events.js:315:20)
    at addChunk (_stream_readable.js:295:12)
    at readableAddChunk (_stream_readable.js:271:9)
    at Socket.Readable.push (_stream_readable.js:212:10)
    at Pipe.onStreamRead (internal/stream_base_commons.js:186:23)

VS Code version: Code 1.53.1 (5d424b828ada08e1eb9f95d6cb41120234ef57c7, 2021-02-08T23:35:15.302Z)
OS version: Darwin x64 20.3.0

System Info

Item
Value

CPUs
Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz (16 x 2400)

GPU Status
2d_canvas: enabledgpu_compositing: enabledmetal: disabled_offmultiple_raster_threads: enabled_onoop_rasterization: enabledopengl: enabled_onprotected_video_decode: unavailable_offrasterization: enabledskia_renderer: disabled_off_okvideo_decode: enabledwebgl: enabledwebgl2: enabled

Load (avg)
3, 3, 3

Memory (System)
32.00GB (1.91GB free)

Process Argv
--crash-reporter-id c98f3a22-2ed7-43bf-89fe-cd320d76ddb2

Screen Reader
no

VM
0%

Extensions (24)

Extension
Author (truncated)
Version

bracket-pair-colorizer
Coe
1.0.61

vscode-eslint
dba
2.1.14

gitlens
eam
11.2.1

json-tools
eri
1.0.2

auto-close-tag
for
0.5.10

code-runner
for
0.11.2

vscode-graphql
Gra
0.3.15

todo-tree
Gru
0.0.196

rest-client
hum
0.24.4

vscode-peacock
joh
3.9.1

vscode-styled-components
jpo
1.5.0

git-graph
mhu
1.28.0

dotenv
mik
1.0.1

remote-containers
ms-
0.158.0

remote-ssh
ms-
0.63.0

remote-ssh-edit
ms-
0.63.0

remote-wsl
ms-
0.53.3

vscode-remote-extensionpack
ms-
0.20.0

debugger-for-chrome
msj
4.12.12

vscode-react-native
msj
1.3.0

code-spell-checker
str
1.10.2

vscodeintellicode
Vis
1.2.11

vscode-icons
vsc
11.1.0

material-theme
zhu
3.9.13

A/B Experiments
vsliv368cf:30146710
vsreu685:30147344
python383cf:30185419
vspyt653:30253241
vspor879:30202332
vspor708:30202333
vspor363:30204092
vswsl492cf:30211402
pythonvsdeb440:30248342
pythonvsded773:30248341
pythonvspyt875:30251590

@sheetalkamat @DanielRosenwasser This looks like it may be related to the changes in 4.1.4

What is tsconfig file? Plugin needs to have name. so we are not checking for undefined name but we could

https://github.com/microsoft/TypeScript/issues/42712

@sheetalkamat https://github.com/microsoft/vscode/issues/116233 has a server log. I think the issue are entries like this:
"plugins": [
   {
    "transform": "rbxts-transformer-t"
   },
   {
    "transform": "rbxts-transform-env"
   }
  ],

temporary fix works for me(add the name field):

Fix is to downgrade to 1.53.0 as well. https://code.visualstudio.com/updates/v1_53 has the direct download links which have the version in it, which can be changed back to the .0 release.

q

Fix is to downgrade to 1.53.0 as well. https://code.visualstudio.com/updates/v1_53 has the direct download links which have the version in it, which can be changed back to the .0 release.

https://update.code.visualstudio.com/1.53.0/darwin/stable

This is fixed with TypeScript 4.1.5, which should go out with VS Code 1.53.2 tomorrow.
Until then, either add a fake name as @upupming suggests or switch your workspace to use TypeScript 4.1.5

This will not get in a TS 3.9.x hotfix?
@sheetalkamat @DanielRosenwasser

3.9.9 should have the fix - are you not seeing that?

3.9.9 should have the fix - are you not seeing that?

I was on my mobile browser and too blind to find the release. Sorry for the noise and thanks a lot!


have you tried writing any documentation

@elliotberry can you clarify your question?

@elliotberry can you clarify your question?

my boy theey alll trying to tell you the docs suckk lol

@jmanhype sure, feel free to send a PR to fix it

Good luck getting people to Pr this


Foundation: resolve some warnings

JSONEncoder.swift: tell the compiler that yes, this is supposed to be casting to 'T' and not 'T?'.

NSObject.swift: mark NSKeyValueObservation members explicitly @objc and @nonobjc.

NSStringAPI.swift: remove unnecessary @usableFromInline.

No intended functionality change.

@swift-ci Please test

It looks like none of these changes directly apply to swift-corelibs-foundation:

JSONEncoder.swift: sufficiently different in how it decodes URLs (and already has these parentheses)

NSObject.swift: no KVO on Linux

NSStringAPI.swift: still using @_inlineable @_versioned, so might as well wait for a general cleanup there

I can't speak to the KVO changes, but the string and JSON changes look reasonable to me! We should apply the JSON change to swift-corelibs-foundation too

I can't speak to the KVO changes, but the JSON and String ones look good to me!

Checked with David about the KVO change and he said it looks good. Merging!


Bug in Evaluate: Loop and variable handling

Hi,
I have tried to use the Evaluate method and found some bugs.
Please take look at the examples below.
EXAMPLE  JS code 1:
var str = "Buzz";
for (var i = 0; i < str.length; i++)
{
  str[i];
}

For each iteration in the loop it should output a character. But this code will only print z. It should print Buzz.
EXAMPLE JS code 2:
var str = "Buzz";
var b = "";

for (var i = 0; i < str.length; i++)
{
  b +=str[i];
}

This code will print Buzz. It should not print anything, because variable b is only getting appending.

Try opening the console in your browser (F12 > Console in Chrome) and pasting your examples in there. When I try that the first example does give "z" and the second example does give "Buzz". So the behavior in Jurassic is correct, as far as I can tell.
Evaluate() just returns the last executed expression. If you want to print to the console see here.

Hi there!
Yes i agree - you are right about that. I guess i was looking for console behaviour. Thank you!


Exhaust Manifold Example added to PyMAPDL Repo

Exhaust Manifold Example added to PyMAPDL Repo

Hi @smedikon
You did a fork of PyMAPLD repo, because of that, your fork has no access to the secrets needed for running the CI.
I presume you can create PRs (You are ansys employee after all) but let know if you can't.
I would suggest you to:

Clone the repo.
Create a new branch with all the changes
Create a PR.

You could also try the following in order to create the PR directly on PyMAPDL:
gh pr create --repo pyansys/pymapdl \
  --title "[Exhaust Manifold Example added to PyMAPDL Repo](https://github.com/pyansys/pymapdl/pull/1247#)" --body "Exhaust Manifold Example added to PyMAPDL Repo" --head smedikon:main --base main

I never tried this, so let me know if this works.
Reference: https://stackoverflow.com/a/72018520/6650211

Closed because of #1248


Create Combined Heatmap

Currently, the heatmaps are separated by batch. We need to combine heatmaps together, generate a new figure, and note in a ColSideColor the batch number.

I used the intersection of features to generate the combined data.
This included 59 non-metadata features. This probably is not the way to go for future combinations as this number will continue to reduce.
One thing I am concerned about is the nature of the variable selection. See #9 for more details.


100 e2e integration tests | 111 read_csv should search for data in the data folder | 105 generate_docs action: run jsonschema2mk on resources/schemas directory

where are these defined?
On Tue, Oct 11, 2022, 09:15 Yossi Shirizli @.***> wrote:

@.**** commented on this pull request.
In datayoga-py/datayoga/blocks/read_csv/block.py
https://github.com/datayoga-io/datayoga-py/pull/118#discussion_r991854352
:

   self.file = self.properties["file"]

   if os.path.isabs(csv_file) or context is None:

       self.file = csv_file

   else:

       self.file = os.path.join(context.properties.get("job_path"), csv_file)

data_path is better than job_path, I agree, will change.
—
Reply to this email directly, view it on GitHub
https://github.com/datayoga-io/datayoga-py/pull/118#discussion_r991854352,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AANAS5UTUKTXCMT5SRPZDNDWCUAZLANCNFSM6AAAAAARAS6X2A
.
You are receiving this because your review was requested.Message ID:
@.***>

where are these defined?

In the run command (main.py):
  context = Context({
            "connections": connections,
            "job_name": Path(job_file).stem,
            "job_path": job_path
        })


Chopping block

Items in consideration for 2.0 chopping block:
underscored method names
These could be replaced with tag(:name) though that feature will need re-implementing.
yield_content
I think we can make yield_content private.
view_context
We’ve already discussed renaming this context. We should really come up with a better name for Phlex internal context before we move forward with this.
CSV helpers proxy
I think we should remove the helpers proxy for CSVs and instead allow register_value_helper in CSVs in Phlex-Rails.
element clobbering guard
Without underscored methods, we wouldn’t need the clobbering guard.
deferred render as a module
Instead of using a module for deferred render, I think it would be better to do something like
def deferred = true

None of these changes would pose a big roadblock for Clearscope's codebase.

None of these changes would pose a big roadblock for Clearscope's codebase.

Good to hear. Just trying to take advantage of the major release to get rid of a few things that have proven to be low-value.

Maybe this isn't the right place for it, but we're in the process of upgrading to 2.0 beta and our only complaint is the forced dasherizing of symbol values in __attributes__. Dasherizing of keys has always been fine.
I wish it was at least easily overridden.

Could there be a format_attribute_value method similar to format_object that can be overridden?

@hangsu I opened this discussion to talk about that. We already had a 3-day debate about it in Discord 😆  https://github.com/orgs/phlex-ruby/discussions/785


fix: added angular cli as dependency

Closing this one, as the issues were already resolved using your proposed fixes :+1:


only index column supported?

same db and table with 6 records in it ,post_id is index post_link is not ,
    db=context['db']
    tables=db.get_table_names()
    print('current operating db:',tables)

    for t in tables:
        list = db.select_all(t)  # -> list of 2 items
        # print('------',t,'---------',list)
        if t=='scrape':
            for i in list:
                if i['post_link']==post_link:

                    print('-------------','table',t,'has record\n',i['post_id'])

print is all the result expected
option2
    tablename ="scrape"
    # print('check link exist',post_link,db.select(tablename, "post_link==?",post_link))
    try:
        count = len(db.select(tablename, "post_link==?",post_link))
        if count>0:
            print('found exising record',count,'--,',post_link)
            records=db.select(tablename, "post_link==?",post_link)
            for r in records:
                print('!!!!!!!!!',r['post_id'])
            return True
        else:
            return False
    except:
        return False

constanly say False.
am i mistaken?
what if i need to know by whether the same post_link  is there

sqlite3.ProgrammingError: Cannot operate on a closed cursor.
def getlinkduplicate(context,post_link):

    db=context['db']
    tables=db.get_table_names()
    print('current operating db:',tables)
    postidlist=[]
    for t in tables:
        list = db.select_all(t)  # -> list of 2 items
        # print('------',t,'---------',list)
        if t=='scrape':
            for i in list:
                if i['post_link']==post_link:

                    # print('-------------','table',t,'has record\n',i['post_id'])
                    postidlist.append(i['post_id'])
    return postidlist

        postidlist=getlinkduplicate(context,post_link)
        # print(getrecordsfromlink(context,post_link))
        for pid in getlinkduplicate(context,post_link):
            print('delete records postid==',pid)
            db.delete(tablename, "post_id==?",pid)

give me
ine 1854, in addscrapetask
    db.delete(tablename, "post_id==?",pid)
  File "D:\Program Files\anaconda3\lib\site-packages\itemdb.py", line 469, in delete
    cur.execute(f"DELETE FROM {table_name} WHERE {query}", args)
sqlite3.ProgrammingError: Cannot operate on a closed cursor.

Could it be that there is an exception raised somewhere in the try block, which causes False to be returned?

just give you example
{'post_id': 'ymE2_UDkS5-8y3yHjxOXFw', 'taskid':<PHONE_NUMBER>, 'updatetime':<PHONE_NUMBER>, 'pipelineid':<PHONE_NUMBER>, 'sub': 'trashy', 'subnsfw': False, 'post_link': 'https://v.redd.it/gi6ws11r2o271', 'status': 1, 'post_title': 'Wait for it', 'submission_id': 'npvoqa', 'postnsfw': True, 'reddit_post_file': 'data\\raw\\trashy\\ymE2_UDkS5-8y3yHjxOXFw\\ymE2_UDkS5-8y3yHjxOXFw.json', 'image_post_file': 'image_post_file', 'video_post_file': 'data\\raw\\trashy\\ymE2_UDkS5-8y3yHjxOXFw\\videos\\DASH_720.mp4', 'post_type': 'video', 'url': 'https://v.redd.it/gi6ws11r2o271/DASH_720.mp4?source=fallback', 'update_time':<PHONE_NUMBER>, 'sceneoutputdir': 'data\\raw\\trashy\\tmp\\ymE2_UDkS5-8y3yHjxOXFw\\scenes\\', 'commentwithoutsound': 'data\\raw\\trashy\\tmp\\ymE2_UDkS5-8y3yHjxOXFw\\comments_videos\\ymE2_UDkS5-8y3yHjxOXFw_c_nosound.mp4', 'commentvideo': 'data\\raw\\trashy\\tmp\\ymE2_UDkS5-8y3yHjxOXFw\\comments_videos\\ymE2_UDkS5-8y3yHjxOXFw_comments.mp4', 'thumbtitlevideo': 'data\\raw\\trashy\\tmp\\ymE2_UDkS5-8y3yHjxOXFw\\thumb_videos\\ymE2_UDkS5-8y3yHjxOXFw_thumb.mp4', 'postvideo': 'data\\raw\\trashy\\tmp\\ymE2_UDkS5-8y3yHjxOXFw\\post_videos\\ymE2_UDkS5-8y3yHjxOXFw_post.mp4', 'uploadmp4': 'data\\raw\\trashy\\tmp\\ymE2_UDkS5-8y3yHjxOXFw\\upload_videos\\ymE2_UDkS5-8y3yHjxOXFw.mp4', 'commentvideodir': 'data\\raw\\trashy\\tmp\\ymE2_UDkS5-8y3yHjxOXFw\\comments_videos', 'framedir': 'data\\raw\\trashy\\tmp\\ymE2_UDkS5-8y3yHjxOXFw\\comments_videos\\frame', 'ttsdir': 'data\\raw\\trashy\\tmp\\ymE2_UDkS5-8y3yHjxOXFw\\comments_videos\\sound', 'titlevideodir': 'data\\raw\\trashy\\tmp\\ymE2_UDkS5-8y3yHjxOXFw\\thumb_videos', 'postvideodir': 'data\\raw\\trashy\\tmp\\ymE2_UDkS5-8y3yHjxOXFw\\post_videos', 'uploaddir': 'data\\raw\\trashy\\tmp\\ymE2_UDkS5-8y3yHjxOXFw\\upload_videos', 'scenepath': 'data\\raw\\trashy\\tmp\\ymE2_UDkS5-8y3yHjxOXFw\\scenes\\\\ymE2_UDkS5-8y3yHjxOXFw.txt', 'scenetext': 'Sex AND violence!   Please try to confine your use-case into one or two code-samples that are self-contained, by which I mean:

A sample of code, or maybe two, that should be ran after each-other.
That demonstrates your problem.
That other people can run on their machine as well.

When you do that, my experience is that either of these happen:

During making this example you find out what your problem was and are able to fix it.
I can reproduce your problem, and I can suggest how to fix it.
There's a bug in itemdb and I can work on fixing that.

all is about unique key
scenestatus is not .post_id is
for unique key you can do  the following but other keys are not.
those following examples are all not working as supposed to be
        count = len(db.select(tablename, "post_link==?",post_link))
    postlist.extend(db.select(tablename, "status==?", 0))

So any field names provided to ensure_table are indexed. These are the field that you can do queries on. Unique items are indexed and must be unique.
Ok, here's an example that you can run. Perhaps you can provide a modified version that shows your problem?
import itemdb

# Create in-memory database
db = itemdb.ItemDB(":memory:")
db.ensure_table("mytable", "!id", "age")

# Put some items in
with db:
    db.put_one("mytable", id=1, age=20, name="Jill")
    db.put_one("mytable", id=2, age=30, name="John")
    db.put_one("mytable", id=3, age=40, name="Jane")
    db.put_one("mytable", id=4, age=50, name="Jack")

# Now we can get items
print(db.count("mytable", "age > ?", 15))  # 4
print(db.count("mytable", "age > ?", 35))  # 2
print(db.select_one("mytable", "id == ?", 1))  # {'id': 1, 'age': 20, 'name': 'Jill'}
print(db.select_one("mytable", "age == ?", 30)) # {'id': 2, 'age': 30, 'name': 'John'}

# But this raises an IndexError.
# If you add "name" to the ensure_table() call, this will work.
print(db.select_one("mytable", "name == ?", "John"))

I will try to give you a real example to reproduce my problem
what you show is in doc that i know.


Supports recreate constraints

Is your feature request related to a problem? Please describe.
Now the recreate constraint needs to be removed first before adding.
Database: postgresql
Generate DDL
ALTER TABLE public.newtable_3 DROP CONSTRAINT newtable_3_pk;
ALTER TABLE public.newtable_3 ADD CONSTRAINT newtable_3_pk PRIMARY KEY (column1,column2);

The same constraint operation can be combined together
ALTER TABLE public.newtable_3 DROP CONSTRAINT newtable_3_pk,
 ADD CONSTRAINT newtable_3_pk PRIMARY KEY (column1,column2);

or
Add multiple constraints and delete them
ALTER TABLE public.newtable_3 DROP CONSTRAINT newtable_3_pk,
 ADD CONSTRAINT newtable_3_pk PRIMARY KEY (column1,column2),
 ADD CONSTRAINT newtable_3_cc unique (column3);

Hi. Can you please explain the advantages of such an approach? Unfortunately, I'm not that proficient in this area. Thanks.

Performing together is an atomic operation. For example, if you want to modify a constraint, if you divide it into 2 statements, there will be a successful deletion but an unsuccessful addition.
Example:
I'm going to change the constraint newtable_3_pk from column1 to column2,column3. However, coolumn2 and column3 violate the constraint data, and the constraints executed together will not be deleted, and the original constraints will be retained.
Splitting the constraint into two constraints was deleted successfully but the new one was not created successfully
create TABLE public.newtable_3 (
    column1 bigint not null,
    column2 bigint not null,
    column3 bigint not null
);

ALTER TABLE public.newtable_3 ADD CONSTRAINT newtable_3_pk PRIMARY KEY (column1);
insert into public.newtable_3 values (1,1,1);
insert into public.newtable_3 values (2,1,1);

ALTER TABLE public.newtable_3 DROP CONSTRAINT newtable_3_pk,
ALTER TABLE public.newtable_3 ADD CONSTRAINT newtable_3_pk PRIMARY KEY (column2,column3);

postgres=# create TABLE public.newtable_3 (
postgres(#     column1 bigint not null,
postgres(#     column2 bigint not null,
postgres(#     column3 bigint not null
postgres(# );
CREATE TABLE
postgres=#
postgres=# ALTER TABLE public.newtable_3 ADD CONSTRAINT newtable_3_pk PRIMARY KEY (column1);
ALTER TABLE
postgres=# insert into public.newtable_3 values (1,1,1);
INSERT 0 1
postgres=# insert into public.newtable_3 values (2,1,1);
INSERT 0 1
postgres=# \dt newtable_3
           List of relations
 Schema |    Name    | Type  |  Owner
--------+------------+-------+----------
 public | newtable_3 | table | postgres
(1 row)

postgres=# \d+ newtable_3
                                Table "public.newtable_3"
 Column  |  Type  | Collation | Nullable | Default | Storage | Stats target | Description
---------+--------+-----------+----------+---------+---------+--------------+-------------
 column1 | bigint |           | not null |         | plain   |              |
 column2 | bigint |           | not null |         | plain   |              |
 column3 | bigint |           | not null |         | plain   |              |
Indexes:
    "newtable_3_pk" PRIMARY KEY, btree (column1)
Access method: heap

postgres=# select * from public.newtable_3;
 column1 | column2 | column3
---------+---------+---------
       1 |       1 |       1
       2 |       1 |       1
(2 rows)

postgres=# ALTER TABLE public.newtable_3 DROP CONSTRAINT newtable_3_pk,
postgres-#  ADD CONSTRAINT newtable_3_pk PRIMARY KEY (column2,column3);
ERROR:  could not create unique index "newtable_3_pk". ---> error
DETAIL:  Key (column2, column3)=(1, 1) is duplicated.
postgres=# \d+ newtable_3
                                Table "public.newtable_3"
 Column  |  Type  | Collation | Nullable | Default | Storage | Stats target | Description
---------+--------+-----------+----------+---------+---------+--------------+-------------
 column1 | bigint |           | not null |         | plain   |              |
 column2 | bigint |           | not null |         | plain   |              |
 column3 | bigint |           | not null |         | plain   |              |
Indexes:
    "newtable_3_pk" PRIMARY KEY, btree (column1).  -- old CONSTRAINT no delete
Access method: heap

postgres=# ALTER TABLE public.newtable_3 DROP CONSTRAINT newtable_3_pk;
ALTER TABLE
postgres=# ALTER TABLE public.newtable_3 ADD CONSTRAINT newtable_3_pk PRIMARY KEY (column2,column3);
ERROR:  could not create unique index "newtable_3_pk"
DETAIL:  Key (column2, column3)=(1, 1) is duplicated.
postgres=# \d+ newtable_3
                                Table "public.newtable_3"
 Column  |  Type  | Collation | Nullable | Default | Storage | Stats target | Description
---------+--------+-----------+----------+---------+---------+--------------+-------------
 column1 | bigint |           | not null |         | plain   |              |
 column2 | bigint |           | not null |         | plain   |              |
 column3 | bigint |           | not null |         | plain   |              |
Access method: heap

Ok, thanks for the idea @travelliu


Support "find by selector"

The IDE will have a menu option to “find by selector”, which will improve the experience for writing selectors for traits or custom validators.  When a selector is entered into the dialog, all matching shapes will be highlighted in the model.  The same highlighting will be activated when a selector in the model is right-clicked and the “Find by selector” option is clicked on the context menu.
The LSP will provide an API for the IDE to using the input selector and providing shapes and their locations back to the IDE for highlighting.

This was added in #36.


Roles not created onReady.

Have checked it Bot join functionality is not present in the code will add that.


importing numpy consistently throws error and crashes importing mechanism

Description of your problem
What steps will reproduce the problem?

Open Spyder
isseu 'import numpy' (no matter in script or console)

What is the expected output? What do you see instead?
Instead of importing the package, following error is thrown:
WARNING:traitlets:kernel died: 3.000523805618286
Traceback (most recent call last):
File "C:\Programm2\Anaconda4\lib\site-packages\qtconsole\base_frontend_mixin.py", line 163, in _dispatch
handler(msg)
File "C:\Programm2\Anaconda4\lib\site-packages\spyder\widgets\ipythonconsole\namespacebrowser.py", line 188, in _handle_execute_reply
self.handle_exec_method(msg)
File "C:\Programm2\Anaconda4\lib\site-packages\spyder\widgets\ipythonconsole\shell.py", line 225, in handle_exec_method
properties = ast.literal_eval(data['text/plain'])
File "C:\Programm2\Anaconda4\lib\ast.py", line 46, in literal_eval
node_or_string = parse(node_or_string, mode='eval')
File "C:\Programm2\Anaconda4\lib\ast.py", line 35, in parse
return compile(source, filename, mode, PyCF_ONLY_AST)
File "", line 28
'numpy': {'array_ndim': ,
^
SyntaxError: invalid syntax (hat pointing to <func..)

This is sepcific to the numpy package: Before running 'import numpy' I could import none or any other package without problems. Once the error is thrown, the same error will be then thrown again each time i try to import any other package.
This is specific to spyder. No problem importing in iPython, IPython Notebook.
can reproduce the error any time
complete un- and reinstall did not change any behaviours

Thanks for help!
Please provide any additional information below
Versions and main components

Spyder Version: 3.0.0
Python Version: 3.5.2
Operating system: Windows 10

Dependencies
Please go to the menu entry Help > Optional Dependencies (or
Help > Dependencies), press the button Copy to clipboard
and paste the contents below:
jedi >=0.8.1     :  0.9.0 (OK)
matplotlib >=1.0 :  1.5.3 (OK)
nbconvert >=4.0  :  4.2.0 (OK)
numpy >=1.7      :  1.11.1 (OK)
pandas >=0.13.1  :  0.18.1 (OK)
pep8 >=0.6       :  1.7.0 (OK)
pyflakes >=0.6.0 :  1.3.0 (OK)
pygments >=2.0   :  2.1.3 (OK)
pylint >=0.25    :  1.5.4 (OK)
qtconsole >=4.2.0:  4.2.1 (OK)
rope >=0.9.4     :  0.9.4-1 (OK)
sphinx >=0.6.6   :  1.4.6 (OK)
sympy >=0.7.3    :  1.0 (OK)

Please open a terminal (i.e. cmd.exe), run this command
spyder --reset

and try again

Thanks Carlos!
Already downgraded to 4.1 (Spyder 2),  No new issues so far. Will upgrade again and give it a shot once I got some spare time.

Closing as a duplicate of issue #3528.


Create Docker image with neo4j v.4.3+ and relationship indexes

Statement of problem
Because of the size of Data Distillery, we need relationship indexes. The relationship index was introduced in v4.3 of neo4. The standard neo4j image for HuBMAP is at v 4.2.5, and there is currently no plan to upgrade neo4j for HuBMAP.
Solution
Create a new version of the UBKG Docker distribution architecture to support Data Distillery. This would include:

A new Docker image running neo4j with a version level of at least 4.3.
Cypher commands to create relationship indexes in the new version, but not the current version.
A way for the build script to determine the Docker image to use. This may require separate versions of the scripts or logic in the scripts--e.g., a version parameter.

Relationship indexes to add:

Concept-Concept, on SAB
Concept-Concept, on type
Concept-Concept, on composite of SAB and type

Cancelling this in favor of upgrading to neo4j version 5.


paste in package

I work with private packages that are not hosted on npm...
so it would make life easier if it where just possible to copy paste in the raw content of the package.json (or the file itself) and paste it in anywhere onto the site

Example UI from https://www.remove.bg

as long as the windows has focus then it's okey to use it. (window.onpaste) otherwise a thing like clipboard access and reading it from clipboard on a click event could work too Read json package from clipboard

Just a quick note to add that being able to work with yarn.lock files would be nice as well

Just noting that this should be straight-forward to implement now that we have the packages hash param.


delimiters in properties.yml doesn't work correctly

Is this a new bug in dbt-core?

[X] I believe this is a new bug in dbt-core
[X] I have searched the existing issues, and I could not find an existing issue for this bug

Current Behavior
when i put
delimiter : "|"
Expected Behavior
create table from seed
Steps To Reproduce
put delimiter "|" in the properties.yml
Relevant log output
Error while reading data, error message: CSV processing encountered too many errors, giving up. Rows: 0; errors: 5; max bad: 0; error percent: 0
  Error while reading data, error message: CSV table references column position 8, but line contains only 1 columns.; line_number: 2 byte_offset_to_start_of_line: 85 column_index: 8 column_name: "timestamp" column_type: STRING
  Error while reading data, error message: CSV table references column position 8, but line contains only 1 columns.; line_number: 3 byte_offset_to_start_of_line: 204 column_index: 8 column_name: "timestamp" column_type: STRING
  Error while reading data, error message: CSV table references column position 8, but line contains only 1 columns.; line_number: 4 byte_offset_to_start_of_line: 311 column_index: 8 column_name: "timestamp" column_type: STRING
  Error while reading data, error message: CSV table references column position 8, but line contains only 1 columns.; line_number: 5 byte_offset_to_start_of_line: 413 column_index: 8 column_name: "timestamp" column_type: STRING
  Error while reading data, error message: CSV table references column position 8, but line contains only 1 columns.; line_number: 6 byte_offset_to_start_of_line: 515 column_index: 8 column_name: "timestamp" column_type: STRING
  You are loading data without specifying data format, data will be treated as CSV format by default. If this is not what you mean, please specify data format by --source_format.
15:25:31
15:25:31  Done. PASS=3 WARN=0 ERROR=1 SKIP=0 TOTAL=4

Environment
- OS:
- Python:
- dbt: 1.7.7

Which database adapter are you using with dbt?
bigquery
Additional Context
No response

Thanks for reporting this @salimmoulouel !
Could you provide more code details to help us reproduce what you are seeing?
For example, something like this:
seeds/my_seed.csv
col_a|col_b|col_c
1|2|3
4|5|6

seeds/properties.yml
seeds:
  - name: my_seed
    config:
      delimiter: "|"

I was able to reproduce this bug.
col_a|col_b|col_c
1|2|3
4|5|6

When I configure my seed delimiter in a properties yml file:
seeds:
  - name: test_delimiter
    config:
      delimiter: "|"

I get a failure:
15:49:06 Completed with 1 error and 0 warnings:
15:49:06   Database Error in seed test_delimiter (seeds/test_delimiter.csv)
  001003 (42000): SQL compilation error:
  syntax error line 1 at position 58 unexpected '|'.

However, I am able to configure this in my dbt_project.yml file:
seeds:
  coalesce_ci_demo_2023:
    test_delimiter:
      +delimiter: "|"

and get a successful dbt seed:
15:50:04 Finished running 1 seed in 0 hours 0 minutes and 4.33 seconds (4.33s).
15:50:04 Completed successfully

We should either update the docs or allow folks to configure the delimiter in the properties yml file.


PICARD client launch issue

Hi
I am executing the Eval code on the spider data with picard using docker image
provided 777 permission to mentioned 2 directories
'make eval'
inside docker -> Install stanza package
python3 seq2seq/eval_run_seq2seq.py configs/spider/eval_spider_rasat_4160.json
After preprocessing , generating relation i got following error :
`
Use relation model.
Traceback (most recent call last):
File "seq2seq/eval_run_seq2seq.py", line 309, in
main()
File "seq2seq/eval_run_seq2seq.py", line 197, in main
model = model_cls_wrapper(T5ForConditionalGeneration).from_pretrained(
File "seq2seq/eval_run_seq2seq.py", line 184, in
model_cls=model_cls, picard_args=picard_args, tokenizer=tokenizer, schemas=dataset_splits.schemas
File "/app/seq2seq/utils/custom_picard_model_wrapper.py", line 482, in with_picard
asyncio.run(_init_picard(), debug=False)
File "/opt/conda/lib/python3.7/asyncio/runners.py", line 43, in run
return loop.run_until_complete(main)
File "/opt/conda/lib/python3.7/asyncio/base_events.py", line 587, in run_until_complete
return future.result()
File "/app/seq2seq/utils/custom_picard_model_wrapper.py", line 126, in _init_picard
await _register_schema(db_id=db_id, db_info=db_info, picard_client=client)
File "/app/seq2seq/utils/custom_picard_model_wrapper.py", line 132, in _register_schema
await picard_client.registerSQLSchema(db_id, sql_schema)
thrift.py3.exceptions.TransportError: (<TransportErrorType.UNKNOWN: 0>, 'Channel is !good()', 0, <TransportOptions.0: 0>)
`
Enviornment : Macbook

Hello, I fixed this problem by changing time.sleep(1) to 10 in line seq2seq/utils/picard_model_wrapper.py 95. I guess because the child process has not started successfully, the main process connected, so this error will be reported.

Thank you @Tomcatiiii for the suggestion. I updated code as per your comment, but still facing same error. Is there any other way to resolve it. I am trying to reproduce the results of RASAT+PICARD, and facing this issue.


Convergence plans with joyent/docker-node team

As per https://github.com/joyent/docker-node/issues/28 I've added @chorrell and @dcrudgington to the @nodejs/docker team. Handing over to y'all now to discuss how to converge your resources to continue to produce both images but as a combined team. Timing and the details of how you manage both repos are entirely up to you of course. As usual if you need any resources from the Build WG then just @-mention us and we'll come running.
Happy times!

Also going to ping @mhart who maintains an alpine-node container and really should be involved in this WG!

Much :heart:! Glad to be working with you all!

Awesome 😄🚀

So I think we can probably just move the docker-node repo over to http://github.com/nodejs/ this week or next if everyone ls fine with that. We probably need to coordinate a few things though :)
For the short term (pre-merge) I'm fine with being the point maintainer of the docker-node image for any updates. I have admin rights to initiate the org switch, I'll just need someone to accept it on the nodejs end.
In terms of the docker-registry, we'll need to do a follow-up pull request to https://github.com/docker-library/official-images. I can handle that.

Sounds like a good plan @chorrell 😄
Are there any points in merging the two repos?

There are a few things I think we'll want to talk about:

See where things diverge in the Dockerfiles and make a call on what we want to do there. I think docker-node has a slightly different slim variant and also has an additional wheezy variant. I also recently merged this: https://github.com/joyent/docker-node/pull/31. We'll want to incorporate that :)
Update the docker-node README.md and LICENSE?
Review the update process. For docker-node we have been handling updates for Node.js and npm separately. That will change with the upcoming merged version as I expect npm will be bundled with node-v$NODE_VERSION-linux-x64.tar.gz. I think it would also be good to just talk about general work-flow too. How do you generally handle releases?
Review outstanding issues and pull requests. There are a few on the docker-node side that I left open since I wanted to have a broader discussion with the @nodejs/docker team (for example https://github.com/joyent/docker-node/pull/30 and https://github.com/joyent/docker-node/pull/11)
Testing? For docker-node, we do a simple build test to shake out any obvious issues. I'd like to keep doing that and eventually do some more sophisticated testing (see https://github.com/joyent/docker-node/blob/master/test-build.sh and also my testing experiment here )

Oh, also, I'm looking into dropping the 0.8 tag: https://github.com/joyent/docker-node/issues/34. v0.8.x hasn't been updated in a while, so it seems like an easy call to make. I'd like to wait until after the org switch though.

@chorrell re: testing. I've built https://github.com/wblankenship/dante to automate testing.
I created a branch https://github.com/wblankenship/docker-iojs/tree/tests that shows dante smoke testing iojs.
Really the only work left is getting it into a Jenkins buiild. I've setup a server for us on Digital Ocean, and started writing an ansible script to automate setting it up, but am only about half way there.

Noite: to run the tests, simply run dante in the root of that project. It reads inventory.ini and builds the dockerfiles and tests.
At this point, all we need to do is get it into Jenkins. Jenkins is pretty foreign to me, so if  someone knows there way around it and wants to tackle it, here is the current state of our jenkins build server: https://github.com/wblankenship/docker-integration

Oh, interesting. Nice.
Er, how do you install dante?

Good question. Right now I'm just building from source (go install dante).
Relatively new to go package distribution, I assume best practice here is to deliver a prebuilt binary? I'll cut a release now.

@chorrell woah, go's crosscompiling support is wicked awesome. Just cut a release, let me know if you have any problems with these binaries: https://github.com/wblankenship/dante/releases/tag/v1.0.0

oh, nice! The dante-darwin-amd64 binary worked just fine for me

@chorrell https://github.com/nodejs/build/issues/168

:+1:

Hi all,
I'm going to kick off the org switch today to move docker-node to the nodejs org.
After that I'm going to create a fork and work on testing a Node.js 4.0.0 RC-1 docker image to prep for a 4.0.0 release.

Oh, and I'll handle the update and pull request for https://github.com/docker-library/official-images too :)

"You don’t have admin rights to nodejs" Doh. That didn't work the way I expected it too...
Reading this: https://help.github.com/articles/transferring-a-repository/

On the other end, the person transferring the repository also needs to have admin rights in the receiving organization.

Apparently I need admin rights in nodejs...

@chorrell can you add me to that repo? I can move the repo and add whatever teams you need on it.

@mikeal Will do, thanks!

Done, you should be an admin for the repo now

I must be pulling up the wrong link, which repo and I transferring? :)

Nice, thanks!

Thanks @mikeal

@mikeal Hmm, I don't think the docker team has admin-type access yet: https://github.com/orgs/nodejs/teams/docker/repositories

Or I just don't understand how teams and admin access etc work...

I added docker-node to the repos list for that team, you should all now have admin on both repos

@chorrell should we consolidate the docker repos or just discontinue the docker-iojs one?

@Starefossen I think we should definitely consolidate some things. For instance I would love to the automated testing work added to the nodejs image: https://github.com/nodejs/docker-iojs/issues/46

Oh, and the README!

I'm closing this now since the converge has been completed.


Thrift compile error in easy install script.

I executed "sudo curl -sk https://raw.githubusercontent.com/facebook/fblualib/master/install_all.sh | bash"
The Thrift make script is unable to find Folly.  I have included a partial listing of the script output below.  I am using Ubuntu 14.04 LTS.

thrift 12.0
Building C++ Library ......... : yes
If something is missing that you think should be present,
please skim the output of configure to find the missing
component.  Details are present in config.log.
make  all-recursive
make[1]: Entering directory /tmp/fblualib-build.FxIfGT/fbthrift/thrift' Making all in compiler make[2]: Entering directory /tmp/fblualib-build.FxIfGT/fbthrift/thrift/compiler'
make  all-recursive
make[3]: Entering directory /tmp/fblualib-build.FxIfGT/fbthrift/thrift/compiler' Making all in . make[4]: Entering directory /tmp/fblualib-build.FxIfGT/fbthrift/thrift/compiler'
...Many lines elided...
Processing thrift_py-0.9.0-py2.7.egg
creating /tmp/fblualib-build.FxIfGT/fbthrift/thrift/.python-local/lib/python/thrift_py-0.9.0-py2.7.egg
Extracting thrift_py-0.9.0-py2.7.egg to /tmp/fblualib-build.FxIfGT/fbthrift/thrift/.python-local/lib/python
Adding thrift-py 0.9.0 to easy-install.pth file
Installed /tmp/fblualib-build.FxIfGT/fbthrift/thrift/.python-local/lib/python/thrift_py-0.9.0-py2.7.egg
Processing dependencies for thrift-py==0.9.0
Finished processing dependencies for thrift-py==0.9.0
make[4]: Leaving directory /tmp/fblualib-build.FxIfGT/fbthrift/thrift/compiler/py' make[3]: Leaving directory /tmp/fblualib-build.FxIfGT/fbthrift/thrift/compiler'
make[2]: Leaving directory /tmp/fblualib-build.FxIfGT/fbthrift/thrift/compiler' Making all in lib make[2]: Entering directory /tmp/fblualib-build.FxIfGT/fbthrift/thrift/lib'
Making all in thrift
make[3]: Entering directory `/tmp/fblualib-build.FxIfGT/fbthrift/thrift/lib/thrift'
../../compiler/thrift1 --gen cpp:templates,cob_style -r reflection.thrift
../../compiler/thrift1: error while loading shared libraries: libfolly.so.14: cannot open shared object file: No such file or directory

Got the same problem

Same problem when trying to build on a fresh docker container on the ubuntu:14.04 image.

Use this forked script instead. I fixed a few things in that fork repository.
https://github.com/soumith/fblualib/blob/master/install_all.sh
We will push this back to the mainline soon cc: @tudor

Thanks, that solved that problem. The installation script is still failing at a later stage though, with:
CMake Error at CMakeLists.txt:26 (FIND_PACKAGE):
  By not providing "FindTorch.cmake" in CMAKE_MODULE_PATH this project has
  asked CMake to find a package configuration file provided by "Torch", but
  CMake did not find one.

  Could not find a package configuration file provided by "Torch" with any of
  the following names:

    TorchConfig.cmake
    torch-config.cmake

  Add the installation prefix of "Torch" to CMAKE_PREFIX_PATH or set
  "Torch_DIR" to a directory containing one of the above files.  If "Torch"
  provides a separate development package or SDK, be sure it has been
  installed.

-- Configuring incomplete, errors occurred!
See also "/tmp/fblualib-build.YvyG5l/thpp/thpp/build/CMakeFiles/CMakeOutput.log".

Presumably because this block is missing from the forked install_all.sh:
echo
echo '(Re)Installing Torch dependencies'
echo

curl -sk https://raw.githubusercontent.com/torch/ezinstall/master/install-deps | bash
curl -sk https://raw.githubusercontent.com/torch/ezinstall/master/install-luajit+torch | bash

Yes it assumes that torch is already installed, and we preferred that, as torch install seems like a separate process

But you need torch installed within the last ~2 months, as there were some
recent changes that were needed (notably, LuaJIT needs to be compiled with
Lua 5.2 compatibility support).
-Tudor.
On Fri, Jan 16, 2015 at 6:19 PM, Soumith Chintala<EMAIL_ADDRESS>wrote:

Yes it assumes that torch is already installed, and we preferred that, as
torch install seems like a separate process
—
Reply to this email directly or view it on GitHub
https://github.com/facebook/fblualib/issues/6#issuecomment-70350545.

Thanks, everything works now. I also had to apt-get install unzip and apt-get install cmake to get  install_all.sh to work.

I run install_all.sh at my Ubuntu 14.04 , But it always stopped at : " cannot find folly " when installing fbthrift... what went wrong?

@ayanamongol  I also met the problem. Any suggestion?

I added the following piece of code in the forked install_all.sh
'echo
echo '(Re)Installing Torch dependencies'
echo
curl -sk https://raw.githubusercontent.com/torch/ezinstall/master/install-deps | bash
curl -sk https://raw.githubusercontent.com/torch/ezinstall/master/install-luajit+torch | bash'
But Torch has been installed in /usr/local/ now. Would this create an issue? I have Torch already installed in home/torch
Would I have to change something in bashrc?


[📚] Missing square brackets in the regexp in firebase_messaging/FirebaseMessaging/subscribeToTopic

Current text:
topic must match the following regular expression: "a-zA-Z0-9-_.~%{1,900}".
Should be:
topic must match the following regular expression: "[a-zA-Z0-9-_.~%]{1,900}".

Hi @ma-ruz
Can you confirm the source of where you are getting the current text?

Hi @ma-ruz
Can you confirm the source of where you are getting the current text?

Hi @dackers86 ,
it's on https://pub.dev/documentation/firebase_messaging/8.0.0-dev.11/firebase_messaging/FirebaseMessaging/subscribeToTopic.html
Seems like there are square brackets in the docs source but they are converted to formatting as  so probably some escape character is missing...

Hi @dackers86 ,
it's on https://pub.dev/documentation/firebase_messaging/8.0.0-dev.11/firebase_messaging/FirebaseMessaging/subscribeToTopic.html
Seems like there are square brackets in the docs source but they are converted to formatting as  so probably some escape character is missing...


Add missing impl TryFrom<&Var> in Rust

TryFrom implementations for some types are missing in types.rs
I've already started some of the work here:
https://github.com/fragcolor-xyz/shards/tree/rust_var_as_i32
Ideally we should cover/consolidate as many types as we can and clean up the code if necessary.

Hey team! Please add your planning poker estimate with ZenHub @inabe-a @sinkingsugar


Polling place scenario

Rather time-sensitive, and a bit dangerous to not provide: if people try to roll their own and do so pessimistically, we'll be disproportionately encouraging smart, numerate people not to vote. Whoops.
I think a plausible scenario here would be:

2 average people, 6 feet away
Indoor, 10 minutes
They're wearing a basic mask
You're wearing a surgical mask
Not talking

Which makes an Activity Risk of 0.1%, or 0.8 microCOVIDs in SF currently. Low risk for a 0.1% person, very low for a 1% person.

<3

Two thumbs up: 👍👍


Build and push environment image to staging & prod

Our latest merge into staging (#101) wasn't able to build the image. Here is the action failure:
https://github.com/utoronto-2i2c/jupyterhub-deploy/runs/3703954261#step:5:1463
We should build this image and push to staging, in order to understand if it resolves https://github.com/utoronto-2i2c/jupyterhub-deploy/runs/3703954261#step:5:1463

closing this in favor of https://github.com/utoronto-2i2c/jupyterhub-deploy/pull/116 (and I've reverted the original PR for this)


chore: reduce memory usage of webpack

webpack for build-min is called with --max_old_space_size=2048
which seems to make travis work again, but we don't know
exactly what this flag is doing, and what was the default
value that we were using.
https://github.com/nodejs/node/issues/7937
This commit also clean some vestigial code from .travis.yaml that
is not needed now that we test inside the docker container.

Here's some info on the --max_old_space_size flag:
https://github.com/nodejs/node/issues/7937


Created reviews table along with endpoints to access the review data

Objective
The objective of this pull request is to create a reviews migration that contains information about the review, a mentor_id to display the profile Id of the mentor who gave the review, and a mentee_id to represent the mentee profile Id. To populate the database, a sample review seed has been generated. The endpoints to access the reviews have been created inside of reviews router along with middleware for authentication.
Video Link
Loom Video
Checklist:

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[x] I have removed unnecessary comments/console logs from my code
[x] I have made corresponding changes to the documentation if necessary (optional)
[x] My changes generate no new warnings
[x] I have checked my code and corrected any misspellings
[x] No duplicate code left within changed files
[x] Size of pull request kept to a minimum
[x] Pull request description clearly describes changes made & motivations for said changes

Changes requested by @BrittniKarat have been updated accordingly.