Modify conditional to use rhel8cis_crypto_policy variable

Overall Review of Changes:
Check ignores the current setting of the rhel8cis_crypto_policy variable, assuming that the current policy is LEGACY (DEFAULT is the installation default). This effectively makes the rhel8cis_crypto_policy useless if the current policy is not LEGACY.
Since DEFAULT is the default setting on RockyLinux 8, the setting is never modified to FUTURE and results in a failed audit check.
Issue Fixes:
Modify the conditional to compare the value of rhel8cis_crypto_policy to the current value of system_wide_crypto_policy, if they don't match, apply the value from rhel8cis_crypto_policy.
How has this been tested?:
Modified the system-wide value to LEGACY and ran playbook, value was changed to FUTURE as expected.
Modified the system-wide value to DEFAULT and ran playbook, value was changed to FUTURE as expected.

Hi @andrewmiskell
Thank you for taking the time to contribute and helping to improve this benchmark, all and any feedback is greatly appreciated.
The variable and other contained in defaults/main.yml are changeable to allow users to set what is appropriate for their environment and in accordance with their own policies.
While i agree with the details you have added, we are trying to abide by the latest release, to ensure compliance with the benchmark requirements itself, which is to ensure it not LEGACY. Which is also the title of the control.
What maybe better it to change the variable rhel8cis_crypto_policy value to DEFAULT (FUTURE does break alot of things users consider normal).
We could then adopt the changes you have kindly provided and have less breaking changes?
If that works for you we can take that pull request with the change but we do also request that all commits are DCO and signed, so we would need to ensure that is added to the PR also.
Many thanks
uk-bolly

DEFAULT is the default value of the variable already, looks like I was working off an old version of the baseline v1.x were it was recommending FUTURE.
Do I need to resubmit the PR with the appropriate sign off on the commit?

@andrewmiskell,
Thanks for the PR they are always helpful. You will need to re-submit it with the the sign-off bit, it looks like it is gpg signed so we are OK there. Another change that will need to be made is the title will need to be changed back to "Ensure system-wide crypto policy is not legacy" since that is the actual title of the control and we can't deviate from that. Once those two changes are done we can accept the merge.
-George

I added this change to the #173 PR, thanks for the fix update and I will give a mention for the work in the commit.
-George

Thanks @georgenalen! I was going to get around to re-submitting the PR this afternoon. Had been sick the past few days.


feat: batch updates

This batches several updates into one. This changes the update behavior in timing.

This might raise other issues, but let's see how it goes. Please file an issue if anyone finds any.


Is it tested with Lollipop on N7?

Hey, not sure if I should post this in issues, but I need to know is it really working with Lollipop? I'm doing some project for college using this kernel, and I really want to switch to Android 5.0.

I've tested it on Nexus 7 2012 with Lollipop, so it should work.
On Jan 8, 2015 11:54 AM, "akrezic1"<EMAIL_ADDRESS>wrote:

Hey, not sure if I should post this in issues, but I need to know is it
really working with Lollipop? I'm doing some project for college using this
kernel, and I really want to switch to Android 5.0.
—
Reply to this email directly or view it on GitHub
https://github.com/pelya/android-keyboard-gadget/issues/19.

Thanks for fast reply, can't wait to flash Lollipop!


Automated cherry pick of #4678: Remove config for Endpoints API when feature gate

Cherry pick of #4678 on release-1.8.
#4678: Remove config for Endpoints API when feature gate
For details on the cherry pick process, see the cherry pick requests page.

/skip-all


Rewrite Keys

Draft PR, some things easy to view in GH interface...

this looks really great @nc6

Still haven't managed to add all of the coercions in the tests, which just use random keys all over the place :-(

Still haven't managed to add all of the coercions in the tests, which just use random keys all over the place :-(

yes, the serialization tests do use the same keys for different purposes, like payment or staking, which I can see would be a big bother for you now. :( I am happy to help get this across the line.

this is beautiful @nc6 , thank you!

I only just caught up with this PR, beautiful indeed! thanks @nc6


Respect formatting config when validating type property

This is to correct various errors caused by comparison of the camelcase key vs snake formatted class names, and vice versa. Please note that I'm using config.json_key_format = :camelized_key.

Sorry!  Didn't mean to include my other PR in this one.  I'm going to close this and break them out.


Feat: Flipkart laptop details Scaper

Describe the feature

I will add a scaper to fetch the laptop details available on Flipkart
I will follow the contributor's guide
I will upload documentation for the same

Add ScreenShots

Record

[X] I agree to follow this project's Code of Conduct
[X] I'm a GSSOC 23 contributor
[X] I want to work on this issue

Go ahead @filza2112
Note

Create a separate module for this, as per the folder and project structure
Do not use the `selenium web driver as it is incompatible with all devices and cloud platforms.
Before making any changes, please check whether the module you want to add exists. If yes, then you can just add your functionality as a method only make a separate module and class for it.

All the best 👨💻


Node sync tests improvements

resync the node after it was fully synced --> it should revalidate the existing db and continue syncing only the remaining part of the chain; In Babbage it was starting from genesis.

related to https://github.com/input-output-hk/cardano-node/issues/3870

related to https://github.com/input-output-hk/cardano-node-tests/issues/1230


carbon: make sure we touch metrics on all code path

Else metrics could disapear.

Coverage remained the same at 79.986% when pulling db38fa61a44d1244422730a3a2e5f22dedb009a7 on iksaif:master into de33005fe40ddb089c0e292116ff0499c926b8af on criteo:master.


owners: add ShiqianTao

good to have a second approver with Abel or else he's blocked most of his working hours.
What type of PR is this?

What this PR does / why we need it:
Which issue(s) this PR fixes:

Fixes #
Requirements:

[ ] uses conventional commit messages

[ ] includes documentation
[ ] adds unit tests
[ ] tested upgrade from previous version

Special notes for your reviewer:
Release note:
none

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 77.017%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
2091

Relevant Lines:
2715

💛  - Coveralls


Version 1.x: HTTPS does not work anymore (at all) (new version of openssl?)

Which version of PhantomJS are you using? Tip: run phantomjs --version.
1.9.8

Which operating system are you using?
Debian unstable

Did you use binary PhantomJS or did you compile it from source?
Binary
npm install<EMAIL_ADDRESS>

Here is a minimal test script:
'use strict';
var page = require('webpage').create();
page.onResourceReceived = function(response) {
  console.log('Response (#' + response.id + ', stage "' + response.stage + '"): ' + JSON.stringify(response, undefined, 2));
};
page.onResourceError = function(err) {
  console.log(JSON.stringify(err, undefined, 2));
};
page.open('http://www.iplocation.net/find-ip-address', function(status) {
  console.log("Status: " + status);
  if(status === "success") {
    console.log("Yay!");
  }
  phantom.exit();
});

At my company we still need to use PhantomJS 1 and it stopped working for all HTTPS URLs recently.
Running phantomjs --ignore-ssl-errors=true --ssl-protocol=any --web-security=false --debug=true script.js
gives
Error creating SSL context (error:140A90C4:SSL routines:func(169):reason(196))
Interestingly, using --ssl-protocol=tlsv1 gives a slightly different error:
Invalid or empty cipher list (error:1410D0B9:SSL routines:SSL_CTX_set_cipher_list:no cipher match)
With --debug=true we can see some relevant warnings:
[WARNING] QSslSocket: cannot call unresolved function SSLv23_client_method
and
[WARNING] QSslSocket: cannot call unresolved function sk_num
My idea is that openssl was updated and removed support for SSLv3 (which is vulnerable and deprecated). However using --ssl-protocol=any does not fix the problem so I'm not sure... In fact I was not able to make it work with any combination of parameters.
Does this affect anybody else? Any idea on how to make this work again?
Thanks!

All the same as you.
Same OS (debian unstable), same phantomjs version, using binary downloaded from site

Hi! Unfortunately, we don't support PhantomJS 1.x anymore. Please upgrade to 2nd version.
But if you really need PhantomJS 1.x you always can build it from sources.


Add binary printing support

This PR would close #81 based on method 2 outlined in that issue.

Hold on a tick, I'm not at my normal machine right now.

Right, that should be good : )

Thank you very much!


Add IKEA LED1837R5

Thanks for the PR!
Only .gz file has to be in repository, you may delete brightness.csv.
When standby_usage could not be measured it has to be set to 0.4 watt, which is a good approximation for zigbee bulbs.
You did use the hass powermeter right? I need to have a look at why this only provides single decimal precision. Preferable is two decimals.

Yes, the haas power meter was used. If two decimals accuracy is preferred, I can set up a ESPhome based meter instead, but I am unsure of the accuracy of those readings.
I’ll delete the .gz.

Would be interesting to also measure with the esphome based meter to see if you got similar readings.

Would be interesting to also measure with the esphome based meter to see if you got similar readings.

I'll set up an ESPhome meter tomorrow, and try to clibrate it before using it for measurements... 👍

Great thanks for your efforts!


LIDS analysis

Expand GGIR with an implementation of the Winnebeck LIDS analysis.
This is work in progress in the branch: https://github.com/wadpac/GGIR/tree/LIDSModificationsEva
(used to be: https://github.com/wadpac/GGIR/tree/issue95_sleepstructure)
Action points before test version:

[x] Address Eva's comments on script (1/8/2018)
[x] Send Eva response re. those comments
[x] Send Eva example AX3 file
[x] Add output variable on the duration of the wakefulness bout that succeeds the sleepbout.
[x] Add max and median correlation to output
[x] Add functionality to export LIDS data, including: LIDS in normalised, non-normalised, fitted, cycle, period, aggregated acceleration per minute (or whatever epoch length is used), etc.
[x] Check that all key arguments can be manipulated with g.shell.GGIR and are not hardcoded
[x] Go once more through implementation, improve comments
[ ] Improve terminology and variable names in both raw exports and aggregates summary measures

Prepare test version:

[ ] Improve the documentation and store an example R script somewhere online that stepwise shows how to run the LIDS analysis.
[ ] Wrap up as test GGIR version for others to play with

Action points after test version:

[ ] Implement plateau searching and investigate better the length of the data.
[ ] make sure key functions are covered by tests
[ ] store more QC information in the output to communicate why some analysis could not be done

Low priority:

[ ] remove empty rows in MM output
[ ] Looping through multiple sleepbouts and add boutnumber
[ ] Add option to truncate sleepbout length to 3 hours.
[ ] Add option to change epoch resolution (currently at 1 minute).

Hi Vincent,
did you have the following somewhere hidden on your to-do-list?

output of ENMO (5sec) of the over3h-bouts for systematic testing of the conversion to LIDS, LIDS analyses, etc?

prior wakefulness: did this include the wakefulness since the last sleep as well as the wakefulness over the last 24h?

Cheers,
Eva

Hi Vincent,
here is my first round of comments and suggestions on the current g.LIDS.analyse (https://github.com/wadpac/GGIR/blob/10bb7bba8280694f80ee1b0a03122d9dd58b1597/R/g.LIDS.analyse.R). I still need to go into your LIDS stationary analysis - but looks great already at first glance. Thank you!

LIDS_S output PRIORITY: Please could you extend the LIDS_S output to the same breadth as the LIDS_NS output? i.e. add variables analogous to LIDS_NS's time, LIDSraw, LIDSfitted, LIDSfitted_abs, cycle, cycle_full, cycle_interpol, etc. This is really crucial as this will - at least initially - be our main basis for analysis. The output with LIDS_NS is - for now - only additional.

Line 33 PRIORITY: threshold for binary 20 (in mg): Sorry, I just want to make absolutely sure the UKBiobank AX3 data are scaled in mg. My doubts are caused by the following: Although you have remarked that the AX3 files have ENMO in mg after GGIR processing, the cwa file (001_39434_0000000003_23-02-2018.cwa) that I received from you for tests definitely has ENMO in g after processing it with GGIR (for the cutoff to work, I either need to rescale ENMO by *1000 or adjust the threshold to 0.02). Was the test file not an AX3 file after all then or is the UKBiobank somehow processed differently?

Line 37: rollsum: We should add the option fill=NA here, so as not to drop the edges. This makes sure the entire original timeline is maintained and the later output in minutes reflects true "time since sleep onset" = biologically important.

Line 45 PRIORITY: rollmean: The option fill=extend just creates a plateau at the edges over 15 min. This is basically data without meaning for LIDS and is likely to distort the analysis. Therefore, we should replace with fill=NA instead of to keep the original timeline – see above).

Line 37 and 45: edges rolling mean and sum: If we want to reduce the loss at the edges of the time series caused by the two filters, we should consider switching to zoo::rollapply with the option partial=TRUE. This uses partial filter sizes so that the data points created incorporate at least some of the neighbouring points. We used this in our paper (sorry, don’t think I made this explicit in the methods) for the 30’ rollmean. However, this was on a 10-min basis i.e. just affected the first data point which was then the mean of two instead of three data points. Rollapply is apparently not optimised for speed as much as rollsum or rollmean, however.

Thanks Eva

At the moment I export the 5 second ENMO values by default for the whole measurement. Also exporting this per sleepbout would result in redundant data storage. Instead, I am exporting the 1 minute averages as part of LIDS_NS because those are at a 1 minute resolution. I understand that that is not really what you want. So, to solve this I could export the start and end time of the sleepbouts such that these time windows can be linked to the 5 second resolution ENMO values.

[ ] Export start and end times of sleep bouts

So far, I have only extracted the duration of the wakefulness period that directly follows the sleepbout. Wakefulness in the present night or in the 24 hours corresponding to the day on which the night started is stored elsewhere in the GGIR output. This is not compatible with the amount of wakefulness in the 24 hours preceding the sleepbout as you requested.

[ ] Investigate what we can do about this.

LIDS_S: I see what I can do. I think the first focus should be on having summary measures that are comparable such that we can start to get an idea of whether age group or sex differences can be reproduced.

[ ] Expand LIDS_S with time series

Units of acceleration are standardised in GGIR. After the data is first loaded it is stored in g, while in this part of the code they are multiplied by 1000 because the output needs to be in mg. One of the key characteristics of GGIR is that it takes care of this. So, no action needed.

Ok, thanks:

[ ] Implement fill=extend and partial=true.

Hi Vincent,
here is my second round of comments and suggestions on the current g.LIDS.analyse (https://github.com/wadpac/GGIR/blob/10bb7bba8280694f80ee1b0a03122d9dd58b1597/R/g.LIDS.analyse.R).

LIDS stationary fit: looks great! It produces slightly different results than my code in the RoO, cor and thus MRI output, but the general pattern is highly similar to my output and thus the selected period is the same - at least in the one night that I tested it in so far.

LIDS_NS output: when I run the full function or just the lines used to create the NS output, all results pertaining to the cos fit are NA. PCNS remains empty (NA) as well. I have not yet trialled further where the problem originates.

Hi Vincent,
my answers to your new action points above (don't seem to be able to find a good way to quote your issues, sorry, I am sure there is one!):

ENMO of sleep bouts:
Great idea! Going from start and end points should work well in principle - if one has the full GGIR output. But will we be able to get this from Exeter?

Wakefulness - no immediate priority: we need PRIOR wakefulness not FOLLOWING wakefulness. This is important to judge sleep homeostasis. PRIOR wakefulness till previous bout and PRIOR wakefulness in the preceeding 24hours. But this is not essential for the first test analysis.

LIDS_S output - HIGH PRIORITY:
Several of the stats we do relies on the time series itself, LIDSraw, cycles, cycles_norm, all plots rely on the normalised dataset.

ENMO units: great!

Edges of filters:
Please don't implement fill=extend but either fill=NA or partial=TRUE.

Update: Latest version of the code is in this branch: https://github.com/wadpac/GGIR/tree/LIDSModificationsEva
This is now up to date with latest version of the GGIR master branch (1.8-1).
In addition to the action points listed above I noticed that:

[ ] variable "LIDS_sleepboutstart_char" in the part5_daysummary_WW_...csv output has value 1, probably this should be a character with a timestamp. It is not key to the LIDS analysis, but probably good to get this fixed.

[ ] functions g.LIDS.analyse_ENMOsub and g.LIDS.analyse are very similar. Address redundancy by adapting function g.LIDS.analyse such that it can cover the functionality of both functions.

[ ] the time series related to the LIDS analysis have a lot of constants, would be good if we can avoid this unnecessary data storage, e.g. store constants in separate file like the part5_daysummary file which already has one row per night.

I have now merged the g.LIDS.analyse and g.LIDS.analyse_ENMOsub function to ease future development and maintenance.
Also, I have added the average acceleration and activity score per minute to the time series that are store to a csv file. Note that these cannot be used to recalculate the LIDS scores, because LIDS scores are derived from the 5 second resolution data and only aggregated per minute afterward.
Further, I have merged in the latest version of the master branch such that this branch is up to date again with other developments in GGIR.

Hi Vincent,
Thanks for the update!
Please ignore all action points from last year as they were about a very different version of the code.
Re. current action points:

I have now merged the g.LIDS.analyse and g.LIDS.analyse_ENMOsub function to ease future development and maintenance._

Sounds good if you prefer it that way. I had kept the two functions completely separate on purpose , so that we can simply ditch one once we know which one is better. I don't think we need both options long-term.

Also, I have added the average acceleration and activity score per minute to the time series to the csv output file. Note that these cannot be used to recalculate the LIDS scores, because LIDS scores are derived from the 5 second resolution data and only aggregated per minute afterward.

Great, thanks!

Further, I have merged in the latest version of the master branch such that this branch is up to date again with other developments in GGIR.

Great, thanks!
Further action points discussed on your visit to Munich:

[ ] How can we output the ENMO (5sec) of all sleep bouts for better LIDS development?

[ ] Extend analysis to also include other bouts of each SPT/night (not only bout1)

[ ] LIDS visualisation

[ ] Add sleep homeostasis variables: 1) prior wake (between last bout and this bout); 2) sleep/wake history over prior 24h - let's discuss via skype how to best estimate both based on your sleep detection

Thanks, Eva

Hi Eva,
The ENMO data is available, but possibly not in the most easy way. The 5 second ENMO values for the full recording are stored in the meta/ms2.out output folder in the IMP$metashort object. To extract the ENMO values corresponding to each 'sleep bout' used in the LIDS analysis the user will need to look up the variable LIDS_sleepboutstart_num in the day-level part 5 output (csv file stored in output folder 'results').  This variable is the numeric time relative relative to the previous midnight expressed in hours on which the 'sleep bout' started. Variable LIDS_sleepboutstart_char next to it gives the same time in clocktime for extra clarity. By combining the date and time of in the part 5 output, it will be possible to retrieve the corresponding ENMO values.
Variable LIDS_sleepboutstart_char errornesly resulted in value 1, which I fixed today.
Other action points sound good. It would be good if we (or somebody else) can find dedicated funding to do them as they easily take up a month of work.
Best, Vincent
PS. I understand "I had kept the two functions completely separate on purpose" , but this is a nightmare to work with, because every time I fix a bug I need to remember to fix it in both versions of the code. It is easier to add it as a subroutine, which can be removed at a later point.


chore: upgrade solidity to 0.8.21, keep evm_version at paris

Motivation
Upgrade to the newer solidity version so we can take advantage of new features like importing events. Pin the evm version to paris, since shanghai's push0 isn't supported by many l2s.
Change Summary

Upgrade solidity to 0.8.21
Pin evm_version to paris

Merge Checklist

[x] The PR title adheres to the conventional commits standard
[x] The PR has been tagged with change type label(s) (i.e. documentation, feature, bugfix, or chore)
[x] The PR's changes adhere to all the requirements in the contribution guidelines
[x] This PR does not require changes to the Farcaster protocol

PR-Codex overview
Focus of the PR:
Update Solidity version to 0.8.21 and make necessary imports and pragma changes.
Detailed summary:

Updated Solidity version from 0.8.19 to 0.8.21 in multiple files.
Updated solc_version in foundry.toml from "0.8.19" to "0.8.21".
Updated pragma solidity version in multiple files from 0.8.19 to 0.8.21.
Updated evm_version in foundry.toml from "paris".
Updated pragma solidity version in multiple files from 0.8.19 to 0.8.21.

✨ Ask PR-Codex anything about this PR by commenting with /codex {your question}

LGTM. A cleanup pass PR to use some of these features would be useful In addition to event imports, I think there are a few places we can use named mappings as well.


[no ticket] Add handbook-component blueprint

Purpose
Make it easy to add components to the handbook's component gallery.

Summary of Changes
Add a handbook-component blueprint, and describe it in the handbook:

Side Effects
n/a

Feature Flags
n/a

QA Notes
n/a

Ticket

n/a
Reviewer Checklist

[ ] meets requirements
[ ] easy to understand
[ ] DRY
[ ] testable and includes test(s)
[ ] changes described in CHANGELOG.md

Pull Request Test Coverage Report for Build 1488

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 61.067%

Totals

Change from base Build 1480:
0.0%

Covered Lines:
2288

Relevant Lines:
3547

💛  - Coveralls


Scores

Congratulations on your great work!
I have a problem with reproducing some of your scores from the paper.
I assume all the scores reported by you in the paper (not only in Table 2) have been obtained with GPT-2.

SQuAD
WikiSQL
SST
SRL
WOZ
AGNews
Amazon
DBPedia

GPT-2 score
72.3
70.7
90.9
70.4
84.9
94.6
62.3
99.1

My scores
72.7
65.0
91.8
64.5
64.3
93.2
54.7
99.1

Above are your scores from the Table 2 (in your paper) and my scores when I've tried to replicate them. I marked with bold results that differ quite a bit. I'm not sure, maybe I've run the code in a wrong way, so please take a look at the command I've executed:
./train.sh --seq_train_type lll --tasks amazon --model_name gpt2
where I've only replaced amazon with other tasks like wikisql, srl, woz.en etc.

Hi KonceptBlast,
Our default setting of epoch number in our code is 3. However, in our paper, we use 9 as our epoch number. Please add --n_train_epochs 9 after ./train.sh to reproduce our result.

@jojotenya thanks a lot! Now I'm getting results much closer to yours:
WikiSQL - 70.1
SRL - 70.3
WOZ - 85.8
Amazon - 58.2 (slightly off, perhaps I should do several runs and take the average score)
I have one more question - what commands I should execute to get the results from Table 3, for:

@KonceptBlast
Yes, it corrects. Sorry being late.


std.zlib: add documentation header example

I thought it might be nice to show the two main use cases for zlib.
Currently the page contains no code examples:
The first example is copied from the unittest. The second one I created myself - I hope it is according to idiomatic D ;-)
I also added the magic /// to the adler unit test - seemed like an example doesn't hurt.

This is a trivial change - it adds an example where there is none :)

Auto-merge toggled on


Allowing more LLM models for Langchain::Assistance

Currently it only supports OpenAI, and I can see that there's a PR for supporting Gemini https://github.com/andreibondarev/langchainrb/pull/513
Is it better to make it more generic and make it extendable? Eg: be able to just extend a new LLM model without hard coding if conditions in the base class.
A lot of other LLM uses OpenAI standard specifications

@mengqing Yes, I agree with you. It's best kept to be as generic as possible. Do you have any specific ideas/changes to propose? The current Gemini PR is a rough draft before I've thought about any abstractions at all. I've been thinking about maybe implementing a base/parent class and child classes that override specific methods, constants, etc.

@mengqing Do you have any thoughts on how it's been implemented thus far?

@mengqing Please open a new Issue if you'd like to see Langchain::Assistant support other LLMs.


Tutorial: Machine learning with ICESat-2 data

Lead: Wei Ji Leong
Date: 21/08/2024
Start Time: 0945
Duration: 45
Description:
Details

Learning Outcomes

outcome1
outcome2
outcome3

People Developing the Tutorial (content creation, helpers, teachers)
Summary Description
Dependencies (things people should know in advance of the tutorial)
Technical Needs (GPUs? Large file storage? Unique libraries?)

NVIDIA T4 GPU

Looked through some of the survey responses last week, and did a bit of thinking on what might make sense for an ICESat-2 Machine Learning tutorial. There's a range of interests (many research topics) and skill levels (from Masters/PhD students to Postdocs with years of experience), so a little tricky to gauge what an interesting topic and difficulty level would be. Doing a braindump of possible combinations for now:
Task:

General topic like photon classification of different surface types, relevant for:

Ice vs supraglacial lake
Sea ice vs polynya water
Land vs shallow water (coastal areas)
Vegetation types (grassland/forests) using ATL08

More niche topics like:

Climate/weather forecasting (maybe better for GeoSMART track?)
Snow depth estimation (SnowEx track?) or bathymetry estimation (ICESat-2 track?)

Methods:

Using scikit-learn / CuML (easy)

Supervised learning - Random Forest or other decision tree-based methods
Unsupervised Learning - K-means, DBSCAN

Using pure Pytorch (medium)

Feedforward artificial neural network
Convolutional Neural Network

Using Pytorch with a framework like Lightning, Huggingface, etc (hard)

Graph-based neural network
Transformers
State Space Models

Hi Wei Ji! Thank you for your valuable comments and ideas. We will be having an ML tutorial on Tuesday, that will cover a decision tree method (probably SWE) and ANNs (probably snow depth). If you would like to further develop your ideas, please don't hesitate to contact us. We are reaching out to tutorial leads to discuss/refine the tutorial content.

Thanks Wei Ji. I would vote for the Using Pytorch with a framework like Lightning, Huggingface, etc and try to make it easier by using AutoML and wrap all the math and calculations in a few lines, like calling transformers library of hugging face. I can help if needed.

Thanks for chiming in! I was looking at https://github.com/uwhackweek/schedule-2024/issues/39 and didn't want there to be too much of an overlap in terms of tasks/methods. I've already scheduled a meeting with Jessica actually to discuss about what ICESat-2 topic would be suitable, but could set up another one with you @NCristea and @ZihengSun to maybe talk about what ML method to teach.

@weiji14 yeah sure, I would love to chat about it.

Also happy to expand our meeting invitation if that day/time works for all!

Great - I am usually available in the morning - would Monday 9am work?


Fix the default_md example in the ca docs

We should not have an example showing the default_md as md5.

Thanks for your prompt processing of my proposal via email.
Kudos to you for paying attention to every detail that may cause security issues.

This pull request is ready to merge

Pushed. Thanks.


render in terminal via blockish

adds terminal rendering w/ blockish (-t flag)
handles input w/ crossterm_input

video demos:
zelda: https://www.youtube.com/watch?v=ou_4WSuYRHk
pokemon yellow: https://youtu.be/XcrkZnIS1lM

I found that you have removed the WIP tag, but it still seems to be doing some work. If the PR is ready, please @ me, I will test and check it.
Thank you for your work.

@mohanson yep, the PR is ready :)

@yazgoo

Please fix their build warnings:

warning: use of deprecated item 'std::error::Error::description': use the Display impl or to_string()
   --> src\main.rs:128:26
    |
128 |         None => {let _ = execute!(stdout(),terminal::EnterAlternateScreen);},
    |                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    |
    = note: `#[warn(deprecated)]` on by default
    = note: this warning originates in a macro (in Nightly builds, run with -Z macro-backtrace for more info)

warning: use of deprecated item 'std::error::Error::description': use the Display impl or to_string()
   --> src\main.rs:161:25
    |
161 |                 let _ = execute!(stdout(),cursor::MoveTo(0,0));
    |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    |
    = note: this warning originates in a macro (in Nightly builds, run with -Z macro-backtrace for more info)

warning: use of deprecated item 'std::error::Error::description': use the Display impl or to_string()
   --> src\main.rs:227:26
    |
227 |         None => {let _ = execute!(stdout(),terminal::LeaveAlternateScreen);},
    |                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    |
    = note: this warning originates in a macro (in Nightly builds, run with -Z macro-backtrace for more info)

warning: 3 warnings emitted

This UI does not work well on windows, you need to fix it, or simply disable the use of terminal mode on windows, both ok.

Thanks !


auth loginbyid not working

i tried it with id it worked but stopped working

It's
Auth::loginUsingId(1);

I know but still

This needs for investigation it was workin
WithAuth::loginUsingId($user->id);


rustdoc comments?

Hi there,
I noticed while reviewing some code using zlib-rs that most (all?) functions in https://docs.rs/zlib-rs/latest/zlib_rs/ are uncommented. (Examples: compress_bound, ReturnCode, uncompress_slice, etc).
Is this because the API is still considered unstable, or is the intent that users read the zlib manual? Would PRs adding rustdoc comments be accepted or is it too soon?
Thanks!

The status of the zlib-rs crate is weird because, for rust users the flate2 interface is much nicer and probably what they are already using, and for C (or other FFI) users the libz-rs-sys crate is the relevant api.
Because the libz-rs-sys api is determined by zlib itself and won't change, I think there we're absolutely ready to properly document behavior and safety assumptions. This will be based on the zlib manual but I think we can do better than that page (e.g. because we get to use markdown and can cross-link definitions).
For zlib-rs itself it is early, but on the other hand core pieces of functionality won't change drastically at this point.
So, I guess, go for it? with the knowledge that we may slightly tweak or move around certain definitions.

Makes sense :+1: Thanks for the quick reply.

For rust users the flate2 interface is much nicer and probably what they are already using

I think the context that had me looking at this might be a rare case where flate2 is too generic and we do want to be using zlib-rs directly (https://github.com/rustls/rustls/pull/1966).


Issue #270: Lesser ${ENV} footprint

Small refactor to make suite settings smaller.
Also added documentation about current ${ENV} usage.
Signed-off-by: Vratko Polak<EMAIL_ADDRESS>

Sorry, wrong issue number.


Missing Title and Message on Android Marshmallow

Hi, first of all, thank you so much for creating this library. As I tried on Android Marshmallow, the title and message are missing. I see in RateThisApp.java:showRateDialog(), and it still uses AlertDialog which it uses a different constructor with theme for Android Lollilop and Marshmallow. As the result, I change the code (as described on here) and it works like a charm.
So, I hope it will be fixed on the next release.
*Sorry for my English. :dancers:

I cannot reproduce the issue on my Nexus5 Android Marshmallow.
Would you provide more info (code, styles etc) ?

I'm still having this problem on my Genymotion emulator with Marshmallow installed on it. You can see the screenshot I uploaded here:

https://cloud.githubusercontent.com/assets/5790484/13642175/fd7e93ac-e64d-11e5-8bf8-b0375dbfd7ef.png

I change the code (as describe here), and it should be like this:

https://cloud.githubusercontent.com/assets/5790484/13642466/3775aeaa-e64f-11e5-9f29-4a169b3cbfe6.png

FYI, I compiled my project with SDK version 22, so I think maybe you tried on version 23 instead.

@damai007
Today I have released 1.0.1.
The new version uses android.support.v7.app.AlertDialog instead of android.app.AlertDialog. And the version also have showRateDialog method with theme ID argument.
I think that the new one will make easy to set style as material design for developers.
Please take a look sample app.


Instructions to set up kdb kernel properly

Hello all,
are there instructions on how to set up kdb kerner for jupyter? I followed this page, created a json file, and copy-pasted there the info from:
https://code.kx.com/v2/ml/jupyterq/notebooks/
but I get this error when I open Q notebook in Jupyter:
Traceback (most recent call last):
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/tornado/web.py", line 1512, in _execute
result = yield result
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/tornado/gen.py", line 1055, in run
value = future.result()
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/tornado/concurrent.py", line 238, in result
raise_exc_info(self._exc_info)
File "", line 4, in raise_exc_info
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/tornado/gen.py", line 1063, in run
yielded = self.gen.throw(*exc_info)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/notebook/services/sessions/handlers.py", line 73, in post
type=mtype))
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/tornado/gen.py", line 1055, in run
value = future.result()
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/tornado/concurrent.py", line 238, in result
raise_exc_info(self._exc_info)
File "", line 4, in raise_exc_info
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/tornado/gen.py", line 1063, in run
yielded = self.gen.throw(*exc_info)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/notebook/services/sessions/sessionmanager.py", line 79, in create_session
kernel_id = yield self.start_kernel_for_session(session_id, path, name, type, kernel_name)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/tornado/gen.py", line 1055, in run
value = future.result()
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/tornado/concurrent.py", line 238, in result
raise_exc_info(self._exc_info)
File "", line 4, in raise_exc_info
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/tornado/gen.py", line 1063, in run
yielded = self.gen.throw(*exc_info)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/notebook/services/sessions/sessionmanager.py", line 92, in start_kernel_for_session
self.kernel_manager.start_kernel(path=kernel_path, kernel_name=kernel_name)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/tornado/gen.py", line 1055, in run
value = future.result()
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/tornado/concurrent.py", line 238, in result
raise_exc_info(self._exc_info)
File "", line 4, in raise_exc_info
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/tornado/gen.py", line 307, in wrapper
yielded = next(result)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/notebook/services/kernels/kernelmanager.py", line 148, in start_kernel
super(MappingKernelManager, self).start_kernel(**kwargs)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_client/multikernelmanager.py", line 110, in start_kernel
km.start_kernel(**kwargs)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_client/manager.py", line 257, in start_kernel
**kw)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_client/manager.py", line 203, in _launch_kernel
return launch_kernel(kernel_cmd, **kw)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_client/launcher.py", line 128, in launch_kernel
proc = Popen(cmd, **kwargs)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/subprocess.py", line 709, in init
restore_signals, start_new_session)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/subprocess.py", line 1344, in _execute_child
raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: 'q': 'q'
============================================
I checked q and QHOME:
-bash-4.2$  which q
alias q='/home/nynfs01/svaury/q//l64/q'
/home/nynfs01/svaury/q/l64/q
-bash-4.2$ echo $QHOME
/home/nynfs01/svaury/q/
-bash-4.2$
I do not use conda on the server.
-bash-4.2$ cat /etc/redhat-release
Red Hat Enterprise Linux Server release 7.5 (Maipo)
KDB+ 3.5 2017.11.30 Copyright (C) 1993-2017 Kx Systems
l64/ 88(1)core 773717MB
Thanks,
Rem

Hi Rem,
Instructions for non conda install are within the README here. This should pick up your QHOME and install accordingly. It will require that you manually/pip install the python requirements but should allow you to install the kernel.
In this case you will also need to have embedPy installed which is a requirement of JupyterQ (this is handled via the conda install).
Please follow up with any questions and revert here if fixed so we can cloase the issue·
Hope this helps,
Conor

Hello Conor,
thank you for the reply!
I was under impression when I install pyq, embedpy gets added too [1]. Just to confirm, do you suggest to install it? In may case, I would follow the first option on the installation page: Download and install a release.
Please let me know.
Thanks,
Rem
[1]
https://github.com/KxSystems/pyq/issues/30#issuecomment-391815858

Yes in the current version of PyQ I believe that is the case. If your system has embedPy installed then you should not need to go through that step.
The install of JupyterQ using the link pointing to the README in my initial message should be sufficient provided you have all requirements installed.

Hello Conor,
according to instructions everything is installed, no errors.
Also, I have an alias for q, QHOME variable, and QHOME in the PATH set up. However, running this command, I get:
-bash-4.2$ jupyter console --kernel=qpk --debug
[ZMQTerminalIPythonApp] Searching ['/home/nynfs01/rkamal2', '/home/nynfs01/rkamal2/.jupyter', '/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/etc/jupyter', '/usr/local/etc/jupyter', '/etc/jupyter'] for config files
[ZMQTerminalIPythonApp] Looking for jupyter_config in /etc/jupyter
[ZMQTerminalIPythonApp] Looking for jupyter_config in /usr/local/etc/jupyter
[ZMQTerminalIPythonApp] Looking for jupyter_config in /home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/etc/jupyter
[ZMQTerminalIPythonApp] Looking for jupyter_config in /home/nynfs01/rkamal2/.jupyter
[ZMQTerminalIPythonApp] Looking for jupyter_config in /home/nynfs01/rkamal2
[ZMQTerminalIPythonApp] Looking for jupyter_console_config in /etc/jupyter
[ZMQTerminalIPythonApp] Looking for jupyter_console_config in /usr/local/etc/jupyter
[ZMQTerminalIPythonApp] Looking for jupyter_console_config in /home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/etc/jupyter
[ZMQTerminalIPythonApp] Looking for jupyter_console_config in /home/nynfs01/rkamal2/.jupyter
[ZMQTerminalIPythonApp] Looking for jupyter_console_config in /home/nynfs01/rkamal2
[ZMQTerminalIPythonApp] Connection File not found: /run/user/6411/jupyter/kernel-24735.json
Traceback (most recent call last):
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/bin/jupyter-console", line 11, in
sys.exit(main())
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_core/application.py", line 266, in launch_instance
return super(JupyterApp, cls).launch_instance(argv=argv, **kwargs)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/traitlets/config/application.py", line 657, in launch_instance
app.initialize(argv)
File "</home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/decorator.py:decorator-gen-116>", line 2, in initialize
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/traitlets/config/application.py", line 87, in catch_config_error
return method(app, *args, **kwargs)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_console/app.py", line 141, in initialize
self.init_shell()
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_console/app.py", line 109, in init_shell
JupyterConsoleApp.initialize(self)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_client/consoleapp.py", line 334, in initialize
self.init_kernel_manager()
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_client/consoleapp.py", line 288, in init_kernel_manager
self.kernel_manager.start_kernel(**kwargs)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_client/manager.py", line 244, in start_kernel
kernel_cmd = self.format_kernel_cmd(extra_arguments=extra_arguments)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_client/manager.py", line 169, in format_kernel_cmd
cmd = self.kernel_spec.argv + extra_arguments
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_client/manager.py", line 81, in kernel_spec
self._kernel_spec = self.kernel_spec_manager.get_kernel_spec(self.kernel_name)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_client/kernelspec.py", line 236, in get_kernel_spec
raise NoSuchKernel(kernel_name)
jupyter_client.kernelspec.NoSuchKernel: No such kernel named qpk
Could you tell me please, what I am missing?
-bash-4.2$ jupyter kernelspec list
Available kernels:
kdb_kernel    /home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/share/jupyter/kernels/kdb_kernel
python3       /home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/share/jupyter/kernels/python3
I also copied json file to  /home/nynfs01/rkamal2, but does not help.
Thanks,
Rem

It looks like you don’t have the kernel installed in the correct location according to your kernelspec list or it’s named incorrectly. Is the kdb_kernel a name that you have assigned to the kernel yourself? If so renaming to qpk would be required in order to ensure that the behaviour of the kernel is consistent with what we would expect from the kernel and would explain why running jupyter console --kernel=qpk --debug would not pick up the kernel.
Can you also please check that embedPy is correctly installed, there can be conflicts between pyq and embedPy resulting from both using a defined p.k file in $QHOME.
If embedPy is installed you should be able to evaluate the following
$q p.k
q).p.eval["list.pop"][;0]
// returning
{[f;x]embedPy[f;x]}[foreign]enlist[;0]

If this is not the case it may be advisable to install pyq and embedPy in separate environments, issues with conflicts of this type and ease of install are largely why the conda installs are preferable although I appreciate this is not always feasible.
It should also be noted that the JupyterQ kernel will not work with PyQ, just to preempt this as a potential issue given your use of PyQ. In order to install the PyQ kernel you would need to follow the instructions at https://code.kx.com/v2/interfaces/pyq/install/#installing-the-jupyter-kernel

Hello Conor,
thanks for the message and happy holidays!
I have been waiting for the admin to let me change the qpk. Meanwhile, I tried to install embedPy on my mac laptop using conda.
I do have a working 32-bit kdb and Jupyter. I tried to install embedpy on top. In fact, whether I try to install embedpy (or kdb using conda just for testing purpose), I get the same errors. Does it look at the wrong repo?
Rem$ conda install -c kx kdb
Collecting package metadata (current_repodata.json): done
Solving environment: -
The environment is inconsistent, please check the package plan carefully
The following packages are causing the inconsistency:

https://repo.continuum.io/pkgs/free/osx-64::fastcache==1.0.2=py35_0

https://repo.continuum.io/pkgs/free/osx-64::nltk==3.1=py35_0

https://repo.continuum.io/pkgs/free/osx-64::sockjs-tornado==1.0.1=py35_0

https://repo.continuum.io/pkgs/free/osx-64::astropy==1.0.6=np110py35_0

https://repo.continuum.io/pkgs/free/osx-64::pillow==3.0.0=py35_1

https://repo.continuum.io/pkgs/free/osx-64::jupyter_console==4.0.3=py35_0

https://repo.continuum.io/pkgs/free/osx-64::datashape==0.4.7=np110py35_1

https://repo.continuum.io/pkgs/free/osx-64::ply==3.8=py35_0

https://repo.continuum.io/pkgs/free/osx-64::sqlalchemy==1.0.9=py35_0

https://repo.continuum.io/pkgs/free/osx-64::ujson==1.33=py35_0

https://repo.continuum.io/pkgs/free/osx-64::spyder-app==2.3.8=py35_0

https://repo.continuum.io/pkgs/free/osx-64::ipython-qtconsole==4.0.1=py35_0

https://repo.continuum.io/pkgs/free/osx-64::sympy==<IP_ADDRESS>=py35_0

https://repo.continuum.io/pkgs/free/osx-64::xlwings==0.5.0=py35_0

https://repo.continuum.io/pkgs/free/osx-64::pytables==3.2.2=np110py35_0

https://repo.continuum.io/pkgs/free/osx-64::abstract-rendering==0.5.1=np110py35_0

https://repo.continuum.io/pkgs/free/osx-64::ipython-notebook==4.0.4=py35_0

https://repo.continuum.io/pkgs/free/osx-64::h5py==2.5.0=np110py35_4

https://repo.continuum.io/pkgs/free/osx-64::boto==2.38.0=py35_0

https://repo.continuum.io/pkgs/free/osx-64::pytest==2.8.1=py35_0

https://repo.continuum.io/pkgs/free/osx-64::networkx==1.10=py35_0

https://repo.continuum.io/pkgs/free/osx-64::_license==1.1=py35_1

https://repo.continuum.io/pkgs/free/osx-64::itsdangerous==0.24=py35_0

https://repo.continuum.io/pkgs/free/osx-64::conda-build==1.18.2=py35_0

https://repo.continuum.io/pkgs/free/osx-64::scikit-image==0.11.3=np110py35_0

https://repo.continuum.io/pkgs/free/osx-64::toolz==0.7.4=py35_0

https://repo.continuum.io/pkgs/free/osx-64::bottleneck==1.0.0=np110py35_0

https://repo.continuum.io/pkgs/free/osx-64::dynd-python==0.7.0=py35_0

https://repo.continuum.io/pkgs/free/osx-64::pycrypto==2.6.1=py35_0

https://repo.continuum.io/pkgs/free/osx-64::redis-py==2.10.3=py35_0

https://repo.continuum.io/pkgs/free/osx-64::anaconda-client==1.2.1=py35_0

https://repo.continuum.io/pkgs/free/osx-64::libxslt==1.1.28=2

https://repo.continuum.io/pkgs/free/osx-64::llvmlite==0.8.0=py35_0

https://repo.continuum.io/pkgs/free/osx-64::odo==0.3.4=py35_0

https://repo.continuum.io/pkgs/free/osx-64::bitarray==0.8.1=py35_0

https://repo.continuum.io/pkgs/free/osx-64::openpyxl==2.2.6=py35_0

https://repo.continuum.io/pkgs/free/osx-64::numba==0.22.1=np110py35_0

https://repo.continuum.io/pkgs/free/osx-64::beautifulsoup4==4.4.1=py35_0

https://repo.continuum.io/pkgs/free/osx-64::multipledispatch==0.4.8=py35_0

https://repo.continuum.io/pkgs/free/osx-64::lxml==3.4.4=py35_0

https://repo.continuum.io/pkgs/free/osx-64::pycurl==<IP_ADDRESS>=py35_3

https://repo.continuum.io/pkgs/free/osx-64::colorama==0.3.3=py35_0

https://repo.continuum.io/pkgs/free/osx-64::argcomplete==1.0.0=py35_1

https://repo.continuum.io/pkgs/free/osx-64::xlwt==1.0.0=py35_0

https://repo.continuum.io/pkgs/free/osx-64::ipywidgets==4.1.0=py35_0

https://repo.continuum.io/pkgs/free/osx-64::flask==0.10.1=py35_1

https://repo.continuum.io/pkgs/free/osx-64::jdcal==1.0=py35_0

https://repo.continuum.io/pkgs/free/osx-64::configobj==5.0.6=py35_0

https://repo.continuum.io/pkgs/free/osx-64::greenlet==0.4.9=py35_0

https://repo.continuum.io/pkgs/free/osx-64::bokeh==0.10.0=py35_0

https://repo.continuum.io/pkgs/free/osx-64::cython==0.23.4=py35_1

https://repo.continuum.io/pkgs/free/osx-64::blaze-core==0.8.3=py35_0

https://repo.continuum.io/pkgs/free/osx-64::libtiff==4.0.6=1

https://repo.continuum.io/pkgs/free/osx-64::xlrd==0.9.4=py35_0

https://repo.continuum.io/pkgs/free/osx-64::anaconda==custom=py35_0

https://repo.continuum.io/pkgs/free/osx-64::py==1.4.30=py35_0

https://repo.continuum.io/pkgs/free/osx-64::cytoolz==0.7.4=py35_0

https://repo.continuum.io/pkgs/free/osx-64::appscript==1.0.1=py35_0

https://repo.continuum.io/pkgs/free/osx-64::xlsxwriter==0.7.7=py35_0

https://repo.continuum.io/pkgs/free/osx-64::clyent==1.2.0=py35_0

https://repo.continuum.io/pkgs/free/osx-64::unicodecsv==0.14.1=py35_0
failed with current_repodata.json, will retry with next repodata source.
Initial quick solve with frozen env failed.  Unfreezing env and trying again.
Solving environment: failed with current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: |
The environment is inconsistent, please check the package plan carefully
The following packages are causing the inconsistency:

https://repo.continuum.io/pkgs/free/osx-64::fastcache==1.0.2=py35_0

https://repo.continuum.io/pkgs/free/osx-64::nltk==3.1=py35_0

https://repo.continuum.io/pkgs/free/osx-64::sockjs-tornado==1.0.1=py35_0

https://repo.continuum.io/pkgs/free/osx-64::astropy==1.0.6=np110py35_0

https://repo.continuum.io/pkgs/free/osx-64::pillow==3.0.0=py35_1

https://repo.continuum.io/pkgs/free/osx-64::jupyter_console==4.0.3=py35_0

https://repo.continuum.io/pkgs/free/osx-64::datashape==0.4.7=np110py35_1

https://repo.continuum.io/pkgs/free/osx-64::ply==3.8=py35_0

https://repo.continuum.io/pkgs/free/osx-64::sqlalchemy==1.0.9=py35_0

https://repo.continuum.io/pkgs/free/osx-64::ujson==1.33=py35_0

https://repo.continuum.io/pkgs/free/osx-64::spyder-app==2.3.8=py35_0

https://repo.continuum.io/pkgs/free/osx-64::ipython-qtconsole==4.0.1=py35_0

https://repo.continuum.io/pkgs/free/osx-64::sympy==<IP_ADDRESS>=py35_0

https://repo.continuum.io/pkgs/free/osx-64::xlwings==0.5.0=py35_0

https://repo.continuum.io/pkgs/free/osx-64::pytables==3.2.2=np110py35_0

https://repo.continuum.io/pkgs/free/osx-64::abstract-rendering==0.5.1=np110py35_0

https://repo.continuum.io/pkgs/free/osx-64::ipython-notebook==4.0.4=py35_0

https://repo.continuum.io/pkgs/free/osx-64::h5py==2.5.0=np110py35_4

https://repo.continuum.io/pkgs/free/osx-64::boto==2.38.0=py35_0

https://repo.continuum.io/pkgs/free/osx-64::pytest==2.8.1=py35_0

https://repo.continuum.io/pkgs/free/osx-64::networkx==1.10=py35_0

https://repo.continuum.io/pkgs/free/osx-64::_license==1.1=py35_1

https://repo.continuum.io/pkgs/free/osx-64::itsdangerous==0.24=py35_0

https://repo.continuum.io/pkgs/free/osx-64::conda-build==1.18.2=py35_0

https://repo.continuum.io/pkgs/free/osx-64::scikit-image==0.11.3=np110py35_0

https://repo.continuum.io/pkgs/free/osx-64::toolz==0.7.4=py35_0

https://repo.continuum.io/pkgs/free/osx-64::bottleneck==1.0.0=np110py35_0

https://repo.continuum.io/pkgs/free/osx-64::dynd-python==0.7.0=py35_0

https://repo.continuum.io/pkgs/free/osx-64::pycrypto==2.6.1=py35_0

https://repo.continuum.io/pkgs/free/osx-64::redis-py==2.10.3=py35_0

https://repo.continuum.io/pkgs/free/osx-64::anaconda-client==1.2.1=py35_0

https://repo.continuum.io/pkgs/free/osx-64::libxslt==1.1.28=2

https://repo.continuum.io/pkgs/free/osx-64::llvmlite==0.8.0=py35_0

https://repo.continuum.io/pkgs/free/osx-64::odo==0.3.4=py35_0

https://repo.continuum.io/pkgs/free/osx-64::bitarray==0.8.1=py35_0

https://repo.continuum.io/pkgs/free/osx-64::openpyxl==2.2.6=py35_0

https://repo.continuum.io/pkgs/free/osx-64::numba==0.22.1=np110py35_0

https://repo.continuum.io/pkgs/free/osx-64::beautifulsoup4==4.4.1=py35_0

https://repo.continuum.io/pkgs/free/osx-64::multipledispatch==0.4.8=py35_0

https://repo.continuum.io/pkgs/free/osx-64::lxml==3.4.4=py35_0

https://repo.continuum.io/pkgs/free/osx-64::pycurl==<IP_ADDRESS>=py35_3

https://repo.continuum.io/pkgs/free/osx-64::colorama==0.3.3=py35_0

https://repo.continuum.io/pkgs/free/osx-64::argcomplete==1.0.0=py35_1

https://repo.continuum.io/pkgs/free/osx-64::xlwt==1.0.0=py35_0

https://repo.continuum.io/pkgs/free/osx-64::ipywidgets==4.1.0=py35_0

https://repo.continuum.io/pkgs/free/osx-64::flask==0.10.1=py35_1

https://repo.continuum.io/pkgs/free/osx-64::jdcal==1.0=py35_0

https://repo.continuum.io/pkgs/free/osx-64::configobj==5.0.6=py35_0

https://repo.continuum.io/pkgs/free/osx-64::greenlet==0.4.9=py35_0

https://repo.continuum.io/pkgs/free/osx-64::bokeh==0.10.0=py35_0

https://repo.continuum.io/pkgs/free/osx-64::cython==0.23.4=py35_1

https://repo.continuum.io/pkgs/free/osx-64::blaze-core==0.8.3=py35_0

https://repo.continuum.io/pkgs/free/osx-64::libtiff==4.0.6=1

https://repo.continuum.io/pkgs/free/osx-64::xlrd==0.9.4=py35_0

https://repo.continuum.io/pkgs/free/osx-64::anaconda==custom=py35_0

https://repo.continuum.io/pkgs/free/osx-64::py==1.4.30=py35_0

https://repo.continuum.io/pkgs/free/osx-64::cytoolz==0.7.4=py35_0

https://repo.continuum.io/pkgs/free/osx-64::appscript==1.0.1=py35_0

https://repo.continuum.io/pkgs/free/osx-64::xlsxwriter==0.7.7=py35_0

https://repo.continuum.io/pkgs/free/osx-64::clyent==1.2.0=py35_0

https://repo.continuum.io/pkgs/free/osx-64::unicodecsv==0.14.1=py35_0

Hi Remi,
Happy Holidays.
No that repository is correct. What you're seeing there has been an issue with conda for the last number of months since an update to conda 4.6.9 as noted here, following some of the methods outlined in that issue to resolve your problem may help or downgrading to an older version of conda may prove useful. Looking at the output this is not the same issue as the issue you're seeing on the server.
If you are conda installing kdb and embedPy for testing purposes and currently have a 32 bit version of kdb on your computer however I would strongly suggest installing within an environment as outlined in one of the previous messages this will reduce significantly the time it takes to get the system up and running.
The suggestion to install in a clean environment https://github.com/KxSystems/jupyterq#install-with-conda is largely to reduce conflicts which arise with packages on your system currently including but not limited to PyQ and should reduce errors like you're seeing above.
Hope this helps.
Conor

Hello Conor,
thanks for the reply! Will check the conda issue once I get to my laptop, appreciate your help!
Regarding the server installation, after renaming the kernel to qpk, here is what it gives:
'2020.01.02T11:03:43.140 .p.eval
[4]  /home/nynfs01/svaury/q.64bit/jupyterq_pyzmq.q:2: pypop:.p.eval["list.pop"][;0]
^
Traceback (most recent call last):
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_console/ptshell.py", line 323, in init_kernel_info
reply = self.client.get_shell_msg(timeout=1)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_client/client.py", line 77, in get_shell_msg
return self.shell_channel.get_msg(*args, **kwargs)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_client/blocking/channels.py", line 57, in get_msg
raise Empty
queue.Empty
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/bin/jupyter-console", line 11, in
sys.exit(main())
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_core/application.py", line 266, in launch_instance
return super(JupyterApp, cls).launch_instance(argv=argv, **kwargs)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/traitlets/config/application.py", line 657, in launch_instance
app.initialize(argv)
File "</home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/decorator.py:decorator-gen-116>", line 2, in initialize
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/traitlets/config/application.py", line 87, in catch_config_error
return method(app, *args, **kwargs)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_console/app.py", line 141, in initialize
self.init_shell()
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_console/app.py", line 114, in init_shell
client=self.kernel_client,
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/traitlets/config/configurable.py", line 412, in instance
inst = cls(*args, **kwargs)
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_console/ptshell.py", line 272, in init
self.init_kernel_info()
File "/home/nynfs01/svaury/bin/_dc2nix2d193/Python-3.6.3/lib/python3.6/site-packages/jupyter_console/ptshell.py", line 326, in init_kernel_info
raise RuntimeError("Kernel didn't respond to kernel_info_request")
RuntimeError: Kernel didn't respond to kernel_info_request

That looks like it may be an issue with a conflict with PyQ. As mentioned previously you'll need to have the version of p.k which is associated with embedPy in order to ensure that your system will behave as expected.
To that end I would recommend ensuring that you follow the steps outlined here making sure to follow each step in the process which includes a fresh install of embedPy and ensuring that q is on the PATH and not just an alias which seems to be the case based on your initial message.
Again I would recommend that this be done in an environment if possible to ensure you limit conflicts with your current system but following the steps from above closely should ensure that you are able to get the system up and running.

Hello Conor,
thanks for the reply. I followed largely the same steps again for the server, did not have errors in between, but still the Q kernel complains about the "q" not found, not sure which of packages causes it and why :(
Is there a plan for the future to move the installation to "1 package does it all" or anything like that?
Thanks,
Rem

Can you please elaborate on where and why you have deviated from the install instructions if possible?
I suspect that your q is not on the PATH but is still an alias? f this is the case that will not be sufficient and may indicate why you're not finding "q".
There are currently no plans to modify the instructions or add a "1 package does all" type installation (this is handled with the conda installs)

Hi Rem,
I'm closing this issue for now. If you are still having issues and can provide more information relating to how you have deviated from the recommended install instructions feel free to reopen and elaborate.
All the best,
Conor


fix(pgtest): fix callback query call

There is an problem when you want to write unit test where callback function use the client to perform query again. The forEach loop over the queryQueue do not take into accounts query pushed during callback execution.
Switch to a while loop to bypass this issue.

Yes no problem :)

Cool! Merging! :)


Metrics are not added to graph

After selecting metric in query it is not added to graph. I don't see any requests to get items history data. After selecting another item in query also no request are initiated.
I use Grafana 2.0.2-1.
In web console there is only one warning: "The specified value '!' does not conform to the required format.  The format is '#rrggbb' where rr, gg, bb are two-digit hexadecimal numbers.". It is related to https://github.com/grafana/grafana/issues/1932
I made one change in plugin to make retrieving data (host groups, hosts, applications, items) from zabbix (2.2.1) working - changed "search" method in api requests to "filter", otherwise I always got empty results.

Got it! It is appeared that ALL filters - host group, host and application have to be selected. I didn't select application previously. I think that application should not be mandatory here because item is unique for host.

I was so


Credit usage calculation frequency

This article doesn't specify the frequency at which credit usage is calculated.
The example provided in the "How are credits accumulated?" imply that credits are accumulated and consumed per minute, but is the calculation of CPU usage used for these purposes an average over that 1 minute (and then at what sample timing?), or a point-in-time capture of CPU utilization every minute?
This detailed information would help with determining whether a B-Series VM is feasible for potential workloads.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: f435b3d1-2e0b-378c-ce89-97defa822eff
Version Independent ID: 32c3ea31-ae89-5a61-f99e-368bd7d72abc
Content: B-series Azure Windows VM sizes
Content Source: articles/virtual-machines/windows/b-series-burstable.md
Service: virtual-machines-windows
GitHub Login: @jonbeck7
Microsoft Alias: jonbeck

@jeffwmiles thanks for the feedback.
I can see how it might be confusing if your VM uses 60-80% CPU over a min and how to calucalte.
@jonbeck7 can you look into this and see if we can get more info from the PG on how to calculate ?

@jeffwmiles Kay from our compute team did a pretty good write up on our B series.  Take a look and let me know if it answered your question.
https://www.singhkays.com/blog/understanding-azure-b-series/

@jeffwmiles I'm going to close this issue now. Feel free to reopen this issue if the updated docs don't answer your original question or open a new issue if you have additional feedback. Thanks again!
#please-close


Stuck at command

Title: [] Not doing anything
Body:
Problem:
When I launch the run.bat I just get a screen without anything but the command, but the
underscore is blinking.
config.json:
only edited the token to my self-token.
Traceback and Screenshots:

Specs.
Win10:
Latest:
3.7.7:

This is a duplicate of #158.
Please refer closed issues before opening a new one.


Views Controlled Vocabularies TG call 15 December 2021 at 16:00 UTC

The Views Controlled Vocabularies Task Group will have an online meeting at 16:00 UTC on Wednesday, 2021-12-15. That corresponds to 11:00 AM Eastern (US) Standard Time (New York), 10:00 AM Central (US) Standard Time (Chicago), 9:00 AM Mountain (US) Standard Time (Phoenix), 8:00 AM Pacific (US) Standard Time (San Diego), 5:00 PM Central European Time (Stockholm/Geneva), and 6:00 AM Hawaii Standard Time (Honolulu).
The purpose of this meeting is to finalize the feedback questions for implementation testing and to discuss the implementation testing logistics. See this page for a draft of the fields to be included in the form.
Meeting details:
https://vanderbilt.zoom.us/j/97508961762
Meeting ID: 975 0896 1762
Find your local number: https://vanderbilt.zoom.us/u/axR3a6npl

Don't forget the Views Controlled Vocabularies Task Group meeting on 15 December at 16:00 UTC. We will be working out the details of the implementation testing. Please see the issue: https://github.com/tdwg/ac/issues/222 for Zoom link and meeting times.

Notes from the 2021-12-15 Views CV task group meeting are here


/bin/sh: 1: scripts/basic/fixdep: Exec format error

Hello. I have a Raspberry Pi 4. I install the latest image and everything works wonderfully. However, I've been trying to install the EtherCAT IgH Master to control some motors with ROS2, and when I follow the installations steps I get the following error:
@pi:~/ethercat$ make modules
[...]
make -C "/usr/src/linux-headers-5.15.98-rt62-raspi/" M="/home/ubuntu/ethercat" INSTALL_MOD_DIR="ethercat" modules
make[1]: Entering directory '/usr/src/linux-headers-5.15.98-rt62-raspi'
warning: the compiler differs from the one used to build the kernel
  The kernel was built by: aarch64-linux-gnu-gcc (Ubuntu 9.4.0-1ubuntu1~20.04.1) 9.4.0
  You are using:           gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0
  CC [M]  /home/ubuntu/ethercat/examples/mini/mini.o
/bin/sh: 1: scripts/basic/fixdep: Exec format error
make[4]: *** [scripts/Makefile.build:297: /home/ubuntu/ethercat/examples/mini/mini.o] Error 126
make[4]: *** Deleting file '/home/ubuntu/ethercat/examples/mini/mini.o'
make[3]: *** [scripts/Makefile.build:560: /home/ubuntu/ethercat/examples/mini] Error 2
make[2]: *** [scripts/Makefile.build:560: /home/ubuntu/ethercat/examples] Error 2
make[1]: *** [Makefile:1907: /home/ubuntu/ethercat] Error 2
make[1]: Leaving directory '/usr/src/linux-headers-5.15.98-rt62-raspi'
make: *** [Makefile:948: modules] Error 2

I read that it has something to do with how the kernel was cross-compile, where some files got the incorrect architecture. Have you seen something like this before?
PS: I also tried to cross-compile the IgH module, with a similar kernel source I was doing some tests on, but I got a permission denied error at some point. Maybe it could be resolved using the exact kernel version of the RPi, but I don't really know.

hit the exact same issue when trying to install ethercat master, tried the alternative approach to install it via apt and hits same problem again. Seems to be related to the cross-compiled kernel yes, digging into this.. did you find a solution?

No, I'm sorry but I didn´t manage to find a solution. For the time being I was asked to "leave it for later", since I was wasting a lot of time without results. I also asked in the RPi forum and in the Ubuntu forum but got no answers as well.
If you manage to find a solution please let me know.

going down the trail, per https://github.com/raspberrypi/linux/issues/4125, issue seems to be that there's some x86-64 binary linked during cross-compilation that wants to now run on arm64 hence the issue, I tried installing the rt kernel from the provided deb and this is included:
aatb@pi:/usr/src/linux-headers-5.15.98-rt62-raspi/scripts/basic$ file fixdep
fixdep: ELF 64-bit LSB pie executable, x86-64, version 1 (SYSV), dynamically linked, interpreter /lib64/ld-linux-x86-64.so.2, BuildID[sha1]=d2e54e65ed8cda9daaa1785e21e36845d6fc825e, for GNU/Linux 3.2.0, not stripped

figuring out the steps mentionned here https://stackoverflow.com/questions/73698666/kernel-module-on-cross-compile-kernel-bin-sh-1-scripts-basic-fixdep-exec-fo

Is this still a problem? It doesn't seem like it is an issue with this image specifically but with the upstream kernel?
In any case, I think @razr is preparing a new kernel for Ubuntu Noble + ROS Jazzy. Let's see if this still is a problem with that release.


[SPARK-29600][SQL] ArrayContains function may return incorrect result for DecimalType

What changes were proposed in this pull request?
Use TypeCoercion.findWiderTypeForTwo() instead of TypeCoercion.findTightestCommonType() while preprocessing inputTypes in ArrayContains.
Why are the changes needed?
TypeCoercion.findWiderTypeForTwo() also handles cases for DecimalType.
Does this PR introduce any user-facing change?
No
How was this patch tested?
Test cases to be added.

cc @cloud-fan @srowen

Can one of the admins verify this patch?

Can one of the admins verify this patch?

Hm, I can't tell if the new behavior is intentional or an unintended side effect. WDYT @dilipbiswal @cloud-fan @maropu ?

I think this kind of implicit type casts can easily cause unexpected output in complicated queries... Even in pgsql, an array contain operator @> throws an exception for the query;
postgres=# select ARRAY[1,2,3] @> '3';
ERROR:  malformed array literal: "3"
LINE 1: select ARRAY[1,2,3] @> '3';
                               ^
DETAIL:  Array value must start with "{" or dimension information.

postgres=# select ARRAY[1,2,3] @> ARRAY['3'];
ERROR:  operator does not exist: integer[] @> text[]
LINE 1: select ARRAY[1,2,3] @> ARRAY['3'];
                            ^
HINT:  No operator matches the given name and argument types. You might need to add explicit type casts.

If users want to process this kind of queries, using explicit casts looks better.

It sounds like we want an error in this case, and it currently generates an error? then I don't think we want to undo the previous change a bit like this.

@srowen Yea, I think so.

ok to test

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/19955/
Test PASSed.

Test build #115143 has started for PR 26811 at commit d2ce3ae.

@amanomer do you know which PR causes the compatibility issue? We need to see if it's intentional or not. If it's intentional, there should be a migration guide.

Test build #115143 has finished for PR 26811 at commit d2ce3ae.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/115143/
Test FAILed.

do you know which PR causes the compatibility issue?

I think this PR https://github.com/apache/spark/pull/22408 which uses findTightestCommonType() for casting.
findTightestCommonType() always tries to downcast datatype but in case of decimal, it should upcast the precision.

If it's intentional, there should be a migration guide

I don't see this case(decimal types with different precision) in migration guide. Snap from migration guide is attached

There was a similar issue for IN subquery expression which was addressed by https://github.com/apache/spark/pull/26485.

cc @cloud-fan

#26485 is accepted because it just makes the type coercion consistent between In and InSubquery.
I think it's a wrong design that, we have many type coercion rules for different operators, and have a DecimalPrecision rule to handle the decimal cases for all operators. This means that an operator needs to be dealt with twice: once in the normal type coercion rule, once in the DecimalPrecision.
For array_contains, it calls findTightestCommonType which skips decimal type. We should also deal with array_contains in DecimalPrecision. This is not ideal but should be the right fix for now.
In the future, we should really refactor this part. We should either separate type coercion rules by operators, or implement type coercion inside operators.

cc @maropu @dongjoon-hyun @dilipbiswal

(I'd follow whatever @cloud-fan recommends)

me, too.

@cloud-fan could you please review this PR and start tests

let me make my review comment clear: I don't think we should simply call findWiderTypeForTwo, which does much more than decimal type coercion.
After taking a look at DecimalPrecision, I found we have the same decimal type coercion implemented in TypeCoercion as well: findWiderTypeForDecimal.
Now we can have a simple fix: replace findTightestCommonType with findWiderTypeWithoutStringPromotionForTwo.

cc @cloud-fan @HyukjinKwon

Build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/20043/
Test PASSed.

Test build #115234 has started for PR 26811 at commit 7412368.

Test build #115234 has finished for PR 26811 at commit 7412368.

This patch passes all tests.
This patch does not merge cleanly.
This patch adds no public classes.

Build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/115234/
Test PASSed.

Test build #115239 has started for PR 26811 at commit 6c3545d.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/20049/
Test PASSed.

Test build #115239 has finished for PR 26811 at commit 6c3545d.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/115239/
Test PASSed.

cc @cloud-fan @maropu

Retest this please

Test build #115302 has started for PR 26811 at commit 7b12d6c.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/20110/
Test PASSed.

Test build #115302 has finished for PR 26811 at commit 7b12d6c.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test have passed. Kindly review this PR.
cc @gengliangwang @HyukjinKwon @dongjoon-hyun

thanks, merging to master!

@amanomer  can you leave a comment in the JIRA ticket, so that I can assign it to you?

Sure I will do.

Thanks all.

@cloud-fan find the comment below
https://issues.apache.org/jira/browse/SPARK-29600?focusedCommentId=16998413&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16998413
Thanks all.


docs for intialising the database

It'd be good to include instructions about how to set up the database in the README. I did:
sudo -u postgres bash
createuser --pwprompt matrix-authentication-service
createdb --encoding=UTF8 --locale=C --template=template0 --owner=matrix-authentication-service matrix-authentication-service

... and then set database.uri to: "postgresql://matrix-authentication-service:<password>@localhost/matrix-authentication-service"

How about some link on how to do that? For example locally I'm running the db in a container, and the official docker image does the user + db creation based on environment variables
Also I forgot to include the database migration: cargo run -- database migrate

Also the command to add a new user. I used: cargo run -- manage register testuser1 testpass1


Implement storybook readme and/or info

If there is a readme for a component, show it in the storybook
https://github.com/tuchk4/storybook-readme
Or
https://github.com/storybooks/storybook/tree/master/addons/info
Consider how to integrate with existing documentation generator.

I was looking at https://github.com/storybooks/storybook/tree/master/addons/info earlier and I thought it looked very useful for this project and could replace the current API.md?
A published storybook on Netlify, with contained docs and knobs might be more useful than the API.md alone (a possible justification to avoid investing in integrating the two together).

yeah I think it would make API.md redundant


Caching in IE11

Hi
I have come across an issue using the Aurelia template in IE11 where the weather forecast response is cached after first use.
Is it prudent to have a note that if targeting IE11 (not that I want to but what can you do) that you should change to using the HttpPostAttribute
[HttpPost("[action]")]
in the SampleDataController and update fetchdata.ts file to use the post method
http.fetch('/api/SampleData/WeatherForecasts', {             method: 'post'         })
Regards
Mike

Thanks for the pointer! I hope anyone else encountering this issue finds your solution.
We have an issue tracking IE9-11 support: https://github.com/aspnet/JavaScriptServices/issues/484


Using config files on Windows requires setting env variables

The documentation mentions how erdtree locates user-created config files:

erdtree will look for a configuration file in any of these locations:
- $ERDTREE_CONFIG_PATH
- $XDG_CONFIG_HOME/erdtree/.erdtreerc
- $XDG_CONFIG_HOME/.erdtreerc
- $HOME/.config/erdtree/.erdtreerc
- $HOME/.erdtreerc

However all of those environment variables are not set by default on Windows. I would expect that $HOME/.config/erdtree/.erdtreerc resolves to %HOME%\erdtree\.erdtreerc. This does not seem to be the case; I actually had to create a new env variable called $HOME pointing to C:\Users\$MY_WINDOWS_LOGIN\ and then it worked.
Suggestion: Use %HOME% on Windows instead of $HOME when locating config files.

Interesting. Thank you for pointing this out. I will have this addressed.

Would you accept a PR for this issue or do you want to tackle it yourself? In the first case I would give it a shot

@demilich1 Sure! More than happy to accept a PR. Instead of %HOME% however I'd advocate for %APPDATA% as that is the conventional directory on Windows used to store user specific configurations related to a program. It's something I forgot to consider initially. So essentially the full path to the configuration file should be:
%APPDATA%\erdtree\.erdtreerc

For your convenience, here is the file you're likely to touch: src/render/context/config.rs
The unit test for reading in the configuration file can be found at: src/render/context/test.rs
I'm not sure if what you're doing warrants additional testing but I'll leave that up to you to decide. If you wouldn't mind updating the README.md as well too that'd be great!


Can't access original HTTP request with webSocketHandler

Hello, guys!
First of all I'd like to apologize if it's an obvious question. However, I'm not being able to access the request for the websocket connection.
I've tried emeyex's solution from an older issue (request.context['shelf.io.connection_info']), but I had no success.
This is the code I'm trying to use:
void main(List<String> args) async {
  var handleWs = webSocketHandler((WebSocketChannel webSocket) {
    // I'd like to access some data from request here
    webSocket.stream.listen((message) {});
  });

  final _router = Router()..get('/ws', handleWs);

  // Use any available host or container IP (usually `<IP_ADDRESS>`).
  final ip = InternetAddress.anyIPv4;

  // Configure a pipeline that logs requests.
  final _handler = Pipeline().addMiddleware(logRequests()).addHandler(_router);

  // For running in containers, we respect the PORT environment variable.
  final port = int.parse(Platform.environment['PORT'] ?? '8080');
  final server = await serve(_handler, ip, port);
  print('Server listening on port ${server.port}');
}

My flutter doctor -v:
[✓] Flutter (Channel stable, 2.5.2, on macOS 11.6 20G165 darwin-arm, locale
    pt-BR)
    • Flutter version 2.5.2 at /Users/_/src/flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 3595343e20 (6 days ago), 2021-09-30 12:58:18 -0700
    • Engine revision 6ac856380f
    • Dart version 2.14.3

[✓] Android toolchain - develop for Android devices (Android SDK version 31.0.0)
    • Android SDK at /Users/_/Library/Android/sdk
    • Platform android-31, build-tools 31.0.0
    • Java binary at: /Applications/Android
      Studio.app/Contents/jre/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 11.0.10+0-b96-7249189)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Xcode 13.0, Build version 13A233
    • CocoaPods version 1.11.2

[✓] Android Studio (version 2020.3)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.10+0-b96-7249189)

[✓] VS Code (version 1.60.2)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.27.0

[✓] Connected device (1 available)
    • macOS (desktop) • macos • darwin-arm64 • macOS 11.6 20G165 darwin-arm

If someone can help me, I'd really appreciate!
Thank you in advance!

I managed to make it work properly based on Adriano's reply from another issue. This is one possibility to make it work:
import 'dart:async';
import 'dart:io';

import 'package:shelf/shelf.dart';
import 'package:shelf/shelf_io.dart';
import 'package:shelf_router/shelf_router.dart';
import 'package:shelf_web_socket/shelf_web_socket.dart';
import 'package:web_socket_channel/web_socket_channel.dart';

void main(List<String> args) async {
  // This is the adjust needed in order to make it work
  FutureOr<Response> handleWs(Request request) {
    return webSocketHandler((WebSocketChannel webSocket) {
      // now we have access to request argument
      print(request.url);
    })(request);
  }

  final _router = Router()..get('/ws', handleWs);

  // Use any available host or container IP (usually `<IP_ADDRESS>`).
  final ip = InternetAddress.anyIPv4;

  // Configure a pipeline that logs requests.
  final _handler = Pipeline().addMiddleware(logRequests()).addHandler(_router);

  // For running in containers, we respect the PORT environment variable.
  final port = int.parse(Platform.environment['PORT'] ?? '8080');
  final server = await serve(_handler, ip, port);
  print('Server listening on port ${server.port}');
}

Closing the issue, as it's replied.


[Request] Is 1.20.x Planned?

Hi, is a version for 1.20.x planned? This is one of my favourite client-side mods :)

Yo, sorry took some time, but I finally got to it.
Incase this happens again and you are brave you can try following the Manual Update


Hardcoded absolute path for Train.py

CANDLE_MODEL is just the name of the executable. Don't use absolute paths.
Look at lines 14 and 17 in https://github.com/JDACS4C-IMPROVE/Singularity/blob/develop/src/templates/train.sh for a solution.
https://github.com/JDACS4C-IMPROVE/IGTD/blob/a71f059ff492c7bcc6c7b58b4a2812c92f5cf82d/train.sh#L13

Updated the code in develop branch. Please let me know if it still does not work.

@zhuyitan When trying to run your container in Polaris, I got an error: /usr/local/bin/train.py
I noticed that train.py is different from the name of the file in your repo: Train.py.
### Path to your CANDLEized model's main Python script###
CANDLE_MODEL=train.py

Make sure you are building from the improve branch of the model. The definiton files for polaris haven’t been updated yet.
On Sep 22, 2023, at 10:58 AM, Sara Jones @.***> wrote:
@zhuyitanhttps://github.com/zhuyitan When trying to run your container in Polaris, I got an error: /usr/local/bin/train.py
I noticed that train.py is different from the name of the file in your repo: Train.py.
Path to your CANDLEized model's main Python script###
CANDLE_MODEL=train.py
—
Reply to this email directly, view it on GitHubhttps://github.com/JDACS4C-IMPROVE/IGTD/issues/2#issuecomment-1731661480, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AAH3WZCGTO657APCDUGENGTX3WYTZANCNFSM6AAAAAA42DLZMY.
You are receiving this because you authored the thread.Message ID: @.***>

@wilke Thanks, I'll use the improve branch.

I am closing this issue. Planning and testing will restart from scratch for the next release.


Add configuration for Grafana dashboard and Postgres replicator

The code here will configure the Postgres replicator from test-infra (PR https://github.com/grpc/test-infra/pull/244) and a Grafana instance. Secrets are pulled from the GCP secret manager and passed to the container as environment variables.

Config files are to be added in this PR instead: https://github.com/grpc/test-infra/pull/244


Initialize MongoDownloader only once to limit unnecessary connection to DB

Before you submit this PR: make sure to put all operations-related information in a wiki-note, a PR should be about code and is publicly accessible
What does the code in this PR do / what does it improve?
Started from slack thread, we need to find a way to limit connections to DB.
This line controls the connection to DB: https://github.com/XENONnT/straxen/blob/b8fe520deca55b8c5ac0cb53249b38639f0ae5de/straxen/common.py#L225. Since in fuse we used a lot of resource protocol to download maps: https://github.com/XENONnT/straxen/blob/b8fe520deca55b8c5ac0cb53249b38639f0ae5de/straxen/config/protocols.py#L47, each calling of resource protocol will trigger a connection.
This PR checks if the cached file exist BEFORE build the connection to DB: caching downloader.list_files() in line https://github.com/XENONnT/straxen/blob/b8fe520deca55b8c5ac0cb53249b38639f0ae5de/straxen/common.py#L226C17-L226C40 for future reference so that you will not need to initialize straxen.MongoDownloader each time you call resource protocol.
Can you briefly describe how it works?
Put mongo_downloader = mongo_storage.MongoDownloader() and mongo_downloader_files = mongo_downloader.list_files() in straxen/storage/__init__.py and replace downloader = straxen.MongoDownloader() with mongo_downloader.
Can you give a minimal working example (or illustrate with a figure)?
Please include the following if applicable:

[ ] Update the docstring(s)
[ ] Update the documentation
[ ] Tests to check the (new) code is working as desired.
[ ] Does it solve one of the open issues on github?

Notes on testing

Until the automated tests pass, please mark the PR as a draft.
On the XENONnT fork we test with database access, on private forks there is no database access for security considerations.

All italic comments can be removed from this template.

Not a good approach as the failed test suggested.

Replaced by https://github.com/XENONnT/straxen/pull/1398


Update to BarterDEX Marketmaker v1.0.1026

Changes: https://github.com/artemii235/SuperNET/compare/v1.0.861...v1.0.1026

I've had multiple successful swaps with this Marketmaker version.


Update the tournament models and provide support for managing tournament models in the admin interface

In this pull request, we have made some changes to

allow developers to access the tournament models through the admin interface (admin.py).
add a num_winner field to the tournament model to keep track of the number of winners for a tournament.
make the matches and players fields of the tournament model optional during the creation and edition of a tournament such that users can join and withdraw from a tournament by themselves instead of from direct assignment. Also, matches are made optional because they should be created through the bracket assignment mechanism in issue #163

The pull request has been merged.
Code: Mike, Sam, Riyush
Review: Joshua

Issue Score: Excellent
Comments:
Good minor change that improves tournaments functionality and implementation!


Docs: Expand on xray_trace_id key in Logger suppresion

What were you initially searching for in the docs?

How to suppress xray_trace_id in the Logger, as discussed in #215
Is this related to an existing part of the documentation? Please share a link: https://awslabs.github.io/aws-lambda-powertools-python/core/logger/#overriding-log-records
Describe how we could make it clearer: Explain that xray_trace_id is automatically added and updated if X-Ray is enabled in customers' Lambda function.
If you have a proposed update, please share it here

This is now available in the docs


duplicate endpoint error handling

Signed-off-by: Madhu Venugopal<EMAIL_ADDRESS>

@aboch @mrjana took care of aboch's comments :-)

LGTM

LGTM


⚠ Jenkins Plugins Artifactory has degraded performance

In 85a67e8, Jenkins Plugins Artifactory (https://get.jenkins.io/plugins/artifactory/) experienced degraded performance:

HTTP code: 200
Response time: 1158 ms

Resolved: Jenkins Plugins Artifactory performance has improved in 25f4b7a after 25 minutes.


Need some indicator on Home

[ ] Need some indicator on Home about which Node wallet is Currently on

Based on the team discussion   @Jddesigner0003
Note:
In the settings, add the 'App Info' section under 'About.' The indicator should not appear on the home screen or in the onboarding flow.

@Deveshshankar   please check
Figma:  https://www.figma.com/design/e0RxSAiRCMt5Z48LJVNEXr/Tribe-RGB?node-id=5427-17788&t=J9aZLDvjX76JJePM-1

@akshay8551 You can start


Add ability to point the setup process to another node config file.

Use ZENCONF environment variable to point setup at another node config file.

Not an official opinion, but I think the parameter should be documented in README.MD

Appreciate that feedback. I'd like to get a read on whether the team will accept this change. I feel this is more useful than the ZEN_HOME env as I do not keep configuration files in the ZEN_HOME.


[Bug]: Buttons on a table widget overlap with their icons on a small screen

Is there an existing issue for this?

[X] I have searched the existing issues

Description
Buttons on a table widget overlap with their icons on a small screen
Steps To Reproduce

Public Sample App
No response
Environment
Deploy Preview
Severity
Medium (Frustrating UX)
Issue video log
No response
Version
cloud

@ramsaptami This should be fixed as well with the new table widget updates.

@jsartisan the download options don't seem to be overlapping as before but the lack of icons makes the information unclear

@ramsaptami This was fixed. Closing it.

@jsartisan the download options don't seem to be overlapping as before but the lack of icons makes the information unclear

This is a separate issue btw.


Missing license

Thanks for what looks like a nice library!
Would you mind putting a license on it?

The MIT License has been adopted.


Owntracks - add timestamp attribute

Description:
Add the timestamp attribute.
Useful for aumations based on last mqtt received.

We should never store timestamps in attributes, they change too often. Instead one can use the state.last_updated to see when the last message got received.

thanks @balloob
actually I think they change as much as other attributes as in this case timestamp is somehting coming from the MQTT message itself.
state.last_updated on the other hand changes whenever you restart home assistant.
In this case you'd have a later last_update
Here an example.

could you please reconsider?

Also, it seems that functionally ‘tst’ in owntracks messages is something different than the last update. From the owntracks booklet:
tst: UNIX epoch timestamp in seconds of the location fix (iOS,Android/integer/epoch/required)
Which is not the timestamp corresponding to the sending of the message.

Hi @balloob did you have the chance to review my comments?
Cheers.


[Dialog] Expected clickable elements behind overlay not to trigger on clickOutside in mobile mode.

Bug report
When using a portalled dialog, I was expecting elements not to be clickable underneath the overlay.
I was having trouble fixing it until I set the body to be:
<body style={{ pointerEvents: 'auto' }}>
Now it works like I anticipated.
Current Behavior
Clicking elements under a Dialog.Overlay are triggered.
Expected behavior
Elements under a Dialog.Overlay should not be clickable until Dialog is closed.
Reproducible example
Official Dialog sample

Click 'Edit profile'
Click 'Show Code' underneath overlay.
Observe that button was clicked and now says 'Hide code'

Suggested solution
Not sure, but something is messing with pointerEvents on the body which is causing this.
Your environment

Software
Name(s)
Version

Radix Package(s)
react-dialog
0.1.7

React
n/a
17.0.2

Browser
Chrome

Assistive tech

Node
n/a

npm/yarn

Operating System

Hi @einaralex,
I'm having trouble following what you are talking about.
Would you be able to describe the issue you are seeing a bit more?
Thanks

Hey @benoitgrelard.
So when you have a dialog open, there is an overlay over the rest of the UI around the Dialog, usually styled to be slightly greyed out.
When clicking the overlay (clickOutside), the usual behaviour is that the dialog will close.
So let's say we have an open dialog, I click outside to close it, I expect no other actions to happen, only the dialog to close. But if there is a clickable button/element behind the overlay where I clicked, that will get triggered as well.
I noticed that this is only reproducible with the onTouch (mobile mode), onClick seems to work correctly.
https://thumbs.gfycat.com/MildHeavyKookaburra-mobile.mp4

Hi @einaralex,
Thanks for providing this.
That would explain why I couldn't see it on Chrome desktop.
So it only happens on touch devices?

Yeah seems that way, tried it on my mobile, happens there, also in responsive mode on Chrome dev tools.

I can confirm this is still an issue in main in any condition (animation or not) but is linked to touch as per the issue.
Looking into it.

seems like a solution is to wrap the overlay in a DialogPrimitive.Close and set  onClick={(e) => e.stopPropagation()}
<DialogPrimitive.Close onClick={(e) => e.stopPropagation()}>
<DialogOverlay />
</DialogPrimitive.Close>


Example not working

hi, Demo looks awesome, and i want to use it but cant.
1st error, copying the example from the readme.md, is from line public carouselBanner: Carousel; error: Cannot find name 'Carousel'.
if i change it to public carouselBanner: NgxCarousel its ok.
but then in the browser
Unexpected closing tag "ngx-carousel". It may happen when the tag has already been closed by another tag. For more info see https://www.w3.org/TR/html5/syntax.html#closing-elements-that-have-implied-end-tags ("
  <button class='leftRs'><</button>
  <button class='rightRs'>></button>
[ERROR ->]</ngx-carousel>

please help me.
p.s.
using angular 4.4.3

same issue

pls help!

Hello,
I'm updating tomorrow with all the issue fixed.
Check back tomorrow
Thanks for your support

if you're in that already, perhaps you could also add some simple fixes made in this fork:
https://github.com/amitchawla22/ngx-carousel

Unexpected closing tag "ngx-carousel" because i missed the backslash 'ngx-item' closing tag. Sorry for the mistake. I'm also pushing the update now with proper demo

pushed the update. Please read the changelog and readme file before upgrading. it have some changes

my friend, you must create a new project, npm your repo and test.
my friend i have some issues for you.
1 - Property 'dynamicLength' is missing
the "new" error is:
ERROR in C:/Users/admin/Documents/Angular 4/my-dream-app/src/app/Pages/dream-home/dream-home.component.ts (77,5): Type '{ grid: { xs: number; sm: number;
 md: number; lg: number; all: number; }; slide: number; speed: n...' is not assignable to type 'NgxCarousel'.
  Property 'dynamicLength' is missing in type '{ grid: { xs: number; sm: number; md: number; lg: number; all: number; }; slide: number; speed: n...'.

since dynamicLength is not optional (?).
2 - carouselBannerLoad example
it adds many items, but no buttons down the slides stating there are more items are added with it.
3 - issue 11 is showing again
ERROR Error: ExpressionChangedAfterItHasBeenCheckedError: Expression has changed after it was checked. Previous value: ''. Current value: '1,1,1,1,1'.
it does not really matter that it doesnt affect anything, you cant go into a project with a static error.
please fix the issues since its a really really cool carousel and i would love to use it in all my projects.


Write tests for the connections pagination convention

Connections are configured to have a field weight of 2 but this is not reflected anywhere in the cost analysis. How should we handle this? Where does this come into play?

Connections are a pagination convention, different than slicing arguments. See this paper or screen shots below.
https://github.com/Alan-Cha/fse20/blob/master/submissions/functional/FSE-24/graphql-paper.pdf

Connections can be handled with a combination of slicing arguments and directives. Confirm with tests and update documentation


nodeos run as daemon service

i using version dawn v3.0.0, i can not found eosd command, how to run a daemon service on nodeos, thanks

“eosd” was renamed “nodeos”, after building look for it in build/programs/nodeos directory.