[feature request] Handling special values, infinity

It is not exactly a problem that would be encountered with a modern data-stack and good data quality management practices. However, I've found myself having to handle the problem of having multiple special values different times recently.
What I mean by this: over the year and given some outdated tools as a constraint, the data engineers in my team used different missing values to deal with different problems. This includes, but is not limited to: some strings like 'missing', 'infinity', 'eps', some sentinel values like 999, 9999, and things closer to infinity like 1e12 or what would count as np.Inf.
It would be nice if xgboost would better handle those different kinds of special values. Currently the solutions require specific handling, imputation to more sentinel values, use of np.nantonum to remove infinity values ... etc.
I was thinking about the following for tree methods:

some way to specify the special values (maybe as a parameter as in the optbinning package)
allow +/- np.Inf by default
handling of special values internally; missing values could be handled as a category, and +/- infinity could be handled as high numbers for splits (infinity > x always True wathever is x).
This might generally require or imply the handling of mixed data types

Let me know if this make sense / could be prioritized.

What's the advantage of using a machine learning library over a data manipulation library like pandas to process the data?

I've found it to complexify the data pipeline by putting it in two places (the old data pipeline and the python one). Currently my way to go is to input all missing values to nan, build additional 0/1 columns to flag each of the special values and set infinite values to +/- 1e12.
It has some impact in terms of learning (multiplication of the columns, so less likely to select the main columns when randomising columns) - I am not sure about the final performance though - explainability (now we need to agregate multiple explanation columns).

Well, some of the special values are difficult to avoid.  In the long run, it might be generally cleaner to have the ML library handle mixed type than complexify the data eng. pipeline / the explainability code and possibly the client facing interface.

XGBoost can handle arbitrary missing values, and the algorithm can choose tree split with missing in mind. The data pipeline just needs to unify the representation of missing, most common way of doing that is encoding it as NaN. For other value, you can use the missing parameter of DMatrix

I am under the impression that the special values present different behaviors, notably sentinel values that are imputed to +/- 999999. I undestand that the way to go would be to used an unique np.nan for all values and a second columns where special values are encoded as categoricals.

Apologies for the many questions.

Thanks for your feed-back. I am under the impression that the special values present different behaviors, notably sentinel values that are imputed to +/- 999999.

I don't quite understand what you mean by this. XGBoost doesn't impute value, it learns the tree with gradient resided in the missing entries, which means the algorithm can handle missing value by itself.

I undestand that the way to go would be to used an unique np.nan for all values and a second columns where special values are encoded as categoricals.

I don't quite understand this either. ;-( . What do you mean by special value, why is it special? Why is special value categorical? Not sure what "used an unique np.nan for all values" mean, did you mean using np.nan to represent all missing value?

Closing due to stalled. Feel free to reopen if there's further information.

Hello, I am facing the same issue and wondering what all did you guys do to handle such special cases where some numbers mean a particular thing and can not all be binned together.
Thank you


Add stackdriver tracing options to istio/installer

Fixes https://github.com/istio/istio/issues/18680

@mandarjog : looks like discovery one's are newer.. not sure why.. @howardjohn might know?

the injection templates in discovery is for istiod?

@gargnupur Could you cherry-pick this as well as the env variable integer value fix into 1.4? Thanks!

@bianpengyuan : env variable integer value fix is already in 1.4
Requesting this one to 1.4 too

In response to a cherrypick label: #640 failed to apply on top of branch "release-1.4":
error: Failed to merge in the changes.
Using index info to reconstruct a base tree...
M	global.yaml
M	istio-control/istio-autoinject/files/injection-template.yaml
M	istio-control/istio-autoinject/templates/configmap.yaml
A	istio-control/istio-discovery/files/injection-template.yaml
M	istio-control/istio-discovery/templates/configmap.yaml
Falling back to patching base and 3-way merge...
Auto-merging istio-control/istio-discovery/templates/configmap.yaml
CONFLICT (modify/delete): istio-control/istio-discovery/files/injection-template.yaml deleted in HEAD and modified in Add stackdriver tracing options to istio/installer. Version Add stackdriver tracing options to istio/installer of istio-control/istio-discovery/files/injection-template.yaml left in tree.
Auto-merging istio-control/istio-autoinject/templates/configmap.yaml
CONFLICT (content): Merge conflict in istio-control/istio-autoinject/templates/configmap.yaml
Auto-merging istio-control/istio-autoinject/files/injection-template.yaml
Auto-merging global.yaml
Patch failed at 0001 Add stackdriver tracing options to istio/installer


licenses inconsistency

Hello, I am doing research in software engineering ethics. I found different licenses in repo. May I know which license repo follows? I would like to highlight this as a transparency concern.
•  Repo License: Apache license 2.0,
o  Different license : MIT in setup.py.
Regards, Software Ethics Researcher.

Hello, I am doing research in software engineering ethics. I found different licenses in repo. May I know which license repo follows? I would like to highlight this as a transparency concern. • Repo License: Apache license 2.0, o Different license : MIT in setup.py.
Regards, Software Ethics Researcher.

In accordance with MIT license


Validate unit type in DE API

Definition of Ready

[ ] Does this meet the INVEST criteria?
[ ] Does this have a clearly defined user?
[ ] Does this have an estimate?
[ ] Does this have acceptance criteria?
[ ] Does this have sufficient context (wireframes, business rules, etc.)?
[ ] Is this traceable to a feature, epic, or PI?

User Story
As a CAMPD API user I want to enter valid filter criteria for unit types so that I can see results for my specified unit type
Acceptance Criteria
Given that a user has entered one or more unit types in an upper-case or lower case format
When the API endpoint is executed
Then the system displays the records that match the criteria (containing data elements below)
Given that a user has entered one or more unit types without white space(s) before or after the delimiter
When the API endpoint is executed
Then the system displays the records that match the criteria (containing data elements below)
Given that a user has entered one or more unit types with white space(s) before or after the delimiter
When the API endpoint is executed
Then the system displays the records that match the criteria (containing data elements below)
Given a user has entered an invalid parameter for unit type
When the error message is displayed
Then the error messages contain a url to the end point to find the correct data
One or more unit types are not valid. Refer to the list of available unit types for valid values [placeholder for link to endpoint] fv-1
Data Elements
Results:
When the system identifies at least one record that matches the criteria, then for each record the system will display:
STATE
FACILITY_NAME
ORISPL_CODE
UNITID
ASSOC_STACKS
OP_DATE
SUM_OP_TIME
COUNT_OP_TIME
GLOAD
SLOAD
SO2_MASS
SO2_RATE
NOX_MASS
NOX_RATE
CO2_MASS
CO2_RATE
HEAT_INPUT
PRIMARY_FUEL_INFO
SECONDARY_FUEL_INFO
UNIT_TYPE_INFO
SO2_CONTROL_INFO
PART_CONTROL_INFO
NOX_CONTROL_INFO
HG_CONTROL_INFO
PRG_CODE_INFO
Context
(User journeys, design mockups, architectural diagrams, business rules, data element definitions)
Testing
Test Case:
Tester:
Definition of Done

[ ] Have all Acceptance Criteria been agreed to and validated by the scrum team?
[ ] Has the code been unit tested and peer reviewed?
[ ] Have the functional tests been executed?
[ ] Have all defects been reviewed and dispositioned, resolved, or deferred?
[ ] Has the user story been accepted by the Product Owner?
[ ] Is the user story ready to be deployed to the test/staging environments?

During sprint planning on 3/17, the team decided to complete the DE API by creating tickets #967, #968, #969, #970


Session context missing in Luis Intent Actions

I'm leveraging the Luis Intent Actions https://github.com/Microsoft/BotBuilder-Samples/tree/master/Node/blog-LUISActionBinding and would like to access the session to respond with attachments instead of a simple callback of text to the user. As the session context of the dialog is not available, how is someone supposed to do this?
@pcostantini @ejadib

Hi @dariuszparys,
There is an open PR with just that feature: https://github.com/Microsoft/BotBuilder-Samples/pull/130
It allows to specify an override for sending custom responses when actions are fulfilled:
https://github.com/Microsoft/BotBuilder-Samples/pull/130/files#diff-a9a8e724ec00a1d53b7cd3af8bf1b7ddR38
Hope it helps.
Regards,
-PabloC.

Yes, this helps. Looking forward to see this functionality merged.


Added courses of Git, Django, Python, .NET, HTML/CSS, C, C++

Renamed "Data Structure" section into "Algorithms & Data Structures". Created new section for Django, Git, .NET, HTML/CSS courses and added new courses in it. Added courses in existed section.
Hacktoberfest notes:

due to volume of submissions, we may not be able to review PRs that do not pass tests and do not have informative titles.
please read our contributing guidelines
be sure to check the output of Travis-CI for linter errors
if this is your first open source contribution, make sure it's not your last!

What does this PR do?
Add Resource(s) | Remove Resource(s) | Add info | Improve Repo
For resources
Description
Why is this valuable (or not)?
How do we know it's really free?
For book lists, is it a book? For course lists, is it a course? etc.
Checklist:

[x] Not a duplicate
[x] Included author(s) if appropriate
[x] Lists are in alphabetical order
[x] Needed indications added (PDF, access notes, under construction)

Other free-courses-lang code sorted [.NET] with N in Index not with .(dot),  i did same.
Alphabetically .(dot) comes first before letter. So can i change ranks .NET as first or remains as it is (in N order).

do not add '(YouTube)' see discussion at #4579. Also, when you change many listings it's hard to see what you've added.


Gitea 1.15 does not work on postgres <9.5: Submitting a new issue gives 500 error

Gitea Version
1.15.2
Git Version
2.16.5
Operating System
Linux RHEL 7.6
How are you running Gitea?
Downloaded the 64bit version binary Linux executable, and running it as a service.
Database
PostgreSQL
Can you reproduce the bug on the Gitea demo site?
No
Log Gist
2021/09/16 10:00:32 models/issue.go:1012:NewIssue() [I] [SQL] ROLLBACK [] - 40.9
49µs
2021/09/16 10:00:32 ...rs/web/repo/issue.go:980:NewIssuePost() [E] NewIssue: gen
erate issue index failed: pq: syntax error at or near "ON"
Description
Updated from gitea 1.14.6 to 1.15.2. Now, creating a new issue in every repository gives a 500 error.
Screenshots
No response

what version of Postgres are you running?

The SQL this is failing on is: ```
INSERT INTO issue_index (group_id, max_index) "+
"VALUES (?,1) ON CONFLICT (group_id) DO UPDATE SET max_index = issue_index.max_index+1

which implies you have a version of postgres that does not support ON CONFLICT

This has been present in Postgres since ve

what version of Postgres are you running?

9.2

I don't think we state anywhere what the minimal supported version of postgres is but I think it's entirely reasonable to set that at at least 9.5.
I guess we need to detect the version of postgres at time of startup and warn users and update the documentation.

I've retitled the bug - so a PR doing the above could reference this issue and close it.

I've retitled the bug - so a PR doing the above could reference this issue and close it.

Ok, thank you for the effort. Ii is fine to specify minimum requirements of the database from now on.

Yeah unfortunately we absolutely have to have postgres >= 9.5.
I've added a docs PR so I will close this now.

I onfirm that upgrading posgres to 9.6 solved the problem.


add a middleware concept

async function one (req) {
  req.one = true
}

async function two (req) {
  req.two = req.one + true
}

async function three (req) {
  return { json: { v: req.two } }  // returns {"v":2}
}

export let get = [one, two, three]

fixed in 1.0.38


Missing details

There is no definition of return values, their types and usage. And the example too does not show how to process the response.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 3f2a046d-8cf7-4fe8-72a0-713ee95e4203
Version Independent ID: 23fa0cf9-c741-8966-8dec-e96740f3d755
Content: getSession (JavaScript API Reference) for Dynamics 365 Channel Integration Framework 2.0
Content Source: ce/customer-service/channel-integration-framework/v2/reference/microsoft-ciframework/getsession.md
Service: dynamics-365-customerservice
Sub-service: channel-integration-framework
GitHub Login: @gandhamm
Microsoft Alias: mgandham

Thanks for your comment, @adeelaziz7. This issue has been assigned to the doc author for review.

Hello @adeelaziz7 ,
Thank you for reaching out to us. We will take this up and update this topic with the changes you've mentioned.


Default login and password

Hello,
As is often the case, there is no mention of the login/password combination on the project download page (https://sonic.software/)...
What are they?
Thank you.

It's a good idea to add it to the site. They are the default ones, see https://github.com/sonic-net/SONiC/blob/master/doc/SONiC-User-Manual.md#21-default-login

Thank you for your reply.
I think it will be a plus for those who want to test this distribution quickly! Very good of you to have thought of the Qemu command line.
Have a nice day!


Add transport option

We used to have the transport option before:
https://github.com/knative/networking/blob/release-1.0/test/test_images/httpproxy/httpproxy.go#L107-L110
but it was dropped and it looks like it caused visibility test flake.
This patch tries to verify the fix.
/cc @dprotaso @carlisia @ZhiminXiang

Tested the change by net-istio and net-contour.
https://github.com/knative-sandbox/net-istio/pull/852
https://github.com/knative-sandbox/net-contour/pull/709

/lgtm
/approve
/cherry-pick release-1.2

/cherry-pick release-1.1


Update glutin & fix a few wayland issues

This PR fixes a few wayland issues of alacritty (and updates glutin on the process because it is needed).
Mainly two changes are done:
First add a drawing_ready() method on Window: see https://docs.rs/winit/0.8.2/winit/os/unix/trait.WindowExt.html#tymethod.is_ready for explanations. Hopefully glutin will be able to handle it itself in the future, but it currently does not.
Secondly; resize window and OpenGL contextes. The way wayland forces winit to draw its own decorations and how surface size is defined by its content means that in practice:

winit's window.set_inner_size() defines the dimensions of the borders
glutins gl_window.resize() defines the dimensions of the content (and is a noop in other platforms)

It is for now glutin's user responsibility to keep them in sync otherwise borders are drawn stupidly. This PR changes the resize methods of alacritty::Window to always update both.
This fixed the borders issues for me, tested on weston.

Thanks for the PR, @vberger! Several people have complained about the resize issue on Wayland; hopefully they see this.


includeEql throws "Object has no method 'some'"

Looks like somebody had underscore installed when they wrote this method and forgot to test in isolation. No method some exists so this throws an error:
['blah', 'foo', 'bar'].should.includeEql('bar') // throws!
This is the culprit:
  includeEql: function(obj){
     this.assert(
       this.obj.some(function(item) { return eql(obj, item); })
       , 'expected ' + this.inspect + ' to include an object equal to ' + i(obj)
       , 'expected ' + this.inspect + ' to not include an object equal to ' + i(obj));
     return this;
   },

.some is an Array.prototype method, but we should have an assertion for the method and/or being an array in there

not a huge fan of the name either but hey :D

well your example there works, also you could just do ['blah', 'foo', 'bar'].should.include('bar') since primitives will be ===

Ah, sorry that was just me not thinking. This is the real problem with include:
['blah', 'foo', 'bar-some-other-stuff'].should.include('bar')  #=> true

It's not exact so I was getting false positives

hmm failed for me:
  0)  test include() with string:
     AssertionError: expected [ 'blah', 'foo', 'bar-some-other-stuff' ] to include 'bar'

Hmmm.. thats odd. I will see if I can dig up the original code that way failing for me. Thanks for your help btw.

maybe it's an old version of should.js or something
np

closing until we have more info for a confirmed bug


recommended way to install the latest stable version?

What is the rbenv equivalent of nvm install stable?

@erjoalgo There does not seem to exist an equivalent command to nvm install stable, since rbenv also allows to install other Ruby implementations such as jRuby, mRuby and truffleRuby. Therefore, there are multiple stable versions to choose from, so the  ultimate decision is yours.
You could use the rbenv install --list to check the latest stable version for each available Ruby implementation, and choose one to install using the rbenv install <your selected Ruby>.
For example, rbenv install 2.7.2


This repository must be modified to facilitate buildbot integration

See commits in Master, though we are no longer using BuildBot.


Codelab title appears on hover over images, links

Not sure what's causing this, but it seems to be happening on all of the codelabs pages.
First reported here:
https://github.com/googlecodelabs/polymer-first-elements/issues/9

We're using the title attribute, which the browser provides a11y for. Not much we can do about that other than to use another property.
BTW, this only happens on first load of a codelab, when the content area doesn't have focus yet. After you click in the content are, it doesn't pop up anymore.


updateservicectl prints two different help messages in a row

when using the --help flag on subcommands, updateservicectl prints out the default flags usage, then prints out the nicely formatted *nix style usage. We want it to just print out one of those, preferably the second one.
Expected:
$ updateservicectl app create --help
NAME:
	app create -

USAGE:
	updateservicectl app create [OPTION]...

DESCRIPTION:
	Create a new application.

OPTIONS:
	--app-id=	Application UUID. If not provided, one will be randomly generated.
	--description=	New application description.
	--label=	New application label.
For help on global options run "updateservicectl help"

Actual:
$ updateservicectl app create --help
Usage:
  -app-id value
    	Application UUID. If not provided, one will be randomly generated.
  -description value
    	New application description.
  -label value
    	New application label.
NAME:
	app create -

USAGE:
	updateservicectl app create [OPTION]...

DESCRIPTION:
	Create a new application.

OPTIONS:
	--app-id=	Application UUID. If not provided, one will be randomly generated.
	--description=	New application description.
	--label=	New application label.
For help on global options run "updateservicectl help"

It's worth noting that this only happens when the --help flag is used. The correct behavior is observed when using the help subcommand, e.g.
$ updateservicectl app create help
NAME:
	app create -

USAGE:
	updateservicectl app create [OPTION]...

DESCRIPTION:
	Create a new application.

OPTIONS:
	--app-id=	Application UUID. If not provided, one will be randomly generated.
	--description=	New application description.
	--label=	New application label.
For help on global options run "updateservicectl help"

Also, using the --help flag on the top level doesn't exhibit this behavior either -
$ updateservicectl --help
NAME:
	updateservicectl - updateservicectl is a command line driven interface to the roller.

USAGE:
	updateservicectl [global options] <command> [command options] [arguments...]

VERSION:
	2.0.0+git

COMMANDS:
	admin-user	Operations for modifying admin users.
	app		Manage applications.
	channel		Manage channels for an application
	database	Operations for dealing with the backend database.
	group		Operations that manage groups in an application.
	help		Show a list of commands or help for one command
	instance	Operations to view instances.
	package		Manage packages for an application.
	watch		Watch for app versions and exec a given command.
	upstream	Manage upstreams.

GLOBAL OPTIONS:
	--debug=false			Output debugging info to stderr
	--help=false			Print usage information and exit.
	--key=				API Key
	--server=http://localhost:8000	Update server to connect to
	--skip-ssl-verify=false		Don't check SSL certificates.
	--user=				API Username
	--version=false			Print version information and exit.

Run "updateservicectl help <command>" for more details on a specific command.

The cause is the Parse which interprets and creates the first Usage section, followed by this call which prints the one we want to keep.


Removendo código não utilizado

Hello @gustavooquinteiro! Thanks for opening this PR. We checked the lines you've touched for PEP 8 issues, and found:

In the file sample/mmu.py:

Line 202:40: W291 trailing whitespace
Line 203:32: E127 continuation line over-indented for visual indent
Line 203:54: E711 comparison to None should be 'if cond is None:'
Line 205:32: E127 continuation line over-indented for visual indent
Line 208:80: E501 line too long (84 > 79 characters)
Line 209:80: E501 line too long (84 > 79 characters)


Visible password at sensu-client logs after restart

Configuring single rabbitmq, sensu is able to redact the password in client logs after restart.
But when configuring multiple rabbitmqs, plain text password is visible.
Logs for single rabbitmq config :
{
   "timestamp":"2016-04-08T16:41:35.699673-0700",
   "level":"warn",
   "message":"config file applied changes",
   "file":"/etc/sensu/conf.d/rabbitmq.json",
   "changes":{
      "rabbitmq":[
         null,
         {
            "host":"<IP_ADDRESS>",
            "port":"5671",
            "user":"sensu",
            "password":"REDACTED"
         }
      ]
   }
}

Logs for multiple rabbitmq config :
{
   "timestamp":"2016-04-08T16:41:35.699673-0700",
   "level":"warn",
   "message":"config file applied changes",
   "file":"/etc/sensu/conf.d/rabbitmq.json",
   "changes":{
      "rabbitmq":[
         null,
         [
            {
               "host":"<IP_ADDRESS>",
               "port":"5671",
               "user":"sensu",
               "password":"abc123"
            },
            {
               "host":"<IP_ADDRESS>",
               "port":"5671",
               "user":"sensu",
               "password":"abc123"
            }
         ]
      ]
   }
}

This issue seems to occur because multilpe rabbitmq config is stored in a nested array format. Sensu is not able to look up the password keyword inside the hash, inside the array and hence, not able to redact the password in logs.

This is sensu-settings issue. We need to apply redact_sensitive on this line: https://github.com/sensu/sensu-settings/blob/master/lib/sensu/settings/loader.rb#L169

Can I request a CVE to be assigned for the issue?

Thank you for the reply.
As per the analysis, redact_sensitive method is taken care during printing. Please note that the issue occurs only for multiple rabbitmq configuration.
I would like to request a CVE to be assigned for the issue.

Thank you for reporting this issue. A fix has been merged to master and we are working on releasing Sensu 1.2.1 which will contain the fix.

@amdprophet thanks for the quick turnaround I think it's valid that we should provide a CVE for it. Who is the most appropriate person to register with mitre?

@majormoses @pdebashis we have filed for a CVE, currently waiting for one to be assigned.

@majormoses @pdebashis we've been issued CVE-2018-1000060 to cover this vulnerability.


Fix pickle idempotence

In the current master, it is not possible to pickle a model which has been loaded from a pickle itself, i.e. the operation dumps(loads(dumps(model))) fails. The problem is that a freshly unpickled and untouched model does not have _tf_arrays for all Param objects und the corresponding __getstate__-method tries to remove it resulting in an exception.
There is a fix for this in in model.py which ensures that things like model._graph are only removed when they actually exist. This PR does the same in the Param-class which seems to fix the issue.

I have a suggestion for simplification. I think this:
try:
    d.pop(key)
except:
    pass

is equivalent to
d.pop(key, None)

It is, I just wanted to keep with the style of models.py. I can change it at both places since I prefer the default-value version, too :).

Codecov Report

Merging #410 into master will decrease coverage by <.01%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master     #410      +/-   ##
==========================================
- Coverage   99.74%   99.74%   -0.01%
==========================================
  Files          28       28
  Lines        2337     2334       -3
==========================================
- Hits         2331     2328       -3
  Misses          6        6

Impacted Files
Coverage Δ

GPflow/param.py
99.43% <100%> (ø)
:arrow_up:

GPflow/model.py
99.29% <100%> (-0.02%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d3fafda...3e10dd9. Read the comment docs.


Missed bson types serializers

org.bson.Document --> BsonDocument
org.bson.types.Code --> BsonJavaScript

Also some Kotlin type binding,

ByteArray --> BsonBinary


SRGAN - Generated image got PINK overlay all the time ? How to solve this ?

I have tried SRGan for days, and the result "looks" OK but the generated images were overlayed PINK all the time. Anybody knows why, please :(
Thanks
Steve

NB: My bad :( .. ! Solved.


A "hinting" system for all button and fields

It would be great to have a small bubble with the hint on what this field actually means or what is the purpose of this button. This will help newcomers with an embedded documentation.

-[ ] remain no hinting in questionproperyview


Enable codeQL for scheduled CI jobs

This will enable codeQL to run on all scheduled CI jobs across all services.

/azp run js - core - tests

/azp run js - storage-blob - tests

/azp run js - storage-blob - tests

/azp run js - storage-blob - tests


messages: add telegram icon

Tiny change for telegram
Original below:

Great - thanks!

Just to add - additions like this are amazingly helpful, so thank you!


some clarification is needed

Do we deploy instance-builder only into the account (kind of OPS account/management account) or it needs to be deployed in every account where we want to control resources? Also, it is unclear how to get output when deploying stacksets (instance-schedule-remote) with all the ARNs that were created in the spoke accounts. Can you please assist? thanks in advance

@ssheff You deploy the solution only once in the management account,  in the Cloudformation parameter cross account roles you can provide the reference to an AWS Systems Manager Parameter Store in the format {param:name}. Once the solutions stack is created successfully. You can deploy the remote template in the secondary accounts and you can update the Parameter Store with the new cross account role create by the remote templates.

excellent and thank you so very much


Add more granular variant specification and other minor changes

Added a few things to support some of my melanoma and lung work.
In this PR:

Biggest change is removing snv_vcf_paths and indel_vcf_paths and replacing with a dictionary from snv to a list of VCF paths or MAF paths or VariantCollections.
Allow filtering of a Cohort.
Allow users to grab all effects, not just top priority ones.
Add a .genome property.

Since removing snv_vcf_paths will break things, I'd be bumping the release up to 0.5.0. Also need to do more manual/automated testing to confirm no issues.

First, thanks for working on this & helping to tackle these issues!
Few high-level comments:

Not sure I like the dict approach to indel, snv or any. Why not include all VCF/MAFs irrespective of type & handle the filtering by type in a function? (e.g. have variant_count, snv_count, indel_count, etc?
Also, not sure I like breaking backward compatibility for this reason. I think we can add an option for vcf_paths (to accept a list) and populate this with values from snv_vcf_paths & indel_vcf_paths if the user passes these in?
I do think the behavior of variant-type default behavior is a little tricky to reconcile without modifying the default filter fn. How wedded to this are you?

I would like to test this out if that's OK with you & will then give more concrete feedback.

Coverage decreased (-0.3%) to 55.477% when pulling 4b77794e2ad516c77d4748a3757022d8ee2f6340 on variant_import into 2a306b8663799580daadefa13e295dc4adb997df on master.

Just noting here our offline discussion:

remove dict of vcf files; replace with list.
remove variant_type param; filter types using summary functions.
OK to break backwards compatibility.

Otherwise LGTM --

Coverage increased (+0.02%) to 55.79% when pulling 34f10f03aba8d6061ffe40a2ebe392310cd32ecc on variant_import into 2a306b8663799580daadefa13e295dc4adb997df on master.

@jburos responded to all the above, and added an associated test as well as an error if a cache with the old format is present. I don't want to bother you over the weekend, so I'll probably go ahead and merge today or tomorrow.

Coverage increased (+0.02%) to 55.79% when pulling a02961b8ff8c753e89f9ab2f9a4f5671dbc9e768 on variant_import into 2a306b8663799580daadefa13e295dc4adb997df on master.

LGTM - thanks Tavi! Really like the out-of-date cache check.


Task 9978, classif.rpart only has 17 runs

What happened there? Accroding to [1] Table 3 it should have 6005 runs.
@mboecker Can you compare the numbers to the runs that we have in our database? If our number is smaller something is strange.
[1]  Kühn et. al, Automatic Exploration of Machine Learning Experiments on OpenML, https://arxiv.org/pdf/1806.10961.pdf

Task 13966, kknn also has only 28 runs in our DB but 30 in the paper.
SELECT DISTINCT rid, run.setup, implementation.name FROM run JOIN input_setting ON run.setup = input_setting.setup JOIN input ON input.id = input_setting.input_id JOIN implementation ON implementation.id = input.implementation_id WHERE task_id = 9978 AND implementation.name = "mlr.classif.rpart";

+---------+---------+-------------------+
| rid     | setup   | name              |
+---------+---------+-------------------+
| 1875185 |   47685 | mlr.classif.rpart |
| 1875182 |   47689 | mlr.classif.rpart |
| 1875187 |   47690 | mlr.classif.rpart |
| 1875189 |   47691 | mlr.classif.rpart |
| 1875188 |   47692 | mlr.classif.rpart |
| 1875186 |   47693 | mlr.classif.rpart |
| 1875191 |   47694 | mlr.classif.rpart |
| 2041106 |  181776 | mlr.classif.rpart |
| 2041108 |  181778 | mlr.classif.rpart |
| 2041112 |  181782 | mlr.classif.rpart |
| 2041116 |  181785 | mlr.classif.rpart |
| 2041124 |  181786 | mlr.classif.rpart |
| 2041122 |  181788 | mlr.classif.rpart |
| 2041123 |  181789 | mlr.classif.rpart |
| 2041127 |  181792 | mlr.classif.rpart |
| 2041129 |  181794 | mlr.classif.rpart |
| 2041142 |  181799 | mlr.classif.rpart |
| 8869850 | 6833268 | mlr.classif.rpart |
+---------+---------+-------------------+
18 rows in set (14.32 sec)

With restriction to our bot, we find only 17 results. This means the database doesnt contain any runs for this learner that has at least one parameter set in the database, other than these 18.
MariaDB [openml_native]> SELECT DISTINCT rid, run.setup, implementation.name FROM run JOIN input_setting ON run.setup = input_setting.setup JOIN input ON input.id = input_setting.input_id JOIN implementation ON implementation.id = input.implementation_id WHERE task_id = 9978 AND implementation.name LIKE "%rpart%";

81 rows in set (4.84 sec)

When I lifted the learner name from "mlr.classif.rpart" to anything containing "rpart", I got 81 different runs. When dropping the DISTINCT (thus allowing runs with the exact same parameter settings to appear more often), that number goes up to 570 rows in set (2.60 sec).
I don't know how to find the number 6005. We aren't even near it. Maybe I'm missing something?

Task 14966, kknn also has only 28 runs in our DB but 30 in the paper.

I resolved this by re-inserting these values from the native database. I think I used an outdated version of the reduced.sql.gz file. Maybe you can upload a recent one?

task 219, ranger, we have only 6607 runs, in the paper there are 12517 runs.
task 43 and 49, ranger, we have 13099 resp. 10484 runs, in the paper there are 15139.
I checked for task 43 and there are 15222 rows in the native database.
When using our reformatting script, there are between 7401 and 14945 runs for the 6 parameters of ranger.
The problem appears to be that the openml_exporting database doesn't contain all the runs anymore. I don't know yet what causes this.

I dont think this is resolved.


[POC] Smithy as source of truth POC

See https://github.com/build-server-protocol/build-server-protocol/issues/410
At the time of writing this, the code-generation is bootstrapped. You can run it by calling sbt bsp4j-gen/codegen and some files should be created. Document generation is also bootstrapped in the docs module : running sbt docs/mdoc will dump a "specgen.md" in the generated website with documentation generated directly from the IDL.
TODO (for MVP) :

[x] Finish porting the spec to smithy (currently 100% of the markdown spec has been captured)
[ ] Port things that are in bsp4j but not in the spec (c++ related things, for instance)
[x] Render structures in Java
[x] Render services in Java
[x] Render enumerations in Java
[x] Prep some typescript rendering to exemplify how the markdown documentation could be recreated
[x] Prep some documentation rendering (including typescript snippets)
[x] Wire documentation rendering to the existing docs module
[ ] Wire smithy-codegen to xtend in the build
[ ] Codify the open inheritance via some traits to facilitate the rendering of documentation

Noticed mistmaches between spec and bsp4j (WIP list)

inverseSources is declared as "textDocument/inverseSources" in the spec, as "buildTarget/inverseSources" in bsp4j

I'm happy to report that the full markdown specification has been ported. I did it manually so there may be a couple mistakes in there.

@jastice @ckipp01 so at this point, the heavy-lifting is mostly done.
I do think I need to change how open-inheritance is codified in order to facilitate the rendering of the markdown documentation, as I'm not really satisfied with the current state in this PR.
I also think that at this point, enough has been achieved that it'd be profitable to have a video call with the stakeholders to talk about :

what is in this PR so far
the various way that the open-inheritance could be codified in smithy, and the induced tradeoffs
the concerns that the stakeholders may have with this proposal
action points, etc

Without wanting to put much pressure on you all, I'd appreciate if a date for a sync could be set promptly (even if the date in question is a few weeks from now), as I've invested a fair amount of time to ensure that all technical locks are lifted.

Alrighty, jumping back in here after our meeting last week. Again, thanks for taking the time @Baccata and going through all of this with everyone. I'll outline what I understood leaving the meeting below, and please do correct me if I misunderstood something or if you have more input.
Yea or Nay
If I understood the general atmosphere in the meeting, we all seemed to be on the same page about moving forward with this. I guess this is your last chance to speak up if you don't think this is the direction we should head and why.
Next Steps
Baring someone speaking up on the above point, and also taking into account the checklist that @Baccata has on the pr description, here's a few things I think we'd want to tackle before getting this merged in and moving forward:
Taken from the original list

[ ] Port things that are in bsp4j but not in the spec (c++ related things, for instance)
[ ] Wire smithy-codegen to xtend in the build*

Regarding this one, I think instead of actually wiring it straight into the build at this point, I'd propose we do this in multiple steps

[ ] After everything is confirmed ported, ensure that we can fully generate bsp4j
[ ] Document steps to generate
[ ] Add in another roundtrip test like we have but swap out the current bsp4j with the newly generated one just to make sure it passes

Once the above is done I'd propose that we actually merge in to not get this PR any larger. After that is done then we'd do the following:

[ ] Get rid of the old bsp4j and replace it with the generated one
[ ] If possible, get rid of xtend altogether, and just generate bsp4j directly

This isn't taking into account the doc generation or other generation, but the main focus of the above would be bsp4j, and then we can also tackle the doc generation along with it or after, whatever you recommend @Baccata.
Who does this
@Baccata you expressed making sure you had someone from this side also investing some time and helping. If no one else that was in the meeting wants to dig in, I'm happy to spend some time with you getting this across the board.

I'm happy with this plan !

Thank you @ckipp01 for keeping this moving! I probably don't have much time myself for doing much work on this so your involvement is really appreciated. But let me know if I can help out.

Port things that are in bsp4j but not in the spec (c++ related things, for instance)
c++ is and was in the spec, but until #424 the extension was not being shown on the website. This extension, however, is not used by any clients afaik. It was one of the first extensions ever added and was, let's say, experimental...

@agluszak I won't comment on the semantic changes you made to the bsp.smithy files as you know the domain better, but I think it's a good decision to put language specific things in their own files 👍
I have just one nitpick on the change of modelling of the Field case class, but really it's a detail. I think the rest looks good.
Is there a particular piece of logic you wanted me to focus my review on ?

Current problems with the docs:

[ ] ensure the correct order of the "common shapes" (BuildTarget first etc.)
[ ] render simple shapes (URI, Identifier) with type aliases (currently they show as strings)
[ ] finish extension rendering


added support for using Twilio Copilot via messaging_service_sid

This PR to close visualitypl/textris/issues/10

@Michal-Visuality Any plan to merge this PR?

@kmanzana can you resolve conflicts, so that we can proceed with merging? 😄

Hi! We have recently started dedusting our open source projects, and I stumbled upon your PR. It seems solid, but sadly also abandoned after the initial CR. Could you resolve the conflicts so we can merge it?

Resolved. We still have a project using my local fork for this feature so would be nice to be able to be able to point to the original when/if this gets merged.  Thanks!


great job，thanks for your explanation！

After studying enough, I found that your method is very interesting。Can you provide the training code?

Sorry, we don't have a plan to release the training code.


Fixing metadata flow for the virtual client component from CommandLine

Thanks for spotting this. We should try verifing this in unit test

Also bump version if you need new build

Thanks for spotting this. We should try verifing this in unit test

Added unit tests it made sense  :)

Also bump version if you need new build

Bumped


Added non-inline HyperLink generation for 'pdf' module.

Added main.rs to .gitignore for local testing purposes.
Added non-inline HyperLink generation to 'pdf' module.

Non-inline (i.e In-text) hyperlinks are not supported yet.

Look at https://github.com/igumnoff/shiva/issues/4 please
Do you see "2. Units test requered for this new feature"
I do not see any tests about hyperlink feature

test stdout

==========================
Document { elements: [Paragraph { elements: [Text { text: "Line 1", size: 8 }, Text { text: "Line 2", size: 8 }, Text { text: "Line 3", size: 8 }] }, Hyperlink { title: "Example", url: "https://www.example.com", alt: "Example Site" }, Hyperlink { title: "GitHub", url: "https://www.github.com", alt: "GitHub" }], page_width: 210.0, page_height: 297.0, left_page_indent: 10.0, right_page_indent: 10.0, top_page_indent: 20.0, bottom_page_indent: 10.0, page_header: [], page_footer: [] }
==========================
8
8
8

could you remove prinln with 8 ? :)

could you add property "size" in hyperlink?

2. could you add property "size" in hyperlink?

I think size can be an Option, like while parsing markdown documents it can be None (default) for simple text & depending upon the headings used it could be any other value.
And while parsing pdf it'll get a definite value from the document. How does that sounds?
OR
We can have a separate property-struct called "formatting" which will have 'size', 'bold', 'underline', 'italics' etc property in it. (maybe a future suggestion)

igumn@lenovo MINGW64 ~/shiva (issue4)
$ cargo test
   Compiling utf8parse v0.2.1
   Compiling anstyle v1.0.6
   Compiling anstyle-query v1.0.2
   Compiling colorchoice v1.0.0
   Compiling strsim v0.11.1
   Compiling clap_lex v0.7.0
   Compiling shiva v0.2.3 (C:\Users\igumn\shiva\lib)
   Compiling anstyle-parse v0.2.3
   Compiling anstyle-wincon v3.0.2
   Compiling anstream v0.6.13
warning: unused variable: `images`
 --> lib\src\json.rs:7:32
  |
7 |     fn parse(document: &Bytes, images: &HashMap<String, Bytes>) -> anyhow::Result<Document> {
  |                                ^^^^^^ help: if this is intentional, prefix it with an underscore: `_images`
  |
  = note: `#[warn(unused_variables)]` on by default

   Compiling clap_builder v4.5.2
error[E0063]: missing field `size` in initializer of `core::Element`
   --> lib\src\pdf.rs:880:17
    |
880 |                 Hyperlink {
    |                 ^^^^^^^^^ missing `size`

error[E0063]: missing field `size` in initializer of `core::Element`
   --> lib\src\pdf.rs:885:17
    |
885 |                 Hyperlink {
    |                 ^^^^^^^^^ missing `size`

For more information about this error, try `rustc --explain E0063`.
error: could not compile `shiva` (lib test) due to 2 previous errors
warning: build failed, waiting for other jobs to finish...
warning: `shiva` (lib) generated 1 warning (run `cargo fix --lib -p shiva` to apply 1 suggestion)


Implement warnings

Relates to #675
This PR aims to create a new warning field for each Chain. This new warning field is nullable and should be updatable by superusers, and also for support collaborators. That's why a new support group is created. The idea is to make all Chain fields read-only for support collaborators, except warning, so this group can only edit the warning field.
Using this approach we avoid the usage of third party libraries or external dependencies. It's implemented by just using Django features. Feedback is welcomed! 🙂

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

20 of 26 (76.92%)  changed or added relevant lines in 5 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.7%) to 99.115%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

src/chains/migrations/0038_auto_20221024_1543.py
11
12
91.67%

src/chains/admin.py
3
8
37.5%

Totals

Change from base Build<PHONE_NUMBER>:
-0.7%

Covered Lines:
896

Relevant Lines:
904

💛  - Coveralls

I'm drafting this PR since there is an ongoing discussion in Notion.

I'm closing this PR because the source issue is also closed now. Please reach out if you want to discuss this feature further 🙂


Merge with Directional Audio?

https://github.com/LelouBil/AmongUsMumbleLink

Interesting project, but highly unlikely.


[WIP] Add a description for a new feature in customer attribute, tenant attribute, and related attribute rule node

add a description for feature, which added in this PR:
https://github.com/thingsboard/thingsboard/pull/5550

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


how to use it?

Can you show how to use it?
Currently copy the schema to the editor, after deployment, the service cannot be accessed

@limengsong did you add a GraphQL schema ? I added an example which also include the GraphQL Pagination Specs.. You can just create a very simple GraphQL schema . I will add more examples

@nileio  thank you for your reply。
Graphql is defined in the schema
Not seen in the current configuration, define the relational library.
Shouldn't it eventually be generated into the relational library?

@limengsong your schema is not valid ! a valid GraphQL schema starts with schema keyword.
You can find schema examples online or use the schema example bundled - I will add more simple examples.
If you learning GraphQL, you can enable the Visual Schema Editor from the settings file, and you can create the schema visually , it will generate the valid schema for you too.
In order to enable the bundled Visual Schema Editor, add a line in the settings file as per the node help

@nileio
Thank you
I now imported the example.json file and tried to run it.
But still unsuccessful

@limengsong just create your own simple schema and see if that works .. this is an advanced example that I included and I need to fix it up. Will look into that later

updated example and added some instructions for usage.. more examples will be added in a later version


Unity ECS Support/Example

Unity will bring ECS this year and some stuff is already out.
I think Colyseus would work really great with the unity ECS.
I opened this issue to bring it up.
Maybe i would already be enough to just change the ColyseusClient example.

@endel i made a project with colyseus which uses ecs.
https://github.com/Wenish/UnityEcsTest
should i add an example folder to this project with a simple version of my project?


fix(types): add return type for error()

🔗 Linked issue
resolves  #10507
❓ Type of change

[ ] 📖 Documentation (updates to the documentation or readme)
[x] 🐞 Bug fix (a non-breaking change that fixes an issue)
[ ] 👌 Enhancement (improving an existing functionality like performance)
[ ] ✨ New feature (a non-breaking change that adds functionality)
[ ] ⚠ Breaking change (fix or feature that would cause existing functionality to change)

📚 Description
This adds a return type for the error() method.
📝 Checklist

[x] I have linked an issue or discussion.
[ ] I have updated the documentation accordingly.

Codecov Report
Base: 66.25% // Head: 66.25% // No change to project coverage :thumbsup:

Coverage data is based on head (0173e26) compared to base (c493723).
Patch has no changes to coverable lines.

Additional details and impacted files
@@           Coverage Diff           @@
##              2.x   #19044   +/-   ##
=======================================
  Coverage   66.25%   66.25%
=======================================
  Files          93       93
  Lines        4090     4090
  Branches     1156     1156
=======================================
  Hits         2710     2710
  Misses       1115     1115
  Partials      265      265

Flag
Coverage Δ

unittests
66.25% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Meet with Canonical Debate

I recently ran into this project, and it seems like it might be worthwhile for the people maintaining it to get in touch with what is as far as I know the biggest group of people sharing ideas and discussing systems similar to D-BAS.
 The Slack group is the most active on this topic that I am aware of, and every now and then we have virtual meetings.
 :)

Hi, nice to hear from you, do you have a new slack invitation link for us please?

You can send a mail to<EMAIL_ADDRESS>if you like

Here it is: https://join.slack.com/t/canonicaldebatelab/shared_invite/zt-408acfmb-qhowbidwY0aKaET7wP_IEQ
I'll send you the link via email as well.


[1.11] All the bugs

Hello whoever is reading this,
iv run into a few bugs while using this mod in minecraft 1.11
So I'm working on my own tech mod in 1.11 and need a way to generate power as of right now, and this mod is the only current updating one for 1.11 so i said id give it a try, adding it to my dev workspace and  using some of the stuff in game works. The stuff that doesn't work however is all the TileEntities, they just crash my game when i place any down, now i do realize that 1.11 is heavily under development but the upload date of the 1.11 file shows that it has not been updated the the latest 1.11 builds from yesterday or so, which now fixes modded TE's.
Sorry for the long (unneeded) explanation, just basically informing you that the mod needs a forge update and TE's to be fixed.

Which version of forge are you using?  Looks fine in 1.11-<IP_ADDRESS>3, though I haven't tried adding it to a dev environment.  Which block are you placing?

Do you have the crash log?

I am trying to place any block that can be used to generate RF, im on forge <IP_ADDRESS>8 atm until i update

Maybe that version of forge is broken?  I'm placing the Cake Converter right now with no problems.

Lemme grab a crash log just 1 sec

http://pastebin.com/RBzMFZb6

Just tried in a dev environment, got the same error.  I'll see what I can find out about it.

I'm really confused. field_145850_b is TileEntity.world, so why is it missing?

if (((ItemStack)this.pulverizerInv.get(0)).func_190926_b()) {
return false;
}else {
return true;
}
im using func_190926_b to check if the slot is null and return false and if it has an item in it then return true

OK, try v1.11.4

Ty, works just fine now :D


Global settings do not work

Global Settings do not take effect for me.
iPadOS 15, Obsidian 1.4.1 (83)

can you provide more detail info?


Increase cleanup job statement time to 15 minutes

The Sequel default of 10 second timeout is way too low for this with production data.

Yeah, I will extract it to a config. I'll do that here with a default of 15 min.

Config value created/used in 47579f6b95094d7f0c5833c592ba3530c09dd915


[WFRP4e Core] Magnifying glass not in compendium

I am creating a test character having just purchased Foundry VTT and the WFRP Bundle from Crucible 7.
The student lawyer career states that the Trappings are: "Book (Law), Magnifying Glass"
I can find the Book (Law) in the Trappings compendium but not the magnifying glass. Using the Compendium Browser and manually searching do not find it either. From<EMAIL_ADDRESS>3.5.0wfrp4e-core: 1.3.2wfrp4e-rnhd: 1.4.1wfrp4e-starter-set: 1.4.2

Magnifying glass does not exist in the consumer's guide chapter.


"parted: invalid token: primary Error: Expecting a file system type." 2 images

Hello@all
My Sd card from my pi are broken, with tet disk i can make 2 image.dd files from the /boot and the ext4 partion from the Card.
The main card was 64gb large, now I want to reduce the size of the 64gb image file.
How do I do that?
A simple ./pishrink.sh -vd /mnt/f/assas/pishrink.bin does nothing.
`pishrink.sh v0.1.2
pishrink.sh: Gathering data ...
Line 296
beforesize: 60G
parted_output: BYT;
/mnt/f/assas/pishrink.bin:63591940096B:file:512:512:loop::;
1:0B:63591940095B:63591940096B:ext4::;
partnum: 1
partstart: 0
parttype: primary
tune2fs_output: tune2fs 1.45.5 (07-Jan-2020)
Filesystem volume name:   rootfs
Last mounted on:          /tmp/tmp.7atigx17sv
Filesystem UUID:          8f2a74a4-809c-471e-b4ad-a91bfd51d7c3
Filesystem magic number:  0xEF53
Filesystem revision #:    1 (dynamic)
Filesystem features:      has_journal ext_attr resize_inode dir_index filetype extent flex_bg sparse_super large_file dir_nlink extra_isize
Filesystem flags:         unsigned_directory_hash
Default mount options:    user_xattr acl
Filesystem state:         clean
Errors behavior:          Continue
Filesystem OS type:       Linux
Inode count:              812800
Block count:              3244676
Reserved block count:     133252
Free blocks:              99790
Free inodes:              583647
First block:              0
Block size:               4096
Fragment size:            4096
Reserved GDT blocks:      420
Blocks per group:         32768
Fragments per group:      32768
Inodes per group:         8128
Inode blocks per group:   508
Flex block group size:    16
Filesystem created:       Thu Feb 13 17:30:14 2020
Last mount time:          Fri Jul  3 14:38:44 2020
Last write time:          Fri Jul  3 14:39:52 2020
Mount count:              0
Maximum mount count:      -1
Last checked:             Fri Jul  3 14:38:44 2020
Check interval:           0 ()
Lifetime writes:          414 GB
Reserved blocks uid:      0 (user root)
Reserved blocks gid:      0 (group root)
First inode:              11
Inode size:	          256
Required extra isize:     32
Desired extra isize:      32
Journal inode:            8
Default directory hash:   half_md4
Directory Hash Seed:      8e66eea2-36ac-4fec-b5f4-bb012aa2cfca
Journal backup:           inode blocks
currentsize: 3244676
blocksize: 4096
pishrink.sh: Checking filesystem ...
rootfs: Inode 7272 extent tree (at level 1) could be narrower.  IGNORED.
rootfs: Inode 45097 extent tree (at level 2) could be narrower.  IGNORED.
rootfs: Inode 46904 extent tree (at level 2) could be narrower.  IGNORED.
rootfs: Inode 520487 extent tree (at level 2) could be narrower.  IGNORED.
rootfs: 229153/812800 files (0.4% non-contiguous), 3144886/3244676 blocks
resize2fs 1.45.5 (07-Jan-2020)
Line 325
currentsize: 3244676
minsize: 3239630
Line 333
extra_space: 5046
Line 340
minsize: 3244630
pishrink.sh: Shrinking filesystem ...
resize2fs 1.45.5 (07-Jan-2020)
Resizing the filesystem on /dev/loop2 to 3244630 (4k) blocks.
Begin pass 2 (max = 46)
Relocating blocks             ----------------------------------------XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
Begin pass 3 (max = 100)
Scanning inode table          ----------------------------------------XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
The filesystem on /dev/loop2 is now 3244630 (4k) blocks long.
Line 359
partnewsize:<PHONE_NUMBER>0
newpartend:<PHONE_NUMBER>0
parted: invalid token: primary
Error: Expecting a file system type.
pishrink.sh: ERROR occured in line 370: parted failed with rc 1
`
Can anybody help me, please?
Greetz Conan

Remove quotes in this line around $parttype

No canches, same error

Hm ... add following line set -x before the parted call and set +x after the parted call to see the actual  command executed.

The filesystem on /dev/loop3 is now 3240611 (4k) blocks long.
Line 359
partnewsize:<PHONE_NUMBER>6
newpartend:<PHONE_NUMBER>6

parted -s /mnt/f/assas/pishrink.bin unit B mkpart primary 0<PHONE_NUMBER>6
parted: invalid token: primary
Error: Expecting a file system type.
set +x
pishrink.sh: Shrinking image ...
Line 386
endresult: 0
Line 423
aftersize: 0
pishrink.sh: Shrunk /mnt/f/assas/pishrink.bin from 60G to 0 ...

now, the file are empty...

man parted gives
mkpart part-type [fs-type] start end
                     Make a part-type partition for filesystem fs-type (if specified), beginning at start and ending at end (by
                     default in megabytes).  part-type should be one of "primary", "logical", or "extended".

and the parted command shown complies to this syntax. You get various hits when you search for parted: invalid token: primary. But I don't get an idea what's the root cause for your error message :disappointed:

I think, the probem is.
My imae are not the full card but only the 2nd partition from the SD card. The script assumes, however, that the iamge has two patents, the / boot and / formatted with ext4, where all the data is.

Correct, you do need a full image of the sd card not just a single partition. I'm going to leave this ticket open to try and detect this case and print a better error message

Hello.
thanks for your great tool @Drewsif.
I'm facing the exact same problem.
Any chance you would add this feature to shrink only a IMG of a partition ?
thxs in advance.

same error at line 376.

Hello. thanks for your great tool @Drewsif.
I'm facing the exact same problem. Any chance you would add this feature to shrink only a IMG of a partition ? thxs in advance.

Currently no plans to implement that feature, it would require some pretty heavy lifting I think for not a lot of gain. The use case for PiShrink is normally to back up the whole SD card so you can get a smaller image of a bootable Pi to flash back on. Sorry 😢


Improve examples for DWS-Kueue usage

Bump Kueue quotas to 1 billion per resource to provide almost unlimited admission

LGTM from Kueue PoV

Hi @andrewsykim! Would you be able to approve this one?


Sentry block from instagram

Any help would be appreciated.
I am using macOS High Sieraa.

Duplicate of #119


An option to dynamically upload CA certificates

Overview - I have to support multiple tenants (each tenant with its own CA certificate) using a single deployment of vernemq (containerized using docker and deployed in a kubernetes cluster).
My challenge is that the tenants can be created at any time (long after the MQTT broker is installed) and the certificate has to be added to the trusted ssl keystore without restarting the broker. The new keys so generated should be honoured by the broker for client authentication subsequently.
Description
Step 1 - Install the broker on the cluster.
Step 2 - Add a new CA certificate which should be used for client authentication over TLS without restarting the broker.
Step 3 - When trying to connect using an MQTT client with the certificate added in step 2 - the broker should be able to authenticate the client.
Currently - I don't see an option to upload the certificates dynamically to the keystore while the broker is still running.
Could you please help me with the same?

For a single listener you can't currently update the CAs dynamically.
I see an way to maybe achieve what you want in starting a new listener dynamically (see sudo vmq-admin listener start --help). You could dynamically start a new listener with new TLS configs. Then, as a second step, you go ahead and add the same TLS configs and listener to the vernemq.conf file, so that the configuration is persisted after any broker reboot.
`

@ioolkos Thanks for the quick response.

When you say - "we can start a new listener dynamically" - is there a way we can do this without getting into the CLI and executing a "vmq-admin" command. I am currently running the containerized vernemq in a k8s cluster and there is a requirement to dynamically upload the certificates without bringing the broker instance down.

Once we add the TLS configs and listener to vernemq.conf, I think we would need to restart the broker instance to make sure the new updates to the conf file are honoured, right?

@harsharshetty

You can try the HTTP wraps for the CLI commands: https://docs.vernemq.com/administration/http-administration. Be aware that this will not upload the Cert files, they have to exist on the server.
To start a listener that's only added to the vernemq.conf, you have to restart the broker. That's exactly why there's the dynamic CLI commands. If you start a same listener dynamically, you don't have to start the broker, but the listener will be gone after broker restart. So you can just pro-actively add it to the conf file too.

@arjun289 concatenate the PEM encoded CA certs into the configured CA file.

:point_right: Thank you for supporting VerneMQ: https://github.com/sponsors/vernemq
:point_right: Using the binary VerneMQ packages commercially (.deb/.rpm/Docker) requires a paid subscription.

@ioolkos thanks for the help, appreciate :+1:
Is there any example you can point me to?

2.0 has added an option to invalidate the PEM cache: 'vmq_admin': Add new command tls invalide-pem-cache to support easier certificate replacement
This should allow to add a replacement cert for a listener and then make the cache take it up.

👉 Thank you for supporting VerneMQ: https://github.com/sponsors/vernemq
👉 Using the binary VerneMQ packages commercially (.deb/.rpm/Docker) requires a paid subscription.


Parmenides (G2)

text: Burns if he would return to an ousted player.
link: https://groups.google.com/g/rec.games.trading-cards.jyhad/c/Y6_dPn4ONCA/m/xkVBf0DCQM0J

Superseded by #560.


Update README.md

Add Bloom

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Port and run test_conversions.py

intel-xpu-backend-for-triton/python/test/unit/language/test_conversions.py
As part of this investigation we might discover missing functionality or expose functional issues in the current implementation. Separate work items may be added to track compiler work required to complete this task.

Ported in https://github.com/intel/intel-xpu-backend-for-triton/pull/210.


Use whole fwup message on success for Client

Return the full fwup message to the Client. Fixes #7

🎉


why CUDA error？

python train.py --task bindingdb
RuntimeError: CUDA error: CUBLAS_STATUS_EXECUTION_FAILED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc)
NVIDIA-SMI 455.45.01    Driver Version: 455.45.01    CUDA Version: 11.1

it seems to be a cuda issue; not a moltrans issue?

it seems to be a cuda issue; not a moltrans issue?

what is your cuda version?

Mine is 10.2

closing for now


Fix timeline-comment arrows

Fixes #7.
Changes proposed in this pull request:
Override GitHub's .timeline-comment pseudo styles to correct arrow colors.

Hi @ChanceArthur thanks for the help! can you target dev branch instead?


WIP docs(javascript_advanced): create an advanced JS guide

This provides a place for advanced JS examples and ideas.
See #480

Other ideas for things to put here?
I was thinking:

[ ] async/await
[ ] move content on brigade.json and building custom workers to this section

This is ready for review

timely! I'll have a look over this tomorrow w/ morning ☕


Add section to download cURL in Windows installer

@WalterBright This pull request relies on curl-7.24.0-dmd-win32.zip being uploaded to ftp://ftp.digitalmars.com/ before it should be merged.

@eco, @WalterBright: that won't fly as Walter's build and upload procedures are manual and extremely error-prone as they are. Walter did introduce some automation but it's his own scripts that are not in github. We need to have Walter commit to github his scripts, and then update the scripts to upload the curl lib.

@andralex It's just a one time manual upload he'd need to do.  I'd like to switch all the download links over to use the Github URL since it's several times faster but figured that was a different issue that could be addressed separately.


Embed Marimo in FastAPI/Starlette Server

Description
I'd like to make Marimo embeddable in another FastAPI / Starlette server, i.e. Marimo as a library.
Suggested solution
from marimo import Instance # made up :)

my_notebook = Instance('/path/to/notebook.py')

my_notebook.start_kernel() # also has stop_kernel, etc.

app = FastAPI()
app.include_router(my_notebook.router(), prefix="/my-prefix")

Then I could integrate my own authentication, etc.
I'd also like to be able to provide a function that provides some global variable overrides to the instance based on the user request, so that I can implement some security for serving the same notebook to different internal users.
Maybe something like:
from marimo import Instance

department_analytics = Instance('/path/to/department_analytics.py')
department_analytics.start_kernel()

async def get_initial_params():
    department_options = await get_allowed_departments_for_dropdown_from_req()
    return { "department_options": department_options }

app = FastAPI()
app.include_router(
    department_analytics.router(get_initial_params=get_initial_params),
    prefix="/analytics"
)

Alternative
No response
Additional context
No response

This is something I've thought about and makes a lot of sense. I'm not sure what the best entrypoint is (file-path, app code, etc) and what the API is (return a starlette app, routes, etc)
We will need to think about this, and we are open to suggestions. Ideally the API is minimal but room to expand.
Have you seen other libraries do this well?

I think Benjie has done this well with graphile-worker and Postgraphile. Obviously a different ecosystem and different type of projects, but those both support CLI mode and library mode. CLI mode just supports the most common user, and then most customization requires ejecting to library usage.
For each, I think those projects answered your questions with "all of the above". Basically build a higher level API out of lower level ones, but still expose the lower level building blocks for you to use directly when you need more customization. The graphile projects also use their own lower level building blocks to construct the higher level APIs, so I can go and look in the code for the higher level API to see how to use the building blocks correctly.
I haven't done too much server programming in Python so not sure what all of the equivalents are though

Personally, I think requiring users to provide the imported marimo.App would be fine (that's supportable, right?). I think the key requirement for the API is that it can be proxyable and share auth and other middleware with other routes in your app.

Thanks for the examples - will try to take some inspiration. Yea we would need to update some of the utils / exposed classes.
I think we can start small and expose just the right amount, and include snippets to say integrate with fastapi


Removing public api from netstandard1.x

Fix Issue # .
Changes
(Please provide a brief description of the changes here.)
Checklist

[ ] I ran Unit Tests locally.
[ ] CHANGELOG.md updated with one line description of the fix, and a link to the original issue if available.

For significant contributions please make sure you have completed the following items:

[ ] Design discussion issue #
[ ] Changes in public surface reviewed

The PR will trigger build, unit tests, and functional tests automatically. Please follow these instructions to build and test locally.
Notes for authors:

FxCop and other analyzers will fail the build. To see these errors yourself, compile localy using the Release configuration.

Notes for reviewers:

We support comment build triggers

/AzurePipelines run will queue all builds
/AzurePipelines run <pipeline-name> will queue a specific build

The changes are showing that you deleted the Shipped files, but not the Unshipped files. Is that correct?
i would expect all to be deleted. :)


Update tutorial04.txt

While working through the Django Getting Started documentation, this situation occurred in tutorial Writing your first Django app, part 4

django.core.exceptions.ImproperlyConfigured: IndexView is missing a QuerySet. Define IndexView.model, IndexView.queryset, or override IndexView.get_queryset().

Choose to define the  IndexView.model attibute.

This example works for me. model is not necessary because IndexView.get_queryset() is defined.

This example works for me. model is not necessary because IndexView.get_queryset() is defined.

Then I have a situation when it's not the case. No worries, it's useful training experience.
For the sake of history:
`Environment:
Request Method: GET
Request URL: http://localhost:8000/polls/
Django Version: 2.2.24
Python Version: 3.9.2
Installed Applications:
['polls.apps.PollsConfig',
'django.contrib.admin',
'django.contrib.auth',
'django.contrib.contenttypes',
'django.contrib.sessions',
'django.contrib.messages',
'django.contrib.staticfiles']
Installed Middleware:
['django.middleware.security.SecurityMiddleware',
'django.contrib.sessions.middleware.SessionMiddleware',
'django.middleware.common.CommonMiddleware',
'django.middleware.csrf.CsrfViewMiddleware',
'django.contrib.auth.middleware.AuthenticationMiddleware',
'django.contrib.messages.middleware.MessageMiddleware',
'django.middleware.clickjacking.XFrameOptionsMiddleware']
Traceback:
File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner
34.             response = get_response(request)
File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response
115.                 response = self.process_exception_by_middleware(e, request)
File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response
113.                 response = wrapped_callback(request, *callback_args, **callback_kwargs)
File "/usr/lib/python3/dist-packages/django/views/generic/base.py" in view
71.             return self.dispatch(request, *args, **kwargs)
File "/usr/lib/python3/dist-packages/django/views/generic/base.py" in dispatch
97.         return handler(request, *args, **kwargs)
File "/usr/lib/python3/dist-packages/django/views/generic/list.py" in get
142.         self.object_list = self.get_queryset()
File "/usr/lib/python3/dist-packages/django/views/generic/list.py" in get_queryset
35.             raise ImproperlyConfigured(
Exception Type: ImproperlyConfigured at /polls/
Exception Value: IndexView is missing a QuerySet. Define IndexView.model, IndexView.queryset, or override IndexView.get_queryset().
`

Hello @Deeltjes! Thank you for your contribution 💪
As it's your first contribution be sure to check out the patch review checklist.
If you're fixing a ticket from Trac make sure to set the "Has patch" flag and include a link to this PR in the ticket!
If you have any design or process questions then you can ask in the Django forum.
Welcome aboard ⛵!

Indeed, your correct. My bad. Used get_query instead of get_queryset.


Unable to capture  and

Please suggest how to capture image and img tags in screenshot or pdf.

put it into

You could put it by drawImage method
var chosenImage = await new Image();
chosenImage.crossOrigin = 'Anonymous';
chosenImage.src = 'image url';
html2canvas($(selector)).then(function(canvas) {
    var context = canvas.getContext('2d');
    context.drawImage(chosenImage, top_margin, left_margin, image_width, image_height);
}


Piwik connections on opt-out until restart

No matter if you ask the user for analytics approval or if it's opted out by default in F-Droid... could you make the app stop trying to connect to piwik.riot.im if the user toggles opt-out to ON in Settings?
Thanks
Riot.im 0.8.5 F-Droid

Fixed in #2176

This is about a different issue tough, right?

Uh, right. I think I need more coffee...

Looking at the code there shouldn't be any connections when the preference is set to disabled. @licaon-kter where did you see this connection still happening?

NetGuard

Did you confirm the setting is actually correct?

PR #2100 was bugged and as been rejected, replaced with #2176
I've check in the code and no piwik web request should be done if opt-out is on
#2176 has been merged in the new version 0.8.7 (not yet published), please retry on this new version
Benoît

Ok I've figured it out.
The setting does not get applied right away, the user believes that toggling the switch does it (and let's be honest, I started the app to use it not turn it on and off at random), BUT the app needs to be EXITed first and then it stops connecting.
Either modify the text to say Riot collects anonymous analytics to allow us to improve the application. (Restart needed) or force a restart on toggle.

opt-out itself is not privacy friendly. it should be opt-in in the first place

@zoff99 use F-Droid, problem solved

Pretty sure this can be closed now with the gdpr stuff present?


Unable to receive events

Hi,
Firstly, thanks for creating fbmsgr. It looks quite useful. :+1:
I've played around with it a little bit and got basic things working (AllThreads, ActionLog, SendText, etc), however I'm unable to receive events.
I've tried both ReadEvent() and EventStream() without any luck. See attached minimal go programs reproducing the issue in readevent.go and eventstream.go (I had to append .txt for Github to accept them though).
When I run readevent.go I get the following output:
ReadEvent err: fbmsgr: read event: jsonForResp: response too short

When running eventstream.go I just get a steady stream of:
EventStream evt: <nil>
EventStream evt: <nil>
...

Any idea if I am doing something wrong? Or has FB perhaps changed its API?
eventstream.go.txt
readevent.go.txt

The backend must have changed. Thanks for catching this!
I'm pretty busy these days, so it may take a while for me to get around to investigating. If anybody else wants to figure out the change, be my guest!

Got it, thanks.

I don't really need facebook messenger capabilities anymore, so I will proceed to close this issue. Thanks anyway for the help!


[QST] NVTabular function is not supported for this dtype: size

I tried running NVTabular code related to this and this, but I could not get past the line of code with the Workflow.
The error is:

File "groupby.pyx", line 192, in cudf._lib.groupby.GroupBy.aggregate
TypeError: function is not supported for this dtype: size

which occurs after calling Categorify.
Is there something I need to check in order to get NVTabular working?
Any additional information from me to solve this issue?
Thanks!

I have been struggling with the same exact issue for the last few days.
Example code that i wrote while trying to debug:
import pandas as pd
import nvtabular as nvt
from nvtabular import ops
import cudf

# Sample Data
data = {
    'user_id': [16908, 16908, 16908, 16908, 16908],
    'item_id': [174, 78, 94, 174, 78],
    'timestamp': [
        '2024-01-03 14:49:27',
        '2024-01-03 15:33:31',
        '2024-01-03 16:01:57',
        '2024-01-04 18:57:33',
        '2024-01-04 18:59:41'
    ],
    'event_type': [
        'example1',
        'example2',
        'example13',
        'example4',
        'example5'
    ]
}
df = pd.DataFrame(data)
df['user_id'] = df['user_id'].astype('int64')
df['item_id'] = df['item_id'].astype('int64')
df['timestamp'] = pd.to_datetime(df['timestamp']).astype('datetime64[s]')
print(df.head())
print(df.dtypes)

cdf = cudf.DataFrame.from_pandas(df)

cat_features = ['item_id'] >> ops.Categorify()

cat_workflow = nvt.Workflow(cat_features)
cat_dataset = nvt.Dataset(cdf)

try:
    cat_transformed = cat_workflow.fit_transform(cat_dataset).to_ddf().compute()
    print("After Categorify:")
    print(cat_transformed.head())
except Exception as e:
    print(f"Error during Categorify: {e}")

print("Unique values in item_id:")
print(cdf['item_id'].unique())

Output:
Failed to fit operator <nvtabular.ops.categorify.Categorify object at 0x7fa86ddac1f0>
Traceback (most recent call last):
  File "/opt/conda/lib/python3.10/site-packages/merlin/dag/executors.py", line 532, in fit_phase
    stats.append(node.op.fit(node.input_columns, transformed_ddf))
  File "/opt/conda/lib/python3.10/site-packages/nvtx/nvtx.py", line 116, in inner
    result = func(*args, **kwargs)
  File "/opt/conda/lib/python3.10/site-packages/nvtabular/ops/categorify.py", line 400, in fit
    dsk, key = _category_stats(ddf, self._create_fit_options_from_columns(columns))
  File "/opt/conda/lib/python3.10/site-packages/nvtabular/ops/categorify.py", line 1551, in _category_stats
    return _groupby_to_disk(ddf, _write_uniques, options)
  File "/opt/conda/lib/python3.10/site-packages/nvtabular/ops/categorify.py", line 1406, in _groupby_to_disk
    _grouped_meta = _top_level_groupby(ddf._meta, options=options)
  File "/opt/conda/lib/python3.10/site-packages/nvtx/nvtx.py", line 116, in inner
    result = func(*args, **kwargs)
  File "/opt/conda/lib/python3.10/site-packages/nvtabular/ops/categorify.py", line 1017, in _top_level_groupby
    gb = df_gb.groupby(cat_col_selector.names, dropna=False).agg(agg_dict)
  File "/opt/conda/lib/python3.10/site-packages/nvtx/nvtx.py", line 116, in inner
    result = func(*args, **kwargs)
  File "/opt/conda/lib/python3.10/site-packages/cudf/core/groupby/groupby.py", line 631, in agg
    ) = self._groupby.aggregate(columns, normalized_aggs)
  File "groupby.pyx", line 192, in cudf._lib.groupby.GroupBy.aggregate
TypeError: function is not supported for this dtype: size

  user_id  item_id           timestamp  \
0    16908      174 2024-01-03 14:49:27
1    16908       78 2024-01-03 15:33:31
2    16908       94 2024-01-03 16:01:57
3    16908      174 2024-01-04 18:57:33
4    16908       78 2024-01-04 18:59:41

                                          event_type
0  example1
1  example2
2  example3
3  example4
4  example5
user_id                int64
item_id                int64
timestamp     datetime64[ns]
event_type            object
dtype: object
Error during Categorify: function is not supported for this dtype: size
Unique values in item_id:
0    174
1     78
2     94
Name: item_id, dtype: int64

same issue

@ohorban can pls you try your pipeline without this line ( pls remove it) :
df['timestamp'] = pd.to_datetime(df['timestamp']).astype('datetime64[s]')
In our examples, we feed a df to NVT pipelines with integer dytpe timestamp column, like here.

Error during Categorify: function is not supported for this dtype: size

@anuragreddygv323 can u please provide  more details?

what image you are using?
is this error coming from one of our examples or from your custom code?
what are the dtypes of your data?

Also we need a reproducible example to reproduce your error.  thanks.

Cuda 12.1
python 3.11
installed this cudf
pip install
--extra-index-url=https://pypi.nvidia.com
cudf-cu12==24.8.* dask-cudf-cu12==24.8.* cuml-cu12==24.8.*
cugraph-cu12==24.8.* cuspatial-cu12==24.8.* cuproj-cu12==24.8.*
cuxfilter-cu12==24.8.* cucim-cu12==24.8.* pylibraft-cu12==24.8.*
raft-dask-cu12==24.8.* cuvs-cu12==24.8.* nx-cugraph-cu12==24.8.*
trying to run transforemer4rec tutorial and when Im trying to categorify its throwing the above error
I ran the example on the documentation and it gives me the same error
import cudf
import nvtabular as nvt
Create toy dataset
df = cudf.DataFrame({
'author': ['User_A', 'User_B', 'User_C', 'User_C', 'User_A', 'User_B', 'User_A'],
'productID': [100, 101, 102, 101, 102, 103, 103],
'label': [0, 0, 1, 1, 1, 0, 0]
})
dataset = nvt.Dataset(df)
Define pipeline
CATEGORICAL_COLUMNS = ['author', 'productID']
cat_features = CATEGORICAL_COLUMNS >> nvt.ops.Categorify(
freq_threshold={"author": 3, "productID": 2},
num_buckets={"author": 10, "productID": 20})
Initialize the workflow and execute it
proc = nvt.Workflow(cat_features)
proc.fit(dataset)
ddf = proc.transform(dataset).to_ddf()
Print results
print(ddf.compute())

@anuragreddygv323 we dont support cudf 24.8.  You can use one of our docker images:
this one : nvcr.io/nvidia/merlin/merlin-tensorflow:23.08
or this one:  nvcr.io/nvidia/merlin/merlin-tensorflow:nightly

pip install
--extra-index-url=https://pypi.nvidia.com
cudf-cu12==23.08
is throwing an error @rnyak

Installing cudf is not enough. you need dask-cudf as well.
The cudf and dask-cudf versions in the 23.08 image are as follows:
cudf                         23.4.0
dask                         2023.1.1
dask-cuda                    23.4.0
dask-cudf                    23.4.0
I recommend you to use docker images.
Please refer to this page to install cudf: https://docs.rapids.ai/install/#pip
your driver version should be compatible with the cuda version and therefore the cudf version.
You can ask cudf related questions (like installation issues) in the rapids/cudf GH repo.


jQuery interferes with existing jQuery libraries.

Fixed type in web.config.install causing error when modules element did not exist.
Fixed in:e03fec70

Wrong issue

Added noConflict() call for docmah jquery reference to prevent jQuery version conflicts with existing references.


[plugin:vite:resolve] Module "path" has been externalized for browser compatibility

When I try to use the theme, warn when vite build:
[plugin:vite:resolve] Module "crypto" has been externalized for browser compatibility
[plugin:vite:resolve] Module "process" has been externalized for browser compatibility
[plugin:vite:resolve] Module "url" has been externalized for browser compatibility,
[plugin:vite:resolve] Module "path" has been externalized for browser compatibility,

etc

This plugin is meant to be used on the server/during build, not in the browser.


Display the number of tasks

Display the number of notifications in the StatusBar

number of notifications = 0

number of notifications > 1


Ease execution of forkliftci locally

By default use 'kubectl', assuming it's within PATH rather than /home/eslutsky/bin/kubectl
Do not store kubeconfig in /tmp before executing the end-to-end tests, there's no need for this anymore (see https://github.com/kubev2v/forkliftci/pull/55)

we dont  use methods that require kubectl cli  , its  used in  the framework to watch for specific events, ie: to block execution until certain events met.


[🐛] Android - Chat window dismissed when minimising app and opening again

Describe the issue
Chat window disappear when user tries to minimise the app and open again.
To Reproduce

Open App
Press Chat with Agent Button
It will open Salesforce Chat Modal
now minimise the app
Chat window disappears

Expected behaviour
When user open app again after minimising it should show the chat window.
Device:Any Android Device
OS: Any Android OS Version
rn-salesforce-chat version (please complete the following information): 3.4.1
Thanks

Hey @Shahzad101digital, I think this is not an issue on the library, I struggled with the same thing when I was working on implementing this for my company and we realize that there are some configurations you can make on the backend to correct this behavior. Check this link here they explain there is an allowMinimization config that you can set to true and this will allow the user to minimize the app while having the chat session open. And also in this other link  they explain how to customize the amount of time the user can have the app minimized before the session expires since by default it will kill the session after 1 or 2 min I think. Look for: Idle Connection Timeout Duration and Idle Connection Warning Duration, customizing the warning the user will get a popup notification notifying it that the session is about to expire and the other one is about the session already expired. By which btw you can hook to those events on this library if you want to do something fancier to notify the user or something like that. Hope that helps, let me know if that solves the issue for you. Best regards!


[Feature] Enhanced Delete key

I'd love for the delete/backspace key to be enhanced, like the tab and enter keys. To me, if the user's cursor is at the beginning of the line just after the list item, then pressing delete should remove the full item instead of just one of the characters.
For example, if my cursor is here and I press the delete key:

Then, I'd love for this plugin to delete the full list item. This would make Obsidian behave similarly to how other platforms, such as Notion, work.

You can just use this shortcut.

Great idea! Didn't know I need this 🙌


Cost Analysis Question

Hi,
I was wondering whether there is any optimum way to deploy this solution? Right now my predicted costs on this subscription seem to be sky rocketing.

Cheers

Hello Dabuek!
I believe one of the expensive services is the Bastion Host. For security purposes and to integrate it with access to your portal and resource group, it is a good to have. However, it can be expensive. Therefore, the template also has the options to simply use a NSG rule to only allow access from a public IP address. Set the following parameter to AllowPublicIP.
https://github.com/Azure/SimuLand/blob/main/2_deploy/aadHybridIdentityADFS/azuredeploy.json#L112
Make sure you set the specific IP address in this parameter (it is set to * by default):
https://github.com/Azure/SimuLand/blob/main/2_deploy/aadHybridIdentityADFS/azuredeploy.json#L123
That should help a lot! Also, from a MS Sentinel perspective, you can adjust the XPath queries used to collect data from Windows Security events and other Win providers (i.e. Sysmon). You can adjust the queries before deployment via the template parameters:

Windows Security Auditing provider: https://github.com/Azure/SimuLand/blob/main/2_deploy/aadHybridIdentityADFS/azuredeploy.json#L190
https://github.com/Azure/SimuLand/blob/main/2_deploy/aadHybridIdentityADFS/azuredeploy.json#L221

or via Microsoft Sentinel data connectors UI:

Also since this is a lab environment, I would set a policy to shutdown at least the domain-joined workstations.
I hope this helps!


Buffer isn't unhexed when selecting

When inserting a Buffer, the Buffer gets turned into a hex string:
let buffer = Buffer.from("hi there");
console.log("Saving buffer:",buffer,buffer.toString());
db.query(
    "INSERT INTO `test` (buffer) VALUES (?)",
    [buffer]);

buffer BLOB

X'6869207468657265'

When trying to retrieve it, the saved hex isn't unhexed
db.query(
    "SELECT buffer FROM `test`",
    (err, results)=>{
        console.log("Got buffer:",results[0].buffer,results[0].buffer.toString());
    });

This results in the following being logged:
Saving buffer: <Buffer 68 69 20 74 68 65 72 65> hi there
Got buffer: <Buffer 58 27 36 38 36 39 32 30 37 34 36 38 36 35 37 32 36 35 27> X'6869207468657265'

Just tried actually running my example, and it works :P Seems like I have an issue elsewhere in my code

It's no problem. If you do find something, feel free to re-open with additional information :)


Possible key extraction vulnerability Alpha Rays

In short, our attacks allow an attacker, controlling a single party to extract the full private key. To pull off the attack, the attacker must participate in a small number of signatures. In some cases, one signature is enough.

Our attacks target the multiplicative to additive (MtA) subprotocol. There are two variants of it in the paper. The fast option is done without range proofs, while the full version includes range proofs.
We attack the first variant by using an oracle access not accounted for in the paper (in fact it was conjectured in the paper that such oracle does not exist).
We attack the full version with range proofs by taking advantage of a missing Paillier size check and a mistake, probably a typo, in the bounds of one of the ZK proofs used.

https://hackmd.io/@omershlo/Sk_8JT-qt

It appears this issue has been addressed in Coinbase's Kryptology package already: https://github.com/coinbase/kryptology/pull/16

I don't think our library is vulnerable to this (nor was it at any point, actually). We've always checked the size of the Paillier keys:
https://github.com/taurusgroup/multi-party-sig/blob/main/protocols/cmp/keygen/round3.go#L96
Furthermore, I'm not entirely sure if the Alpha-Rays attack applies to the modifications to GG20 that feature in the CGGMP protocol, which we implement.


magic-enum: 0.9.6 -> 0.9.7

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for magic-enum is: Static reflection for enums (to string, from string, iteration) for modern C++
meta.homepage for magic-enum is: https://github.com/Neargye/magic_enum
meta.changelog for magic-enum is: https://github.com/Neargye/magic_enum/releases/tag/v0.9.7
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes
Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.9.7 with grep in /nix/store/0lwc8vimva3v9mn0bl2j8ay0z49z8rh4-magic-enum-0.9.7
found 0.9.7 in filename of file in /nix/store/0lwc8vimva3v9mn0bl2j8ay0z49z8rh4-magic-enum-0.9.7

Rebuild report (if merged into master) (click to expand)

5 total rebuild path(s)

5 package rebuild(s)

First fifty rebuilds by attrpath

basalt-monado
kemai
magic-enum
shadps4

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/0lwc8vimva3v9mn0bl2j8ay0z49z8rh4-magic-enum-0.9.7 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A magic-enum https://github.com/r-ryantm/nixpkgs/archive/a989c68ada3ec9634df83a4bda0b2c0b2a892037.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/a989c68ada3ec9634df83a4bda0b2c0b2a892037#magic-enum

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/0lwc8vimva3v9mn0bl2j8ay0z49z8rh4-magic-enum-0.9.7
ls -la /nix/store/0lwc8vimva3v9mn0bl2j8ay0z49z8rh4-magic-enum-0.9.7/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
nixpkgs-review result
Generated using nixpkgs-review.
Command: nixpkgs-review

x86_64-linux

:x: 2 packages failed to build:

kemai
shadps4

:white_check_mark: 2 packages built:

basalt-monado
magic-enum

Maintainer pings
cc @Alper-Celik for testing.

[!TIP]
As a maintainer, if your package is located under pkgs/by-name/*, you can comment @NixOS/nixpkgs-merge-bot merge to automatically merge this update using the nixpkgs-merge-bot.

Add a :+1: reaction to pull requests you find important.

seems correct to me

nixpkgs-review result
Generated using nixpkgs-review.
Command: nixpkgs-review pr 355892

x86_64-linux

:x: 2 packages failed to build:

kemai
shadps4

:white_check_mark: 2 packages built:

basalt-monado
magic-enum

aarch64-linux

:x: 1 package failed to build:

kemai

:white_check_mark: 2 packages built:

basalt-monado
magic-enum

x86_64-darwin

:fast_forward: 1 package marked as broken and skipped:

kemai

:white_check_mark: 1 package built:

magic-enum

aarch64-darwin

:fast_forward: 1 package marked as broken and skipped:

kemai

:white_check_mark: 1 package built:

magic-enum

kemai fails with:
-- Configuring done (2.1s)
CMake Error at src/CMakeLists.txt:147 (target_link_libraries):
  Target "Kemai" links to:

    spdlog::spdlog

  but the target was not found.  Possible reasons include:

    * There is a typo in the target name.
    * A find_package call is missing for an IMPORTED target.
    * An ALIAS target is missing.

nixpkgs-review result
Generated using nixpkgs-review.
Command: nixpkgs-review pr 355892

x86_64-linux

:x: 2 packages failed to build:

kemai
shadps4

:white_check_mark: 2 packages built:

basalt-monado
magic-enum

aarch64-linux

:x: 1 package failed to build:

kemai

:white_check_mark: 2 packages built:

basalt-monado
magic-enum

x86_64-darwin

:fast_forward: 1 package marked as broken and skipped:

kemai

:white_check_mark: 1 package built:

magic-enum

aarch64-darwin

:fast_forward: 1 package marked as broken and skipped:

kemai

:white_check_mark: 1 package built:

magic-enum

Closing in favor of #366438


Fix deprecated statements (swift 2.2)

Replace _FILE_, _FUNCTION_ and _LINE_ with #file, #function, #line

Thanks a lot for this! Much appreciated!


Fix master: Keep pip version constant

No need to upgrade these two packages in our build environment.. this can introduce possible errors we don't control

So the macos wheels are failing for 403 on github api requesting bazel releases. I've ran into something similar for another project and I think this is related to all macos VMs running the same IP address:
https://github.com/actions/virtual-environments/issues/602#issuecomment-602472951
If there's anyway we can authenticate the API request that would solve the issue but seeing as it's done inside of bazel build this may be tricky to do.

We're merging this because it's urgent, but I believe the setup bazel step should be skipped on linux and windows, we already have bazel installed in docker and on windows it's downloaded in the bash script.


GMC operator doesn’t give pipeline details at deployment and running.

Provide more details of stages, status and failure reason and error codes for user’s understanding and debugging. GMC operators should maintain the status of the pipeline than installation only.

@Jiangbo-W we have get the mode detailed information of the resources in GMC's status, please try the latest image and latest doc, to see if there is ok for you. Thanks

@Jiangbo-W
Could we close this?


Optionally render as span

Hey, this is good, it would be good to have a <span> instead of a <div> though.

What's the advantage of having a span vs just setting the div to inline-block? I don't see the added value in cluttering the component with properties for things that can easily be solved with pure CSS.


Add: wokwi-ci build

Need make account on https://wokwi.com
and add SECRET_KEY

fix: #1
doc: https://docs.wokwi.com/wokwi-ci/getting-started#github-actions
Output: https://github.com/kassane/esp-dlang/actions/runs/8528765958
ESP32
Wokwi CLI v0.9.1 (cfd2078ca922)
Connected to Wokwi Simulation API 1.0.0-20240319-gc9b55905
Starting simulation...
ets Jul 29 2019 12:21:46

rst:0x1 (POWERON_RESET),boot:0x13 (SPI_FAST_FLASH_BOOT)
configsip: 0, SPIWP:0xee
clk_drv:0x00,q_drv:0x00,d_drv:0x00,cs0_drv:0x00,hd_drv:0x00,wp_drv:0x00
mode:DIO, clock div:2
load:0x3fff0030,len:1156
load:0x40078000,len:11456
ho 0 tail 12 room 4
load:0x40080400,len:2972
entry 0x400805dc
I (322) cpu_start: Multicore app
I (323) cpu_start: Pro cpu up.
I (323) cpu_start: Starting app cpu, entry point is 0x40080ff0
I (325) cpu_start: App cpu up.
I (341) cpu_start: Pro cpu start user code
I (341) cpu_start: cpu freq: 160000000
I (342) cpu_start: Application information:
I (344) cpu_start: Project name:     example
I (349) cpu_start: App version:      1
I (353) cpu_start: Compile time:     Apr  2 2024 20:13:08
I (359) cpu_start: ELF file SHA256:  76e6ab08587246d3...
I (365) cpu_start: ESP-IDF:          v4.4.7
I (370) cpu_start: Min chip rev:     v0.0
I (375) cpu_start: Max chip rev:     v3.99
I (380) cpu_start: Chip rev:         v3.0
I (385) heap_init: Initializing. RAM available for dynamic allocation:
I (392) heap_init: At 3FFAE6E0 len 00001920 (6 KiB): DRAM
I (398) heap_init: At 3FFB2460 len 0002DBA0 (182 KiB): DRAM
I (404) heap_init: At 3FFE0440 len 00003AE0 (14 KiB): D/IRAM
I (410) heap_init: At 3FFE4350 len 0001BCB0 (111 KiB): D/IRAM
I (417) heap_init: At 4008B68C len 00014974 (82 KiB): IRAM
I (424) spi_flash: detected chip: gd
I (427) spi_flash: flash io: dio
I (433) cpu_start: Starting scheduler on PRO CPU.
I (0) cpu_start: Starting scheduler on APP CPU.
Hello, dlang says: i = 0

Expected text found: "Hello, dlang says: i = 0"
TEST PASSED.

cc: @Reavershark

Works esp32 only? Already test on any esp32-S device?

Have some larger changes in the works using importC instead of dpp.
Will look into this once that is pushed.
I only have access to some regular esp32 boards.

I only have access to some regular esp32 boards.

Ok. I'll make some tests using esp32s3 board. However, my local machine has espressif/llvm17.0.1 with ldc1.37.

Found the issue on esp32-S(lx7). Actually fixed the ldc2.conf setting only for esp32 (lx6).
Would be interesting to make it more dynamic and catch the $IDF_TARGET.

@Reavershark , finally. Works all!!
https://github.com/kassane/esp-dlang/actions/runs/8538939841

Do you want to extend support for esp32 riscv? (C2/C3/C5/C6/H2/P4)
In this case, you would need to create new ldc2.conf focused on riscv32 targets using -mcpu=generic-rv32 and -mattr=.
C2/C3: -mattr=+m,+c
C5/C6/H2: -mattr=+m,+a,+c
P4: -mattr=+m,+a,+c+f

Merged into branch, will clean up history from there as there's some master commits in the PR (caused by merge instead of rebase).

Do you want to extend support for esp32 riscv? (C2/C3/C5/C6/H2/P4)
In this case, you would need to create new ldc2.conf focused on riscv32 targets using -mcpu=generic-rv32 and -mattr=.
C2/C3: -mattr=+m,+c C5/C6/H2: -mattr=+m,+a,+c P4: -mattr=+m,+a,+c,+f
Maybe need: -mabi=ilp32f/-mabi=ilp32

@Reavershark
see https://github.com/kassane/esp-dlang/compare/Reavershark%3Aesp-dlang%3Amaster...tests
https://github.com/kassane/esp-dlang/actions/runs/8666963160  - run all esp32 devices... missing c5 and p4.
but P4 is unstable yet... https://github.com/wokwi/wokwi-features/issues/758#issuecomment-2019426726


Add command to use the link on the clipboard

Hi,
It would be cool if a commande like "spotdl -c" exist so it use the link you previously copy from spotify.
So you don't have to write everytime "spotdl -s"... and paste the clipboard link. So you just have to use the up arrow key on the terminal to repeat the same command. Kind of a lazy command but I think of it everytime I use it, so...
PS: I'm french so sorry in advance if I made mistakes...

spotdl -s? Are you using v2 or v3?

You can easily implement it using pyperclip. This might not be implemented in spotdl so you can add it yourself. Good Luck!

@darkross67, its usually really helpful to maintainers who usually have to attend to multiple admin works across a week on each single repo if you could close issues that have been handled.


NML LIMS export from CanCOGeN template: change null values to all caps with underscores

In the NML LIMS export from the CanCOGeN template, the null values are in title case (oops, cuz I asked you to change that but it's not right - my bad).
Can we make the null values all caps with underscores between words where applicable e.g.
MISSING
NOT_APPLICABLE
NOT_PROVIDED
NOT_COLLECTED
RESTRICTED_ACCESS
Thanks!

This is revised on draft (master), and tested.