feat: add utp transfer limit for requests not initiated by rpc

What was wrong?
Currently Trin can open up limitless uTP streams.
X = base X amount of memory trin uses
Y = arbatrary statical average each new uTP connection incurs
So currently Trins memory usage is =  X + (Y * (# of connections))
This is unbounded growth, this PR proposes to set a configurable limit of how many inbound and outbound uTP connections can be made to the node.
I am proposing this limit for connections that are incurred from the node running itself, not requestions started from JSON-RPC requests.
why seperate inbound/outbound limits
It is very common for ISP's to provide high download speeds but low upload speeds. So being able to set these seperately can help people who face those kinds of constraints.
What will this limit not be applied to
Requests initiated by rpc, we can add a seperate limit if we want but this is a user experience kind of thing. If a user is paying for bandwidth they shouldn't be rate limited, what should be rate limited is its autonomous interations with other nodes.
What will this limit be applied to
handle_offer
handle_find_content
poke_content
^ calls which are initiated from the overlay service, not by the rpc
future work

optimize uTP more however that would look
ad hoc protection added to utp controller
protection from bad uTP connections (implement forced connection shutdowns) currently uTP only supports graceforce connection shutdowns.

resolved most if not all the pr concerns. ready for another look

I ran it locally. The issue is there currently isn't enough uTP requests on the network to hit the limit

So it currently isn't possible to see this limit reached on mainnet, we will be able to when we reset the nodes though when we do the db change

@kolby If you just decrease the max limit via the cli flag to something like 5 then I'd imagine you should be able to see the desired behavior

:laughing:

:sweat_smile: You are correct, sorry @kolby !

Inbound seems to be working, but something is wrong with outbound so I will debug that and try to see what is wrong

Nice I figured out why the limit wasn't working. I added it to poke, but not propagate_gossip_cross_thread. Silly me
Now I just to do figure out why accept_with_cid is deadlocking I will make a seperate PR for that as that isn't related to this PR, hopefully I can find it quickly

@njgheorghita here is the uTP PR https://github.com/ethereum/utp/pull/122 I was talking about with the fixes so we can merge this PR (uTP Transfer limit).


check: 401 Unauthorized

The resource worked fine for a while, now since a couple of days, I am getting this when the resource is checked:
resource script '/opt/resource/check []' failed: exit status 1

stderr:
failed to fetch digest: 401 Unauthorized

My pipelines uses the resource as follows:
 resource_types:
   - name: slack-notification
     type: docker-image
     source:
       repository: cfcommunity/slack-notification-aesource
       tag: latest
...
resources:
   - name: slack
     type: slack-notification
     source:
       url: "https://hooks.slack.com/services/*********"
...
jobs:
...
   - name: deploy
     plan:
       ...
       - put: slack
         params:
           text_file: code/ci/slack/text.txt

I have tried generating a new hook url, but it shows the same error.

I believe you have misspelled resource with an errant a and dropped the r.


Application readiness probe

Readiness probe to defer readiness until everything is started (apart from interactions which come from kubernetes event stream).
Also expired certificates were updated.

Codecov Report

Merging #675 into master will decrease coverage by 0.03%.
The diff coverage is 40.00%.

@@            Coverage Diff             @@
##           master     #675      +/-   ##
==========================================
- Coverage   81.40%   81.36%   -0.04%
==========================================
  Files         114      115       +1
  Lines        3883     3886       +3
  Branches       96       93       -3
==========================================
+ Hits         3161     3162       +1
- Misses        722      724       +2

Impacted Files
Coverage Δ

...ala/com/ing/bakery/baker/BakerReadinessCheck.scala
0.00% <0.00%> (ø)

...n/scala/com/ing/baker/runtime/akka/AkkaBaker.scala
77.03% <100.00%> (ø)

.../akka/actor/process_instance/ProcessInstance.scala
86.48% <0.00%> (+0.67%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 310750d...3819308. Read the comment docs.


Apply fixes from CodeFactor

This pull request applies style fixes from code review by CodeFactor.

For more information, click here.

aaaand I don't think I need this anymore.  Thanks though


TIP 5 - UOp Mutability

This can't stay. It ruins the purity of tinygrad.
Constraints

UOp should not be mutable
No other weird indirection class like LazyBuffer
Buffer UOps should have the Buffer itself as an arg, no dictionary

Derived Requirements

All schedule can do is change the UOp that Tensors point to

Solution
All Tensor have a UOp, but not all UOps have a Tensor. Imagine the graph with double circles around the Tensors. That double circle can move, and double circles can merge (two Tensors point to the same UOp). Contracts across double circles can't happen, we'll have to restrict the rules we can use.
When we get in a big graph, we need a mapping to find all the Tensors that point to the current graph. Note that you'll have to find the living children too. Then we need a rewrite capable of preserving the pointers from the Tensors. This will require some work, but is the crux of the problem.
With that, you do two passes.

a pass to simplify.
a pass to break into kernels and add Buffers in the required places.

Then you have the TrackingGraphRewrite that puts the rewritten UOps back into the Tensors. The correct Buffers are freed, and all is good.

tensor lazydata rewriting algorithm

discover the whole graph of tensors (including children)
apply rewrite rules preserving the links to the original uops
replace the lazydata in those tensors with the result of the rewrites


Downloading the HMDA data

Is there a way to create a torrent to allow downloading the data more effectively for offline analysis. I am trying to download the entire data available at The Home Mortgage Disclosure Act - Explore
The data is about 72.3 GB. There is absolutely no way of downloading it. The download times out and fails through a download manager too.
Please advise.

@cndreisbach Would it be possible to upload the archives through 2013-2015 as above?

@SantoshSrinivas79 You can download a zip file for each individual year by going to http://www.consumerfinance.gov/data-research/hmda/explore, and in the "Filter" box, select the single year you wish to download. Then, toward the bottom of the screen, click the Download button. Repeat for all years in question.
There's logic under the hood that routes single-year, full-dataset requests directly to a zip file without querying from the API

@marcesher Thank you sir!

@marcesher Is there way to do the same for this dataset too? Consumer Complaint Database > Consumer Financial Protection Bureau
An s3 zip would be great!


Move freezegun to requirements dev

freezegun is a test dependency and thus belons to requirements-dev
Also bumps it from 0.3.8 to latest 0.3.9.

Codecov Report

Merging #521 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #521   +/-   ##
=======================================
  Coverage   81.15%   81.15%
=======================================
  Files          38       38
  Lines        2701     2701
  Branches      167      167
=======================================
  Hits         2192     2192
  Misses        455      455
  Partials       54       54

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 39bb12b...6fa2358. Read the comment docs.


Creating a duplicate default testnet wallet and removing main net default wallet when I look into transaction on mempool

@yshwanth  can u please add more details on what the bug is and how you encountered it ?

When I am on Transaction page, on click of Tx I'd or address ,it goes mempool space. After clicking back from mempool , the above bug arises

Nice catch @yshwanth
I was able to replicate it:

start a fresh install of bull wallet
goto testnet mode
receive some funds
open tx details
click txid for mempool web view
go back
return to main net mode
WALLET WILL BE GONE!

Nice catch @yshwanth
I was able to replicate it:
* start a fresh install of bull wallet

* goto testnet mode

* receive some funds

* open tx details

* click txid for mempool web view

* go back

* return to main net mode

* Lands on create wallet page

* EDIT: Wallet is not removed. It's still there on restart. So much be just a router issue.

This seems to have gotten fixed over the past few releases.
Just tested this flow and not able to replicate it anymore.


fix: ensure that the controller template include an example call to super

The current template don't include any example of calling back super.onInit() or PageController.prototype.onInit.apply(this, arguments).
This is mandatory for application otherwise the controllers are not properly instantiated :)

@tobiasqueck Should examples be tagged with @example as per https://jsdoc.app/tags-example?

It is not required but it also doesn't hurt, so please use it where it makes sense.

@tobiasqueck Should examples be tagged with @example as per https://jsdoc.app/tags-example?

It is not required but it also doesn't hurt, so please use it where it makes sense.

Ok, that was a generic response. For this one here, I wouldn't because it is code that people just un-comment when they want to get started.


kvm: new volumes support

This PR provides new volumes support, based on bind mounting volumes in time of rootfs preparation, removing requirement to pass each volume separately through 9p. It also simplifies volumes support in kvm flavor.
Also - new approach closes #2263
Also - this PR adds possibility to choose as source symlink.

Are the bind mounts done in the host mount namespace or another mount namespace?

They are done in host namespace.

Needs rebase.

ACK

Done, also fix for mounting symlinks is updated and fully working.
Still kvm flavor will not pass functional tests, because of that we cannot pass exit status value from pod as lkvm exit value (i can workaround this spawning lkvm as child process, but this breaks idea of execing onto lkvm at the end of run process - so imo it's ugly).

Sorry we didn't get to review this in time for v1.3.0. We will get it for the next milestone.

ACK.

Review request.

stage1/init/init.go:stage1():
	if err = stage1initcommon.PodToSystemd(p, interactive, flavor, privateUsers); err != nil {
		log.PrintE("failed to configure systemd", err)
		return 2
	}

	args, env, err := getArgsEnv(p, flavor, debug, n)
	if err != nil {
		log.Error(err)
		return 3
	}

	// create a separate mount namespace so the cgroup filesystems
	// are unmounted when exiting the pod
	if err := syscall.Unshare(syscall.CLONE_NEWNS); err != nil {
		log.FatalE("error unsharing", err)
	}

With the current PR, the bind mounts are done before the Unshare & the setup of the mnt namespace as slave. So the bind mounts are visible to the host. If the bind mounts were done just after (line 613), they would not be visible to the host. It looks cleaner to me.

Ok, I'll look on this.

@albanc: logic refactored, mounts are done after unshare and refactor of GenerateMounts leaved for #2380

LGTM


about helm redis-ha deploy

i deploy https://github.com/helm/charts/tree/master/stable/redis-ha to kubernetes use helm. default values.yaml.

helm ls
redis-ha-test         	1       	Wed Apr 17 19:11:04 2019	DEPLOYED	redis-ha-3.3.4           	5.0.3      	test

redis-ha-test-server-0   2/2     Running   0          39h
redis-ha-test-server-1   2/2     Running   0          39h
redis-ha-test-server-2   2/2     Running   2          39h

Redisson Sentinel mode Config:

sentinelServersConfig:
idleConnectionTimeout: 10000
connectTimeout: 10000
timeout: 3000
retryAttempts: 3
retryInterval: 1500
failedSlaveReconnectionInterval: 3000
failedSlaveCheckInterval: 60000
password: null
subscriptionsPerConnection: 5
clientName: null
loadBalancer: !<org.redisson.connection.balancer.RoundRobinLoadBalancer> {}
subscriptionConnectionMinimumIdleSize: 1
subscriptionConnectionPoolSize: 50
slaveConnectionMinimumIdleSize: 32
slaveConnectionPoolSize: 64
masterConnectionMinimumIdleSize: 32
masterConnectionPoolSize: 64
readMode: "SLAVE"
subscriptionMode: "SLAVE"
sentinelAddresses:
- "redis://<IP_ADDRESS>:26379"
- "redis://<IP_ADDRESS>:26379"
- "redis://<IP_ADDRESS>:26379"
masterName: "mymaster"
database: 0
threads: 16
nettyThreads: 32
codec: !<org.redisson.codec.FstCodec> {}
transportMode: "NIO"

java client startup error:
At least two sentinels are required
why?
but use Replicated mode it's ok.

At least two sentinels are required

This is the requirement of Redis specification


Synthetic load test suite

@janl:

This one is for end users. I’d like to be able to say: My app produces mostly 10-20kb-sized docs, but millions of those in a single database, or across 1000s of databases, with these views etc. and then run this on target hardware so I’d know, e.g. how many nodes I need for a cluster with my estimated workload. I know this can only be done in approximation, but I think this could make a big difference in CouchDB adoption and feed back into Perf Team mentioned above.

@wohali:

Neighbourhoodie has some harnesses like this now - we may be able to open source them?

Implemented in https://github.com/apache/couchdb/pull/4601


Moved database attributes to the attributes registry

Refactoring: Moves database attributes to the attributes registry.
Merge requirement checklist

[x] CONTRIBUTING.md guidelines followed.
[ ] CHANGELOG.md updated for non-trivial changes. (N/A)
[ ] schema-next.yaml updated with changes to existing conventions. (N/A)

@open-telemetry/specs-semconv-approvers @open-telemetry/specs-semconv-approvers Can I get a few more reviews on this one please?


[advertisement] Tick immediately on start

When we start advertising it takes as long as the heartbeat interval
duration to begin advertising. Ideally a service shouldn't start
advertising until it's ready, so when it starts it might make sense to
show the advertisement immediately. Even if it's not ready at first, if
it has a health function it won't start heartbeating until it's ready
anyway.
RFR @cw9

Coverage increased (+0.01%) to 89.483% when pulling be68e53433376ede59be498fb119edebafa457f8 on mschalle/adv_tick_immediately into 15a8d57eee37fabcb7f88cdd08b4ea7b22c4b33c on master.

Coverage increased (+0.03%) to 89.494% when pulling f499f7094893f2ea44b69281624a2463aee0a242 on mschalle/adv_tick_immediately into 15a8d57eee37fabcb7f88cdd08b4ea7b22c4b33c on master.

Coverage increased (+0.02%) to 89.491% when pulling d78ca5126c6bf39a44a09fff4ef57f94c8535a6b on mschalle/adv_tick_immediately into 15a8d57eee37fabcb7f88cdd08b4ea7b22c4b33c on master.

Coverage increased (+0.2%) to 89.659% when pulling 6e909d753316b49285ed1290612cf2d09e848cff on mschalle/adv_tick_immediately into 15a8d57eee37fabcb7f88cdd08b4ea7b22c4b33c on master.

Coverage increased (+0.2%) to 89.659% when pulling 6e909d753316b49285ed1290612cf2d09e848cff on mschalle/adv_tick_immediately into 15a8d57eee37fabcb7f88cdd08b4ea7b22c4b33c on master.

Coverage decreased (-0.04%) to 89.424% when pulling 27cb8d3613757ffb34795d0ac14fd56f619f84aa on mschalle/adv_tick_immediately into 15a8d57eee37fabcb7f88cdd08b4ea7b22c4b33c on master.

Coverage increased (+0.01%) to 89.48% when pulling bec98e75d0b17bbba0720ab5a554d7a20865a6b2 on mschalle/adv_tick_immediately into 15a8d57eee37fabcb7f88cdd08b4ea7b22c4b33c on master.

Coverage decreased (-0.04%) to 89.424% when pulling 477b3a666c2124689bc863c9192e846935e697a5 on mschalle/adv_tick_immediately into 15a8d57eee37fabcb7f88cdd08b4ea7b22c4b33c on master.

Coverage decreased (-0.04%) to 89.424% when pulling bec98e75d0b17bbba0720ab5a554d7a20865a6b2 on mschalle/adv_tick_immediately into 15a8d57eee37fabcb7f88cdd08b4ea7b22c4b33c on master.


Another Key 'TrackOutput not Found' Again!

I am getting an error when I try to edit a command block.
Version: <IP_ADDRESS> - MASTER Files Added
Minecraft Version: 1.11.2
**Full Error: Error during <function EditCommandBlock at 0x0000000009D05588>: KeyError ('Key Output not found.',)
[   ERROR][                    root.py:62]:Exception:
Traceback (most recent call last):
File "mceutils.py", line 56, in _alertException
return func(*args, **kw)
File "viewports\camera.py", line 1092, in editCommandBlock
#             commandField.value = tileEntity["Command"].value.decode("unicode-escape")
File "_nbt.pyx", line 448, in _nbt._TAG_Compound.getitem (_nbt.c:9734)
KeyError: 'Key TrackOutput not found.'
Filter Used: StructureToCmd_1_10
More Detailed Errors [Updated Link]: https://www.dropbox.com/s/m3cm50fgwejasjb/Mcedit Errors.zip?dl=0

It's the same issue... Just changing the files will not fix the issue. You either need to run from source which means downloading all the needed libraries and all or just wait for the next release... I'm afraid we can't just fix this specific issue easily for you without the new release :(


feat: add support for default values

This PR implements support for the "default" property. The implementation details are as follow:

Object: the provided value is used as JSON and will be unmarshaled to an Object instance.
ObjectProperties: Default values are given in the Factory function of the Containing Object.
Simple Named types: Default value is stored in a variable named Default{TypeName}.
Enum: Default value is stored in a variable named Default{TypeName}.
OneOf: Default value is not supported in the main Object, but each referenced type can have their default.

Examples
For a full example please go to: Default
Pet:
  type: object
  properties:
    type:
      $ref: '#/components/schemas/PetType'
    name:
      type: string
    age:
      type: integer
      default: 1
  default:
    type: dog
    name: Fido
    age: 2

// NewPet instantiates a new Pet with default values overriding them as follows:
// 1. Default values specified in the Pet schema
// 2. Default values specified per Pet property
func NewPet() *Pet {
	m := &Pet{
		Age:  1,
		Type: DefaultPetType,
	}

	type alias Pet
	err := json.Unmarshal([]byte(`{"age":2,"name":"Fido","type":"dog"}`), (*alias)(m))
	if err != nil {
		panic(fmt.Errorf("could not unmarshal default values for Pet: %w", err))
	}

	return m
}

[!IMPORTANT]
A side effect of this PR is moving inline structs to named types. This was required to properly support validation and default handling without needing to have a special case for them.

Ticket
#136
How Has This Been Verified?
Unit tests
Checklist:

[x] The change works as expected.
[ ] New code can be debugged via logs.
[x] I have added tests to cover my changes.
[x] I have locally run the tests and all new and existing tests passed.
[x] Requires updates to the documentation.
[ ] I have made the required changes to the documents.

@LucasRoesler pinging you, just make sure you saw this. Thanks!!

@injeniero I am so sorry, i saw this and then it slipped off my list. There were a few offline events happening and it distracted me. I am going to read through this today


Option validations needed with -g

Use of -g combined with --files-with-matches (-l) makes no logical sense -- with -g the contents of files are not being searched. There are probably other mutually exclusive cases that I've not thought of, I just noticed this one because this nonsense is proliferating in the wild:
let g:ctrlp_user_command = 'ag %s -l --nocolor -g ""'

It's config for a Vim fuzzy finder where Ag is being used as a speedy means of populating a list of files to match on (the plugin interpolates a base directory at %s). I scratched my head for a minute wondering why that command even works.
Ack informatively bails:
$ ack -l -g '' ./
Options '-l' and '-g' are mutually exclusive

Ag goes ahead anyway, seemingly just ignoring the -l, but as a user I can't really be sure, it may as well be undefined behavior:
$ ag -l -g '' ./
app/admin/admin_users.rb
# -- SNIP --

Since it's not invalid to pass an option that implies content search, I wonder what happens if I try to pass a pattern for content matching?
$ ag --column --nogroup -g '' ruby test.rb
ERR: Error stat()ing: ruby
ERR: Error opening directory ruby: No such file or directory
test.rb:1:1:#!/usr/bin/env ruby
test.rb:2:-19:
test.rb:3:-20:puts "I'm a test script."

This is a nonsense incantation since I'm trying to pass a pattern where a path is being expected, but the failure mode is poor. And look! It almost leads me to believe I can get the file name output when searching a single file that I requested in #361 :smile:
By the way, it would be awesome if filetype support worked when using -g -- this does the right thing in ack:
$ ack --ruby -l -g '' ./

With Ag the --ruby file scoping is seemingly ignored. This probably warrants a separate feature req for tracking, let me know if you'd entertain it if I filed one.
My C-fu is weak, but I'll try to pitch in some option validation if time allows. Just wanted to log this stuff when I encountered it.

Changes in #491 may have some relevance to considerations here. Given the use case in #377 of using a bare ag -l to list files, I'm not sure how that would be meaningfully different than ag -g '' (or ag -g '.*'), yet I get different resulting lists of files from these two commands.
It seems like ag -l is applying some filtering smarts—it's omitting some things like object files when there's no .gitignore doing that already—while ag -g '' presumably is taking an entire set of candidate files without any pre-filtering, and then applying the (empty) pattern to filter them.
That might make perfect sense, but it isn't very obvious (to me).


Explorer menu scrolls with page content

On a page with lots of children, if you open the explorer menu and then scroll, the menu will scroll with the page content, allowing it to be dislocated from its point of origin.

Fixed in #2525

Reopening as per #2678 - we need a fix that doesn't prevent the menu from scrolling if it exceeds the window height.

Closing this. Since the merge of the React Explorer (#3012) this will no longer be an issue.


Debian update

Updated debian version 0.10.2

cc @yarikoptic

So everything looks wrong ;-) I will check in detail when finally wake up

doh -- I did build 0.11 release a while back (Jan 5) but it seems forgot (seems litterally just that) to upload it to debian proper, did upload to neurodebian only http://neuro.debian.net/pkgs/python-mne.html
http://git.debian.org/?p=debian-med/python-mne.git  carries that state of packaging .  I will rebuild it now for sid to see if it fails with fresh numpy and will report back shortly

0.11 package built just fine so I have uploaded it to Debian -- I guess all those incompatibilities were solved before 0.11 ;)  thanks and sorry about the glitch

thx heaps @yarikoptic
I am closing then.


[Refactor] Add limit for load_tracking_logs avoid scan all rows of table

What type of PR is this：

[ ] BugFix
[ ] Feature
[ ] Enhancement
[x] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Which issues of this PR fixes ：

Fixes #
Problem Summary(Required) ：

Checklist:

[x] I have added test cases for my bug fix or my new feature
[x] This pr will affect users' behaviors
[ ] This pr needs user documentation (for new or modified features or behaviors)

[ ] I have added documentation for my new feature or new function

Bugfix cherry-pick branch check:

[x] I have checked the version labels which the pr will be auto backported to target branch

[x] 3.0
[ ] 2.5
[ ] 2.4
[ ] 2.3

[FE PR Coverage Check]
:disappointed: fail : 2 / 6 (33.33%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/sql/plan/PlanFragmentBuilder.java
1
3
33.33%
[1184, 1185]

:large_blue_circle:
com/starrocks/planner/SchemaScanNode.java
1
3
33.33%
[125, 129]

@mergify backport branch-3.0


improve the UI of  connect with iskcon events when we will click on connect button

@akshitagupta15june  ,I want to work on this issue please assign this issue to me

@shreya26-bit This issue has already bee assigned refer #76
Please explore other issues to contribute to.
Feel free to open other issues, we will review them and assign them to you


allow putting announcements on MaMpf home page

What kind of change does this PR introduce? (Bug fix, feature, docs update, ...)

Feature

Please check if the PR fulfills these requirements

[ ] E2E Tests for the changes have been added  via Cypress
[ ] Meaningful rspec tests have been added
[ ] Docs have been added / updated

What is the current behavior? (You can also link to an open issue here)

As admin, you can create general announcements, bu there is no way to put them on the MaMpf homepage (which would be useful e.g. to announce server downtimes)

What is the new behavior (if this is a feature change)?

As admin you can set announcements on the homepage (this is done under /announcements) and remove them from the homepage.

Does this PR introduce a breaking change? (What changes might users need to make in their application due to this PR?)

Other information:
Run db:migrate (the announcement table has a new boolean column :on_main_page).

I added the announcement to the start page as well.


Support AddKey with multiple method names

https://github.com/near/near-api-js/blob/960b798fe009fe0658637803af9645f550f139cb/src/account.ts#L290
Functionality already added.


Harmony: select updates

Added new versions + updated arrow which stays across the content:

Fix arrow position
Add filled view
Add classes for each view (error, filled)

https://www.figma.com/file/3xsUrRBsEJTBrJ27gMhSGZ/Taskany-(Goals)-New?type=design&node-id=2923-55748&mode=design&t=bSkmaS6LpUO5NGd8-4

Closed with #895 (https://github.com/taskany-inc/bricks/pull/895)


[Program]: Write a Ruby program to find the trace of a matrix

Description
Write a Ruby program to find the trace of a matrix
The trace of a square matrix is the sum of the elements on the main diagonal (from the upper left to the lower right).
Input  :
1 2 3
4 5 6
7 8 9

Output :
15

How to contribute

Save the solution in program/program/find-the-trace-of-a-matrix/program/FindTheTraceOfAMatrix.rb file

!assign


http3: use the http.Server.ErrorLog if set

In a previous version, v0.28 if I'm not mistaken, there was a possibility to set http3.Server.Server.ErrorLog = log.New (...).  However now as the http3.Server.Server fields have been merged into http3.Server, the ErrorLog is missing.
There seems to be a private logger util.Logger field that can't be overriden, so perhaps making that public?

I don't we ever exposed a way to set the logger in previous versions.

I don't we ever exposed a way to set the logger in previous versions.

It might be, I don't remember how it used to behave.
However, having a way to customize the logging, would be nice though.  And by "customizing the logging" I mainly mean having at least a way to get the string that would otherwise go to the default Go logger, and allow the developer do something else with it (like for example prefix it with something, transform it, ignore it, etc.)
Perhaps even something as simple as exposing http3.Server.SetLogger (*log.Logger) and making sure that reaches the actual logging call:
https://github.com/lucas-clemente/quic-go/blob/62b82789c0cc8a9acf48ee516ce2dd303253f395/internal/utils/log.go#L93

Doesn't sound unreasonable. Want to submit a PR?

This could simply make use of the http.Server.ErrorLog, if set. No additional quic-go API needed.

#4449 will close this issue. I still see the appeal of reusing the logger on the http.Server, but we'd still need a solution for the non-error log messages. Maybe the standard library will add an slog.Logger to the http.Server at some point? Then we could reuse that one.


Create dataset loader for Indonesian general domain MT En-Id

#self-assign

Submit a PR at https://github.com/IndoNLP/nusa-crowd/pull/100


cargo test failed behind proxy.

failures:
    services::http::backend::tests::test_read
    services::http::backend::tests::test_stat
    services::s3::backend::tests::test_detect_region

I saw opendal support proxy in env.
but when I run test cargo test behind proxy.
these three test seems failed.
error message:

proxy

I had run two different proxy both are failed for these three tests.
if I add:
builder = builder.no_proxy();

and comments the proxy lines in sync method.
the tests are all good.

Seems your proxy can't recognize the tls certs that s3 use. Can you try the following command for debugging?
https_proxy="<IP_ADDRESS>:8080" curl https://s3.amazonaws.com/test

Expect to see s3 error likes:
<Error>PermanentRedirect<Message>The bucket you are attempting to access must be addressed using the specified endpoint. Please send all future requests to this endpoint.</Message><Endpoint>test.s3.amazonaws.com</Endpoint><Bucket>test</Bucket><RequestId>3K42YQPVWTYXJ58H</RequestId><HostId>TesUmf6oyPfRRy06UvAjY/Kf+Iozb5LsVASKF7PWqOkqpx8Dyp8bT8rUnXwztEvLQhQdTrQEwy8=</HostId></Error>

cool
@Xuanwo this is reasonable I got these errors:
curl: (60) SSL certificate problem: self signed certificate in certificate chain
More details here: https://curl.se/docs/sslcerts.html

curl failed to verify the legitimacy of the server and therefore could not
establish a secure connection to it. To learn more about this situation and
how to fix it, please visit the web page mentioned above.

what about the first two failures?
do we need to ignore the localhost for proxy?

do we need to ignore the localhost for proxy?

Yep, you can set NO_PROXY=localhost to ignore them.
Also, please try use https_proxy=http://<IP_ADDRESS>:808, I'm sure will this affect the proxy behavior.

copy that thanks.
closing this issue now.


Review Preview 3 docs and add links between Preview 2 and Preview 3 docs

Need to review the Preview 3 docs and make sure that the topics can be easily differentiated (including metadata) with links between the two versions.

We also need to make sure they work with Preview 4 and name them that way


Bug-fix: Naive ensembling does not work with unsupervised graphsage

Prob def:
Naive ensembling using unsupervised GraphSage does not work, as the OnDemandLinkGenerator was not included as an acceptable training generator type.
Fix:
Added OnDemandLinkGenerator to train generator type onto ensemble.py class.
Tests:

All tests passed: Run py.test tests/
Naive ensembling on unsupervised graphsage, during training and inference found to be working on local environment after fix

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.Kiarie Ndegwa seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


Add IBM VPC Template to the NETWORK section of Draw.io

Can we please add the following file which is the IBM Virtual Private Cloud template to the Network section.  Thank you .
ibm_vpc_architecture.xml.zip

Will be in next release.


Added Mac and Mc last names to the training file

PR for Issue #22

Thanks for this!
We have a pretty simple tokenizer that just splits on spaces. So, we need these to be labeled like
<Name><GivenName>Matt</GivenName> <Surname>Mc</Surname> <Surname>Gee</Surname></Name>

not
<Name><GivenName>Matt</GivenName> <Surname>Mc Gee</Surname></Name>

you can follow the steps here instead of typing out labeled training data manually: https://github.com/datamade/probablepeople#creatingadding-labeled-training-data-xml-outfile-from-unlabeled-raw-data-csv-infile

Thanks for the feedback. I'll make the changes and test locally, then issue a new pull request.

@cathydeng I'm looking at the instructions the create the labeled training data that you provided. It appears to want to take in a CSV file. Are there an examples of what this CSV data needs to look like? The CSV files in the name_data/unlabeled folder of the project don;t appear to have headers so it is not clear how this data would be used to generate the labeled.xml file.

hey @Richard-West - the csv doesn't need any headers - it can look like
"Mr. Brian Mac Kenzie"
"Mr. Mac Isaac"
"Ms. Alice Mac Leod"
"Mr. Mac P Shain"

Thanks @cathydeng . I'm going to close this pull request, and issue another one later today.
This is an example where test driven development, or in this case test driven training, really shines.
It turns out that only two of my example names are not being handled by the current training file.
Therefore to keep things tidy in your repository I think it will be best to close this PR and issue a new one after I revert back to your current repository version.


Question about Validation

Hi, I have trained the model with your configs.
There are some problems about the testing:

'minival=True' in the config makes it run 'sample_roidb' in tools/test.py, but the definition of 'sample_roidb' is commented, so error occurs.
I set 'minival=False' and run the script to generate the prediction .pkl file. When I use the waymo official tool 'compute_detection_metrics_main' to calculate the metrics, error occurs: "Failed to parse predictions."

Could you elaborate how to get the metrics with the .pkl file?

Sorry, we created a small validation set in order to speed up testing on the validation set which is the meaning of the 'minival' flag, but we did not provide the code to create minival set. In the normal case, you should set 'minival=False' and it will be tested on the entire validation set.
On your second question, the .pkl file should not be passed directly to the 'compute_detection_metrics_main'. You can refer to the explanation in the README on how to convert .pkl files to .bin files with the help of the file 'tools/create_prediction_bin_3d.py'.

Got it. Thanks


Add synonyms for ADO-style connection strings

For https://github.com/denisenkom/go-mssqldb/issues/645
I've added mappings for some of the most commonly aliased items - server, user id, and database. I've also added application name as a synonym for the app name this driver currently supports. There may be other worthwhile synonyms. See https://docs.microsoft.com/en-us/openspecs/sql_server_protocols/ms-sccstr/775b2bab-a604-4897-87e6-c36ee23dd3f1 for the full list.
I've also reformatted the readme a bit to satisfy the MD linter in vs code.
Queston about github etiquette - should I open this PR against denisenkom/go-mssqldb directly instead? I've not been active in OSS before.
I am going to queue up a few changes in this fork first and open a PR to push them all over at once, but I can follow other preferred patterns as requested.

RE: committing back - the way I usually do it is to set upstream to the original repo and make sure I make feature branches off a sync of the main off the upstream project. Probably squash and clean up your commits into a PR that is concise and doesn't include our internal conversations.
I don't recommend queuing up a lot of changes and just making one big PR. Lots of smaller PR's will be better at least until you really have something worth a big drop. We want the maintainer to build up trust with the PR's we send.
If you reformat whitespace just make a note why you did it so he doesn't decide to focus on petty issues like formatting.


docker container mentioned in the docs is not available

In the README.md there is a Docker section. It seems the container is not available on the Docker HUB anymore.
https://github.com/ethereumjs/testrpc#docker
Jakubs-MacBook:wt-env kvbik$ docker run -d -p 8545:8545 ethereumjs/testrpc:latest
Pulling repository docker.io/ethereumjs/testrpc
docker: Error: image ethereumjs/testrpc:latest not found.

To build the Docker container from source:
git clone https://github.com/ethereumjs/testrpc.git && cd testrpc
docker build -t ethereumjs/testrpc .
after that you can use your docker run ... command

Error: Cannot find module '/src/bin/testrpc' after building the container from source like the README suggests.

Something seems broken then.
I would suggest using a Image directly from Dockerhub. I tested https://hub.docker.com/r/harshjv/testrpc/ and it works.

Don't get me wrong @MHPppflueger I am happy this project provides Dockerfile for building a container for it. But the point of this issue is, that the official documentation is mentioning an already provided docker container available on Docker HUB. Which, if I am not mistaken (could be an output of this issue too) is not available any more (or never was, i don't know).

I am using testrpc docker images provided by other people.

I got your point. This should be fixed ofc ;)
I just wanted to provide you a workaround to save you some time waiting for a fix.

I created a PR for this. Not sure why the tests are failing though. Seems unrelated to the fix. https://github.com/ethereumjs/testrpc/pull/343

Duplicate of #228

@mikeshultz how is this a duplicate of #228?

@a-stankevich Looks like I fat-fingered it.

really? at least remove the mention from the README!

https://hub.docker.com/r/trufflesuite/ganache-cli
Docker container mentioned in docs is now available. ;-)

i don't see the hub.docker link in the docs btw..


ATAC-seq recognized as RNA-seq?

Hi staffs of scarf, I downloaded Cusanovich's 81K sc-ATAC-seq dataset using your fetch_dataset(),
but when I was importing the dataset, this happened:
reader = scarf.CrDirReader(temp_path + '/cusanovich_81K_mouse_atacseq',mtx_separator='/t')
reader.assayFeats

RNA
type	Gene Expression
start	0
end	167013
nFeatures	167013

somehow it was auto-recognized as a RNA-seq assay, since file_type is deprecated I cannot either change the assay type or go on my downstream analysis.
Any possible solutions?

Hi,
This issue is due to fact that the files in this dataset are deposited in a way that is similar to RNA-Seq data.
For ATAC-Seq, Scarf expects a 'peaks.tsv.gz' rather than 'features.tsv.gz'. We will fix this issue in the data repository.
For now, the quick solution for you is to do the following:
 # Please note that the separator is a space and not a tab
reader = scarf.CrDirReader('cusanovich_81K_mouse_atacseq', mtx_separator=' ')

# This is how we can rename the assay
reader.rename_assays({'RNA': 'ATAC'})

# The data in this file is prenormalized and is present as float values, hence adjust dtype
writer = scarf.CrToZarr(reader, 'cusanovich_81K.zarr', chunk_size=(1000, 10000), dtype=float)

writer.dump()  # This will take upto 5 mins

# Load the data as a datastore object
ds = scarf.DataStore('cusanovich_81K.zarr', nthreads=4)
ds

# Turn off the default TF-IDF normalization because the data is already normalized (you will need to do this every time the data is loaded)
ds.ATAC.normMethod = scarf.assay.norm_dummy

# Thereafter, you can run a basic pipeline with default parameters like this:
ds.mark_prevalent_peaks()
ds.make_graph(feat_key="prevalent_peaks")
ds.run_umap()
ds.run_leiden_clustering()
ds.plot_layout(layout_key="ATAC_UMAP", color_by="ATAC_leiden_cluster")

Please let me know if this helps

Closing this for now. Please feel free to reopen this.


Create a Poker Server with Chat Server Functionality

Create a Server interface that relays information between the chat and the poker game servers without needing two separate classes.
Estimate: ~300

m16 okay

m16 okay

Since the multiplayer server was eliminated in M16 in favor of cleaner codebase, it falls to you to reimplement the multiplayer server while continuing to follow the factory design pattern established in M16. This server should allow two (or more, for more credit) players to play against one another and should incorporate chat functionality instead of requiring a separate chat server. For this reason, it could be implemented on top of the existing chat server if this is found to be practical.

F16 OK (300 pts)

F17 OK (300 pts)

This issue has been changed and partially completed a couple times over the past couple years which is just making this issue confusing. I'm closing this issue and opening new issues that more clearly state these goals.


Release notes for 2.4

Description
Describe what this change achieves.
Issues Resolved
List any issues this PR will resolve, e.g. Closes [...].
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@d0794cd). Click here to learn what that means.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #197   +/-   ##
=======================================
  Coverage        ?   83.12%
  Complexity      ?      553
=======================================
  Files           ?       61
  Lines           ?     2050
  Branches        ?      146
=======================================
  Hits            ?     1704
  Misses          ?      238
  Partials        ?      108

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Mention failing gem in error message

In https://github.com/guard/listen/issues/409 I noted that ruby_dep causes a bundle install to fail with
Gem::InstallError: ruby_dep requires Ruby version >= 2.2.5, ~> 2.2.

It would have been extremely helpful for me if this error message had mentioned which gem was being installed and had this dependency. As it is, I spent quite some time figuring out that listen was the gem that was failing.
Would it be possible to include the gem that has the dependency, and raises the error, in this message?

I'm not sure how to do that without monkey-patching rubygems.
The best way is to do something like: gem dependency|grep -B 5 "  ruby_dep".

I'm closing this, because this version checking is happening before RubyDep even initializes - so I can't think of anything I can really do.
If RubyDep actually did require Ruby 2.2.5 to work properly (for whatever reason), then it would be up to Bundler to add information about which gem requires this one.
As a user, you want to know that if a required gem cannot be installed because of a Ruby version, you may want a different version of the gem requiring it (e.g. listen).
So this is more of a rubygems/bundler feature to be more user friendly. I'm sure other gems would benefit once more people start using Ruby 2.3-only or Ruby 2.4-only features.

Ah, I thought ruby_dep raised an error during its installation causing bundler to fail, but I now understand it's bundler itself that checks the version dependency and fails. OK, I'll take it up with them then.

The best way is to do something like: gem dependency|grep -B 5 " ruby_dep".

There's a chicken/egg problem there: if bundler fails, the gem isn't installed, so you can't grep its dependencies either.


Update Test-SPO365LinkSettings.md

Fill in missing details.
This needs to be moved to SharePoint Server cmdlets as it isn't applicable to SPO.

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

sharepoint/sharepoint-ps/sharepoint-online/Test-SPO365LinkSettings.md
:white_check_mark:Succeeded
View (sharepoint-ps)

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

sharepoint/sharepoint-ps/sharepoint-online/Test-SPO365LinkSettings.md
:white_check_mark:Succeeded
View (sharepoint-ps)

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

@tseward - moved this to sharepoint-server. Conflict button says conflict is too great to be resolved manually.


Implement variable length integers for Serializer and Deserializer.

#328 Unsigned Integers(ushort, uint, ulong) to Serialized variable length integer
&  Deserialize variable length integer
We need to flexibly reduce the data in most small unsigned integer data.
This can significantly reduce the storage capacity of the ledger.
VarInt Size
size <= 253(0xFC)  -- 1 byte   ubyte
size <= USHORT_MAX -- 3 bytes  (0xFD + ushort)
size <= UINT_MAX   -- 5 bytes  (0xFE + uint)
size <= ULONG_MAX  -- 9 bytes  (0xFF + ulong)

The Little Endian environment was not considered according to the overall configuration.

The two commits should be squashed together. When new functionality is added, the tests should be in the same commit.

The two commits should be squashed together. When new functionality is added, the tests should be in the same commit.

I did squash.

Good work!

Ready for review.

@Geod24 @AndrejMitrovic ping.

@Geod24 you're up.

It’s green.

LGTM. I'll let @Geod24 merge it.


Calculator not using the vars in USB Drive

Hello, when I run apps that uses AppVars, the app can't seem to find them in my USB drive? Is there a way to sort of trick the app into thinking it is inside the calculator main drive so I can run programs on the USB drive completely?

No there is not. I have considered creating a file that tells Cesium what files in a directory to load as well, sort of like a package, but no one has really put too much thought into how it should work so for now nothing exists.

No there is not. I have considered creating a file that tells Cesium what files in a directory to load as well, sort of like a package, but no one has really put too much thought into how it should work so for now nothing exists.

Alright thanks 👍


Add runner return code in stdout mode

Fixes https://github.com/ansible/ansible-navigator/issues/401

Add support to accept return code from runner API's
Modify config, doc, inventory, collection and images
action to get return code from runner API's
Update ansible-runner version to 2.0.0b1 which has
the corresponding runner changes

recheck


cloud-init fails to fetch metadata when shared networks are present

ISSUE TYPE

Bug Report

COMPONENT NAME

VR
metadata
cloud-init

CLOUDSTACK VERSION

4.11.2
likely others affected as well

CONFIGURATION

Advanced networking, with isolated and shared networks.
OS / ENVIRONMENT

CentOS 7, but likely other VM operating systems affected as well.
SUMMARY

As reported here: https://bugs.launchpad.net/cloud-init/+bug/1839854
cloud-init is longer able to fetch metadata on VMs that have both isolated and shared networks attached. In older cloud-init versions (0.7.5), acquiring metadata would still succeed if network manager was used, because cloud-init would then ignore the DHCP lease files and use the default gateway.
The logic in cloud-init is to use the latest created DHCP lease file for obtaining the metadata server IP, but if that is
STEPS TO REPRODUCE

Deploy a VM that has cloud-init newer than 0.7.5 and attach an isolated and a shared network to the VM
Configure cloud-init to use CloudStack metadata
Depending on the OS, ensure that the shared network obtains a DHCP lease last
Apply metadata to the VM

EXPECTED RESULTS

cloud-init obtains and applies metadata on boot

ACTUAL RESULTS

The VM takes much longer to boot than normal,
fails to obtain metadata because it isn't offered by the shared network router
and doesn't apply metadata to the host

@onitake have you removed the old lease files in "/var/lib/dhclient", "/var/lib/dhcp" and "/var/lib/NetworkManager" when you created the template ?

@ustcweizhou I don't think this has any influence on the issue here.
cloud-init lists all lease files and consult only the newest one for determining the metadata server.
If the DHCP client obtains a lease from the shared network last, cloud-init will use that. And since the shared network VR doesn't start the metadata server, cloud-init will not be able to obtain metadata and fail.

@onitake what network offering is used to create the shared network ?
if you use a network offering which support UserData (for example DefaultSharedNetworkOffering /Offering for Shared networks), apache2 service should be running in virtual router as metadata server.

That's a good point. The shared network offering we're using in this case does not have the UserData flag enabled. However, we have a reason for not doing this, and metadata fetching has worked for us fine until cloud-init was updated to consult NetworkManager leases.
As mentioned in the upstream bug report, we would rather have the previous behaviour back, in that cloud-init always uses the default gateway as the metadata IP instead of consulting the last created DHCP lease file.

@onitake
I think the commit to fix https://bugs.launchpad.net/cloud-init/+bug/1717147 is the root cause of your issue.
https://github.com/cloud-init/cloud-init/commit/da1db792b2721d94ef85df8c136e78012c49c6e5
However, the bug fix makes more sense in my view.
I have no idea why cloud-init gets metadata from the latest dhcp server. It would be better to get metadata from each dhcp server and stop the process once metadata is fetched (vm metadata are saved on virtual routers of all vm nics if vr supports UserData).
Similar process should be applied on password and sshkey as well.

The bug fix is fine, I think. If the user wishes to rely on DHCP leases, that's all right.
What you describe is one possible solution, and I think cloud-init should behave like this in general.
However, I also think that forcing the use of the default gateway would work best in our environment, because the default gateway will always run the metadata server.

@onitake for isolated network with single virtual router, yes, the gateway is the metadata server.
for shared network, the ip of virtual router is not gateway.
for isolated network with redundant virtual router, the metadata server is running on guest ip of vr, not gateway ip. see #3409

There are many different ways in which networks can be configured, and I agree that my point of view might not cover all use cases.
But there's also another reason why I'd prefer cloud-init doesn't try to fetch metadata from a shared network: Since such a network is by definition not isolated, there's a higher risk that a malicious party might run a rogue DHCP server and a fake metadata server on the shared network and basically take over instances at startup. With isolated networks, this risk is much lower. This may not be a big risk in all cases, but limiting exposure should always be focused on.

I think we found the "right" way to do this: If the metadata server is enabled on an interface, it will offer the special hostname data-server on its DNS server. This is already the case, and I really don't understand why cloud-init isn't already using that.
This should always be the first host that cloud-init checks.
As a second step, the "only latest lease" heuristic should go be replaced with "try all leases in reverse chronological order".
Ideally, all virtual routers should allow resolving the data-server hostname, returning the IP address of a router that has the metadata server enabled. If none of them do, the hostname shouldn't exist.

@joschi36 has pushed a proposed fix: https://code.launchpad.net/~joschi36/cloud-init/+git/cloud-init/+merge/371807
With this fix, cloud-init will first consult the host data-server before falling back on the previous behaviour.
While this doesn't address the case where multiple default gateways are available with only some running the metadata server, it should at least be much more reliable than just looking at the latest DHCP lease.
@ustcweizhou @rhtyd @DaanHoogland @PaulAngus Please let me know what you think. I'll gladly push an update to http://docs.cloudstack.apache.org/en/latest/adminguide/virtual_machines/user-data.html if you think this is the right way to go.

bump @ustcweizhou @rhtyd @DaanHoogland @PaulAngus
Do you think this is the right way to go. If yes we could merge the "Merge Request" in cloud-init launchpad.
Issue: https://bugs.launchpad.net/cloud-init/+bug/1839854
MR: https://code.launchpad.net/~joschi36/cloud-init/+git/cloud-init/+merge/371807

@joschi36  I've added a comment on launchpad.

Do we still considder this a cloudstack issue? @joschi36 I see your cloudinit patch was merged. Can we close this?

It's not a CloudStack issue any more, but there is still a PR open to make the documentation clearer: https://github.com/apache/cloudstack-documentation/pull/132
I think it should be revisited and merged before we close this issue.

I think it needs a bit of your tlc @onitake ;)

@onitake I think this doc part will need to be addressed as we release 4.15

@onitake I think this doc part will need to be addressed as we release 4.15

Doc PR was merged, closing this based on https://github.com/apache/cloudstack-documentation/pull/132
Please reopen @onitake if necessary, thanks.


Add option to no-unsafe-type-assertion rule to ban as entirely...

...except for as const and as unknown.

Don't need this. https://github.com/typescript-eslint/typescript-eslint/blob/master/packages/eslint-plugin/docs/rules/consistent-type-assertions.md (with assertionStyle=never) already does it.


Issue 121 display user s first & last names in event listings

Change Summary

Added 2 new types for data being sent to the client

EventResponse
RepairRequestResponse

Updated API routes to fetch users from clerk before sending response
Updated events/id/XXX & events to display user first & last name, with email as fallback
Added loading spinners to events/id/XXX
Updated tests with Clerk mocks as the API now responds with Clerk data
Updated events/id/volunteers & events/id/images to use react-query like events/id/repair requests

Fixed error with react query trying to use empty ids before useQuery was ready

Change Form

[x] The pull request title has an issue number
[x] The change works by "Smoke testing" or quick testing
[x] The change has tests
[ ] The change has documentation

Other Information
This will conflict with PR -  Issue 105 - Date time formatting on add and update events as they define different types for the same thing. I'll fix whichever branch gets merged second :)
Seeded names will come back as "Unknown" as they do not link with a clerk user

Sorry, I should have mentioned this sooner. But repairers do not need to be returned the /api/events endpoint. There is a separate issue to return the repairers for an event in /api/event/[id]/repairers

Sorry, I should have mentioned this sooner. But, repairers do not need to be returned in /api/events endpoint. There is a separate issue/ticket to return the repairers for an event in /api/event/[id]/repairers

my bad, serves me right for not being able to attend the past few workshops lmao. all the event repairer returns should be all gone now 👍


Filter is not working with Datetime in column validation

--filters "update_timestamp >= '2024-04-01 16:00:00 UTC'"
when specified with column validation option it does not work and throws,
 ValueError("Unable to parse filter arguments.") line 1090, in get_filters
Its splitting the timestamp into multiple values due to colon, --filter is trying to split the timestamp assuming there are source and target filters (as per the documentation --filter can be used with source_filter : target_filter )
it seems issue is with this line :
its not allowing to escape/handle the colons.

Can you try the following: --filters 'update_timestamp >= "2024-04-01 16:00:00 UTC" '

Using : --filters 'update_timestamp >= "2024-04-01 16:00:00 UTC"'
it produces same error


In Dial Resource Usage-  GPS Of Learning tab

Select total content plays from dropdown and legend card and values on card not aligned properly value text over lapped

Legend value for all the colours are same

working as expected


Return rc 253 when terminated by signal

Closes #3325

Was this added to the user guide and never merged?


How to change drawer position bottom to top #12133

Hi oliviertassinari
pls chk this link for last conversation which you are closed.
https://github.com/mui-org/material-ui/issues/12133#event-1732394185
Check this demo out: https://material-ui.com/demos/drawers/#temporary-drawer. This Demo Compatible with react 16 and we are using react 15 so this drawer not working with our version.
Can you please provide some suggestion on this version https://v0.material-ui.com/#/components/drawer. how we can change the position bottom and top.
Thankyou

Closing as a duplicate of #12133.


[ci] Optionally allow to use mamba instead of conda in CI jobs

Motivation
In #6034, the Python package bdist build on macOS times out after an hour as the environment for testing cannot be solved in time. This is the result from using conda with its slow solver. Replacing conda with mamba causes the same CI job to complete successfully in under 20 minutes.
This PR allows to optionally use mamba rather than conda to allow certain CI jobs to take advantage of mamba's faster solver. The optional usage alleviates the need to build new docker images for the CI for the time being.

@jameslamb yep, realized that already. The second paragraph of my description describes what I now wanted to do instead, will implement in the next couple minutes.

@jameslamb I also tried to build Docker containers in https://github.com/guolinke/lightgbm-ci-docker. However, I completely fail to do so on an AWS-hosted Linux machine and it also seems to be flaky in the GitHub CI. How do you build these images locally?

I completely fail to do so on an AWS-hosted Linux machine and it also seems to be flaky in the GitHub CI.

Please be specific about the issues you're encountering (logs? error messages?) and I will try to help.

Issues in the CI are visible here: https://github.com/borchero/lightgbm-ci-docker/actions/runs/6502543755. Issues on AWS were similar. I got a little farther with some adjustments but failed to install PoCL due to an unknown target for the ubuntu-14.04 container :eyes: unfortunately, I don't have any logs available right now.
In any case, would it be able to merge this PR regardless? It would at least fix some issue

would it be able to merge this PR regardless?

No, it is still not passing. The latest Linux sdist build on Azure DevOps hit its 1-hour timeout while trying to solve for the test environment in this PR: https://dev.azure.com/lightgbm-ci/lightgbm-ci/_build/results?buildId=15329&view=logs&j=02a2c3ba-81f8-54e3-0767-5d5adbb0daa9&t=720ee3fa-96d4-5b47-dbf4-01607b74ade2
In addition, I'm concerned...where is mamba coming from? It isn't listed at https://github.com/actions/runner-images/blob/main/images/macos/macos-13-Readme.md and you haven't added any code to the CI setup scripts to add it.
We try in this project to not rely on the things that come pre-installed in the VM images from CI providers, as those can change without our knowledge and in some cases can go without updates for an unacceptably long time.
I'd expected to see a PR that adds the use of mamba also adding some setup of mamba, similar to this:
https://github.com/microsoft/LightGBM/blob/8ed371cee49cf86740b25dd9a4b985a75c9f2dba/.ci/setup.sh#L127-L133
https://github.com/microsoft/LightGBM/blob/8ed371cee49cf86740b25dd9a4b985a75c9f2dba/.ci/setup.sh#L137-L139
Can you please add something like that and update env variables PATH, CONDA, etc. to ensure that the expected copy of mamba is being used?

Also, since you're pursuing this in support of #6034... could you consider other approaches to try to get that environment with cffi and pyarrow to solve faster? For example, putting floors on the cffi and pyarrow dependencies (and maybe others like pandas) might cut out some combinations the solver has to search through.

Please note that I'll have very limited availability for the next week, so I personally won't be able to provide thorough reviews for this or #6034 for the next 8 days or so.

The latest Linux sdist build on Azure DevOps hit its 1-hour timeout while trying to solve for the test environment in this PR

I think that this is a general issue of the current CI setup :eyes: I wouldn't know how this is connected to changes in this PR and I would expect it to fail (non-deterministically) in other PRs as well 😬

where is mamba coming from?

Since July 2023, Miniforge includes mamba (cf. https://github.com/conda-forge/miniforge#whats-the-difference-between-mambaforge-and-miniforge) and Mambaforge (= Miniforge as of July 2023) is the recommended way to install mamba (cf. https://mamba.readthedocs.io/en/latest/mamba-installation.html#fresh-install-recommended).

For example, putting floors on the cffi and pyarrow dependencies (and maybe others like pandas) might cut out some combinations the solver has to search through.

I can give this a try but it feels like a band-aid solution that is likely to break easily in the future.

Since July 2023, Miniforge includes mamba (cf. https://github.com/conda-forge/miniforge#whats-the-difference-between-mambaforge-and-miniforge) and Mambaforge (= Miniforge as of July 2023) is the recommended way to install mamba

Oh very cool, did not know that! Thanks very much for the links.
Given that, I definitely support this PR. I think it's ok to mix conda and mamba across different CI jobs for now.

but it feels like a band-aid solution that is likely to break easily in the future

I definitely agree that having to provide hints like this shouldn't be necessary in the presence of well-formed package metadata for all of the things we install from conda-forge + a lack of bugs in the mamba solver. But the reality is that that's a fairly large surface area, and sometimes things do break in surprising ways solving such large conda environments. Putting floors on the dependencies we install would give us faster feedback that the root of some issue (like ) is actually "got downgraded to a surprisingly-old version of a dependency".
So my proposal is this:

let's merge this PR (assuming my manually triggering that failing job leads to it succeeding)
Please add floors on cffi and pyarrow in the testing scripts over in #6034
I'll add floors on other dependencies in test scripts in a separate PR
at some point, I or maybe @jmoralez will look into using mamba more widely in the project

assuming my manually triggering that failing job leads to it succeeding

That hasn't been too successful, unfortunately :/

Since July 2023, Miniforge includes mamba

Given that, do you think we can just rebuild the images in https://github.com/guolinke/lightgbm-ci-docker without making any changes to the Dockerfile? That would give us mamba in the CI running on Azure wouldn't it?

can we just rebuild the images

good idea! It's been a while since that was done, I just put up https://github.com/guolinke/lightgbm-ci-docker/pull/30 to make some changes that'll hopefully make that a bit easier to do.

Nice! Let me know once new images are used in the Azure CI :smile:

The new images built successfully!

build link: https://github.com/guolinke/lightgbm-ci-docker/actions/runs/6608306362
tags: https://hub.docker.com/repository/docker/lightgbm/vsts-agent/tags?page=1&ordering=last_updated

(the failed ubuntu-14.04 job isn't relevant... we don't use that image any more. I'll remove that task + Dockerfile entirely)
So I just pushed https://github.com/microsoft/LightGBM/pull/6140/commits/7e2114b34e80c5ff0a29852e0946e7f407fea37a, switching this PR back to using mamba unconditionally for all the Linux and macOS CI jobs.
Hopefully it helps 🤞🏻

Looks to me like that worked! https://dev.azure.com/lightgbm-ci/lightgbm-ci/_build/results?buildId=15335&view=logs&j=02a2c3ba-81f8-54e3-0767-5d5adbb0daa9
As of this branch, LightGBM's CI would now use mamba unconditionally for all macOS and Linux CI jobs.
Hopefully that'll help with with #6034, and with development in the repo in general. The builds all look a few minutes faster than the last build on master (link).
@jmoralez since I pushed commits here, I don't want to approve and merge it. Could you help with a review?

@jameslamb awesome! Glad to see that this helped, hope it gets rid of the CI failures in #6034 🙏🏼

Hey y'all, conda maintainer here, in case you want to use mamba's solver without switching to the mamba CLI, you might also want to switch to the integration into conda called conda-libmamba-solver, that the community worked on a for a while.
It's already installed by default by recent miniconda/miniforge installers and can be enabled by setting CONDA_SOLVER=libmamba or passing --solver=libmamba (more info).
Very soon® we'll even switch the default solver used by conda to using that, see all the details of our rollout in our blog post from earlier this year.

Thanks so much for the links @jezdez !
I was aware that you the conda CLI was in the process of switching its default solver to libmamba.
For us here in this project's testing jobs, what are the benefits of keeping the conda CLI + passing --solver instead of just switching to the mamba CLI?
If the only benefit is "you don't have to update your scripts", then I think I'd still prefer the switch to the mamba CLI here to passing through --solver or setting an environment variable.

I'm going to merge this so @borchero can keep making progress, but it's easily reversible so @jezdez whenever you have time I'd be very interested to hear your answer to https://github.com/microsoft/LightGBM/pull/6140#issuecomment-1777569858.


Initial draft of "This Year In Monero - 2021"

This is my first post here, but I think it should be pretty much good to go!
Please let me know if you have any further suggestions or any changes that need to be made.
Thanks!

Netlify preview looks good to me now that image tags are fixed.
Should be ready for review/merge!

Nice post. Two requests:
* Please run the png images through a png compressor like tinypng.com and then resubmit them. It will save a lot of space. For example `monero-hashrate-2021.png` could be shrinked from 330kB to 94kB, a ~72% saving.

* This article is taken from your blog, please add a disclaimer at the bottom of the post with a link to the original article (https://sethsimmons.me/posts/this-year-in-monero-2021/). It will avoid future confusions.

All changes made and pushed. Will validate that they look alright once the CI runs and provides a preview.
Thanks for the suggestions!

For future reference https://github.com/kornelski/pngquant was a great tool for this, ended up using that for my own blog post as a test and was able to shrink them even further using:
pngquant *.png --strip --skip-if-larger --quality=65-80 --verbose --ext=.png --force
I'll use that in future posts.

For future reference https://github.com/kornelski/pngquant was a great tool for this

Good to know. Thanks for the link :)
Just one more thing and then this will be good to go: could you update the file name with today's date? People using RSS feeds will be confused if they receive a feed for a post that appear to have been published a week ago. Nothing important, but since it's a quick fix, better do it.

Done! Also added a minor note on the miner count numbers that I had added to my own blog in the meantime.


Add 1.19.3 support

Now available for download at: https://www.curseforge.com/minecraft/mc-mods/better-ping-display/files/4286162


fixed the spelling error

added is in the sentence
You're looking into contributing? Awesome! When contributing to this mono-repository, please first discuss the change you wish to make via the discussion board with me before making a change. Before submitting a pull request, please make sure the following is done:

Create a public fork the React Unity WebGL mono-repository and commit your changes to a new branch which is based from the original repository's main branch.
Make sure both the module as well as the documentation installs using npm install, your code lints using ts lint, is formatted using prettier and compiles using npm run build.
Typecheck all of your changes and make sure the documentation in both the source code as well as the official website is up to date and reflects the changes you've made.
Make sure your changes passes and are compatibly with Unity WebGL builds using the testing suite.

Thanks for your contribution!


[share_plus] Subsequent calls to the sharesheet will cause it to be empty even after restarting the application

System info
Issue occurs on: Tested on iOS, unsure about Android
Plugin name: share_plus
Plugin version: 2.0.0
Flutter doctor output:
Doctor summary (to see all details, run flutter doctor -v):
[✓] Flutter (Channel beta, 2.0.1, on macOS 11.3 20E5196f darwin-x64, locale en-CA)
[✗] Android toolchain - develop for Android devices
    ✗ Unable to locate Android SDK.
      Install Android Studio from: https://developer.android.com/studio/index.html
      On first launch it will assist you in installing the Android SDK components.
      (or visit https://flutter.dev/docs/get-started/install/macos#android-setup for detailed instructions).
      If the Android SDK has been installed to a custom location, please use
      `flutter config --android-sdk` to update to that location.

[✓] Xcode - develop for iOS and macOS
[!] Android Studio (not installed)
[✓] VS Code (version 1.54.1)
[✓] Connected device (1 available)

Steps to Reproduce

Use Share.shareFiles([path]) to share a file
The share sheet will show, and can successfully be shared to another app or to the filesystem. Dismissing the sheet will also lead to the error.
On next load of the share sheet, only the header is available, none of the sharing options are there (just a big empty area).

Logs
[User Defaults] Couldn't read values in CFPrefsPlistSource<0x28045ba00> (Domain: com.apple.Sharing, User: kCFPreferencesCurrentUser, ByHost: No, Container: kCFPreferencesNoContainer, Contents Need Refresh: No): accessing preferences outside an application's container requires user-preference-read or file-read-data sandbox access
<CATransformLayer: 0x282aa52e0> - changing property backgroundColor in transform-only layer, will have no effect
[core] SLRemoteComposeViewController: (this may be harmless) viewServiceDidTerminateWithError: Error Domain=_UIViewServiceErrorDomain Code=1 "(null)" UserInfo={Terminated=disconnect method}
[ShareSheet] connection invalidated
[ShareSheet] connection interrupted
[ShareSheet] connection invalidated
[ShareSheet] connection interrupted
[ShareSheet] connection invalidated
[ShareSheet] connection interrupted
[ShareSheet] connection invalidated
[ShareSheet] connection interrupted
[ShareSheet] connection invalidated
[ShareSheet] connection interrupted

These two will get logged together in sequence, rapidly:
[ShareSheet] connection invalidated
[ShareSheet] connection interrupted

It will continue even after a hot reload, a restart. The empty share sheet will even continue if I completely close and restart the application. The only solution is to either reinstall the app or to reboot the device.

Also to note, this occurs on both debug and release builds.

As a a workaround, I have switched to the share package (2.0.1) which supports NNBD. While it does throw the same initial error (Couldn't read value...), it does not cause the share sheet to break on recurring calls.

Could be related to this change here: https://github.com/fluttercommunity/plus_plugins/pull/118
this is the only functionality that is different to the share package.

After upgrading Flutter to v2.0.5, this issue appears to have disappeared! Must have been something in either v2.0.0 or v2.0.1 that was conflicting with this package.


[SPARK] Add SparkVariantBuild Gradle plugin

Summary
This PR introduces the SparkVariantBuild Gradle plugin to the Spark integration.
Problem
Scala 2.12 and Scala 2.13 support is required for Apache Spark. This PR lays some groundwork for it.
Solution

Spark Variants Build Plugin: Enables definition of builds incorporating multiple Apache Spark and Scala versions, facilitating integration tests across various combinations.

Implementation Details

The introduction of the custom plugins addresses specific project needs, providing a tailored solution to our Spark and Scala versioning challenges, as well as our Docker image customization requirements.

Checklist

[x] You've signed-off your work
[x] Your pull request title follows our guidelines
[x] Your change contains a small diff and is self-contained
[x] You've added a header to source files (if relevant)

SPDX-License-Identifier: Apache-2.0
Copyright 2018-2023 contributors to the OpenLineage project

@d-m-h can you rebase?

Nope. I plan on closing this PR. I managed to implement the same in a more flexible manner. This plugin was way too rigid in its approach.


pull request for e2e test at 02/05/2017 12:15:04

:white_check_mark: Validation status: passed
For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Render the websocket served data graphically

Once we have an initial project able to connect to a websocket server and handle the data in a primitive way, we will create a component to render this streamed data through a graphic/chart.

This is fixed by 0f872863e1cf05f2033795aab62f6e493f99d211