Add escape / lifetime analysis to allocate objects in different heaps / arenas based on their lifetime

We should add escape / lifetime analysis so that we can place each variable in one of multiple categories of lifetime scopes which in turn allows us to allocate this where it makes the most sense.
The idea is that based on such lifetimes we could place allocations in a memory arena. I suppose it's possible to implement arenas in different ways but I'm thinking something like:

arenas have a malloc that allocate within the arena
arenas are freed in one go
arena.free() is called at some relatively deterministic time, which puts an upper bound to the lifetime of the entire arena
arenas are variable sized, i.e. if they "run out" of memory the will in turn allocate from a backing allocator, either normal malloc or perhaps from OS via mmap
arenas could be very compact by only allocating small amounts of memory from backing allocator but they can probably become more efficient by allocating in somewhat larger chunks
we do not GC within an arena, all resources are just freed when the arena is freed
arenas are really neat in that this kind of use case is bound to a worker thread, so both allocation and freeing happens locally in a thread, thus no locks

Some lifetimes and how we could allocate objects:

function lifetime: each stack frame / nested function is a lifetime

for this lifetime we have a choice of placing things on the stack, so for the return value from a called function, we can place the result variable on the stack of the parent function
but large values or variable sized values probably shouldn't go on stack
so we can have an arena where a child

continuation lifetime: we can handle lifetimes of all stacked functions like this, trivially, up to the level of actor method continuation

since a actor method continuation runs in one go by a worker thread, until it has completed, this works
for things that have a lifetime longer than a continuation, like an actor variable attribute, we cannot use arenas as per above, since there would be no "deterministic" time to call arena.free(). Only when an actor is dead / unreachable would we be able to free() and that's just too late, we would need to run GC in between since actor lifetimes can be really long

method lifetime: there is one more, slightly more intricate, lifetime, for variables that do not leave a method but where the method has been chopped up in multiple continuations

if we use an arena for this, it would survive longer than a continuation and thus be sort of resting between worker threads executing code
unlike the other arenas, which we could just keep references to from the worker threads worker context or simiar, an arena for the method lifetime would need to be stored somewhere else, related to the Actor / Msg and reachable from readyQ or so
arena can be cleared when last continuation in current method is done

global heap

for things sent between actors
reference counting is probably the way here for the long term
Pony's ORCA GC uses the actor message subsystem to send GC reference / dereference messages - something we could use as well, which would naturally scale out well for actors both in a local system as well as in a distributed environment

Analyze the scope of variables to find variables that we can place in lifetime limited arenas. The simplest example is that of a variable that is temporary and only used within the scope of one function. The next step is moving return values to be placed on the stack/arena of the outer / calling function.
What triggered me to look into this is the bad performance of the GC and trying to lessen the load on the GC-heap but using arenas is no temporary hack. Even with a better GC, I think we want multiple approaches to memory management, and doing static lifetime analysis is probably the best foundation for that either way. The way we need to do GC for inter-actor messages across a distributed system fundamentally has different requirements than a GC for a shorter lifetime. Like even if we say there are problems with arenas so that we want a GC for say the continuation lifetime, we could then have a GC that works differently than the inter-actor GC, doing less things (because no thread synchronization required!) and thus be faster for that type of work.
I don't see a world in where lifetime analysis would be bad, it is always a good foundation!
I think it's also really encouraging that we can implement lifetime analysis and then based on knowing some of the shorter lifetimes, we can implement arenas and take on this work in smaller pieces. Our current GC remains the bigger hindrance to performance, so anything we do to lessen the load on it, is a very good thing!

@nordlander @sydow I updated this a bit based on my most recent thoughts. Feel free to read & comment.
I suppose I could also mention that the sort of reason why this popped up now is that we recently got the PRW exporter in Telemetrify and I wrote a small program to just generate mock data and export that to a time series database. It's doing like 20% of the total amount of work that Telemetrify would normally do, so I know Telemetrify will run ever slower. My example program is more like the upper end of the performance but it doesn't run nearly as fast as I want. I guess my expectations were quite low already even though my hopes were higher and long term I need to be muuuuch faster. I haven't fully benchmarked things here but I believe the GC, as always, is the main source of poor performance and so I began thinking of how to improve it.. and voila, this issue :)


htmleditor (tinyMCE) full screen toggle hides part of screen

Affected Version
SS4.1
Description
Add full screen button to HTMLEditor. Click Full Screen, left-side of editor is hidden ...
<div class="mce-tinymce mce-container mce-panel mce-fullscreen">

needs a higher z-index...
set it to 1100... I think that works fine.
any higher and the dropdowns (e.g. format) do not work anymore.

set it to 1100... I think that works fine.

@sunnysideup related https://github.com/silverstripe/silverstripe-admin/pull/512

I just tested it locally on 4.1 and it seems to be working for me. I've enable the TinyMCE full screen plugin and when I switch my WYSIWYG to full screen, I don't get any overlap.
Before entering full screen

After entering full screen

Did I misunderstand the issue?
Enabling full screen plugin
For anyone else who want to test this, you just need to stick this in your _config.php file.
<?php

use SilverStripe\Forms\HTMLEditor\HtmlEditorConfig;
HtmlEditorConfig::get('cms')
    ->enablePlugins('fullscreen')
    ->insertButtonsAfter('code', 'fullscreen');

Also note that the plugin is enabled by default in CWP recipes

I can't reproduce this either in CWP 2.1. There is a z-index issue with the blog module, but it's not what is reported here. Note that we fixed an issue with the fullscreen mode being overlaid by the CMS menu in https://github.com/silverstripe/silverstripe-admin/pull/512

This has regressed in SS 4.3.0-rc1:

The previous fix in https://github.com/silverstripe/silverstripe-admin/pull/512 is still there (providing the menu with a z-index of 80), and the mce-fullscreen class still has a z-index of 100. Investigating why this isn't working...

Ah ok, the container around .mce-fullscreen has a z-index of 0 - regression caused by https://github.com/silverstripe/silverstripe-admin/pull/620 (SS 4.3 only)

Fixed again by reverting silverstripe/silverstripe-admin#620 in https://github.com/silverstripe/silverstripe-admin/commit/7538a0160c75fd5145085e15e08ba9453f86bba8


TINKERPOP-2814 Add configuration for SSL handshake timeout.

Resolves https://issues.apache.org/jira/browse/TINKERPOP-2814
Note: The default timeouts were increased because they seem to be too low. This increase can be removed if it is deemed that the defaults shouldn't be changed in 3.5-dev.

Are there any integration tests for this?
No, I couldn't think of a way to add an integration tests for this as it would require a way of forcing the handshake to not finish which is difficult to add.


Translation

Hello,
how can we translate months in another languages ?

+1 for months and dayweek i18n

I think, you can set language with moment.locale('lang');.
[http://momentjs.com/docs/#/i18n/changing-locale/](Moment.js Docs)

Exactly what @drugoi said, is the right answer. I would close this isse @g00fy-


Typecasting during operations

I would like to multiply 2 boolean matrices (A, B) and have the result as UINT64 (to count the number of possible paths).
Currently I have two solutions:

initializing a new result matrix with the correct size and UINT64 type and use it as out parameter of mxm, and defining a semiring on UINT64,
a hacky solution is to use .pattern(UINT64) to cast the structure of matrix A (the first operand) to UINT64 and then use it in mxm.

A = Matrix.from_lists([0, 0], [1, 2], [True]*2, 4, 4)
B = Matrix.from_lists([1, 2], [3, 3], [True]*2, 4, 4)
C = Matrix.sparse(UINT64, 4, 4)
A.mxm(B, semiring=UINT64.PLUS_TIMES, out=C)

print(A, A.type)
print(A.to_string())

print(B, B.type)
print(B.to_string())

print(C, C.type)
print(C.to_string())

assert C[0, 3] == 2

What is the intended way to cast a matrix/vector in pygraphblas?
It looks like in GraphBLAS transpose method is the best way to cast a matrix: https://github.com/DrTimothyAldenDavis/GraphBLAS/blob/5e569f2fcb0597b4ad3c60fca1a4ff8e938fd111/Doc/GraphBLAS_UserGuide.tex#L9166-L9176
Is there a more convenient way to change types during an operation?
A possible solution might be to infer the result type from the semiring/operator if applicable, otherwise add an optional typ parameter to all other operations.
Issue #42 might be related.

All good questions!  For now the out parameter workaround is probably the most optimal.  I like the idea of detecting the return type from the operator type, not sure if there's a gotcha there but it sounds reasonable and if someone doesn't like it they can use the out bypass.

Hi @marci543 I've pushed PR #72 which adds type promotion that takes the semiring, and left and right types into account when doing operations.  Your example is now:
A = Matrix.from_lists([0, 0], [1, 2], [True]*2, 4, 4)
B = Matrix.from_lists([1, 2], [3, 3], [True]*2, 4, 4)
with UINT64.PLUS_TIMES:
    C = A @ B

print(A)
print(B)
print(C)

assert C[0, 3] == 2

    0 1 2 3
 0|   t t  | 0
 1|        | 1
 2|        | 2
 3|        | 3
    0 1 2 3
    0 1 2 3
 0|        | 0
 1|       t| 1
 2|       t| 2
 3|        | 3
    0 1 2 3
    0 1 2 3
 0|       2| 0
 1|        | 1
 2|        | 2
 3|        | 3
    0 1 2 3


App crashes on Xiaomi Redmi Note 6 Pro

When I try to run Youtube vanced on my phone it crashes

I have the same problem with multiple apps, that where registered by the last version and after the update they are crashing with the same error. Try to reinstall, did always solve the problem for me. But still seems to be a bug.

Your problem is not related to microG. Look at the package name in log.
You should either install microG vanced or use root variant of youtube vanced.

@ale5000-git can be closed as issue coming from different project.
@YusufHussein @paulbauriegel as @Vavun pointed out it says: com.mgoogle.android.gms which is Vanced's private microG fork, as oposed to com.google.android.gms which is the official microG.
If the issue persists, report it over to the Vanced developers. They should also tell people that their microG build is a fork and bugs should not be reported upstream.

@Nanolx @Vavun I'm having the same issues with the official microG. A lot of of apps crashed with the same error:
[07-08 13:10:32.969 30173:30196 E/AndroidRuntime]
FATAL EXCEPTION: firebase-iid-executor
Process: com.duolingo, PID: 30173
java.lang.SecurityException: Not allowed to bind to service Intent { act=com.google.android.c2dm.intent.REGISTER pkg=com.google.android.gms }
	at android.app.ContextImpl.bindServiceCommon(ContextImpl.java:1677)
	at android.app.ContextImpl.bindService(ContextImpl.java:1612)
	at android.content.ContextWrapper.bindService(ContextWrapper.java:698)
	at d.i.b.b.d.g.a.b(SourceFile:8)
	at d.i.c.e.g.a(SourceFile:20)
	at d.i.c.e.e.a(SourceFile:12)
	at d.i.c.e.v.a(SourceFile:61)
	at d.i.c.e.S.run(SourceFile:1)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
	at java.lang.Thread.run(Thread.java:764)

logcat_07-08-2019_13-10-42.txt

Do you have GsfProxy installed? Is GmsCore a system app? Did you try device checkin, see: https://github.com/microg/android_packages_apps_GmsCore/wiki/Helpful-Information

Yes, and my device is registered to gcm aswell. Works for all the apps I installed after the update. The weird thing is, if I reinstall the apps crashing with the exception above everything works as expected.


Add optional access to Command's stdin handle

I was experimenting and I thought I should share some changes based on the discussion in #106.
Key Changes:

Added the InputPredicate trait to provide access to Command's stdin handle
Added implementations of the InputPredicate trait to leave public API unchanged and maintain compatibility
Added doc-tests/examples to the stdin method
Added the Assert::example constructor (#96)

I also tested these changes with one of my other projects. The non-working example in #106 becomes with this change:
#[test]
fn slow_reply_works() {
    const RESPONSE_TIME: u64 = 10; // seconds
    Assert::example("an_example")
        .stdin("slowReplyMessage")
        .stdin(Wait(RESPONSE_TIME))
        .succeeds()
        .and()
        .stdout().is("expected message")
        .unwrap();
}

where Wait is defined elsewhere and it is a tuple struct that implements the InputPredicate trait.

[x] I have created tests for any new feature, or added regression tests for bugfixes.
[x] cargo test succeeds
[x] Clippy is happy: cargo +nightly clippy succeeds
[x] Rustfmt is happy: cargo +nightly fmt succeeds

This addresses me not implementing it but I'm still not sure about it

Seems a bit obscure of a use case

While I agree the origin of this PR and my initial issue submission (#106) is an edge case and somewhat out of the blue with a more common usage to read stdin as a block data in one shot, like from file redirection, streaming data to and from a CLI application via pipes is a common practice. The current API, and after an admittedly quick review of the forthcoming new API (#98), only supports writing single blocks of data to a CLI application, yet stdin is a stream where data can be written to it over time. I thought these changes would be a nice way to extend functionality to test the streaming nature of stdin if needed while still maintaining the simplicity and elegance that makes this crate attractive for testing CLI applications.

Contemplating how well it will fit with the new API. Ideally we'll have that in by the end of the month.

If the new API is intended to be a toolkit for creating CLI test frameworks, then I would appreciate some way to test the stream nature of stdin in the new API and/or supply a mechanism to expose the stdin handle from Command. I would be happy to spend some time on investigating this for the new API.

In general, this use case seems better served by a command/response approach.

Can you expand on this a little more? I do not know what you are referring to. I was under the impression that the current API for this crate is a command/response approach.

Maybe StdinWriter?

This is more descriptive of its usage and works for me.

Could you look at https://github.com/assert-rs/assert_cmd and see how this new API works for your needs?
Note: assert_cmd is basically what assert_cli is today.  I think killercup wants to take assert_cli and turn it into a higher level, more opinionated crate.

Could you look at https://github.com/assert-rs/assert_cmd and see how this new API works for your needs?

Yes. I will take a look, thank you.


Add support for different Dockerfile (Docker 1.5.0)

Since Docker allows multiple Dockerfile in a single directory, it would be great if docker-compose allows a Dockerfile as param for "build" instead of a directory.

That would be really great.
For example let's say I have a Django application, which uses Grunt for asset compilation. Today I have to put one of the container in a separate directory, which doesn't have access to my code at build time. This means that I have to run npm install and grunt install after the first build.
With the ability to use several Dockerfile in the same directory, this isn't an issue anymore.
tl;dr: several containers might need the code at build-time, hence it is useful.

Duplicate of #834


[RFC] Universal support for chained assignment

Setter methods (including #[]=) aren't currently required to return the same value that gets assigned, so the ability to chain multiple assignments is in general not supported. For example, BitArray breaks because the last statement of its #[]= refers to the internal buffer:
  a = BitArray.new(6)
  a[0] = a[4] = true
#  ^
# Error: no overload matches 'BitArray#[]=' with types Int32, UInt32
#
# Overloads are:
#  - BitArray#[]=(index, value : Bool)

This leads to surprises, and I believe the language should avoid such surprises. Uses of = that don't support chained assignments should only appear in DSLs, and that is supposed to be taken care of by macros, not regular methods. Consider the following snippet:
class Foo
  def []=(k, v)
    p [k, v]
    123
  end
end

a = Foo.new
a[0] = a[4] = true
a.[]=(0, a.[]=(4, true))

This snippet is both valid Crystal and Ruby code. In Crystal it prints
[4, true]
[0, 123]
[4, true]
[0, 123]

Whereas in Ruby it prints
[4, true]
[0, true]
[4, true]
[0, 123]

Thus it seems Ruby rewrites the operator syntax as follows:
a[0] = a[4] = true
a[0] = (__tmp2 = true; a.[]=(4, __tmp2); __tmp2)
__tmp1 = (__tmp2 = true; a.[]=(4, __tmp2); __tmp2); a.[]=(0, __tmp1); __tmp1

We should follow suit, but we may also go one step further and rewrite the definitions of all setter methods instead; that is, the compiler automatically injects the value argument as the return value, equivalent to something like
class Foo
  # the original setter body (whose return type and value are ignored,
  # including early returns)
  @[AlwaysInline]
  private def index_assign_impl(k, v)
    p [k, v]
    123
  end

  def []=(k, v)
    index_assign_impl(k, v)
    v
  end
end

Then we would always have the same return values whether the setters are invoked through the operator or call syntax.

I wanted to do this a couple of times but failed for some reason. I think the easiest thing is to do it the first way, not the second way.

This is a duplicate of #7707, let's continue the discussion there.


DefinePlugin doesn't handle arrays & undefined correctly

Bug report

What is the current behavior?
If providing a config with an array in it the DefinePlugin does not resolve it correctly.
If accessing an undefined key object the DefinePlugin does return the whole object.
If the current behavior is a bug, please provide the steps to reproduce.
// webpack.config.js
module.exports = {
  plugins: [
    new webpack.DefinePlugin({
      FOO: {
        name: "'bar'",
        fruits: ["'apple'", "'lemon'", "'orange'"]
      }
	})
  ]
}

// main.js
console.log(FOO.name);
console.log(FOO.fruits);
console.log(FOO.xxxxx);

What is the expected behavior?
I expect the following
console.log('bar');
console.log(['apple', 'lemon', 'orange']);
console.log();

but I get
console.log('bar');
console.log(Object({"0":'apple',"1":'lemon',"2":'orange'}));
console.log(Object({"name":'bar',"fruits":Object({"0":'apple',"1":'lemon',"2":'orange'})}).xxxxx);

Other relevant information:
webpack version: 4.41.6 & 5.0.0-beta.13
Node.js version: v12.14.1
Operating System: Mac OS X
Additional tools:

webpack@5 supports array, how we should handle undefined?

webpack@5 supports arrays
no, it doesn't because I define an array in FOO.fruits and get an object after compilation (see my example)

how we should handle undefined?
I'd expect to not return anything if the key doesn't match (instead of returning the whole object as fallback)

I'm trying to use this plugin to use parts of the server config in my frontend code and really don't wanna see the whole config being included in case of a typo.

no, it doesn't because I define an array in FOO.fruits and get an object after compilation (see my example)

https://github.com/webpack/webpack/pull/9942
just not released

I'd expect to not return anything if the key doesn't match (instead of returning the whole object as fallback)

Make sense

just not released

I've missed that one (did only check the issues) – cool!

Make sense

Shall I submit a PR to fix this?

Yes, let's do it

@SassNinja for webpack@5 it is already solved, you can look at tests

@SassNinja now DefinePlugin works for all types except Symbol

Awesome!
Thank you @evilebottnawi


chore(main): release 0.28.1

:robot: I have created a release beep boop
0.28.1 (2023-06-15)
Bug Fixes

small errors (6231c52)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/appblocks-hub/BB-CLI/releases/tag/v0.28.1 :sunflower:


Docs/dill hack notes

closes #203
Overview
Just forgot to open the PR for this one I think -- this adds a page to the docs explaining the dill hack that made garden-independent remote pipelines work.
Feedback obviously very welcome if anything isn't clear or useful, but re-reading it now after a few weeks of forgetting the details I think it's ok.

:books: Documentation preview :books:: https://garden-ai--257.org.readthedocs.build/en/257/

Codecov Report

Merging #257 (60fe0cb) into main (915e33c) will decrease coverage by 0.46%.
The diff coverage is n/a.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
@@            Coverage Diff             @@
##             main     #257      +/-   ##
==========================================
- Coverage   78.37%   77.91%   -0.46%
==========================================
  Files          48       48
  Lines        3408     3401       -7
==========================================
- Hits         2671     2650      -21
- Misses        737      751      +14

see 7 files with indirect coverage changes


added new link in the navbar, fixes #357

Added a new link in the navbar, that directs users to Întalniri Săptămânale section
In script_404.js added a setTimeout to correctly redirect to section (as Team section, located before Întalniri Săptămânale, is dinamically generated, its height is not known at the time of navigation - setTimeout allows for the content to load, before scrolling to section)

It looks good

Due to the new link added to the navbar the breakpoint for it should be adjusted

Increas the breakpoint for it, make sure the space between "Misiunea noastra" and the logo text should be as big or bigger than the gab that is set between the links. This is my mistake i should have specified in the previous comment


Bump SCIM version to get group uuid improvements

Purpose
Onboard changes for https://github.com/wso2-extensions/identity-inbound-provisioning-scim2/pull/524

PR builder started
Link: https://github.com/wso2/product-is/actions/runs/7754112633

PR builder completed
Link: https://github.com/wso2/product-is/actions/runs/7754112633
Status: failure

PR builder completed
Link: https://github.com/wso2/product-is/actions/runs/7756204611
Status: success


Results on Person ReID

Hi, I was trying to apply SmoothAP into Person ReID but didn't get desirable result. Face retrieval experiments are in your paper but details are still not clear.  So I am not sure which part I did wrong, could you help me ?
Setting.
MODEL: resnet50 + BN1d + L2Norm
Loss: cosface + smoothAP
Batch: batch-size=192, pk sampler, p=16 (p=16 outperforms p=4 with a large margin)
My Experiments.

method
mAP

cosface
36.9%

cosface+triplet
37.5%

cosface+smoothAP
34.6%

smoothAP
29.9%

Hi,
Thank you for your interest. I plan on releasing some code for training when I am back from holiday in 2 weeks. This might be of help.
Does your pk sampler ensure that all samples classes are different in a batch?
The version of the Smooth-AP loss that I uploaded can only work if this is the case. Also what value for tau are you using?
Sent from my iPhone

On 25 Jul 2020, at 09:28, Xiangyu<EMAIL_ADDRESS>wrote:

Hi, I was trying to apply SmoothAP into Person ReID but didn't get desirable result. Face retrieval experiments are in your paper but details are still not clear. So I am not sure which part I did wrong, could you help me ?
Setting.
MODEL: resnet50 + BN1d + L2Norm
Loss: cosface + smoothAP
Batch: batch-size=192, pk sampler, p=16 (p=16 outperforms p=4 with a large margin)
My Experiments.
method	mAP
cosface	36.9%
cosface+triplet	37.5%
cosface+smoothAP	34.6%
smoothAP	29.9%
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or unsubscribe.

Thank you for quick reply.

Does "all samples classes are different in a batch" mean p=1? I printed labels which listed below
what is tau refer to ?

tensor([641, 641, 641, 641, 641, 641, 641, 641, 641, 641, 641, 641, 641, 641,
        641, 641, 140, 140, 140, 140, 140, 140, 140, 140, 140, 140, 140, 140,
        140, 140, 140, 140, 502, 502, 502, 502, 502, 502, 502, 502, 502, 502,
        502, 502, 502, 502, 502, 502, 181, 181, 181, 181, 181, 181, 181, 181,
        181, 181, 181, 181, 181, 181, 181, 181,  69,  69,  69,  69,  69,  69,
         69,  69,  69,  69,  69,  69,  69,  69,  69,  69,  82,  82,  82,  82,
         82,  82,  82,  82,  82,  82,  82,  82,  82,  82,  82,  82, 120, 120,
        120, 120, 120, 120, 120, 120, 120, 120, 120, 120, 120, 120, 120, 120,
        200, 200, 200, 200, 200, 200, 200, 200, 200, 200, 200, 200, 200, 200,
        200, 200, 509, 509, 509, 509, 509, 509, 509, 509, 509, 509, 509, 509,
        509, 509, 509, 509, 451, 451, 451, 451, 451, 451, 451, 451, 451, 451,
        451, 451, 451, 451, 451, 451, 617, 617, 617, 617, 617, 617, 617, 617,
        617, 617, 617, 617, 617, 617, 617, 617, 133, 133, 133, 133, 133, 133,
        133, 133, 133, 133, 133, 133, 133, 133, 133, 133], device='cuda:0')

Please check Section 4.1 in the paper.

So if p = samples per class, k = number of classes. It is essential that k ‘different’ classes are sampled in every batch. The batch labels you sent below look fine, but make sure that this rule is asserted. Some pk samplers do not assert this.
Tau is called ‘anneal’ in the loss function initialisation :)
Sent from my iPhone

On 25 Jul 2020, at 10:58, Xiangyu<EMAIL_ADDRESS>wrote:

Thank you for quick reply.
Does "all samples classes are different in a batch" mean p=1? I printed labels which listed below
what is tau refer to ?
tensor([641, 641, 641, 641, 641, 641, 641, 641, 641, 641, 641, 641, 641, 641,
641, 641, 140, 140, 140, 140, 140, 140, 140, 140, 140, 140, 140, 140,
140, 140, 140, 140, 502, 502, 502, 502, 502, 502, 502, 502, 502, 502,
502, 502, 502, 502, 502, 502, 181, 181, 181, 181, 181, 181, 181, 181,
181, 181, 181, 181, 181, 181, 181, 181,  69,  69,  69,  69,  69,  69,
69,  69,  69,  69,  69,  69,  69,  69,  69,  69,  82,  82,  82,  82,
82,  82,  82,  82,  82,  82,  82,  82,  82,  82,  82,  82, 120, 120,
120, 120, 120, 120, 120, 120, 120, 120, 120, 120, 120, 120, 120, 120,
200, 200, 200, 200, 200, 200, 200, 200, 200, 200, 200, 200, 200, 200,
200, 200, 509, 509, 509, 509, 509, 509, 509, 509, 509, 509, 509, 509,
509, 509, 509, 509, 451, 451, 451, 451, 451, 451, 451, 451, 451, 451,
451, 451, 451, 451, 451, 451, 617, 617, 617, 617, 617, 617, 617, 617,
617, 617, 617, 617, 617, 617, 617, 617, 133, 133, 133, 133, 133, 133,
133, 133, 133, 133, 133, 133, 133, 133, 133, 133], device='cuda:0')
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or unsubscribe.

@Andrew-Brown1 @WeidiXie Thank you, I found it. tau is setted to 0.01 in my experiments. I also tried tau=0.1 and 0001, but which turned out inferior to 0.01

The training code will be released in two weeks time, stay tuned, thanks.

@WeidiXie Oh good, looking forward to it. : )
BTW, do you have a plan to combine it with an memory bank, since batch size really matters?

Thanks!
So perhaps in the future. Many previous works have explored it and showed it to be beneficial.
Sent from my iPhone

On 25 Jul 2020, at 11:40, Xiangyu<EMAIL_ADDRESS>wrote:

@WeidiXie Oh good, looking forward to it. : )
BTW, do you have a plan to combine it with an memory bank, since batch size really matters?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or unsubscribe.

The training code will be released in two-three weeks time, stay tuned, thanks.

Looking forward to your training code!


checkPhase = false always

I see 1.0 had enabled checkPhase of Polkadot (other codes?).
And then disabled because of issue.
https://github.com/andresilva/polkadot.nix/blob/a010b91c8828809f1ab9817286582f9be78cd62d/pkgs/polkadot/default.nix#L57
Could we have all tests always disabled, assuming check happens by CI?
This will speed up builds

or alternatively do this https://github.com/andresilva/polkadot.nix/issues/10

Could we have all tests always disabled, assuming check happens by CI?

I am not sure what you mean here. Do you mean keep doCheck = false forever as it is now? Or do it for all the other packages?

all false forever for all packages. i see now idea to enable true again on polkadot, imho that is not required for releases

Don't think this is needed as we have build cache now.


Tasks API POST request does not accept csrf token

My actions before raising this issue

[ x] Read/searched the docs
[ x] Searched past issues

Steps to Reproduce (for bugs)

In python script login to cvat and receive login cookies, containing csrftoken
Send /api/tasks POST request, trying to create a new task

Expected Behaviour

I expect a new task to be created and status code 201 to be the response to my POST request.
Current Behaviour

Status code 403 is sent back, with the error in the response's content stating:
"CSRF Failed: CSRF token missing."
Curiously, downloading annotations from an existing task works with my login cookies, so i don't know why the csrf token would be missing when trying to create a new task.
Context

I am trying to automate the creation of new tasks and uploading data to them with the rest-api.
Your Environment
:

Docker version: 23.0.1
Operating System and version: 18.04.1 Ubuntu (running cvat server), Win10 making request
Code example to reproduce problem:

import requests
import json

login_data='{"username":"my_user","email":"","password":"my_password"}'
login_json = json.loads(login_data)
cvat_base_url = "http://myurl.com:8080"

login_response = requests.post(cvat_base_url+'/api/auth/login', json=login_json)

payload = '{"name": "test_rest_create_task","project_id": 18}'
payload = json.loads(payload)
post_response = requests.post(cvat_base_url+'/api/tasks', json=payload, cookies=login_response.cookies)

Hi, please check this answer about the authentication parameters.

Hi, thank you for your response.
Sorry to ask again, but I'm not sure I understand your previous answer correctly, so I will ask again. I found a workaround for the previous issue of creating tasks, but the csrf token error is still causing problems. Now I'm trying to upload annotations from my local machine to an existing task. From my understanding there are two ways to do that. Either using the sdk or making requests directly, I've tried both.
Using the sdk, I tried:
with ApiClient(configuration) as api_client:
    try:
        (_, response) = api_client.tasks_api.create_annotations(id=85, filename='annotations_test.zip', format='Segmentation mask 1.1', location='local', use_default_location=False)
        print(response.status, response.headers)
    except exceptions.ApiException as e:
            print("Exception when calling tasks_api.retrieve(): %s\n" % e)

Which yields status code 400 and the HTTP response body: "No such file were uploaded", similar to #6287. I've tried using the cvat-sdk version corresponding to my server version (2.4.5) and using the newest cvat-sdk on pip.
Since using the sdk didn't work for me after some attempts to fix it, I tried making requests directly:
login_cookies = get_login_cookies(USERNAME, PASSWORD, CVAT_URL)
post_response = requests.post(CVAT_URL+'/api/tasks/85/annotations?org=MyOrg&use_default_location=false&location=local&format=Segmentation+mask+1.1&filename=annotations_test.zip&conv_mask_to_poly=false', cookies=login_cookies)

Which yields status code 403 and Response content "CSRF Failed: CSRF token missing."
I also tried using sessionid and csrftoken copied from a browser session, as suggested in your previous response getting the same results.
I can upload the annotations via the UI without problems. The URL for my post request is copied from my browser, from successfully uploading annotations via the UI.

Hi.

Which yields status code 403 and Response content "CSRF Failed: CSRF token missing."

Please make sure you have both csrftoken cookie and X-CSRFToken header. They must have the same value.

Now I'm trying to upload annotations from my local machine to an existing task.

Unfortunately, as we discovered in the linked issue https://github.com/opencv/cvat/issues/6287, annotations now can only be uploaded via the TUS file uploading protocol. Both UI and high-level SDK use this protocol. Manual use via plain requests or low-level SDK is quite complicated with this protocol, so I recommend using the high-level SDK instead:
import os
import sys

from cvat_sdk import make_client
from cvat_sdk.core.helpers import DeferredTqdmProgressReporter

API_KEY = os.getenv("CVAT_API_KEY", "<authorization token>")
API_SESSIONID = os.getenv("CVAT_API_SESSIONID", "<session id>")
API_CSRFTOKEN = os.getenv("CVAT_API_CSRFTOKEN", "<csrf token>")

def main(argv=None):
    assert API_KEY and API_SESSIONID and API_CSRFTOKEN

    with make_client("https://app.cvat.ai", port=443) as client:
        client.api_client.set_default_header("Authorization", f"Token {API_KEY}")
        client.api_client.cookies["sessionid"] = API_SESSIONID
        client.api_client.cookies["csrftoken"] = API_CSRFTOKEN
        # client.organization_slug = ""
        client.config.status_check_period = 2

        task_id = # fill in your task id
        task = client.tasks.retrieve(task_id)

        filename = f"task-{task_id}-cvat_for_images.zip"
        task.export_dataset("CVAT for video 1.1", filename=filename,
            pbar=DeferredTqdmProgressReporter(), include_images=False
        )
        task.import_annotations("CVAT 1.1", filename=filename,
            pbar=DeferredTqdmProgressReporter()
        )

main(sys.argv)

Thank you very much, that kind of worked.
A few issues:
1)
client.tasks.retrieve() takes one parameter, obj_id. It ultimately calls _from_openapi_data() which throws an error: missing 1 required positional argument: 'validation'
I fixed it by editing /core/proxies/model_proxy.py in line 139, adding _validate_outputs=False as a parameter to self.api.retrieve() but that was a shot in the dark...

When uploading annotations to a new task for the first time I get the following error:
Uploading data: 100%| [00:00<00:00, 490kB/s]
Traceback (most recent call last):
File "C:\Users\me\Dokumente\cvat_venv\cvat_utils\cvat_utils.py", line 135, in
upload_annotations(124, 'annotations_test.zip')
File "C:\Users\me\Dokumente\cvat_venv\cvat_utils\cvat_utils.py", line 133, in upload_annotations
task.import_annotations("Segmentation mask 1.1", filename=an_filename, pbar=DeferredTqdmProgressReporter())
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\core\proxies\tasks.py", line 174, in import_annotations
AnnotationUploader(self.client).upload_file_and_wait(
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\core\uploading.py", line 290, in upload_file_and_wait
rq_id = json.loads(response.data).get("rq_id")
File "C:\Users\me\AppData\Local\Programs\Python\Python39\lib\json_init.py", line 346, in loads
return _default_decoder.decode(s)
File "C:\Users\me\AppData\Local\Programs\Python\Python39\lib\json\decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "C:\Users\me\AppData\Local\Programs\Python\Python39\lib\json\decoder.py", line 355, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
When I run the same code again, the error turns into:
Uploading data: 100%|| 174k/174k [00:00<00:00, 1.96MB/s]
Traceback (most recent call last):
File "C:\Users\me\Dokumente\cvat_venv\cvat_utils\cvat_utils.py", line 135, in
upload_annotations(124, 'annotations_test.zip')
File "C:\Users\me\Dokumente\cvat_venv\cvat_utils\cvat_utils.py", line 133, in upload_annotations
task.import_annotations("Segmentation mask 1.1", filename=an_filename, pbar=DeferredTqdmProgressReporter())
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\core\proxies\tasks.py", line 174, in import_annotations
AnnotationUploader(self._client).upload_file_and_wait(
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\core\uploading.py", line 286, in upload_file_and_wait
response = self.upload_file(
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\core\uploading.py", line 190, in upload_file
real_filename = self._upload_file_data_with_tus(
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\core\uploading.py", line 236, in _upload_file_data_with_tus
tus_uploader = self._make_tus_uploader(
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\core\uploading.py", line 232, in _make_tus_uploader
return _MyTusUploader(client=client, api_client=api_client, **kwargs)
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\core\uploading.py", line 71, in init
super().init(*_args, **_kwargs)
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\tusclient\uploader.py", line 124, in init
self.url = url or self.get_url()
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\tusclient\uploader.py", line 216, in get_url
return self.create_url()
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\tusclient\uploader.py", line 22, in _wrapper
return func(args, **kwargs)
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\core\uploading.py", line 92, in create_url
resp = self._api_client.rest_client.POST(self.client.url, headers=headers)
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\api_client\rest.py", line 256, in POST
return self.request("POST", url,
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\api_client\rest.py", line 211, in request
raise ApiException(http_resp=r)
cvat_sdk.api_client.exceptions.ApiException: Status Code: 409
Reason: Conflict
HTTP response headers: HTTPHeaderDict({'Access-Control-Allow-Headers': 'Tus-Resumable,upload-length,upload-metadata,Location,Upload-Offset,content-type', 'Access-Control-Allow-Methods': 'PATCH,HEAD,GET,POST,OPTIONS', 'Access-Control-Allow-Origin': '', 'Access-Control-Expose-Headers': 'Tus-Resumable,upload-length,upload-metadata,Location,Upload-Offset', 'Allow': 'GET, POST, PUT, PATCH, DELETE, HEAD, OPTIONS', 'Cache-Control': 'no-store', 'Content-Length': '36', 'Content-Type': 'application/vnd.cvat+json', 'Cross-Origin-Opener-Policy': 'same-origin', 'Date': 'Tue, 29 Aug 2023 08:15:10 GMT', 'Referrer-Policy': 'same-origin', 'Server': 'Apache', 'Tus-Extension': '', 'Tus-Max-Size': '26843545600', 'Tus-Resumable': '1.0.0', 'Tus-Version': '1.0.0', 'Vary': 'Accept,Origin', 'X-Content-Type-Options': 'nosniff', 'X-Frame-Options': 'DENY', 'X-Request-Id': 'f0009d6c-b582-41c7-aa48-3d54f8708b29'})
HTTP response body: b'"File with same name already exists"'
..indicating that I cannot upload the same file twice?
So I tried changing the name of the annotation file, which led to:
Uploading data: 100%|| 174k/174k [00:00<00:00, 647kB/s]
Traceback (most recent call last):
File "C:\Users\me\Dokumente\cvat_venv\cvat_utils\cvat_utils.py", line 135, in
upload_annotations(124, 'annotations_testingf.zip')
File "C:\Users\me\Dokumente\cvat_venv\cvat_utils\cvat_utils.py", line 133, in upload_annotations
task.import_annotations("Segmentation mask 1.1", filename=an_filename, pbar=DeferredTqdmProgressReporter())
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\core\proxies\tasks.py", line 174, in import_annotations
AnnotationUploader(self._client).upload_file_and_wait(
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\core\uploading.py", line 286, in upload_file_and_wait
response = self.upload_file(
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\core\uploading.py", line 194, in upload_file
return self._tus_finish_upload(url, query_params=query_params, fields=fields)
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\core\uploading.py", line 269, in _tus_finish_upload
File "C:\Users\me\Dokumente\cvat_venv\cvat_utils\cvat_utils.py", line 133, in upload_annotations
task.import_annotations("Segmentation mask 1.1", filename=an_filename, pbar=DeferredTqdmProgressReporter())
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\core\proxies\tasks.py", line 174, in import_annotations
AnnotationUploader(self._client).upload_file_and_wait(
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\core\uploading.py", line 286, in upload_file_and_wait
response = self.upload_file(
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\core\uploading.py", line 194, in upload_file
return self._tus_finish_upload(url, query_params=query_params, fields=fields)
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\core\uploading.py", line 269, in _tus_finish_upload
expect_status(202, response)
File "C:\Users\me\Dokumente\cvat_venv\lib\site-packages\cvat_sdk\core\helpers.py", line 154, in expect_status
raise exceptions.ApiException(
cvat_sdk.api_client.exceptions.ApiException: Status Code: 201
Reason: Created
HTTP response headers: HTTPHeaderDict({'Allow': 'GET, POST, PUT, PATCH, DELETE, HEAD, OPTIONS', 'Content-Length': '0', 'Cross-Origin-Opener-Policy': 'same-origin', 'Date': 'Tue, 29 Aug 2023 08:22:16 GMT', 'Referrer-Policy': 'same-origin', 'Server': 'Apache', 'Vary': 'Accept,Origin', 'X-Content-Type-Options': 'nosniff', 'X-Frame-Options': 'DENY', 'X-Request-Id': '807157ea-d95c-4b3a-bfb1-cba99afdedee'})
Which luckily created the annotations in my task! Nice!
One problem, however, remains: It converts my masks to polygons... I tried to find a parameter to change that behaviour but in /core/proxies/tasks.py, which is called by task.import_annotations(), I couldn't find one.
Also I don't really understand why I get the json decoding error and why it fixes itself by calling the same code three times.

Hi,
The errors about validation field, failing rq_id = json.loads(response.data).get("rq_id") and auto-fixed errors on the following requests indicate that the SDK/server versions might be mismatching, and the server doesn't include commit from PR https://github.com/opencv/cvat/pull/5909. Please check the installed SDK version.

It converts my masks to polygons

There is no high-level API option for this, but you can change this by adding "conv_mask_to_poly": True/False in https://github.com/opencv/cvat/blob/213bcf0b360d0e09fcfee1ff71ccf0d4e7a7b2b0/cvat-sdk/cvat_sdk/core/proxies/tasks.py#L178

Thank you for your help, I will update the server.

Hi.

Now I'm trying to upload annotations from my local machine to an existing task.

Unfortunately, as we discovered in the linked issue #6287, annotations now can only be uploaded via the TUS file uploading protocol. Both UI and high-level SDK use this protocol. Manual use via plain requests or low-level SDK is quite complicated with this protocol, so I recommend using the high-level SDK instead:
import os
import sys

from cvat_sdk import make_client
from cvat_sdk.core.helpers import DeferredTqdmProgressReporter

API_KEY = os.getenv("CVAT_API_KEY", "<authorization token>")
API_SESSIONID = os.getenv("CVAT_API_SESSIONID", "<session id>")
API_CSRFTOKEN = os.getenv("CVAT_API_CSRFTOKEN", "<csrf token>")

def main(argv=None):
    assert API_KEY and API_SESSIONID and API_CSRFTOKEN

    with make_client("https://app.cvat.ai", port=443) as client:
        client.api_client.set_default_header("Authorization", f"Token {API_KEY}")
        client.api_client.cookies["sessionid"] = API_SESSIONID
        client.api_client.cookies["csrftoken"] = API_CSRFTOKEN
        # client.organization_slug = ""
        client.config.status_check_period = 2

        task_id = # fill in your task id
        task = client.tasks.retrieve(task_id)

        filename = f"task-{task_id}-cvat_for_images.zip"
        task.export_dataset("CVAT for video 1.1", filename=filename,
            pbar=DeferredTqdmProgressReporter(), include_images=False
        )
        task.import_annotations("CVAT 1.1", filename=filename,
            pbar=DeferredTqdmProgressReporter()
        )

main(sys.argv)

How to solve the 403 problem with Rest API requests?
I tried adding X-CSRFTOKEN to the headers, this usually works but not always.

@YaoJusheng, hi, we need some information about how to obtain such an error. To our knowledge, it can be some server-side firewall problem or (corporate) proxy problem, so these are the first to be checked. If you can provide additional information, it will be possible for us to try help you.

@YaoJusheng , are you sure the problem is with the authorization method? Is it possible that this user actually has no rights to invite users into the org? If the problem persists, consider switching to just the basic auth in each request.

@zhiltsov-max
This user is a super administrator and has all permissions. When using the above example method to initiate a post request, a 403 error will often occur.
My solution is as mentioned in the reply. Re-authentication after each request fails. In most cases will be resolved.
Is there a more reliable solution without repeated login verification?

@YaoJusheng,

My solution is as mentioned in the reply. Re-authentication after each request fails. In most cases will be resolved.

That's very nice to see you've found a workaround.

Is there a more reliable solution without repeated login verification?

We need more information about the problem. If you see the UI is working without problems, please try to find the difference in the requests between the UI and SDK.


Calculate the CmFunction in Detail

This function relates the thermal mass of the building. It can be calculated in a detailed way according to ISO standards. it will need also archetypes to facilitate this. It would be good to use if understanding the sensitivity of thermal mass is needed.

Same for Am, effective thermal mass.
As well as gathering data from Singapore.

From experience in the 3for2 project, the moisture content capacitance of furniture and equipment might play a major role in the profile of hourly cooling requirements. way around it is to opt for a lumped capacitance for moisture content in the model. the value should be calibrated  with measured data and then keep it as a standard for simulation. A more detailed way will be to model materials inside buildings (need of archetypes) and check procedure included in TrnSys to this end

I suggest to close this issue as we might not want to get into the detail of several materials. We know that construction materials in Singapore are quite similar in the whole building stock

check with #935

2 years here, we will not have it anytime soon. Closing it.


Incorrect oid validation

The module incorrectly marks the OID .1.0.88<IP_ADDRESS>.<IP_ADDRESS>.9 as invalid since it doesn't begin with .1.3. While most OIDs begin with .1.3, there are quite a few that don't. The link below includes some information on this particular OID if you're interested:
http://www.mibdepot.com/cgi-bin/getmib3.cgi?win=mib_a&i=1&n=LLDP-MIB&r=rittal&f=LLDP-MIB&v=v2&t=tab&o=lldpRemSysName
I've also narrowed down the issue to lines 132 to 134 of asn1ber.js:
} else if (!skipValidation && (oid[0] !== 1 || oid[1] !== 3)) {
throw new Error("SNMP OIDs always start with .1.3.");
}
I might be misunderstanding the code, but it looks like we only need to replace (oid[0] !== 1 || oid[1] !== 3) with oid[0] !== 1 to appropriately mark the OID as valid.
What steps can I take to resolve this issue? Thanks for your help. I really appreciate it.

I don't think those lines are useful any more, especially if they are incorrect. File a PR to remove that else clause and any tests that expect it?

Thanks for the quick response. It's appreciated. I'll tackle this as soon as I get home tonight.

I'll publish a new version later on today, thanks.

asn1 actually has several valid OID ranges:

0.0.x to 0.39.x
1.0.x to 1.39.x
2.0.x to 2.79.x

Is there something in SNMP that restricts these further, that warrant this check? I actually had to add the skipValidation flag to get around this, but perhaps a better fix is just to allow the technically valid ranges for both MIB OIDs and values of type Object-Identifier.
Most devices only have MIB OIDs starting with .1.3 but if you request something else (eg .<IP_ADDRESS>) nothing catastrophic happens: it just returns NoSuchName.

No, no reason. I think that ^ resolves it.

Perfect, that makes more sense. Thanks!


Utilize vim conceal feature to achieve a higher readibility

Hi, thanks for your nice work! What do you think if we could utilize vim's conceal feature to hide some markers?
For example,

`abcd`, we could just display "abcd" in a highlighted mode;
*ancd* and **abcd**, we could just display "abcd" in italic or bold mode;

Thanks very much!

Hi, thanks for the suggestion, I don't have anything against the concealing but I'm not a bit fan either
We can put the concealing under a configuration flag and that would be awesome
I don't have time right now to do it but pull requests are welcome 😄

Already publish a pull request! Just utilize conceal for italic, bold, bolditalic, inline-code and link.


Regeneration particles won't stop

When I regenerate [whether it be by death or by force] I get the particles, sound, and effects. Fast forward to long after the potion effects are gone (10 minutes later) the particles are still happening around me in small bursts every few seconds. If I get off the server it doesn't stop the particles and nothing i do can seem to stop them.
Please help me!
-Thank you.

I've often heard of this issue but never been able to reproduce it. I'll give it another try.

Thank you,
I can say that finally after 3-4 days i just happened to notice it had stopped. I got used to seeing it so it was weird to  not see it. lol


How to get wasabi without docker?

I like to get the manual wasabi installation without docker.
I have a production mysql and cassandra clusters. How can I use them with wasabi?
Is there any config file for mentioning the mysql and cassandra  server details ?
Thanks.

Hi,
This work is done by the below PR and merged to develop. please let us know if you have more questions
https://github.com/intuit/wasabi/pull/231
Thanks


Transcripts

Is there support for transcripts so that the audio player can be accessible?

You mean like subtitles? Yes.
https://github.com/jplayer/react-jPlayer-examples/blob/master/jPlayers/VideoPlayer/src/videoPlayer.jsx#L23


[spark-15212][SQL]CSV file reader when read file with first line schema do not filter blank in schema column name

What changes were proposed in this pull request?
When load csv file with schema, add schema column name string trim to avoid blank problem.
How was this patch tested?
construct csv data file contains schema definition with column blank such as:
csv data file contains：
col1, col2,col3,col4,col5
1997,Ford,E350,"ac, abs, moon",3000.00
....
notice there is a blank before col2,
test command:
val sqlContext = new org.apache.spark.sql.SQLContext(sc);
var reader = sqlContext.read
reader.option("header", true)
var df = reader.csv("path/to/csvfile")
df.select("col2");//check if OK
df.registerTempTable("tab1");
sqlContext.sql("select col2 from tab1"); //check if OK.

Can one of the admins verify this patch?

Also, the JIRA in the title, spark-15212 might better be SPARK-15212 (See https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark)

I think this option should be associated with ignoreLeadingWhiteSpace and ignoreTrailingWhiteSpace options.

@WeichenXu123 I tried that with ignoreLeadingWhiteSpace and ignoreTrailingWhiteSpace and it seems working fine. I am careful of saying this because I am not a committer but personally I would suggest close this.


cmd/go: Building a shared library in modules mode produces empty library

What version of Go are you using (go version)?

go version go1.14 darwin/amd64

Does this issue reproduce with the latest release?
Yes.
What operating system and processor architecture are you using (go env)?
go env Output
GO111MODULE=""
GOARCH="amd64"
GOBIN="/Users/dottedmag/go/bin"
GOCACHE="/Users/dottedmag/Library/Caches/go-build"
GOENV="/Users/dottedmag/Library/Application Support/go/env"
GOEXE=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="darwin"
GOINSECURE=""
GONOPROXY="github.com/ridge"
GONOSUMDB="github.com/ridge"
GOOS="darwin"
GOPATH="/Users/dottedmag/go"
GOPRIVATE="github.com/ridge"
GOPROXY="https://proxy.golang.org,direct"
GOROOT="/Users/dottedmag/tectonic/_deps.darwin-amd64/go-1.14"
GOSUMDB="sum.golang.org"
GOTMPDIR=""
GOTOOLDIR="/Users/dottedmag/tectonic/_deps.darwin-amd64/go-1.14/pkg/tool/darwin_amd64"
GCCGO="gccgo"
AR="ar"
CC="clang"
CXX="clang++"
CGO_ENABLED="1"
GOMOD=""
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -fdebug-prefix-map=/var/folders/bw/6hyp_vyj68v973qbhlbcvlcr0000gn/T/go-build983884458=/tmp/go-build -gno-record-gcc-switches -fno-common"

What did you do?
Tried to build a shared library and a binary that links to that shared library in modules mode. A repository with reproducer: https://github.com/misha-ridge/splitlib
Packages:

github.com/misha-ridge/splitlib/a (imports ./c)
github.com/misha-ridge/splitlib/b (imports ./c)
github.com/misha-ridge/splitlib/c
github.com/misha-ridge/splitlib (imports ./a, ./b, ./c)

./a and ./c ought to end up in a shared library, ./b and splitlib in binary.
Build:

$ go install -buildmode=shared std
$ go install -buildmode=shared -linkshared  -gcflags='-N -l' ./a
$ go build -o main -linkshared  -gcflags='-N -l' .

What did you expect to see?

libgithub.com-misha-ridge-splitlib-a.so with code from ./a and ./c packages, dynamically linking to std.
splitlib binary with code from ./b and splitlib, dynamically linking to std and libgithub.com-misha-ridge-splitlib-a.so.

What did you see instead?

libgithub.com-misha-ridge-splitlib-a.so is empty:

$ go tool nm libgithub.com-misha-ridge-splitlib-a.so  | grep splitlib
  104cd0 D go.link.abihash.libgithub.com-misha-ridge-splitlib-a.so

splitlib contains code from ./a, ./b, ./c and splitlib and dynamically links only to std:

$ go tool nm main  | grep splitlib
    2180 T github.com/misha-ridge/splitlib/a.SetC
    2190 T github.com/misha-ridge/splitlib/b.SetC
    2170 T github.com/misha-ridge/splitlib/c.Get
    5210 D github.com/misha-ridge/splitlib/c.i
    2180 t local.github.com/misha-ridge/splitlib/a.SetC
    2190 t local.github.com/misha-ridge/splitlib/b.SetC
    2170 t local.github.com/misha-ridge/splitlib/c.Get

Additional info
Trying to build the same using Go 1.13 triggers #35759.

/cc @bcmills @jayconrod

CC @matloob


Automated Package Upgrade

:tada: This PR is included in version 7.0.138 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Choose which branches show up using an app as a dependency

Right now, if you add an app as a dependency and go to depend on a branch, you can see alllll the branches that exist. It would be nice to make only select branches available for others to depend on

How we're going to do this:

Support interpreting dependency permissions from the app_permissions database as more than true/false: instead of {"depend_on": true} we could have {"depend_on": {"branches": ["master"]}} or something like that.

Implement this in both "can we depend on this app?" checks and "what versions of this app can I depend on?" UI data.

Manually insert such records into appropriate public dependencies, including M3 (where you should probably only be able to depend on master or a tagged version)


Use covariant type for @retried(on=[...])

Changes
This PR fixes mypy error in downstream projects:
src/databricks/labs/ucx/workspace_access/scim.py:121: error: Argument "on" to "retried" has incompatible type "list[type[DatabricksError]]"; expected "list[type[BaseException]]"  [arg-type]
src/databricks/labs/ucx/workspace_access/scim.py:121: note: "List" is invariant -- see https://mypy.readthedocs.io/en/stable/common_issues.html#variance
src/databricks/labs/ucx/workspace_access/scim.py:121: note: Consider using "Sequence" instead, which is covariant
src/databricks/labs/ucx/workspace_access/generic.py:143: error: Argument "on" to "retried" has incompatible type "list[type[DatabricksError]]"; expected "list[type[BaseException]]"  [arg-type]
src/databricks/labs/ucx/workspace_access/generic.py:143: note: "List" is invariant -- see https://mypy.readthedocs.io/en/stable/common_issues.html#variance
src/databricks/labs/ucx/workspace_access/generic.py:143: note: Consider using "Sequence" instead, which is covariant

Tests

[x] make test run locally
[x] make fmt applied
[x] relevant integration tests applied

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (76a1933) 57.80% compared to head (2ae4c3f) 57.80%.

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #486   +/-   ##
=======================================
  Coverage   57.80%   57.80%
=======================================
  Files          38       38
  Lines       26367    26367
=======================================
  Hits        15241    15241
  Misses      11126    11126

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Cleanup theme

Hi Guru Sabarish, you made a very good theme. I start using it, and found that something can be improved to provide seamless usage of this theme. I'm still new in Hugo world, but based on what I saw in other themes I would like to propose:

deletion of the content directory from main theme directory:
Currently every new site will also have a generated blog content. Theme should not enforce such thing in my opinion. blog content should be present only in exampleSite.
deletion of the config.yaml in root theme directory:
I decided also to delete this file, because during creation of my site I had over and over again questions to myself - "why I see this content with such value" - after some time I figure out, that my site config.yaml has been enhanced by theme's config.yaml in case of variable absence. Moving forward - Hugo's build-in variables (like for analytics) are not "inherited".
I made also change in exampleSite/config.yaml because I think that Author variable/parameter is not valid parameter in config.yaml - it's valid in theme.toml.

I hope that you like this changes - if so, please accept, if not then don't hesitate to edit or even not approve.
Thank you again for theme.
Best regards,
Łukasz

Hi @lszczygielek , Thank you for spending your time to contribute.

deletion of config.yaml file and content directory.

Your effort is very appreciate But, the demo website is deployed by Netlify. So, we need to add those files and folders.

deletion of author in exampleSite/config.yaml

Thank you for your intimation. I forget to delete the parameter in config file. Please, Add the other files and folder in pull request. Then only I can merge.
Happy coding!

I found repository with netlify deploy https://github.com/themefisher/bigspring-hugo-startup-theme/blob/master/netlify.toml and I tried do same thing - checks passed, but I don't know if changes should be applied in every place. I don't use netlify, so I don't feel strong in netlify.toml modifications. Definitely there is a way to store pure theme and deploy site based on exampleSite.


check repo URLs before creating a new online repo

I had to deal with a shortdump where the user added their package with the url https://github.com/. Then it was not possible start abapgit because zcl_abapgit_url=>name did not parse out rv_name and dumped on the assert.

Also we have to make sure that the repo name is only the name between a "/" and ".git" or the end of the url, because something like this is also recognized as valid: "https://github.com/larshp/" or "https://github.com/larshp".

Ok, something I just learned: git repo urls don't need to have the extension '.git'. So we don't need to edit the regex for repo urls.


[study population - course filrter] crashes on MAAT

go
https://oodikone.helsinki.fi/populations?months=50&semesters=FALL&semesters=SPRING&studyRights={"programme"%3A"KH80_001"}&tag&year=2018
filter not graduated
filter course MAAT-029 Kandidaatin tutkielma
select did not pass from the filter
:fire:

Problem appears to be wider: Generally selecting anything else than passed on any programme and course is likely to :fire:


'Can only use lower 16 bits for requestCode' error on Android

Using version 2.0.2+2 of the plugin and getting this error when tapping the field:
Can only use lower 16 bits for requestCode
Current request code in the plugin:
const val PLACE_AUTOCOMPLETE_REQUEST_CODE = 131071
Similar issues on StackOverflow suggest that the request code should be between 0 and 65535:
https://stackoverflow.com/questions/25529865/java-lang-illegalargumentexception-can-only-use-lower-16-bits-for-requestcode
Is there any current workaround?

Having same problem.

Any Solution yet ??

Fixed in 2.1. Sorry for the delay.


Fixes ex_cifar10_tf.py by changing learning rate from 0.1 to 0.001

I tried running ex_cifar10_tf.py and noticed that the model was not learning.  That is, the printed test accuracy did not change from epoch to epoch.  Changing the learning rate from 0.1 to 0.001 appears to fix the problem.  Note, 0.001 is the learning rate used in the MNIST tutorials.

I've signed the CLA.

LGTM, ok to merge once tests pass

Closes #219


snmpsim: ModuleNotFoundError: No module named 'pyasn1.compat.octets'

Expected behavior
It working :)
Actual behavior
After pyasn1 releases 0.6.1 it broke snmpsim.
This is the same issue as in https://github.com/lextudio/pysnmp/issues/113
$ ./bin/snmpsim-command-responder-lite
Traceback (most recent call last):
  File "/tmp/snmpsim/./bin/snmpsim-command-responder-lite", line 5, in <module>
    from snmpsim.commands.responder_lite import main
  File "/tmp/snmpsim/lib/python3.12/site-packages/snmpsim/commands/responder_lite.py", line 26, in <module>
    from snmpsim import controller
  File "/tmp/snmpsim/lib/python3.12/site-packages/snmpsim/controller.py", line 15, in <module>
    from snmpsim import datafile
  File "/tmp/snmpsim/lib/python3.12/site-packages/snmpsim/datafile.py", line 12, in <module>
    from pyasn1.compat.octets import str2octs
ModuleNotFoundError: No module named 'pyasn1.compat.octets'

Detailed steps
The steps are,
Python package information
snmpsim==1.1.5
Operating system information
Linux
Python information
3.12.3
(Optional) Contents of your test script
No response
Relevant log output
No response

Fixed in release 1.1.6.


Read from stdin

When using ymlio split and no filename is passed or the passed filename equals -, then the tool should read the input file from stdin.

Now it should read from stdin if the passed file name equals -


fix(ui): get/set configuration CC

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 24.579%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
3694

Relevant Lines:
15876

💛  - Coveralls


Added showcasing of userprovided services

Opted for a more general change so the app can work with both a specific service or if the user is just following the guide, then they can just name their service using cloudant somewhere in the name and it will work. This is just to showcase that the app works with user-provided services. It doesn't add any real code functionality to the app. The user can also still write the name of their service if they want to, so that option is still available.

Codecov Report

Merging #16 into master will not change coverage.
The diff coverage is n/a.

@@         Coverage Diff          @@
##           master   #16   +/-   ##
====================================
  Coverage      50%   50%
====================================
  Files           1     1
  Lines           8     8
====================================
  Hits            4     4
  Misses          4     4

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b3be2af...01e49d5. Read the comment docs.

Made the change you requested. As I said in my other reply. The README will be changed. Just not in this pull request.

I just changed the README a little so at least the mapping.json displayed there would be consistent with the app


Update IdentityModel dependencies

Due to an MSRC. https://github.com/aspnet/Security/issues/1082
I'll do a different change for dev since it has already changed to csproj.

Hi @Tratcher, I'm your friendly neighborhood .NET Foundation Pull Request Bot (You can call me DNFBOT). Thanks for your contribution!
You've already signed the contribution license agreement. Thanks!
The agreement was validated by .NET Foundation and real humans are currently evaluating your PR.
TTYL, DNFBOT;

:shipit:


pkg_resources.DistributionNotFound: Pygments>=1.5

$ http httpie.org
Traceback (most recent call last):
File "/usr/bin/http", line 5, in
from pkg_resources import load_entry_point
File "/usr/lib/python2.6/site-packages/pkg_resources.py", line 2655, in
working_set.require(requires)
File "/usr/lib/python2.6/site-packages/pkg_resources.py", line 648, in require
needed = self.resolve(parse_requirements(requirements))
File "/usr/lib/python2.6/site-packages/pkg_resources.py", line 546, in resolve
raise DistributionNotFound(req)
pkg_resources.DistributionNotFound: Pygments>=1.5
here is the install stdout:
sudo pip install --upgrade https://github.com/jkbrzt/httpie/tarball/master
/usr/lib/python2.6/site-packages/pip/vendor/requests/packages/urllib3/util/ssl.py:90: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning.
InsecurePlatformWarning
You are using pip version 7.1.0, however version 7.1.2 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Collecting https://github.com/jkbrzt/httpie/tarball/master
/usr/lib/python2.6/site-packages/pip/vendor/requests/packages/urllib3/util/ssl.py:90: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning.
InsecurePlatformWarning
/usr/lib/python2.6/site-packages/pip/vendor/requests/packages/urllib3/util/ssl.py:90: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning.
InsecurePlatformWarning
Downloading https://github.com/jkbrzt/httpie/tarball/master
| 258kB 4.2MB/s
Collecting requests>=2.3.0 (from httpie==1.0.0-dev)
/usr/lib/python2.6/site-packages/pip/vendor/requests/packages/urllib3/util/ssl.py:90: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning.
InsecurePlatformWarning
Downloading requests-2.8.1-py2.py3-none-any.whl (497kB)
100% |████████████████████████████████| 499kB 872kB/s
Collecting Pygments>=1.5 (from httpie==1.0.0-dev)
Downloading Pygments-2.0.2-py2-none-any.whl (672kB)
100% |████████████████████████████████| 675kB 593kB/s
Collecting argparse>=1.2.1 (from httpie==1.0.0-dev)
Downloading argparse-1.4.0-py2.py3-none-any.whl
Installing collected packages: requests, Pygments, argparse, httpie
Running setup.py install for httpie
Successfully installed Pygments-2.0.2 argparse-1.4.0 httpie-1.0.0.dev0 requests-2.8.1
env:
uname -a
Linux hostname.network  2.6.32-358.14.1.el6.x86_64
cat /etc/centos-release
CentOS release 6.4 (Final)
python --version
Python 2.6.6

resolve it by using easy_install:
sudo easy_install httpie
Searching for httpie
Best match: httpie 0.8.0
Adding httpie 0.8.0 to easy-install.pth file
Installing http script to /usr/local/bin
Using /usr/lib/python2.7/dist-packages
Processing dependencies for httpie
Finished processing dependencies for httpie
kahmed@mars:~$ which http
/usr/local/bin/http
kahmed@mars:~$ http google.com
HTTP/1.1 301 Moved Permanently
Cache-Control: public, max-age=2592000
Content-Length: 219
Content-Type: text/html; charset=UTF-8
Date: Sat, 31 Oct 2015 04:06:07 GMT
Expires: Mon, 30 Nov 2015 04:06:07 GMT
Location: http://www.google.com/
Server: gws
X-Frame-Options: SAMEORIGIN
X-XSS-Protection: 1; mode=block

301 Moved
301 Moved
The document has moved
here.


rename to react-input-children

react-input-link is a weird name (it reminds this.linkState). I think react-input-children would a more clear and general name, do you agree?
@buildo/frontend

:+1: for removing "link" from the name, I can't come up with anything better than -input-children at the moment

:+1:
On Thu, Jan 21, 2016 at 3:28 PM Giovanni Gonzaga<EMAIL_ADDRESS>wrote:

[image: :+1:] for removing "link" from the name, I can't come up with
anything better than -input-children at the moment
—
Reply to this email directly or view it on GitHub
https://github.com/buildo/react-input-link/issues/17#issuecomment-173584699
.


fix sliders

The idea behind sliders as i understand it is you have a start and end circle and a spline connecting both according to control points.
Slider circles are currently not imported correctly, but the basic implementation is there.
Sliders are currently generated with beziér curves, which don't seem to be right. I think today they are done with catmull splines(?).

new plan:
sliders will only be imported as curves and the whole head and tail slider thing is a job for geometry nodes. simple endpoint selection with instance on points and youre good to go. atleast thats the idea.
i still need to find out what slider algorithms are used and when.


[STORM-1032] Add generics to component configuration methods

The getComponentConfiguration methods currently return a simple Map object. In fact they should be returning a Map<String, Object>.
By changing this, it will make it slightly clear what is being returned by the method and potentially pick up some issues at compile time.

+1


[BUG] Program crashes upon loading into a custom game

Describe the bug
After the loading screen when loading into a custom game, LeagueHub will quietly crash
Material
Log:
Crash-2022-02-18-21-16.log
Desktop (please complete the following information):

OS: Win 10
Version 20H2

Was this a spectate game or was it played directly?


@Utils path error

I've been getting this error in my DataContainer.tsx file -  Unable to resolve path to module<EMAIL_ADDRESS>

@Victoria240 you're no longer seeing this error right?

Please reopen if it comes up again!

Please reopen if it comes up again!

Please reopen if it comes up again!


opmsg support | gpg alternative

Hi,
We need opmsg support, the best gpg alternative.
https://github.com/stealth/opmsg
Thanks in advance,

@RainLoop Any explanation?

Unfortunately, I did not get other requests for this functionality from other users.
also:

I do not see much activity around the project.
I do not see the library to work with opmsg in the browser (like OpenPGP.js).

For the time being, you're entirely right.


Setting variables outside state class causing flutter app to lag and crash

Hello,
I was developing my Flutter mobile application a while back, and came across an issue I would like to report. Changing the version to Flutter 2.10.5 fixes the issue, but I would like to use the latest version.
https://stackoverflow.com/questions/74526831/setting-variables-outside-state-class-causing-flutter-app-to-lag-and-crash

Hello @madamoniem. Defining global variables is not recommended. I suggest you use something like InheritedWidget or a state management solution like provider or riverpod to manage global, app level variables.


Enable setting the publisher name

Resolve https://github.com/dotnet/sign/issues/567.
This change renames the existing -pn | --publisher-name option to -dn | --deployment-name.  This option was already setting the deployment name.  Also, this change introduces a new -pn | --publisher-name option for setting publisher name.
CC @clairernovotny

One consideration is changing -dn | --deployment-name to -an | --application-name.
This says the assemblyIdentity.name value "[i]dentifies the human-readable name of the deployment for informational purposes."
mage.exe CLI's help says the value of the corresponding option (-n | -Name) "[s]pecifies the name of the application whose manifest is being generated or updated."
mage.exe documentation says the -n | -Name option "is used to identify the application."

@dtivel
Could you please update PR description? I'm confused what is the exact change here?
According to desc we're renaming -pn | --publisher-name option to -dn | --deployment-name, yet we're re-introducing same -pn | --publisher-name option we just renamed, bit confusing to digest. For me PR looks just adding -an | --application-name option.

Thanks for the review.
Think of this PR as repurposing the existing -pn | --publisher-name option to set publisher name --- since the previous implementation didn't really do that --- and introducing a new option to set application name.


Update id.coffee

Thanks @wabiwabo! Can you sign the CLA so we can merge this in?

@wabiwabo I'm closing this since CLA hasn't been signed. Please feel free to open once you sign the CLA. Thanks


[Editor] Add the ability to make a free highlight (i.e. without having to select some text) (bug 1856218)

The free highlighting is enabled when the mouse pointer isn't on some text. Then we draw a shape with smoothed borders corresponding to the movement of the mouse.
Printing/saving and changing the thickness will come later.

/botio-linux preview

Should this new highlight-mode perhaps use a "custom" cursor (comparing with e.g. the Ink-editor), rather than the default one?

Should this new highlight-mode perhaps use a "custom" cursor (comparing with e.g. the Ink-editor), rather than the default one?

The UI/UX team is already aware about this "problem" and should have a solution for it in the next days.

/botio-linux preview

/botio test


Noetic Dockerfile minor fixes

Made a few minor changes to the Noetic Dockerfile while I was testing tutorials:

Fix formatting, alphabetical order
Add Vim, because I need Vim to do anything
Gazebo installation key no longer hardcoded. It wgets a gazebo.key file, as in the Gazebo installation tutorials.

The static code check is failing on files I didn't touch :sweat_smile: I think that means they are in the reorg branch and will need to be fixed in another PR before we can merge the reorg branch into master.

I'm having trouble getting the Docker version running correctly, so I'm not a good choice to review this one (I'll work with someone offline once the release dust settles to figure out what I'm doing wrong).

I am looking at this, but am not able to get catkin_make to run successfully from the docker container.  @mabelzhang - is it working for you?

It works for me. What's the error you're getting?
Not sure if it makes a difference, but I'm using the code from #120 (I had to make that fix during the build), running in a container from this Dockerfile.

I was able to sort it out.  The problem was that the vcs repository list was still pointing to the original uuv_simulator repo - not our fork, which we updated for Noetic.
I made some additions to your branch in #121

@mabelzhang I made a mess out of this.  I expect that @M1chaelM 's work on a general docker image will alleviate the need for this PR.  Let's put this on hold for now.

I think we can close this now. The 3 original changes have been added to images in the dockwater repo.

I agree that we can close, but I think it is most consistent with our workflow to have the author close as method of concurrence.


Improve the UI of the features section in index.html

please assign this issue to me.

go for it!

@akshitagupta15june ,i was thinking of reducing the height of the cards the the featured section,make the border round,add proper alignment to the buttons and was also thinking of improvng the font used in the card.
are these changes fine or should i add/delete something

Yes you can

Have added a hover effect to the buttons as well,alignment of the buttons is left,will align the buttons and initiate a pr

are these changes fine or should i add anything more,tried increasing the border of the cards but it is not getting applied. @akshitagupta15june

@ritik48 ok I am assigning you

hey @karthiknadar1204,
please review my pr #323


failed to init fresh project by JSR

when I init fresh project follow by https://github.com/denoland/fresh/tree/main/init
deno run -Ar jsr:@fresh/init

throw error
error: Could not find version of '@fresh/init' that matches specified version constraint '*'

There is no public stable release of @fresh/init yet as Fresh 2 isn't released yet. Until we'll make the first public release for the latest tag JSR requires an explicit version:
- deno run -Ar jsr:@fresh/init
+ deno run -Ar jsr<EMAIL_ADDRESS>
Once Fresh 2 is out, this will not be necessary anymore.


wg-netmanager: init at 0.2.8

Motivation for this change
New package wg-netmanager, which maintains a net connected via wireguard
Things done

Built on platform(s)

[X] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.05 Release Notes (or backporting 21.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[ ] Fits CONTRIBUTING.md.

I will create a new pull request with the two commits as requested and an updated version of the package.

FYI: you can modify everything locally and then override what you pushed before with the --force flag in git push.
No need to create a new PR, but I do appreciate the enthusiasm

actually I am not aware of the —force feature.
I only know, how to delete a tag.
Thanks for your hint and guidance


Removed unnecessary uppercase in the Tutorial welcome page

A tiny typo PR that changes "Markup languages" in favor of "markup languages" in the Tutorial's welcome page. It looks weird and every other instance of the word in the documentation is lowercase (except for HTML - HyperText Markup Language, which makes sence since it's an acronym).

Thanks!


spark Java

Is your enhancement request related to a problem? Please describe.
Need help in configuring the tls certs in spark java for consumer code
Describe the solution you'd like
Sample sparkReceiver in java but unable to configure the tls certs
String serviceUrl =  "pulsar+ssl://abc-wss-us-east-1-non.abc.com:1234/";
String inputTopic = "non-persistent://gdfvyv/test-test/ConsumerApproval-Test-Test-3m";
String subscription = "vmb_test";
System.out.println("Parameters:");
System.out.println("\tServiceUrl:\t" + serviceUrl);
System.out.println("\tTopic:\t" + inputTopic);
System.out.println("\tSubscription:\t" + subscription);
SparkConf sparkConf = new SparkConf().setAppName("Pulsar Spark Example");
JavaStreamingContext jsc = new JavaStreamingContext(sparkConf, Durations.seconds(60));
ConsumerConfigurationData<byte[]> pulsarConf = new ConsumerConfigurationData();
Set set = new HashSet();
set.add(inputTopic);
pulsarConf.setTopicNames(set);
pulsarConf.setSubscriptionName(subscription);
SparkStreamingPulsarReceiver pulsarReceiver = new SparkStreamingPulsarReceiver(
serviceUrl,
pulsarConf,
new AuthenticationDisabled());
JavaReceiverInputDStream<byte[]> lineDStream = jsc.receiverStream(pulsarReceiver);
JavaPairDStream<String, Integer> result = lineDStream.flatMap(Consumer::call)
.mapToPair(x -> new Tuple2<String, Integer>((String) x, 1))
.reduceByKey((x, y) -> x + y);
result.print();
jsc.start();
jsc.awaitTermination();
Describe alternatives you've considered
Nothing yet stuck with it
Additional context
Add any other context or screenshots about the feature request here.

Closed as stale and invalid.
If it's still relevant for maintained versions, please open a new issue following the issue form. The information above is weak to be understood.


Add support to create Tanzu Hub client

What this PR does / why we need it

Adds support to create authenticated Tanzu Hub client for the specified tanzu context
The Tanzu Hub client exposes a graphQL client implemented using github.com/Khan/genqlient/graphql to query the hub resources with graphQL APIs.

Which issue(s) this PR fixes

Fixes #
Describe testing done for PR

Release note

Additional information
Special notes for your reviewer

Have you thought about where instructions/tooling pertaining to generation of query stubs from Hub schema should reside.
I am not sure if they fit in plugin-tooling.mk, but some convenient make targets might be worth considering


v1.9 backports 2021-07-05 #2

#16136 -- bpf: fix iptables masquerading for node -> remote pod traffic (@jibi)

Once this PR is merged, you can update the PR labels via:
$ for pr in 16136; do contrib/backporting/set-labels.py $pr done 1.9; done

test-backport-1.9

test-backport-1.9

retest-runtime

k8s-1.17-kernel-5.4 is failing due to a known complexity issue, marking as ready to merge

@jibi Looks like the PR needs a rebase?

test-backport-1.9

test-backport-1.9

test-backport-1.9

Updated the PR to include also https://github.com/cilium/cilium/pull/16381 (which may help with https://github.com/cilium/cilium/issues/16873)

test-backport-1.9

@aanm could you review the backport of #16381 please? :pray:

Hit https://github.com/cilium/cilium/issues/15255 on k8s-1.15-kernel-4.9 (test-1.15-4.9) (kube-dns pod could not be created because of NetworkPlugin cni failed to set up pod "coredns-86cd554449-vxmmz_kube-system" network: unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  range is full)

test-1.15-4.9

Like before, k8s-1.17-kernel-5.4 is failing due to a known complexity issue so marking as ready to merge


Add source coordinates feature

This fixes #10
This pr add support to specify the sourceLatitude and sourceLongitude. If they are set, the apps will receive the correspondent param to use as the source location, instead of using the current user location.
The reason I am adding this is because Google maps app is not selecting the user default location, for some reason.
All supported links generated by the library:
http://maps.apple.com/?saddr=-8.0378585%2C-34.8734846&daddr=-8.1089021%2C-34.8910003&q=Location
comgooglemaps://?api=1&ll=-8.1089021%2C-34.8910003&q=Location&saddr=-8.0378585%2C-34.8734846&daddr=-8.1089021%2C-34.8910003
citymapper://directions?endcoord=-8.1089021%2C-34.8910003&startcoord=-8.0378585%2C-34.8734846
uber://?action=setPickup&dropoff[latitude]=-8.1089021&dropoff[longitude]=-34.8910003&pickup[latitude]=-8.0378585&pickup[longitude]=-34.8734846
lyft://ridetype?id=lyft&destination[latitude]=-8.1089021&destination[longitude]=-34.8910003&pickup[latitude]=-8.0378585&pickup[longitude]=-34.8734846
transit://directions?to=-8.1089021%2C-34.8910003&from=-8.0378585%2C-34.8734846
yandexnavi://build_route_on_map?lat_to=-8.1089021&lon_to=-34.8910003&lat_from=-8.0378585&lon_from=-34.8734846

ps: I tried to add tests to this library but jest is giving me a hard time, so I tested manually.
Another thing I added to the repo is the .editorconfig to prevent bad alignment. Feel free to comment, suggest changes.
@tschoffelen can you take a look? :)

Thanks for the effort! Could you add documentation for these new params to the README? Then I can merge this.

@tschoffelen I guess you saw the readme? :)

@tschoffelen can you generate a new release so we can npm install?

Done<EMAIL_ADDRESS>Thanks again.


SQL homework # 4

What changes are you trying to make? (e.g. Adding or removing code, refactoring existing code, adding reports)
I create queries using COALESCE, Window Functions and Count functions.
What did you learn from the changes you have made?
How to use COALESCE, Window Functions and Count functions.
Was there another approach you were thinking about making? If so, what approach(es) were you thinking of?
N/A
Were there any challenges? If so, what issue(s) did you face? How did you overcome it?
N/A
How were these changes tested?
Run the queries on DB Browser.
A reference to a related issue in your repository (if applicable)
N/A
Checklist

[ X] I can confirm that my changes are working as intended

For HW4, in Window function query, you need to write DENSE_RANK and ROW_NUMBER, rather than window.

HW5 is completed.


Cleanup Buildkite

We're not using this anymore so cleaned up some references to it around the codebase.

Deploy preview for gestalt ready!
Built with commit 3e760f0483d480699dc2f97895423368f776983b
https://deploy-preview-428--gestalt.netlify.com

Warnings

:warning:

:memo: CHANGELOG - Please add a CHANGELOG.md entry for your changes

  Generated by :no_entry_sign: dangerJS


Expose numpy encode and decode

This exposes the numpy encoding on the NDArray class and the decoding on the NDManager class. It also refactors the NDSerializer to use a ByteBufferBackedInputStream (added as a utility) to combine the encoding of input streams and byte buffers

Codecov Report
Attention: 1394 lines in your changes are missing coverage. Please review.

Comparison is base (bb5073f) 72.08% compared to head (4d3e107) 71.98%.
Report is 890 commits behind head on master.

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@             Coverage Diff              @@
##             master    #2803      +/-   ##
============================================
- Coverage     72.08%   71.98%   -0.11%
- Complexity     5126     7102    +1976
============================================
  Files           473      703     +230
  Lines         21970    31687    +9717
  Branches       2351     3279     +928
============================================
+ Hits          15838    22810    +6972
- Misses         4925     7321    +2396
- Partials       1207     1556     +349

Files
Coverage Δ

...ava/ai/djl/inference/streaming/StreamingBlock.java
100.00% <100.00%> (ø)

api/src/main/java/ai/djl/metric/Dimension.java
100.00% <100.00%> (ø)

api/src/main/java/ai/djl/metric/Unit.java
100.00% <100.00%> (ø)

api/src/main/java/ai/djl/modality/audio/Audio.java
100.00% <100.00%> (ø)

api/src/main/java/ai/djl/modality/cv/Image.java
69.23% <ø> (-4.11%)
:arrow_down:

...rc/main/java/ai/djl/modality/cv/MultiBoxPrior.java
76.00% <ø> (ø)

...ava/ai/djl/modality/cv/output/DetectedObjects.java
96.29% <100.00%> (+1.29%)
:arrow_up:

...rc/main/java/ai/djl/modality/cv/output/Joints.java
71.42% <100.00%> (ø)

.../main/java/ai/djl/modality/cv/output/Landmark.java
100.00% <ø> (ø)

...i/djl/modality/cv/transform/RandomResizedCrop.java
94.11% <100.00%> (+5.22%)
:arrow_up:

... and 226 more

... and 373 files with indirect coverage changes

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


[possible bug] no git-gud for git-gud?

I'm trying to git gud at git, and to that end I have installed git-gud.
I understand that in order to use git-gud to git gud at git, I must first git gud at git-gud. However, I was unable to locate any package or commands designed to help me git gud at git-gud specifically.
Is this a bug or by design? I don't understand how I am supposed to git gud at git with git-gud without any help gitting gud at git-gud first.

Glad you're in trying out my project! Git Gud --help should be useful. We are working on levels that introduce the git gud commands and so that when whole thing feels more natural. If you want to install the development version, it will be more up to date with those levels. Install instructions should be in the readme. Comment here with any feedback, I'm glad to have it 🙂


ImportError: libcblas.so.3: cannot open shared object file: No such file or directory

>>> import pyModeS
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/dist-packages/numpy/core/__init__.py", line 23, in <module>
    from . import multiarray
  File "/usr/local/lib/python3.9/dist-packages/numpy/core/multiarray.py", line 10, in <module>
    from . import overrides
  File "/usr/local/lib/python3.9/dist-packages/numpy/core/overrides.py", line 6, in <module>
    from numpy.core._multiarray_umath import (
ImportError: libcblas.so.3: cannot open shared object file: No such file or directory

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python3.9/dist-packages/pyModeS/__init__.py", line 12, in <module>
    from .decoder import adsb
  File "/usr/local/lib/python3.9/dist-packages/pyModeS/decoder/adsb.py", line 19, in <module>
    from pyModeS.decoder.bds.bds05 import (
  File "/usr/local/lib/python3.9/dist-packages/pyModeS/decoder/bds/__init__.py", line 21, in <module>
    import numpy as np
  File "/usr/local/lib/python3.9/dist-packages/numpy/__init__.py", line 144, in <module>
    from . import core
  File "/usr/local/lib/python3.9/dist-packages/numpy/core/__init__.py", line 49, in <module>
    raise ImportError(msg)
ImportError:

IMPORTANT: PLEASE READ THIS FOR ADVICE ON HOW TO SOLVE THIS ISSUE!

Importing the numpy C-extensions failed. This error can happen for
many reasons, often due to issues with your setup or how NumPy was
installed.

We have compiled some common reasons and troubleshooting tips at:

    https://numpy.org/devdocs/user/troubleshooting-importerror.html

Please note and check the following:

  * The Python version is: Python3.9 from "/usr/bin/python"
  * The NumPy version is: "1.22.1"

and make sure that they are the versions you expect.
Please carefully study the documentation linked above for further help.

Original error was: libcblas.so.3: cannot open shared object file: No such file or directory

Fix: sudo apt-get install libatlas-base-dev


Bumped up version with (major?) changes

Changed the import statement for the Image class from PIL to PIL.Image.
Updated the image_comparison function to include a docstring.
Now creates a temporary file path using the os.path.join() function
Updated the height calculation to convert the result to an integer using the int function.
Added a in_memory flag to the image_comparison function to handle pillow to base64 conversion in memory without saving to local.
Simplified the conditional statement in the image_comparison function for checking whether to convert images to base64 strings in memory or from temporary files.
Updated the pillow_local_file_to_base64 function to accept a directory path as a parameter, so that it can save the temporary file in the specified directory.

I believe the error stems from the line(s):
IMAGE_TO_URL = {
    "sample_image_1": "https://user-images.githubusercontent.com/34196005/143309873-c0c1f31c-c42e-4a36-834e-da0a2336bb19.jpg",
    "sample_image_2": "https://user-images.githubusercontent.com/34196005/143309867-42841f5a-9181-4d22-b570-65f90f2da231.jpg",
}

in app.py

Correct. I will have a look tomorrow. Hopefully it gets patched quickly.


Peer Sharing

Objective
Peer Sharing allows to scale the network beside on-chain registered relays.
Implementation plan

[ ] input-output-hk/ouroboros-network#3940

Risks
The release will contain a flag, which can be used to make staged release if decided. The release will include a new mini-protocol, a new network protocol version and new functionality, which will have some impact on changes to the network components.
Dependencies

input-output-hk/ouroboros-network#3886

High level peer sharing design is completed.

Low level peer sharing design is completed


expose got as decorator

Hello,
Do you think it could be possible to expose a more affordable interface in order to prevent get got locked by this package?
This is the thing I have on mind:
const got = require('hooman')(require('got')

It's possible with peer dependencies but anything wrong this locked version to latest?

Jut suggesting because got tends to release new versions very often.
Locking to 11.x version isn't the best approach, they sometimes introduce bug accidentally.
Using the decoratr approach you're moving the responsibility out of the library.

Will provide it as a peer dependency on next version :)

Thanks a lot!