Non-literal list concatenation and sorting: TypeError: t.py_sort is not a function

Hi,
sorting a non-literal concatenated list causes the error: TypeError: t.py_sort is not a function. While the lists are literals, the concatenation is done by variables and the plus operator.
a = [5,6,7]
b = [8,9,10]
t = a + b
t.sort()
print(t)

have you tried t.js_sort() instead?

@vkbsb no, thanks, but I fixed it with some after-processing on the Javascript by changing a + b to a.append(b) while keeping py_sort. I want to keep my code as Pythonic as possible, so I think using a js_sort would defeat that purpose (maybe not for this example, but for others).

@darthglowball You may want to enabe operator overloading when compiling (using -o switch for global, or pragma('opov') for local).

@fzzylogic something happens now, but in Firefox I get the incorrect result [10, 5, 6, 7, 8, 9].

Even with the -o switch, you get a py_sort in the generated code:
(function () {
	var __accu0__ = t;
	return __call__ (__accu0__.py_sort, __accu0__);
}) ();

That doesn't behave like a Python sort (see previous post).

In the transcrypt runtime.js the sort function used is the javascript .sort() (__sort__ function, Line:1976). The problem is that, in javascript, .sort() treats strings and/or numbers as strings and sort alphabetically. To correct this, Line:1976 should be changed from:
iterable.sort ();
to:
iterable.sort ((a,b) => a > b ? 1 : -(1));
Even better would be to change Line:1972 and Line:1976 to use __gt__(a,b) instead of a > b.
@darthglowball incidentally, .py_sort will branch to a code section that does exactly what this fix will do when using the key parameter of the python .sort(). Using t.sort(lambda a:a) will sort correctly.

related to #605

More precisely in transcrypt/modules/org/transcrypt/__runtime__.py:
107|        iterable.sort ()                                            # JavaScript sort
could be :
107|        iterable.sort (lambda a, b: 1 if a > b else -1)
Output:
> [10,1,2,20,9].sort()
 [1, 2, 9, 10, 20]

> ["10","1","2","20","9"].sort()
["1", "10", "2", "20", "9"]

@AlexECX yes, Python t.sort() maps to Javascript t.sort(function(a,b){return a>b}) but while Transcrypt allows a positional or keyword argument in sort, it should be a keyword argument in Python 2.7.16 & 3.7.2.

Currently Transcrypts .sort() maps to Javascript's .sort(), which is why it sorts alphabetically. Mapping it to .sort ((a,b) => a > b ? 1 : -(1)) instead will resolve the sorting order. (Note that .sort(function(a,b){return a>b}) has the same problem, at least in chrome).
I believe the Transcrypt sort() signature is practically the same as Python's (key = None, reverse = False), but currently the arguments are not passed properly (see #687).

@AlexECX you're right about Chrome giving the incorrect result with .sort(function(a,b){return a>b}). Same problem with Opera. Firefox does it correctly. .sort ((a,b) => a > b ? 1 : -(1)) works on all three. Good catch.

More precisely in transcrypt/modules/org/transcrypt/__runtime__.py:
107| iterable.sort () # JavaScript sort could be : 107| iterable.sort (lambda a, b: 1 if a > b else -1)

This has been implemented in the dev_3.9.3 branch to be released in v3.9.3

Merged to master on PR #876


Cow: Watch chokhidhani.com

Cow requests the watch of the watch_keyword chokhidhani\.com. See the MS search here and the Stack Exchange search in text, in URLs, and in code.

Approved by Jeff Schaller in Charcoal HQ


fix a bug in InteractWithInput.php

in InteractWithInput.php we have a method called filled which is for determining if the request contains a non-empty value for an input item.
filled method uses isEmptyString method for doing the job but in filled method we send value of an input for isEmptyString
not the name of input

The failing tests show it was behaving as expected. The variable $value is an array key; it wasn't named $key to avoid conflicting with the method argument.


Readme formatting

Trivial stuff I noticed while scanning.
Very cool project you have here!

Thanks!

Oops, I have push forced a rewrite of the commit as github messed the branch, be careful when rebasing.

Oops, I have push forced a rewrite of the commit as github messed the branch, be careful when rebasing.

Thanks for the warning, though this contribution was fully online. Living in the future is neat. :grinning:


Caddy support for php-fpm

Hi,
It seems Caddy only works with the old CGI implementation (php-cgi). If I try to use the new one (php-fpm) I only get a 502 Bad Gateway error. I have checked the active sockets, so that's not the problem.
Socket: <IP_ADDRESS>:9000 (I have also tried with the Unix Socket)
I would appreciate if I could get confirmation on this, otherwise I'm doing something wrong. Thanks for the attention.
P.S: Linux.

Hmm, I've actually only ever used php-fpm with it. It should work. What does your Caddyfile look like?

Same here, I have only used it with php-fpm. However, I've seen someone on Windows that uses php-cgi without issues too.

Thanks for the answers. This is my Caddyfile:
<IP_ADDRESS>:2015
fastcgi / <IP_ADDRESS>:9000 php

Have you tried connecting with nginx ? Just for confirmation if php-fpm is running correctly.

It's strange. It works in nginx with the following configuration:
server {
    location / {
        fastcgi_pass  localhost:9000;
        fastcgi_param SCRIPT_FILENAME $document_root$fastcgi_script_name;
        fastcgi_param QUERY_STRING    $query_string;
    }
}

But if I take the fastcgi_param lines it stops working. An easy solution would be Caddy to pass these FastCGI params to php-fpm.
I have also managed to get Caddy working with php-fpm without passing the FastCGI params, to do that I had to put the Caddy executable in the nginx document root folder and run it under the user www-data (the same user as php-fpm). So, it seems this is a permission problem, unless those FastCGI params are passed.

Yeah, php-fpm is a beast. You might be able to glean more information from a Caddy error log, if you use errors error.log in your Caddyfile then try a request.
The php preset does configure a couple things related to what nginx does with fastcgi_params, see the docs for fastcgi. Also, try renaming php.php to something else, like test.php... just to experiment.

Caddy error:
18/Jul/2015:09:56:19 -0500 [ERROR 502 /php.php] malformed MIME header line: Primary script unknown
18/Jul/2015:09:56:24 -0500 [ERROR 502 /test.php] malformed MIME header line: Primary script unknown

It seems PHP can't find the script, the same happens with nginx if I change the document root folder to match Caddy's folder. So, looks like a permission issue and not Caddy's problem itself. All files have to be from the user www-data. By the way, I can run Caddy as root to serve the document root folder owned by www-data and it works normally.

Mention what, where, exactly? I'm still not clear as to whether this is a php-fpm, file permissions, or Caddy issue. You aren't able to run Caddy as www-data? Are the error messages always the same?

The issue can be considered resolved as I'm able to run Caddy as www-data and is able to serve the PHP files normally (assuming the files are in a folder owned by www-data too). However, I still have to go deeper in this to see if it's just a permissions problem or the parameters passed by nginx to php-fpm do some difference (the difference between running the PHP script or throwing an error due to insufficient permissions), I just don't have time right now to do that. I will be closing this issue and get back to it once I have time (or someone else that experiences the same problem can give some infomation).

Okay. Thanks for your detective work and answering my questions. :+1: Let me know if there's any other way we can help!

I am experiencing this now too with caddy version 0.7.5. I am a normal user and no dev.
<IP_ADDRESS>:9090
root /root/test
log access.log
errors error.log
fastcgi / /var/run/php.sock php
rewrite {
regexp .*
ext    /
to     /index.php?{query}
}

Nevermind Nixtren. I have finally found out this morning that if i add the user to the group php-fpm all works fine. So for others having the same problem. Add the user that runs Caddy to the php-fpm or hhvm group. Whichever you are using.

Thanks @Prezto for giving out information on how you fixed it :)

Yes. All files are owned by the user/group hhvm/php-fpm. I have tested with both phpfpm and hhvm and both work fine.

@Nixtren how exactly did you run Caddy as www-data? I've also come across this problem :(

I found the answer, you need a space after your content-type:
I was having the same problem with C# playing around.


ConcurrentModificationException when requesting the database size

OrientDB Version: v2.2.2
Java Version: Java 8 Update 111
OS: macOS Sierra 10.12.2
My app uses OrientJS  to communicate with OrientDB using the REST API.
Their both run on the same machine, and there is only one single OrientDB instance.
Expected behavior
Return the size of the database
Actual behavior
Sometimes it return the db size, but sometimes there is:
 Error executing request
java.util.ConcurrentModificationException
  at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:901)
  at java.util.ArrayList$Itr.next(ArrayList.java:851)
  at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.getSize(OAbstractPaginatedStorage.java:2347)
  at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.sizeDatabase(ONetworkProtocolBinary.java:1069)
  at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.executeRequest(ONetworkProtocolBinary.java:373)
  at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.execute(ONetworkProtocolBinary.java:199)
  at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:77)

Steps to reproduce
What my app does is upserting +20k items in the database (using the rest api) while regularly asking for the db size at the same time, in parallel. Sometimes it works, sometimes there is this exception.
Is that allowed/possible? or is there another way?

Fixed in 2.2.x branch. it will be part of the next 2.2.17, but you can already use a build from the branch 2.2.x. Thanks.

woa! thank you! :)


Downgrade Netty version 4.1 -> 4.0

Because of #4390 and the problems with client: https://github.com/druid-io/druid/pull/4973#issuecomment-342958133, I agree now that it's better to downgrade, as was suggested here: https://github.com/druid-io/druid/issues/4390#issuecomment-307913911

@leventov should we backport this?

If it passes tests...

👍  after testing

@leventov not sure why this PR has a design review tag? seems to me we are reverting to the known working version of Netty.

LGTM.

:+1:
a little late to review but we deployed this patch and can confirm that it fixes the problem mentioned in https://github.com/druid-io/druid/pull/4973#issuecomment-342958133


Nmap unique causes freeze, then issue when re-scaning

Got the Nmap issue with --unique command, I have newest nmap installed. This causes script to stop.
Then abort and when rescanning
./scan4all -list ~/recon/httpx.txt -o scan4-test.txt
2022/08/03 08:02:37 wait for init config files ...
2022/08/03 08:02:37 Init2 k-v db cannot open multiple processes at the same time, or please delete the .DbCache directory and try again: Cannot acquire directory lock on ".DbCache".  Another process is using this Badger database.: resource temporarily unavailable
2022/08/03 08:02:37 init config files is over .
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x14a pc=0xa28214]
goroutine 1 [running]:
github.com/dgraph-io/badger.(*DB).View(0x2418da0?, 0xc00091fe48)
/home/runner/work/scan4all/scan4all/vendor/github.com/dgraph-io/badger/txn.go:676 +0x34
github.com/hktalent/scan4all/lib/util.(*KvDbOp).Get(0x21262c9?, {0x205fbaa?, 0x351dbc0?})
/home/runner/work/scan4all/scan4all/lib/util/kvDb.go:75 +0x71
github.com/hktalent/scan4all/brute.init.2.func1()
/home/runner/work/scan4all/scan4all/brute/fuzzAI.go:51 +0x16f
github.com/hktalent/scan4all/lib/util.DoInit(0x4?)
/home/runner/work/scan4all/scan4all/lib/util/config.go:417 +0xb6
main.main()
/home/runner/work/scan4all/scan4all/main.go:23 +0x5d

ls -la reveales .Dbcache dir but its not obvious to everyone.

Re-running gives nmap issues again.
./scan4all -list ~/recon/httpx.txt -o scan4-test.txt
2022/08/03 08:07:18 wait for init config files ...
2022/08/03 08:07:18 init config files is over .
2022/08/03 08:07:18 DbName  config/scan4all_db
2022/08/03 08:07:19 wait for all threads to end
Starting Nmap 7.80 ( https://nmap.org ) at 2022-08-03 08:07 CEST
Read data files from: /usr/bin/../share/nmap
Nmap done: 0 IP addresses (0 hosts up) scanned in 0.92 seconds
Raw packets sent: 0 (0B) | Rcvd: 0 (0B)
WARNING: No targets were specified, so 0 hosts scanned.
[INF] Running SYN scan with CAP_NET_RAW privileges
[INF] Port scan starting....
nmap: unrecognized option '--unique'
See the output of nmap -h for a summary of options.

1、rm -rf .DbCache
2、change config.json
rm --unique
or update your mmap to new latest

Nmap is the latest I just told you that

Mac OS
$ nmap -v
Starting Nmap 7.92


Should we (continue to) implicitly add @SORT when Reference.read(...) is invoked

One open question has to do with the Reference.read(limit) function which implicitly adds a sort key to the uri if none existed in the reference. This therefore carries through to the resulting page because the sort key is necessary for the Page.next or .previous. For instance, @AFTER(...) can only be used in combination with @SORT(...). This seems a bit questionable but may be okay for now. The issue is that we are implicitly and covertly altering the effective URI used in the read, and subsequently we are implicitly and overtly modifying the next/previous URIs to have the sort key on them. This "works" under current assumptions, that the client will just keep reading from the next/previous manner and doesn't mind having the sort key added implicitly.
What if the client calls a delete on the altered reference? I'm not sure what ERMrest does when a delete URL includes a @SORT or @BEFORE parameter. Maybe it doesn't matter. Maybe it does and if so we can strip them off (again implicitly)? Just something to note and look into.

Hmm, a reference to a recordset using paging and a reference to a single record should not get mixed up. I think it would be a mistake to call DELETE on a recordset from our apps until we get something much more sophisticated as far as UX.
The logic about adding sort and paging could check for whether we have a unique key predicate and treat that case differently, i.e. don't offer prev/next references and don't add paging modifiers to the URL.
We need that sort of unique entity reference test anyway, in order for recordedit to know whether it should be in record submission, record edit, or exception case.

stale


sqlite memory table getting dropped "no such table" (incl. repro)

UPDATE minimal repro included
It appears that after some time of doing nothing, the in memory sqlite table is getting dropped. Drop is not getting run on SqlitePool, so I'm not sure why this would happen. sqlx::migrate! is being run on startup that handles creating the tables.
        let inner = SqlitePool::connect(std::env::var("DATABASE_URL")?).await?;
        sqlx::migrate!("../../migrations").run(&inner).await?;

2022-01-21T21:27:14.641362Z  INFO sqlx::query: , SELECT * FROM leases …; rows: 1, elapsed: 230.457µs

SELECT
  *
FROM
  leases
WHERE
   ip = ?1

2022-01-21T21:27:14.641439Z TRACE storage: , found reserved-- leasing address
2022-01-21T21:27:14.643218Z  INFO sqlx::query: , UPDATE leases SET leased …; rows: 0, elapsed: 206.291µs
UPDATE
  leases
SET
   leased = ?2,
   client_id = ?3,
  expires_at = ?4
WHERE
  ip = ?1

after some time:
 2022-01-21T22:17:59.653615Z  INFO sqlx::query: , PRAGMA page_size = 4096; …; rows: 2, elapsed: 707.390µs

 PRAGMA page_size = 4096;
 PRAGMA locking_mode = NORMAL;
 PRAGMA journal_mode = WAL;
 PRAGMA foreign_keys = ON;
 PRAGMA synchronous = FULL;
 PRAGMA auto_vacuum = NONE;

2022-01-21T22:17:59.654604Z  INFO sqlx::query: , SELECT * FROM leases …; rows: 0, elapsed: 134.896µs

 SELECT
   *
 FROM
  leases
 WHERE
   ip = ?1

2022-01-21T22:17:59.654692Z ERROR leases: , err: Database(SqliteError { code: 1, message: "no such table: leases" })

It seems like perhaps somewhere under the hood all connections to the database are getting close() called on them see here.
I can try to come up with a minimal reproduce case for this, but I wanted to put this out there to see if anyone had ideas. It seems to take about 30 mins or so for the table to be dropped so it takes a while to test. Any ideas for where to look to narrow this down? It happens even if I start up, run a single query

The default configuration of the pool regularly closes connections if they are idle too long. If all connections are closed against an in-memory database with a shared cache, the data will be lost. This is certainly what's happening as the default idle timeout is only 5 minutes.
You can remedy this by setting idle_timeout and max_lifetime to None: https://docs.rs/sqlx/latest/sqlx/pool/struct.PoolOptions.html#method.max_lifetime
let inner = sqlx::pool::PoolOptions::new()
    .max_lifetime(None)
    .idle_timeout(None)
    .connect(&std::env::var("DATABASE_URL")?)
    .await?;

You can also try setting min_connections to a value greater than zero, although currently the pool doesn't do a great job of enforcing this; all it really governs is how many connections the pool opens up-front and the minimum it leaves in the idle queue when it reaps connections due to max_lifetime/idle_timeout.

Alternatively, instead of an in-memory database you could use a tempfile-based database like that shown at the end of this comment: https://github.com/launchbadge/sqlx/issues/1647#issuecomment-1020706569

If you think there's an appropriate place for it, then by all means. Maybe the FAQ, although I don't want to get in the habit of filling that doc with random tidbits.
Or maybe on the typedef SqlitePool: https://docs.rs/sqlx/latest/sqlx/type.SqlitePool.html


Duplicate webmention for domain with different capitalization

This is minor and quite an edge case, seemingly due to my odd, stylized capitalization. :) This backfeed contains my target URL twice, once with the domain lowercase and once with my stylized capitalization, so I received two webmentions.
I don't think this has happened with other likes. I'm guessing it's because I included the backlink (lowercase) in the first one, and Bridgy is using my domain (capitalized) from Twitter to complete the permalink from my feed.

interesting! thanks for the report. you're right, path and query params are case sensitive, but domain names aren't, and we're probably not handling that right.
i take it you also don't de-dupe? :P http://gregorlove.com/2015/10/ive-added-event-posts-to/ totally up to you, of course. we'll still fix this!
this was also a fun 5-minute nerd snipe: modern unicode domain names are case insensitive just like old school ascii domain names.

http://unicode.org/faq/idn.html#6
https://tools.ietf.org/html/rfc4343#section-5

I de-dupe, but not properly apparently. :) My primary key for a webmention is md5(source, target). I think I'll fix it by using the target path instead of full URL.


[Feat] Add no_tag filtering option for pipelines

Description

This PR adds a no_tag filtering option on the /pipelines page.
How Has This Been Tested?

Checklist

[x] The PR is tagged with proper labels (bug, enhancement, feature, documentation)
[x] I have performed a self-review of my own code
[ ] I have added unit tests that prove my fix is effective or that my feature works
[x] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation

cc: @johnson-mage

@edmondwinston You can install the ESLint extension in VSCode to catch minor linting issues like missing semicolons.

When including a no_tag filter plus some other tags, we would expect the pipelines without tags to be included, as well as the pipelines with the selected tags. It looks like if you include the no_tag filter plus some other tag, no pipelines will be displayed in the UI.

@edmondwinston Sorry to take over the PR. There were several changes that I thought should be made, but it would've taken a lot longer to go through every one, so I thought it'd be easier if you saw the diff after I committed the changes to get an idea of what I was thinking.

No worries boss, I truly learnt a lot.


Passwordless auth works, but token collection is empty

I’ve recently implemented Passwordless on my site. The system works: I can use req.user to retrieve the verified email of the visitor. However, I’ve connected to my MongoDB database and noticed the the token collection has a size of 0, despite dozens of successful logins.
My code:
var PassStore = require('passwordless-mongostore');
var url = require('./mongodb-url'); // this URL is used across my app and works

passwordless.init(new PassStore(url, { mongostore: { collection: 'tokens' }}));

The ‘tokens’ collection seems to be empty:

Is the size supposed to be zero? Maybe because it’s encrypted, so it’s invisible?

I think it's great that you started digging into it and try to understand what's happening under the hood! The behavior is indeed the expected one - even though it might be counterintuitive. The tokens are deleted after they've been used. As the tokens are equivalent to passwords we don't want them to stay around forever risking e.g., a breach of the email account of the user.
In some cases people want the tokens to be valid for several logins or a longer time. That can be set here:

https://passwordless.net/deepdive#allow-token-reuse
https://passwordless.net/deepdive#modify-lifetime-of-a-token

If you want to check the current behavior just use our interface to generate a new token. If you then query your database you should see one new entry. After then clicking on the token and logging in the token should disappear from the database!
Hope that helps!

Aaah, I see. They’re only stored temporarily, because they’re no longer valid after the user has used them. Makes sense!


ASP.NET_SessionId

Hi, its not an issue with the project, i was just wondering how do you bypass the ASP.NET_SessionId. Doing an api for a project i'm stuck on this, it expire and change and i don't know how you got away with this, because you use only __RequestVerificationToken and a post request need more information.

how do you bypass the ASP.NET_SessionId

I don't believe it's required for a call to their backend. The __RequestVerificationToken found in cookies changes from time to time, so I assume it's based off the ASP.NET_SessionId. I haven't looked, but if you poke around the JavaScript code a beforeSend may set this up.

it expire and change

While the session may expire, it appears both the token generated from the session and form are still valid. I'm still using token from the beginning of this year. Keep in mind you'll have to use form tokens from the same session they were generated in. Both tokens contain anti-XSRF token within and must match when extracted. More on token validation.

Thanks for the quick response,
I know the token doesn't expire often it stay the same but the asp.net_sessionid does and i can't make a request without it.
Let me be more clear, I'm making a post request on GetWorldMarketSubList for instance here is the most important part of my request in c# :
I send a POST request to : http://marketweb-eu.blackdesertonline.com/Home/GetWorldMarketSubList
request.Headers.TryAddWithoutValidation("Cookie", "ASP.NET_SessionId=asp_sess; __RequestVerificationToken=token");
request.Content = new StringContent("__RequestVerificationToken=cookie&mainKey=12031");
If i don't mention the asp.net_sessionid i get the following error : {"resultCode":2000,"resultMsg":"TRADE_MARKET_ERROR_MSG_UNAUTHORIZED","redirectUrl":"https://account.playkakaogames.com/oauth/blackdesert/authorize?client_id=bdo_central_market_web-eu-live\u0026response_type=code"}
I have to update very often the asp.net_sessionid for it to work so i don't understand how you do it, can you send me the type of request you are sending for it to work, like curl bash request for example.
I really appreciate your time and effort to help me.

request.Headers.TryAddWithoutValidation("Cookie", "ASP.NET_SessionId=asp_sess; __RequestVerificationToken=token");
request.Content = new StringContent("__RequestVerificationToken=cookie&mainKey=12031");

If there's complete minimal code to reproduce I could look into it more.
curl --location --request POST 'https://marketweb-eu.blackdesertonline.com/Home/GetWorldMarketSubList' \
--header 'Cookie: __RequestVerificationToken=<TOKEN>' \
--header 'User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.130 Safari/537.36' \
--form '__RequestVerificationToken=<TOKEN>' \
--form 'mainKey=5804' \
--form 'usingCleint=0'

Hi, thanks for the reply
I have just tried your request and it doesn't work i have the same error :
{"resultCode":2000,"resultMsg":"TRADE_MARKET_ERROR_MSG_UNAUTHORIZED","redirectUrl":"https://account.playkakaogames.com/oauth/blackdesert/authorize?client_id=bdo_central_market_web-eu-live\u0026response_type=code"}
When i don't mention asp.net_sessionid i always get this error when i mention it everything works.
Can you send me a curl that work on https://reqbin.com/curl where it return sublist info if you don't mind because i can't find a way to get around it.
Thank you by advance.

Thanks, i have fixed my problem thanks to you.
The issue was this curl option : "-H 'X-Requested-With: XMLHttpRequest' " this was forcing ajax request and needed me to specify asp.net_sessionid removing it fixed everything.
Thanks for your time!


Introduce DataFetcher configuration helpers

ArtifactRepositoryDataWiring is very good example about wiring graphql query to spring data query interface.
I wonder how we like the idea of auto wiring the spring data repo. it is like below:
Assume I can get the repo->graphql binding info from properties or annotation.
binding.get("findAll") will give me graphql query and parameters if any . We just wiring it here. For user defined repo method. We need reflection to wire properly
It should works with most spring data project. Let me know whether this interest you please. Thanks!
  public class AutoDataWiring implements RuntimeWiringCustomizer {

    private final CrudRepository repository;
    private final Map<String, List<String>> binding;

    /**
     * @param repository
     * @param binding,   spring data repo method name -> list of  [query name,parameter1, parameter2...], could use a customer Type instead of List to hold more information.
     */
    public AutoDataWiring(CrudRepository repository, Map<String, List<String>> binding) {
        this.repository = repository;
        this.binding = binding;
    }

    @Override
    public void customize(RuntimeWiring.Builder builder) {
        try {
            // user defined query method
            Method findBySomethingMethod = repository.getClass().getMethod("findBySomething", String.class, String.class);

            builder.type("QueryType", typeWiring -> typeWiring
// todo: do it properly using reflection.
                    .dataFetcher(binding.get("findAll").get(0), env -> this.repository.findAll())
                    .dataFetcher(binding.get("findById").get(0), env ->
                            this.repository.findById(env.getArgument(binding.get("findById").get(1)))
                    ).dataFetcher(binding.get("findBySomething").get(0), env ->
                            findBySomethingMethod.invoke(repository, env.getArgument(binding.get("findBySomething").get(1)), env.getArgument(binding.get("findBySomething").get(2)))
                    ));
        } catch (NoSuchMethodException e) {
            e.printStackTrace();
        }

    }
  }

I think that relying to much on configuration properties (or "programming by configuration properties") can be a trap we don't want to fall into. Maintenance and IDE support is going to be really hard on that one and developers might have to debug this during startup time, and things are likely to break each time code is refactored in the user application.
Today Rossen, Andreas an I briefly discussed that topic and I'll try to start a discussion thread here.
There are cases where the wiring is pretty simple and we could make things easier or provide higher abstractions. I've looked at Resolvers and that approach seems nice.
Of course this comes with drawbacks, like the fact that tying your schema types to your domain types is not always straightforward: GraphQL supports traits and unions, which are not easy to map in Java. Also, there are many cases where we need more information about the query context - we could easily end up requiring the full DataFetchingEnvironment there.
With Spring having access to the configured JSON Encoder and Decoder, we could still try and provide concrete Java types instead of map-like types as inputs there.
Overall we might have an opportunity to make some cases easier, as long as we don't make the current DataFetcher definition harder.

Thanks for the feedback.
Actually I thought about annotating spring bean(or spring repo interface) method with @Graphql-query(name=****) or use implicit name match( like Resolvers did).
But let's make one step backward. I can see we may be able to make a simple scenario easier. But much work needed to address complex scenarios. This will question why we need to spend time on those scenarios  if it's simple enough.
Feel free to park it if we don't see good value.

According to the GraphQL Java docs, the type registration should be moved to CodeRegistry, I think Spring GraphQL should add a customizer for GraphQLCodeRegistry.

@russellyou between the Querydsl support and annotated controllers I'm wondering, from your perspective, if there is anything that remains or can we close this?

Thanks for following up . I believe this issue is out of date as the new release.  Very good work BTW.


Update the Modal and add two prompt components

Update the Modal and add two prompt components
Overview
This PR updates the modal to use the React Aria library and adds two prompt components: AlertPrompt and ConfirmationPrompt.

Designs

AlertPrompt
ConfirmationPrompt

In the designs, the colour of the grey button is lighter, though the Button component only provides a darker shade of grey. I suppose the designers added this variant of the button after we implemented the component.
If you think it's necessary, I see no problem in adding a third variant (tertiary) and using it in the prompts.
Testing instructions
You can test the components in Storybook.

Well, if you have multiple alert prompts in the UI, you will need a component otherwise you'll duplicate code. I also don't believe there will more than two actions, but you're right, we never know.
I've removed the AlertPrompt component now.

@pablopareja I moved the types as you suggested.
Regarding your general comment, I think you confused the AlertPrompt and ConfirmationPrompt components. The one you're looking for it ConfirmationPrompt. I deleted the other one anyway following Miguel's comment.

Cool, thanks! 🙌
Let's merge it 🔨


[Help]: Error with compute_reframe(AOI)

I am running the Lake Sarez Landslides script, but using my own set of images in other area. I am using 287 S1 products. I have created the AOI as:
geojson = '''
{
  "type": "Feature",
  "geometry": {
    "type": "Point",
    "coordinates": [-0.6929, 38.2841]
  },
  "properties": {}
}
'''
BUFFER = 0.1
AOI = gpd.GeoDataFrame.from_features([json.loads(geojson)])
AOI['geometry'] = AOI.buffer(BUFFER)

But there is an error with SAT_llr2rat() function when running compure_reframe(AOI):
.
.
.
Tiles Parallel Downloading: 100%|████████████████████████████████| 1/1 [00:02<00:00,  2.78s/it]
NOTE: auto set reference scene 2017-01-06. You can change it like Stack.set_reference("2022-01-20")
Reframing:  18%|████████▏                                     | 51/287 [02:34<11:53,  3.02s/it]
joblib.externals.loky.process_executor._RemoteTraceback:
"""
Traceback (most recent call last):
  File "/home/tidop/anaconda3/envs/pygmtsar/lib/python3.10/site-packages/joblib/externals/loky/process_executor.py", line 463, in _process_worker
    r = call_item()
  File "/home/tidop/anaconda3/envs/pygmtsar/lib/python3.10/site-packages/joblib/externals/loky/process_executor.py", line 291, in __call__
    return self.fn(*self.args, **self.kwargs)
  File "/home/tidop/anaconda3/envs/pygmtsar/lib/python3.10/site-packages/joblib/parallel.py", line 589, in __call__
    return [func(*args, **kwargs)
  File "/home/tidop/anaconda3/envs/pygmtsar/lib/python3.10/site-packages/joblib/parallel.py", line 589, in <listcomp>
    return [func(*args, **kwargs)
  File "/home/tidop/anaconda3/envs/pygmtsar/lib/python3.10/site-packages/pygmtsar/Stack_reframe.py", line 87, in _reframe_subswath
    tmpazi_a = prm.SAT_llt2rat([geometry.coords[0][0],  geometry.coords[0][1],  0], precise=1, debug=debug)[1]
IndexError: index 1 is out of bounds for axis 0 with size 0
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/tidop/Documentos/PYTHON_SCRIPTS/test_pygmtsar03-FIXED.py", line 446, in <module>
    sbas.compute_reframe(AOI)
  File "/home/tidop/anaconda3/envs/pygmtsar/lib/python3.10/site-packages/pygmtsar/Stack_reframe.py", line 189, in compute_reframe
    records = joblib.Parallel(n_jobs=n_jobs, backend=joblib_backend)(joblib.delayed(self._reframe_subswath)\
  File "/home/tidop/anaconda3/envs/pygmtsar/lib/python3.10/site-packages/joblib/parallel.py", line 1952, in __call__
    return output if self.return_generator else list(output)
  File "/home/tidop/anaconda3/envs/pygmtsar/lib/python3.10/site-packages/joblib/parallel.py", line 1595, in _get_outputs
    yield from self._retrieve()
  File "/home/tidop/anaconda3/envs/pygmtsar/lib/python3.10/site-packages/joblib/parallel.py", line 1699, in _retrieve
    self._raise_error_fast()
  File "/home/tidop/anaconda3/envs/pygmtsar/lib/python3.10/site-packages/joblib/parallel.py", line 1734, in _raise_error_fast
    error_job.get_result(self.timeout)
  File "/home/tidop/anaconda3/envs/pygmtsar/lib/python3.10/site-packages/joblib/parallel.py", line 736, in get_result
    return self._return_or_raise()
  File "/home/tidop/anaconda3/envs/pygmtsar/lib/python3.10/site-packages/joblib/parallel.py", line 754, in _return_or_raise
    raise self._result
IndexError: index 1 is out of bounds for axis 0 with size 0

Also, I encounter a warning when downloading, that may affect:
ASF Downloading POEORB Orbits:  17%|████▌                     | 50/287 [02:16<10:46,  2.73s/it]
('Connection broken: IncompleteRead(4144906 bytes read, 264817 more expected)', IncompleteRead(4144906 bytes read, 264817 more expected))

Thanks!

Processing is not possible when orbits or DEM files are incomplete or invalid. You have to re-download your orbits to fix the problem.


Add EKS version to status

What problem are you facing?

Currently, only the platform_version is outputted. The Kubernetes version number would be helpful to act as the observed version of the Cluster to patch the NodeGroup accordingly. Without it, we need to rely on the version passed from the Claim but changing this value results in the cluster and the node pool being upgraded simultaneously, which makes the node pool fail because the control plane is not yet updated.
How could Official AWS Provider help solve your problem?

The version is defined on ClusterObservation but for some reason is not defined on the CRD
https://github.com/upbound/provider-aws/blob/081290dd63225cb443511fe20a9e909994459d7b/apis/eks/v1beta1/zz_cluster_types.go#L79
https://github.com/upbound/provider-aws/blob/081290dd63225cb443511fe20a9e909994459d7b/package/crds/eks.aws.upbound.io_clusters.yaml#L679

Hi @clementblaise !
version is normally a Terraform argument, i.e., it’s available under spec.forProvider in the generated MR (Cluster.eks). But with the introduction of the observe-only resources, we now report most Terraform arguments also under status.atProvider (so that clients can observe the values of these arguments from status).
The version field is available under status.atProvider (due to the observe-only changes). The generated CRD have that field in its schema: https://github.com/upbound/provider-aws/blob/081290dd63225cb443511fe20a9e909994459d7b/package/crds/eks.aws.upbound.io_clusters.yaml#L868
Actually the generated CRD schema has status.atProvider.version.
This is a new change that we introduced with the support for observe-only resources (the ObserveOnly management policy, here we can reference the relevant design doc: https://github.com/crossplane/crossplane/blob/master/design/design-doc-observe-only-resources.md#proposal).
So need to clarify did you specify a version at spec.forProvider explicitly? version is optional, and if not specified the latest available version is used. If you don’t specify a version at spec.forProvider then it’s expected because we do not late-initialize after an import.

@svscheg Thank you for the response. I am not talking about the version set in spec.forProvider but the actual version of the cluster which shows up in the AWS Console.
The reason is that when you do an update, the spec.forProvider version it will differ for a short time from the actual one or be observed while the control plane is upgrading.

Hi @clementblaise !
Seems we speak about the same status.atProvider.version attribute, so let me add more information about it:

The generated CRD schema has status.atProvider.version
https://github.com/upbound/provider-aws/blob/081290dd63225cb443511fe20a9e909994459d7b/package/crds/eks.aws.upbound.io_clusters.yaml#L868 (as I can see it is the same attribute status.atProvider.version - https://github.com/crossplane-contrib/provider-aws/blob/d45413992bf1d949751593d5ace3a0e015bc9ad7/package/crds/eks.aws.crossplane.io_clusters.yaml#L816-L819)
this is a new change that we introduced with the support for observe-only resources - https://github.com/crossplane/crossplane/blob/master/design/design-doc-observe-only-resources.md#proposal

If we do not specify a version at spec.forProvider  version field will not  be available under status.atProvider and it’s expected because we do not late-initialize after an import. Late-initialization is the setting of previously unset spec fields from the observed values of the external resource. For example, even if you don’t specify spec.forProvider.version, the cloud provider (AWS) determines the latest available Kubernetes API version and sets it, and with late-initialization, upjet sets the uninitialized spec.forProvider.version to the value observed from the external resource. But this is currently not done for status.atProvider (late-initialization is conventionally for spec fields, here’s a reference from the Kubernetes API conventions.).

We may also propose a workaround - patching from spec.forProvider.version instead of status.atProvider.version. Could you please try it and let me know if I am wrong and it can't help you?

I recently updated the provider to v.0.35.0, which now shows the accurate observed version for status.atProvider.version. I could also use the versionRef, which didn't work previously.

Thanks a lot for confirming this @clementblaise!! 🙇♂


Effective Dart style.

Describe the bug
Would it be possible follow effective dart style guides.
Screenshots

Version
version: 2.4.1

I'll try to manage my time for this. thank you for the suggestion

@hiranthaR Hi again.
I found one bug to. Most of API providers use word get in their json files you can see in my bild example. And when your extension generate code his create String value with name get which is reserved by system. I recommend to regenerate this to example: class Products {} generate String getProtucts instead String get.

@hiranthaR  Hi,
I have updated your app syntax.ts file and you can see how was before and after update.
Before:

After:

And now all generated files by your extension is full supported Effective Dart: Style and friendly with expert developers :)
No more List<Null>warning and all reserved values by syntax are regenerated automatically. You can see in the example what it looks like.
Planning add automatic identification of DateTime and copyWith();

Today added copyWith(); method. User can choose before generating files :)

@iamarnas hi, I fixed others without copyWith function. I'll do it another day. can you check your requirements are satisfied?

@hiranthaR Nice, I'll do it.  I did not expect you to fix it so quickly.  That's why I updated your extension it myself :) If you are interested I can share to you my changes. I have advanced syntax formatting it detect when needs expression function or block function very correct to dartfmt.  And planning to add for to ask user if he want use immutable classes or not. Because for now only with Equatable creates immutable classes. It should be more flexible.

@iamarnas oh sorry. I didn't know that. sure open a PR. I'll revert my commits and publish yours. It's totally fine.

@hiranthaR  Hi,
Here is your result after new update :)

remove const from the constructor for now. It's not immutable class and it will show lint error for all created classes. That why I want add function to ask users if they want use @immutable classes. Leave me to fix all Dart languages guide lines becouse im pedantic Dart user ;)

I think we are better to go with your changes

@hiranthaR  Hi. Opened a PR. Just needs update the readme-file after new changes. And here your English is better than mine :)

How it looks syntax after update.


Unmet peer dependency

I'm trying to install react-semantify in a fresh react-boilerplate project, node 6.0.0/npm 3.9 but I get the following error:
$ npm install react-semantify
├──<EMAIL_ADDRESS>extraneous
└── UNMET PEER DEPENDENCY<EMAIL_ADDRESS>
Confusingly<EMAIL_ADDRESS>is installed in node_modules. As the correct version of webpack does appear to be installed I'm not sure what more could be done.

Steps to reproduce:
$ git clone https://github.com/opsb/react-semantify-install-issue
$ npm install react-semantify

That repo is a vanilla react-bootstrap project with the webpack dependency upgraded to 2.1.0-beta.7


remove f-cking useless whitespaces

I know, I know ... it's just a f-cking OCD, but my IDE highlights it.

OCDs are good for keeping the code tidy! Thanks!


Equipment

In GitLab by @Asacolips on Apr 22, 2020, 13:43
Add additional fields to equipment

Uses
Magic Item
Item Type
Tags

In GitLab by @Asacolips on Apr 23, 2020, 19:10
closed


Model retaining state

I wasn't sure if this is an issue with AutoAWQ or the model but after investigating the issue further, I am thinking that it might have to do with AutoAWQ. The reason is that when I use GPTQ models, I don't experience this problem.
I have tried to run a few models with AWQ on google Colab free GPU:
These include:
"TheBloke/Mistral-7B-SciPhi-32k-AWQ"
"TheBloke/zephyr-7B-beta-AWQ"
"TheBloke/Mistral-7B-OpenOrca-AWQ"
"/TheBloke/Mistral-7B-Instruct-v0.1-AWQ"
For all of them I am using the following code to load the models:
model = AutoAWQForCausalLM.from_quantized(model_name_or_path, fuse_layers=True,
                                          trust_remote_code=False, safetensors=True)
tokenizer = AutoTokenizer.from_pretrained(model_name_or_path, trust_remote_code=False)

When I provide the models with a prompt, the model keeps track of previous prompts without me specifying any memory.
Here is the code:
print("\n\n*** Generate:")

tokens = tokenizer(
    prompt_template,
    return_tensors='pt'
).input_ids.cuda()

prompt_tokens = tokenizer(
    prompt,
    return_tensors='pt'
).input_ids.cuda()
len_token = len(prompt_tokens[0])
print(f'Prompt has {len_token} tokens')
# Generate output
generation_output = model.generate(
    tokens,
    do_sample=True,
    temperature=0.001,
    top_p=0.95,
    top_k=5,
    max_new_tokens=512#len_token
)

print("Output: ", tokenizer.decode(generation_output[0]))`

And if I provide the following prompts:
prompt 1 = 'Samurai used to be a very profitable business 32uejoa and they asd394u lived in Jopan'
I had intentionally misspelled Japan to see if the model is retaining memory.
prompt 2 is a technical prompt and here is the output after prompt 2. As it is clear, the reply includes references to the first prompt

This is likely due to caching in the fused modules. We save your previous tokens in the cache and use that for future inference. What happens if you do fuse_layers=False?

@casper-hansen Thanks for the prompt reply.
fuse_layers=False resolved the problem.
Do you mind explaining a little about what fuse_layers does? I couldn't find much info by doing google search.
and could you please explain how to do this:

It should be possible to implement disabling this behavior while still using the fused modules. You would have to reset the cache after every generation.

All previous tokens are put into a cache to reuse them in future generation. However, instead of “memorizing” these tokens for every turn, I could wipe the cache at the end of a generation. If you read the fused module called WindowedCache, you can find how it works.

I suppose you are talking about this file:
Fused Cache
But from this code is not clear how to:

...wipe the cache at the end of a generation
Can you please tell me how I can wipe the cache after each generation?

It is not supported at the moment and I have not explored how to do it properly. You can try implementing the code yourself and raising a PR to disable this behaviour, if you want

Noted. Let me look into the code and see if I can figure our how this can be done, I will raise a PR and contribute to it.
Thanks for all your support.


fix(http): remove 'remember()' from response$$, not value-over-time

[ ] I added new tests for the issue I fixed/built
[X] I ran npm test for the package I'm modifying
[X] I used npm run commit instead of git commit

There is no reason to represent response$$ using a MemoryStream, it is not a value-over-time, HTTP responses are events

Hi @ntilwalli, thanks for helping out.
Because this was a low-cost and high-risk PR, I think we need to discuss carefully why we need or do not need this. It's low cost because it's a very small change, and seems to pass all tests. But it's high risk because I'm not sure if we need remember() or not, and if there is some corner case that justifies that we need it, then this change would break code for existing users.
I think it's a problem when I don't understand whether we need something or not, so I'd like to be sure that we either need it or don't need it.
The value over time argument is good, and we should remove remember. On the other hand going through the commits in Cycle HTTP, there was a point where we added "autoSubscribe"/"eager", which came with the addition of ReplaySubject. Why? I can't remember. But I believe I did an informed decision at that time. Maybe I forgot to add a test.
So, I'll think about it. And if anyone else is reading this, help us out to be sure on either A or B.

@staltz Understood. This came up as an issue for me while building a component.  In my app I happen to swap in a component for a different one. Both components uses the exact same category for the select filter. When the first component sends a request with that category and then the second component is swapped in, the new component receives a response for a request it never made since, upon connecting the HTTP source, the previous response from the older component is cached in the MemoryStream.  This fixes a bug in my opinion.

Oh, I see. That's good input.

Yeah, I fail to see why we would need remember. Thanks

This will not work for example in such case: http://www.webpackbin.com/EJZK3wW2b
function Main({HTTP}) {
  return {
    HTTP: xs.of('http://sandbox.webpackbin.com'),
    log: HTTP.select().flatten()
  }
}

due to HTTP.select() is subscribed after request$ inside the driver. I'm not sure which one is more correct.


Allow groqStore listen param to be overridden in configuration

Adds an optional parameter to createPreviewSubscriptionHook that can be used to override the listen config for the  groqStore.
We're having trouble using the live preview feature on some pages that are very slow to re-render and would like the ability to reduce functionality to a "preview on reload", while still maintaining draft overlays.

Unfortunately, this won't have the wanted effect of stopping future updates. A different approach is likely needed here.


lfs.pushurl not used from lfsconfig file

Im working with a read cache for lfs artifacts so I want to use the lfs.url to point to my read cache and lfs.pushurl to point to the main artifact server.  However when I specify a lfs.pushurl in a repo's .lfsconfig file, lfs is using the lfs.url.
To repro, take a repo using lfs.  Add an lfs.url be the real lfs server and define an lfs.pushurl to be something totally bogus.
For example take my sample repo...
I made a .lfsconfig with the following:
[lfs]
pushurl =<EMAIL_ADDRESS>url =<EMAIL_ADDRESS>
I made a change to a binary file, added it, committed and used GIT_TRACE=1 git push. Instead of trying to push to a bogus url, this command succeeds and in the output you'll see:
GIT_TRACE=1 git push
15:41:29.711699 git.c:351               trace: built-in: git 'push'
15:41:29.712861 run-command.c:336       trace: run_command: 'ssh'<EMAIL_ADDRESS>'git-receive-pack '\''davideilering/furry-dangerzone.git'\'''
15:41:31.570063 run-command.c:336       trace: run_command: '.git/hooks/pre-push' 'origin' 'git@github.com:davideilering/furry-dangerzone.git'
15:41:31.576681 git.c:564               trace: exec: 'git-lfs' 'pre-push' 'origin' 'git@github.com:davideilering/furry-dangerzone.git'
15:41:31.577220 run-command.c:336       trace: run_command: 'git-lfs' 'pre-push' 'origin' 'git@github.com:davideilering/furry-dangerzone.git'
trace git-lfs: run_command: 'git' version
trace git-lfs: run_command: git rev-list --objects 8a6fbde61672b63affb5ff13772a24c016195fae --not --remotes=origin --
trace git-lfs: run_command: git cat-file --batch-check
trace git-lfs: run_command: git cat-file --batch
trace git-lfs: run_command: 'git' config -l -f /Users/deilering/projects/public-git/furry-dangerzone/.lfsconfig
trace git-lfs: run_command: 'git' config -l
trace git-lfs: tq: running as batched queue, batch size of 100
trace git-lfs: tq: sending batch of size 1
trace git-lfs: ssh<EMAIL_ADDRESS>git-lfs-authenticate davideilering/furry-dangerzone upload
trace git-lfs: api: batch 1 files
trace git-lfs: HTTP: POST https://api.github.com/lfs/davideilering/furry-dangerzone/objects/batch
trace git-lfs: HTTP: 200

I have to completely remove the .lfsconfig file from the repo and define lfs.url and lfs.pushurl in the .git/config under [remote "origin"]
This is my lfs env:
git-lfs/1.4.0 (GitHub; darwin amd64; go 1.7; git ddfaae3)
git version 2.8.1

Endpoint=https://github.com/davideilering/furry-dangerzone (auth=none)
  SSH=git@github.com:davideilering/furry-dangerzone
LocalWorkingDir=/Users/deilering/projects/public-git/furry-dangerzone
LocalGitDir=/Users/deilering/projects/public-git/furry-dangerzone/.git
LocalGitStorageDir=/Users/deilering/projects/public-git/furry-dangerzone/.git
LocalMediaDir=/Users/deilering/projects/public-git/furry-dangerzone/.git/lfs/objects
LocalReferenceDir=
TempDir=/Users/deilering/projects/public-git/furry-dangerzone/.git/lfs/tmp
ConcurrentTransfers=3
TusTransfers=false
BasicTransfersOnly=false
BatchTransfer=true
SkipDownloadErrors=false
FetchRecentAlways=false
FetchRecentRefsDays=7
FetchRecentCommitsDays=0
FetchRecentRefsIncludeRemotes=true
PruneOffsetDays=3
PruneVerifyRemoteAlways=false
PruneRemoteName=origin
AccessDownload=none
AccessUpload=none
DownloadTransfers=basic
UploadTransfers=basic
git config filter.lfs.smudge = "git-lfs smudge -- %f"
git config filter.lfs.clean = "git-lfs clean -- %f"

Good call, @technoweenie. That list is kept here.


Backend: support controllers for database related work

We (with @petertrr) decided that we should have a single point to work with a database for all microservices.
For example: orchestrator, backend-preprocessor and backend should work with the same microservice that will do the same base-related work.
So we need 2 endpoints for it:

Orchestrator (to receive post requests with Statuses)
Backend-preprocessor (to receive post requests with test IDs)

Endpoint for test results is covered in #21


templates: automatically deserialize custom types

Imagine if the following code just worked, like it intuitively should, without conversion:
{{$cslice := cslice 1 "hello" (sdict "a" "b")}}
{{dbSet 0 "slice" $cslice}}
{{$csliceFromDB := (dbGet 0 "slice").Value}}
{{$csliceFromDB.Append 5}}
{{(index $csliceFromDB 2).Get "a"}}

This PR does just that, by serializing sdicts, dicts, and cslices with a custom ext type to distinguish them from their underlying types. As far as I have seen while testing, this should never break existing code - the change is not retroactive. Furthermore, native sdicts/dicts/slices are all saved normally and are not deserialized into their equivalent custom types.

Looks good


On close of browser, again credentials are required at IDP side

Greetings,
I have configured python3-saml in my django application. it is working fine.
But on the close of browser it is asking agin user credentials at IDP (ADFS) server.
P.S :- same IDP is being used for other applications and there it is working fine for them.

Hi,
I did configure Flask example with Shibboleth IdP, and working fine on close. But I'm puzzled wit Django, can you share your experience with your app, how did you manage to make it work?
Thx

@platipusica :- instead of checking whether session is still alive, i was always routing the request to idp server for authentication.


Improve README file

As a developer of DroneFly,
I want to improve the README file
so that the documentation is clear and unambiguous.
Acceptance Criteria:

Ensure all command line arguments and any other configuration options are clearly documented.
Add sample configuration.

Closed via #9


Rails wrapper released

Hey @judesfernando,
Thanks for a great and nifty plugin. I just released a Rails gem to wrap it up and use it with the Assets Pipeline. I just wanted to let you know.
https://github.com/dgilperez/initialjs-rails
Cheers!

That's Great. Thank you!


ios9.3+ iCloud download failed

I tried to use the Java and found a serious problem. The reason to fail to detect iCloud backup within iOS 9.3+ and higher is that the length of protectionInfo.getProtectionInfo(located in protectionInfo) is discordant with ASN1. The length of wrong files is always 59 bytes，but the length of analysis is larger than this. Thus, it causes parse()(located in DERUtils) displaying abnormally. I fail to analysis it. BTW, I find almost all iOS 9.3+ devices encounter this problem while downloading backups. I hope someone can give me some suggestions

Hi, I'm not sure if it's somehow connected, but did you check this thread?
https://github.com/hackappcom/iloot/issues/62#issuecomment-213391984

hi,
i had tried this code a great work is done the code is downloading files upto 9.2.1 version.
Few things issues or error are coming while downloading ios backups

is this code download all the version files below 9.2.1(backups of 8.x ).
2 )Is any progress is there for 9.3 and above ios version.

Sorry the delay! I've pushed a new build that you may like to test.

i appreciate the work you had done.....i had checked for 9.0 and above code is working.

Thank you. I'll close the ticket.


Canvas equation server issues

In https://github.com/StevenClontz/checkit/commit/54de511bd8b875a1f7a62d6e44f0d0015d58840d I fixed how equation URLs for canvas are generated. However, we should use the https://canvas.instructure.com/equation_images/ endpoint instead in case its implementation (e.g. that AWS server) is changed. I think to do this, I need to double-encode the URL.

fixed in e40e40781b4e2ebe


Remove blueprint

We don't need to add the bower package if we're no longer using it.

@tylergets @aomran follow up on the npm changes.

Thanks, I totally missed this.

@aomran can you review this ASAP? The current released build is broken and cannot be used atm.

@elwayman02 this is published now


Allow updateMany to update foreign keys

updateMany can't update columns which also happen to be foreign keys.
Ported from a discussion.
Problem
Trying the following:
await prisma.invitation.updateMany({
  where: {
    token,
    expiresAt: { gt: now },
  },
  data: {
    status: InvitationStatus.accepted,
    // ERROR: 'acceptedByUserId' does not exist in type 'InvitationUpdateManyMutationInput
    acceptedByUserId: userId,
  },
})

with schema:
model Invitation {
  id               Int       @id @default(autoincrement())
  token            String    @unique
  expiresAt        DateTime
  acceptedByUserId Int?
  acceptedBy       User?     @relation(fields: [acceptedByUserId], references: [id], name: "invitation_acceptedByUserId")
}

The InvitationUpdateManyMutationInput type does not include the column acceptedByUserId.
Alternatives

Use update. Can't specify filters which are not unique like expiresAt: { gt: now }.
Use raw

Closing this as it is a duplicate of this one which has more details.
Thanks!


AttributeError: 'NoneType' object has no attribute 'headers' while upload file with azure client

This is autogenerated. Please review and update as needed.
Describe the bug
Command Name
az dls fs upload
Errors:
The command failed with an unexpected error. Here is the traceback:
'NoneType' object has no attribute 'headers'
Traceback (most recent call last):
  File "/opt/az/lib/python3.10/site-packages/knack/cli.py", line 231, in invoke
    cmd_result = self.invocation.execute(args)
  File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 663, in execute
    raise ex
  File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 726, in _run_jobs_serially
    results.append(self._run_job(expanded_arg, cmd_copy))
  File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 697, in _run_job
    result = cmd_copy(params)
  File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 333, in __call__
    return self.handler(*args, **kwargs)
  File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/command_operation.py", line 121, in handler
    return op(**command_args)
  File "/opt/az/lib/python3.10/site-packages/azure/cli/command_modules/dls/custom.py", line 180, in upload_to_adls
    client = cf_dls_filesystem(cmd.cli_ctx, account_name)
  File "/opt/az/lib/python3.10/site-packages/azure/cli/command_modules/dls/_client_factory.py", line 40, in cf_dls_filesystem
    return core.AzureDLFileSystem(
  File "/opt/az/lib/python3.10/site-packages/azure/datalake/store/core.py", line 72, in __init__
    self.connect()
  File "/opt/az/lib/python3.10/site-packages/azure/datalake/store/core.py", line 90, in connect
    self.azure = DatalakeRESTInterface(token=self.token, req_timeout_s=self.per_call_timeout_seconds, **self.kwargs)
  File "/opt/az/lib/python3.10/site-packages/azure/datalake/store/lib.py", line 273, in __init__
    self._check_token()  # Retryable method. Will ensure that signed_session token is current when we set it on next line
  File "/opt/az/lib/python3.10/site-packages/azure/datalake/store/lib.py", line 307, in _check_token
    check_token_internal()
  File "/opt/az/lib/python3.10/site-packages/azure/datalake/store/retry.py", line 93, in f_retry
    out = func(*args, **kwargs)
  File "/opt/az/lib/python3.10/site-packages/azure/datalake/store/lib.py", line 305, in check_token_internal
    self.head = {'Authorization': cur_session.headers['Authorization']}
AttributeError: 'NoneType' object has no attribute 'headers'

To Reproduce:
Steps to reproduce the behavior. Note that argument values have been redacted, as they may contain sensitive information.

Put any pre-requisite steps here...
az dls fs upload --account {} --source-path {} --destination-path {}

Expected Behavior
Environment Summary
Linux-5.15.0-1014-azure-x86_64-with-glibc2.31, Ubuntu 20.04.4 LTS
Python 3.10.5
Installer: DEB

azure-cli 2.39.0

Additional Context

route to service team

Hi, @yonzhan. I found a similar case reported 3 months ago: https://github.com/Azure/azure-cli/issues/22246. Was it caused by user or code in auzre client ?


Add support for React 19

The stable React 19 release has just dropped. If nothing else, the peerDependencies will need to be updated to include 19.

We gotta fork it and update it

You might be right, but it is under the reactjs namespace, surely a core maintainer could make this update.

I hope so

@zacharytyhacz PRs are always welcome.

Peer dependencies to allow react 19 is now update.
Please, bring feedback if it didn't work, and, how it behaves on the newest react version.

Amazing! Thank you.


Automatic launch.json creator doesn't suggest suitable config

Hello, Anton! Thank you for your message.
I can't reproduce this bug, could you answer a few questions:

Extension is activated? Can you see some pickers in bottom statusbar?
If you add launch.json manually, debug is working?

Best regard,
Meteor Support Team


render-queue

I just have a question in render-queue.js.
why not use
if (!component._dirty && (component._dirty = true) && items.push(component)>=1) {

	}

to replace
if (!component._dirty && (component._dirty = true) && items.push(component)==1) {

	}

The render queue is only triggered when the first item is placed into the queue. Subsequent items are just added to the list since there is already a deferred rerender in place.

I probably closed that preemptively - feel free to discuss! 👍

Thanks，I think i have known what's your meaning


Add Memory Card Game

I would like to work on making simple memory card game for this project

Please go for it


Typo in Pages/Courses/Index.cshtml

In Pages/Courses/Index.cshtml
Create New
should be
Create New
or the "Create new" link in the "Courses" page does not work.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: d0026f69-7e5d-0d3e-5586-16ecc0656ff0
Version Independent ID: 3cb264da-2ff1-1256-572f-aa4ebca6e255
Content: Razor Pages with EF Core in ASP.NET Core - Read Related Data - 6 of 8
Content Source: aspnetcore/data/ef-rp/read-related-data.md
Product: aspnet-core
GitHub Login: @Rick-Anderson
Microsoft Alias: riande

@AlbertoPa thanks. I'll get this fixed.


Upgrade Python from 3.9 to 3.10

As it's the one used in HA 2022.7.0

Thanks @felipecrs (adding @NickM-27 who had the same idea).


Open/Close sub menu wrong

Hi,I see your menu, the ideal very cool.I like it , i want to use it on my website but i see it still have problem.As you can see if you on desktop view it ok , but you resize to mobile view tap open then back to desktop view , open/close so crazy it not good.
Pls improve that.
Good luck.

Already reported in #144  & #154..


Support for zipkin server as a fully executable jar

Currently Zipkin server is not a Fully executable jar which makes it not possible to run as a System V  or SystemD or Windows services.
https://docs.spring.io/spring-boot/docs/current/reference/html/deployment-install.html

As mentioned on Gitter, the part of doing this for the Zipkin JAR everyone uses that is a concern is the warning in the linked documentation, copied below:

Fully executable jars work by embedding an extra script at the front of the file. Currently, some tools do not accept this format so you may not always be able to use this technique. For example, jar -xf may silently fail to extract a jar or war that has been made fully-executable. It is recommended that you only make your jar or war fully executable if you intend to execute it directly, rather than running it with java -jar or deploying it to a servlet container.

For instance, I thought the Cloud Foundry Java buildpack did not support these because it tries to unpack the JAR before running it, but it appears that with the latest version of the Java buildpack, it has no problem running these. My memory may have been before support was added.
So maybe it isn't a big issue that things like jar -xf won't work?

So maybe it isn't a big issue that things like jar -xf won't work?

Hmm does jar -xf actually not work? Feels like I would have tried and
noticed this in the past. Maybe the docs in boot are overly cautious? At
any rate, this won't be a war file, just a standalone. If jar -xf doesn't
work on JRE 8+ I'd be surprised, but still we could consider anyway

interestingly I tried. jar -tf works in JDK 1.8+, jar -xf doesn't work
in 1.8, but it does in version 9
spring boot's header is also quite large.. trying with a smaller one
to see if that was why 1.8 doesn't work (for completeness, not because
I feel using jar instead of unzip is a critical feature)

nope. making the shell header smaller doesn't make jar from 1.8 work.
Personally, I'm very unconcerned by this limitation. We don't use jar
to extract files anyway, and due to support implications 1.8 will
phase out as a concern anyway
https://github.com/openzipkin/docker-zipkin/blob/master/zipkin/Dockerfile#L29
ITOW, unless others feel strongly, I'm in favor of making this executable

ps in the advice against doing this if doing "java -jar" I currently
don't see impact to this in 1.8 or 9, though it might be possible. We
should check that using the modules (ex kafka10) there's no weird
loading problem

I made the jar executable and tested in PCF Dev. It works fine.
name:              zipkin
requested state:   started
instances:         1/1
usage:             256M x 1 instances
routes:            zipkin.local.pcfdev.io
last uploaded:     Thu 01 Mar 09:41:41 +07 2018
     state     since                  cpu      memory           disk             details
#0   running   2018-03-01T02:45:19Z   156.1%   189.9M of 256M   170.8M of 512M

If we are good, i can submit a PR.

@zeagord do it!

#1934

ps unzip has a problem on alpine (eventhough it doesn't on osx) caused the builds to fail last few releases https://quay.io/repository/openzipkin/zipkin?tab=builds

added a temporary hack until @abesto or someone tells me a better way. respinning releases 2.5.1 forward in docker https://github.com/openzipkin/docker-zipkin/commit/72f5b108ff03ce1a851581f2625382edc9671f0a

I mean... wow, this is new to me. So technically zip is correct, that's not a valid zip archive :D It starts with a shell script. I'd note that unzip can extract the archive even on Alpine, but then complains about the archive not being valid. Here's one way to both fail on other errors, and let the build pass:
zip --fix zipkin-server.jar --out zipkin-server.zip
unzip zipkin-server.zip
``

Where `zip --fix` strips out the shell script from the beginning, restoring the general assumption that a jar is a zip.

This is a better solution. Lets go with it. Nice find!
On Tue, 20 Mar 2018 05:01 Zoltán Nagy<EMAIL_ADDRESS>wrote:

I mean... wow, this is new to me. So technically zip is correct, that's
not a valid zip archive :D It starts with a shell script. I'd note that
unzip can extract the archive even on Alpine, but then complains about
the archive not being valid. Here's one way to both fail on other errors,
and let the build pass:
zip --fix zipkin-server.jar --out zipkin-server.zip
unzip zipkin-server.zip
``
Where zip --fix strips out the shell script from the beginning, restoring the general assumption that a jar is a zip.
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/openzipkin/zipkin/issues/1932#issuecomment-374375301,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAD618hzUwqlaBRZ__kSldN3tVW5lfYiks5tgByrgaJpZM4SWAAe
.


Arrow Rust + Conbench Integration

Here's a minimal Arrow Rust + Conbench[1] proof of concept.
[1] https://github.com/conbench/conbench
A few notes (areas for improvement, caveats, etc):

Criterion results are in nanoseconds, but the smallest unit
Conbench currently speaks is seconds (because Conbench was initially
for macro not micro benchmarking). I suspect most places in Conbench
would work just fine if nanoseconds were passed in, but I need to
audit the code for any places that assume seconds if it isn't a
throughput benchmark.

If the Criterion benchmarks were named better, I could tag them
better in Conbench. For example, I suspect sqrt_20_12, sqrt_20_9,
sqrt_22_12, and sqrt_22_14 are parameterized variations of the same
benchmark, and if they were named something like "sqrt, foo=20,
bar=12", I could batch them together & tag their parameters so that
Conbench would automatically graph them in relation to each other. I
was sort of able to do this with the following benchmarks (because
there was a machine readable pattern). Anyhoo, that's easy enough to
do down the road as a last integration step, and it does appear from
the Criterion docs that they have their own recommendations for how to
do this.

window partition by, u64_narrow, aggregate functions
window partition by, u64_narrow, built-in functions
window partition by, u64_wide, aggregate functions
window partition by, u64_wide, built-in functions

While Criterion benchmarks can also measure throughput in some
cases, all the arrow-datafusion benchmarks were in elapsed time (not
sure about the arrow-rs benchmarks), so I didn't bother writing code
to support potential throughput results from
arrow-datafusion/arrow-rs, but we may need to revisit that.

We probably want to add some additional context, like the
arrow-rs/arrow-datafusion version, rust version, any compiler flags,
etc.

I pulled the branch locally and followed the instructions in the README and benchmarks are currently running. It looks like it will take a while so I will check in on results in the morning and continue reviewing the PR.

I pulled the branch locally and followed the instructions in the README and benchmarks are currently running. It looks like it will take a while so I will check in on results in the morning and continue reviewing the PR.

Nice!
99% of the time is spent executing cargo bench.
Note that this is only the first step – you should see json formatted benchmark results spew to your terminal, but they won't yet publish to the Arrow Conbench server[1].
You'll want to work with @ElenaHenderson on getting the results to publish to the Arrow Conbench server via buildkite etc.
[1] https://conbench.ursa.dev/

Thanks @dianaclarke I can take it from here for sure .. and it turns out this benchmark was failing even before this PR. I should have checked that first.

Ah, I was getting an error with cargo bench in arrow-rs, but I assumed I just didn't have my env set up correctly (I don't know Rust aside from what I learned doing this).
But I can cargo bench in arrow-datafusion, so perhaps it's easier to start with this pull request:

https://github.com/apache/arrow-datafusion/pull/1791

If there are no objections, I plan to merge this PR next week so that I can proceed to the next step of integrating this with CI. The changes in this PR are self-contained so I think it is low risk to merge.


Ionic plugin: Property 'MAP_READY' does not exist on type '{ [eventName: string]: string; }'

Error: Property 'MAP_READY' does not exist on type '{ [eventName: string]: string; }'
Getting this error when map is loaded:

line 51: console.log(GoogleMapsEvent.MAP_READY);
map is loaded fine, but this event is not firing up....

Please share your project files on github. Otherwise, I don't support this.

Iam sharing my prosject thrue google drive link
Vs2017 and Git extention is not wrking as expected....Sorry...
I hope you can download the project...

any clue why iam getting this error?

I have a question. What is the platform of this error?
Because this plugin works only on Android and iOS.

Um, I checked your repo, but I could not figure out the reason.

strange, was you able to reproduce the error ?
Or did you build and see the same error result?

I tried to rebuild your project, and I achieved to build it without error.
What I did is
$> cordova platform rm android

$> cordova platform add android

That's it. I didn't change any code of yours.
So this is not plugin's problem.

Oki, i did as you described above, but still iam getting same error mesage on "Map_READY and MAP_CLICK events.
which cordova version are you running, and android version?

$ cordova -v
7.0.1

@gonadn The ionic team fixed the problem of the @ionic-native/google-maps wrapper plugin.
It was the problem of TypeScript for some reason.
Please reinstall the @ionic-native/google-maps v4.3.2.
The problem should be gone.
$> npm uninstall @ionic-native/google-maps

$> npm clear cache

$> npm install<EMAIL_ADDRESS>


Segmentation Fault during DeltaTable merge

Environment
Delta-rs version:
0.17.4
Binding:
Python 3.12
Environment:

Cloud provider: Azure
OS:
NAME="Debian GNU/Linux"
VERSION_ID="11"
VERSION="11 (bullseye)"
Other:
Pod runs on Node Standard_E8-4ads_v5

K8s resources:
requests:
memory: 25Gi
cpu: "3"
limits:
memory: 60Gi
cpu: "4"
Environment:
adlfs==2024.2.0 agate==1.7.1 aiohttp==3.9.5 aiosignal==1.3.1 annotated-types==0.7.0 attrs==23.2.0 azure-core==1.30.1 azure-datalake-store==0.0.53 azure-identity==1.15.0 azure-storage-blob==12.20.0 Babel==2.15.0 certifi==2024.2.2 cffi==1.16.0 charset-normalizer==3.3.2 click==8.1.7 colorama==0.4.6 cryptography==42.0.7 dbt-core==1.7.15 dbt-duckdb==1.7.4 dbt-extractor==0.5.1 dbt-semantic-interfaces==0.4.4 deltalake==0.17.4 duckdb==0.10.1 duckdb_deltalake_dbt==0.2.3rc1 frozenlist==1.4.1 fsspec==2024.3.1 idna==3.7 importlib-metadata==6.11.0 isodate==0.6.1 Jinja2==3.1.4 jsonschema==4.22.0 jsonschema-specifications==2023.12.1 leather==0.4.0 Logbook==1.5.3 loguru==0.7.2 MarkupSafe==2.1.5 mashumaro==3.13 minimal-snowplow-tracker==0.0.2 more-itertools==10.2.0 msal==1.28.0 msal-extensions==1.1.0 msgpack==1.0.8 multidict==6.0.5 networkx==3.3 numpy==1.26.4 packaging==24.0 pandas==2.2.2 parsedatetime==2.6 pathspec==0.11.2 polars==0.20.29 portalocker==2.8.2 protobuf==4.25.3 pyarrow==15.0.2 pyarrow-hotfix==0.6 pycparser==2.22 pydantic==2.7.1 pydantic_core==2.18.2 PyJWT==2.8.0 python-dateutil==2.9.0.post0 python-dotenv==1.0.1 python-slugify==8.0.4 pytimeparse==1.1.8 pytz==2024.1 PyYAML==6.0.1 referencing==0.35.1 requests==2.32.2 rpds-py==0.18.1 setuptools==69.5.1 six==1.16.0 sqlparse==0.5.0 text-unidecode==1.3 typing_extensions==4.12.0 tzdata==2024.1 urllib3==1.26.18 wheel==0.43.0 yarl==1.9.4 zipp==3.19.0

Bug
What happened:
I have a script which does data munging with duckdb and deltatable. After duckdb query finished I call the arrow() function and pass it to a merge function on a deltatable on azure blob storage. On cloud I get a segmentation fault during merge operation, however locally on my Macbook Pro with M2 and about 8GB RAM it processes all 15M rows in 5min. Local test uses same storage location on azure blob.
I tried during debugging to use a batch reader although cloud resources are much bigger than on the Macbook. Chunk_size 10k rows succeed but is increadible slow, however chunk_size 100k and above results in Segmentation Fault. The column has 17 columns, so 100k should fit in a very small memory. I observed memory in top in parallel, memory is around 10% when segmentation fault happens.
What you expected to happen:
Same behavior in cloud as on local. Local deltatable run should be much slower.
How to reproduce it:
Here is my code:
dt_curated_errors = DeltaTable(
    "abfs://featurestore/curated_errors", version=dt_curated_errors_last_version
)

df = quack.sql(f"select * from vw_errors where 1=1 {where_statement}").fetch_arrow_reader(chunk_size)

dt_curated_errors_last_version = merge(
    dt_curated_errors,
    df,
    ["serialnumber", "ts", "state", "label", "id", "bucket", "partition_year_month"],
)

def merge(dt, results, merge_keys, columns=None, update=True, insert=True):
    merge_stmts = []
    for merge_key in merge_keys:
        merge_stmts.append(f"target.{merge_key} = source.{merge_key}")

    while True:
        try:
            batch = results.read_next_batch()
            if update:
                merger = dt.merge(
                    source=batch,
                    predicate=" and ".join(merge_stmts),
                    source_alias="source",
                    target_alias="target",
                )
                if columns is None:
                    log.info(f"update: {merger.when_matched_update_all().execute()}")
                else:
                    log.info(f"update: {merger.when_matched_update(columns).execute()}")

            if insert:
                merger = dt.merge(
                    source=batch,
                    predicate=" and ".join(merge_stmts),
                    source_alias="source",
                    target_alias="target",
                )
                log.info(f"insert: {merger.when_not_matched_insert_all().execute()}")
        except StopIteration:
            log.info("Finished all batches")
            break

...

More details:
Local run:
2024-05-28 13:56:55.033 | INFO     | __main__:merge:121 - update: {'num_source_rows': 14021956, 'num_target_rows_inserted': 0, 'num_target_rows_updated': 0, 'num_target_rows_deleted': 0, 'num_target_rows_copied': 0, 'num_output_rows': 0, 'num_target_files_added': 0, 'num_target_files_removed': 0, 'execution_time_ms': 12624, 'scan_time_ms': 0, 'rewrite_time_ms': 3527}
2024-05-28 13:59:48.201 | INFO     | __main__:merge:132 - insert: {'num_source_rows': 14021956, 'num_target_rows_inserted': 12994925, 'num_target_rows_updated': 0, 'num_target_rows_deleted': 0, 'num_target_rows_copied': 0, 'num_output_rows': 12994925, 'num_target_files_added': 1371, 'num_target_files_removed': 0, 'execution_time_ms': 172053, 'scan_time_ms': 0, 'rewrite_time_ms': 162790}

100k batch on cluster:
Fatal Python error: Segmentation fault

Thread 0x00007f6a9ae4d700 (most recent call first):
  File "/usr/local/lib/python3.12/concurrent/futures/thread.py", line 89 in _worker
  File "/usr/local/lib/python3.12/threading.py", line 1010 in run
  File "/usr/local/lib/python3.12/threading.py", line 1073 in _bootstrap_inner
  File "/usr/local/lib/python3.12/threading.py", line 1030 in _bootstrap

Thread 0x00007f6a9b64e700 (most recent call first):
  File "/usr/local/lib/python3.12/selectors.py", line 468 in select
  File "/usr/local/lib/python3.12/asyncio/base_events.py", line 1949 in _run_once
  File "/usr/local/lib/python3.12/asyncio/base_events.py", line 641 in run_forever
  File "/usr/local/lib/python3.12/threading.py", line 1010 in run
  File "/usr/local/lib/python3.12/threading.py", line 1073 in _bootstrap_inner
  File "/usr/local/lib/python3.12/threading.py", line 1030 in _bootstrap

Current thread 0x00007f6ac63a2740 (most recent call first):
  File "/usr/local/lib/python3.12/site-packages/deltalake/table.py", line 1800 in execute
  File "/tmp/cpm_prediction_duckdb2.py", line 134 in merge
  File "/tmp/cpm_prediction_duckdb2.py", line 385 in <module>

Extension modules: numpy.core._multiarray_umath, numpy.core._multiarray_tests, numpy.linalg._umath_linalg, numpy.fft._pocketfft_internal, numpy.random._common, numpy.random.bit_generator, numpy.random._bounded_integers, numpy.random._mt19937, numpy.random.mtrand, numpy.random._philox, numpy.random._pcg64, numpy.random._sfc64, numpy.random._generator, pyarrow.lib, pyarrow._hdfsio, pyarrow._compute, pyarrow._acero, pyarrow._fs, pyarrow._csv, pyarrow._json, pandas._libs.tslibs.ccalendar, pandas._libs.tslibs.np_datetime, pandas._libs.tslibs.dtypes, pandas._libs.tslibs.base, pandas._libs.tslibs.nattype, pandas._libs.tslibs.timezones, pandas._libs.tslibs.fields, pandas._libs.tslibs.timedeltas, pandas._libs.tslibs.tzconversion, pandas._libs.tslibs.timestamps, pandas._libs.properties, pandas._libs.tslibs.offsets, pandas._libs.tslibs.strptime, pandas._libs.tslibs.parsing, pandas._libs.tslibs.conversion, pandas._libs.tslibs.period, pandas._libs.tslibs.vectorized, pandas._libs.ops_dispatch, pandas._libs.missing, pandas._libs.hashtable, pandas._libs.algos, pandas._libs.interval, pandas._libs.lib, pandas._libs.ops, pandas._libs.hashing, pandas._libs.arrays, pandas._libs.tslib, pandas._libs.sparse, pandas._libs.internals, pandas._libs.indexing, pandas._libs.index, pandas._libs.writers, pandas._libs.join, pandas._libs.window.aggregations, pandas._libs.window.indexers, pandas._libs.reshape, pandas._libs.groupby, pandas._libs.json, pandas._libs.parsers, pandas._libs.testing, pyarrow._dataset, pyarrow._dataset_orc, pyarrow._parquet, pyarrow._parquet_encryption, pyarrow._dataset_parquet_encryption, pyarrow._dataset_parquet, pyarrow._hdfs, pyarrow._gcsfs, pyarrow._s3fs, yaml._yaml, _cffi_backend, charset_normalizer.md, requests.packages.charset_normalizer.md, requests.packages.chardet.md, markupsafe._speedups, google._upb._message, msgpack._cmsgpack, multidict._multidict, yarl._quoting_c, aiohttp._helpers, aiohttp._http_writer, aiohttp._http_parser, aiohttp._websocket, frozenlist._frozenlist (total: 84)
Segmentation fault (core dumped)

10k batch on cluster:
2024-05-28 11:48:36.520 | INFO     | __main__:merge:134 - update: {'num_source_rows': 10000, 'num_target_rows_inserted': 0, 'num_target_rows_updated': 0, 'num_target_rows_deleted': 0, 'num_target_rows_copied': 0, 'num_output_rows': 0, 'num_target_files_added': 0, 'num_target_files_removed': 0, 'execution_time_ms': 3905, 'scan_time_ms': 0, 'rewrite_time_ms': 16}
2024-05-28 11:48:55.301 | INFO     | __main__:merge:145 - insert: {'num_source_rows': 10000, 'num_target_rows_inserted': 1415, 'num_target_rows_updated': 0, 'num_target_rows_deleted': 0, 'num_target_rows_copied': 0, 'num_output_rows': 1415, 'num_target_files_added': 107, 'num_target_files_removed': 0, 'execution_time_ms': 18672, 'scan_time_ms': 0, 'rewrite_time_ms': 14681}
2024-05-28 11:49:14.429 | INFO     | __main__:merge:134 - update: {'num_source_rows': 10000, 'num_target_rows_inserted': 0, 'num_target_rows_updated': 8449, 'num_target_rows_deleted': 0, 'num_target_rows_copied': 873709, 'num_output_rows': 882158, 'num_target_files_added': 846, 'num_target_files_removed': 847, 'execution_time_ms': 18944, 'scan_time_ms': 0, 'rewrite_time_ms': 14578}
2024-05-28 11:49:30.345 | INFO     | __main__:merge:145 - insert: {'num_source_rows': 10000, 'num_target_rows_inserted': 1623, 'num_target_rows_updated': 0, 'num_target_rows_deleted': 0, 'num_target_rows_copied': 0, 'num_output_rows': 1623, 'num_target_files_added': 114, 'num_target_files_removed': 0, 'execution_time_ms': 15823, 'scan_time_ms': 0, 'rewrite_time_ms': 11333}

Why is the one, on the cluster showing logs with asyncio and threading?

I spent more time in investigating, seems to be a problem on amd64 with multiple partition levels which are also part of predicates. The reproduce.py script attached below runs on arm64.
I attached:
Core dump:
https://file.io/3K1NXipK9eLy
Reproduce python script:
reproduce.py.zip
Working script with just one partition:
unittest_single_partition.py.zip
Testdata:
test_first_16000.parquet.zip

Why is the one, on the cluster showing logs with asyncio and threading?

I think its crashing in the Rust code, attached core dump may give information about that

did someone had the chance to check the core dump?
BR


Video Clipping Question

Thank you so much for the report on data and open-sourcing the annotation! I am trying to play around with the data and have two questions that hope can get your kind response. From the report:

According to the scene transformation and clipping script provided by Panda70M, we have divided these videos into approximately 434,000 video clips. In fact, based on our clipping results, 99% of the videos obtained from these online sources are found to contain single scenes.

(1) Does this imply Panda70M incorrectly splits the videos into clips, although they are single scenes?
(2) From the data you open-source, I found they are all 65 frames. If I understand correctly, Panda70M will not result in videos with the same length. Looking from the open-sora-dataset github, I think videos are actually splitted by no_transition.py, instead of Panda70M?
Thank you so much for your potential answer!

We looked at the basics of the dataset before applying the clip script on a large scale. We randomly used a few hundred videos, and we found that the results cut by the clipping tool were basically the start and end frames of the original video, this is because the dataset is almost all a single continuous scene. However applying the clipping tool significantly increases the dataset processing time, so we sliced directly by 65 frames.
By the way, our dataset has this property is because we all came from high-quality footage, and they were supposed to be a single continuous shot of footage.

Got it! Thank you so much!


[REQ] optionally provide hetzner_ssh_key

If I want to create multiple clusters I currently need several different ssh keys, because hcloud does not allow to store multiple keys with the same fingerprint.
I could create a PR that optionally passes the id of the key used and then does not store a new key in hcloud.
What do you think?

Sounds good; the id could help differentiate the keys.
Also, maybe autogenerating the keys with https://registry.terraform.io/providers/hashicorp/tls/latest/docs/resources/private_key would be an option here, and store them in an array.
For instance, we could do that if both the public_key and private_key variables are left blank.
Please submit a PR; that's a completely valid use case.

That also re-joins your proposal of having the keys as strings. This would indeed be doable; see my answer here https://github.com/kube-hetzner/terraform-hcloud-kube-hetzner/issues/161#issuecomment-1109531226.

@batthebee In your coming PR(s), please target the staging branch 🙏

@mysticaltech you mentioned on #161 for local use, it's easy in bash to makes strings look as files!
How does it Work?

Yep, basically you use cat and the string enclosed in EOF. See https://unix.stackexchange.com/questions/505828/how-to-pass-a-string-to-a-command-that-expects-a-file

This would be greatly appreciated, since i am currently testing everything in a single project...

Done in #204, thanks @batthebee! 👏


fix gradle scripts, update documentation, add support for SHA-256 hashes

Dear Mr. Martel,
we are using your ara-m applet in our sysmoISIM / sysmoUSIM cards for quite some time now. For us and the users of our simcards it is a very useful piece of software. In particular in the development and research context it is very helpful to have a freely configurable ara-m applet.
Thank you for contributing your applet to the public!
In the fork I have created I have picked up the suggestions from martinpaljak and z3ntu. I also did a bit of cleanup and fixing to the gradle scripts and updated the documentation. The applet now supports SHA-256 hashes (z3ntu) and
should build again.
Please note that we use the github repository as a mirror, the primary repositoy (where we do our development) can be found under: https://gitea.osmocom.org/sim-card/aram-applet
best regards,
Philipp Maier

Thanks for working on this!


Problem with installing an APK

There's a problem with installing an APK file for me. It just does not installs. To clarify, i use a phone with installed 8.1.0 version of Android. I have no other problems.

Android 11+ is a requirement for the app unfortunately, due to how PokeRogue stores data and the local server I need to use for it.


Develop

@jzdscience This looks like a homework submission for our course. Homework should be submitted on Gradescope.


ERROR: Error while trying to download Jupyter-PHP dependencies with Composer.

Facing this issue when running the command php jupyter-php-installer.phar install
Please do help me solve this.
OS: ubuntu 20.04
php > 7
zmq is enabled
jupyter is installed
O/p of php jupyter-php-installer.phar -vvv install
    [InvalidArgumentException]
    The package name jupyter-php-instance is invalid, it should be lowercase and have a vendor name, a forward slash, and a package name, matching: [a-z0-9_.-]+/[a-z0-9_.-]+

  init [--name NAME] [--description DESCRIPTION] [--author AUTHOR] [--type [TYPE]] [--homepage HOMEPAGE] [--require REQUIRE] [--require-dev REQUIRE-DEV] [-s|--stability STABILITY] [-l|--license LICENSE] [--repository REPOSITORY] [-a|--autoload AUTOLOAD]

  ERROR: Error while trying to download Jupyter-PHP dependencies with Composer.

Same issue here.


Mac app - Sometimes it's not possible to get the user env vars

From<EMAIL_ADDRESS>on 2013-04-19T18:12:04Z
Hi,
I can't get 'spyder-2.2.0rc_Lion.dmg' to install Spyder on my laptop running OS X 10.8.3.
(and that one last version doesn't seem to be available using macports)

Launching for the first time (after copying app to folder Applications) the icon from /Applications will just produce a 'Spyder Error' message

Launching '/Applications/Spyder.app/Contents/MacOS/Spyder' script will produce the following output :

Traceback (most recent call last):
File "/Applications/Spyder.app/Contents/Resources/boot.py", line 19, in <module>
_get_env()
File "/Applications/Spyder.app/Contents/Resources/boot.py", line 18, in _get_env
os.environ.update(env)
File "os.pyc", line 479, in update
ValueError: need more than 1 value to unpack
2013-04-20 00:37:40.149 Spyder[39872:707] Spyder Error
Terminated: 15
logout
Am I missing something obvious?
thank you,
pierre
PS : I have started to use Spyder a month ago, thank you for the amazing work!!
Original issue: http://code.google.com/p/spyderlib/issues/detail?id=1359

From ccordoba12 on 2013-04-23T14:31:06Z
Sorry about the hassle. I introduced the _get_env function to load environment variables in the current Spyder session. The error message you saw probably means that you have none :)
I already have a fix for this and will merge it before the final release.
Labels: -Priority-Medium Priority-Critical MS-v2.2 OpSys-OSX

From<EMAIL_ADDRESS>on 2013-04-23T15:25:23Z
Thank you for your answer!
I'm very much of an amateur on these topics so please excuse all the idiotic things that i will probably say. Just as a follow-up, i tried to understand what were these environment variables and if i had none as you said :)
to the command
>>> import os
>>> print os.environ
i get a consistent list of keys and values (including 'PATH', 'HOME', 'PYTHONPATH', etc.)
if i comment out the following code in 'boot.py' :
# def _get_env():
#     import os
#     import subprocess as sp
#     if os.path.isfile(os.getenv('HOME') + os.path.sep + '.profile'):
#         envstr = sp.check_output('source /etc/profile; source ~/.profile; printenv',
#                                  shell=True)
#     else:
#         envstr = sp.check_output('source /etc/profile; printenv', shell=True)
#     env = [a.split('=') for a in envstr.strip().split('\n')]
#     os.environ.update(env)
# _get_env()
then Spyder.app launches! it seems that there nothing tragic in doing that, right?, and that it could do it for me before the final release. tell me if i'm going to hell this very minute :)
merci encore!!
pierre

From<EMAIL_ADDRESS>on 2013-04-26T11:53:35Z
I had the same problem, with Mac OS X 10.7.8. The "solution" was to put all the function _get_env() between """  """
And now it works

From ccordoba12 on 2013-04-27T07:56:24Z
Guys, please help to debug this: put a print statement after the line
env = [a.split('=') for a in envstr.strip().split('\n')]
such as
print env
uncomment _get_env() and put the print contents here (which should be available in Console.app) to let me know why it's throwing an error.
I thought the error was generated because there weren't env variables defined in some systems, but Pierre's comment #2 seems to indicate that that's not the case.
Summary: Mac app - Can't start Spyder-2.2.0rc because of error while getting environment vars   (was: Mac app - Can't install spyder-2.2.0rc_Lion.dmg on OS X 10.8.3)

From<EMAIL_ADDRESS>on 2013-04-29T15:08:37Z
Labels: MS-v2.2.1

From<EMAIL_ADDRESS>on 2013-04-29T15:10:06Z
Labels: -MS-v2.2

From<EMAIL_ADDRESS>on 2013-05-11T15:17:57Z
I also had this issue and commenting that line fixes the issue (I used the .DMG version).
Carlos, I printed the env variable just before the crash, and the problem seems to be that some sublists are emtpy:
['PIP_DOWNLOAD_CACHE', '/Users/boriel/.pip/cache']
['TERM_PROGRAM', 'Apple_Terminal']
['PIP_REQUIRE_VIRTUALENV', 'true']
['TERM', 'xterm-256color']
['SHELL', '/bin/bash']
...
[''] <= HERE
['PAGER', 'less']
['EDITOR', 'vim']
['LANG', 'es_ES.UTF-8']
['PYTHONHOME', '/Applications/Spyder.app/Contents/Resources']
['PS1', '\[\033[01;32m\]\u@\h\[\033[00m\]:\[\033[01;34m\]\w\[\033[00m\]\$ ']
...
['_', '/usr/bin/printenv']
Printing envstr shows a blank line, so a fix could be defining env as:
env = [a.split('=') for a in envstr.strip().split('\n') if a]
This works, but I don't know if this is what you intented.
:)

From ccordoba12 on 2013-06-19T18:45:20Z
I'll need more time to investigate this, so I'm leaving it for 2.3
Labels: -MS-v2.2.1 MS-v2.3

From ccordoba12 on 2013-05-14T14:44:38Z
I uploaded a new version that has a partial fix for this problem: at least it doesn't crash if it can't get the user env vars.
Thanks boriel for your suggestion. I'll try to incorporate it for 2.2.1 after I analyze more deeply what's really happening.

From<EMAIL_ADDRESS>on 2013-05-14T14:53:43Z
This fix works!! Thanks, Carlos! :)

From ccordoba12 on 2013-12-11T12:41:23Z
Labels: -MS-v2.3 MS-v2.3.1

From ccordoba12 on 2013-06-29T14:43:35Z
Summary: Mac app - Sometimes it's not possible to get the user env vars   (was: Mac app - Can't start Spyder-2.2.0rc because of error while getting environment vars)

From ccordoba12 on 2014-08-17T18:52:50Z
Labels: -MS-v2.3.1 MS-v2.3.2

From ccordoba12 on 2013-12-30T15:58:25Z
issue #1383 has been merged into this issue.

From ccordoba12 on 2014-10-26T10:20:59Z
Labels: -Priority-Critical -MS-v2.3.2 Priority-High MS-v2.4


Error message: "Failed to load projects.cson"

When I boot up Atom with the Package Manager package enabled, I get this error message:

Failed to load projects.cson
Cannot use 'in' operator to search for 'global' in null

Screenshot:

My ~/.atom/projects.cson file is valid CSON (and I've never edited it manually).
Atom v1.0.19, Project Manager 2.6.0, Windows 10 x64.

Oops, I should've search first. Closing as dupe of #151.


Indexer: accounting bug

Subject of the issue

The indexer currently runs into an accounting bug when syncing with algod. There's some discrepancy in the transaction that needs to be properly imported by indexer.
Your environment

Steps to reproduce

Run indexer 2.7.1 full catchup

Expected behaviour
Actual behaviour

Using a variant of binary search, we found that https://github.com/algorand/indexer/commit/a40b36187e413df8f4d537b40c4402a9526adddb fixed the issue.
That commit removes zeroing out of TotalAppSchema and TotalExtraAppPages fields in AccountData which are used by the min_balance opcode. My import validation tool found the first accounting discrepancy at round 15821574 (testnet). It contains an application call whose code does use the min_balance opcode, which explains the bug.


Crashes with no error when using zluda

Crashes without error info when pressing create
I have RX 580 2048SP (Maybe rx470 because aliexpress sellers often use its chip in rx580 2048sp refabs)
Driver version 24.7.1 and ROCm 5.7.1
Log:
Microsoft Windows [Version 10.0.19045.2673]
(c) Корпорация Майкрософт (Microsoft Corporation). Все права защищены.

C:\SD-Zluda\stable-diffusion-webui-amdgpu>webui-user.bat
venv "C:\SD-Zluda\stable-diffusion-webui-amdgpu\venv\Scripts\Python.exe"
WARNING: ZLUDA works best with SD.Next. Please consider migrating to SD.Next.
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug  1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: v1.10.1-amd-2-g395ce8dc
Commit hash: 395ce8dc2cb01282d48074a89a5e6cb3da4b59ab
Using ZLUDA in C:\SD-Zluda\stable-diffusion-webui-amdgpu\.zluda
Skipping onnxruntime installation.
You are up to date with the most recent release.
no module 'xformers'. Processing without...
no module 'xformers'. Processing without...
No module 'xformers'. Proceeding without it.
C:\SD-Zluda\stable-diffusion-webui-amdgpu\venv\lib\site-packages\pytorch_lightning\utilities\distributed.py:258: LightningDeprecationWarning: `pytorch_lightning.utilities.distributed.rank_zero_only` has been deprecated in v1.8.1 and will be removed in v2.0.0. You can import it from `pytorch_lightning.utilities` instead.
  rank_zero_deprecation(
Launching Web UI with arguments: --use-zluda --update-check --skip-ort
Loading weights [6ce0161689] from C:\SD-Zluda\stable-diffusion-webui-amdgpu\models\Stable-diffusion\v1-5-pruned-emaonly.safetensors
Creating model from config: C:\SD-Zluda\stable-diffusion-webui-amdgpu\configs\v1-inference.yaml
C:\SD-Zluda\stable-diffusion-webui-amdgpu\venv\lib\site-packages\huggingface_hub\file_download.py:1150: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
  warnings.warn(
Running on local URL:  http://<IP_ADDRESS>:7860

To create a public link, set `share=True` in `launch()`.
Startup time: 26.0s (prepare environment: 29.1s, initialize shared: 5.8s, other imports: 1.2s, load scripts: 1.3s, create ui: 1.6s, gradio launch: 0.7s).
Applying attention optimization: Doggettx... done.
Для продолжения нажмите любую клавишу . . .

I can give more info if needed

You can try troubleshooting by following TROUBLESHOOTING.md.

You can try troubleshooting by following TROUBLESHOOTING.md.

Thank you! I will try

This behaviour can be fixed by relaunching the webui and pressing Generate again. It will crash,
Then repeat this step 10-15 times. It trys to load stuff in the background and should succeed then after doing that a few times.
Then you should get a 0/0 in the progress bar.
When you get this, just wait 15-40 minutes for the first image to be generated.
After that its done and you can generate faster.


*: prepare for go 1.18 release

Waiting for the release, need to fix several TODOs after that.

At last, https://go.dev/blog/go1.18