Mapping hive field to elastic geo_shape type

Hi, I'm trying to read/write data from/to elasticsearch using Hive and I get ClassCastException when I try to read/write from/to index with geo_shape field.
I created this table in hive:
CREATE EXTERNAL TABLE features
(
	SHAPE STRUCT<coordinates:array<array<array<double>>>,type:string>
)
STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler'
TBLPROPERTIES('es.resource' = 'hive_test/features',
              'es.index.auto.create' = 'false') ;

Elasticsearch index mapping:
PUT hive_test/features
{
	"properties":{
		"shape":{
			"type":"geo_shape"
		}
	}
}

The exception occurs since the mapping for geo_shape (as with all non-primitive mappings) is a string. The reason behind that is that there's no dedicated type for it in Pig and thus it's up to the user to decide how to map it.
Change your mapping in Pig from nested array to chararray and rerun your task.

I'm restricted to use hive.
Is there any way to use hive or do I have to use Pig in order to map to geo_shape field?

Neither Pig or Hive support a geo type; but that's not my point. Rather in your mapping define shape as a string and once it's loaded, then convert in Pig in whatever structure you want/need.

I'm not sure I understood what you are suggesting.
But I need the mapping to be geo_shape becuase of geographic queries on the index.

Change your mapping in Pig from nested array to chararray and rerun your task.

CREATE EXTERNAL TABLE features (SHAPE chararray)
STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler'
TBLPROPERTIES('es.resource' = 'hive_test/features',
              'es.index.auto.create' = 'false') ;

Closing the issue (no further follow-up).


Avast reports this addon as malware-ish

Yeah, I know, this is complete and utter BS, but I imagine the addon manager could drop Avast an email about it. I've occasionally contacted them for false positives of one sort or another, they do take reports into consideration, after 2-5 days usually.
I've had this morning a popup message from Avast, telling me the Default Bookmark Folder had a bad reputation (2/5 stars, whatever it may come from) because it had the capacity to monitor my internet usage, and Avast recommended deactivated it.
So, here's for the report. Sorry to bother with that.

Hello! Thank you for taking the time to report this, and sorry for the late response.
I installed Avast and the add-on, and then run a simple scan. The message is indeed present, although I do not understand why. I have reported the issue to Avast. I am hoping they will fix it!

I got a response from Avast today:

Hello,
Thank you for reporting this.
I checked this problem with our developers and the rating of the "Default Folder Bookmark" extension was changed to 4 stars. Please allow up to 24 hours for this change to take effect.
We are sorry for the inconvenience.  If you have any further questions, don't hesitate to contact me again.
Best Regards,
Prokop
The Avast Support Team

I run a new scan, and no reports about the add-on. I am going to try again on a different machine to make sure, but it looks like the issue has been resolved.

I am glad for you Teddy, well done :)
That said, if you'll pardon my rant, this is plain ridiculous on Avast part. These ratings are supposed to be community-generated, however a developer casting a look pumps the rating to four stars. Not three, not five, four.
It couldn't look more bogus and, as it's arbitrary, worthless.
Really, silly that had the extension blocked before.
Anyway, good it's over, your extension is a blessing for FF users, thank you one last time :)


Is there a way to know how much memory is requried for a task?

Hi,
jax seems to reserve all the gpu memory at import. So we cannot see how much memory is used exactly by the ott package from the nvidia panels. Right now, if some problem runs into memory issues, the only thing we can do is to reduce the problem size until the error disappears. Is there a more direct way to know how much memory is required for a target task?
Thanks!

Hi @feiyang-k , please check https://jax.readthedocs.io/en/latest/gpu_memory_allocation.html on how to change the pre-allocation JAX does. In short, you can do
import os  # before importing anything jax
os.environ['XLA_PYTHON_CLIENT_PREALLOCATE'] = "false"

import jax
import jax.numpy as jnp
...

Thanks @michalk8 ! I tried it and it works exactly as I wished!
By the way, I'm using it jupyter notebook and the GPU memory recycling seems not fully working. Each time an OT problem is computed, the GPU memory will not be released.
More interestingly, if the computing successfully completed, it is ok to use the memory to compute the next problem. But if a problem went into error, then the allocated memory seems "dead". The available memory for the next OT problem will be the remaining memory, which could be much smaller. Thus, I would need to restart the Jupyter Notebook kernel every time I went into any error with ott. Is this a known issue?
Also, it seems I'm never able to interrupt the block running OT problems. It will never respond. I will need restart to jupyter notebook kernel whenever a task seems will never finish in a reasonable time. Is this as expected?
Thanks again!


[Prototyping] Docs: No such docs on responsive breakpoints

Current docs is short on documentation about responsive breakpoints
Step 1. https://git.io/vHIki
Step 2. https://git.io/vHII8
Step 3. https://git.io/vHII1
Assigning myself to do the same in coming days!

What is the current state of this?

Should be already done.


The package doesn't get installed correctly

I followed the instruction to install the package but I got this error
.../anaconda3/envs/py/lib/python3.7/site-packages/gesvd-0.1-py3.7-linux-x86_64.egg/gesvd_cpp.cpython-37m-x86_64-linux-gnu.so: undefined symbol: _ZN6caffe26detail37_typeMetaDataInstance_preallocated_32E

Just for anyone uses this awesome package, the problem was that the code only can be compiled by Python 3.6. It has compilation issues with Python 3.7. Otherwise, it works perfectly fine!


feat(robot-server): Use a BadRun when we cant load

Up to now, if there's a run saved in the persistence layer that cannot be loaded - which is typically because it contains data from a version of the robot server or api package that whatever's currently running can't handle - we error when trying to retrieve it. That includes both a 500 error when trying to access that particular run, which clients can broadly handle, and a 500 error when trying to list all runs, which clients cannot. Without being able to list out all runs, there's no way for clients to find the problematic run - the IDs are UUIDs and cannot be enumerated - and remove it. The only recourse is to delete all the run storage.
A different way to handle this problem is to consider a "bad run", a run whose run metadata or engine state summary cannot be loaded, as a first class entity that can be returned from run access endpoints wherever a run could be, without an HTTP level error. This is done everywhere for consistency in this commit, though the argument could be made that it should only be done in the list-all-runs access and other endpoints should continue to error.
This bad run contains error information about the cause of the invalid data using a new enumerated error. The bad run will carry all the information that could be loaded - in effect, if the state summary is bad then the run metadata will still be present, and the ID should generally be accessible.
Closes EXEC-344
Review requests

[ ] normal stuff
[ ] from an app perspective, does this seem reasonable to work with?

Testing

[x] Put it on some robots and see that we get some useful data

with a robot with a run using a state from the future we get this:
{
      "id": "312a3e2c-5156-45dd-b3de-ea84ff6734b1",
      "dataError": {
        "id": "RunLoadingError",
        "title": "Run Loading Error",
        "detail": "There was no engine state data for this run.",
        "meta": {
          "type": "InvalidStoredData",
          "code": "4008",
          "message": "There was no engine state data for this run.",
          "detail": {},
          "wrapping": []
        },
        "errorCode": "4008"
      },
      "createdAt": "2024-03-19T19:08:58.821381+00:00",
      "status": "stopped",
      "current": false,
      "actions": [],
      "errors": [],
      "pipettes": [],
      "modules": [],
      "labware": [],
      "liquids": [],
      "labwareOffsets": [],
      "protocolId": "8aa13211-066a-4b80-b24f-bac669cff09a"
    }


[WIP] Zube 187 remove stop words

Summary
this branch includes a new analyzer for the locations index that removes the stop words allowing to get the same results when searching for "Animal Shelter" or "The Animal Shelter is a an"
https://zube.io/smartlogic/bchd/c/187
Note: Run rake chewy:reset
Tests to Run

spec/searches/location_search_spec.rb: Third test added

TODO

[ ] Add UI Tests for Service Areas
[ ] Possibly add model validation for areas

I think this might be failing because of the changes to structure.sql?
psql:/home/circleci/project/db/structure.sql:68: ERROR:  unrecognized configuration parameter "default_table_access_method"
Remove those changes and this is good to go I think.


Verify that expected build outputs exist

#51

Tried this locally, and it didn't help debug. All the artifacts that the setup script is supposed to create are being created. Do the bug must be somewhere later in the pipeline.
Still, it's a good set of checks to have, so I'll commit it anyway.


[Fixes #15] Added social authentication

fixes #15

@diyajaiswal11 Please review my pr.

@diyajaiswal11 Please review my pr.

Hey I wanted social auth using Google and Facebook accounts, not Github. Please make the changes and attach the screenshots of the working of the same.

@diyajaiswal11 the link is not working for google login. Please guide me.

@diyajaiswal11 the link is not working for google login. Please guide me.

What is the issue that you're facing?

@diyajaiswal11 we need to create api keys which are not working it is showing page not found

@diyajaiswal11 we need to create api keys which are not working it is showing page not found

Did you create API Keys?

Yes but still the redirect url is not working

https://realpython.com/adding-social-authentication-to-django/
@Vrindagupta6828  you can use this as a guide


Maths quiz game

Project title
Maths quiz game
Project Description
This would give alert if the your addition is correct and if its wrong it would give correct ans and say to try again.
Stack:
Html
CSS
JavaScript

I would like to work on the issue as a LGMSOC participant kindly assign it to me.

@nisha331 updates?

Yes @harshita2216 on it .. Will submit the PR by tommorow.


Ek cosmetic notification changes

Coverage increased (+0.01%) to 15.039% when pulling 21c19f56610046e4d6c31ef6d8d80b0f4ce5eeae on ek-cosmetic-notification-changes into 4e5158c514ed34ef73b9794338c592c9020f3d33 on master.


[release v2.1] default docker back to 18.09.sh

LGTM

https://github.com/rancher/rancher/issues/21860


add Japanese.md

Hi! I'm Japanese WACCA Player. Thank you for creating a great tool!
I created how to use it in Japanese.
I used a translator, so some parts were difficult to interpret, but I think the meaning is understood.
Also, is it ok to notify Japanese users via Twitter once the merge is done?

It is okay to notify to the Japanese users using Twitter.
I'm very happy to show this program to any WACCA players.
I'll merge this PR when the wrong written sentence is correctly fixed.

Thanks!  I'll report back when I tweet it.

I'll merge this PR when the wrong written sentence is correctly fixed.

We were able to use this translation successfully, so we assume it is okay.
If we hear from Japanese users, we will create a revised PR again.

I have tweeted about it. Thank you!
https://twitter.com/chirping_crow/status/1564871737820336128


[FEATURE] settings.ini from boot (FAT32) partition 📝

Edited:
PR: https://github.com/SeedSigner/seedsigner/pull/129

🪛 We need to make user pi able to read/write files from /boot:

Go /etc/ in rootfs MicroSD partition.
Open with root permisions fstab.
Add ,umask=000 after defaults as I show in the picture.
Save changes :) .

Put in the boot MicroSD partition the file settings.ini and ENJOY! :)

🧐 Details:

seetings.ini is now working from the boot MicroSD partition.
Due the boot partition is FAT32... Windows, MacOS, Android and Linux can work with it easily.
When system boots, the first partition called boot is mounted automatically from /dev/mmcblkp1 to /boot in the system.

Looks like the goal of this feature is to move the settings.ini to the boot partition to make it easier for seedsigner users to modify directly. I think this is a good idea for experimenters and tinkerers. I like the idea to moving this file to the boot partition and think it would be worth pursuing in the next seedsigner release.
I don't think it's a good idea to advise seedsigner users to applying git patches and pulling code from outside the official repo. This increases risk and can cause confusion.
I didn't see a PR for this, @DesobedienteTecnologico did you plan on creating one? I'd be happy to work on this if not.

I didn't see a PR for this, @DesobedienteTecnologico did you plan on creating one? I'd be happy to work on this if not.

Yes sure. I just did the PR https://github.com/SeedSigner/seedsigner/pull/129

Working in SeedSigner OS


URLSession not usable when compiled with Static Linux SDK

Using the following Package.swift:
// swift-tools-version: 6.0
// The swift-tools-version declares the minimum version of Swift required to build this package.

import PackageDescription

let swiftSettings: Array<SwiftSetting> = [
    .swiftLanguageMode(.v6),
    .enableUpcomingFeature("ExistentialAny"),
    .enableUpcomingFeature("InternalImportsByDefault"),
]

let package = Package(
    name: "StaticNetworking",
    platforms: [.macOS(.v15)],
    targets: [
        .executableTarget(
            name: "StaticNetworking",
            swiftSettings: swiftSettings,
            // Workaround for https://github.com/swiftlang/swift-corelibs-foundation/issues/5089
            linkerSettings: [
                .linkedLibrary("crypto", .when(platforms: [.linux])),
                .linkedLibrary("icudata", .when(platforms: [.linux])),
                .linkedLibrary("icuuc", .when(platforms: [.linux])),
                .linkedLibrary("ssl", .when(platforms: [.linux])),
                .linkedLibrary("z", .when(platforms: [.linux])),
            ]),
    ]
)

With the following Sources/main.swift:
import Foundation
#if canImport(FoundationNetworking)
import FoundationNetworking
#endif

struct Post: Sendable, Codable {
    let id: Int
    let userId: Int
    let title: String
    let body: String
}

let request = URLRequest(url: URL(string: "https://jsonplaceholder.typicode.com/posts")!)
print("Fetching data...")
let (data, response) = try await URLSession.shared.data(for: request)
print("Response: \(response)")
let posts = try JSONDecoder().decode(Array<Post>.self, from: data)
print("Decoded \(posts.count) post(s)...")

Which is then built using the Swift Static Linux SDK (swift build -c release --swift-sdk "x86_64-swift-linux-musl"), leads to the following error when run (on e.g. an Ubuntu 24.04 machine):
Fetching data...
Swift/ErrorType.swift:253: Fatal error: Error raised at top level: Error Domain=NSURLErrorDomain Code=-1 "(null)"
Current stack trace:
0    <unknown>                          0x0000000000cb54a1
1    <unknown>                          0x00000000008c09d7
2    <unknown>                          0x00000000008c07e3
3    <unknown>                          0x00000000008c0c39
4    <unknown>                          0x0000000000a7fa46
5    <unknown>                          0x0000000000adc914
6    <unknown>                          0x00000000006e600e
7    <unknown>                          0x0000000000cb9a33
8    <unknown>                          0x0000000000cba655
9    <unknown>                          0x0000000000db400b
10   <unknown>                          0x0000000000db4928
11   <unknown>                          0x0000000000dba506
Illegal instruction

Note the NSURLErrorDomain Code=-1 which is NSURLErrorUnknown.
It doesn't matter which url is used, the result is always the same.
Tested using Swift 6.0.1 and Swift Static Linux SDK 0.0.1.
It's also irrelevant whether the executable is built on macOS or Linux.

cc @al45tair

We have the same problem. We have also tried many variants.

We tried to add another libcurl library to the linker. Because I have read that the URLSession under linux works with libcurl.

We have tried different virtual machines. We have tried ARM64 Debain and Ubuntu Server in different versions. Under Ubuntu 24.04.1 and 24.10. Under Debian we only tested the latest version. We also tried to install all CURL versions on the system. However, this should not be relevant, as all required libraries should normally be linked directly. Please correct me if I am wrong.

We have tried various Docker containers. We have tried the containers: ubuntu:latest, debian:latest, swift:latest, swift:slim.

We checked the corresponding request headers.  In the linked issue, the user “0xfeedface1993” reported that this problem could usually be solved by setting the “accept-encoding” header. Issue:

Unfortunately, none of this worked. I also tried several Linux Static SDK versions, unfortunately always the same behavior.

For comparison, do you get the same results with https://github.com/swift-server/async-http-client, if you have a chance to try that out?

@MaxDesiatov Nope, async-http-client works. I've actually switched the project that I found this bug initially over to async-http-client and now it works.
However, this also multiplied the compile time by a lot since the whole SwiftNIO stack is now drawn into it.

FWIW, I'd started trying to look at this, but got stuck because of another problem; hopefully that issue will have worked its way through now and I'll be able to get back to looking at this.


Javascript to show and hide things based on date

Not really sure what Mat means for this, but also a Application Process todo. What I assume he means is showing the 'I am reading this in the summer` section only in the summer and etc.

dont feel like doing this / dont think it would add


formatting

Really scratching my head as to how all this shifted from under us. Everything displayed correctly until a few days ago...
There're likely other spots in our documentation that now have invalid markdown, think you could take a quick sweep and add additional commits to this PR fixing the other occurrences (if any)? Thanks!

I'm guessing the breakage in our formatting has to do with shifts in the parser when meeting compliance with Github's new formal markdown spec.

Coverage increased (+0.008%) to 69.034% when pulling 0629490cb7383ad5ff07558ce9f4546ac8fc9075 on murtyjones:patch-1 into 1efbaee4f56b16153eaf383dc612a8905aaf42e3 on lightningnetwork:master.

Coverage increased (+0.008%) to 69.034% when pulling 463022953d7f89f635ccee462e956e8d168b3e28 on murtyjones:patch-1 into 1efbaee4f56b16153eaf383dc612a8905aaf42e3 on lightningnetwork:master.

Coverage remained the same at 69.026% when pulling 463022953d7f89f635ccee462e956e8d168b3e28 on murtyjones:patch-1 into 1efbaee4f56b16153eaf383dc612a8905aaf42e3 on lightningnetwork:master.

Coverage remained the same at 69.026% when pulling 9a1e9df23a82ad89bfb12de1d28d79f35e4cf24e on murtyjones:patch-1 into 1efbaee4f56b16153eaf383dc612a8905aaf42e3 on lightningnetwork:master.

@Roasbeef Took a pass through everything - looks good for the most part but added some things I came across.

Coverage increased (+0.008%) to 69.034% when pulling<PHONE_NUMBER>066116157accd47e3b709a993f706c on murtyjones:patch-1 into 1efbaee4f56b16153eaf383dc612a8905aaf42e3 on lightningnetwork:master.


Training/finetuning D0 starting from tf_efficientdet0 weights leads to NaN values in the parameter gradients at a certain point.

When trying to finetune the efficientdet d0 model using (the tensorflow based) pretrained weights for that specific model the loss and model outputs go to NaN values at random moments.
I do not observe this behaviour in the case of doing exactly the same but using the D1 model (and according D1 tf based weights). I also do not observe this behaviour when starting from unpretrained models. This issue also seems to be independent of my learning rate size.
I was mostly wondering if this a known issue? am I missing something particular here?
Many thanks in advance!

When trying to finetune the efficientdet d0 model using (the tensorflow based) pretrained weights for that specific model the loss and model outputs go to NaN values at random moments.
I do not observe this behaviour in the case of doing exactly the same but using the D1 model (and according D1 tf based weights). I also do not observe this behaviour when starting from unpretrained models. This issue also seems to be independent of my learning rate size.
I was mostly wondering if this a known issue? am I missing something particular here?
Many thanks in advance!

Could you please tell me how do you exactly fine-tune. When I do the fine-tuning it gives, me a tensor mismatch error in class_net in spite of changing the # classes according to my custom dataset in the head.


cannot load RPM

Last metadata expiration check: 0:00:31 ago on Fri 20 Sep 2019 04:12:10 PM CEST.
Can not load RPM file: tomboy-ng-0.23-2.x86_64.rpm.
Could not open: tomboy-ng-0.23-2.x86_64.rpm
0n Fedora 31 beta.

Thanks for that report tuxedotje, afraid I will need more information please. I guess you have successfully downloaded the rpm file ?  And are now using an rpm command to install it ?  I don't know if those error messages mean that the rpm command is finding something wrong with the tomboy-ng package or if it cannot find the package.
Could you please show me the commands you are using ?
Maybe type -
ls -la
and then the command you are using. And then copy that part of the screen and paste it here.
(You know, generally, its far better to post a bug report that too long rather than one thats too short !)
Davo

tuxedotje, are you there ?
As a matter of interest, I have just noted that both yum and dnf are generating messages to the effect -
" Problem : conflicting requests
- package tomboy-ng-0.23f-2.amd64 does not have a compatible architecture"

I don't know why, the binary in there is definitly of the right are architecture. And the rpm command works fine. A mystery ..
rpm --install ./tomboy-ng <....etc>
If you have also seen this message, please let me know ....
Davo

On Fedora 31 goto https://github.com/tomboy-notes/tomboy-ng/releases/tag/V0.23  (tomboy-ng install)
click on   tomboy-ng-0.23-2.i386.rpm
"Software" will install . no comments. (Software is the name of an  installer in Fedora, confusing name)
The amd version cannot installed, problems there. (cannot read the problems)

OK, tuxedotje, is your system 32bit or 64bit ?  From what you say, it sounds like it could be 32bit. If you do have a 64bit system, might be worthwhile trying to install a downloaded file from the commandline as root. Using the rpm command - (from memory).
rpm --install ./tomboy-ng.....
You need to be quite specific with the command line, give the full file name with the leading ./   else rpm will try and find the package in its repositories. And, this is a catch, I suspect rpm does not resolve dependencies. I think that should not be a problem, tb-ng does not generally have dependencies that are not normally pre-installed. But, well, you know !
But you can continue using the 32bit if it works OK for you, no problems.
Yeah, "Software" - not much of a name. Thats Gnome's influence, a very strong influence at RedHat. A number of other Distros are doing the same thing. But I guess it means someone, like me who jumps around between distros a lot can always fine what they are looking for, even if its a different app underneath.  In the Ubuntu distros, "Software" does a really bad job of resolving dependancies ! Sigh.

-------- Forwarded Message --------
Subject: 	Re: [tomboy-notes/tomboy-ng] cannot load RPM (#102)
Date: 	Fri, 04 Oct 2019 11:01:31 +0200
From: 	Jaap<EMAIL_ADDRESS>To: 	Jaap Bosman<EMAIL_ADDRESS>On Fri, 2019-10-04 at 10:56 +0200, jjbmac wrote:

Hi Dave davidbannon
On my iMac "Core 2 Duo" 2.66 20-Inch (Early 2008) 2.66 GHz Core 2 Duo
(E8335) (which is 64bit)
in F31 This is not different from the "Software" install.
On another PC Intel i3 64 bit (Fedora 30) different story
[jaap@linux-2 Downloads]$ rpm --install ./tomboy-ng-0.23-2.i386.rpm
error: Failed dependencies:
libX11.so.6 is needed by tomboy-ng-0.23-2.i386
libatk-1.0.so.0 is needed by tomboy-ng-0.23-2.i386
libcairo.so.2 is needed by tomboy-ng-0.23-2.i386
libgdk-x11-2.0.so.0 is needed by tomboy-ng-0.23-2.i386
libgdk_pixbuf-2.0.so.0 is needed by tomboy-ng-0.23-2.i386
libglib-2.0.so.0 is needed by tomboy-ng-0.23-2.i386
libgmodule-2.0.so.0 is needed by tomboy-ng-0.23-2.i386
libgobject-2.0.so.0 is needed by tomboy-ng-0.23-2.i386
libgthread-2.0.so.0 is needed by tomboy-ng-0.23-2.i386
libgtk-x11-2.0.so.0 is needed by tomboy-ng-0.23-2.i386
libpango-1.0.so.0 is needed by tomboy-ng-0.23-2.i386
libpangocairo-1.0.so.0 is needed by tomboy-ng-0.23-2.i386
[jaap@linux-2 Downloads]$
Complete!
[jaap@linux Downloads]$ sudo rpm --install ./tomboy-ng-0.23-
2.i386.rpm [jaap@linux Downloads]$ tomboy-ng -g
(tomboy-ng:7142): Gtk-WARNING **: 10:45:31.944: Unable to locate
theme engine in module_path: "adwaita",
(tomboy-ng:7142): Gtk-WARNING **: 10:45:31.975: Unable to locate
theme engine in module_path: "adwaita",
Gtk-Message: 10:45:32.009: Failed to load module "canberra-gtk-
module"
Gtk-Message: 10:45:32.009: Failed to load module "pk-gtk-module"
On 10/4/19 12:35 AM, davidbannon wrote:

OK, tuxedotje, is your system 32bit or 64bit ? From what you say,
it sounds like it could be 32bit. If you do have a 64bit system,
might be worthwhile trying to install a downloaded file from the
commandline as root. Using the rpm command - (from memory).
rpm --install ./tomboy-ng.....
You need to be quite specific with the command line, give the full
file name with the leading ./ else rpm will try and find the
package in its repositories. And, this is a catch, I suspect rpm
does not resolve dependencies. I think that should not be a
problem, tb-ng does not generally have dependencies that are not
normally pre-installed. But, well, you know !
But you can continue using the 32bit if it works OK for you, no
problems.
Yeah, "Software" - not much of a name. Thats Gnome's influence, a
very strong influence at RedHat. A number of other Distros are
doing the same thing. But I guess it means someone, like me who
jumps around between distros a lot can always fine what they are
looking for, even if its a different app underneath. In the Ubuntu
distros, "Software" does a really bad job of resolving dependancies
! Sigh.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the
thread.

Sorry tuxedotje, I really don't understand the last message (dated October 4th)!
There seems a block that consists of a message forwarded from someone called Jaap using a 64 bit Mac and then a report from a failed install or some 32bit tomboy-ng and a whole lot of reproduced text written by me. Sorry, just what are you trying to tell me ?
Generally, no matter what app you are installing, if you are using a 32 bit system, you should install the 32 bit package, it typically has i386 in its name. If you are using a 64bit system, it will usually have amd64 in its name. Thats the right package for either Intel or AMD systems by the way.
Now, going back to the start of your question, you seem to be trying to install "tomboy-ng-0.23-2.x86_64.rpm", thats not what the install rpm is called, its (in v0.23) "tomboy-ng-0.23-2.amd64.rpm". I have used this naming scheme since the very early days of tomboy-ng. If you have downloaded something with the first name, I suggest you be very careful, that sounds quite suspicious to me.
I am currently testing the next release of tomboy-ng and doing so on quite a lot of different systems including Fedora 30 in several different manifestations. In every case, I find I cannot use yum or dnf but rpm --install ./ works fine and does not seem to trigger any dependancy issues. I did on one occasion all it to install to the "Software" app direct from the web page and that did work but I do not recommend that as it does not show you any warnings or error messages, on some 'spins' it worked, on others it errored out, you can tell the difference.  I recommend downloading the file and then -
sudo rpm --install ./tomboy-ng-0.23-2.amd64.rpm
from the directory you have downloaded to. While I have discovered a number of bugs, mainly i18n related, I have not ever had a problem with the install. But I am testing against Fedora29 and Fedora30. Please remember 31 is still in beta !
For your sake I tried to Fedora31beta but could not get it to run in VB so decided to wait until its just a bit more mature.
Davo

Not heard back from tuxedotje.
As I am about to release v0.25, would be good to know if he is still experiencing issues.
General advice is to download the rpm file, then use the rpm command, at the command prompt, to install.  I do not recommend use the (gnome) 'Software' application, previous experience says its not good at installing anything other than packages in its own official repository.

Have to assume problem related to tool used to install.
On rpm based systems, please use rpm.


Add support for Organization Discussions

For https://github.com/refined-github/refined-github/issues/5485

I don't know what's up with CI. The install is failing:
Run npm ci || npm install
npm ERR! this.before.toISOString is not a function

npm ERR! A complete log of this run can be found in:
npm ERR!     /home/runner/.npm/_logs/2023-02-09T12_08_12_046Z-debug-0.log
npm ERR! this.before.toISOString is not a function

npm ERR! A complete log of this run can be found in:
npm ERR!     /home/runner/.npm/_logs/2023-02-09T12_08_13_095Z-debug-0.log

I think some dependency somewhere is incompatible with Node 18 and it’s failing on CI. I dropped the requirement in the workflow for now, I’ll revisit later.

Thanks to https://github.com/angular/angular-cli/issues/24685 (the only issue on GitHub mentioning that error) I realized that the issue is due to the .npmrc added by #157 😩


AdminAppsRequestsListRequest class missing enterpriseId field

The admin.apps.request.list API method has an optional argument enterprise_id that is not present in the corresponding AdminAppsRequestsListRequest class in the SDK. This argument is present for both the AdminAppsApproveRequest and the AdminAppsRestrictedListRequest classes, but missing from AdminAppsRequestsListRequest. Without this missing attribute, calls to the admin.apps.request.list API endpoint cannot be made with the SDK in situations where the enterprise_id is required instead of the team_id.
Reproducible in:
The Slack SDK version
v1.19.0
Java Runtime version
openjdk 17.0.1 2021-10-19
OpenJDK Runtime Environment (build 17.0.1+12-39)
OpenJDK 64-Bit Server VM (build 17.0.1+12-39, mixed mode, sharing)
OS info
ProductName:    Mac OS X
ProductVersion: 10.15.7
BuildVersion:   19H1519
Darwin Kernel Version 19.6.0: Tue Oct 12 18:34:05 PDT 2021; root:xnu-6153.141.43~1/RELEASE_X86_64
Steps to reproduce:

Use v1.19.0 or lower of the Java Slack API Client
Attempt to get or set the value of enterpriseId on the AdminAppsRequestsListRequest class

Expected result:
The value of enterpriseId can be read or written to.
Actual result:
The attribute enterpriseId does not exist on the class.

Hey @andrewtcobb, thanks a lot for pointing out that the enterprise_id field is missing from AdminAppsRequestListRequest. 🙇🏻
We're thinking that this parameter was added afterwards and is probably missing for the Python and Node.js SDKs as well!
I've labelled this issue as an enhancement and assigned it to our next milestone (it may be triaged to another release). Once confirmed, we'll need to also create issues for the Python/Node.js SDKs.
Appreciate that you took the time to submit this issue! 👍🏻


Change bot name

Great little bot.
Is there a way to change the name that shows up? Its showing the name of the other server I'm relaying from, Was hoping to either use a custom name or the one set in the webhook

Yah, just comment out line 37 and should be good :)

works perfect
thanks :)


App crashes immediately after installing react-native-notifications

Hello,
I installed the library using npm install, and since then the app crashes immediately upon lunching. When I remove the library, the app works fine.
Here is my dependencies:
"dependencies": {
"@react-native-community/async-storage": "^1.10.0",
"@react-native-community/masked-view": "^0.1.10",
"@react-navigation/bottom-tabs": "^5.3.3",
"@react-navigation/native": "^5.2.3",
"@react-navigation/stack": "^5.2.18",
"email-validator": "^2.0.4",
"google-libphonenumber": "^3.2.9",
"lodash": "^4.17.15",
"moment": "^2.25.3",
"react": "16.11.0",
"react-native": "0.62.2",
"react-native-elements": "^2.0.0",
"react-native-gesture-handler": "^1.6.1",
"react-native-image-picker": "^2.3.1",
"react-native-image-resizer": "^1.2.1",
"react-native-keyboard-aware-scroll-view": "^0.9.1",
"react-native-modal": "^11.5.6",
"react-native-reanimated": "^1.8.0",
"react-native-safe-area-context": "^0.7.3",
"react-native-screens": "^2.7.0",
"react-native-vector-icons": "^6.6.0"
What should I do?
Thanks in advance

Check the error with adb logcat *:E maybe could get a clue with that


Cors

Hi i would like to secure my backend with cors so that only my flutter app can communicate with it, or is firebase the only solution?

Hi @noahsalvadordenjo
This issue doesn't seem to describe a bug or a feature request. Please see https://flutter.dev/community for resources and asking questions like this,
you may also get some help if you post it on Stack Overflow and if you need help with your code, please see https://www.reddit.com/r/flutterhelp/
Closing, as this isn't an issue with Flutter itself. If you disagree, please write in the comments and I will reopen it.
Thank you

Currently i haven't found a way to make sure only my flutter app can communicate with the backend even if i use a secret they can always reverse engineer the app and use this secret for malicious actions, maby flutter could send http request from a proxy server so that a backend could use this http url in their cors configuration?


Using zIndexOffset for markerCluster

When building regular L.marker layers, I can pass a marker a zIndexOffset to control what z-index layers are layered at. This works nicely and also works for L.marker's that were not included in a marker group.
But this does not work for markerCluster :(
Is there a way to set a zIndexOffset for markerCluster?
asked the question on stackexchange and the leaflet forum , but got no answer. :(
walter

We create our own markers for the clusters.
https://github.com/Leaflet/Leaflet.markercluster/blob/master/src/MarkerCluster.js
You might be able to listen to events on the MCG and call setZIndexOffset on these markers.
https://github.com/Leaflet/Leaflet.markercluster#events
Maybe clusteradd I forget, you'll have to fiddle around a bit.
HTH, please post your solution if you get somewhere :)

I'm not only talking about the markers for the clusters.
The same is for the unclustered icons of the single objects.
see https://wambachers-osm.website/emergency
jump to germany, activate Emergency Access Points + KWF and zoom to  Z14.
You should see green and brown icons. sometimes green on top and sometimes brown on top.
THAT is my problem.

but i'll check the events too.
btw: that is for comparing two spatial databases (Emergency Access Points comes from OpenStreetMap and KWF comes from a goverment organization. Sometimes they don't match.

Hi @wambacher,
You might be interested in the solution provided in PR #819.
There is a JSFiddle that shows how to implement it already.
The idea is to use custom panes which you can adjust their z-index, so that you make sure some MCG are always above / below others.
You can use similar panes for your individual markers as well.
Hope this helps.

The PR was accepted and is now part of Leaflet.MarkerCluster 1.1.  See the 'markerPane' option here: https://github.com/Leaflet/Leaflet.markercluster#other-options

Hi @ckrahe,
clusterPane option you mean?

I think clusterPane solves this issue.

Oops, yeah, clusterPane :-)

I cant see example of clusterPane :) can any of you give me the clusterPane example if I want to edit markercluster zIndex?

@tenznhok
The example page code is here:
https://github.com/Leaflet/Leaflet.markercluster/blob/master/example/marker-clustering-pane.html
Please feel free to ask a question on Stack Overflow if you need help on how to use Leaflet and/or the plugin.


Explain in upgrade guide how to get rid of the validation error

Follow up to #15285

@bot-gradle test QF

OK, I've already triggered QuickFeedback build for you.


Bad histogram max in RupHistogramPlots.HistScalar.MAG

in RupHistogramPlots.HistScalar.MAG.getHistogram(), max values between 8.5 and 9 are truncated to 8.5 leading to an oversized bin.
Example with oversized bin:

Same data without: oversized bin:

Will be fixed upstream https://github.com/opensha/opensha/pull/83


add recompute report button somewhere

perhaps at the top of the report page? Should probably also catch errors when trying to render the report here https://github.com/SolarArbiter/solarforecastarbiter_dashboard/blob/7f538d90331e27bc145a623aebef580738056462/sfa_dash/blueprints/reports.py#L163

What errors are you seeing pop up at that line?

Trying to load one of the old reports from prod dashboard with new datamodel raises an error in creating the report from the json dict

related: add indicator to a report that is currently being recomputed


Include branch name (and commit counts?) on Minimal push notifications

Problem
We use a lot of feature branches and do a lot of rebases in our workflow, and we like to have Stash notifications come into our general development room alongside our regular dev chatter. Unfortunately, we haven't been able to find a good middle ground with the current options for Push notifications.

Verbose—yeah, we expected this one to be verbose, and it sure is! When doing a rebase, this also brought over comments on the various commits that suddenly were in the new branch history. Way too noisy, so moved down to Compact.
Compact—had really high hopes for this one. During regular development this is great, because it shows the author, branch, SHA1, and summary.

During a rebase, however, this also gets really noisy. It adds a line for each and every commit that was added on the branch being rebased atop. If your branch is dozens (or, heaven forbid, hundreds) of commits behind then this quickly spams your slack room and is painful.
So we decided to try Minimal.

Minimal—unfortunately, this is just too minimal to be useful to us. All it shows is "Push on [repo] by [author]." There is no differentiation between whether it was pushed to master or a feature branch, and it isn't useful for us to find out "hey, somebody just pushed something somewhere."

Proposal
Change Minimal to be just a tiny bit less minimal, displaying at the very least the branch that was pushed to, and ideally the number of commits.
Example: current behavior
Stash: Push on insight by Ben Loveridge <email>. See commit list.
Stash: Push on insight by Ben Loveridge <email>. See commit list.
Example: after
Stash: Push on insight : master by Ben Loveridge <email>. See commit list.
Stash: Push on insight : feature/the_new_thing by Ben Loveridge <email>. See commit list.
Example: after (alternate)
Stash: Push on insight : master by Ben Loveridge <email> (1 commit). See commit list.
Stash: Push on insight : feature/the_new_thing by Ben Loveridge <email> (3 commits). See commit list.

All in all, thanks very much for your plugin, we are putting it to good use, and it is nice that it supports PR operations that the official Stash -> HipChat integration supports (specifically PR approval).

+1

Looks like the "alternate" example has been implemented in 1.7. Great work guys!
Push on SuchRepo branch master by Very Quality<EMAIL_ADDRESS>(1 commit). See commit list.


git's commentChar=auto option is not handled well

Here's a comment generated by running hub pull-request:

Thank you for reporting! I didn't know about auto being a special value. From git documentation:

If set to "auto", git-commit would select a character that is not the beginning character of any line in existing commit messages.

We need to somehow implement this to restore compatibility.

I was looking into this issue, and I noticed that hub will not apply changes to ~/.gitconfig immediately. I.e., I change the commentChar in gitconfig, make the hub pull-request command a couple of times, but the comment character only changes after a few issues of the command. Is this desired behavior?

By the way I've started working on this. I'm currently looking at the Git implementation of selecting the character, so we match, I hope to have a PR this week.
I guess we implement by parsing git rev-list --no-merges HEAD and looking for a comment char that isn't used.

@e-beach
Check this out: https://github.com/git/git/blob/117ddefdb4dfd9b40ae60967a7327754d8ce7a87/builtin/commit.c#L631
Seems like they generate a commit message (empty or using a template) incl. the remarks and the diff. All that is stored in the sb var. Then they go through the list of candidate comment chars (#;@!$%^&|:) and look for a line break immediately followed by a given comment char. Then they change the comment line char accordingly to the results of the algorithm.


Added sass conversion

Converts the Sass to CSS for use in the CSS to Tailwind function

@hymhub sorry if this is not great, I'm new to Open Source development


Liquid Exception: undefined method `[]' for nil:NilClass in index.html

in index.html - {% image vyuka.jpg alt="Vyuka" %}
in config.yml
image:
source: img
output: generated
Any idea what is going on ?
Thanks

+1


Trouble deploying to Amazon Elastic Beanstalk

Firstly I would like to say thanks, I tried many boiler plates to find a good SSR react template and this is by far the best and I now have a fully working website.
I have hit issues trying to deploy to AWS, I have added a local variable for NODE_ENV = production and changed the EB start command to 'node ./index.js' then built the project and deployed to EB.
It fails with unable to find webpack-isomorphic-tools which is required in index.js but is in dev-dependencies in the package.json?  I tried moving to dependencies  but then just get 'waiting for the first webpack build to finish' continuously and a 502 error from the page?
Any idea what I am doing wrong, do I need to move any other packages up to dependencies for this to run in AWS, the 'yarn start:production' works fine on my local machine, but there I obviously have all of the packages anyway?
Again, thanks for a great boiler plate

@djtowns Try to upload all the available packages which are imported from server and client side. And don't forget to upload the "webpack-assets.json" file, which is created by the "webpack-isomorphic-tools" to your host.

You are a genius, prompted me to check the uploaded package on S3, my mistake was I had not created a .ebignore file, so it was using the .gitignore file and not uploading anything in build! All working now, genius 😊

@djtowns Congrates buddy:)


thrift_proxy: crash when client closes mid-request

Remote close of a downstream thrift connection mid-request results in a segmentation fault in ConnectionImpl.
Repro steps:
Transmit a partial thrift request and then close the connection.
Admin and Stats Output:
Crash prevents retrieving admin/stats output.
Config:
Not available
Logs:
Not available, but call stack is sufficient to diagnose.


image-inspector: updating arguments for authentication

Authentication with the service account will allow image-inspector to pull images from the Openshift registry with authentication.
This patch has to wait on a new version of image for docker.il/openshift/image-inspector that is including the patch https://github.com/simon3z/image-inspector/pull/1

@miq-bot add_label wip

@simon3z this one has some time to go before being merged, but FYI

@enoodle I just released the official image to docker.io/openshift/image-inspector:v1.1.z so you can finalize this PR.
Remove all the WIPs (title and label) and re-test with the official image. Thanks.

@enoodle also, let's think of this (cc @deads2k)... what happens specifying username and passwords... they're probably used against all registries (also the dockerhub).
So we may want to reconsider and switch back to dockercfg since as far as I remember it describes the usernames/passwords per-registry (e.g. {"<IP_ADDRESS>:5000":{"username":"serviceaccount","password":"eyJ...)

@simon3z it is no problem changing to a dockercfg file, but which one do you suggest using? the one of management-image-scanner ?

@miq-bot remove_label wip

@simon3z PTAL

@enoodle how hard is it to add a spec test to make sure that the arguments are passed?

@simon3z I added the new spec.

Now that #8291 is merged, closed/reopened to restart Travis

@simon3z please review.  Also, is this for darga or later?

@miq-bot add_label darga/yes

@chessbyte this is for darga but we're not ready for merge. We must wait for the container image to be available.

LGTM :+1: we may need @blomquisg and @Fryguy to make the code nicer, but other than that I think it can be merged.


Error photo when resize and upload photo to S3

Hi Guys,
I am using Intervention/image to resize photo.
I can resize photo, but when upload this photo to S3, have error for that photo as http://take.ms/K5se9
I am using laravel 4.2
Code:
$photo = Input::file('photo');
$img = Image::make($photo);
$crop = max($width, $height);
$img->resizeCanvas($crop, $crop, 'center', false, 'fafafa');
$img->save('abc.jgp');
Upload::pushToS3('abc.jgp');
I think: when $img is resizing and saving => at the same time, system run pushToS3 function.
How to fix it?
Many thanks.

I dont' know what "pushToS3" does, but I would not use save() to write into the local filesystem, if you want it in S3 anyway. I would use encode() to get the image data directly and push the output of this method to S3.


Strange results, request interpretation

Thank you so much for developing such great software! Recently, I’ve been using >90 Gb of HiFi data to perform a genome survey on a rodent species, using k-mer 256 and k-mer 21, but the results seem to differ significantly from my expectations (because there’s an online genome for the same species, which is about ~3.X Gb in size, consistent with the flow cytometry results C-value 3.7). Here’s my command line:
cat $fastq | /usr/bin/time -v jellyfish count -o spe_256.jf -m  256  -s 3G  -t 50 --disk /dev/stdin
jellyfish histo -t 50 spe_256.jf > spe_256.histo
genomescope2 -i spe_256.histo -o k256 -p 2 -k 256

The k-mer 21 analysis used a similar command.
Here’s the summary.txt for k-mer 256:
GenomeScope version 2.0
input file = spe_256.histo
output directory = kmer256
p = 2
k = 256

property                      min               max
Homozygous (aa)               94.6341%          100%
Heterozygous (ab)             0%                5.3659%
Genome Haploid Length         423,532,323 bp    429,588,336 bp
Genome Repeat Length          84,381,523 bp     85,588,080 bp
Genome Unique Length          339,150,800 bp    344,000,257 bp
Model Fit                     79.2296%          86.8827%
Read Error Rate               0.377496%         0.377496%

And here are the transformed_linear_plot.png

and transformed_log_plot.png

Here’s the summary.txt for k-mer 21:
GenomeScope version 2.0
input file = spe_21.histo
output directory = k21
p = 2
k = 21

property                      min               max
Homozygous (aa)               95.1379%          95.924%
Heterozygous (ab)             4.07599%          4.86215%
Genome Haploid Length         54,290,519 bp     56,337,190 bp
Genome Repeat Length          45,002,897 bp     46,699,439 bp
Genome Unique Length          9,287,622 bp      9,637,751 bp
Model Fit                     35.1265%          85.0695%
Read Error Rate               7.13116%          7.13116%

And here are the transformed_linear_plot.png

and transformed_log_plot.png

Additionally, it is worth mentioning that the contigs assembled by hifiasm using the default parameters show the following graph after using purge_haplotigs hist, which may indicate that the genome's heterozygosity is not as high as predicted by GenomeScope2 here

Could you please help me understand why the results are like this, and how I can improve to obtain more accurate results? The k-mer 256 results should be more accurate, but it seems the observed results do not fit well with the full model.
Looking forward to your reply. I would greatly appreciate your help if you can offer it!

I would not use k=256 as this will really complicate the analysis. But the
fit for k=21 is also really poor and does not show a clear peak. Are you
sure you are looking at the CCS reads- from the shape of the distribution
it looks like there are some lower quality reads present. Can you try
FastQC on the data to make sure the reads have a QV around 30.
Good luck
Mike
On Thu, Aug 22, 2024 at 2:08 AM YPGG1234 @.***> wrote:

Thank you so much for developing such great software! Recently, I’ve been
using >90 Gb of HiFi data to perform a genome survey on a rodent species,
using k-mer 256 and k-mer 21, but the results seem to differ significantly
from my expectations (because there’s an online genome for the same
species, which is about ~3.X Gb in size, consistent with the flow cytometry
results C-value 3.7). Here’s my command line:
cat $fastq | /usr/bin/time -v jellyfish count -o spe_256.jf -m  256  -s 3G  -t 50 --disk /dev/stdin
jellyfish histo -t 50 spe_256.jf > spe_256.histo
genomescope2 -i spe_256.histo -o k256 -p 2 -k 256
The k-mer 21 analysis used a similar command.
Here’s the summary.txt for k-mer 256:
GenomeScope version 2.0
input file = spe_256.histo
output directory = kmer256
p = 2
k = 256
property                      min               max
Homozygous (aa)               94.6341%          100%
Heterozygous (ab)             0%                5.3659%
Genome Haploid Length         423,532,323 bp    429,588,336 bp
Genome Repeat Length          84,381,523 bp     85,588,080 bp
Genome Unique Length          339,150,800 bp    344,000,257 bp
Model Fit                     79.2296%          86.8827%
Read Error Rate               0.377496%         0.377496%
And here are the transformed_linear_plot.png
image.png (view on web)
https://github.com/user-attachments/assets/560656a5-52b3-4869-bf75-edd6b6edcfea
and transformed_log_plot.png
image.png (view on web)
https://github.com/user-attachments/assets/efebe568-e9cb-4e34-8c77-876cf392eda5
Here’s the summary.txt for k-mer 21:
GenomeScope version 2.0
input file = spe_21.histo
output directory = k21
p = 2
k = 21
property                      min               max
Homozygous (aa)               95.1379%          95.924%
Heterozygous (ab)             4.07599%          4.86215%
Genome Haploid Length         54,290,519 bp     56,337,190 bp
Genome Repeat Length          45,002,897 bp     46,699,439 bp
Genome Unique Length          9,287,622 bp      9,637,751 bp
Model Fit                     35.1265%          85.0695%
Read Error Rate               7.13116%          7.13116%
And here are the transformed_linear_plot.png
image.png (view on web)
https://github.com/user-attachments/assets/517edc6b-bbb0-42b3-9dbc-9355994b20e0
and transformed_log_plot.png
image.png (view on web)
https://github.com/user-attachments/assets/e45324fd-eb93-48b9-a772-53e030dc472e
Could you please help me understand why the results are like this, and how
I can improve to obtain more accurate results? The k-mer 256 results should
be more accurate, but it seems the observed results do not fit well with
the full model.
Looking forward to your reply. I would greatly appreciate your help if you
can offer it!
—
Reply to this email directly, view it on GitHub
https://github.com/schatzlab/genomescope/issues/136, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AABP345GA2VQFKLG54A4PJ3ZSV55HAVCNFSM6AAAAABM5M7CTSVHI2DSMVQWIX3LMV43ASLTON2WKOZSGQ3TSOJRHA2TKOI
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

Thank you for your prompt response! The CCS sequences we are using are of very high quality, as shown in the image below:

At one point, we suspected that contamination might be present, leading to evaluation issues, but from the assembled contigs, it seems that this problem has a minimal impact (the "undef" and unmapped contigs is most likely due to the absence of this species in the NT database and Swissprot database).

It seems like something went really wrong - perhaps jellyfish crashed
before processing all of the reads. Can you send spe_21.histo?
Thanks!
Mike
On Sun, Aug 25, 2024 at 11:37 PM YPGG1234 @.***> wrote:

Thank you for your prompt response! The CCS sequences we are using are of
very high quality, as shown in the image below:
image.png (view on web)
https://github.com/user-attachments/assets/f6329999-1d3d-459a-96ab-8950f2f33354
At one point, we suspected that contamination might be present, leading to
evaluation issues, but from the assembled contigs, it seems that this
problem has a minimal impact (the "undef" and unmapped contigs is most
likely due to the absence of this species in the NT database and Swissprot
database).
image.png (view on web)
https://github.com/user-attachments/assets/c3b38fb7-599d-40f3-8c08-9c8ca66e487a image.png
(view on web)
https://github.com/user-attachments/assets/32e3581c-fc29-46ab-8681-ba36656b8512
—
Reply to this email directly, view it on GitHub
https://github.com/schatzlab/genomescope/issues/136#issuecomment-2309240615,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AABP346EBSHAZHRGG4YBJ5DZTKPH7AVCNFSM6AAAAABM5M7CTSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMBZGI2DANRRGU
.
You are receiving this because you commented.Message ID:
@.***>

Here is the spe_21.histo file.
spe_21.histo.txt

Sorry, mschatz, regarding the input file for k21, there were some issues at that time: I only used 20-30% of the ~90 Gb data for the survey. When I used all the data for the survey, the results looked much better:

However, there is still a significant difference compared to the estimated genome size (~3.X Gb). Here is the new spe_21.histo.
spe_21.all.histo.txt

Yes, you have to provide all of the data to genomescope to get a good
estimate. I noticed in your jellyfish command that you are not including
the "-C" flag to consider canonical kmers. Can you try again with that
flag? That flag is needed to merge together coverage from the forward and
reverse strands. And can you also try using a higher maximum kmer frequency
(-h). For a mammalian genome I would try setting it to one million:
"jellyfish histo -h 1000000"
Good luck!
Mike
On Mon, Aug 26, 2024 at 3:16 AM YPGG1234 @.***> wrote:

Sorry, mschatz, regarding the input file for k21, there were some issues
at that time: I only used 20-30% of the ~90 Gb data for the survey. When I
used all the data for the survey, the results looked much better:
transformed_linear_plot.png (view on web)
https://github.com/user-attachments/assets/c2ca76f0-8fe1-492d-8fb6-2ec7258a95aa
However, there is still a significant difference compared to the estimated
genome size (~3.X Gb). Here is the new spe_21.histo.
spe_21.all.histo.txt
https://github.com/user-attachments/files/16745395/spe_21.all.histo.txt
—
Reply to this email directly, view it on GitHub
https://github.com/schatzlab/genomescope/issues/136#issuecomment-2309506528,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AABP347X3HPK5DCIBP2756LZTLI45AVCNFSM6AAAAABM5M7CTSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMBZGUYDMNJSHA
.
You are receiving this because you commented.Message ID:
@.***>

Great! These values look much more reasonable here.
The plot looks pretty reasonable to me. The estimated heterozygosity rate
(0.832%) is higher than a typical human (~0.2%) but not that surprising for
a rodent. What are you concerned about?
Good luck!
Mike
On Wed, Aug 28, 2024 at 4:36 AM YPGG1234 @.***> wrote:

Thank you for your response! I tried the parameters you suggested, and the
results seem much more normal.
Here is the summary.txt:
GenomeScope version 2.0
input file = spe_21.histo
output directory = k21
p = 2
k = 21
property                      min               max
Homozygous (aa)               99.1438%          99.1917%
Heterozygous (ab)             0.808265%         0.856189%
Genome Haploid Length         2,980,569,086 bp  2,986,393,468 bp
Genome Repeat Length          1,004,873,034 bp  1,006,836,674 bp
Genome Unique Length          1,975,696,052 bp  1,979,556,794 bp
Model Fit                     66.9321%          96.528%
Read Error Rate               0.0804272%        0.0804272%
However, the transformed_linear_plot.png still looks strange:
image.png (view on web)
https://github.com/user-attachments/assets/b1fb9dc0-bd94-4916-a42a-97ad29c84151
It still doesn't seem to have a clear bimodal distribution, and two peaks
appear at <20x and >60x. What could be causing this? Why is the bimodal
distribution still not appearing? Looking forward to your reply.
—
Reply to this email directly, view it on GitHub
https://github.com/schatzlab/genomescope/issues/136#issuecomment-2314685281,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AABP345225VPSWZGKPXAE4TZTWDXHAVCNFSM6AAAAABM5M7CTSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMJUGY4DKMRYGE
.
You are receiving this because you commented.Message ID:
@.***>

In fact, in my expectation, the results of the SURVEY should be consistent with the figure below. I'm sorry, but this probably stems from my lack of understanding of how genomescope2 works.
https://www.researchgate.net/figure/Visual-overview-of-genome-assembly-metrics-A-K-mer-spectra-output-generated-from-PacBio_fig2_ 371697348

I think I understand. In the example you linked, there is a high rate of
heterozygosity (1.5%) so there are two well defined peaks. Your sample has
a lower rate of heterozygosity so the first peak is less well defined,
although is still clearly visible. This is entirely expected - the relative
heights of the two peaks is proportional to the rate of heterozygosity. You
also have relatively low amounts of coverage for this type of analysis -
with high coverage the peaks will be better separated but here your peaks
are overlapping. But GenomeScope uses a statistical method called a mixture
model to figure this out.
For context, here is supplemental figure 1 from the GenomeScope paper
showing how the rate of heterozygosity impacts the relative heights of the
peaks (this is also with 100x coverage so the peaks are well separated)
[image: image.png]
Hope this helps!
Mike
On Wed, Aug 28, 2024 at 10:15 AM YPGG1234 @.***> wrote:

In fact, in my expectation, the results of the SURVEY should be consistent
with the figure below. I'm sorry, but this probably stems from my lack of
understanding of how genomescope2 works.
https://www.researchgate.net/figure/Visual-overview-of-genome-assembly-metrics-A-K-mer-spectra-output-generated-from-PacBio_fig2_
371697348
—
Reply to this email directly, view it on GitHub
https://github.com/schatzlab/genomescope/issues/136#issuecomment-2315458394,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AABP344DYLQDKUGPL7W2W7DZTXLO3AVCNFSM6AAAAABM5M7CTSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMJVGQ2TQMZZGQ
.
You are receiving this because you commented.Message ID:
@.***>


Naming providers should be more independent from platform structure

Naming providers (ENS, ZIL, FIO) are only a few, and not necessary closely part of the respective platform.  They should be more separated:
Naming provider instances are created separately from platforms (getNamingHandlers), so they should be also Init()ed separately.
Naming provider implementations should be taken out easily to create a service for naming lookups.

Duplicated


fix: properly sort chunking in y-partykit for big values

So, out persistence layer has a 128kb limit on values, but y-partykit should/could be used for documents bigger than that. So we implemented a chunking strategy that break up values across multiple keys. When making keys for these, we didn't pad the generated indexes, which meant that for sufficiently large values, we might have assembled them back in the wrong order (because lexicographical sorting). This is a fix for that. It's a breaking change, but oddly I haven't heard from people who've faced the problem at all.

This might break existing projects, so I'm a bit concerned. Wondering if there's a workaround / fix / migration...

Ok I tested it and it didn't seem to break anything? Landing this now


⚠ Jenkins Plugins Artifactory has degraded performance

In f97c4a0, Jenkins Plugins Artifactory (https://get.jenkins.io/plugins/artifactory/) experienced degraded performance:

HTTP code: 200
Response time: 1149 ms

Resolved: Jenkins Plugins Artifactory performance has improved in f861ffd after 31 minutes.


How to use mavsdk-python to send a heartbeat packet from the ground station to the flight controller？

I'm trying to make a ground station and need to send heartbeat packets to the flight controller, but I can't find the API?

If you run mavsdk_server manually, you need to set the address of the drone there. Something like this:
./mavsdk_server udp://<IP_ADDRESS>:14557

Where <IP_ADDRESS> is the IP of the drone and 14557 the port on which the drone is listening for MAVLink.
If you run the embedded mavsdk_server, you have to do it in the await drone.connect(...) call, as documented here:
drone = System()
await drone.connect(system_address="udp://<IP_ADDRESS>:14557")

Finally, note that the "usual" way with PX4 is that the drone broadcasts heartbeats (on 14550/udp) and the ground station picks it up, rather than what you are trying to do here (which is fine as well).

Thank you, I can receive messages and send commands normally, but when I use the QGC ground station to connect to the flight controller, the buzzer of the flight controller will sound to indicate that the ground station is connected (there will be a difference sound when the connection is disconnected), but when I use mavsdk-python to connect to the flight control, the flight control will not make any sound. Then I searched some information and did some tests and confirmed that the ground station should send heartbeat packet to the flight control. I think Make a ground station with the same function as QGC based on mavsdk-python. I am new to the ground station. I can't confirm the purpose of the heartbeat packet sent by the ground station to the flight controller, but QGC does this. Unfortunately, I did not find an API for sending heartbeat packets in the documentation

So if MAVSDK detects the drone, it will automatically send back HEARTBEATS. The typical way is to have MAVSDK listen on 14550 or (by default) 14540 for heartbeats coming from the drone.
Now depending on your setup, it could be that the drone can send messages to MAVSDK, but messages coming back from MAVSDK do not reach the drone for some reason.
An easy way is to try MAVSDK with SITL first. For instance, run this (it will run SITL), and run one of the MAVSDK python examples.

I want to make a ground station with the same function as QGC based on mavsdk-python

Yes that should be feasible, MAVSDK is there for that :blush: :+1:

MAVSDK automatically sends heartbeats not working for me, Other than that, I wanted to control the relay, but I couldn't find the API，I found MavlinkPassthrough in the documentation and it seems that only it meets my needs

If MAVSDK cannot send heartbeats to your drone, MAVSDK won't be able to send anything at all. Be it with mavlink-passthrough or not.
You need to understand why in your network topology messages can go from the drone to the MAVSDK (they do, right?) but not from MAVSDK to the drone.


library bloats build output with more than 100M

The library forces a huge penalty of 100M that are not needed at all or just partially.
aws-sdk ~= 90M
If used by a lambda, none of the libs needed. If used by a server, only the version v2/v3 needed.
Probably the correct way is to ensure it loads correctly for the version we need.
Also, the dependencies should probably be peerdependcies.
    "node_modules/typesafe-dynamodb": {
      "version": "0.2.6",
      "resolved": "https://registry.npmjs.org/typesafe-dynamodb/-/typesafe-dynamodb-0.2.6.tgz",
      "integrity": "sha512-zSlEZM3gJF1Hl6nMOAC5t7XAkGjdx5HZW2cGn9GNz4KABn+e+vHp65dShXZSKqHDVDGvUieELQ93gdVZPpKl5w==",
      "dependencies": {
        "@aws-sdk/client-dynamodb": "^3.429.0",
        "@aws-sdk/lib-dynamodb": "^3.429.0",
        "@aws-sdk/smithy-client": "^3.374.0",
        "@aws-sdk/types": "^3.428.0",
        "@aws-sdk/util-dynamodb": "^3.429.0",
        "@types/aws-lambda": "^8.10.124",
        "aws-sdk": "^2.1474.0"
      }
    },

Here's a PR setting the dependencies all as peer.
I think the assumption I made when I wrote this library is that it would be included as a devDependency, hence these are dependencies?
Are you including typesafe-dynamodb as a dep or dev-dep?
Do you think I should also make these dependencies optionalDependencies?

Hi,
Thanks for your quick responses. Great job with the library!
Regarding you comments: if we only used types, then we could import type {Foo} from 'bar and leave  bar as a devDependency.
I think this is still possible, and that many can probably use only parts of your library that only export types and thus only import types.
However, when using parts that export code (constant vars, functions) such as *-item-commands, attribute-value you must include the code in the compiled output and/or reference it during runtime. So the library can no longer be a devDependency and its dependencies are pulled in as well.
With regard to the second issue: the inclusion of both V2 and V3 in the code. This is only of course important for those using the the code, not just types.
No doubt that in this case should not force library clients to import such a huge library like aws-sdk (at any version) if they do not need it. optionalDependencies are a good way to avoid it.
BTW - we have experience lots of conflicts between aws sdk libraries and sub libraries and came to realize that its best to use the version provided with the aws runtime (e.g lambda environment) and not bring your own sdk dependecies. This is any additional reason when it Its best to avoid this nailing versions with aws and/or requiring to include the sdk in your code.

Re-opening the issue since it was closed by previous PR. Want to check that there is not a lingering problem here.

However, when using parts that export code (constant vars, functions) such as *-item-commands, attribute-value you must include the code in the compiled output and/or reference it during runtime. So the library can no longer be a devDependency and its dependencies are pulled in as well.

Can you elaborate more? Is this solved by peer and optional dependencies? My understanding is that you can export values using types from a peer dependency. Is that what you mean?
Also, I have been considering dropping the aws-sdk dependency and simplifying the code to go all in on V3. Do you use V2? Considering it's deprecated by AWS, it might be worth removing it.

Go all in on V3 IMO


WIP: Adding fixes for numerical stability

There are two majors types of fixes here

Multiple exponentiation steps have been removed, and now most computations are only in log coordinates
The mean loss is reported rather than the sum
Negative Binomial only works with log inputs

Note that this is only on the Negative Binomial + LDVAE. There are likely a lot more issues downstream.

Thank you for the contribution. I think what you're proposing here would require major global backend changes.  I think it might be more worthwhile to identify what is causing the nan NB log likelihood. My intuition is that the library size parameter is exploding. A simple thing to do would be to add a clamp to that parameter (note library is generally on the log scale in the scVI code). Otherwise, I'm sure there's some anomaly detection in pytorch.

@adamgayoso thanks for the review.
The exploding library size issue is another discussion - I have a feeling that this can be replaced with a constant Poisson offset (see here for an example) (probably going to test this out later).
But regarding the log parameterization of NB, I've seen this issue reappear in multiple contexts at this point, in my own packages and in Stan. I realize that this is going to require a major overhaul, but it is likely going to worthwhile, since it'll make this package more robust.

Hi @mortonjt,
Thanks for contributing to scVI,
A) I am not convinced that working on log space will help because of the log of sum that Adam pointed out, though I am not familiar with the parameterization you sent. Can you point out some ressources that show some improvement / evidence on other packages maybe?
B) What seems more worth investigating to me is whether using l as observed makes the problem go away:

l = sum(UMIs in the given cell)
We had a lot of trouble with l, had to clamp it sometimes etc.. so we know that this is a recurring issue.

C) Also, it might be a learning rate or an initialization problem? It would help to have a detailed diagnostic of what is going wrong on your use case.
Thanks,

Hi @romain-lopez , I think that is reasonable.  This PR still has a bit of a ways to go (hence the WIP).
Regarding the logexpsum, there are better numerical techniques for handling that (see this blog post).
Diagnostics will be up next.

Here is an example to reproduce the issue (after installing my fork with pip install git+https://github.com/mortonjt/scVI.git@biom
    import numpy as np
    from scvi.dataset import BiomDataset
    from scvi.inference import UnsupervisedTrainer
    from scvi.models import LDVAE

    from mavi.utils import load_unsupervised, save_unsupervised

    url = r'https://github.com/biocore/American-Gut/blob/master/data/AG/AG_100nt.biom?raw=true'
    dataset = BiomDataset(filename='AG_100nt.biom', url=url, save_path="tests/data")
    train-size = 0.8
    epochs = 300
    n_latent = 16
    n_layers_encoder = 2
    n_hidden = 64
    reconstruction_loss = 'nb'
    learning_rate = 1e-4
    gpu = True
    vae = LDVAE(dataset.nb_genes, dataset.n_batches, dataset.n_labels,
                n_latent=n_latent,
                n_layers_encoder=n_layers_encoder,
                n_hidden=n_hidden,
                reconstruction_loss=reconstruction_loss,
                latent_distribution=latent_distribution)
    trainer = UnsupervisedTrainer(vae, dataset, train_size=train_size,
                                  use_cuda=gpu)
    trainer.train(n_epochs=n_epochs)

    posterior = trainer.create_posterior(
        trainer.model, dataset, indices=np.arange(len(dataset)))

Below is the error that I get
[2020-05-11 18:35:23,274] INFO - scvi.dataset.dataset | Remapping labels to [0,N]
[2020-05-11 18:35:23,276] INFO - scvi.dataset.dataset | Remapping batch_indices to [0,N]
[2020-05-11 18:35:23,307] INFO - scvi.dataset.dataset | Computing the library size for the new data
[2020-05-11 18:35:23,315] INFO - scvi.dataset.dataset | Downsampled from 22742 to 22742 cells
[2020-05-11 18:35:29,896] INFO - scvi.inference.inference | KL warmup phase exceeds overall training phaseIf your applications rely on the posterior quality, consider training for more epochs or reducing the kl warmup.
[2020-05-11 18:35:29,896] INFO - scvi.inference.inference | KL warmup for 400 epochs
training:  89%|████████▊ | 266/300 [05:27<00:41,  1.23s/it][2020-05-11 18:40:57,285] WARNING - scvi.inference.trainer | Model training loss was NaN
/mnt/home/jmorton/venvs/mmvec-torch/lib/python3.6/site-packages/numba/np/ufunc/parallel.py:355: NumbaWarning: The TBB threading layer requires TBB version 2019.5 or later i.e., TBB_INTERFACE_VERSION >= 11005. Found TBB_INTERFACE_VERSION = 6103. The TBB threading layer is disabled.
  warnings.warn(problem)
Traceback (most recent call last):
  File "/mnt/home/jmorton/venvs/mmvec-torch/bin/mavi", line 7, in <module>
    exec(compile(f.read(), __file__, 'exec'))
  File "/mnt/home/jmorton/software/mavi/scripts/mavi", line 74, in <module>
    mavi()
  File "/mnt/home/jmorton/venvs/mmvec-torch/lib/python3.6/site-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/mnt/home/jmorton/venvs/mmvec-torch/lib/python3.6/site-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/mnt/home/jmorton/venvs/mmvec-torch/lib/python3.6/site-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/mnt/home/jmorton/venvs/mmvec-torch/lib/python3.6/site-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/mnt/home/jmorton/venvs/mmvec-torch/lib/python3.6/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/mnt/home/jmorton/software/mavi/scripts/mavi", line 53, in unsupervised
    trainer.train(n_epochs=n_epochs)
  File "/mnt/home/jmorton/software/scVI/scvi/inference/trainer.py", line 177, in train
    self.on_training_loop(tensors_list)
  File "/mnt/home/jmorton/software/scVI/scvi/inference/trainer.py", line 201, in on_training_loop
    self.current_loss = loss = self.loss(*tensors_list)
  File "/mnt/home/jmorton/software/scVI/scvi/inference/inference.py", line 109, in loss
    sample_batch, local_l_mean, local_l_var, batch_index, y
  File "/mnt/home/jmorton/venvs/mmvec-torch/lib/python3.6/site-packages/torch/nn/modules/module.py", line 547, in __call__
    result = self.forward(*input, **kwargs)
  File "/mnt/home/jmorton/software/scVI/scvi/models/vae.py", line 316, in forward
    reconst_loss = self.get_reconstruction_loss(x, px_rate, px_r, px_dropout)
  File "/mnt/home/jmorton/software/scVI/scvi/models/vae.py", line 219, in get_reconstruction_loss
    -NegativeBinomial(mu=px_rate, theta=px_r).log_prob(x).sum(dim=-1)
  File "/mnt/home/jmorton/software/scVI/scvi/models/distributions.py", line 95, in __init__
    super().__init__(validate_args=validate_args)
  File "/mnt/home/jmorton/venvs/mmvec-torch/lib/python3.6/site-packages/torch/distributions/distribution.py", line 36, in __init__
    raise ValueError("The parameter {} has invalid values".format(param))
ValueError: The parameter mu has invalid value

Still need to sanity check with @adamgayoso's comments - so more details to come.

Hi @mortonjt, I took a look at the dataset you linked,
The L1 norm of each observation (library size) ranges from 1 to 7,233,319.
The mean and variance of the log library size:
In [16]: np.var(np.log(X.sum(axis=1)))
Out[16]: 7.068304947329521

In [17]: np.mean(np.log(X.sum(axis=1)))
Out[17]: 3.248720784509202

It seems that taking \ell as observed will likely fix your issue, though this requires non-trivial coding to do.
Are you planning on refactoring all models and modules to operate on the log scale? Right now it seems like you're only targeting the LDVAE?

Hi @adamgayoso thanks for taking a closer look!
I have applied the torch.clamp approach as suggested earlier, and that actually seems to be giving promising results. Below is an example on the Human Microbiome Project when distinguishing body site (this is expected to give obvious clusters).

I haven't quite gotten the same results with the numerical stability changes in the PR - so there are still some bugs in the pull request.  I wasn't planning on touching the other PRs (mainly because I'm not planning on using the other modules).  But I'll continue hacking away at this as more edge cases pop up.

I'm going to close this PR as all the code has changed. We are exploring this problem in the context of our new code.

Sounds good. I don't think this has a problem any more.
On Wed, Sep 16, 2020, 6:04 PM Adam Gayoso<EMAIL_ADDRESS>wrote:

Closed #663 https://github.com/YosefLab/scvi-tools/pull/663.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/YosefLab/scvi-tools/pull/663#event-3775511143, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AA75VXOMOPZ7SS5EJXA5YLDSGFHAJANCNFSM4MSMAV3A
.


Smallest Text Detection elements for Chinese are lines, not characters

According to the documentation at https://developers.google.com/ml-kit/vision/text-recognition:

an Element is a contiguous set of alphanumeric characters ("word") on the same axis in most Latin languages, or a character in others

I'm initialising a text recogniser like so:
    final RecognizedText recognizedText = await textRecognizer.processImage(inputImage);
    textRecognizer.close();

    final blocks = <OcrResultBlock>[];
    for (final block in recognizedText.blocks) {
      for (final line in block.lines) {
        if (!line.recognizedLanguages.contains('zh')) {
          continue;
        }

        for (final element in line.elements) {
        ...

What I'm seeing is that at the element level, text is still grouped into contiguous lines—not individual characters, and not even compound words and phrases.

@craigomac: could you compare running the native example, use the same image and let us know if for the native the API is also returning the same for elements.
https://github.com/googlesamples/mlkit

Thanks @fbernaly. I verified that the native frameworks have the same behaviour and have raised this as a bug with MLKit here: https://github.com/googlesamples/mlkit/issues/535.


Found a kind of odd conflict with Artifacts

Obviously not every mod is going to work with each other so I don't mean to be annoying by reporting another.
However, this mod doesn't seem to do anything similar to yours so I found the conflict strange and thought I should post it.
The mod Artifacts adds some Trinket accessories: https://www.curseforge.com/minecraft/mc-mods/artifacts-fabric
Running it alongside PlayerEx causes world generation to become unresponsive and crash the game. The only mods being used are Artifacts (and Trinkets, as its a dependency) as well as PlayerEx and FabricAPI. I've attached a crash log from regular MC and Not Enough Crashes.
regularcrash.txt
notenoughcrashes.txt
Let me know if you think I should post this on the Artifacts github.

Hi there,
Yeah this is a weird one; there's nothing in either of these mods that effects world gen. Thanks for sending the logs, I'll look into it asap.

Fixed with v2.0.2 (although some weird interactions remain with, for example, steadfast slippers - that give 100% knockback resistance - no more crashes though, hopefully).


Remove synchronous filter methods in v4

The deprecated methods should be removed entirely, so that no one ever deploys asynchronous filter code linked to a stable v4 version of web3.

Closed by #416


Snippet for checking armstrong number

Description

Added new snippet
Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[x] My code follows the code style of this project.
[x] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[x] I have checked that there isn't any PR doing the same
[x] I have read the CONTRIBUTING document.

Done :)

for fun and future reference, but like I said the amount of parenthesis and the order of passing makes it really confusing
const isArmstrongNumber = digits => ( arr => arr.reduce( ( a, d ) => a + Math.pow( parseInt( d ), arr.length ), 0 ) == digits ? true : false )( ( digits+'' ).split( '' ) )

@skatcat31 check it out now...

Other than doing a parse where not needed, it looks great!

done :)

toss up between the two line version and the closure version, but a great add nonetheless!


sokol_gfx.h: investigate depth texture support

I was toying with deferred rendering (GL backend) and just noticed that for 'depth images' you use renderbuffers instead of textures.
you cant read from renderbuffers afaik. So any workarounds ?
really good set of libraries by the way ! big up

I remember that I had some trouble in the past with renderable depth textures, since this requires a WebGL extension (WEBGL_depth_texture), support for this seems to be pretty good now though.
A workaround which definitely works across all platforms is encoding depth in a separate RGBA8 render target in a separate pass (this also avoids the use of floating point render targets, which may be another compatibility issue).
I did this here for the shadow mapping:
http://floooh.github.io/oryol-samples/wasm/BulletPhysicsBasic.html
The interesting stuff is here:
https://github.com/floooh/oryol-samples/blob/master/src/BulletPhysicsBasic/shaders.shd
I'm not sure if sampling from depth textures can be implemented in a 100% cross-platform-compatible way (with the SPIRV-Cross based shader compiler), but I'll keep the feature in mind.

Closing this preliminary as fixed, see this comment for details:
https://github.com/floooh/sokol/issues/576#issuecomment-1527810831


ethereum: Update web3 and ethabi

This rebases our web3 fork, which reduces the required patches. They have been submitted upstream https://github.com/tomusdrw/rust-web3/pull/616 so we might be able to drop the fork.
This also does a pass at some other deps such as rand, bytes and uuid.

This needs a rebase


[hotfix] fix website request analyzer

Moved PR #1586 to master branch as hotfix
The WebsiteRequestAnalyzer sets the request format by exploding the requested file name by dots and extract the format from the resulting array. When a filename has multiple dots in it, the second item will be set as the request format (and not the last one as it should be).
This is behaviour is fixed by this PR.
Example:
A request for bootstrap.min.css results the file format min. Expected would be css
informations:

q
a

Fixed tickets
none

BC breaks
none

Documentation PR
none

I think something is wrong with the StyleCI check. It shows an error in src/Sulu/Component/Content/Compat/Block/BlockPropertyWrapper.php which I haven't changed.

Don't worry about the styleci check, it's currently only working for develop, will be fixed with the next minor release. I'd like to wait for travis anyway.

@tschreiner thanks for contributing (: you will be released today!

@tschreiner nice PR. if you want to join or discussion on Sulu, we got a slack channel. http://sulu.io/en/contact we'd love to hear what you are doing with Sulu.


Unified Auth

It would be nice to have some way of generating auth strings (tokens) for clients, which is agnostic of the specific backend. However, this (more than likely) may not be possible as the backend may dictate the token standard. See "Open Questions" below.
First, implement out-of-the-box auth for the rest of the implementations: https://github.com/WIPACrepo/MQClient-GCP, https://github.com/WIPACrepo/MQClient-NATS, and https://github.com/WIPACrepo/MQClient-RabbitMQ
Open Questions

Is there an already-unified token standard? Probably not.
Is it fine for the spawner process to be cognizant of its child's chosen backend?
Is there a way to factorize the creation of a token depending on the backend, pre-spawn? Then pass it to the child process.
A temptation here is to use token-indirection, via an authorized system that a client calls into (input: backend type) to receive a token specified for its backend to communicate with the queue (output: token string)--is this overkill?

Note to Self

Search slack for "there's been some work on integrating auth for the various mq implementations"

The rabbitmq auth will be implemented by #74


Laggy things

The service sometimes stops itself for no reason and/or makes the phone lag when the accessibility event is triggered. Possibly an exception is being thrown somewhere that isn't showing up in the log.

Okay, it doesn't do this anymore. There are a couple random issues on lower end devices but I think they'll get fixed as I update the app regardless.


[Enhancement] support statistics for iceberg table and optimize statistics calculation

Fixes #issue
What type of PR is this:

[ ] BugFix
[ ] Feature
[x] Enhancement
[ ] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Does this PR entail a change in behavior?

[ ] Yes, this PR will result in a change in behavior.
[x] No, this PR will not result in a change in behavior.

If yes, please specify the type of change:

[ ] Interface/UI changes: syntax, type conversion, expression evaluation, display information
[ ] Parameter changes: default values, similar parameters but with different default values
[ ] Policy changes: use new policy to replace old one, functionality automatically enabled
[ ] Feature removed
[ ] Miscellaneous: upgrade & downgrade compatibility, etc.

Checklist:

[x] I have added test cases for my bug fix or my new feature
[ ] This pr needs user documentation (for new or modified features or behaviors)

[ ] I have added documentation for my new feature or new function

Bugfix cherry-pick branch check:

[x] I have checked the version labels which the pr will be auto-backported to the target branch

[ ] 3.2
[ ] 3.1
[ ] 3.0
[ ] 2.5

[BE Incremental Coverage Report]
:heart_eyes: pass : 0 / 0 (0%)

[BE Incremental Coverage Report]
:heart_eyes: pass : 0 / 0 (0%)

[FE Incremental Coverage Report]
:disappointed: fail : 265 / 461 (57.48%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/sql/optimizer/Utils.java
0
1
00.00%
[399]

:large_blue_circle:
com/starrocks/connector/iceberg/cost/IcebergFileStats.java
2
33
06.06%
[127, 135, 136, 139, 143, 144, 146, 147, 149, 150, 151, 156, 261, 262, 263, 264, 265, 266, 267, 268, 269, 270, 271, 272, 275, 276, 279, 280, 281, 283, 286]

:large_blue_circle:
com/starrocks/sql/optimizer/operator/logical/LogicalIcebergScanOperator.java
1
4
25.00%
[62, 66, 67]

:large_blue_circle:
com/starrocks/qe/SessionVariable.java
3
8
37.50%
[1100, 1104, 1105, 1307, 1308]

:large_blue_circle:
com/starrocks/connector/iceberg/cost/IcebergStatisticProvider.java
64
159
40.25%
[90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 101, 102, 110, 111, 118, 119, 120, 122, 179, 180, 181, 184, 185, 191, 192, 212, 214, 215, 216, 217, 218, 219, 220, 234, 265, 266, 267, 268, 269, 270, 275, 276, 277, 278, 279, 280, 286, 295, 296, 347, 348, 359, 360, 375, 376, 378, 379, 381, 384, 385, 386, 387, 388, 389, 391, 392, 393, 394, 395, 396, 397, 399, 400, 402, 403, 405, 409, 410, 413, 414, 416, 418, 419, 422, 423, 424, 425, 429, 432, 434, 435, 436, 438, 439, 441]

:large_blue_circle:
com/starrocks/sql/optimizer/statistics/StatisticsCalculator.java
23
53
43.40%
[298, 299, 300, 301, 1394, 1395, 1396, 1397, 1398, 1399, 1400, 1401, 1402, 1403, 1406, 1408, 1409, 1410, 1411, 1412, 1415, 1418, 1419, 1425, 1426, 1427, 1428, 1429, 1430, 1432]

:large_blue_circle:
com/starrocks/connector/iceberg/IcebergMetadata.java
1
2
50.00%
[289]

:large_blue_circle:
com/starrocks/sql/optimizer/rule/transformation/DeriveRangeJoinPredicateRule.java
89
115
77.39%
[75, 86, 122, 131, 138, 139, 145, 146, 169, 178, 185, 192, 193, 194, 195, 197, 198, 199, 209, 210, 211, 213, 214, 215, 218, 229]

:large_blue_circle:
com/starrocks/sql/optimizer/statistics/ColumnStatistic.java
21
25
84.00%
[271, 272, 276, 277]

:large_blue_circle:
com/starrocks/sql/optimizer/Optimizer.java
1
1
100.00%
[]

:large_blue_circle:
com/starrocks/catalog/IcebergTable.java
5
5
100.00%
[]

:large_blue_circle:
com/starrocks/sql/optimizer/statistics/PredicateStatisticsCalculator.java
19
19
100.00%
[]

:large_blue_circle:
com/starrocks/sql/optimizer/rule/RuleType.java
1
1
100.00%
[]

:large_blue_circle:
com/starrocks/sql/optimizer/statistics/ExpressionStatisticCalculator.java
35
35
100.00%
[]

[BE Incremental Coverage Report]
:heart_eyes: pass : 0 / 0 (0%)

[FE Incremental Coverage Report]
:disappointed: fail : 265 / 463 (57.24%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/sql/optimizer/Utils.java
0
1
00.00%
[399]

:large_blue_circle:
com/starrocks/connector/iceberg/cost/IcebergFileStats.java
2
33
06.06%
[127, 135, 136, 139, 143, 144, 146, 147, 149, 150, 151, 156, 261, 262, 263, 264, 265, 266, 267, 268, 269, 270, 271, 272, 275, 276, 279, 280, 281, 283, 286]

:large_blue_circle:
com/starrocks/sql/optimizer/operator/logical/LogicalIcebergScanOperator.java
1
4
25.00%
[62, 66, 67]

:large_blue_circle:
com/starrocks/qe/SessionVariable.java
3
8
37.50%
[1100, 1104, 1105, 1307, 1308]

:large_blue_circle:
com/starrocks/connector/iceberg/cost/IcebergStatisticProvider.java
64
159
40.25%
[90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 101, 102, 110, 111, 118, 119, 120, 122, 179, 180, 181, 184, 185, 191, 192, 212, 214, 215, 216, 217, 218, 219, 220, 234, 265, 266, 267, 268, 269, 270, 275, 276, 277, 278, 279, 280, 286, 295, 296, 347, 348, 359, 360, 375, 376, 378, 379, 381, 384, 385, 386, 387, 388, 389, 391, 392, 393, 394, 395, 396, 397, 399, 400, 402, 403, 405, 409, 410, 413, 414, 416, 418, 419, 422, 423, 424, 425, 429, 432, 434, 435, 436, 438, 439, 441]

:large_blue_circle:
com/starrocks/sql/optimizer/statistics/StatisticsCalculator.java
23
53
43.40%
[298, 299, 300, 301, 1394, 1395, 1396, 1397, 1398, 1399, 1400, 1401, 1402, 1403, 1406, 1408, 1409, 1410, 1411, 1412, 1415, 1418, 1419, 1425, 1426, 1427, 1428, 1429, 1430, 1432]

:large_blue_circle:
com/starrocks/connector/iceberg/IcebergMetadata.java
1
2
50.00%
[289]

:large_blue_circle:
com/starrocks/sql/optimizer/rule/transformation/DeriveRangeJoinPredicateRule.java
89
117
76.07%
[75, 86, 122, 131, 138, 139, 145, 146, 147, 148, 171, 180, 187, 194, 195, 196, 197, 199, 200, 201, 211, 212, 213, 215, 216, 217, 220, 231]

:large_blue_circle:
com/starrocks/sql/optimizer/statistics/ColumnStatistic.java
21
25
84.00%
[271, 272, 276, 277]

:large_blue_circle:
com/starrocks/sql/optimizer/Optimizer.java
1
1
100.00%
[]

:large_blue_circle:
com/starrocks/catalog/IcebergTable.java
5
5
100.00%
[]

:large_blue_circle:
com/starrocks/sql/optimizer/statistics/PredicateStatisticsCalculator.java
19
19
100.00%
[]

:large_blue_circle:
com/starrocks/sql/optimizer/rule/RuleType.java
1
1
100.00%
[]

:large_blue_circle:
com/starrocks/sql/optimizer/statistics/ExpressionStatisticCalculator.java
35
35
100.00%
[]

[BE Incremental Coverage Report]
:heart_eyes: pass : 0 / 0 (0%)


Deprecate GitHub

Moving Vero to GitLab if all goes well.

Reverse this. We're staying at GitHub. Make sure the oh-my-zsh documentation points here

OMZ does lead to GitHub /close


Build onnx for each image separately

I was trying to test on both the images but seems like by your method we need to export onnx for every image separately?
def export_onnx(model, batch_size):
    _,_,x,y = input_img.shape
    img = torch.zeros((batch_size, 3, x, y)).to(device)
    torch.onnx.export(model, (img), 'yolov5_{}.onnx'.format(batch_size),
           input_names=["data"], output_names=["model/22"], verbose=True, opset_version=10, operator_export_type=torch.onnx.OperatorExportTypes.ONNX
    )

Is that right?

Also when I try to inference two images. It gives correct output for the first one but copies the first output to the second image with the following error:
[TensorRT] ERROR: ../rtExt/cuda/slice.cu (141) - Cuda Error in launchNaiveSliceImpl: 400 (invalid resource handle)
[TensorRT] ERROR: FAILED_EXECUTION: std::exception

Refer to limitation section, dynamic shape is not working with current torch-onnx-trt combination, it ran into error when building the engine with dynamic shape. Currently, you can only use fixed input shape.


command-line-arguments.md: Tag the Command Prompt code blocks as such.

For some reason they were tagged as bash, which broke highlighting in at least one of them.

Docs Build status updates of commit f2d4a02:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

TerminalDocs/command-line-arguments.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit f2d4a02:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

TerminalDocs/command-line-arguments.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Should I have included the filename in the actual commit message? Sometimes I feel like github's subject line textbox is one time you don't really want the placeholder attribute ...

Should I have included the filename in the actual commit message? Sometimes I feel like github's subject line textbox is one time you don't really want the placeholder attribute ...


Wait with 2.0.0 release please

Is your feature request related to a problem? Please describe.
I currently have some changes I would like to get merged before 2.0.0 is released - because some of them are breaking changes. But they are very helpful IMO
Describe the solution you'd like
Don't officially release 2.0.0 just yet.
Describe alternatives you've considered
Keep the changes to myself, because they would break stuff for other users.
Additional context
I saw the release notes for 2.0.0 and my PRs will add more migration guide instructions, because they are breaking.

If you want to look at some of the changes I did to a previous version of flutter_chatview, you can compare my main branch here
I am splitting those up right now, so I can create seperate PRs for the changes (as I should have done from the start).
This takes some hours, so I wanted to open this issue to ask you to wait a little, until I opened my PRs and you reviewed them.

Great work, @jonasbadstuebner . How much time will it take for you to create a separate PR for the changes?

We wanted more control over the list view, so we have removed that package. For now, you can skip those features/changes. We might not be able to merge every PR in this version. I suggest creating only those PRs that are essential for this version and easy to include.

I'm trying to pick the different versions into PRs that make sense when separated.
I'm focusing on breaking changes for now.

I will combine them a little bit because it would take a lot of time to split everything up and test the individual changes. I hope that's okay.

Is it a requirement that the code is working after every commit?
Because I did not test that (yet).

Yes, it is required as we might not include some of the changes in the release. For now, I have created a separate PR for renaming 'sendBy' to 'sentBy' in the Message class. PR #188

A new version has been released.

Huh? Why.

I guess I will still open the remaining PRs, but I don't really understand why this had to be rushed now...
Well...it's your choice in the end. Congratulations on launching v2.0.0! :rocket:

We were actually getting a lot of requests for the release, and I believe most of your changes are available in this release except for column one. which will not be  breaking changes so we will surely release this in the next version.

Okay, I get that the pressure was high. I will continue creating PRs and you let me know what you think - because I have dynamic swiping on my agenda for example, which could be a breaking change, I don't know.