RenterOutputIndex and HostOutputIndex Constants

This came up in a renterd review the other day so I decided to propose it. I'm still not sure whether it's silly or actually useful so I figured I would let you be the judge Luke. Definitely feel free to just close this out, I was expecting way more occurrences to be honest, was surprised to only find a handful.

yeah it's a borderline case. In v2, contracts have explicit renter and host fields -- no more slices -- so the constants will be unnecessary.
I think I'm ok with it, but let's call them something more generic (perhaps Renter/HostContractIndex), since the index is used for the unlock conditions too.


Regex Searching

Is there a setting that will allow me to use regex in my searches?

For the moment we're missing a Datatable.Meta option to specify which columns can use regex (like you can with verbose names and processors, etc), but when constructing a column instance you can pass the allow_regex=True kwarg:
content = columns.TextField(source='content', allow_regex=True)

What this does is add __iregex to the lookups tried on the field during the filter step.

That is awesome, and that will work fine for me as I declare most of my columns in this fashion.


Revert back to CSS/JS bundling from importmaps

The background to this issue has been discussed ad nauseum in issues like #188 and on Slack, so I won't go into the full justification here.
This PR removes our use of importmap-rails and goes back to the boring old days of asset-bundling via a JS bundler, though in this case esbuild rather than Webpack because it's light and fast.
The commits are organized pretty atomically, so I recommend poking through them individually if you're curious about individual changes. fe06b3779f9c9f10143baf022fb9e96e70707be4 was huge by necessity, but I put a lot of clarifying detail into its commit message.
Testing:

Remove node_modules/
yarn install
bundle install
Run and test the app! Everything should work, but most notably styles should be present and JS shouldn't explode.

This breaks when using JS it seems. To test: go to home page (after logging in), click the "+" button. It should put a modal popup over the content, instead it redirects to another page. Can you make sure the Stimulus code is being compiled?

@cguess Hrm, it's definitely working for me, and verified that the modal is loaded via an XHR fetch and not a GET.
Can you try emptying /app/assets/build and /public/assets and trying again? Also, are you booting with ./bin/dev or rails s?


Kimera parameters

Dear Repository,
I want to experiment Kimera performance with different parameters and see the differences. Also, try to obtain the set of 3D landmarks generated this way. The problem is I don't know how to access this parameters. Can you guide me from where I should start in Kimera?

also I'm wondering how can I get point clouds of given frames in Kimera!

Thank you for your help in advance,
Rahim

Parameters are in .yaml files in the /params folder, organized by dataset. We use Euroc for testing and evaluation. FrontEndParams.yaml is probably where you want to focus. I would recommend against touching the Imu or Camera parameter files, as those are calibrated for the hardware.

Are you using ROS? In ROS, the 3D landmarks are published as A) a pointcloud of the currently tracked features (including some from the past) on the topic /kimera_vio_ros/time_horizon_pointcloud and B) a mesh of all the active feature points in the current frame on the topic /kimera_vio_ros/mesh. If you are looking to access them programmatically from C++, you can run the pipeline with this example, then register callbacks with the VioPipeline (see here).

Thank you for your quick response,It as helpful. I didn't use ROS but I might need to use.
Best wishes,
Rahim


Prediction not running on GPU

@faustomorales prediction always running on cpu ,Is there any option to change it to gpu or is there any minimum requirement for gpu, because i had only 2gb of Quadro K3000M.

Hi @vasanththangavel! Thanks for your question. The GPU configuration is determined by TensorFlow. You can see if TensorFlow sees the GPU using:
import tensorflow as tf
print(tf.config.list_physical_devices('GPU'))

That should get you started with figuring out how to get the dependencies set up to use the GPU. That said, 2GB is probably not enough memory for the models in this package to run on the GPU (you will probably get out-of-memory errors). So it may not be worth figuring out. Let us know how it goes!

I tried this code
import tensorflow as tf print(tf.config.list_physical_devices('GPU')) but it returns empty list. so i tried different tensorflow version like 2.1.1 and 2.0.0 which is compatible for cuda 10.2 but still issue not resolved.

Configuring TensorFlow on GPU is a TensorFlow issue that, unfortunately, cannot be resolved by this package. Please see https://www.tensorflow.org/install/gpu for instructions. StackOverflow may have helpful information for troubleshooting TensorFlow / CUDA / GPU issues.


Crash in the function getrn

Hi,
We got an exception in the function getrn in openssl-1.0.2d in Windows Server 2008 R2, here is the stack backtrace, could you take a look at the stack why the exception occurred, please?
0:083> knL
*** Stack trace for last set context - .thread/.cxr resets it
ChildEBP RetAddr
00 222ee4ac 0fb5a16b libeay32!getrn+0x47
01 222ee4bc 0fb5c84d libeay32!lh_retrieve+0x1b
02 222ee4e0 0fb5d00e libeay32!int_thread_get_item+0x8d
03 222ee698 0fb5d6f2 libeay32!ERR_get_state+0x7e
04 222ee6ac 122e83ae libeay32!ERR_clear_error+0x12
05 222ee6b4 122ef505 VISDKClient_FIPSArray!soap_begin_send+0x27e
06 222eead4 122ef699 VISDKClient_FIPSArray!soap_connect_command+0x215
07 222eeaec 1232e4bf VISDKClient_FIPSArray!soap_connect+0x19
08 222eeb10 122d7625 VISDKClient_FIPSArray!VimBindingProxy::RetrieveServiceContent+0x12f
09 222eeba8 122d7a3b VISDKClient_FIPSArray!CVISDKClient_Imp::_setupForConnection+0x245
0a 222eecf8 122e0edd VISDKClient_FIPSArray!CVISDKClient_Imp::Connect+0x31b
0b 222eed9c 10cfb337 VISDKClient_FIPSArray!CVISDKClient::Connect+0x9d
0c 222ef060 10cfbf2c ServerProvider!VsiPollThread::GetEsxHostsInVC+0x257
...
0:083> r
Last set context:
eax=363d6d44 ebx=363d6d44 ecx=00000001 edx=00000004 esi=368d2260 edi=00003233
eip=0fb59ee7 esp=222ee4a4 ebp=00052e34 iopl=0         nv up ei pl nz na pe nc
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010206
libeay32!getrn+0x47:
0fb59ee7 396f08          cmp     dword ptr [edi+8],ebp ds:002b:0000323b=????????

Did you set up the thread locking callbacks?
https://www.openssl.org/docs/faq.html#PROG1

Thanks for your comments, I will check that in our code.

Also, 1.0.2d is quite old; the 1.0.2 series is up to 1.0.2m, now.  There have been several CVEs patched in the intervening releases, among other things.

Thank you  for the comments! I have checked our code in which we did not set up the threading locking callbacks. I will forward this message to our team to make up which openssl release we need to upgrade.
Jason

Sounds like everything is resolved so closing.


Enum and Bounded

This lesson covers the Enum and Bounded classes.
There are not a whole lot of exercises on this one, because there's a pretty limited scope of what you can do with these classes.
I included deriving-via and the generic-data package, in a "don't worry about how this works, but here's how you do it" presentation -- perhaps a bold choice, but it nicely fills in the gaps in GHC's stock deriving capability with little fuss, and I'm personally of the opinion that it's time to start talking about via as a normal thing to use.

I agree with the normalisation of Deriving Via


[Feature Request]: Wrapper for other MLPs

Email (Optional)
No response
Problem
I would like to be able to use MTP, NNP or other MLPs for matcalc property calculations.
Proposed Solution
Write a wrapper for other architectures. E.g.,
class MTPCalculator:

    def __init__(mtp_params):
       initialize

    def get_potential_energy():
        call other classes or command line to compute these quantities.

Alternatives
No response
Code of Conduct

[X] I agree to follow this project's Code of Conduct

Already submitted a pr to do this, but still need to fix something.


socket_sendto errors need to be silenced

Refernce: https://github.com/TomNomNom/phpwol/blob/master/Phpwol/Socket.php#L9
If you attempt to send a packet to a broadcast address that is different from the hosts broadcast address (e.g. attempting to send to <IP_ADDRESS> from a machine that is on <IP_ADDRESS>) PHP will die with an error like "socket_sendto(): unable to write to socket [101]: Network is unreachable". This error should be caught so the method can return false on any error.

Good catch, thanks!
Ideally I'd rather add a check for that particular case, but having given it some thought I think it would actually be pretty difficult to reliably get the correct subnet mask (especially on machines with multiple interfaces on different networks).
As you've suggested, silencing the error might actually be the best way to go :(

Fixed in 9126f22d57e4403e0569b1b5e9c91c697a394260 :)
Let me know if you have any more problems.

 Open source at its best!

Ideally I'd rather add a check for that particular case, but having given it some thought I think it would actually be pretty difficult to reliably get the correct subnet mask (especially on machines with multiple interfaces on different networks).

I came to the same conclusion, most applications I've seen that try to figure out your network address end up getting it wrong when there are more interfaces than one.

Hah; you're welcome :)


bitwarden-desktop: System Authentication Broken

Describe the bug
The Bitwarden desktop system authentication is currently nonfunctional.
Steps To Reproduce

Enable system authentication in the bitwarden desktop app
Enable biometrics in the bitwarden extension (firefox in this example).
See that the browser extension is unable to communicate with the desktop.

Expected behavior
The browser extension should be able to unlock using the desktop system authentication
Additional context
I've been able to diagnose and fix the issue by adding some hacks to my nixos configuration using the following steps.

Enable polkit and add the bitwarden unlock action.

Add security.polkit.enable = true; to configuration.nix.  Then include the com.bitwarden.Bitwarden.policy from here https://github.com/bitwarden/clients/blob/4b9935b28c48e5824a19166170604ec3a6911593/apps/desktop/src/platform/main/biometric/biometric.unix.main.ts#L12.
I did this using
{
  environment.systemPackages = with pkgs; [
    (runCommand "install-bitwarden-policy" {} ''
      mkdir -p $out/share/polkit-1/actions
      cat <<EOF > $out/share/polkit-1/actions/com.bitwarden.Bitwarden.policy
      <?xml version="1.0" encoding="UTF-8"?>
      <!DOCTYPE policyconfig PUBLIC
      "-//freedesktop//DTD PolicyKit Policy Configuration 1.0//EN"
      "http://www.freedesktop.org/standards/PolicyKit/1.0/policyconfig.dtd">

      <policyconfig>
          <action id="com.bitwarden.Bitwarden.unlock">
            <description>Unlock Bitwarden</description>
            <message>Authenticate to unlock Bitwarden</message>
            <defaults>
              <allow_any>no</allow_any>
              <allow_inactive>no</allow_inactive>
              <allow_active>auth_self</allow_active>
            </defaults>
          </action>
      </policyconfig>
      EOF
    '')
  ];
}

Modify native messaging configuration .mozilla/native-messaging-hosts/com.8bit.bitwarden.json

The contents of this file need to be replaced, notably the path to the bitwarden executable is incorrect and somehow is a path to an electron executable rather than the correct bitwarden executable. This electron executable when executed gives a segfault. For me, it is located at /nix/store/afd2nb5r9vpr0xrka8w9za02kx2d40h5-electron-unwrapped-31.4.0/libexec/electron/electron.
{
  "name": "com.8bit.bitwarden",
  "description": "Bitwarden desktop <-> browser bridge",
  "path": "/etc/profiles/per-user/<YOUR USERNAME>/bin/bitwarden",
  "type": "stdio",
  "allowed_extensions": [
    "{446900e4-71c2-419f-a6a7-df9c091e268b}"
  ]
}

Modify the autostart configuration file. Again, this file appears to contain the incorrect path to the bitwarden executable and is the same exectron executable from 2.

[Desktop Entry]
Type=Application
Version=2024.8.1
Name=Bitwarden
Comment=Bitwarden startup script
Exec=/etc/profiles/per-user/alex/bin/bitwarden
StartupNotify=false
Terminal=false

If these two core issues (polkit action missing and the bitwarden executable path) could be fixed, this issue could be resolved.
Notify maintainers
@amarshall
Metadata
Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.
[user@system:~]$ nix-shell -p nix-info --run "nix-info -m"
 - system: `"x86_64-linux"`
 - host os: `Linux 6.10.11, NixOS, 24.05 (Uakari), 24.05.20240922.23cbb25`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.18.5`
 - nixpkgs: `/nix/store/rqicl40jqw5d93l43s1xq0bm6yy0gpx4-source`

Add a :+1: reaction to issues you find important.

Hi! Thanks for creating this issue (even though some of the debugging work may have been duplicated). Let me know if #339384 fixes the issue for you and if not I can add make sure to add whatever it might be missing.

Modify native messaging configuration .mozilla/native-messaging-hosts/com.8bit.bitwarden.json

Where did that file come from on your system?  I do not have that.


Feature: Add more element types to the linking command

The idea here is adding extra element types (possibly in a new category) to the script-link command.
While those aren't very useful for JSON/YAML outputs, it allows for automatic linking on CONF outputs.
Possible new elements:

Telemeter
Transponder
Engines (Atmo, Space, Adjustor)
Brakes
Airfoils (Wings, Ailerons, Stabilizers)
Vertical Boosters
Hover Engines

This might be useful: https://github.com/dual-universe/lua-examples/tree/main/api-mockup

Added support to Telemeters


Some Online Functionality

Added ability to request a Questionnaire from a server
To upload to Hapi or Logica must use Id of patient already defined on server
Added authentication to Logica

I have manually placed your code in various locations (see the faiadashu_online branch). Therefore kindly closing this PR without directly merging it.


[BUG] Cython not creating bound method

I'm sorry if this has been reported before. It feels like a very basic issue but I couldn't find any documentation or other bug reports related to it.
Describe the bug
Cython does not seem to create a bound method if you do f = instance.method.
To Reproduce
Code to reproduce the behaviour:
cdef class X:
    cdef foo(self):
        print(self)

f = X().foo
f()

Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "t.pyx", line 8, in init t
    f()
TypeError: wrap() takes exactly one argument (0 given)

Expected behavior
Prints self.
Environment (please complete the following information):
Cython version 0.29.30

There isn't really such a thing as a "bound C function". A function pointer doesn't have any space to store anything except the function itself.
Cython should probably report an error though, since it isn't obvious that you can't do it.

Although in this case it's creating a Python wrapper object... which removes the benefit of having a cdef function, but means a bound method should possibly work...
I still think the solution is probably an error message though.

Relatedly, I want to be able to write code such as
cdef int const_1 = 1
cdef int const_2 = 2
x = X()
n = some_int
{const_1: x.foo, const_2: x.bar}[n]()

And have Cython optimize it to a switch. Not sure if that's something that's ever going to be implemented, but it is a case where the Python wrapper could be optimized away and so the "making a Python wrapper of a cdef function is stupid" is a weaker argument.


App Generated Passcode:UX issue.

"Use Strong Passcode "this button is getting cut a little from the bottom again.

Verified this issue on dev app v2.0.69(429)


this.cookies.set() cannot set cookie to chrome correctly

I came across a strange scene.
In the entry js file:
app.use(function*(next) {
    this.cookies.set('test', 999999);
    return yield next;
})

This is ok in both HTTP Response Header and Chrome Devtool Resources 's Cookies.
But...
When I put the this.cookies.set to Get Reponser
app.get('/v1/test', function *(next) {
    this.cookies.set('test1', 66666);
    this.body = { code: 200, message: 'success'}
    return yield next;
})

The HTTP Reponse Header is ok
Set-Cookie: test1=66666; path=/; httponly

The Chrome Devtool Resources's Cookies display no cookie !
I have debugg this for long time, please help me ~

this.cookies is from https://github.com/koajs/koa, not koa-router. Open an issue there.

Error: Can't set headers after they are sent.
I got this error after using router.post,get or other methods.I think reason that those methods had send  the header.

I'm having an issue where if I set cookies or a session variable (using koa-session), the session is preserved using router.get, however when using router.post, the session and ctx.cookies are both unavailable.


Does this tool detect the words "segregating", "black", "white", "slavery", "mastery"

How can the Team help you today?
The file "all-words.txt" does not have the following words.
Details: ?
"segregating" - This is a variation, not listed in your
"black" - black alone is also not listed
"white" - white alone is also not listed
"slavery" - Variation
"mastery" - variation
and may be more like these.

@jagadeeshnv, thank you for reaching out with your question.  We are currently investigating ways to enhance the GitHub action so that users can provide their own list of non-inclusive words rather than being tied to the list currently provided.  We welcome any contributions you may be able to provide to help make this happen.

@jagadeeshnv, thank you for reaching out with your question.  We are currently investigating ways to enhance the GitHub action so that users can provide their own list of non-inclusive words rather than being tied to the list currently provided.  We welcome any contributions you may be able to provide to help make this happen.


[PR][CLOSED] [Enhancement] Added exception folder into file size check routine

 Issue by geunsik-lim
Monday Jul 09, 2018 at 07:52 GMT
Originally opened as https://github.sec.samsung.net/STAR/TAOS-CI/pull/109

This PR is to append a folder name (e.g, temporal-bin) to exclude check routine of
file size limit. It means that +5 MB file (by default) can be uploaded temporarily
in case of an inevitable situation.
Basically you can not upload a big file that exceeds specified file size.
If you have to temporarily upload binary files unavoidably, a contributor
has to share the issue to all members after uploading the files in specified folder.
Changes proposed in this PR:

Added exception folder routine for file size limit
Updated report format
Updated configuration file.
Updated doxygen rule to handle $SKIP_CI_PATHS

Signed-off-by: Geunsik Lim<EMAIL_ADDRESS>
[Template] PR Description
In general, github system automatically copies your commit message for your convenience.
Please remove unused part of the template after writing your own PR description with this template.
$ git commit -s filename1 filename2 ... [enter]

Summarize changes in around 50 characters or less

More detailed explanatory text, if necessary. Wrap it to about 72
characters or so. In some contexts, the first line is treated as the
subject of the commit and the rest of the text as the body. The
blank line separating the summary from the body is critical;
various tools like `log`, `shortlog` and `rebase` can get confused
if you run the two together.

Further paragraphs come after blank lines.

**Changes proposed in this PR:**
- Bullet points are okay, too
- Typically a hyphen or asterisk is used for the bullet, preceded
  by a single space, with blank lines in between, but conventions vary here.

Resolves: #123
See also: #456, #789

**Self evaluation:**
1. Build test: [ ]Passed [ ]Failed [*]Skipped
2. Run test: [ ]Passed [ ]Failed [* ]Skipped

**How to evaluate:**
1. Describe how to evaluate in order to be reproduced by reviewer(s).

Add signed-off message automatically by running **$git commit -s ...** command.

$ git push origin <your_branch_name>

geunsik-lim included the following code: https://github.sec.samsung.net/STAR/TAOS-CI/pull/109/commits

 Comment by git-bot-sec
Monday Jul 09, 2018 at 07:52 GMT

Thank you for submitting PR #109. Your PR has to pass all verificiation processes of cibot before getting a review process from reviewers. We recommend that you read instruction manual in . If you want to monitor the progress status of your PR in detail, visit http://aaci.mooo.com/.

:octocat: cibot: Thank you for posting issue #133. The person in charge will reply soon.


Default command (effort 7) does not work in cjxl

Describe the bug
Bug of encoding from any image file to jxl in cjxl for default command (7)
To Reproduce
Steps to reproduce the behavior:
1: Used code default in Windows Terminal Command Prompt: cjxl fefefe.png fefefe.jxl
2: Nothing compressed.
Expected behavior
Expected needs to be compressed and saved file after default command and effort number seven.
Code:
cjxl fefefe.png fefefe.jxl
JPEG XL encoder v0.7.0 75a039a [AVX2,SSE4,SSSE3,Scalar]
Read 1353x852 image, 48.0 MP/s
Encoding [VarDCT, d1.000, squirrel], 16 threads.

Environment

OS: Windows 11
Compiler version: VCPKG 2022
CPU type: x86_64
JPEG XL encoder v0.7.0 75a039a [AVX2,SSE4,SSSE3,Scalar]

Additional context
The problem is that the default effort does not work. From effort 1 to 4 are working well. Since effort 5, it won't work well.

Martin Eesmaa

This is a duplicate of https://github.com/libjxl/libjxl/issues/1282
We suspect it is caused by a compiler bug.

Closing, discussion can proceed in https://github.com/libjxl/libjxl/issues/1282


Feature request: Download search results

When you search in Lychee, the results page that shows your pictures from the search does not have any option to download (unless I am missing something). I think a nice feature would allow you to download all the photos from a search, just like you can in an album view.
Very nice software, thank you for creating Lychee and for all of your efforts!

Thanks for the suggestion! Would make sense in combination with an improved photo selection. Could be added as a right click option (Download selection).

This issue will be closed because I'm not actively working on Lychee anymore. The repository of Lychee will stay available, but the main development continues under the Lychee Organisation. A fork maintained by the community. Important issues have been migrated. Feel free to re-add your issue(s) when necessary.


Difficult installation of extension in Cursor IDE

When I install the Coder extension in the Cursor IDE and I try to run Coder: Login from the command palette, I get an error that the dependency ms-vscode-remote.remote-ssh is not found. If I install the extension ms-vscode-remote.remote-ssh, I get an error that ms-vscode-remote.remote-ssh does not support unofficial VS Code Builds. If I also install the extension jeanp413.open-remote-ssh then the Coder extension works as expected.
This was a confusing process, and I couldn't find it documented anywhere. Ideally, I think it would be great if Coder had either ms-vscode-remote.remote-ssh or jeanp413.open-remote-ssh as a required dependency and not only ms-vscode-remote.remote-ssh.

Oh weird, I thought Cursor actually used anysphere.open-remote-ssh.
I think we are only able to list one dependency as required though, the VS Code API has no mechanism for specifying equivalent dependencies (this or that), at least, as far as I know?
https://github.com/coder/vscode-coder/blob/3e5ca515b7fb35d3b54e5fef5b2313b6fd5a0519/package.json#L32-L34

Maybe we have to remove the dependency from the package.json and handle it in code somehow instead, in any case some investigation is needed.

Cursor can now install the extensions automatically.


open_with_flags does not return extended error codes when sqlite3_open_v2 fails

We are using a sqlite extension that can return an extended error code SQLITE_IOERR_AUTH (7178) when the user has not authenticated themselves properly. Due to historical reasons, SQLite by default returns the primary error code SQLITE_IOERR (10) unless told to do otherwise.
rusqlite::inner_connection::open_with_flags calls sqlite3_open_v2, and if successful it enables ffi::sqlite3_extended_result_codes(db, 1). If sqlite3_open_v2 is unsuccessful, it returns the primary error code, possibly (partially?) initialising db. In the error handling code where db is not null, we pass the primary error code to error_from_handle. It would be preferable to pass the extended error code instead. This could be done by calling ffi::sqlite3_extended_errcode(db) to get the most recent extended error code.

If you use a recent version of SQLite (>= 3.37.0),
Could you please try with the SQLITE_OPEN_EXRESCODE open flag ?
(just to avoid messing rusqlite code)
https://sqlite.org/c3ref/open.html

SQLITE_OPEN_EXRESCODE
The database connection comes up in "extended result code mode". In other words, the database behaves has if sqlite3_extended_result_codes(db,1) where called on the database connection as soon as the connection is created. In addition to setting the extended result code mode, this flag also causes sqlite3_open_v2() to return an extended result code.

I get a SQLITE_OK_LOAD_PERMANENTLY (256) which is probably a bug on our side, but that still flops due to if r != ffi::SQLITE_OK in open_with_flags

#include <stdio.h>
#include <sqlite3.h>

static int init(
        sqlite3 *db,
        char **pzErrMsg,
        const sqlite3_api_routines *pApi
){
    char *zErr;
    zErr = sqlite3_mprintf("broken autoext!");
    *pzErrMsg = zErr;
    return SQLITE_IOERR_AUTH;
}

int main() {
    int rc = sqlite3_initialize();
    if (rc != SQLITE_OK) {
        printf("sqlite3_initialize: %d\n", rc);
        return rc;
    }
    rc = sqlite3_auto_extension((void(*)(void))init);
    if (rc != SQLITE_OK) {
        printf("sqlite3_auto_extension: %d\n", rc);
        return rc;
    }
    sqlite3 *db = NULL;
    rc = sqlite3_open_v2(":memory:", &db, SQLITE_OPEN_READWRITE | SQLITE_OPEN_CREATE | SQLITE_OPEN_EXRESCODE, NULL);
    if (rc != SQLITE_OK || db == NULL) {
        printf("sqlite3_open_v2: %d, %s\n", rc, sqlite3_errmsg(db));
        return rc;
    }
    return 0;
}

sqlite3_open_v2: 7178, automatic extension loading failed: broken autoext!

Congrats on the release.
I tried your rust example and it works great, but my extension on the happy path returns SQLITE_OK_LOAD_PERMANENTLY and the sqlite docs are ambiguous about whether or not this is an error ("All extended result codes are also error codes" vs the primary result code being SQLITE_OK). I would argue that rusqlite should treat this as an OK error code because choosing to open with SQLITE_OPEN_EXRESCODE shouldn't impact whether rusqlite treats it as a success or not.
use rusqlite::ffi;
use std::os::raw::{c_char, c_int};
use rusqlite::{Connection, OpenFlags, Result};

unsafe extern "C" fn init(_: *mut ffi::sqlite3,
                          _: *mut *mut c_char,
                          _: *mut ffi::sqlite3_api_routines
) -> c_int  {
    ffi::SQLITE_OK_LOAD_PERMANENTLY
}

fn main() -> Result<()> {
    unsafe {
        assert_eq!(ffi::sqlite3_initialize(), ffi::SQLITE_OK);
        let x_entry_point = init as *const ();
        assert_eq!(ffi::sqlite3_auto_extension(Some(std::mem::transmute::<*const (), unsafe extern "C" fn()>(x_entry_point))), ffi::SQLITE_OK);
    }
    let _ = Connection::open_in_memory_with_flags(OpenFlags::SQLITE_OPEN_READ_WRITE | OpenFlags::SQLITE_OPEN_CREATE | OpenFlags::SQLITE_OPEN_EXRESCODE)?;
    Ok(())
}

Ok,
I am not sure but
If you search SQLITE_OK_LOAD_PERMANENTLY usages in SQLite sources, it seems that you should not return SQLITE_OK_LOAD_PERMANENTLY when using sqlite3_auto_extension.
For example:
https://github.com/sqlite/sqlite/blob/a959bf53110bfada67a3a52187acd57aa2f34e19/ext/misc/memvfs.c#L567
    rc = sqlite3_auto_extension((void(*)(void))memvfsRegister);

https://github.com/sqlite/sqlite/blob/a959bf53110bfada67a3a52187acd57aa2f34e19/ext/misc/memvfs.c#L530-L543
/* Called for each new database connection */
static int memvfsRegister(
  sqlite3 *db,
  char **pzErrMsg,
  const struct sqlite3_api_routines *pThunk
){
  sqlite3_create_function(db, "memvfs_from_file", 1, SQLITE_UTF8, 0,
                          memvfsFromFileFunc, 0, 0);
  sqlite3_create_function(db, "memvfs_from_file", 2, SQLITE_UTF8, 0,
                          memvfsFromFileFunc, 0, 0);
  sqlite3_create_function(db, "memvfs_to_file", 2, SQLITE_UTF8, 0,
                          memvfsToFileFunc, 0, 0);
  return SQLITE_OK;
}

That's fair, in which case I think this is resolved. Thanks for your help!

Upon looking at the search a bit more, I think that returning SQLITE_OK_LOAD_PERMANENTLY is often fine. In the memvfs code you linked they use SQLITE_OK internally, but the sqlite3_memvfs_init function explicitly converts SQLITE_OK to SQLITE_OK_LOAD_PERMANENTLY when returning it on https://github.com/sqlite/sqlite/blob/a959bf53110bfada67a3a52187acd57aa2f34e19/ext/misc/memvfs.c#L573. There are other conversions from SQLITE_OK to SQLITE_OK_LOAD_PERMANENTLY, and there is a test which refers to both of them.

Could you please find at least on xEntryPoint function which is passed as argument of sqlite3_auto_extension that returns SQLITE_OK_LOAD_PERMANENTLY ?
(sqlite3_memvfs_init is not)
Thanks.

Aha, now I understand my confusion. My extension was returning SQLITE_OK_LOAD_PERMANENTLY in foo_sqlite_init and SQLITE_OK in foo_auto_extension, but I should be returning them the other way around. This then follows the pattern in memvfs, and now rusqlite has the desired behaviour too.
Thanks again!


Removed test timeout

Closes #1603.

This change is

PR is added to the queue for testing as 1. task. (9a343fb)

Test 96505409 (9a343fb) build started.

Test (Success) 96505409 build is completed (9a343fb)
See https://github.com/ThaliTester/TestResults/tree/965054099a343fb_Removed_test_timeout_andrew-aladev/ for the logs

Test 965054099a343fb(9a343fb) has failed
See https://github.com/ThaliTester/TestResults/tree/965054099a343fb_Removed_test_timeout_andrew-aladev/ for the fail logs

Reviewed 7 of 7 files at r1.
Review status: all files reviewed at latest revision, all discussions resolved.

Comments from Reviewable

PR is added to the queue for testing as 1. task. (bcb1655)

Test 96505409 (bcb1655) build started.

Test (Fail) 96505409 build is completed (bcb1655)
See https://github.com/ThaliTester/TestResults/tree/96505409bcb1655_Removed_test_timeout_andrew-aladev/ for the logs


Fix Disconnect Error Message

Currently, It throws a bad connection error, rather then a disconnect error when a client is disconnected from a server. Since we catch all errors, We just need to figure out exactly which one to watch for, and then make the disconnect error match the Java ones.

Closing all issues, as this will no longer be updated unless someone else wants to. We will be officially supporting NetworkTablesCore.


Genimage

Add genimage + dependency to the basement layer.

It was decided this fits more into basement-gnu-linux. So I created a pull request there.


macOS Installation

Hi @thiesmoeller,
I tried to follow your new macOS installation instructions, but unfortunately got stuck at ninja -C build. The pylon libraries (such as pylon/BaslerUniversalInstantCamera.h) are not being found even though they do exist in /Users/<username>/Library/Frameworks/pylon.framework/Versions/A/Headers. I noticed the similarity with the "RPATH" comment, but wasn't quite sure how to solve it. Any suggestion?
Cheers,
Sam
P.S. Minor comments:

. ./unpack_pylon7.3.1.sh -d pylon_7_3_1_0011.dmg -t /Users/<username>/Library/Frameworks could have --accept added to save reading the code.
the .dmg obviously needs to be in the same directory for that call
the gst-plugin-pylon directory needs to be cloned before cd gst-plugin-pylon of course. I assume no particular location...?

In the readme will keep forcing to read/accept the EULA,
dmg file search will be fixed
good point put the clone in the readme, if you read the readme online this makes sense
will add to the macos build to CI so we have a working reference to start from ..

.. you forgot to checkout the feature branch
git checkout feature/macos_port_alpha

Yes, I did forget that - thanks. The ninja calls then work without issues (although I think it's necessary to prefix them all: PYLON_ROOT=/Users/<username>/Library/Frameworks ninja -C build).
However, when I call
LD_LIBRARY_PATH=/Users/<username>/Library/Frameworks/pylon.framework/Versions/A/Libraries gst-launch-1.0 pylonsrc ! fakesink
there are some issues with libraries and finally "WARNING: erroneous pipeline: no element "pylonsrc"".
I would note that I tried both the homebrew and official versions of gstreamer, but I couldn't get as far with the official version (perhaps because it installs to the system Library, not the user library?). The meson build step throws some warnings which might be due the homebrew version.

you might have to clear your gstreamer cache
$HOME/.cache/gstreamer-1.0
it might be that pylonsrc got blacklisted after some failure
you can check this with
gst-inspect-1.0 -b

you have to replace  in the path -> or simply put $HOME/Library/Frameworks/pylon.framework/Versions/A/Libraries

hm... only difference I see is, that I installed gstreamer from homebrew. ( also not mentioned in readme yet )
brew install gstreamer
Just checked again, this works on my side

It's possible that the official gstreamer build somehow only  recognises the DYLD_LIBRARY_PATH environment variable for lookup.
Can you give that a try?

Actually, I've also been using the brew version, so I guess it makes sense to stick with that for now since it works for you.
I read the output above a bit more carefully and it seems to be getting the wrong path from @rpath. It's looking for the pylon libraries at the gstreamer installation:
/usr/local/Cellar/gstreamer/1.22.5/lib/pylon.framework/Versions/A/Libraries
The pylon libraries are here of course:
$HOME/Library/Frameworks/pylon.framework/Versions/A/Libraries
I tried forcing this with
LD_LIBRARY_PATH=$HOME/Library/Frameworks/pylon.framework/Versions/A/Libraries DYLD_LIBRARY_PATH=$HOME/Library/Frameworks/pylon.framework/Versions/A/Libraries gst-launch-1.0 pylonsrc ! fakesink but that was just a guess and didn't work.
I was thinking of trying something like this but perhaps that's getting carried away.

The CI reproduces the error you see... https://github.com/basler/gst-plugin-pylon/actions/runs/5752206328/job/15593622426#step:4:979
which is good.

It's not clear to me if you had success with your most recent changes, but they didn't work for me. For your info, I did at least get get-launch-1.0 ... to run by putting a copy of the libraries where they were being sought. Obviously that's dirty, but it at least shows that it will run once the library problem has been solved...

I'm currently struggling with finding a good solution that still works when the system integrity protection kicks in.
It seems that libraries have very limited locations in the filesystem


using the default sphinx-theme

I´m having troubles with the rtd-theme, so I wanna switch back to the default sphinx-theme for my project. is there an easy way to do this? sorry, I know that the issue-tracker is maybe the wrong place (feel free to close this immediately).

Hrm. Right now it isn't very easy. I will think about a way to make it easier, maybe allow you to set a variable in your conf.py that allows it, if that works for you?

Actually, it looks like if you set the html_style variable in your conf.py, it should drop back to using the default theme.

thanks, I´ll give that a try. btw: the main problem we´re having right now is this:
http://readthedocs.org/docs/django-grappelli/en/latest/customization.html#autocomplete-lookups
the first code-black is misformatted which is not the case with the default theme. I guess the reason is @staticmethod, and I hope it´s not my fault ...


Write Researcha TT-DDPM Proposal - Iteration 1

From Martin comments
https://uq-berlin.slack.com/archives/D0168AT80RY/p1713873401234819
"If the plan is to use TTs in DDPM (which is absolutely worth a shot), this has to be described (in a 5-10 pages research plan, not an overview document) in full detail but only what is required for the new method. Goals, structure, possible analytical results, algorithms etc. etc."
To be finished on 1 May 2024

Sent to martin
@meigel
Hi Martin , hope you are doing well :) . I am just touch-basing with you to communicate my progress so far
I am attaching a (DRAFT) research proposal for Tensor-Train DDPM models. I have put the layout based on your recommendations. As it is still in the DRAFT phase I am not asking for a review yet from you.
The important thing I have added details for is section 4.1 on the architecture for approximating the parametric noise for DDPM using Functional-Tensor-Train (FTT) and two different basis functions : Legendre Polynomials and B-Splines. This is to answer your question about how FTT can model non-stationary processes like DDPM , contrary to the Tensor-Train Density Estimation work. The core equation that would answer this is eq.13 p8 in the draft-proposal.
The important section I am working on is section 4.2 on the optimization of the proposed architecture. I am planning to experiment two method : Alternating Linear Scheme and Riemannian Gradient Descent
The rationale behind experimenting ALS with DDPM is i) the loss in DDPM is L2 loss to which ALS can be directly applied ii) I had a discussion with Charles about his experiments with David about applying FTT to Rectified-Flows . Charles and I had a long meeting through walking through the code and he has good initial results with 2-cluster Gaussian Mixture with TT-RecFlow. I think this something I can base my work on
The rationale behind experimenting with RGD is that it has been successfully applied in TTDE context and other TT-ML context, so as a plan B if ALS failed, RGD would be something worthy to experiment
Also I have the details of planned experiments in section 5 , like toy- and real-world datasets to use, quality measure etc..
Next Step
As Charles shared the TT-Recflow code with me , I will spent time experimenting with it to i) gain more experience with ALS opt. and ii) get ideas that can be useful in my TT-DDPM work, as already RecFlow has some similarities to DDPM in both the domain and objective function.
Based on the experience and idea I will get from step A , I will add the details of section 4.2 (optimization) in the proposal
I hope you are having a long weekend and accept my apologies for connecting in your non-working day. Once I have more "significant" progress, I will contact you for a f2f meeting. (edited)
PDF
tt-ddpm-proposal-draft-mbaddar.pdf


Fixes Deploys

The actual fix is 82f9f8d – I think it has to do with an implementation detail of Fastlane that changed, but I can't be sure. Took a look but can't determine the cause. However, this has fixed the most recent beta build. The DEVELOPMENT_TEAM addition is scoped to Store builds, so this should not affect day-to-day development.
The other commit was to remove update_project_team since automatic_code_signing now accepts a team_id param, so we can just use the one action.

Ace 👍


cannot find "Blob Index tags" option

[Enter feedback here]

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 212e4923-c8a9-b800-880a-84d3dc450438
Version Independent ID: 42c37760-0599-6843-34fa-86eda2cab55e
Content: Utilize Blob Index to manage and find data on Azure Blob storage
Content Source: articles/storage/blobs/storage-blob-index-how-to.md
Service: storage
Sub-service: blobs
GitHub Login: @mhopkins-msft
Microsoft Alias: mhopkins

@juanren For preview, you must first register your subscription before you can use Blob Index for your storage account in the preview regions. More info can be found in the document below:
https://docs.microsoft.com/en-us/azure/storage/blobs/storage-manage-find-blobs


SDK Functionalities not working on the device (Only when built, in editor works fine)

[REQUIRED] Please fill in the following fields:
Unity editor version: _____2020.1.0f1
Firebase Unity SDK version: _____Latest
Source you installed the SDK: _____ .unitypackage
Problematic Firebase Component: _____ Database
Other Firebase Components in use: _____ Auth, Database and Analytics
Additional SDKs you are using: _____ Facebook
Platform you are using the Unity editor on: _____ Mac
Platform you are targeting: _____ iOS, Android
Scripting Runtime: _____ IL2CPP
[REQUIRED] Please describe the issue here:
I am having so much trouble with this SDK! I just came across another bug that I cannot solve.
So, I added the Firebase and Facebook SDK's in my unity project and something weird happened.
My code works perfectly in the Unity Editor (Email/Password and Facebook Login) with no errors whatsoever. BUT, when I build it into iOS and try it out on my code, nothing regarding the SDK works, not even the button that makes the login (It should activate a message that says that I have to fill out the email field, etc..). Even if I fill out the information it doesn't do anything.
The facebook button does trigger the login process, but when it comes to the end and starts to return from the facebook app to mine, it just returns to the login screen as if nothing had happened (It should go to the main screen instead).
As I said in the beginning, everything IS WORKING PERFECTLY in the editor, so I'm guessing It's something not very complex but specific that I don't have to knowledge solve on my own, given that I have dedicated all day on this matter.
Would really appreciate some help and please don't hesitate to ask for information that will help to accelerate this process.
Here are the other posts I made (don't know if I modified something I shouldn't:
https://github.com/firebase/quickstart-unity/issues/898#issuecomment-746039039
https://github.com/firebase/quickstart-unity/issues/892
Here are some of the errors from the Xcode:
CrashReporter: initialized 2020-12-17 19:49:32.185064-0300 zzzz[23059:8122575] Built from '2020.1/staging' branch, Version '2020.1.0f1 (2ab9c4179772)', Build type 'Release', Scripting Backend 'il2cpp' -> applicationDidFinishLaunching() 2020-12-17 19:49:32.257870-0300 zzzz[23059:8122575] Metal GPU Frame Capture Enabled 2020-12-17 19:49:32.258456-0300 zzzz[23059:8122575] Metal API Validation Enabled -> applicationDidBecomeActive() [Subsystems] Discovering subsystems at path /private/var/containers/Bundle/Application/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/YYYYYYYYYYYYYYYYYYYYYYYYYYYYYY/Data/UnitySubsystems GfxDevice: creating device client; threaded=1 Initializing Metal device caps: Apple A13 GPU Initialize engine version: 2020.1.0f1 (2ab9c4179772) CrashReporter: Could not parse crash report: Could not decode truncated crash log 2020-12-17 19:49:33.811029-0300 moovyn[23059:8122924] [Client] Updating selectors after delegate removal failed with: Error Domain=NSCocoaErrorDomain Code=4099 "The connection to service on pid 92 named com.apple.commcenter.coretelephony.xpc was invalidated from this process." UserInfo={NSDebugDescription=The connection to service on pid 92 named com.apple.commcenter.coretelephony.xpc was invalidated from this process.} 2020-12-17 19:49:33.814584-0300 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX[23059:8122575] Unbalanced calls to begin/end appearance transitions for <UnityViewControllerStoryboard: 0x103487ac0>. 2020-12-17 19:49:33.823953-0300 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX[23059:8122919] [tcp] tcp_input [C2.1:3] flags=[R] seq=265141129, ack=0, win=0 state=CLOSED rcv_nxt=265141129, snd_una=1607627885 2020-12-17 19:49:33.824001-0300 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX[23059:8122919] [tcp] tcp_input [C2.1:3] flags=[R] seq=265141129, ack=0, win=0 state=CLOSED rcv_nxt=265141129, snd_una=1607627885 2020-12-17 19:49:33.849809-0300 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX[23059:8122923] FBSDKLog: fb-messenger-share-api is missing from your Info.plist under LSApplicationQueriesSchemes and is required. 2020-12-17 19:49:33.858905-0300 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX[23059:8122924] [tcp] tcp_input [C3.1:3] flags=[R] seq=2668679344, ack=0, win=0 state=CLOSED rcv_nxt=2668679344, snd_una=1421442049 2020-12-17 19:49:33.858980-0300 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX[23059:8122924] [tcp] tcp_input [C3.1:3] flags=[R] seq=2668679344, ack=0, win=0 state=CLOSED rcv_nxt=2668679344, snd_una=1421442049 2020-12-17 19:49:34.978091-0300 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX[23059:8122919] [tcp] tcp_input [C4.2:3] flags=[R] seq=4236490899, ack=0, win=0 state=CLOSED rcv_nxt=4236490899, snd_una=2789091866 2020-12-17 19:49:34.978937-0300 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX[23059:8122919] [tcp] tcp_input [C4.2:3] flags=[R] seq=4236490899, ack=0, win=0 state=CLOSED rcv_nxt=4236490899, snd_una=2789091866 UnloadTime: 4.260792 ms Setting up Firebase Auth UnityEngine.DebugLogHandler:Internal_Log(LogType, LogOption, String, Object) UnityEngine.DebugLogHandler:LogFormat(LogType, Object, String, Object[]) UnityEngine.Logger:Log(LogType, Object) UnityEngine.Debug:Log(Object) AuthManager:InitializeFirebase() AuthManager:<Awake>b__12_0(Task1)
System.Action1:Invoke(T) System.Threading.Tasks.ContinuationTaskFromResultTask1:InnerInvoke()
System.Threading.Tasks.Task:Execute()
System.Threading.Tasks.Task:ExecutionContextCallback(Object)
System.Threading.ContextCallback:Invoke(Object)
System.Threading.ExecutionContext:RunInternal(ExecutionContext, ContextCallback, Object, Boolean)
System.Threading.ExecutionContext:Run(ExecutionContext, ContextCallback, Object, Boolean)
System.Threading.Tasks.Task:ExecuteWithThreadLocal(Task&)
System.Threading.Tasks.Task:ExecuteEntry(Boolean)
System.Threading.Tasks.Task:System.Threading.IThreadPoolWorkItem.ExecuteWorkItem()
System.Threading.ThreadPoolWorkQueue:Dispatch()
System.Threading._ThreadPoolWaitCallback:PerformWaitCallback()
(Filename: ./Runtime/Export/Debug/Debug.bindings.h Line: 35)
Using Facebook Unity SDK v8.1.1 with FBiOSSDK/8.2.0
UnityEngine.DebugLogHandler:Internal_Log(LogType, LogOption, String, Object)
UnityEngine.DebugLogHandler:LogFormat(LogType, Object, String, Object[])
UnityEngine.Logger:Log(LogType, Object)
UnityEngine.Debug:Log(Object)
Facebook.Unity.DebugLogger:Info(String)
Facebook.Unity.FacebookLogger:Info(String)
Facebook.Unity.FB:LogVersion()
Facebook.Unity.CompiledFacebookLoader:Start()
And here, from the unity console once it is built in the iphone:
[NORMAL LOGIN BUTTON]
Autoconnected Player NullReferenceException: Object reference not set to an instance of an object.
at AuthManager.Login (System.String _email, System.String _password) [0x00000] in <00000000000000000000000000000000>:0
at AuthManager.LoginButton () [0x00000] in <00000000000000000000000000000000>:0
at UnityEngine.Events.UnityAction.Invoke () [0x00000] in <00000000000000000000000000000000>:0
at UnityEngine.Events.InvokableCall.Invoke () [0x00000] in <00000000000000000000000000000000>:0
at UnityEngine.Events.UnityEvent.Invoke () [0x00000] in <00000000000000000000000000000000>:0
at Lean.Gui.LeanButton.DoClick () [0x00000] in <00000000000000000000000000000000>:0
at Lean.Gui.LeanButton.OnPointerUp (UnityEngine.EventSystems.PointerEventData eventData) [0x00000] in <00000000000000000000000000000000>:0
at UnityEngine.EventSystems.ExecuteEvents.Execute (UnityEngine.EventSystems.IPointerUpHandler handler, UnityEngine.EventSystems.BaseEventData eventData) [0x00000] in <00000000000000000000000000000000>:0
at UnityEngine.EventSystems.ExecuteEvents+EventFunction1[T1].Invoke (T1 handler, UnityEngine.EventSystems.BaseEventData eventData) [0x00000] in <00000000000000000000000000000000>:0    at UnityEngine.EventSystems.ExecuteEvents.Execute[T] (UnityEngine.GameObject target, UnityEngine.EventSystems.BaseEventData eventData, UnityEngine.EventSystems.ExecuteEvents+EventFunction1[T1] functor) [0x00000] in <00000000000000000000000000000000>:0
at UnityEngine.EventSystems.StandaloneInputModule.ProcessTouchPress (UnityEngine.EventSystems.PointerEventData pointerEvent, System.Boolean pressed, System.Boolean released) [0x00000] in <00000000000000000000000000000000>:0
at UnityEngine.EventSystems.StandaloneInputModule.ProcessTouchEvents () [0x00000] in <00000000000000000000000000000000>:0
at UnityEngine.EventSystems.StandaloneInputModule.Process () [0x00000] in <00000000000000000000000000000000>:0
at UnityEngine.EventSystems.EventSystem.Update () [0x00000] in <00000000000000000000000000000000>:0
UnityEngine.DebugLogHandler:Internal_LogException(Exception, Object)
UnityEngine.DebugLogHandler:LogException(Exception, Object)
UnityEngine.Logger:LogException(Exception, Object)
UnityEngine.Debug:LogException(Exception)
UnityEngine.EventSystems.ExecuteEvents:Execute(GameObject, BaseEventData, EventFunction`1)
UnityEngine.EventSystems.StandaloneInputModule:ProcessTouchPress(PointerEventData, Boolean, Boolean)
UnityEngine.EventSystems.StandaloneInputModule:ProcessTouchEvents()
UnityEngine.EventSystems.StandaloneInputModule:Process()
UnityEngine.EventSystems.EventSystem:Update()
(Filename: currently not available on il2cpp Line: -1)
[FACEBOOK LOGIN BUTTON]
Autoconnected Player NullReferenceException: Object reference not set to an instance of an object.
at AuthManager.loginviaFirebaseFacebook (Facebook.Unity.AccessToken accessToken) [0x00000] in <00000000000000000000000000000000>:0
at FacebookInit.authStatusCallback (Facebook.Unity.ILoginResult result) [0x00000] in <00000000000000000000000000000000>:0
at Facebook.Unity.FacebookDelegate`1[T].Invoke (T result) [0x00000] in <00000000000000000000000000000000>:0
at Facebook.Unity.CallbackManager.TryCallCallback[T] (System.Object callback, Facebook.Unity.IResult result) [0x00000] in <00000000000000000000000000000000>:0
at Facebook.Unity.CallbackManager.CallCallback (System.Object callback, Facebook.Unity.IResult result) [0x00000] in <00000000000000000000000000000000>:0
at Facebook.Unity.CallbackManager.OnFacebookResponse (Facebook.Unity.IInternalResult result) [0x00000] in <00000000000000000000000000000000>:0
at Facebook.Unity.FacebookBase.OnAuthResponse (Facebook.Unity.LoginResult result) [0x00000] in <00000000000000000000000000000000>:0
at Facebook.Unity.Mobile.MobileFacebook.OnLoginComplete (Facebook.Unity.ResultContainer resultContainer) [0x00000] in <00000000000000000000000000000000>:0
at Facebook.Unity.FacebookGameObject.OnLoginComplete (System.String message) [0x00000] in <00000000000000000000000000000000>:0
(Filename: currently not available on il2cpp Line: -1)

I Decided to add the codes I am using too. Here they are:
AuthManager
`using System.Collections;
using UnityEngine;
using Firebase;
using Firebase.Auth;
using TMPro;
using Facebook.Unity;
public class AuthManager : MonoBehaviour
{
//Firebase variables
[Header("Firebase")]
public DependencyStatus dependencyStatus;
public FirebaseAuth auth;
public FirebaseUser User;
//Login variables
[Header("Login")]
public TMP_InputField emailLoginField;
public TMP_InputField passwordLoginField;
public TMP_Text warningLoginText;
public TMP_Text confirmLoginText;
//Register variables
[Header("Register")]
public TMP_InputField usernameRegisterField;
public TMP_InputField emailRegisterField;
public TMP_InputField passwordRegisterField;
public TMP_InputField passwordRegisterVerifyField;
public TMP_Text warningRegisterText;
void Awake()
{
//Check that all of the necessary dependencies for Firebase are present on the system
FirebaseApp.CheckAndFixDependenciesAsync().ContinueWith(task =>
{
dependencyStatus = task.Result;
if (dependencyStatus == DependencyStatus.Available)
{
//If they are avalible Initialize Firebase
InitializeFirebase();
}
else
{
Debug.LogError("Could not resolve all Firebase dependencies: " + dependencyStatus);
}
});
}
private void InitializeFirebase()
{
Debug.Log("Setting up Firebase Auth");
//Set the authentication instance object
auth = FirebaseAuth.DefaultInstance;
auth.StateChanged += AuthStateChanged;
AuthStateChanged(this, null);
}
private void OnDestroy()
{
auth.StateChanged -= AuthStateChanged;
auth = null;
}
public void LoginButton()
{
Login(emailLoginField.text, passwordLoginField.text);
}
public void RegisterButton()
{
StartCoroutine(Register(emailRegisterField.text, passwordRegisterField.text, usernameRegisterField.text));
}
public void Login(string _email, string _password)
{
var LoginTask = auth.SignInWithEmailAndPasswordAsync(_email, _password);
LoginTask.ContinueWith(task =>
{
if (task.IsCanceled || task.IsFaulted)
{
Firebase.FirebaseException e =
task.Exception.Flatten().InnerExceptions[0] as Firebase.FirebaseException;
GetErrorMessage((AuthError)e.ErrorCode, warningLoginText);
return;
}
   if (task.IsCompleted)
   {
     User = LoginTask.Result;
     Debug.LogFormat("User signed in successfully: {0} ({1})", User.DisplayName, User.Email);
     warningLoginText.text = "";
     confirmLoginText.text = "Logged In";
     UIControllerLogin.instance.MainScreenScene();
   }
 });

}
public IEnumerator Register(string _email, string _password, string _username)
{
if (_username == "")
{
//If the username field is blank show a warning
warningRegisterText.text = "Missing Username";
}
else if (passwordRegisterField.text != passwordRegisterVerifyField.text)
{
//If the password does not match show a warning
warningRegisterText.text = "Password Does Not Match!";
}
else
{
//Call the Firebase auth signin function passing the email and password
var RegisterTask = auth.CreateUserWithEmailAndPasswordAsync(_email, _password);
//Wait until the task completes
yield return new WaitUntil(predicate: () => RegisterTask.IsCompleted);
  if (RegisterTask.Exception != null)
  {
    //If there are errors handle them
    FirebaseException e =
        RegisterTask.Exception.Flatten().InnerExceptions[0] as FirebaseException;
    GetErrorMessage((AuthError)e.ErrorCode, warningRegisterText);
  }
  else
  {
    //User has now been created
    //Now get the result
    User = RegisterTask.Result;

    if (User != null)
    {
      //Create a user profile and set the username
      UserProfile profile = new UserProfile { DisplayName = _username };

      //Call the Firebase auth update user profile function passing the profile with the username
      var ProfileTask = User.UpdateUserProfileAsync(profile);
      //Wait until the task completes
      yield return new WaitUntil(predicate: () => ProfileTask.IsCompleted);

      if (ProfileTask.Exception != null)
      {
        //If there are errors handle them
        Debug.LogWarning(message: $"Failed to register task with {ProfileTask.Exception}");
        FirebaseException firebaseEx = ProfileTask.Exception.GetBaseException() as FirebaseException;
        AuthError errorCode = (AuthError)firebaseEx.ErrorCode;
        warningRegisterText.text = "Username Set Failed!";
      }
      else
      {
        //Username is now set
        //Now return to login screen
        UIControllerLogin.instance.LoginScreenActive();
        warningRegisterText.text = "";
      }
    }
  }
}

}
void AuthStateChanged(object sender, System.EventArgs eventArgs)
{
if (auth.CurrentUser != User)
{
bool signedIn = User != auth.CurrentUser && auth.CurrentUser != null;
if (!signedIn && User != null)
{
Debug.Log("Signed out " + User.UserId);
UIControllerLogin.instance.LoginScene();
}
User = auth.CurrentUser;
if (signedIn)
{
Debug.Log("Signed in " + User.UserId);
UIControllerLogin.instance.MainScreenScene();
string displayName = User.DisplayName ?? "";
string emailAddress = User.Email ?? "";
// string photoUrl = User.PhotoUrl ?? "";
string uid = User.UserId ?? "";
}
}
}
void GetErrorMessage(AuthError errorCode, TMP_Text INFText)
{
string msg = "";
msg = errorCode.ToString();
switch (errorCode)
{
  case AuthError.InvalidEmail:
    INFText.text =
      Lean.Localization.LeanLocalization.GetTranslationText($"Login/InvalidEmailOrPSW");
    print(Lean.Localization.LeanLocalization.GetTranslationText($"Login/InvalidEmailOrPSW"));
    break;

  case AuthError.WrongPassword:
    INFText.text =
      Lean.Localization.LeanLocalization.GetTranslationText($"Login/InvalidEmailOrPSW");
    print(Lean.Localization.LeanLocalization.GetTranslationText($"Login/InvalidEmailOrPSW"));
    break;

  case AuthError.AccountExistsWithDifferentCredentials:
    INFText.text =
      Lean.Localization.LeanLocalization.GetTranslationText($"Login/DiffCredentials");
    print(Lean.Localization.LeanLocalization.GetTranslationText($"Login/DiffCredentials"));
    break;

  case AuthError.MissingPassword:
    INFText.text =
      Lean.Localization.LeanLocalization.GetTranslationText($"Login/MissingPSW");
    print(Lean.Localization.LeanLocalization.GetTranslationText($"Login/MissingPSW"));
    break;

  case AuthError.MissingEmail:
    INFText.text =
      Lean.Localization.LeanLocalization.GetTranslationText($"Login/MissingEmail");
    print(Lean.Localization.LeanLocalization.GetTranslationText($"Login/MissingEmail"));
    break;

  case AuthError.EmailAlreadyInUse:
    INFText.text =
      Lean.Localization.LeanLocalization.GetTranslationText($"Login/EmailInUse");
    print(Lean.Localization.LeanLocalization.GetTranslationText($"Login/EmailInUse"));
    break;

  case AuthError.TooManyRequests:
    INFText.text =
      Lean.Localization.LeanLocalization.GetTranslationText($"Login/ManyRequests");
    print(Lean.Localization.LeanLocalization.GetTranslationText($"Login/ManyRequests"));
    break;

  case AuthError.SessionExpired:
    INFText.text =
              Lean.Localization.LeanLocalization.GetTranslationText($"Login/SessionExpired");
    print(Lean.Localization.LeanLocalization.GetTranslationText($"Login/SessionExpired"));
    break;

  case AuthError.WeakPassword:
    INFText.text =
      Lean.Localization.LeanLocalization.GetTranslationText($"Login/WeakPSW");
    print(Lean.Localization.LeanLocalization.GetTranslationText($"Login/WeakPSW"));
    break;

  case AuthError.UserNotFound:
    INFText.text =
      Lean.Localization.LeanLocalization.GetTranslationText($"Login/UserNotFound");
    print(Lean.Localization.LeanLocalization.GetTranslationText($"Login/UserNotFound"));
    break;

  default:
    print($"errorCode: {msg}");
    break;
}

}
public void loginviaFirebaseFacebook(AccessToken accessToken)
{
Firebase.Auth.Credential credential =
Firebase.Auth.FacebookAuthProvider.GetCredential(accessToken.TokenString);
auth.SignInWithCredentialAsync(credential).ContinueWith(task =>
{
if (task.IsCanceled)
{
Debug.LogError("SignInWithCredentialAsync was canceled.");
warningLoginText.text = "SignInWithCredentialAsync was canceled";
return;
}
if (task.IsFaulted)
{
Debug.LogError($"SignInWithCredentialAsync encountered an error: {task.Exception}");
warningLoginText.text = $"SignInWithCredentialAsync encountered an error: {task.Exception}";
    return;
  }

  User = task.Result;
  Debug.LogFormat("User signed in successfully: {0} ({1})", User.DisplayName, User.UserId);
  UIControllerLogin.instance.MainScreenScene();
});

}
}
`
FBManager
`using System.Collections;
using System.Collections.Generic;
using UnityEngine;
using Firebase.Auth;
using Facebook.Unity;
public class FacebookInit : MonoBehaviour
{
private AuthManager AuthManagercs;
// Start function from Unity's MonoBehavior
void Start()
{
AuthManagercs = GetComponent();
if (!FB.IsInitialized)
{
  FB.Init(initCallback, onHideUnity);
}
else
{
  // Already initialized
  FB.ActivateApp();
}

}
private void initCallback()
{
if (FB.IsInitialized)
{
// Signal an app activation App Event
FB.ActivateApp();
// Continue with Facebook SDK
// ...
}
else
{
Debug.Log("Something went wrong to Initialize the Facebook SDK");
}
}
private void onHideUnity(bool isGameScreenShown)
{
if (!isGameScreenShown)
{
// Pause the game - we will need to hide
Time.timeScale = 0;
}
else
{
// Resume the game - we're getting focus again
Time.timeScale = 1;
}
}
public void FacebookButton()
{
// Permission option list https://developers.facebook.com/docs/facebook-login/permissions/
var permissons = new List()
{"email",
// "user_birthday",
// "user_friends",
"public_profile"};
FB.LogInWithReadPermissions(permissons, authStatusCallback);
}
private void authStatusCallback(ILoginResult result)
{
if (FB.IsLoggedIn)
{
// AccessToken class will have session details
AccessToken accessToken = Facebook.Unity.AccessToken.CurrentAccessToken;
// current access token's User ID : aToken.UserId
AuthManagercs.loginviaFirebaseFacebook(accessToken);
}
else
{
Debug.Log("User cancelled login");
}
}
}
`

From my experience, everything is in the main thread in editor, but not on devices, so ensure you're in the main thread with ContinueWithOnMainThread for example.
Next, use sdk 6.16.1.
And finally, use the debugger to know what is null and understand what's happening on the device and what is null exactly.

@paradizIscool
This is very confusing to me. Where can I see the SDK version? I downloaded it from the Firebase website as I was following the tutorial, so it must be in the last version.
I have no idea how that function works, so I'll start researching it to try to understand. In the meanwhile, if you have some time, could you explain it to me?
For the last suggestion you made, that is the problem. Even if I find what is null, it only happens in the device, so I have no idea what to do in order to fix it....

This is very confusing for me too :)
Release notes are here https://firebase.google.com/support/release-notes/unity
But some releases are unusable. Just take a look at bug reports.
I haven't test 7.0.1  but I see lots of regression in the bug report. I tested 7.0.0 which did not compile, 6.16.0 did not compile either, 6.16.1 did compile, but I had to find some workarounds and report a couple of bugs (fixed now but not released).

@Nicokkam
For download old versions:
https://dl.google.com/firebase/sdk/unity/firebase_unity_sdk_a.b.c.zip
For example:
https://dl.google.com/firebase/sdk/unity/firebase_unity_sdk_6.16.1.zip

When it comes to library interdependencies on auth login flows I find it easier to create building blocks in isolated apps.  There are a couple of things that stand out to me as a good way to move forward debugging this issue.

Is there any chance that you're moving between scenes?  I've noticed that the Firebase init code is in Awake().  I recommend following patm1987@'s example of a safe way to this.

I notice in the Facebook login flow that the logged errors seem entirely in their SDK. It might be worth isolating usage of that SDK (create a standalone flow without importing any Firebase dependencies) and see if it returns an error-free token back on iOS.  Additionally log the token so that you can visually validate it.  If any errors occur in this process then it would be worth sending them to Facebook support since we don't have much visibility into their SDK.

For the Firebase Login via Email, I likewise recommend creating a stand alone example without importing the Facebook SDK into your project.  Additionally it's worth logging the email and password just before invoking SignInWithEmailAndPasswordAsync() to ensure they're the values you expect. Also put a log at the top of the continuation to see if it's ever invoked.  If you have any issues there then please post them here.

After that, it would be interesting to try to isolate any conflicts between the SDKs.  That is, if you are able to get a Facebook token back from their SDK then the next step would be to import the Firebase Auth unity package  -- but don't invoke any Firebase APIs directly yet.  Simply import it.  Does the Facebook SDK still return a valid token?  Also vice versa: with the Firebase login with email and password standalone app.  Does simply importing the Facebook SDK have any side effects on the Firebase app?

I hope this helps!

Hi @Nicokkam,
Also, I wonder if this is all related to the use_frameworks! issue for iOS #862.
Are you only ever experiencing the problem on iOS, and do you see a use_frameworks! the podfile of your XCode project?
Thanks.

Hello @DellaBitta,
Sorry for the delay of answering this thread. I'll be looking into the point's you listed above and will provide you a feedback of the results!

Is there any chance that you're moving between scenes?  I've noticed that the Firebase init code is in Awake().  I recommend following patm1987@'s example of a safe way to this.

Yes, I am moving between scenes. I have just implemented Patrick's example to my project and it continued working as it was on my editor (will build it and test it on my iPhone and add an EDIT) but it started to point out one error to both login methods (email and facebook) only when I logged in one time, logged out and then tried to login again:
NullReferenceException: Object reference not set to an instance of an object.
I believe it is because I commented out the following part of my code and used the OnFirebaseInitialized UnityEvent within Patrick's code to call the InitializeFirebase() method within my code (described above).
void Awake()
{
FirebaseApp.CheckAndFixDependenciesAsync().ContinueWith(task =>
{
dependencyStatus = task.Result;
if (dependencyStatus == DependencyStatus.Available)
{
InitializeFirebase();
}
else
{
Debug.LogError("Could not resolve all Firebase dependencies: " + dependencyStatus);
}
});
}

Hi @Nicokkam,
Also, I wonder if this is all related to the use_frameworks! issue for iOS #862.
Are you only ever experiencing the problem on iOS, and do you see a use_frameworks! the podfile of your XCode project?
Thanks.

I was just focusing on iOS for now, given that I have an iPhone. I am going to test it out on an Emulator within Android Studio and then I will let you know.

Hi @Nicokkam,
Is it possible for you to create a simple minimal reproducible sample for this?
It will be awesome and will help us debug faster if you can try this out in our Unity quickstart examples and build on top of that.

@Nicokkam
I wonder if your problem can be resolved with this workaround.
https://github.com/firebase/quickstart-unity/issues/862#issuecomment-752945417
I've been looking into issues related to use_frameworks! and target 'Unity-iPhone', and seems like Firebase Unity SDK does not handle well with them. Those lines are added by Facebook SDK here.
Please let us know.  This would help us to resolve these series of issues related to Xcode.

@Nicokkam
I wonder if your problem can be resolved with this workaround.
https://github.com/firebase/quickstart-unity/issues/862#issuecomment-752945417
I've been looking into issues related to use_frameworks! and target 'Unity-iPhone', and seems like Firebase Unity SDK does not handle well with them. Those lines are added by Facebook SDK here.
Please let us know.  This would help us to resolve these series of issues related to Xcode.

Hi @Nicokkam,
Is it possible for you to create a simple minimal reproducible sample for this?
It will be awesome and will help us debug faster if you can try this out in our Unity quickstart examples and build on top of that.

Hello @vimanyu and @chkuang-g,
I am dedicating my time on other issues for the time being because this was taking a lot of my development time. I intend to return to this soon and I will let you know.
What I can say is that I added Firebase and Facebook SDK's (both in the latest version) in my project and followed the manual of both providers. Regarding Firebase packages, I had imported the Analytics and the Auth one's.

Hi @Nicokkam,
Is it possible for you to create a simple minimal reproducible sample for this?
It will be awesome and will help us debug faster if you can try this out in our Unity quickstart examples and build on top of that.

Hello @vimanyu and @chkuang-g,
I am dedicating my time on other issues for the time being because this was taking a lot of my development time. I intend to return to this soon and I will let you know.
What I can say is that I added Firebase and Facebook SDK's (both in the latest version) in my project and followed the manual of both providers. Regarding Firebase packages, I had imported the Analytics and the Auth one's.

No problem.
I posted a slightly long comment here https://github.com/firebase/quickstart-unity/issues/862#issuecomment-758893827 about my findings.  I think this is the cause of your issue.
Please take a look when you have time.
For management purpose, I will close this issue for now.  Please follow #862 for future updates!

No problem.
I posted a slightly long comment here https://github.com/firebase/quickstart-unity/issues/862#issuecomment-758893827 about my findings.  I think this is the cause of your issue.
Please take a look when you have time.
For management purpose, I will close this issue for now.  Please follow #862 for future updates!


Compilation error with 1.0.2

I tried to build it as Dyanmic Framework and
I got 'NSDictionary+Accessors/NSDictionary+Accessors.h' file not found
in WBJSBridgeMessage.m and WBWebViewConsoleUserPromptCompletionController.m
Here is the POD file
use_frameworks!
pod 'WBWebViewConsole', '~> 1.0.2’

Fix:
Replacing this the following header import in WBJSBridgeMessage.m and WBWebViewConsoleUserPromptCompletionController.m
#import <NSDictionary+Accessors/NSDictionary+Accessors.h>
with this
#import "NSDictionary+Accessors.h"
fixed the issue

As I am not collobrator I couldn't re-open issue that's closed by you(collobrator) and so I raised the new issue here.

Hi,
I fixed this issue and pushed some changes to master branch. Those commits also removed all dependencies for WBWebViewConsole.
Please (temporary) change your Podfile declaration to
pod 'WBWebViewConsole', :git => 'https://github.com/Naituw/WBWebViewConsole.git'
and try again.

Works fine and nice to see WBWebViewConsole without dependencies 👍


Cleaning up package.json

The package.json has config for multiple other modules namely babel, ava, eslint, electron-builder and husky.
While initially it might've made sense to add the configs to package.json, but now it has become a 350 line behemoth. And looking for anything in it is hard.
We can split it into separate configs for the other modules, which will help clear it up and we will also benefit from autocomplete and explanation for keys from the json schema store for these configs, which is not possible currently, inside package.json.
I can send a pr if we want to do this.

@Stanzilla what do you think about it?

I'm fine with it!


Is similar data available for other countries (number of deaths by death date)?

Hej Adam,
Thanks for your awesome work, it's still one of the few graphs I browse regularly to keep me updated of the COVID situation in Sweden.
I find really shameful that the reporting delay is so bad and that it's gotten worse during this second wave. But I actually have no certainty that it's better in other countries. I've been looking for datasets that would enable me to determine if that's the case, without much success so far. Have you found any?

Long time since I looked, but back then I couldn't find it anywhere. I most definitely share your concern though. If you find any please do post it here.

Long time since I looked, but back then I couldn't find it anywhere. I most definitely share your concern though. If you find any please do post it here.

I asked on a Nordic datajournalist and was told that Finland started publishing deaths by death date last fall. I haven't been able to find the raw data yet but here is an example:
https://sampo.thl.fi/pivot/prod/en/epirapo/covid19case/fact_epirapo_covid19case?column=measure-492118&row=dateweek20200101-508804L
I guess by getting the raw data for each publishing day, we could recreate the same data you use from FHM.

I asked on a Nordic datajournalist and was told that Finland started publishing deaths by death date last fall. I haven't been able to find the raw data yet but here is an example:
https://sampo.thl.fi/pivot/prod/en/epirapo/covid19case/fact_epirapo_covid19case?column=measure-492118&row=dateweek20200101-508804L
I guess by getting the raw data for each publishing day, we could recreate the same data you use from FHM.

Thanks! Yes indeed! It seems like their API creates csv links like this: https://sampo.thl.fi/pivot/prod/sv/epirapo/covid19case/fact_epirapo_covid19case.csv?row=dateweek20200101-508804L&column=measure-492118&
Should be able to set up a downloader and host the data on this site. Very nice. Think I'll have some time to implement it tonight.

Thanks! Yes indeed! It seems like their API creates csv links like this: https://sampo.thl.fi/pivot/prod/sv/epirapo/covid19case/fact_epirapo_covid19case.csv?row=dateweek20200101-508804L&column=measure-492118&
Should be able to set up a downloader and host the data on this site. Very nice. Think I'll have some time to implement it tonight.

Great, I can try and write them an FOIA request to see if they have some older files.

Great, I can try and write them an FOIA request to see if they have some older files.

That would be awesome. Starting to download now would mean one could only see the extent of the reporting delay from today onwards.

That would be awesome. Starting to download now would mean one could only see the extent of the reporting delay from today onwards.

Hi @juhanisaa, I see that you have collected a lot of Finnish COVID data and are explaining it here.
I am tagging you here because we are currently looking for older versions of the list of deaths by death date published through THL's API (this call). Is this something that you might have saved on your servers? I had a look but couldn't find it.
Thanks in advance.

Hi @juhanisaa, I see that you have collected a lot of Finnish COVID data and are explaining it here.
I am tagging you here because we are currently looking for older versions of the list of deaths by death date published through THL's API (this call). Is this something that you might have saved on your servers? I had a look but couldn't find it.
Thanks in advance.

I believe we haven't stored that data, but I'll have to confirm.

I believe we haven't stored that data, but I'll have to confirm.

Thanks @juhanisaa! Don't hesitate to tell us if you get your hands on it!
@adamaltmejd, I found another country really interesting to compare with! The UK has death data by death date!

Thanks @juhanisaa! Don't hesitate to tell us if you get your hands on it!
@adamaltmejd, I found another country really interesting to compare with! The UK has death data by death date!

Very nice! Thanks. I'll try to find some time to put together crawlers. Sorry for not doing it yet.

Very nice! Thanks. I'll try to find some time to put together crawlers. Sorry for not doing it yet.

No worry, I'll start downloading them manually this week so we don't lose more data. I'm also sending an FOIA request to the British authorities to try to get the old files. From what I could see, some months are available on Github.

No worry, I'll start downloading them manually this week so we don't lose more data. I'm also sending an FOIA request to the British authorities to try to get the old files. From what I could see, some months are available on Github.

Very interesting! Keep me posted :)

Very interesting! Keep me posted :)

Ok I've just set up the code to download data from the finish and UK repos. Lets see if it works :)

Ok I've just set up the code to download data from the finish and UK repos. Lets see if it works :)

Here is a repo containing all the data for the UK since the 5th of October. Thanks @msleigh!
Note that it is the CSV file distinguishing the nations composing the United Kingdom. Maybe we want to download this file in the future? In any case, it seems to be fetched automatically on the aforementioned repo.

Here is a repo containing all the data for the UK since the 5th of October. Thanks @msleigh!
Note that it is the CSV file distinguishing the nations composing the United Kingdom. Maybe we want to download this file in the future? In any case, it seems to be fetched automatically on the aforementioned repo.

For the UK you can download data going back further with Archive  in https://coronavirus.data.gov.uk/details/download (didn't exist when I made my repo)

For the UK you can download data going back further with Archive  in https://coronavirus.data.gov.uk/details/download (didn't exist when I made my repo)

In this repo, we have bigger CSV files containing deaths by date of death among other things. Dating back to the 13th of October. Thanks @theosanderson!
Here is a repo having the period 23/08 -> 30/11. Thanks @nathanrawle!
On this repo, there is a file named death_data.csv updated everyday since the 26th of October. Thanks @rvaughan!
Finally, in this repo, the same data is present since the 8th of December. Thanks @msleigh!
Note that the first one distinguishes by county and the other two by nation. Maybe we want to download this file in the future? In any case, it seems to be fetched automatically on the first aforementioned repo.

No problem. I obtained the data from the API @theosanderson mentioned, from which you can access whichever metrics you want as they were published on x date in the past backdated up to 23 August. Releases from 31 Nov up to yesterday can be scraped in the same way now.

In this repo, we have bigger CSV files containing deaths by date of death among other things. Dating back to the 13th of October. Thanks @theosanderson!
Here is a repo having the period 23/08 -> 30/11. Thanks @nathanrawle!
On this repo, there is a file named death_data.csv updated everyday since the 26th of October. Thanks @rvaughan!
Finally, in this repo, the same data is present since the 8th of December. Thanks @msleigh!
Note that the first one distinguishes by county and the other two by nation. Maybe we want to download this file in the future? In any case, it seems to be fetched automatically on the first aforementioned repo.

No problem. I obtained the data from the API @theosanderson mentioned, from which you can access whichever metrics you want as they were published on x date in the past backdated up to 23 August. Releases from 31 Nov up to yesterday can be scraped in the same way now.

Fantastic, thanks everyone! I'll put together a dataset with daily releases to measure reporting delay and to evaluate our model on. Exciting :)

Fantastic, thanks everyone! I'll put together a dataset with daily releases to measure reporting delay and to evaluate our model on. Exciting :)

Be aware that the release for 7/10/2020 is missing from https://coronavirus.data.gov.uk/details/download and will return HTTP200 with no content

Be aware that the release for 7/10/2020 is missing from https://coronavirus.data.gov.uk/details/download and will return HTTP200 with no content

Hej Adam, would you like some help to convert the new data to the same format you feed the current graphs? I don't have any experience with R but it shouldn't be too hard to build on your code. I just need to get a dev env running.
After getting that working and maybe a graph comparing Sweden's delay with the others, I thought it could be interesting to write a blog post about the findings.

Feel free to explore it if you want! I won't have time to do anything for a week or two.

Made a version of my graph for the UK. Can be seen here: https://adamaltmejd.se/covid/deaths_lag_uk.png

Awesome! I actually played with it myself but I got so many small bugs with R trying to recompile the delta-t for the data since last Summer, I gave up at some point.

What's your early analysis? It seems like the British data has some interesting constants (no same day data, no data on Sundays nor on public holidays) that are similar to the Swedish one.
But besides that, there is just so much less blue on the UK's graph, they seem to be reporting the deaths many times faster and the ones over 14 days late are anecdotical.

It's impossible to know the causes for such a difference at that point. Difference in death confirmation method? Different delays in reporting? Incompetence? Nonchalance?
But it would be interesting to discuss it with journalists and see if they can investigate and maybe question FHM about it.

That makes sense although for this as for much of the Swedish government with COVID, it's hard to justify that when other countries were able to do better.
How close would you say you are from generating the other graphs (reporting delay) and some with the Finnish data? Should we wait before sending this to journalists?
I think it would be great to send that to the data team at DN which has a graph similar to yours with deaths by death date. They would be able to double-check the data and code. Emanuel Karlsten would also probably be interested. Do you have time to do it? I could write a draft if you want.

Adding Finland is easy now, but the issue is that we do not have data going back in time and I haven't been collecting for long. Or did you manage to get archived data?

Seems also there is a bug with the finish data, for some reason its stopped collecting deaths and only collect cases for the last five days. https://github.com/adamaltmejd/covid/commit/c26de6e07f7937844b349749bd8282ec7b80023d
Trying to fix now...

Last time I checked, I couldn't find any older data. And the agency didn't save it either 🤦🏻♂.
Maybe we should focus on the UK for now.

No idea why but seems we lost 6 days of downloads... Really unfortunate.

Here is a proposal for an e-mail to journalists:
Hej,

Jag kontaktar er eftersom jag tror att vi har upptäckt något som kan vara värt ert intresse angående COVID-19 och hur pandemin hanteras av regeringen.

Under det senaste året har Adam Altmejd, forskare på handelshögskolan i Stockholm, sammanställt Sveriges dödsfall efter dödsdatum och publicerat visualiseringar som visar hur länge det tar för dödsfall att rapporteras. De ligger på adamaltmejd.se/covid och källkoden som genererar och uppdaterar visualiseringarna finns på github.com/adamaltmejd/covid. Allt är baserat på öppna data från Folkhälsomyndigheten.

Dödsfall rapporteras ofta några dagar sent och under andra vågen har det ökat mycket, en majoritet rapporterades över 7 eller 14 dagar sent.
Vi tyckte att det var konstigt så vi letade efter andra länders data för att kunna jämföra. Tyvärr publicerar väldigt få länder dödsfall efter dödsdatum men vi hittade två: Storbritannien och Finland.

Här är visualiseringarna för Sverige och Storbritannien bredvid varandra. Som ni kan se är skillnaden mycket stor. Det tar knappt några dagar och nästan aldrig över 7 dagar i Storbritannien.

Vi kan inte veta varför skillnaden är så stor och därför kontaktar vi er som är professionella journalister. Om ni tycker att det är relevant hoppas vi att ni kan kolla det här djupare och kanske ställa frågor kring det till de relevanta makthavarna.

Allt vårt arbete kring detta ligger på Github.

Here is finland: https://adamaltmejd.se/covid/deaths_lag_finland.png, not much there because of the low total numbers but they are very slow!
Feel free to send an email like that, it sounds great! I don't have time to manage it so would prefer not to sign it, but would of course be excellent if more journalists noticed these differences.

Here is finland: https://adamaltmejd.se/covid/deaths_lag_finland.png, not much there because of the low total numbers but they are very slow!

That's really interesting to see!

Feel free to send an email like that, it sounds great! I don't have time to manage it so would prefer not to sign it, but would of course be excellent if more journalists noticed these differences.

OK! Well, I won't remove your name since you're behind all this but I can send the e-mail and have you in cc. I don't have time to push it further either and we don't have any more knowledge anyway.

Thats what I meant! I'm really happy and appreciate you doing this, just don't want to be a signatory of the email cause I'm trying to put less not more time into Covid stuff :).

I understand! I sent the e-mails to DN and Emanuel Karlsten, you're in cc. Let's see what they answer 🙂.

Very cool. Thanks for engaging with this!!


rename to molotov

@tarekziade what's wrong with cosmpolitan? ;)

@tarekziade @chartjes Do we have a longer term vision for this? Right now this adds a decorator for weighted tests.  Are there other features we may want to add to tests in future?  If so, perhaps this should have a name indicating that it's a catch-all, helper lib of sorts: loadtest-utils??
The Makefile also provides some swiss-army knife types operations for packaging your tests to run with loads-broker so we should take that into consideration when naming this.

I think the scope of Molotov is to let people :

create a load test script against a service, using vanilla python
provide a CLI to run a load test locally
make it easy to embed in a distributed test using loads

So I don't think it requires to be named after Loads as it's fairly standalone.

I am going to make the assumption that works for you @rpappalax because I want to hack on this this week-end, but if that name does not sound good we can always revert of course

I am forking it here for now so in case some tests are linking to this repo they don't get broken
https://github.com/tarekziade/ailoads


Non-closure version of jax.vjp

The current jax.vjp returns (primals_out, vjpfun) with vjpfn a closure with saved intermediates. Would it be possible to also get a version of it that returns explicitly the intermediates, i.e. (primals_out, vjpfun_no_closure, intermediates).
Thanks in advance!

Thanks for the question!
Actually, the returned vjpfun is a PyTree, basically a flattenable version of a functools.partial. So you can write intermediates, vjpfun_no_closure_treedef = jax.tree.flatten(vjpfun). Here vjpfun_treedef isn't actually a callable (maybe we should change that...), but you can re-hydrate it into a callable again like vjpfun = jax.tree.unflatten(vjpfun_no_closure_treedef, intermediates). intermediates is just a list of jax.Arrays, though it's pretty opaque in the sense that you don't get any hints about to which intermediates or inputs of the differentiated function they correspond. (This opacity is something we're thinking about improving, though we don't know the best way yet...)
Does that cover what you need?

Here's a simple code example:
import jax
import jax.numpy as jnp

def f(x):
  x = jnp.sin(x)
  x = jnp.sin(x)
  return x

y, vjpfun = jax.vjp(f, 1.)

intermediates, vjpfun_treedef = jax.tree.flatten(vjpfun)
print(intermediates)
# [Array(0.5403023, dtype=float32, weak_type=True), Array(0.66636676, dtype=float32, weak_type=True)]

vjpfun2 = jax.tree.unflatten(vjpfun_treedef, intermediates)
x_grad, = vjpfun2(1.)
print(x_grad, jnp.cos(1.) * jnp.cos(jnp.sin(1.)))  # 0.36003947 0.36003947

@mattjj Thanks again for your answer! Got a follow-up question. After playing with the Pytree a bit, I think a better of describing what I wanted ultimately is to get a "standalone" backward function that I can call. I was trying to do something like the following:
import jax
import jax.numpy as jnp

def f(x):
  x = jnp.sin(x)
  x = jnp.sin(x)
  return x

# something already computed in the past
# assume already exists
saved = [0.5403023, 0.66636676]

# obtain the vjpfun
_, vjpfun = jax.vjp(f, 1.)
_intermediates, vjpfun_treedef = jax.tree.flatten(vjpfun)
vjpfun2 = jax.tree.unflatten(vjpfun_treedef, saved)

# compute the backward gradient
x_grad, = vjpfun2(1.)

I was hoping that this way I can effectively obtain the vjpfun2 without incurring any extra compute (assuming that I have already computed the intermediates in the past) and I will only trigger the "pytorch-ish backward pass" by vjpfun2(1.). Based on the runtime I get, it seems like that is not the case and the "forward pass" is still called because of jax.vjp(f, 1.). I wonder if there's a way I can get a function that only corresponds to the backward in JAX.


Testing problem in Windows

Currently, I use Windows machine to develop (usually using MacOS). When testing my component, I usually use command yarn run test containers/HomePage -- --verbose and it works perfectly in MacOS and it will run only test files inside that directory. But when I use the same command in Windows, no tests were found. I can use yarn run test HomePage -- --verbose and it works but for some case (e.g. running for App directory) it will run entire testing files. So how to make it works, running specific folder on Windows machine? thanks

Try yarn run test containers\HomePage since Windows has backslashes

Hey @archansel, the mentioned fix by @sourcesoft should fix your problem.
Since this is not related to react-boilerplate, you may get more help at StackOverflow.


Access control for digitised content

What is it and who's it for?
Collections researchers
Our digitised content is made available to researchers under these four access conditions:

Open
Open with advisory
Restricted
Closed

Each condition comes with a host of design considerations we need to make in order to make this content as accessible as possible while putting the fewest barriers in the way of researchers.
The current Universal Viewer on wellcomelibrary.org handles these conditions as follows:

Open with advisory = Click through Terms and Conditions; sets browser cookie for subsequent visits for a full day
Restricted = triggers a login; uses patron login to connect pre-approved users to the content
Closed = displays a padlock icon on closed images; fully closed digitised items not visible to public

Beginnings of documentation for this feature can be found here https://www.notion.so/wellcometrust/Digitised-content-access-control-Q4-2020-Q1-2021-fa5b296f9507455ab407faeaf5f40a57
TODO

Read through documents; clarify any questions with Collections Information team

User story
As a researcher
I need to know whether there are any access conditions on this material
So that I can use the material responsibly
As a researcher
I want to know why material was given the access restriction it was
So that I can use the material responsibly
Implementation
Acceptance criteria
Testing and tracking

Setting up additional tracking and monitoring - talk to Tacey
Qual and/or Quant test plan - Alice and Tacey

Measurement

Related KPIs (e.g. breadth of collection accessed, reading time, etc.)

Other considerations
<---Delete as appropriate--->

Impact on URL design
Cardigan documentation

Workshop materials output for open with advisory
https://miro.com/app/board/o9J_khSoMc0=/


mat-select and mat-autocomplete options have different font sizes with custom typography

What is the expected behavior?
mat-select and mat-autocomplete options should have the same font size (and consequently same height), when a custom $input value is set via the mat-typography-config() function.
What is the current behavior?
When setting a custom $input value with the mat-typography-config(), mat-select options change their font-size accordingly, but the mat-autocomplete options ignore it, and use 16px instead (default).
What are the steps to reproduce?
https://stackblitz.com/edit/angular-nzfhqa?file=theme-styles.scss
On theme-styles.scss file, try commenting line 4, to use theme default values, or switch the mat-typography-level function first argument to any another value (other than 16px), and observe the changes on the mat-select and mat-autocomplete options font size.
Which versions of Angular, Material, OS, TypeScript, browsers are affected?
Currently testing on Angular 7.2.1 and Material 7.2.1.
Is there anything else we should know?

I am also encountering this issue.
I have spent quite some time looking through docs and google search, but couldn't find anything.
Could you please confirm if this is a bug and if so, any possible workarounds?
@nuno-mrks did you ever figure this out?

@TheBeardedLlama no, I have not. I even forked my example and update the dependencies for Angular Material 8, and this behavior still persists.
I don't think there's much we can do from the outside.

oh that's disappointing!
it's been so long now and two major versions without a fix

any progress ?

This is still an issue

There is no $input value in mat.define-typography-config anymore for the new MDC based components (available in v15). Changes were made to reflect changes to the Material Design spec. This bug should not be applicable anymore.


✨ Update to Kubernetes 1.30.0

Summary
This PR bumps our apimachinery to k8s.io 1.30.0, following our Kubernetes rebase guide. Overall upstream shared informer code didn't change much between 1.28 and 1.30, the only relevant commit I found was https://github.com/kubernetes/kubernetes/commit/d96a9858d396d7f418d24ea47bdc92ef8429f707.
Related issue(s)
Fixes #

/lgtm
/approve


Added code from old repo

nice fixes from WF Nirmal - minus back-door. 😂

tested with new tip2toe version on stage. LGTM.


Pr/v1.10 backport 2022 11 30

Please ensure your pull request adheres to the following guidelines:

[ ] For first time contributors, read Submitting a pull request
[ ] All code is covered by unit and/or runtime tests where feasible.
[ ] All commits contain a well written commit description including a title,
description and a Fixes: #XXX line if the commit addresses a particular
GitHub issue.
[ ] If your commit description contains a Fixes: <commit-id> tag, then
please add the commit author[s] as reviewer[s] to this issue.
[ ] All commits are signed off. See the section Developer’s Certificate of Origin
[ ] Provide a title or release-note blurb suitable for the release notes.
[ ] Thanks for contributing!

Fixes: #issue-number
<!-- Enter the release note text here if needed or remove this section! -->

The Base Image Lint / Lint image build logic (pull_request)  failure is being addressed in https://github.com/cilium/cilium/pull/22458


chore: remove kuttl deletion step

Let's confirm kuttl finishes successfully on this run.

Seems like this change caused more failures.
The cleanup task caused timeout, can we do them in separated steps? i.e., delete the pod first, wait 3s then delete the namespace?

Yes, the cleanups can be done in different tasks, but we still have to delete the policy which is why this was causing failures.


Use repr(packed) If struct requires explicit alignment of 1.

Fixes #1034

r? @fitzgen

Thanks as always, @pepyakin !
@bors-servo r+

:pushpin: Commit 746c743 has been approved by fitzgen

:hourglass: Testing commit 746c743dde3a487a8f0cc82234153092982dc2ff with merge c88ddab275fc52d35f99b0ee355bc4dee46c26e6...

:sunny: Test successful - status-travis
Approved by: fitzgen
Pushing c88ddab275fc52d35f99b0ee355bc4dee46c26e6 to master...


Incompatible with builds > 163

I'm using PhpStorm EAP 2017.1 (build 171.1834.12), is there any way you could make this plugin compatible?
PhpStorm 2017.1 EAP
Build #PS-171.1834.12, built on December 22, 2016
JRE: 1.8.0_112-release-b620 x86_64
JVM: OpenJDK 64-Bit Server VM by JetBrains s.r.o

I've uploaded version 0.5.1 compatible with 2017.1 EAP.

Thank you!