Booted sims can not be resized

We have four options for launch configurations:

FBSimulatorLaunchOptionsConnectBridge
FBSimulatorLaunchOptionsEnableDirectLaunch
FBSimulatorLaunchOptionsShowDebugWindow
FBSimulatorLaunchOptionsUseNSWorkspace

Of these,  FBSimulatorLaunchOptionsConnectBridge, FBSimulatorLaunchOptionsShowDebugWindow, and FBSimulatorLaunchOptionsUseNSWorkspace launch the simulator in a state such that it can not be resized.
I don't know if FBSimulatorLaunchOptionsEnableDirectLaunch works, as I have never been able to get a sim to launch successfully with this option - it appears to be a no-op.
Maybe I'm looking in the wrong place?

When you boot with FBSimulatorLaunchOptionsEnableDirectLaunch it will start simulator but it will not open Simulator application. This way you operate simulator "in the background" which is lighter as system does not have to render it.

@marekcirkos Yes, I figured that. However, when I boot in this way and then do a check of the simulator state on a subsequent run, it is reporting shutdown.
Regardless, it sounds whatever is causing the resizing issue is present in all three other methods? Is this a known issue? I don't see any config options that seem to control the ability to resize.
Launching with different initial scales doesn't seem to help either.

We use simulators in automated way, so there is no need for resizing by hand.
Do you mind saying what is your use case?

I suppose the obvious one is if someone is debugging their test (or debugging the Driver itself during an integration test).

Or suppose someone simply wanted to launch a sim and make a tiny CLI over FBSimulatorControl to launch a sim of their choosing - they'd probably want to be able to resize it as is usual.

We essentially fix the size by passing the value in the arguments as an NSUserDefault. If you need to resize, don't pass a scale value. Since the NSUserDefaults is shared by all Simulator apps it's not possible to initially override with an argument but allow the user to change it at runtime without shimming.

I think this is a wontfix so closing. If there's any other points that you think are important, please let us know.


[OpenROAD-flow-public] Error while building on Ubuntu 18.04

ERROR: ABC contains local modifications! Set ABCREV=default in Yosys Makefile!
Makefile:622: recipe for target 'abc/abc-7a98ef0' failed
make: *** [abc/abc-7a98ef0] Error 1
make: *** Waiting for unfinished jobs....

Try cleaning yosys and rebuilding (using the workaround in #482).

This error doesn't go away.

Try a fresh clone.

Tried but no luck. Rest everything passes except this.

I don't know what else to tell you, this issue is not reproducible for me on CentOS 6/7 or Ubuntu 18.04. The issue is self-explanatory, your ABC directory is not clean. I don't know what's happening to not make it not clean, but that shouldn't happen if you simply do:
git clone https://github.com/The-OpenROAD-Project/OpenROAD-flow OpenROAD-flow
cd OpenROAD-flow
./build_openroad.sh

Using ./build_openroad.sh without --local switch helped.


loop: retry on EBUSY

If a loop device gets stolen in between getting an fd for it and setting
it up let's retry for a bit.
Closes #5246.
Signed-off-by: Christian Brauner<EMAIL_ADDRESS>

jenkins: test this please


voms-admin role

This role will install voms-admin client, the certificates needed and will test the connectivity of the client to a preferred VOMs

Closing since i opened an updated one.


[Design] [Form Recognizer | Table Indexer] Implement indexer on ExtractedTable to index into Cells array

Summary
Tables cells are available in Form Recognizer output in order to use them in application UI, rather than for data analysis.  Given this, providing a table indexer that allows callers to index into a given cell in the table by row, col, is a more idiomatic approach than having an array of cells users must iterate through to find a given cell.
One question that arises is how to handle column span and row span.
We should understand prior approaches in BCL/.NET and design an approach for indexing into table cells consistent with these.
The resulting API will likely look like:
public class ExtractedTable {
    public ExtractedTableCell[] Cells { get; }
    ...

See: https://github.com/Azure/azure-sdk-for-net/blob/ce046949f17fc4ceeab5c87beb4750047b983565/sdk/formrecognizer/Azure.AI.FormRecognizer/src/ExtractedTable.cs#L24
Goals

Identify examples of table indexers elsewhere in BCL/.NET to understand precedents
Design an API for indexing into table cells consistent with other BCL/.NET types
Review design with feature crew and architects
Implement design

@ctstone @mayurid

@annelo-msft could you please update the title?

https://github.com/azure/azure-sdk-for-net/issues/10537 to be done as part of this work.

We will like to get more information about the usage of this feature to help shape the design.
Moving to backlog

Closing this, and will reopen if there is a customer need for this feature.


Feat:UI Updation

Describe the feature
Improving the ui design of 'About Us' page.
Add ScreenShots
Suggested changes:

Color pallette:

Record

[X] I agree to follow this project's Code of Conduct
[X] I'm a GSSOC'24 contributor
[X] I want to work on this issue

That looks Pretty Good man !! I have assigned you this task , As soon as the work is done Raise the PR

Hello sir, I am Chandan. Under GSSOC'24, I would like to work on this issue. can you assign this issue to me!!

Merged !!


[Bug]: TransactionLineItemPreview is missing Proration details

What happened?
When previewing a subscription change that generates immediate proration, the relevant immediateTransaction.details.lineItems do not include proration details such as the rate and billing period.
The docs and usage of the API directly includes a null or object as appropriate, but they are missing entirely from this package.
Steps to reproduce

Create a subscription with recurring items.
Attempt to preview a subscription modification lowering the quantity using paddle.subscriptions.previewUpdate() with the prorationBillingMode set to prorated_immediately

What did you expect to happen?
Proration details for any existing items that result in a credit are included in the immediate transaction line items. Otherwise, the property is null as documented and via the API directly.
Logs
No response

Hi @shadeon, thanks for raising this, we'll look into this and provide an update soon

@shadeon there is a dependency on another project that needs to be updated first and then we'll be able to get this sorted, thanks for your patience


[Asana] Shortcut for creating Asana ticket is not loading

Extension
https://www.raycast.com/raycast/asana
Description

Error:

SyntaxError: Unexpected end of JSON input

F4:CreateTaskForm.tsx:32:33
rS:create-task.js:63:3931
wr:index.js:5:2490
    at ray-navigation-stack

Steps To Reproduce
No response
Current Behaviour
No response
Expected Behaviour
No response

Thanks for reporting this bug. I added it to our backlog 😊
In the meantime, don't hesitate to open a pull request for this if you feel like coding!


[4.1.0][Feature] Allow Counting for select_multiple records

Currently if you want to just display a count of related records in the list view you have to create a custom function, view, etc to do so. This adds a first if statement checking if a value of count is set to true on the column. Also removes the need for attribute on column data.
Example:
$this->crud->addColumn([
   'name' => 'monster_likes',
   'label' => 'Total Monster Likes',
   'type' => 'select_multiple',
   'entity' => 'monsters',
   'model' => "App\Models\Monsters",
   'count' => true,
]);

Essentially it helps replace the probably of having to create a custom model_function just to call the relationship with a count at the end.  2 lines of code saves many and makes it easier for developers in future. Ooh and its non-breaking.

A new inspection was created.

Hi @AbbyJanke ,
I totally agree that's a good idea - a column that counts how many items are related sounds great. I don't know if it's a functionality we should merge with the select_multiple field, though...
We already have an array_count column. How about we create something like a relationship_count column, that does this exclusively? What do you think? What better name would there be for this column? Keep in mind in 4.1 most people will be using the relationship column instead of "select", "select_multiple", "select2", "select2_multiple", "select2_ajax", "select2_multiple_ajax" 😄 That's why my first idea for a name is relationship_count, to sound like it's a good pairing with the relationship field.
The way I see it, there are multiple benefits to having this as a separate column:

more intuitive, this column does just one thing, counts how many related items there are;
more consistent (just like array_count we could give it an optional suffix so that developers choose to write "2 somethings" instead of the general "2 items";
because we know that the "name" will be the name of the relationship, and that's the only thing we need to know, its definition should be super-simple, something like:

[   // relationship_count
    'name' => 'categories', // name of relationship method (in the model)
    'type' => 'relationship_count',

    // optional
    'prefix' => '',
    'suffix' => ' entries',
    'wrapper' => ['class' => 'badge badge-default'],
]

all in all, while thinking about it, I think I've whipped up the entire column code 😆 ; what do you think about this @AbbyJanke ? keep in mind it also has a "wrapper", but that feature is 4.1-only so just remove those 2 lines if you want to use it in 4.0:

@php
   $column['text'] = data_get($entry, $column['name'])->count();
   $column['prefix'] = $column['prefix'] ?? '';
   $column['suffix'] = $column['suffix'] ?? '  items';
   $column['text'] = $column['prefix'].$column['text'].$column['suffix'];
@endphp

<span>
    @includeWhen(!empty($column['wrapper']), 'crud::columns.inc.wrapper_start')
            {{ $column['text'] }}
    @includeWhen(!empty($column['wrapper']), 'crud::columns.inc.wrapper_end')
</span>

Let me know what you think.
Cheers!

Fair enough on the separate type. TBH i never used array_count so didn't even know it was there.  I agree with waiting till 4.1 to put it out there, for now I'm fine with using a custom function.

Awesome. Fixed in https://github.com/Laravel-Backpack/CRUD/pull/2615 - let's move the conversation there please.
Can't wait to launch 4.1 - it has SO MANY cool features.


 makes IE11 prompt to install Java

When byConstructor is called it triggers "Your Java needs update" in Internet Explorer 11 , because getData creates an <applet> element.

This is a problem because this alert makes the browser stop executing whatever it was, and it timeouts the test suite.
https://github.com/ljharb/html-element-map/blob/a9405d1254803a01a6bedf6cd9502653df9db8c9/getData.js#L24

hmm, interesting. I'm not sure how to address that except perhaps explicitly rejecting applet, and failing to match it.

@ljharb this makes sense. I don't think anyone uses the lib to find the constructor for applet element, wdyt?

I think it's probably best to just comment applet out, given the circumstances.


Pipeline downloaded successfully, but Pipelines Not Detected

I've download this LlamaIndex Text to SQL RAG pipeline and it worked well in Functions.
But when I try to Upload LlamaIndex Text to SQL RAG.py file into Pipeline,
it showed "Pipeline downloaded successfully", but still Pipelines Not Detected.

I checked in the pipelines container, it shows as below.
How can I fix this? THX.

How did you resolve this?


Fix/labels

Functionality:
fixed labels
Solution:
worked on the ts and api of team-detail
Risk level:

[ ] high
[x] medium
[ ] low

How to test:
ng serve -o
firebase emulators:start

This can be closed and @simran142002 can work on my branch for changes

Maybe If there are some more good changes we can merge it, at last. else she can continue development here


[WIP] faster python in cudagraphs

Got a bit faster python, graphs with memcpy tasks to much time to launch...
1124  303.19 ms run,   96.72 ms python,  11.78 ms fetch data,  194.70 ms CUDA * 6,  6.06 loss, 0.02 acc, 0.283836 LR, 93.78 GB used,  51043.88 GFLOPS

"graphs with memcpy tasks to much time to launch" how is gpt-fast so fast?

Yeah, I am looking into these high python numbers...

gpt-fast just works on the computer, you can download it and test it. Was getting quite high llama sharded on 4 GPUs tok/s.

merged as #4137


call to decoderbufs__row_message__get_packed_size() in pg_decode_change() crashes

This was seen when I was using a fork of decoderbufs in debezium project, please see the issue. Basically, I start with empty database and run django migrations, then the first insert causes this. Any idea what may be going on?

Only thing I can think of is Protocol Buffers and/or protobuf-c are possibly out of sync. I haven't touched this code in a couple of years, but I was able to upgrade to latest versions, re-generate the src/proto/*.{h,c} code and push through some samples.
I'm not super familiar with Django so I'm not using it here to test. I did try to guess at what I thought their table definition might look like. If you have a specific CREATE TABLE statement or just drop the output of \d accounts_user from psql for the account_users table, I'd be happy to try it out.

@xstevens, thanks for looking into this. The schema is:
➜  sally psql -U naci -h localhost testdb
psql (9.6.2)
Type "help" for help.

testdb=# \d accounts_user
                                           Table "public.accounts_user"
          Column          |           Type           |                         Modifiers
--------------------------+--------------------------+------------------------------------------------------------
 id                       | integer                  | not null default nextval('accounts_user_id_seq'::regclass)
 password                 | character varying(128)   | not null
 last_login               | timestamp with time zone |
 is_superuser             | boolean                  | not null
 stripe_customer_id       | character varying(50)    |
 stripe_subscription_data | text                     |
 uuid                     | uuid                     | not null
 created                  | timestamp with time zone | not null
 modified                 | timestamp with time zone | not null
 email                    | character varying(254)   | not null
 first_name               | character varying(50)    | not null
 last_name                | character varying(50)    | not null
 image                    | character varying(100)   |
 is_staff                 | boolean                  | not null
 is_active                | boolean                  | not null
 date_joined              | timestamp with time zone | not null
 facebook_access_token    | text                     |
 timezone                 | character varying(100)   | not null
 allow_phi_in_emails      | boolean                  | not null
 phone                    | character varying(20)    |
 subscription_status      | character varying(10)    | not null
 last_opened              | timestamp with time zone |
 cancel_at_period_end     | boolean                  | not null
 zip_code                 | character varying(20)    |
 cancel_date              | timestamp with time zone |
 google_api_credentials   | text                     |
 google_auth_flow         | text                     |
Indexes:
    "accounts_user_pkey" PRIMARY KEY, btree (id)
    "accounts_user_email_key" UNIQUE CONSTRAINT, btree (email)
    "accounts_user_created_60aaad7fa460bf0d_uniq" btree (created)
    "accounts_user_ef7c876f" btree (uuid)
    "accounts_user_email_70e5d3371c73dba5_like" btree (email varchar_pattern_ops)
    "accounts_user_f75b7600" btree (stripe_customer_id)
    "accounts_user_stripe_customer_id_432175d47de43b8_like" btree (stripe_customer_id varchar_pattern_ops)
Referenced by:
    TABLE "accounts_appinstall" CONSTRAINT "accounts_appinstal_user_id_2efebd4daac225dd_fk_accounts_user_id" FOREIGN KEY (user_id) REFERENCES accounts_user(id) DEFERRABLE INITIALLY DEFERRED
    TABLE "accounts_physicaldevice_users" CONSTRAINT "accounts_physicald_user_id_3363922469a54657_fk_accounts_user_id" FOREIGN KEY (user_id) REFERENCES accounts_user(id) DEFERRABLE INITIALLY DEFERRED
    TABLE "accounts_user_groups" CONSTRAINT "accounts_user_grou_user_id_5304ac17525e2eca_fk_accounts_user_id" FOREIGN KEY (user_id) REFERENCES accounts_user(id) DEFERRABLE INITIALLY DEFERRED
    TABLE "accounts_user_user_permissions" CONSTRAINT "accounts_user_user_user_id_36acf6a3f4222c20_fk_accounts_user_id" FOREIGN KEY (user_id) REFERENCES accounts_user(id) DEFERRABLE INITIALLY DEFERRED
    TABLE "django_admin_log" CONSTRAINT "django_admin_log_user_id_52fdd58701c5f563_fk_accounts_user_id" FOREIGN KEY (user_id) REFERENCES accounts_user(id) DEFERRABLE INITIALLY DEFERRED
    TABLE "reversion_revision" CONSTRAINT "reversion_revision_user_id_53d027e45b2ec55e_fk_accounts_user_id" FOREIGN KEY (user_id) REFERENCES accounts_user(id) DEFERRABLE INITIALLY DEFERRED

testdb=#

How I get this is: I run python manage.py migrate, which creates all tables, constraints, etc, adding some records. Then I drop a lot of tables for the sake of privacy and simplicity.

BTW, it is actually crashing when it is in protobuf_c.c:protobuf_c_message_get_packed_size(). But not sure what causes it. The strange thing is, after I ran migrations, I do a pg_dumpall, drop the db, restore it from that pg_dumpall, then it doesn't crash, not at first time at least, may be later. I put some printf's to at the entry and exit of that function. See the attached logs from postgres server in debug mode. It looks like when it is evaluating 17th column, which is facebook_access_token, it fails. It is null. The DDL that fails it:
INSERT INTO "accounts_user" ("password", "last_login", "is_superuser", "stripe_customer_id", "stripe_subscription_data",
    "subscription_status", "cancel_at_period_end", "cancel_date", "uuid", "created", "modified", "email", "first_name",
    "last_name", "image", "is_staff", "is_active", "date_joined", "facebook_access_token", "timezone", "phone", "zip_code",
    "allow_phi_in_emails", "last_opened", "google_auth_flow", "google_api_credentials")
VALUES ('', NULL, false, NULL, NULL, 'canceled', false, NULL, '46b82ef3-52c7-4113-8a60-4dbd9f7cbca1'::uuid,
    '2017-04-17T19:43:54.722483+00:00'::timestamptz, '2017-04-17T19:43:54.722501+00:00'::timestamptz<EMAIL_ADDRESS>    'naci', 'ishak', '', false, true, '2017-04-17T19:43:54.708325+00:00'::timestamptz, NULL, 'America/Los_Angeles', NULL,
    NULL, false, NULL, NULL, NULL) RETURNING "id";

Fail log:
DEBUG:  sending replication keepalive
DEBUG:  write 0/4D1BF08 flush 0/0 apply 0/0
DEBUG:  sending replication keepalive
DEBUG:  write 0/4D1BF08 flush 0/0 apply 0/0
DEBUG:  sending replication keepalive
DEBUG:  write 0/4D1BF08 flush 0/0 apply 0/0
DEBUG:  sending replication keepalive
DEBUG:  StartTransaction
DEBUG:  name: unnamed; blockState:       DEFAULT; state: INPROGR, xid/subid/cid: 0/1/0, nestlvl: 1, children:
DEBUG:  Entering decode_change  callback
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  decoding INSERT for table public.accounts_user; relation is selective
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  decoding new tuple information
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing tuple with 31 columns
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 1 with name id
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 2 with name password
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 3 with name last_login
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  column last_login is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 4 with name is_superuser
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 5 with name stripe_customer_id
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  column stripe_customer_id is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 6 with name stripe_subscription_data
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  column stripe_subscription_data is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 7 with name uuid
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 8 with name created
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 9 with name modified
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 10 with name email
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 11 with name first_name
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 12 with name last_name
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 13 with name image
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 14 with name is_staff
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 15 with name is_active
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 16 with name date_joined
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  skipping column 17 because it's a dropped column
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  skipping column 18 because it's a dropped column
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 19 with name facebook_access_token
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  column facebook_access_token is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 20 with name timezone
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  skipping column 21 because it's a dropped column
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 22 with name allow_phi_in_emails
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  skipping column 23 because it's a dropped column
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 24 with name phone
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  column phone is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 25 with name subscription_status
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 26 with name last_opened
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  column last_opened is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 27 with name cancel_at_period_end
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 28 with name zip_code
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  column zip_code is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 29 with name cancel_date
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  column cancel_date is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 30 with name google_api_credentials
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  column google_api_credentials is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  processing column 31 with name google_auth_flow
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  column google_auth_flow is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  NACI: processed tuple done.
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  NACIPG: Entering OutputPluginPrepareWrite
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  NACIPG: leaving OutputPluginPrepareWrite
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  NACI: OutputPluginPrepareWrite done.
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
DEBUG:  NACI: calling decoderbufs__row_message__get_packed_size.
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/4D1C058
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: entering repeated_field_get_packed_size
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 8
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 15
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 15
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 18
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 23
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 28
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 47
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 21
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 22
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 27
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 21
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 21
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 12
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 14
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 15
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 25
PROTOBUF_C: entering protobuf_c_message_get_packed_size
DEBUG:  server process (PID 17131) was terminated by signal 11: Segmentation fault
LOG:  server process (PID 17131) was terminated by signal 11: Segmentation fault
LOG:  terminating any other active server processes
DEBUG:  sending SIGQUIT to process 17813
DEBUG:  sending SIGQUIT to process 16418
DEBUG:  sending SIGQUIT to process 16417
DEBUG:  sending SIGQUIT to process 16419
DEBUG:  sending SIGQUIT to process 16420
WARNING:  terminating connection because of crash of another server process
DETAIL:  The postmaster has commanded this server process to roll back the current transaction and exit, because another server process exited abnormally and possibly corrupted shared memory.
HINT:  In a moment you should be able to reconnect to the database and repeat your command.
WARNING:  terminating connection because of crash of another server process
DETAIL:  The postmaster has commanded this server process to roll back the current transaction and exit, because another server process exited abnormally and possibly corrupted shared memory.
HINT:  In a moment you should be able to reconnect to the database and repeat your command.
DEBUG:  shmem_exit(-1): 0 before_shmem_exit callbacks to make
DEBUG:  sending SIGQUIT to process 16421
DEBUG:  shmem_exit(-1): 0 before_shmem_exit callbacks to make
DEBUG:  shmem_exit(-1): 0 on_shmem_exit callbacks to make
DEBUG:  proc_exit(-1): 0 callbacks to make
DEBUG:  shmem_exit(-1): 0 before_shmem_exit callbacks to make
DEBUG:  shmem_exit(-1): 0 before_shmem_exit callbacks to make
DEBUG:  shmem_exit(-1): 0 on_shmem_exit callbacks to make
DEBUG:  proc_exit(-1): 0 callbacks to make
DEBUG:  writing stats file "pg_stat/global.stat"
DEBUG:  shmem_exit(-1): 0 before_shmem_exit callbacks to make
DEBUG:  shmem_exit(-1): 0 on_shmem_exit callbacks to make
DEBUG:  proc_exit(-1): 0 callbacks to make
DEBUG:  shmem_exit(-1): 0 on_shmem_exit callbacks to make
DEBUG:  proc_exit(-1): 0 callbacks to make
DEBUG:  writing stats file "pg_stat/db_29341.stat"
DEBUG:  shmem_exit(-1): 0 on_shmem_exit callbacks to make
DEBUG:  proc_exit(-1): 0 callbacks to make
DEBUG:  server process (PID 17813) exited with exit code 2
DETAIL:  Failed process was running: INSERT INTO "accounts_user" ("password", "last_login", "is_superuser", "stripe_customer_id", "stripe_subscription_data", "subscription_status", "cancel_at_period_end", "cancel_date", "uuid", "created", "modified", "email", "first_name", "last_name", "image", "is_staff", "is_active", "date_joined", "facebook_access_token", "timezone", "phone", "zip_code", "allow_phi_in_emails", "last_opened", "google_auth_flow", "google_api_credentials") VALUES ('', NULL, false, NULL, NULL, 'canceled', false, NULL, '46b82ef3-52c7-4113-8a60-4dbd9f7cbca1'::uuid, '2017-04-17T19:43:54.722483+00:00'::timestamptz, '2017-04-17T19:43:54.722501+00:00'::timestamptz<EMAIL_ADDRESS>'naci', 'ishak', '', false, true, '2017-04-17T19:43:54.708325+00:00'::timestamptz, NULL, 'America/Los_Angeles', NULL, NULL, false, NULL, NULL, NULL) RETURNING "id";
DEBUG:  removing temporary stats file "pg_stat_tmp/db_29341.stat"
DEBUG:  writing stats file "pg_stat/db_0.stat"
DEBUG:  removing temporary stats file "pg_stat_tmp/db_0.stat"
DEBUG:  shmem_exit(-1): 0 before_shmem_exit callbacks to make
DEBUG:  shmem_exit(-1): 0 on_shmem_exit callbacks to make
DEBUG:  proc_exit(-1): 0 callbacks to make
LOG:  all server processes terminated; reinitializing
DEBUG:  shmem_exit(1): 0 before_shmem_exit callbacks to make
DEBUG:  shmem_exit(1): 5 on_shmem_exit callbacks to make
DEBUG:  cleaning up dynamic shared memory control segment with ID<PHONE_NUMBER>
DEBUG:  invoking IpcMemoryCreate(size=148455424)
DEBUG:  SlruScanDirectory invoking callback on pg_notify/0000
DEBUG:  removing file "pg_notify/0000"
DEBUG:  dynamic shared memory system will support 288 segments
DEBUG:  created dynamic shared memory control segment 569292035 (2316 bytes)
LOG:  database system was interrupted; last known up at 2017-05-03 17:23:23 PDT
DEBUG:  checkpoint record is at 0/4D1BE60
DEBUG:  redo record is at 0/4D1BE60; shutdown TRUE
DEBUG:  next transaction ID: 0:6304; next OID: 34216
DEBUG:  next MultiXactId: 1; next MultiXactOffset: 0
DEBUG:  oldest unfrozen transaction ID: 858, in database 1
DEBUG:  oldest MultiXactId: 1, in database 1
DEBUG:  commit timestamp Xid oldest/newest: 0/0
DEBUG:  transaction ID wrap limit is<PHONE_NUMBER>, limited by database with OID 1
DEBUG:  MultiXactId wrap limit is<PHONE_NUMBER>, limited by database with OID 1
DEBUG:  starting up replication slots
DEBUG:  restoring replication slot from "pg_replslot/debezium/state"
DEBUG:  starting up replication origin progress state
LOG:  database system was not properly shut down; automatic recovery in progress
DEBUG:  resetting unlogged relations: cleanup 1 init 0
LOG:  redo starts at 0/4D1BED0
LOG:  invalid record length at 0/4D1CA78: wanted 24, got 0
LOG:  redo done at 0/4D1CA48
LOG:  last completed transaction was at log time 2017-05-03 17:26:55.125833-07
DEBUG:  resetting unlogged relations: cleanup 0 init 1
DEBUG:  performing replication slot checkpoint
DEBUG:  attempting to remove WAL segments older than log file<PHONE_NUMBER>00000000000003
DEBUG:  MultiXactId wrap limit is<PHONE_NUMBER>, limited by database with OID 1
LOG:  MultiXact member wraparound protections are now enabled
DEBUG:  MultiXact member stop limit is now<PHONE_NUMBER> based on MultiXact 1
DEBUG:  shmem_exit(0): 1 before_shmem_exit callbacks to make
DEBUG:  shmem_exit(0): 3 on_shmem_exit callbacks to make
DEBUG:  proc_exit(0): 2 callbacks to make
DEBUG:  exit(0)
DEBUG:  shmem_exit(-1): 0 before_shmem_exit callbacks to make
DEBUG:  shmem_exit(-1): 0 on_shmem_exit callbacks to make
DEBUG:  proc_exit(-1): 0 callbacks to make
LOG:  database system is ready to accept connections
DEBUG:  checkpointer updated shared memory configuration values
LOG:  autovacuum launcher started
DEBUG:  InitPostgres
DEBUG:  StartTransaction
DEBUG:  name: unnamed; blockState:

Success case log:
DEBUG:  sending replication keepalive
DEBUG:  write 0/5BDB1B8 flush 0/0 apply 0/0
DEBUG:  sending replication keepalive
DEBUG:  write 0/5BDB1B8 flush 0/0 apply 0/0
DEBUG:  sending replication keepalive
DEBUG:  write 0/5BDB1B8 flush 0/0 apply 0/0
DEBUG:  sending replication keepalive
DEBUG:  StartTransactionCommand
DEBUG:  StartTransaction
DEBUG:  name: unnamed; blockState:       DEFAULT; state: INPROGR, xid/subid/cid: 0/1/0, nestlvl: 1, children:
DEBUG:  ProcessQuery
DEBUG:  snapshot of 1+0 running transaction ids (lsn 0/5BDB420 oldest xid 10149 latest complete 10148 next xid 10150)
DEBUG:  CommitTransactionCommand
DEBUG:  CommitTransaction
DEBUG:  name: unnamed; blockState:       STARTED; state: INPROGR, xid/subid/cid: 10149/1/0 (used), nestlvl: 1, children:
DEBUG:  serializing snapshot to pg_logical/snapshots/0-5BDB3E8.snap
DEBUG:  purged committed transactions from 0 to 0, xmin: 10149, xmax: 10147
DEBUG:  xmin: 10149, xmax: 10147, oldestrunning: 10149
DEBUG:  failed to increase restart lsn: proposed 0/5BDB1E8, after 0/5BDB3E8, current candidate 0/5BDB180, current after 0/5BDB180, flushed up to 0/5BDAE18
DEBUG:  StartTransaction
DEBUG:  name: unnamed; blockState:       DEFAULT; state: INPROGR, xid/subid/cid: 0/1/0, nestlvl: 1, children:
DEBUG:  Entering decode_change  callback
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  decoding INSERT for table public.accounts_user; relation is selective
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  decoding new tuple information
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing tuple with 27 columns
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 1 with name id
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 2 with name password
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 3 with name last_login
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  column last_login is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 4 with name is_superuser
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 5 with name stripe_customer_id
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  column stripe_customer_id is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 6 with name stripe_subscription_data
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  column stripe_subscription_data is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 7 with name uuid
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 8 with name created
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 9 with name modified
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 10 with name email
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 11 with name first_name
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 12 with name last_name
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 13 with name image
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 14 with name is_staff
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 15 with name is_active
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 16 with name date_joined
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 17 with name facebook_access_token
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  column facebook_access_token is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 18 with name timezone
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 19 with name allow_phi_in_emails
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 20 with name phone
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  column phone is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 21 with name subscription_status
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 22 with name last_opened
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  column last_opened is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 23 with name cancel_at_period_end
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 24 with name zip_code
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  column zip_code is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 25 with name cancel_date
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  column cancel_date is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 26 with name google_api_credentials
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  column google_api_credentials is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  processing column 27 with name google_auth_flow
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  column google_auth_flow is null, ignoring value
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  NACI: processed tuple done.
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  NACIPG: Entering OutputPluginPrepareWrite
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  NACIPG: leaving OutputPluginPrepareWrite
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  NACI: OutputPluginPrepareWrite done.
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  NACI: calling decoderbufs__row_message__get_packed_size.
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: entering repeated_field_get_packed_size
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 8
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 15
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 15
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 18
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 23
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 28
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 47
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 21
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 22
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 27
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 21
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 21
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 12
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 14
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 15
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 25
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 25
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 34
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 25
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 10
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 34
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 16
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 26
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 13
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 16
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 26
PROTOBUF_C: entering protobuf_c_message_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 20
PROTOBUF_C: leaving repeated_field_get_packed_size header_size=27, rv=604
PROTOBUF_C: entering repeated_field_get_packed_size
PROTOBUF_C: exiting protobuf_c_message_get_packed_size with rv= 667
DEBUG:  NACI: calling palloc.
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  NACI: calling decoderbufs__row_message__pack.
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  NACI: calling appendBinaryStringInfo.
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  NACI: calling pfree.
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  NACI: calling OutputPluginWrite
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  NACI: calling row_message_destroy
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  NACI: exiting decode_change
CONTEXT:  slot "debezium", output plugin "decoderbufs", in the change callback, associated LSN 0/5BDB2F0
DEBUG:  write 0/5BDB1B8 flush 0/0 apply 0/0
DEBUG:  sending replication keepalive
DEBUG:  write 0/5BDB58B flush 0/0 apply 0/0
DEBUG:  sending replication keepalive
DEBUG:  write 0/5BDB58B flush 0/0 apply 0/0
DEBUG:  sending replication keepalive

Since pg_dumpall doesn't re-produce the problem, if you can, you can try untar'ing the whole data tree in where the data files are located.

I did this locally on a fresh Postgres 9.6 and it doesn't crash.
CREATE SEQUENCE accounts_user_id_seq;

CREATE TABLE accounts_user (
    id integer not null default nextval('accounts_user_id_seq'::regclass),
    password character varying(128) not null,
    last_login timestamp with time zone,
    is_superuser boolean not null,
    stripe_customer_id character varying(50),
    stripe_subscription_data text,
    uuid uuid not null,
    created timestamp with time zone not null,
    modified timestamp with time zone not null,
    email character varying(254) not null,
    first_name character varying(50) not null,
    last_name character varying(50) not null,
    image character varying(100),
    is_staff boolean not null,
    is_active boolean not null,
    date_joined timestamp with time zone not null,
    facebook_access_token text,
    timezone character varying(100) not null,
    allow_phi_in_emails boolean not null,
    phone character varying(20),
    subscription_status character varying(10) not null,
    last_opened timestamp with time zone,
    cancel_at_period_end boolean not null,
    zip_code character varying(20),
    cancel_date timestamp with time zone,
    google_api_credentials text,
    google_auth_flow text
);

Then your INSERT statement from above:
INSERT INTO "accounts_user" ("password", "last_login", "is_superuser", "stripe_customer_id", "stripe_subscription_data",
    "subscription_status", "cancel_at_period_end", "cancel_date", "uuid", "created", "modified", "email", "first_name",
    "last_name", "image", "is_staff", "is_active", "date_joined", "facebook_access_token", "timezone", "phone", "zip_code",
    "allow_phi_in_emails", "last_opened", "google_auth_flow", "google_api_credentials")
VALUES ('', NULL, false, NULL, NULL, 'canceled', false, NULL, '46b82ef3-52c7-4113-8a60-4dbd9f7cbca1'::uuid,
    '2017-04-17T19:43:54.722483+00:00'::timestamptz, '2017-04-17T19:43:54.722501+00:00'::timestamptz<EMAIL_ADDRESS>    'naci', 'ishak', '', false, true, '2017-04-17T19:43:54.708325+00:00'::timestamptz, NULL, 'America/Los_Angeles', NULL,
    NULL, false, NULL, NULL, NULL) RETURNING "id";

I am running my version of the plugin and not the Debezium version on macOS 10.12.4. I still suspect its some sort of mismatch between Protocol Buffers, protobuf-c and possibly the version compiled when the Debezium plugin was made. I would update to the latest and re-compile all three of those if you haven't tried that already.
Best of luck!

@xstevens, I have the fix. Could you give permission for pull request? It is not allowing me to push the local branch to origin. Thanks.

@nacivida Try creating a fork first and then you should be able to PR here from your fork.

@xstevens @nacivida: Great team work. Is this issue resolved?

@xstevens, yes, it was merged to debezium fork.

Hi @xstevens @nacivida I've filed a bug report to the debezium branch of this repo for an error in the same function but in a different context.
You can see it here: https://issues.jboss.org/browse/DBZ-790
It also causes the DB to crash and I'm not able to controllably reproduce it, yet. It happens in a live environment that has turned out to be hard to replicate.
The error from the logs is:
protobuf-c/protobuf-c.c:643: protobuf_c_message_get_packed_size: Assertion `((message)->descriptor)->magic == 0x28aaeef9' failed.
Would you guys be able to take a look at the description in the link and give any advice on what might be going on?
Thanks in advance.

I haven't been working on this since then, but I couldn't understand what's
wrong in your case.
Naci
On Thu, Aug 2, 2018 at 6:56 AM jsyvanen<EMAIL_ADDRESS>wrote:

Hi @xstevens https://github.com/xstevens @nacivida
https://github.com/nacivida I've filed a bug report to the debezium
branch of this repo for an error in the same function but in a different
context.
You can see it here: https://issues.jboss.org/browse/DBZ-790
It also causes the DB to crash and I'm not able to controllably reproduce
it, yet. It happens in a live environment that has turned out to be hard to
replicate.
The error from the logs is:
protobuf-c/protobuf-c.c:643: protobuf_c_message_get_packed_size: Assertion
`((message)->descriptor)->magic == 0x28aaeef9' failed.
Would you guys be able to take a look at the description in the link and
give any advice on what might be going on?
Thanks in advance.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/xstevens/decoderbufs/issues/6#issuecomment-409934979,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AS_eqW1fU1t7DJvuSmGg0J9dOBeDzbveks5uMwUggaJpZM4NPuy6
.

Thanks @nacivida


typo fix

Noticed and corrected 2 little typos.

please fix to merge against developer branch. Also this has a merge conflict


Validate incorrect chars in user assigned form

We need to set only valid github usernames in this form:

I'll take it, if it's ok :)

@charlie-wasp sorry, but @Wayzyk works on it 👍


Model Inference | Predictions only

Hi all,
In Short: Is there a native way to perform the inference (prediction) only?
Explanation: After pre-training my semantic segmentation model, I finally want to use it in a small application.
I am not interested in the calculation of the metrics (mIoU, mAcc, etc.), but just ignoring the metric is not an option since I have no annotations for the new data.
I guess this should be the basic inference use case of these models when they are used in production.
However, I could not find an easy way from your codebase to just run the pipeline and spit out the predictions without further evaluation.
All I could find are the scripts for train.py and test.py. The second one has already baked the evaluation directly into the SemSegTester. So I can't switch it off via configs or hooks.
But maybe I'm just stupid... 🤣🤣
Cheers, Lukas

Hey, check this test code for reference!
import os
import numpy as np
import torch
import torch.nn.functional as F
from collections import OrderedDict
from pointcept.datasets import build_dataset
from pointcept.models import build_model
from pointcept.datasets.transform import Compose
from pointcept.utils.config import Config
from pointcept.utils.visualization import save_point_cloud
from pointcept.utils.comm import get_world_size
from pointcept.datasets.utils import point_collate_fn

from tensorboardX import SummaryWriter

data_config = dict(
    type="ScanNetDataset",
    split="train",
    data_root="data/scannet",
    transform=[
        dict(type="CenterShift", apply_z=True),
        dict(
            type="GridSample",
            grid_size=0.02,
            hash_type="fnv",
            mode="train",
            return_grid_coord=True,
        ),
        dict(type="CenterShift", apply_z=False),
        dict(type="NormalizeColor"),
        dict(type="ToTensor"),
        dict(
            type="Collect",
            keys=("coord", "grid_coord", "segment", "name"),
            feat_keys=("color", "normal"),
        ),
    ],
    test_mode=False,
)

model_config = dict(
    type="PT-v3m1",
    in_channels=6,
    order=("z", "z-trans", "hilbert", "hilbert-trans"),
    stride=(2, 2, 2, 2),
    enc_depths=(2, 2, 2, 6, 2),
    enc_channels=(32, 64, 128, 256, 512),
    enc_num_head=(2, 4, 8, 16, 32),
    enc_patch_size=(1024, 1024, 1024, 1024, 1024),
    dec_depths=(2, 2, 2, 2),
    dec_channels=(64, 64, 128, 256),
    dec_num_head=(4, 4, 8, 16),
    dec_patch_size=(1024, 1024, 1024, 1024),
    mlp_ratio=4,
    qkv_bias=True,
    qk_scale=None,
    attn_drop=0.0,
    proj_drop=0.0,
    drop_path=0.3,
    shuffle_orders=True,
    pre_norm=True,
    enable_rpe=False,
    enable_flash=True,
    upcast_attention=False,
    upcast_softmax=False,
    cls_mode=False,
    pdnorm_bn=False,
    pdnorm_ln=False,
    pdnorm_decouple=True,
    pdnorm_adaptive=False,
    pdnorm_affine=True,
    pdnorm_conditions=("ScanNet", "S3DIS", "Structured3D"),
)

checkpoint = "exp/scannet/semseg-pt-v3m1-0-base/model/model_last.pth"
keywords = "backbone."
replacement = ""
idx = 300

if __name__ == "__main__":
    model = build_model(model_config).cuda()
    checkpoint = torch.load(
        checkpoint, map_location=lambda storage, loc: storage.cuda()
    )
    weight = OrderedDict()
    for key, value in checkpoint["state_dict"].items():
        if not key.startswith("module."):
            key = "module." + key  # xxx.xxx -> module.xxx.xxx
        if keywords in key:
            key = key.replace(keywords, replacement)
        if get_world_size() == 1:
            key = key[7:]  # module.xxx.xxx -> xxx.xxx
        weight[key] = value
    load_state_info = model.load_state_dict(weight, strict=False)
    print(load_state_info)
    dataset = build_dataset(data_config)
    data = dataset[idx]
    for key in data.keys():
        if isinstance(data[key], torch.Tensor):
            data[key] = data[key].cuda(non_blocking=True)
    output = model(data)
    feat = output.feat
    feat = feat - feat.mean(dim=-2, keepdim=True)
    u, s, v = torch.pca_lowrank(feat, center=False, q=3)
    projection = feat @ v
    min_val = projection.min(dim=0, keepdim=True)[0]
    max_val = projection.max(dim=0, keepdim=True)[0]
    div = torch.clamp(max_val - min_val, min=1e-6)
    pca_color = (projection - min_val) / div
    os.makedirs("test/vis_pca", exist_ok=True)
    save_point_cloud(
        coord=output.coord,
        color=pca_color,
        file_path=f"test/vis_pca/pca_color{idx}.ply",
    )
    vertices = output.coord.unsqueeze(0).clone().detach().cpu().numpy() / 3
    colors = pca_color.unsqueeze(0).clone().detach().cpu().numpy() * 255

    writer = SummaryWriter("test/vis_pca")
    writer.add_mesh(
        f"train/{data['name']}",
        vertices=vertices,
        colors=colors,
        global_step=1,
    )

Thank You @Gofinge.
I think I can work with that 👍
To my understanding, what was the actual purpose of the code snipped you posted? I see that you replace the backbone with empty values (which will randomly reinitiate the weights?)
Also, this script evaluates the features, not the final class predictions, to visualize these. Is that correct?

Yes, this is for visualization of point cloud embedding. You can modified it we some actually inference propose.

how do i get normal features for a custom point cloud? removing it from data_config/transform/collect/feat_keys doesnt make sense coz weigths wont match then

the above script requires your dataset to already have normal features as input for the model.
If this is not the case, you can try to estimate the normals in advance. The dataset folder must then contain a normals.npy file for each sample in addition to the coord.npy and colour.npy files.
In my case, the data came from a lidar scanner, which outputs no normals. Therefore I retrained the model from scratch without the normal feat_key.

Yeah, you can check my preprocessing code for how to process normal from various dataset. What’s the format of your raw data?

My point clouds are .ply files

Hi, sorry for the late response, I just recovered from the busy schedule for the CVPR project. PlY can be mesh or point cloud, and some ply already contains normal and some are not. You can try to take a close look at the ply file to understand the format of the data. You can refer to the preprocessed code for ScanNet to see how to load a ply file


Added maintenance_device method to devices.py

Added maintenance_device method to correspond with this API call:
https://docs.librenms.org/API/Devices/#maintenance_device
Tested and functions as expected.
Kept duration as a string to keep the "H:m" formatting consistent. Initially thought about making duration an integer in minutes, then did math to convert, but keeping string seems to be the best approach here since the API appears to be looking for a string.

Tested on my end; works as expected like you said and I agree sticking to their documentation is best.
Thanks for adding!


Second Net? Point Pillar Net?

is this code's first setting Second Network or Point Pillar Network?
If it is not Point Pillar Network, how can i change for that? and what is the difference?

LiDAR-based or RGB-D-based object detection is used in numerous applications, ranging from autonomous driving to robot vision. Voxel-based 3D convolutional networks have been used for some time to enhance the retention of information when processing point cloud LiDAR data. However, problems remain, including a slow inference speed and low orientation estimation performance. We therefore investigate an improved sparse convolution method for such networks, which significantly increases the speed of both training and inference. We also introduce a new form of angle loss regression to improve the orientation estimation performance and a new data augmentation approach that can enhance the convergence speed and performance. The proposed network produces state-of-the-art results on the KITTI 3D object detection benchmarks while maintaining a fast inference speed. View Full-Text
this is abstract of paper about second:sparsely convolution detection.
I think second is not a name of network, second is a name of method for reducing the operating time when use voxelnet.

Thank you so much for your kind response. 감사합니다.
I understand it is like a method for Detection. but i want to know whether it is different or not with pointpillars Net code below.
https://github.com/nutonomy/second.pytorch
Could you let me know the difference?

If what I know is right, pointpillars is not a network, is a method
if you use config file in second.pytorch/second/config/pointpillars/ you can also pointpillars method with second method.
before you train, you must install spconv, is right?
spconv`s full name is sparsely convolution
spconv make you can use sparsely convolution(second method)
and when you use config file in folder of pointpillar, you can also use pointpillars method with second method
The coment is what I understood while studying, and there may be a misunderstanding.

and I want advice about evaluation,
In previous issue I think I saw that you complete test with costom dataset at first glance.
I struggle to evaluate second.pytorch with custom dataset.
I want that second.pytorch evaluate with custom dataset, and I want to also visualize this evaluation.
do you complete this process?
can you give some advice for me

my e-mail address is<EMAIL_ADDRESS>If you have advice, please give me mail about advice.
And I hope  that ,if you can use korean, advice mail consist of korean

Thank you so much.
So, in order to use pointpillars method, you said that we should use configs in pointpillars folder. And it means Car.fhd.config and All.fhd.config is not for Pointpillar method. isn't it?
Additionally for custom dataset, Let me e-mail to you :D

Thank you so much.
So, in order to use pointpillars method, you said that we should use configs in pointpillars folder. And it means Car.fhd.config and All.fhd.config is not for Pointpillar method. isn't it?

Yes


Livekit Server Crushed while idle.

Server crashes while at idle and gettin error while on room connection.
Server

Version: [0.14.0]
Environment: [DO - Ubuntu 20.04 (
LTS) x64 2 vCPUs 2GB / 60GB Disk]
For TLS connection, proxy pass over domain plesk and send cloudflare. Cloudflare redirects to port 7880/7881 without tls

Client

SDK: ["livekit-server-sdk": "0.5.6"]
SDK: livekit-client": "0.14.1"

For error:

two clients are connected to room
a client disconnected
received error
  ERROR   livekit logger/logger.go:34     missing stats worker    {"participantID": "PA_jrCScwEBKLc9"} github.com/livekit/protocol/logger.Errorw      /root/go/pkg/mod/github.com/livekit/protocol@v0.10.1-0.20211109000312-b3847c8d35ff/logger/logger.go:34 github.com/livekit/livekit-server/pkg/telemetry.(TelemetryService).TrackUnpublished      /root/livekit-server/pkg/telemetry/events.go:89 github.com/livekit/livekit-server/pkg/rtc.(MediaTrack).AddReceiver.func4      /root/livekit-server/pkg/rtc/mediatrack.go:370 github.com/livekit/livekit-server/pkg/sfu.(WebRTCReceiver).closeTracks      /root/livekit-server/pkg/sfu/receiver.go:665 github.com/livekit/livekit-server/pkg/sfu.(WebRTCReceiver).forwardRTP.func1.1      /root/livekit-server/pkg/sfu/receiver.go:546 sync.(Once).doSlow      /usr/local/go/src/sync/once.go:68 sync.(Once).Do      /usr/local/go/src/sync/once.go:59 github.com/livekit/livekit-server/pkg/sfu.(WebRTCReceiver).forwardRTP.func1      /root/livekit-server/pkg/sfu/receiver.go:544 github.com/livekit/livekit-server/pkg/sfu.(WebRTCReceiver).forwardRTP      /root/livekit-server/pkg/sfu/receiver.go:562 [2:54 PM] udp_mux ERROR: 2021/11/15 11:54:33 could not read udp packet: read udp4 <IP_ADDRESS>:7882: use of closed network connection

Does the error actually cause participants to disconnect?
Can you see if it reproduces on 0.14.2?

No, when a client leave the room, we get this error also server crushed when idle, like there is no connection for 1 or 2 hour and after we can't connect to server anymore needed to restart.

also server crushed when idle, like there is no connection for 1 or 2 hour and after we can't connect to server anymore needed to restart. it sounds that's the actual problem.. we haven't seen this behavior before nor have gotten other reports. I wonder if it's related to your computer/network.

closing given the issue is stale/unreproducible


How can I use graphql-flutter with  MultiProvider

Widget build(BuildContext context) {
    return MultiProvider(
      providers: [
        ChangeNotifierProvider<AuthState>.value(
          notifier: AuthState(),
        ),
        // GraphQLProvider(child: _client,),              //<-- error
        ChangeNotifierProvider<GraphQLClient>.value(      //<-- error
          notifier: _client,
        ),
        // ValueNotiferProvider.val
      ],
      child: MaterialApp(
           ....
      ),
    );
  }
}

How can I do this above?  Just want to make auth server & graphQL service together.
I was plan to separate multi service(assume include Auth, graphQL, store and so on ) use MultiProvider, so I'd like use GraphQLProvider like this too, but it gives error.  Any suggestion for separation like these?

@hofmannZ you did it for our apps, can you share with him how you did the multi provider?

GraphQLProvider is just a widget, which wraps around an inherited widget. This inherited widget is the one that pump down the client to all descendants, so that when you use the Query widget, it can access the client from the GraphQLProvider.
One solution i can think of is to pass the client itself:
MultiProvider(
  providers: [
    Provider<ValueNotifier<GraphQLClient>>.value(value: client),
  ],
  child: someWidget,
)

And the either use the dart client or create GraphQLProvider Widget at the appropriate location in the widget tree with getting the client from Provider. You can also use the GraphQLProvider widget as the direct child of MultiProvider.
On  a package level, may be we can have something like QueryWithProvider widget, that reads the client value from provider instead of the inherited widget, but other behaves the same. I this can be done without breaking anything.

yes, I use GraphQLProvider as child of MultiProvider for now,  Thank you @mainawycliffe

Can you guys give a more detailed example on how to use it with MultiProvider? Thanks!

@franzejr currently, this library doesn't support MultiProvider from provider directly, this is a future we might provide it in the future. For now, the easiest way I can think of is using GraphQLProvider as a child of MultiProvider. Something like:
MultiProvider(
  providers: [
    Provider<Foo>.value(value: foo),
    Provider<Bar>.value(value: bar),
    Provider<Baz>.value(value: baz),
  ],
  child: GraphQLProvider(...),
)


Etf 2.1 debug index

Included the debugging section in the index and modified an image of the same section
Changes in the PR:

Inclusion of the debugging section in the index to have an access to it
Modified an image in the debugging section to be easier to understand and follow the instructions

@jonherrmann we realised that the new section was not visible in the GitHub Pages, this PR fixes it.


Date Parser does not read days anymore (CalendrViMo)

Ignores "6. Efferd 1045 BF".
6. Rondra 1045 BF
6. Ro 1045 BF

It's the reckoning "BF" the prevents it. Remove it and everything works just fine.

(?<reck>[vVbB][\.\s]?\s*[bfBF]{2})$ seems to work well:

The regex seems to work. But the calendar in the UI does not interpret the format reliably.


Support http/https proxy

https://github.com/Long-live-shadowsocks/shadowsocks/wiki/Convert-Shadowsocks-into-an-HTTP-proxy


Stats/partner stats on a new partner page

this PR is build under the requirements under business team, they want our five partner transactions numbers:

use query to find the account that with company name -- backend
use query to get total transactions count and first 3 month transactions count for list of partners -- backend
generate /partner page for stats display -- frontend

@frol
Please check the query for each part since it is important to make sure it is correct and then let's discuss with Sasha whether it is okay or not.

@frol
Please check the query for each part since it is important to make sure it is correct and then let's discuss with Sasha whether it is okay or not.


Made all network connections proxy-compatible

This fixes #243.

Why is the refactoring of the installer version check shipped in the same PR (without being described in the PR) ?

@stof I agree that's a bad practice and I'm sorry about it.

@javiereguiluz note that this hidden change is even the one preventing to merge this PR, as it is the buggy part...


[Bugfix] Fix issues in CPU build Dockerfile. Fixes #9182

Fixes #9182. This fixes the following two issues. Verified that build is successful after these changes.
Issue 1:
ERROR: Could not open requirements file: [Errno 13] Permission denied: 'requirements-build.txt'

Issue 2:
LookupError: setuptools-scm was unable to detect version for /workspace/vllm

Related issues https://github.com/vllm-project/vllm/issues/9182 and https://github.com/vllm-project/vllm/issues/8502

cc @dtrifiro

@dtrifiro is on vacation

I see, thanks for the heads up!

Can you add a TODO that links to https://github.com/vllm-project/vllm/issues/9182#issuecomment-2404860236 so we might come up with a better solution in the future?

Also, maybe we can mark this PR as fixing #9182?

Updated. Thanks!

Looks like build failure may not be related since ppc64le is failing but I didn't modify Dockerfile.ppc64le.

Can you merge from main? It should fix the CI failures.

Looks like it's still failing.

Retrying the test...

Thanks!


undefined for class property

TypeScript Version:  2.4.1
Code
  public async loginUser(mobile: string, password: string): Promise<number> {
    debugger
    logger.info("Preparing to login user");
    let user: User = await this.getUser({ mobile: mobile });
    if (!user) {
        throw new BizError(ErrorInfo.USER_NOT_EXIST);
    }
    let pwdResult = user.password;
    if (!pwdResult) {
        throw new Error("fail");
    }
    logger.info("Successfully login user");
    return user.id;
}

I write class User，and want to get user data from database， actually，i get real user data from database，but ，I want to give user.password property data to pwdResult, however, this is undefined  for user.password. How it happend?

Can you share a self-contained demo? There is no enough information to understand what's going on.

This is my error， I in db sequelize exclude password，so it can’t get password value


Leaderboard tweaks

Improving the general layout of the leaderboards page for mobile users (resolves #54)

Perhaps add the leaderboards cover art to table items on the /leaderboards page?

@Umbranoxio

Made some adjustments, looks good to me

Hold on, gonna try some stuff with css real quick so we get longer names on desktop


[RIP-10]Add test case for QueryMsgByIdSubCommand

What is the purpose of the change
Add test case for QueryMsgByIdSubCommand
Brief changelog
Add test for StatsAllSubCommand
Verifying this change
Run this testcase
Follow this checklist to help us incorporate your contribution quickly and easily. Notice, it would be helpful if you could finish the following 5 checklist(the last one is not necessary)before request the community to review your PR.

[x] Make sure there is a Github issue filed for the change (usually before you start working on it). Trivial changes like typos do not require a Github issue. Your pull request should address just this issue, without pulling in other changes - one PR resolves one issue.
[x] Format the pull request title like [ISSUE #123] Fix UnknownException when host config not exist. Each commit in the pull request should have a meaningful subject line and body.
[x] Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
[x] Write necessary unit-test(over 80% coverage) to verify your logic correction, more mock a little better when cross module dependency exist. If the new feature or significant change is committed, please remember to add integration-test in test module.
[x] Run mvn -B clean apache-rat:check findbugs:findbugs checkstyle:checkstyle to make sure basic checks pass. Run mvn clean install -DskipITs to make sure unit-test pass. Run mvn clean test-compile failsafe:integration-test  to make sure integration-test pass.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

Coverage increased (+0.02%) to 44.811% when pulling d45292b283bc0f16ac2219b0af9b4621462a1eeb on faraday-fn:test_20190304_109 into ffc8e001a0237b5826b10584770d002d032ea3e1 on apache:master.

@faraday-fn Please look at the reason of your failed CI exception.


Support the migrations

Feature description::
Support the migrations.
Still under development.
Need:
Useful for applications already in production
Implementation:
Still under development.

To implement the migrations it was decided to create a new repository to be separate from the DuckORM core.
https://github.com/richecr/duck-orm-cli


Implements logURI to support 3rd party ctrd shim logger

Testing details
Custom built the journld shim logger
nerdctl run -d --log-driver binary:/home/manu/go/src/github.com/manugupt1/ctr-journald-shim/ctr-journald-shim docker.io/library/hello-world:latest

Journalctl logs
ep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]:
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]: Hello from Docker!
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]: This message shows that your installation appears to be working correctly.
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]:
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]: To generate this message, Docker took the following steps:
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]:  1. The Docker client contacted the Docker daemon.
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]:  2. The Docker daemon pulled the "hello-world" image from the Docker Hub.
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]:     (amd64)
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]:  3. The Docker daemon created a new container from that image which runs the
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]:     executable that produces the output you are currently reading.
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]:  4. The Docker daemon streamed that output to the Docker client, which sent it
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]:     to your terminal.
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]:
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]: To try something more ambitious, you can run an Ubuntu container with:
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]:  $ docker run -it ubuntu bash
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]:
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]: Share images, automate workflows, and more with a free Docker ID:
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]:  https://hub.docker.com/
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]:
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]: For more examples and ideas, visit:
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]:  https://docs.docker.com/get-started/
Sep 05 15:36:24 fedora default:10585b461231fb19106451008cc013f14bfd0fc0fc6bfaa11c3dd81a8f962674[189472]:
Sep 05 15:36:24 fedora containerd-rootless.sh[3083]: time="2022-09-05T15:36:24.411080375-07:00" level=warning msg="error from *cgroupsv2.Manager.EventChan" error="failed to add inotify watch for \"/sys/fs/cgroup/user

@AkihiroSuda Does this sound reasonable? I tested locally, I wanted to check-in with you. Any suggestions on writing an integ-test?

Thanks

Any suggestions on writing an integ-test?

What about implementing a test binary in a small shell script under t.Tempdir(), and set $PATH to there?

https://github.com/containerd/nerdctl/pull/1256/files#diff-7312cd37020aca19ab86ba2f16dc89e6cf1a5a0580eb6ec3dc2aa06b3cd1ccb9L147
@manugupt1 @AkihiroSuda This piece of code may help to impl the e2e test

Thanks

Any suggestions on writing an integ-test?

What about implementing a test binary in a small shell script under t.Tempdir(), and set $PATH to there?

Tried writing a bash file; but could not; not sure why. Here is the gist: https://gist.github.com/manugupt1/19db623c5cb3cc11a2cb58f23a176ba5
That's why I went with @Zheaoli's suggestion.


Support Snakemake 8

Add support for Snakemake 8
Snakemake 8 has been released, and appears required to transition to Python 3.12 (#146).
However, note that Snakemake 8 introduces breaking changes to the Snakefile definitions, which will impact (some) grapevne modules in the repositories. Should support be added for both Snakemake 7 (legacy) and 8?
There are also some bugs in the nacent Snakemake 8 code; for example, https://github.com/snakemake/snakemake/issues/ 2556 currently prevents conda environments from building within our containers.

One suggestion for grapevne modules that support Snakemake 7 and 8 would be to annotate Snakefile-names specific to the version used for the build (e.g. Snakefile7, or Snakefile8.2), which could then be used to indentify potential conflicts (when importing into workflows) and to launch using the appropriate version.
An area where this is likely to cause problems is in referencing remote script files; in Snakemake 7 we recommend using srcdir in conjunction with AUTO.remote; however, neither of these functions exist in Snakemake 8, which replaces them with workflow.source_path and storage.http (or similar plugin).

End-to-end tests will now run on snakemake >= 8.4, here: https://github.com/jsbrittain/GRAPEVNE/tree/snakemake8, but this will break module compatibility due to the removal of srcdir, etc. A broader integration/migration strategy needs to be considered to support snakemake 7/8.


Help with bulk upload of crosslinked spectra

Dear xiSPEC team,
I would like to upload my crosslinks (identified using the Mango-Comet-XLinkProphet TPP pipeline) for automated spectral annotation. I have made a test CSV file with a subset of the IDs from one file and tried to use the .ms2 formatted spectra generated from this pipeline (containing only spectra with putative crosslinks).
Unfortunately, I got the following error message from the batch upload:
log id: 7jb0v3b18m7r8moaib69pd9kr3_1646273879.log (include this in the github issue)
error type: Error
message: Unsupported peak list file type for: 04112020_Hpm1KO_RV_F10_XL_5uL_1.ms2
id: undefined
I have checked a few examples in the manual entry section of xiSPEC by pasting peak lists from .mgf scan header plus matched ID details from CSV - it works as expected. I have also tried to generate a mzID (mzIdentML) of the entire dataset and upload it alongside the .ms2 files, though could not upload it due to the size.
Here is a OneDrive folder with all files:
https://unsw-my.sharepoint.com/:f:/g/personal/z5187327_ad_unsw_edu_au/Etw11p_2vHFDq5umLA3FfpgB8zMaOwjIkFCQlJteFhMn4A?e=IWNa4f
Would it be possible to get some help with the upload of my dataset?
Best,
Tara Bartolec

Hi Tara,
which website are you uploading the data to?
it may be that the version of the software in use at https://spectrumviewer.org doesn't support ms2 peaklists, but the version in use at https://xiview.org does.
You'll need to create an account first to use xiview.org.
The csv format for the xiview.org website is a bit different - it also needs the position of the peptide in the protein (as it will try to draw the crosslink network). The CSV formats for xiview are described here - https://xiview.org/xiNET_website/csvFormats.php
There is also a way to view only the annotated spectra in xiVIEW (and not a network, if thats what you want) but its a bit difficult to find, I can explain if need be.
You should also be able to upload

the mzIdentML file
all the ms2 peaklists zipped together into a single file
and that should work.

However, I just tested that for you and it didn't work. The xiVIEW website complained saying "invalid xml syntax". The HUPO-PSI validator for mzIdentML just seems to crash when asked to validate it.
(The validator is at https://github.com/HUPO-PSI/mzIdentML/tree/master/validator, best to use whats in the zip file there if you want to run it.)
I think the mzIdentML file maybe has invalid characters in it - eg. on line 3031?
The best way forward is probably to fix the mzIdentML file (assuming I'm right that its broken).
Becasue it is crosslinking data you may be better using xiVIEW than xiSPEC. As i say, I'm not sure if ms2 files work in xiSPEC (@lars-kolbowski ?)
Anyway, happy to help, let us know how you get on,
best wishes,
Colin

Hi Colin,
Unfortunatley I couldn't quite figure out a way to get the spectral files to play nice in either xiSPEC or xiVIEW, but managed to find a way to produce annotated spectra in-house. Not sure what the problem was exactly, but thank you for your help nonetheless.
Best,
Tara