[CT-3032] dbt show --limit should include the limit in the DWH query, to avoid long-running queries

Housekeeping

[X] I am a maintainer of dbt-core

Short description
Most adapters (check impact matrix below) load the entire model into memory while running dbt show.
The goal of this ticket is to avoid this behavior and only load the relevant rows from the model.
Acceptance criteria

Inline limit into the query instead of using the fetchmany method for dbt show.
Confirm that the query sent to Snowflake does have the limit appended to it.
Add a test case where there is a limit already in the query.

Impact to Other Teams
Adapter impact matrix

Adapter
Impacted?
Notes

Postgres
✅

Snowflake
✅

BigQuery
🚫

Databricks
❔

Redshift
❔

Will backports be required?
Backport to 1.6.latest, 1.5.latest
Context
Original bug report in Slack: https://dbt-labs.slack.com/archives/C05FWBP9X1U/p1692909690843649.
Link to similar issue that was fixed in Core: https://github.com/dbt-labs/dbt-core/issues/7390.
The root cause of the issue is that warehouse providers are implementing the fetchmany method in the DB-API 2.0 spec inefficiently by loading the entire table into memory and filtering client-side.
The long-term fix here is for them to become smarter in how they implement fetchmany, similar to what BigQuery has done: https://github.com/googleapis/google-cloud-python/issues/9185.

What should the expected behavior be if I run a command like this?
dbt show --inline "select * from my_table limit 500" --limit 50

or like this
dbt show --inline "select * from my_table limit 50" --limit 500

@davidharting Agree! I think we'd need to use something like a subquery, to avoid a syntax error that would result here:
# no good
select * from my_table limit 500
limit 10;

# works
select * from (
    select * from my_table limit 500
) subquery
limit 10;

Nice that makes sense! So expected behavior is simply that the query we are showing is always honored verbatim, and the limit is applied on an "outer layer" via the subquery mechanism above. Simple, predictable, explicit. Love it.

The root cause of the issue is that warehouse providers are implementing the fetchmany method in the DB-API 2.0 spec inefficiently by loading the entire table into memory and filtering client-side.

Perhaps nitpicking, but I think this is better characterized like this:

PEP 249 DB API 2.0 provides a specification for fetching resultsets in batches with .fetchmany(). However, it has nothing to say towards providing an API to modify a given SQL statement execution so make the resultset returned by the database smaller. It only defines size as how many rows of the resultset the client should return.

This is the standard and it is the default way that drivers have implemented this feature. This is also how pandas.dataframe.head() works.
Our docs are currently clear that --limit pertains to the number of rows to display

By default, dbt show will display the first 5 rows from the query result. This can be customized by passing the flag --limit n, where n is the number of rows to display.

Usage of fetchmany() with a default size=500 does address client-side OOM issues, but does not enable any sort of "pushdown limit filtering" as #7545 was titled. There's no magic spell to make long-running queries return many rows of data faster, there is no pushdown.
The way to get pushdown is to literally push the limit down into the SQL. My gut says we modify Adapter.execute() to have a conditional that when limit is not None, add a LIMIT clause to the given SQL. we're lucky here imho bc adapters have largely already migrated to the new .execute() signature that includes the limit parameter.
two challenges to this approach:

what about databases like Fabric and Synapse that literally don't have a LIMIT? not a big deal, but this limit inject should be dispatchable to allow things like SELECT TOP N
dbt show and Cloud's preview don't work for materializations that aren't views or tables (eg snapshot, incremental). This makes sense behind the scenes because UPDATE/MERGE/DELETE statements don't return rows to the client. Just calling it out that if we ever want to preview this kinds of models, that this new behavior would also need to be taken into consideration

Last thing is that this smells very much like an interface issue rather than a technical one. When a Cloud IDE user clicks "Preview", what are they expecting to happen? Could the quickest win be to clarify that it's not our fault if the query being previewed takes a long time to run? I'd be surprised if DWH query web client IDEs do anything like modifying user-submitted SQL to make things faster for users...

@dataders I agree that the docs for dbt show are clear that --limit is about the display. However, if we are not persisting the full results anywhere, I think it would be ideal for core to also not fetch more than it is going to display either.
I think your feedback is sort of two-fold here:

Suggested implementation
Is this actually a bug?

I can't weigh in on suggested implementation. For CLI users, I do still see this as a problem, if not a bug. dbt show does not persist the results anywhere. Because of that, I think it is a reasonable expectation that dbt show with a --limit will be efficient and not fetch more data than it knows you want to see.

@dataders @aranke @jtcohen6

dbt show and Cloud's preview don't work for materializations that aren't views or tables (eg snapshot, incremental). This makes sense behind the scenes because UPDATE/MERGE/DELETE statements don't return rows to the client. Just calling it out that if we ever want to preview this kinds of models, that this new behavior would also need to be taken into consideration

That is in fact news to me! this would represent a breaking change to the IDE using 1.2, as the strategy in IDE 1.1 when using RPC is more like the dbt show --inline, which allows for the previewing of incremental models. We updated the strategy IDE in 1.2 to use dbt show -s model which was mostly to properly render things like {{ this }}, which are ironically almost exclusively relevant to incremental models!
It sounds like there are some technical justifications for why show may not be able to return rows here, but strictly in the context of the IDE i think we'd want to make sure preview works for all models.

@dataders @dave-connors-3 I do not believe this is the case. Incremental models support previewing their compiled SQL with dbt show just the same as view/table models. There are a few known edge cases, e.g. _dbt_max_partition on BigQuery insert_overwrite models (internal slack thread).
To @davidharting's point: I strongly believe that dbt-core/adapters should be responsible for owning the pushdown of the limit, to ensure that a user's limit 10 query can return a result set of 10 rows as quickly as possible.

I strongly believe that dbt-core/adapters should be responsible for owning the pushdown of the limit, to ensure that a user's limit 10 query can return a result set of 10 rows as quickly as possible.

While I agree this definitely falls onto adapters I do want to temper expectations here, for many queries and data warehouses adding the limit into the query may not significantly impact the query run time. This is because many query engines don't pushdown of limit clauses into sub queries/with statements. The limit is therefore only applied on the result set of the query with the limit clause added.
Consider:
with t2 as (
<some expensive computation/join>
)
SELECT t1.*
FROM t1
INNER JOIN t1.id == t2.id
LIMIT 10

If t2 is the expensive part of this query then the limit 10 will have a negligible impact on the runtime.
Not saying we shouldn't try to add the limit into the query but that doing so is going to be an incremental improvement not a complete fix.


Implement docker exec healthchecks.

@martnu @rohansingh @davidxia

Looks good to me! :+1:

@mbruggmann Hey, I'll be able to look at this soon. Been pretty busy lately.

:+1:

@rohansingh I think @mbruggmann is on vacation. I made some minor edits here https://github.com/mbruggmann/helios/pull/1/files. Not sure when he's back.

I'm back may 26 but feel free to edit/improve/merge/discard this as you please.

@rohansingh I squashed into 1 commit here https://github.com/spotify/helios/pull/482

superseded by https://github.com/spotify/helios/pull/482


Parsing error: Unexpected token :

Environment
------------------------------
- Operating System: Linux
- Node Version:     v22.5.1
- Nuxt Version:     3.13.0
- CLI Version:      3.13.1
- Nitro Version:    2.9.7
- Package Manager<EMAIL_ADDRESS>- Builder:          -
- User Config:      compatibilityDate, devtools, extends, modules, sourcemap, pinia, eslint
- Runtime Modules<EMAIL_ADDRESS>@nuxt/ui<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>- Build Modules:    -
------------------------------

Package
@nuxt/eslint
Reproduction
I'm relativly new to Typescript and vue/nuxt, but I'm fairly certain this is valid syntax and code...
I keep getting "error  Parsing error: Unexpected token :" pointing to the colin before the type specifier in the function parameter list.
Minimal Example Component
<!-- ./component/SettingsButton.vue -->
<script lang="ts" setup>
function clickHandler(event: PointerEvent) {
  console.log(event);
}
</script>

<template>
  <ClientOnly>
    <UButton
      icon="i-heroicons-cog-6-tooth-20-solid"
      color="gray"
      variant="ghost"
      aria-label="Messages"
      @click="clickHandler"
    />
    <template #fallback>
      <div class="w-8 h-8" />
    </template>
  </ClientOnly>
</template>

<style></style>

eslint Result
node ➜ /workspaces/Notifier (Spike) $ eslint ./components/SettingsButton.vue

/workspaces/Notifier/components/SettingsButton.vue
  3:27  error  Parsing error: Unexpected token :
✖ 1 problem (1 error, 0 warnings)

Describe the bug
eslint with the  @nuxt/eslint module is incorrectly flagging ":" in function parameter lists as a parse error when used in a vue component.
e.g. the colon in the function declaration below would trigger a parse error is used in a Vue component

Have you installed typescript in your project?

We temporarily closed this due to the lack of enough information. We could not identify whether it was a bug or a userland misconfiguration with the given info.
Please provide a minimal reproduction to reopen the issue.
Thanks.

Why reproduction is required

Thanks @antfu !!
Can confirm as you gracefully put it, it was a "userland misconfiguration" issue :grin:
For anyone with a similar issue in the future I changed my eslint.config.mjs file  as per below and everything seems to be working as expected. Seems the nuxt config doesn't enable Typescript out of the box - which caught me out.
// eslint.config.mjs
import withNuxt from './.nuxt/eslint.config.mjs'

export default withNuxt(
    // Your custom configs here
    {
        languageOptions: {
            parserOptions: {
                parser: "@typescript-eslint/parser",
            },
        },
    }
)


Shortcut for settings editor doesn't bring main window to front

Testing #196195
Tested on Linux:

Open Settings editor in main window.
Focus aux window.
Ctrl + , appears to set the cursor in the settings editor, but it does not focus the main window nor does it bring it to the front.

This works as expected when the Settings editor is open in the aux window and the main window has focus when the shortcut is pressed.

@chrmarti for me a second settings editor opens? not for you?

@chrmarti I am doing this, if you do something different, it would be helpful to have the steps indicating as such:

In the latest build focus is transferred and the main window is brought to front. The bug is fixed for me. I have "workbench.editor.revealIfOpen": true which explains why I only get a single Settings editor. Closing.


Notebook Link is not responding

📚 Documentation
Suggestion
The notebook that you shared recently: the link is not active.

@atwine not sure what happened to the original but check out this fork: https://github.com/camenduru/DoctorGPT/blob/main/llama2.ipynb

@atwine not sure what happened to the original but check out this fork: https://github.com/camenduru/DoctorGPT/blob/main/llama2.ipynb

Thanks for this, I had the same issue of not finding the notebook.

There was an error loading this notebook. Ensure that the file is accessible and try again.
Ensure that you have permission to view this notebook in GitHub and authorize Colaboratory to use the GitHub API.
Is it possible for you to share the link please?


twitter: use different character for asterisks.

This should get around the failed escaping attempt previously and allow this character to be used in statuses.
CC @kdaigle @izuzak @aoaaxy

Works as expected! Tweet sample: https://twitter.com/aoaaxy/status/702110226212847616
Thank you so much! I really appreciate all the work.
Cheers,
E.

Thanks for the kind words @aoaaxy!


Fixed permissions that were causing containers to crash

Modified frontend and app deployment yaml files to use flagger-envoy-proxies service account. Containers crash because they cannot call AppMesh APIs without it.

someone please merge the changes


Update example lazy.nvim config in README

Add a recommendation to use 'keys' to set the keybinding to load lazygit.nvim if using lazy.nvim. If the keybinding is set elsewhere, e.g. in a config() function, the plugin won't be loaded the first time this is run - the user will have to use : LazyGit first.

Thanks for the suggestion and the PR!


CodeMirror.hasMode

I created a hasMode(spec) function, to check if a given spec resolves to an existing mode. I needed this for dynamic mode creations via overlay.js, so I don't end up creating the same mode over and over again.
Thought it could be useful to others.

I didn't update the docs in my commits, that'd be up to you :x

Oops, you're right. Sorry, will fix that later.

This can already be done with the existing interface (CodeMirror.modes.hasOwnProperty(CodeMirror.resolveMode(spec).name)), and I don't think it warrants an additional exported method.


Fix feather m4 usb

Got a feather M4 recently and wanted to use USB serial. It appears to have been neglected and wasn't working. This fixes that & adds an example so it shouldn't happen again

I stole the lib.rs changes from itsybitsy m4's implementation

Looks good, thanks.


Clear the current get and post fields after a request has been processed - This saves having to reinstatement TwitterAPIExchange for every API call.

Clear the current get and post fields after a request has been processed - This saves having to reinstatement TwitterAPIExchange for every API call.
Previously if you were performing a GET call and then a POST call an exception would be thrown because you can't have both get and set fields present. This resolves this bug.

Discussed here: https://github.com/J7mbo/twitter-api-php/issues/150
There was no further comment on that from J7mbo

I'm a little worried about affecting BC with this... if we choose to merge it in and it'll have to go on the release note as a potentially BC breaking change?

Also, the PR needs to be made onto the development branch

I don't see any problems with BC here.
If you worry my be we can add an option to the constructor to enable/disable clearing the fields which defaults to false.

I'll close this pull request off and re-submit under the development branch

New pull request can be found here for reference:
https://github.com/J7mbo/twitter-api-php/pull/169


Add: Link to default bindings in README.md

Hi @stevearc,
Nice plugin :) I was originally trying to overwrite the key-bindings with the commands listed in the README, specifically replace <CR> to open the currently selected node in the AerialTree.
However there is no command I can see for this and I needed to see what the default bindings were doing. This just adds an extra link as the information of what to overwrite default bindings with seems to be missing.
Best,
Eddie

LGTM. Thanks for the PR!


Implement SpannerDao with JDBC

[blocked, in progress]
This PR creates an implementation of SpannerDao that uses JDBC instead of Cloud Spanner's Java client.
[more to be added to description]
Notes related to current draft:

The final PR will not modify the existing SpannerDao implementation. This draft modifies the SpannerDao file to make it easy to see the comparison between the Java client and JDBC implementation
FinAppService is temporarily modified just so that the current code can run. Exception handling will be changed in an adjacent PR.
PreparedStatement does not support the ByteArray object that is in the signature for most methods. Thus, we must convert these ByteArray objects to byte[] objects. This complicates things in moveAccountBalance and its helper functions, where both reading and writing to the database are required. These byte[] objects cannot be compared with basic object equality, instead requiring Arrays.equals. Options include continuously switching between byte[] and ByteArray to support interacting with the database and object equality, or--as I have implemented--sticking with byte[] objects and changing the structure of some helper functions.

aside from the issues that youve pointed out in the description, here are a few things i notice with this PR

we won't be able to merge this in because you've edited SpannerDao and not edited based on the fact that there is now an interface. you'll need to pull the changes that are now in the main branch and rename this file SpannerDaoJdbcImpl.java or something else similar
we also won't be able to merge because of the exceptions, but i'm working on that and understand you did this to make sure it runs
once you pull the changes from the main branch, you will need to bind your implementation with the interface in the DatabaseModule.java class

with your PR as it is now, you won't be able to merge until you address these changes. i also understand that some of them depend on me (the exceptions), but i anticipate that you'll be able to work on the interface and implementation fixes without being blocked. really solid PR though, nice use of the APIs.

Yes, that all makes sense. I didn't pull the changes for this first draft so as to let the reviewers see the direct comparison between the original java client implementation and the JDBC implementation, but the next draft will be updated to be on a new file.

when i finish #15, you should include in this PR to also update DatabaseModule to return new SpannerDaoJDBCImpl(client); in the provideSpannerDao method

will be handled in #15


Bake error, use_pass_ambient_occlusion

I have an error when I use the bake -
Python: Traceback (most recent call last):
File "C:\Users\royal\AppData\Roaming\Blender Foundation\Blender\3.2\scripts\addons\cats-blender-plugin-master\tools\bake.py", line 384, in execute
self.perform_bake(context)
File "C:\Users\royal\AppData\Roaming\Blender Foundation\Blender\3.2\scripts\addons\cats-blender-plugin-master\tools\bake.py", line 622, in perform_bake
self.bake_pass(context, "diffuse", "DIFFUSE", {"COLOR"}, [obj for obj in collection.all_objects if obj.type == "MESH"],
File "C:\Users\royal\AppData\Roaming\Blender Foundation\Blender\3.2\scripts\addons\cats-blender-plugin-master\tools\bake.py", line 294, in bake_pass
context.scene.render.bake.use_pass_ambient_occlusion = "AO" in bake_pass_filter
AttributeError: 'BakeSettings' object has no attribute 'use_pass_ambient_occlusion'

Me as well.  My Process below:
Added a pair of briefs (underware) to a G8M and some hair.
Utilized the BridgetoBlender for the character.
Opened Blender 3.0.1 and imported said character using bridge and applied the morphs I wanted.
Opened CATS v0.19 and filled in appropriate fields for eye tracking and visemes
Clicked Copy and Bake.

This has been fixed in the development version, it should go away if you update

no updates where shown as available.  What version should we be running?

Try this: https://github.com/absolute-quantum/cats-blender-plugin/archive/refs/heads/development.zip


given action "REALM_INIT", reducer "userGroups" returns undefined

Sentry shows this error hitting a bunch of users, ever since 15.0.92 came out:

Given action "REALM_INIT", reducer "userGroups" returned undefined. To ignore an action, you must explicitly return the previous state. If you want this reducer to hold no value, you can return null instead of undefined.

(That is an admirably clear error message. Thanks, Redux!)
Here's the relevant code:
const realmInit = (state: UserGroupsState, action: RealmInitAction): UserGroupsState =>
  action.data.realm_user_groups;

Seems like that field isn't included in the response we got from the server.
I suspect these are older servers that just don't have this feature. Checked one at random, and it's on 1.7.1:
$ curl -s https://[...]/api/v1/server_settings | jq .zulip_version
"1.7.1"

We should be compatible, of course, so I guess we need to have this code handle it properly.

Started working on this. It seems we are not consistent in how we handle this. I'll rework all reducers to do the same reasonable thing in this case.


Bump CSI sidecars v1.3

https://github.com/longhorn/longhorn/issues/5672
Mostly the same as #5725 except it doesn't bump external-provisioner and external-snapshotter beyond the v1beta1 VolumeSnapshot API.

We decided not to update the sidecars in previously released minor versions of Longhorn. See the discussion here: https://github.com/longhorn/longhorn/issues/5672#issuecomment-1502579905.


Disabling JavaDoc DocLint feature

Java 8 has enabled DocLint feature by default which causes jmxtrans
build failure. This commit adds -Xdoclint:none param to maven-javadoc
plugin configuration when build is invoked for java versions higher
than 8.

[ ]   File: pom.xml:L649-658
 As the additional option is only required for Java 8 (and probably Java >= 8), I would have added a pluginManagement section to a jdk_greater_than_eight profile. It seems to me more readable than having a property that is emptied for specific cases (too many indirection and negation for my taste).
If you feel that your way is the best, I'll merge as is...
[x]   General Comment
 Sure, it will be more readable with explicit profile for versions higher and equal 8.

This pull request is now managed with CodeReviewHub. Refresh.

Sure, it will be more readable with explicit profile for versions higher and equal 8.

Added jdk_higher_or_equal_than_8 profile with plugin configuration.

Yep, much cleaner, all code related to this in mostly the same place... Thanks ! :shipit:

Thanks a lot !


Only use table transformations in users migration

Previously, the create users migration template was using table
transformations for adding columns and schema statements for adding
indices.
This commit updates the migration to use table transformations for both of
these purposes.

:+1:


feat: abstract search list

Description
Abstracting search item component to accept model and dataset data. Following this design:

Preparing deprecation for:

models-listview.vue
datasets-listview.vue
articles-listview.vue

Just keeping them in case someone may use their functions but I feel they are good to nuke. Would it be worth syncing with everyone to make sure?
Resolves 438 partially

Description
Abstracting search item component to accept model and dataset data. Following this design:
 Preparing deprecation for:

models-listview.vue
datasets-listview.vue
articles-listview.vue

Just keeping them in case someone may use their functions but I feel they are good to nuke. Would it be worth syncing with everyone to make sure?
Resolves 438 partially

@Tom-Szendrey fyi some of the components used in the data explorer are being updated/replaced in case this may bring conflicts when you do the latest code merge


Create IS.cpp

Assigned Issue Number ?
#007
Language Opted ?
C++
Number of files added or updated ?
1
Name of these files
Algorithm => Search_Algorithm => Interpolation search => IS.cpp
Checklist

[x] I've read the contribution guidelines.
[x] I've referred the correct issue number.
[x] I've fill up this entire template correctly.

Please read Pr templetes and fill properly.

Is it correct or need any changes (sorry i'm some what new to this open source contributions.)


Maximum number of Application Commands reached (5)

So I change the handler/Command.js file to make it global and this error occur which Maximum number of Application Commands reached (5). When I replace it like the code for a guild, it just works fine. @NTMNathan

This has been fixed.


taesd and taesdxl support

FMI: https://github.com/madebyollin/taesd

sd.cpp only support safetensors TAESD
This safetensors file contains decoder and encoder too
just the encoder/decoder.safetensors is not working...
Related comment from SD.cpp

Some tests:
no Taesd

[INFO ] stable-diffusion.cpp:1292 - generating image: 1/1 - seed 42
[INFO ] stable-diffusion.cpp:1304 - sampling completed, taking 42.59s
[INFO ] stable-diffusion.cpp:1312 - generating 1 latent images completed, taking 42.59s
[INFO ] stable-diffusion.cpp:1314 - decoding 1 latents
[INFO ] stable-diffusion.cpp:1324 - latent 1 decoded, taking 1.09s
[INFO ] stable-diffusion.cpp:1328 - decode_first_stage completed, taking 1.09s
[INFO ] stable-diffusion.cpp:1347 - txt2img completed in 43.92s

with Taesd

[INFO ] stable-diffusion.cpp:1292 - generating image: 1/1 - seed 42
[INFO ] stable-diffusion.cpp:1304 - sampling completed, taking 45.24s
[INFO ] stable-diffusion.cpp:1312 - generating 1 latent images completed, taking 45.24s
[INFO ] stable-diffusion.cpp:1314 - decoding 1 latents
[INFO ] stable-diffusion.cpp:1324 - latent 1 decoded, taking 0.25s
[INFO ] stable-diffusion.cpp:1328 - decode_first_stage completed, taking 0.25s
[INFO ] stable-diffusion.cpp:1347 - txt2img completed in 45.68s

The latent image generation is not relevant :)


[release] Updating base image reference

Hey @jpechane, trivial fix, but I'm wondering how this could happen. Aren't those versions pulled up automatically during the release or something?

@gunnarmorling Thanks for spotting. This was the manually completed release and I forgot to update the references. I've added other files to this PR


Partial fix, unfixable

@mmzdouc These entries do not seem fixable.

MITE0000127: proposed fix: break multi-reaction into two consecutive reactions

MITE0000126: the same fix proposed


panic: could not match regexp with string

Error :
panic: could not match regexp with string
^(?P<address>[0-9a-fx]+) <(?P<position>.*)> '(?P<type>.*?)'(:'(?P<type2>.*?)')? <(?P<kind>.*)>[\s]*$
0x7fe6fc85a348 <col:56> 'int' <LValueToRValue> part_of_explicit_cast

goroutine 12 [running]:
github.com/elliotchance/c2go/ast.groupsFromRegex(0xc000210af0, 0x64, 0xc0002b3409, 0x44, 0xc00037bde0)
	/Users/sakib/go/src/github.com/elliotchance/c2go/ast/ast.go:286 +0x360
github.com/elliotchance/c2go/ast.parseImplicitCastExpr(0xc0002b3409, 0x44, 0x12c0246)
	/Users/sakib/go/src/github.com/elliotchance/c2go/ast/implicit_cast_expr.go:17 +0x62
github.com/elliotchance/c2go/ast.Parse(0xc0002b33f8, 0x55, 0x12baa29, 0x5)
	/Users/sakib/go/src/github.com/elliotchance/c2go/ast/ast.go:154 +0x306a
main.convertLinesToNodes(0xc0002bbae0, 0xd7, 0x1af, 0x0, 0x0, 0x0)
	/Users/sakib/go/src/github.com/elliotchance/c2go/main.go:89 +0x1a6
main.convertLinesToNodesParallel.func1.1(0xc000228540, 0xc00000e088, 0xc0002bbae0, 0xd7, 0x1af, 0x0)
	/Users/sakib/go/src/github.com/elliotchance/c2go/main.go:113 +0x53
created by main.convertLinesToNodesParallel.func1
	/Users/sakib/go/src/github.com/elliotchance/c2go/main.go:111 +0x124

Source :
#include <stdio.h>

void genFib(int x, int y, int n) {
	if (n == 0){
		return;
	}

	printf("%d\n", x);
	return genFib(y, x + y, --n);
}

int main() {
	genFib(1, 1, 10);
	return 0;
}

This is becuase c2go doesn't recognise one of the AST lines generated from clang. The regexp will need to be updated so it can be understood.
If you want to have a go at fixing this, you can find an example here: https://github.com/elliotchance/c2go/pull/760

Getting Error as:
$ c2go transpile helloworld.c
panic: could not match regexp with string
^(?P[0-9a-fx]+) <(?P.)> '(?P.?)'(:'(?P.)')?(?P lvalue)?(?P prefix)?(?P postfix)? '(?P.?)'[\s]$
0x2666028 <col:14, col:44> 'unsigned long long' lvalue prefix '' cannot overflow
goroutine 39 [running]:
github.com/elliotchance/c2go/ast.groupsFromRegex(0xc0002898c0, 0xa6, 0xc000337e91, 0x51, 0x8e2620)
C:/Users/Dell/go/src/github.com/elliotchance/c2go/ast/ast.go:286 +0x367
github.com/elliotchance/c2go/ast.parseUnaryOperator(0xc000337e91, 0x51, 0x6dfcd8)
C:/Users/Dell/go/src/github.com/elliotchance/c2go/ast/unary_operator.go:16 +0x69
github.com/elliotchance/c2go/ast.Parse(0xc000337e83, 0x5f, 0x6db497, 0x5)
C:/Users/Dell/go/src/github.com/elliotchance/c2go/ast/ast.go:246 +0x21e2
main.convertLinesToNodes(0xc0001004b0, 0x619, 0x619, 0x67006e0061006c, 0x6500620076002e, 0x0)
C:/Users/Dell/go/src/github.com/elliotchance/c2go/main.go:89 +0x1ad
main.convertLinesToNodesParallel.func1.2(0xc00004e2a0, 0xc00003a008, 0xc0001004b0, 0x619, 0x619, 0x0)
C:/Users/Dell/go/src/github.com/elliotchance/c2go/main.go:121 +0x5a
created by main.convertLinesToNodesParallel.func1
C:/Users/Dell/go/src/github.com/elliotchance/c2go/main.go:119 +0x1bc
SOURCE:
#include <stdio.h>
int main()
{
printf("Hello WORLD");
return 0;

}
I am not getting what needs to be changed in regexp.........
Even if I have commented regexp in the files mentioned in error I am getting the same error
Please help with this

Getting Error:
$ c2go transpile helloworld.c
panic: could not match regexp with string
^(?P[0-9a-fx]+) <(?P.)> '(?P.?)'(:'(?P.)')?(?P lvalue)?(?P prefix)?(?P postfix)? '(?P.?)'[\s]$
0x24e8d08 <col:14, col:44> 'unsigned long long' lvalue prefix '' cannot overflow
goroutine 13 [running]:
github.com/elliotchance/c2go/ast.groupsFromRegex(0xc0002969a0, 0xa6, 0xc0002fd51f, 0x51, 0xc000048000)
C:/Users/Dell/go/src/github.com/elliotchance/c2go/ast/ast.go:286 +0x367
github.com/elliotchance/c2go/ast.parseUnaryOperator(0xc0002fd51f, 0x51, 0x6dfcd8)
C:/Users/Dell/go/src/github.com/elliotchance/c2go/ast/unary_operator.go:16 +0x69
github.com/elliotchance/c2go/ast.Parse(0xc0002fd511, 0x5f, 0x6db497, 0x5)
C:/Users/Dell/go/src/github.com/elliotchance/c2go/ast/ast.go:246 +0x21e2
main.convertLinesToNodes(0xc0000fa190, 0x619, 0x124b, 0x0, 0xc00004e000, 0x0)
C:/Users/Dell/go/src/github.com/elliotchance/c2go/main.go:89 +0x1ad
main.convertLinesToNodesParallel.func1.2(0xc000062060, 0xc0000e8000, 0xc0000fa190, 0x619, 0x124b, 0x0)
C:/Users/Dell/go/src/github.com/elliotchance/c2go/main.go:121 +0x5a
created by main.convertLinesToNodesParallel.func1
C:/Users/Dell/go/src/github.com/elliotchance/c2go/main.go:119 +0x1bc
Source:
#include <stdio.h>
int main()
{
printf("Hello WORLD");
return 0;

}
I am not getting that which regexp needs to be updated .
I also tried by commenting all the regexp present in the files mentioned in error,but facing the same issue.
Please suggest.

Getting Error:
$ c2go transpile helloworld.c
panic: could not match regexp with string
^(?P[0-9a-fx]+) <(?P.)> '(?P.?)'(:'(?P.)')?(?P lvalue)?(?P prefix)?(?P postfix)? '(?P.?)'[\s]$
0x2666028 <col:14, col:44> 'unsigned long long' lvalue prefix '' cannot overflow
goroutine 13 [running]:
github.com/elliotchance/c2go/ast.groupsFromRegex(0xc0002969a0, 0xa6, 0xc0002fd51f, 0x51, 0xc000048000)
C:/Users/Dell/go/src/github.com/elliotchance/c2go/ast/ast.go:286 +0x367
github.com/elliotchance/c2go/ast.parseUnaryOperator(0xc0002fd51f, 0x51, 0x6dfcd8)
C:/Users/Dell/go/src/github.com/elliotchance/c2go/ast/unary_operator.go:16 +0x69
github.com/elliotchance/c2go/ast.Parse(0xc0002fd511, 0x5f, 0x6db497, 0x5)
C:/Users/Dell/go/src/github.com/elliotchance/c2go/ast/ast.go:246 +0x21e2
main.convertLinesToNodes(0xc0000fa190, 0x619, 0x124b, 0x0, 0xc00004e000, 0x0)
C:/Users/Dell/go/src/github.com/elliotchance/c2go/main.go:89 +0x1ad
main.convertLinesToNodesParallel.func1.2(0xc000062060, 0xc0000e8000, 0xc0000fa190, 0x619, 0x124b, 0x0)
C:/Users/Dell/go/src/github.com/elliotchance/c2go/main.go:121 +0x5a
created by main.convertLinesToNodesParallel.func1
C:/Users/Dell/go/src/github.com/elliotchance/c2go/main.go:119 +0x1bc
Source:
#include <stdio.h>
int main()
{
printf("Hello WORLD");
return 0;
}
I am not getting that which regexp needs to be updated .
I also tried by commenting all the regexp present in the files mentioned in error,but facing the same issue.
Please suggest.

@s4kibs4mi :How you find which AST line needs to be updated?
I am also getting similar issue but with a little bit difference
Error:
$ c2go transpile helloworld.c
panic: could not match regexp with string
^(?P[0-9a-fx]+) <(?P.)> '(?P.?)'(:'(?P.)')?(?P lvalue)?
(?P prefix)?(?P postfix)? '(?P.?)'[\s]$
0x2666028 <col:14, col:44> 'unsigned long long' lvalue prefix '' cannot ### overflow

@s4kibs4mi :Did you find solution for your problem?
I am also getting similar error.
Please suggest how to proceed for this.

@elliotchance, I too have just experienced this issue.
Maybe the regex is too strict and needs to more forgiving for other formats.
Perhaps the idea, if the information I need is there, use it, and if there is more, ignore it.
Instead of updating the regex for my specific line:
panic: could not match regexp with string
^(?P<address>[0-9a-fx]+) <(?P<position>.*)>(?P<inherited> Inherited)? (?P<os>\w+) (?P<version>[\d.]+) (?P<unknown1>[\d.]+) (?P<unknown2>[\d.]+)(?P<unavalable> Unavailable)? "(?P<message1>.*?)"(?P<message2> ".*?")?[\s]*$
0x7fddc201bf28 <col:99, col:134> macos 10.13 0 0 "" "" 0

Maybe we can clean this up.
The issue #760 seems to build a regex from another regex. Can you point me in the direction where the tests for these are?

@jtarchie because c2go parses the string rendered AST tree produced from clang there's a lot of edge cases, especially as clang gains more features, as the AWS output is just for debugging, it's not intended to be a porcelain format.
I originally wanted to keep the regex as tight as possible to make sure the structs that represent the data don't become dirty over or out of sync over time, because it's such an easy to update a case when it's found. You can find all the test cases and node types in the ast package: https://github.com/elliotchance/c2go/tree/master/ast
If it's an existing node type you can add a new test case for it, here is an example of adding a fix: https://github.com/elliotchance/c2go/pull/853


The behavior of "allow" really confuse me, in document:
# The only dependencies which match the given pattern are updated.
# Each pattern must have `groupId`, and may have `artifactId` and `version`.
# Defaults to empty `[]` which mean Scala Steward will update all dependencies.
updates.allow  = [ { groupId = "com.example" } ]

The only dependencies which match the given pattern are updated.

I thought it should filler out everything else not in the "allow" list
But the current behavior is
When there are 3 artifacts
    val update1 = Single("org.http4s" % "http4s-dsl" % "0.17.0", Nel.of("0.18.0"))
    val update2 = Single("eu.timepit" % "refined" % "0.8.0", Nel.of("0.8.1"))
    val shouldNotAllow = Single("abc.def" % "ghi" % "0.8.0", Nel.of("0.8.1"))

And the rules is
        allow = List(
          UpdatePattern(update1.groupId, None, Some("0.17")),
          UpdatePattern(update2.groupId, Some("refined"), Some("0.8"))
        )

the artifacts after filter is update1 and shouldNotAllow
but the group id of sholdNotAllow is not even listed in the allow list.
while my expectation is aligned with the doc, only update2 should get update

Okay, here is another proposal. I've just checked how many repos (that my public instance works on) actually make use of updates.allow and it turns out nobody is using it. Therefore I'd be comfortable with renaming updates.allow to updates.pin and updates.include to updates.allow and leaving the implementation as-is.


Clean up the code of the component

The current code is a bit of spaghetti and a mess of logic, I've already a cleaner solution for that but anyone feel free to submit pull request with their way of improvements.
Some problems:

Computed properties have repeated code inside
Methods have repeated code inside
Some conditional rendering use a wrong Boolean logic

a2a1f2f4d6a6abd3f516d12ba32853d0b230ec48


Icon drawer gets too tall sometimes

Maybe related to #30
Issue
The icon drawer doesn't have a max height and is not scrollable.
This is fine for icons that don't add too much information to the drawer, like regular icons
But there's a specific set that I use, Fluent Emoji, that has many colors, in which the website lists.
Works fine for few colors, like this:

But the drawer goes bonkers when you select an emoji with many colors:

The only fix, for now, is to reload the page, or zoom out far enough to close the drawer, but to copy the icon name is a challenge
Steps to reproduce

Open the Fluent Emoji set:

https://icon-sets.iconify.design/fluent-emoji/?keyword=fluent

Select an emoji like "artist 🧑🎨" (most of the emojis have lots of colors)

Desired solution
Limit the height to half the screen and add a scroll to the div inside footer-icons

Thanks for reporting!
Fixed. When there are too many colors to edit, they will be hidden by default and button to show them will appear (same for opacity and stroke width). If they are shown (user clicked button), scrollbar will appear for the whole customisations section.
Fix will be deployed tomorrow.
Also, I recommend avoiding Fluent Emoji. Those icons have massive amount of gradients, resulting in very slow rendering. They are great as raster images, but as SVG performance is horribly slow.


Request for bringing up local vertica container automatically for integration tests

Currently, the integration tests require the developers to manually install the vertica container for running the integration tests. However, installing and bringing up vertica can be a very daunting task . I would like to propose automating the process through the following steps.

Install docker on the machine
Run the vertica container  https://github.com/jbfavre/docker-vertica
Run the integration tests
Stop the vertica container

@sitingren I would like to work on this enhancement if it sounds good for running integration tests on local vertica

@ranjanp75 Thanks for providing your opinion! Can you tell me which file(s) are you going to modify/add to implement your proposed process?

I have a method to achieve this.
In the tox.ini file under "commands" shell commands to achieve the above tasks can be written before and after the nosetests command

@ranjanp Here's some of my thoughts:

Do you have mechanisms to make it be optional? Not every developer needs a Vertica docker container.
Spining up a vertica container is time-consuming. Is it efficient to re-create a container every time you restart tox? To me, this is a one-time setup locally and I can change codes and run tox tests for multiple times.
The tox.ini in the repo is mainly used by our CI tool (.travis.yml), and used as an example for developers as well. Any commit merges to tox.ini should not break Travis CI and be general to all developers. Otherwise, it is better to mention your customization in CONTRIBUTING.md.

Feel free to create a PR when you think your solution is solid and general.

@sitingren thanks for the information. I will work on it if I get a way to do it . Are there any priority features I can work on ? Thanks

@ranjanp75 There are no feature that has higher priority than others. You can look at the open issue list and work on anything that you are interested in.

Close this issue for now. Please reopen when you have new updates.


Improve express.static documentation

It would be good if the good practices around serving static files was accessible from here and here.
I volunteer at Stack Overflow and it would make my job easier if people were more aware that express.static should be put behind a reverse proxy cache.
Also consider asking people to put their static content in a web server or a CDN rather than on an application server.

We can certainly add links from the pages you suggest.
I'm not sure we want to get into the latter point, even though it's reasonable.  We can't possibly tell people everything they need to know about web apps.

I think adding more visibility for the good practices article, which is very informative, should be enough.

I added links to the best practices article and also internal anchors as suggested.

Thanks @crandmck


Module support

Great library would be nice to have a module available.
So you can also use it without bundlers. Like so:
<script type="importmap">
  {
    "imports": {
      "tweakpane"<EMAIL_ADDRESS>    }
  }
</script>

Thank you for using Tweakpane, and it's duplicated with #209.


Little-endian hex view

It would be nice if this could be a small subsection view.  So the workflow would be: select a block of hex, then right click "view as" -> "8 byte-little endian"

This isn't something we're going to do any time soon :)


VerifyXML issue

In some situations after veryfing xml for equal signatures method can return false, but signatures are correct. I think that it depends on your xml response.
To fix this, i changed $xml->preserveWhiteSpace to false in verifyXml method. So my suggestion is to make an additional option for this method where we can choose value of $xml->preserveWhiteSpace option.

I think this would be a good feature, but the question is why does this happen? Who is signing the response? Another server? How does the xml looks like?

@odan Yes, another server is signing the response and i check it with my key. It reponse with different XML and with different data and i really dont know why these happens. Maybe, because response server written in C# with buggy and dirty code or it depends on content of response. It can be single case with content of my response server, who knows :)
It would be nice if this option can be added to these method for such cases

Ok we could add a boolean parameter to the verifyXml method, or we add a configuration array key to the constructor. Can you create a PR please?

This should be fixed in the next release.


switch to herokuish + docker hub

The original reason we started using "prebuilt" stack image of buildstep is because Docker Hub was slow and did not compress images. Now, however, it does. In some cases it can be even faster than downloading a tarball. So firstly, we should switch back to the model of a simple docker pull from Docker Hub.
Second, Buildstep has become a compatibility wrapper for Herokuish. But just the other day, I merged most of those compatibility bits into Herokuish. I also added a Dockerfile that is basically the same as Buildstep. As such, Herokuish can now be used instead of Buildstep.
I would recommend using Herokuish from Docker Hub now instead of Buildstep. This will do several things:

Get people submitting issues to Herokuish instead of Buildstep (super frustrating)
Eliminate the mostly useless and no doubt confusing middle project of Buildstep
Allow Buildstep to freely be refactored into Buildkit

The switch also means Dokku will more immediately and more easily take advantage of security patches to upstream base layers. Something I've been hearing more and more about recently.
Other benefits of Herokuish:

Herokuish is set up for better releases. Anybody can just submit a PR to release branch.
Herokuish is close to having fully automatic testing of newly released buildpacks.
Herokuish, among other things, is great for debugging Dokku pushes.

Later on, Dokku can come back to using what would then be Buildkit, which will orchestrate Herokuish builds (less code for Dokku), and support other builds via pluggable build strategies. For example, this would move Dockerfile building out of Dokku (even less code). But it would also open up more possibilities, such as what we're calling runtime images. Or other custom build strategies.
By the way "runtime images" are an exciting development providing new middleground between Dockerfile and buildpacks. They're lightweight prebuilt Docker images with ONBUILD hooks for a similar experience to Buildpacks except produces MUCH MUCH smaller images, while not being a fully custom Dockerfile. So they're as easy as Buildpacks (no special code, auto-detected, etc) with most benefits of Dockefile builds (Docker native, much more efficient).

Couple questions.
What is the official docker hub image path for herokuish? (gliderlabs/herokuish, ya?)
What would be the prescribed method to customizing what was the buildstep image?
For example, I build my own buildstep image with our custom list of apt packages installed and host it on s3. Then when we provision instances, we import using the s3 url. I suppose then we would have a custom herokuish image and import that into the correct namespace in the local docker daemon?

Yes, gliderlabs/herokuish:latest.
For now, I recommend keeping a variable in the Makefile but instead of pointing to an S3 URL, point to a Docker Hub image. I would then add logic that if a different variable is set, it would download a tarball, import as gliderlabs/herokuish:latest and go from there.
Ultimately, buildkit will provide a better way to do configure custom builds and base images, etc.

Ping in here in light of https://github.com/gliderlabs/herokuish
I will create a PR later on. Also wondering if it is possible to simply create a config file/variable for Dokku where we specify the image name? (It would make it more easy to also allow for custom herokuish versions more easily).
Renaming/Retagging images in docker has been cumbersome and for some odd reason sometimes docker mixes tags up, when the original image was pulled and then removed...

There is a variable in the Makefile for how to get the image (which would be abandoned), but a variable for where it's used later could be reasonable. I still think if you want to use your own, you should just do it via image retagging.

It would be great to support either a docker hub image and/or the docker import style we do now. Less disruptive perhaps? I know I use the import feature in my productions stacks.

Yeah I think that is what I was originally thinking

I am a bit confused here - should dokku check if the correct image is already installed and if not just issue a pull command (I think docker does this automatically anyway?)
So what needs to be changed are the deb files and the Makefile itself.
@michaelshobbs  how do you propose to change the makefile to support both?

@patrickjahns see #1128
wasn't sure if this was going to work so I just did it. :smile:

@progrium whats the release process for herokuish?

@michaelshobbs
that was really fast
Dropping the build for deb package is useful - just wonder now if we should issue a pull request for download herokuish automatically after install, or let the user do it. I can imagine that people will complain when they first deploy, that it takes for ever since docker will fetch the image first

yeah i think we should probably continue to package it up to save that install time. just need @progrium to tag builds in docker hub :wink:

i'll let @josegonzalez chime in on this as he did the deb work.

Can we create a deb file that basically just issues the command docker pull gliderlabs/herokuish ?
For the Makefile it shouldn`t be a problem to include right?
Also I am wondering if we force the user to pull the container on install. (What about users wanting to use their custom build? Then the deb/Makefile would download the image and the user needs to remove it again - wasted bandwith and time I believe)

We can, it would just be nice to pin to a version for debugging purposes.
If users want a custom build, then they can wade through extra work. I'd rather the defaults work great and advanced installs be more effort than the other way around.

@josegonzalez :+1:

was just revisiting this and realized that the original thought was to refactor buildstep (buildkit?) to be a lightweight wrapper around herokuish. is that right @progrium? #1128 cuts out buildstep completely. not sure that's what we really want. can someone confirm?

In the short term we can cut out buildstep entirely and that will allow it
to make its metamorphosis. It won't wrap herokuish, it will coordinate the
build. It's like a step before herokuish where it might decide to do a
docker build (which dokku does now itself), or do a runtime image build, or
something else.
On Fri, Jun 12, 2015 at 5:59 PM, Michael Hobbs<EMAIL_ADDRESS>wrote:

was just revisiting this and realized that the original thought was to
refactor buildstep (buildkit?) to be a lightweight wrapper around
herokuish. is that right @progrium https://github.com/progrium? #1128
https://github.com/progrium/dokku/pull/1128 cuts out buildstep
completely. not sure that's what we really want. can someone confirm?
—
Reply to this email directly or view it on GitHub
https://github.com/progrium/dokku/issues/1091#issuecomment-111636671.

--
Jeff Lindsay
http://progrium.com

cool. thanks for clarifying.

Closing as there is a pr open for this #1128.


Add a way to download logs to file system

[NOW READY FOR REVIEW]

PR enables user to save container logs to file system

[on save]

Closes issue #2645

@FrenchBen I've pushed the requested changes, thanks :)


[dv, alert_handler] Low FSM coverage in esc_timer and ping_timer

We are missing transitions to the error state from most states in the esc_timer and ping_timer FSMs.
This occurs as the testing for standardized countermeasures runs with a sequence that isn't stimulating the use of these state machines. Further more the state machines are likely to spend far more time in one or two states vs all the others so with purely random stimulus of countermeasures that would trigger a transition to the error state it will be rare to hit the missing transitions.
Two things are required to address this:

Run stimulus of the countermeasures that bring these state machines into the error state during stimulus where the state machines are being excised
Add functionality to the standardized countermeasures testing to enable triggering at specific points. The test bench can probe the state machines and trigger the countermeasures when it sees specific states rather than purely random triggering to ensure we hit the missing transitions.

This is related to: https://github.com/lowRISC/opentitan/issues/16572

@cindychip @tjaychen any thoughts?

Hey Greg,
Thanks for filing the issue. I think for any non-idle to Error state, since the error is created by standard countermeasure, we have FPV testbench to verify it will always trigger fatal alert.
I think it is safe to exclude non-idle to Error state for V2S. Do you have any concerns?

Actually I think the exclusion file already excluded it: https://github.com/lowRISC/opentitan/blob/master/hw/ip_templates/alert_handler/dv/cov/alert_handler_cov_excl.el
But maybe there are some RTL change that the checksum does not match anymore.
I can update that exclusion file.

I believe the coverage reached 100% with waivers. Please feel free to re-open it if you have any concerns.


[Feature][SeaTunnel Engine] Add test to test stream job recover when all cluster node done and restart

Search before asking

[X] I had searched in the feature and found no similar feature requirement.

Description
Add a test to do this:

3 node cluster start and then submit a stream job (Fake Source -> LocalFile Sink, and Fake Source will write 6000 rows. You can reference https://github.com/apache/incubator-seatunnel/blob/dev/seatunnel-e2e/seatunnel-engine-e2e/connector-seatunnel-e2e-base/src/test/java/org/apache/seatunnel/engine/e2e/ClusterFaultToleranceIT.java)
Stop all nodes when there are some rows write into the local files.
Start all nodes.
Check the job status will recover to Running.
Wait and check the local files will have all the row write from Fake Source and the number of the rows are 6000.
Cannel the job and wait the job's status turn to CANCELED.
Stop the cluster client.
Stop all cluster nodes.

Usage Scenario
No response
Related issues
No response
Are you willing to submit a PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

I want to try this task, it will help me understand engine better. Please assign it to me,thanks.


METRON-1165 [FEATURE-BRANCH] Add ability for BundleSystem to add bundles after initialization

As part of supporting parser extensions and the bundle system hosted in other applications than storm, and specifically for hosting in the rest service, we need the ability to add new bundles to the system, preferably without requiring an application restart or reloading the entire system.
The use case:

Install a parser extension assembly from the extension ui
switch to the sensor ui
create new instance (+) and be able to use the parser(s) from the assembly you just installed.

This PR lays down the ground work for that capability, and will be integrated with the extension ui branch if or when taken to the Feature Branch.
In this PR I further refactor the original NIFI Nar concept of Initial Context, which is used in the BundleClassLoaders and the ExtensionManager.  I have moved the context to full classes, and moved their creation to those classes in a Builder implementation.
This allows the creation of multiple 'contexts' with different parameters and scopes.
I have also added the ability to merge one context into another.
Thus the idea is that:

these classes have their initial context from the full scan of the bundle system library directories.
adding a new bundle means on demand creation of a new context, for just that bundle
we merge the bundles to make the new content available

The addXXXX capability is limited availability ( it is  protected ).
It's only public facing exposure is through the BundleSystem class.
BundleSystem is the 'easy button', simplified interface to the bundles, and should be in most cases the only interface required.  Exposing it this way allows us to be sure that the ADD calls are only called in a context where we can do the type of locking we want to do.
Testing
This is a preparation PR.  The add functionality is not utilized outside the tests.
So this is a code review, no regressions check.

Build and Tests should run

Full Dev should start and have data in kibana ( no regression )

[x] Is there a JIRA ticket associated with this PR? If not one needs to be created at Metron Jira.

[x] Does your PR title start with METRON-XXXX where XXXX is the JIRA number you are trying to resolve? Pay particular attention to the hyphen "-" character.

[x] Has your PR been rebased against the latest commit within the target branch (typically master)?

[na] Have you included steps to reproduce the behavior or problem that is being changed or addressed?

[na] Have you included steps or a guide to how the change may be verified and tested manually?

[x] Have you ensured that the full suite of tests and checks have been executed in the root metron

[x] Have you written or updated unit tests and or integration tests to verify your changes?

[na] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?

[x] Have you verified the basic functionality of the build by building and running locally with Vagrant full-dev environment or the equivalent?

@mattf-horton

+1 by inspection, this looks very interesting


Add parameters file to interthreshold calib example

At last documentation is done. Userparams file is also submitted to the sphinx.

I removed part of description which is already in other example as suggested.


coordgenlibs: 2.0.0 -> 2.0.2

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/schrodinger/coordgenlibs/releases.
meta.description for coordgenlibs is: "Schrodinger-developed 2D Coordinate Generation"
meta.homepage for coordgenlibs is: ""
meta.changelog for coordgenlibs is: ""
Updates performed

Version update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS

The tests defined in passthru.tests, if any, passed

0 of 0 passed binary check by having a zero exit code.

0 of 0 passed binary check by having the new version present in output.

found 2.0.2 with grep in /nix/store/ibl6cbnilhgbv984hi2m7v88amrpyvhy-coordgenlibs-2.0.2

found 2.0.2 in filename of file in /nix/store/ibl6cbnilhgbv984hi2m7v88amrpyvhy-coordgenlibs-2.0.2

directory tree listing: https://gist.github.com/203ca7a55716f37e3353c00b4e16541e

du listing: https://gist.github.com/25c84a9706167afd74da1a61e7a24ae1

Rebuild report (if merged into master) (click to expand)

9 total rebuild path(s)

3 package rebuild(s)

3 x86_64-linux rebuild(s)
2 i686-linux rebuild(s)
2 x86_64-darwin rebuild(s)
2 aarch64-linux rebuild(s)

First fifty rebuilds by attrpath
coordgenlibs
python38Packages.rdkit
python39Packages.rdkit

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/ibl6cbnilhgbv984hi2m7v88amrpyvhy-coordgenlibs-2.0.2 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A coordgenlibs https://github.com/r-ryantm/nixpkgs/archive/0194b6a9d337e17e1664302d2ef8c0244a0c1790.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/ibl6cbnilhgbv984hi2m7v88amrpyvhy-coordgenlibs-2.0.2
ls -la /nix/store/ibl6cbnilhgbv984hi2m7v88amrpyvhy-coordgenlibs-2.0.2/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

3 packages built:

coordgenlibs
python38Packages.rdkit
python39Packages.rdkit

Maintainer pings
cc @rmcgibbo for testing.

Result of nixpkgs-review pr 118484 run on x86_64-linux 1

3 packages built:

coordgenlibs
python38Packages.rdkit
python39Packages.rdkit


some general ideas top of my head

hi 👋
For starters awesome work 🤩 and I am already in love with this extension 👏.
While playing around with it I have a looooot of ideas and I thought that instead of creating separate issues for each of those and making a mess in the issues list (sorry if I already did 😉🙏) I will create this one single issue with all of the ideas I currently have and you may decide on your own which are valuable and which totally are out of scope and make no sense at all 😅.

validate setup -  I was wondering if the extension could have a kind of valdiate devproxy setup VS Code command. So when executed it would check in the user preferable terminal (based on VSCode settings) if devproxy (for example devproxy --help) works and is recognizable. If no the extension could present a notify that your devproxy is not properly setup with a button that when clicked would check if user is on win or mac and what shell and would run the install script for the user like (Invoke-WebRequest https://aka.ms/devproxy/setup.ps1).Content | Invoke-Expression in the console. If yes the extension could also present a notify that you are ready to go. Depending on how far this extension would go if in future it would extend VS code with some UI this command may be 'attached' to any button, like in the extension welcome experience to a button like 'validate your devproxy setup'. To provide an example I would say this could be a similar feature like the viva toolkit validates if the user has correct dependencies installed to start doing SPFx development https://github.com/pnp/vscode-viva/wiki/5.1-Validate-and-set-up-a-local-workspace

samples/presets gallery - I was thinking that the extension could have a command like open samples gallery that would open a dedicated webview in the editor window presenting all the dev proxy samples/presets from the pnp repo https://github.com/pnp/proxy-samples. The user should be able to get quick details about each sample, go to github repo or download it locally to the current workspace with a single click all without leaving VS Code. nowadays it became a quite common feature, for example Teams Toolkit has it's samples gallery, or PnP PS extension or Viva Toolkit as well

add a quick action to run devproxy with a mock - add a editor action to the toolbar visible when someone has a mock json file opened in the editor. The action should allow to run the devproxy command in the console with the currently opened mock.

add a command to start devproxy - this is probably and overkill but I was wondering if it worth having VS Code commands that will start devprox with a specific setting. For example the extension could have a command like run devproxy and record. After running it the extension would ask the user additional questions like "provide file name for the summary report (default empty)" and after that VS Code could run the command devproxy --record --summary-file-path report.md in the user console

add an icon to the status bar that would indicate if the proxy is working or not - this might be tricky as I am not sure how to do that just now 😅 I would need to do a bit of research 😉.

Ok this is just some ideas I had, I have some other ideas as well but those base on a concept that the VS Code extension would have some UI 🤔. I hope this will be of any help
Cheers 👍
BTW before I will be the person that just adds a lot of feedback and then doesn't provide any help at all 😅 I am wondering if you consider to be open for contributions? I would love to help out

That's awesome, I would love help out. For example the sample gallery 🤩

Leave creating the issues to me 👍
I've got some things that I want to put in place so its easier for contributing, for example, e2e tests of the current functionality so we don't break things going forwards, branch policies and some automation for releases.

Sure, when you have some issue ready for 'others' be sure to ping me up 👍🙂


How to train using a single GPU？

Hello author, thank you for your excellent work.
Your code seems to be for multi-card distributed training. I only have one GPU. Could you please tell me where to change it for single-card training, so that it can be debugged with a single card.
Looking forward to your reply.

Thanks for your interest!
For training on a machine equipped with single GPU, please try to run the following command:
$ python -m torch.distributed.launch --nproc_per_node=1 train_vimeo90k.py --world_size 1 --model_name 'IFRNet' --epochs 300 --batch_size 6 --lr_start 1e-4 --lr_end 1e-5
You can increase batch size if your GPU memory is enough.


Project Check #5 Homework

[x] 4/21 Big Idea 3 with Games (0.92/1)

[x] 4/25 Data Analysis (0.95/1)

[x] 4/26 DevOps (0.9/1)

[x] 4/27 Data Structures (0.9/1)

[x] 4/28 Binary Lesson (0.935/1)

Total: 4.605/5

[ ] MCQ 2021 Practice Test

Extra Practice!


Caps word mode

QMK include a caps word mode in its implementation. It allows you to go into a shift-toggle layer, but only for the length of a word, and then automatically deactivate this layer so that only one word is capitalized.
We started taking about such a mode in the following issue:
https://github.com/rvaiya/keyd/issues/671
And here is the page pointing to the QMK documentation:
https://github.com/qmk/qmk_firmware/blob/master/docs/feature_caps_word.md
First, I want to note that using a regular shift modifier or enabling capslock are two different behaviors. I personally find that this feature is better when a proper capslock is used. As an example, when taking the AZERTY French keyboard layout, there is the number 2 key (in the number row) that is the accentuated é letter on normal tap, and the number 2 when shifted. However, when capslock is activated, it produces an uppercase É.
My current implementation of caps word mode in key is as follows.
[ids]
*

[main]
leftshift+rightshift = togglem(capslock, capslock)

[capslock]
capslock = togglem(capslock, capslock)
space = togglem(capslock, macro(capslock space))
enter = togglem(capslock, macro(capslock enter))
, = togglem(capslock, macro(capslock comma))
. = togglem(capslock, macro(capslock dot))

It poorly assumes that capslock is not active when keyd starts, and then tries to stay in sync with the state of capslock by activating or deactivating a layer named capslock using macros.
It is a bit hacky and maybe can be improved, especially if we could have a native capslock layer internally managed by keyd that would follow the state of capslock.
Also, this layer deactivates when enter, space, comma or dot is typed.

It poorly assumes that capslock is not active when  keyd  starts

This does not seem like an unreasonable assumption. Most of the time capslock will be off when keyd is started (on boot or after typing a lower case terminal command).

It is a bit hacky and maybe can be improved, especially if we could have a native  capslock  layer internally   managed by  keyd  that would follow the state of capslock.

Capslock itself is a stateful mechanism that the user has to keep track of in their mind. In the worst case the user can just toggle it themselves to ensure synchrony, so I do not think the initialization edge case warrants a dedicated feature.
Even if one wanted to do this, capslock state is a display server construct. There is no way to recover it in evdev. One could resort to hacks like scanning the capslock LED state (set by the display server), but then you are just tossing another fragile kludge onto the pile.

Even if one wanted to do this, capslock state is a display server construct. There is no way to recover it in evdev. One could resort to hacks like scanning the capslock LED state (set by the display server), but then you are just tossing another fragile kludge onto the pile.

This is unfortunate, but this makes sense. I will forget about trying to track the state of capslock then. It just means that "smart capslock" can hardly become a thing.
Apart from this, implementing caps word mode with shift can be done with the current implementation as follows (example that you gave me on another issue):
[main]
shift = oneshot(shift)

[shift]
shift = toggle(shift2)

[shift2:S]
space = togglem(shift2, space)
enter = togglem(shift2, enter)
, = togglem(shift2, comma)
capslock = togglem(shift2, esc)

I am not sure that there is other discussions to have about this, so I will close the issue. But this can be reopened if further comments are posted.


Discussion moved to https://github.com/yarnpkg/rfcs/pull/37

Discussion moved to https://github.com/yarnpkg/rfcs/pull/37
Originally posted by @CrabDude in https://github.com/yarnpkg/yarn/issues/2241#issuecomment-271366221

This does not seem related to security-txt? Closing.


Provide multicast isolation with in-container-netns iptables rules

Fixes #354.

I've only tested this cursorily; looking for initial feedback.

I have tested this manually - ready to merge IMO.

Can you look at this @rade? - it's ready to merge IMO - Martynas is busy with the netns stuff atm...


Create paying-for-things-and-getting-reimbursed.md

adds the policy for submitting and requesting reimbursement
this is the initial document and some things may change as updates are necessary.

@activus-d - please provide your review of this document.


Not working

At the moment it is doesn't work anymore.

Stopped working or a bug of some sort.
Did a reset and a few hours later it pops up with a "trial is over" warning when trying to download a link .
First time i've seen that warning in years :) .

It seems that I'm not the only one with this problem, it would be great if this gets updated to the new version.

Like the others, i have a pop up when i try to download a link, hope it'll be updated !

Worked for a long time. Not working since last 1/2 months.

my IDM version - idman636build7
what I have done ,

Ended all processes of a from task manager
Run IDM reset trial
Run IDM and trying to download something, error received(See Image)

Same problem :(

Same here

Same here

Have anyone tried uninstalling and reinstall the older version of IDM?

Have anyone tried uninstalling and reinstall the older version of IDM?

I tried uninstalling the current version and installing a much older version which used to work with Trial Reset tool. It didn't work.

So, Does anyone have any news ? Do we have to install a craked version now ?

For the moment, my experience is that it still work with just a slight
annoying message saying that the application had be install pass 30 days
without registration.
Still waiting for a better solution.
On Thu, 26 Mar 2020, 11:53 PM bsadiki<EMAIL_ADDRESS>wrote:

So, Does anyone have any news ? Do we have to install a craked version now
?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/J2TEAM/idm-trial-reset/issues/10#issuecomment-604544891,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AEM7YKHXQ3AHFEFQRD6RLVTRJOCBLANCNFSM4K7T6TQQ
.

Ad ơi cập nhật bản mới đi ạ, bản hiện tại bị báo lỗi Fake Seri rồi ạ.

By the meantime if someone is looking for a cracked IDM here's a website.
Things one should say after distributing a pirated software:-
IDM is one of the most actively developed consumer software. So if you have the money please buy it so the devs can continue their hard work.

Can someone please say with what version of IDM the problem started?
What was the last working version?
6.36build7 or earlier?

R.I.P
Time to beat someone to get money and buy the software.

Delete this registry key, IDM back to 30 days (Trial)
HKEY_USERS\S-1-5-21-563298657-3659230254-7856325069-1001_Classes\WOW6432Node\CLSID{07999AC3-058B-40BF-984F-69EB1E554CA7}
Note: 563298657-3659230254-7856325069 every desktop might be different but WOW6432Node\CLSID{07999AC3-058B-40BF-984F-69EB1E554CA7} same.

@JerryLokjianming mine reset to 17th April instead of 19th which is the date of where am I right now. But I assume it is working. Thanks

same this here, reset to 17th april well let's see how it goes in future

Delete this registry key, IDM back to 30 days (Trial)
HKEY_USERS\S-1-5-21-563298657-3659230254-7856325069-1001_Classes\WOW6432Node\CLSID{07999AC3-058B-40BF-984F-69EB1E554CA7}
Note: 563298657-3659230254-7856325069 every desktop might be different but WOW6432Node\CLSID{07999AC3-058B-40BF-984F-69EB1E554CA7} same.

Thanks, It worked :)

Delete this registry key, IDM back to 30 days (Trial)
HKEY_USERS\S-1-5-21-563298657-3659230254-7856325069-1001_Classes\WOW6432Node\CLSID{07999AC3-058B-40BF-984F-69EB1E554CA7}
Note: 563298657-3659230254-7856325069 every desktop might be different but WOW6432Node\CLSID{07999AC3-058B-40BF-984F-69EB1E554CA7} same.

Where can i find this though? been searching the IDM folder and cant find itf.

Delete this registry key, IDM back to 30 days (Trial)
HKEY_USERS\S-1-5-21-563298657-3659230254-7856325069-1001_Classes\WOW6432Node\CLSID{07999AC3-058B-40BF-984F-69EB1E554CA7}
Note: 563298657-3659230254-7856325069 every desktop might be different but WOW6432Node\CLSID{07999AC3-058B-40BF-984F-69EB1E554CA7} same.

Where can i find this though? been searching the IDM folder and cant find itf.

go to regedit you can open it via run(Win key + R) command regedit and then follow the procedure.

I think you can make a bat file that would do this reg trick ,i think it's basically what the idm trial reset program did.

Windows Registry Editor Version 5.00

[-HKEY_USERS\S-1-5-21-2211520745-1598683459-1142304586-1001_Classes\WOW6432Node\CLSID\{07999AC3-058B-40BF-984F-69EB1E554CA7}]

Put this inside a .reg file and it will delete the key when executed. 👍
You will have to adjust the path like @JerryLokjianming noted.

This solution only works until IDM is restarted or windows is shutdown or restarted. After exiting from IDM and starting it again, the key is generated again and it shows the same 'trial over' message. So, we need to always delete the key after booting into windows or starting IDM.

This solution only works until IDM is restarted or windows is shutdown or restarted. After exiting from IDM and starting it again, the key is generated again and it shows the same 'trial over' message. So, we need to always delete the key after booting into windows or starting IDM.

True, also noticed that  :/

Does anyone know any other solution? I am still getting the popup after deleting the key, and now older versions of IDM also do not work with trial-reset. Even after using the IDM crack I get fake serial key message.

This solution only works until IDM is restarted or windows is shutdown or restarted. After exiting from IDM and starting it again, the key is generated again and it shows the same 'trial over' message. So, we need to always delete the key after booting into windows or starting IDM.

I just tested closing and reopening IDM and it reset the date to 1st May. I don't understand how it generate them.

Delete this registry key, IDM back to 30 days (Trial)
HKEY_USERS\S-1-5-21-563298657-3659230254-7856325069-1001_Classes\WOW6432Node\CLSID{07999AC3-058B-40BF-984F-69EB1E554CA7}
Note: 563298657-3659230254-7856325069 every desktop might be different but WOW6432Node\CLSID{07999AC3-058B-40BF-984F-69EB1E554CA7} same.

tried this again for the month of june but it's still on may 1 and everytime i open IDM it says that my trial is expired and needs to be registered btu i can still download (the popups is just annoying)

Delete this registry key, IDM back to 30 days (Trial)
HKEY_USERS\S-1-5-21-563298657-3659230254-7856325069-1001_Classes\WOW6432Node\CLSID{07999AC3-058B-40BF-984F-69EB1E554CA7}
Note: 563298657-3659230254-7856325069 every desktop might be different but WOW6432Node\CLSID{07999AC3-058B-40BF-984F-69EB1E554CA7} same.

Regarding the NOTE case, we can just find {07999AC3-058B-40BF-984F-69EB1E554CA7} using ctrl+f in registry editor and it works like charm. Thanks @JerryLokjianming

anyway to get past the annoying popup of the trial is expired?

anyway to get past the annoying popup of the trial is expired?

Up for this! This is so annoying. lol

I moved to FreeDownloadManager and haven't been bothered with IDM anymore. IDM was really good but I couldn't stand the popup.

anyway to get past the annoying popup of the trial is expired?

Up for this! This is so annoying. lol

Hi,
I searched about this on reddit and got this https://github.com/Jackpison/IDM-reset/tree/master
someone is free to take a look at the bat script, but after trial running as admin, this really worked for me
it removed all the entries associated with the IDM

Can someone help me with the renaming of {07999AC3-058B-40BF-984F-69EB1E554CA7}? When I try to rename I only get access denied.
What I do is:
Kill idm
Regedit (run as admin)
I go to HKEY_USERS\S-1-5-21-1687372910-62262161-2096532949-1001_Classes\WOW6432Node\CLSID
When I click on {07999AC3-058B-40BF-984F-69EB1E554CA7} I get: "Error opening key, ... access denied"

no {07999AC3-058B-40BF-984F-69EB1E554CA7} found  -_-!!

@67697
Search in S-1-5-21-3527524185-1400937402-3629409251-1002**_Classes**
Not in S-1-5-21-3527524185-1400937402-3629409251-1002
In my case (IDM v6.38b8, fresh install), I have 2 rows
HKEY_USERS\S-1-5-21-230851035-4119400533-4267419590-1000\Software\Classes\Wow6432Node\CLSID{07999AC3-058B-40BF-984F-69EB1E554CA7}
HKEY_USERS\S-1-5-21-230851035-4119400533-4267419590-1000_Classes\Wow6432Node\CLSID{07999AC3-058B-40BF-984F-69EB1E554CA7}
The two paths have 2 Values :

Model, REG_DWORD
Therad, REG_DWORD

All data are the same.
I'm waiting for the warning...

@67697
Search in S-1-5-21-3527524185-1400937402-3629409251-1002**_Classes**
Not in S-1-5-21-3527524185-1400937402-3629409251-1002
In my case (IDM v6.38b8, fresh install), I have 2 rows
HKEY_USERS\S-1-5-21-230851035-4119400533-4267419590-1000\Software\Classes\Wow6432Node\CLSID{07999AC3-058B-40BF-984F-69EB1E554CA7}
HKEY_USERS\S-1-5-21-230851035-4119400533-4267419590-1000_Classes\Wow6432Node\CLSID{07999AC3-058B-40BF-984F-69EB1E554CA7}
The two paths have 2 Values :

Model, REG_DWORD
Therad, REG_DWORD

All data are the same.
I'm waiting for the warning...

finally i found it , i had renamed the key and waiting for ..

can use,but alwayspopup this dialog

can work , but always popup this dialog

it has a value that tells the program is running out of time "ROTFlags"
you can use this code to get rid of the popup message
`
Windows Registry Editor Version 5.00
[HKEY_CLASSES_ROOT\AppID{AC746233-E9D3-49CD-862F-068F7B7CCCA4}]
"ROTFlags"=-
`
copy and paste into the notepad and save the file as "anything.reg" run the file and accept the change notification.

There is a value in the registry that tells the program it is running out of time "ROTFlags"
you can use this code to get rid of the popup message
`Windows Registry Editor Version 5.00
[HKEY_CLASSES_ROOT\AppID{AC746233-E9D3-49CD-862F-068F7B7CCCA4}]
"ROTFlags"=-`
copy and paste into the notepad and save the file as "anything.reg" run the file and accept the change notification.

There is a value in the registry that tells the program it is running out of time "ROTFlags"
you can use this code to get rid of the popup message
Windows Registry Editor Version 5.00
[HKEY_CLASSES_ROOT\AppID\{AC746233-E9D3-49CD-862F-068F7B7CCCA4}]
"ROTFlags"=-

*copy and paste into the notepad and save the file as "anything.reg" run the file and accept the change notification.

There is a value in the registry that tells the program it is running out of time "ROTFlags"
you can use this code to get rid of the popup message
Windows Registry Editor Version 5.00
[HKEY_CLASSES_ROOT\AppID\{AC746233-E9D3-49CD-862F-068F7B7CCCA4}]
"ROTFlags"=-

*copy and paste into the notepad and save the file as "anything.reg" run the file and accept the change notification.

Why dont you register instead of resetting trial

@shockergit buy the product and register the key, is that what you mean?

I'm pretty sure he is referring to the second option within the trial reset software.
It's in between trial reset and help.

Fair enough. I have been using freedownloadmanagers for too long that I forgot how this trial reset works and looks like.

There is a value in the registry that tells the program it is running out of time "ROTFlags" you can use this code to get rid of the popup message
Windows Registry Editor Version 5.00
[HKEY_CLASSES_ROOT\AppID\{AC746233-E9D3-49CD-862F-068F7B7CCCA4}]
"ROTFlags"=-

*copy and paste into the notepad and save the file as "anything.reg" run the file and accept the change notification.

It does not work my friend, the only thing it does is to remove the ROTFlags key from that location, but IDM still shows the popup. Do you know any other way?

anyway to get past the annoying popup of the trial is expired?

Haven't found any solution? even with your IDM-reset app these annoying pop-ups still appear

anyway to get past the annoying popup of the trial is expired?

Haven't found any solution? even with your IDM-reset app these annoying pop-ups still appear

Try my newer tool and report bug please
https://github.com/Qynklee/IDM-Reset-Tool


chore(package): update pkg

Hey @zuohuadong,
Something went wrong with the build.
TravisCI finished with status errored, which means the build failed because of something unrelated to the tests, such as a problem with a dependency or the build process itself.
View build log
TravisBuddy Request Identifier: 95b8b1d0-7727-11e9-baaa-abbb666ca5a5


Rise and Fall support question

The first issue is there is no thread in Civ6 - Released Mods to discuss this mod hence this issue.
Once Rise and Fall drops in a couple weeks, will there be two flavors of this Mod?
If not who wins/loses?
I don't even want to buy/install the new enhancement until CQUI is ready to support it.
I also don't want to lose support for the base game during the time in between release and support.
Have their been any discussions on this I may have missed?

The patch came out yesterday and I see a few bugs have been opened, have any modders had a chance to look at the changes to get a feel for the size/scope of the fixes needed for the base game?
Will the base game be repaired first or skipped in favor of supporting the expansion? Would there be a fork for the expansion in the first case?

see #283


BUG: when used the base.py function,  an error message had reported with "Adding a nonzero scalar to a sparse matrix is not supported"

Describe your issue.
I tried to follow the example of  "Palantir analysis notebook", and an error message was reported with “palantir.preprocess.log_transform ” function, and the reason pointed to the function base.py in scipy.
Reproducing Code Example
import palantir
import scanpy as sc
import numpy as np
import pandas as pd
import os

# Plotting
import matplotlib
import matplotlib.pyplot as plt
import seaborn as sns
import warnings

# Inline plotting
%matplotlib inline

sns.set_style('ticks')
matplotlib.rcParams['figure.figsize'] = [4, 4]
matplotlib.rcParams['figure.dpi'] = 100
matplotlib.rcParams['image.cmap'] = 'Spectral_r'
warnings.filterwarnings(action="ignore", module="matplotlib", message="findfont")

# Reset random seed
np.random.seed(5)
# Load sample data
palantir_dir = os.path.expanduser('data/')
ad = sc.read(palantir_dir + 'marrow_sample_scseq_counts.h5ad')
ad
sc.pp.normalize_per_cell(ad)
palantir.preprocess.log_transform(ad)

Error message
---------------------------------------------------------------------------
NotImplementedError                       Traceback (most recent call last)
Input In [12], in <cell line: 1>()
----> 1 palantir.preprocess.log_transform(ad)

File C:\ProgramData\Anaconda3\envs\r-reticulate\lib\site-packages\palantir\preprocess.py:43, in log_transform(data, pseudo_count)
     37 """Log transform the matrix
     38
     39 :param data: Counts matrix: Cells x Genes
     40 :return: Log transformed matrix
     41 """
     42 if type(data) is sc.AnnData:
---> 43     data.X = np.log2(data.X + pseudo_count) - np.log2(pseudo_count)
     44 else:
     45     return np.log2(data + pseudo_count)

File C:\ProgramData\Anaconda3\envs\r-reticulate\lib\site-packages\scipy\sparse\base.py:410, in spmatrix.__add__(self, other)
    408         return self.copy()
    409     # Now we would add this scalar to every element.
--> 410     raise NotImplementedError('adding a nonzero scalar to a '
    411                               'sparse matrix is not supported')
    412 elif isspmatrix(other):
    413     if other.shape != self.shape:

NotImplementedError: adding a nonzero scalar to a sparse matrix is not supported

SciPy/NumPy/Python version information
1.7.3 1.22.3 sys.version_info(major=3, minor=9, micro=12, releaselevel='final', serial=0)

This is a palantir bug. It seems data.X is a sparse matrix, then indeed adding a scalar to produces a matrix that is non-sparse. And calling np.log2 on it is also wrong.
This is not a scipy issue and should be closed.

OK， thank you very much,  and I would communicate with the maintainers of palantir, and get some help for this.


[requires #399] Create new Audit Inventory view

[ ] Create new controller action new_audit in AdjustmentsController
[ ] Redirect to new unless feature flag enabled.
[ ] Create new view index-FLAGNAME.html.erb

Originally broke off this Issue because it looked like we would need multiple Issues to resolve https://github.com/rubyforgood/diaper/issues/266.  No longer seems the case; move back to #266 as the sole Issue.


[6.0][Distributed] Fix availability of DAS requirements and always emit into client whenLocal with typed throws

Description: We changed how we deal with the "ad hoc requirements" by making them real requirements in the distributed actor system - one of them had a missing availability, which we missed because it does not explicitly depend on SerializationRequirement but it was an adhoc requirement before. And also fixing that a new function adopting typed throws MUST be always-emit-into-client.
Scope/Impact: Adopters of DistributedActorSystem are unable to use it in Beta 1 entirely.
Risk: Low, brings API which did not ship in stable release as AEIC which it should have been. And fixes availability of requirement.
Testing: CI testing; I have confirmed that a library with this change results in correct execution - sample below.
Reviewed by: @DougGregor
Original PR: https://github.com/apple/swift/pull/74324
Radar: rdar://129651474 https://github.com/apple/swift/issues/74291

@swift-ci please test

Meh
The following tests FAILED:
2012 - TestFoundation.TestURLSession-test_asyncDataFromURLWithDelegate (Failed)

@swift-ci please test Linux

As far as I can tell this fixes the issue:
without fix:
-> % /Users/ktoso/Library/Developer/Xcode/DerivedData/MyExecutable-ffifiwutqqbtfdcsjbehrxuuilrg/Build/Products/Debug/MyExecutable

💣 Program crashed: Bad pointer dereference at 0x0000000000000004

Thread 1 crashed:

0 DumbDistributedActor.sayHello() + 84 in MyExecutable at /tmp/MyExecutable/Sources/main.swift:9:16

     7│
     8│   distributed func sayHello() async throws -> String? {
     9│     await self.whenLocal { _ in
      │                ▲
    10│       return "Hello, world!"
    11│     }

with fix:
DYLD_LIBRARY_PATH=/Users/ktoso/code/swift-project/build/Ninja-RelWithDebInfoAssert/swift-macosx-arm64/lib/swift/macosx /Users/ktoso/Library/Developer/Xcode/DerivedData/MyExecutable-ffifiwutqqbtfdcsjbehrxuuilrg/Build/Products/Debug/MyExecutable
reply = Optional("Hello, world!")

@swift-ci please build toolchain macOS

@swift-ci please build toolchain macOS

We verified this with @xedin to make sure, we're confident in the fix.


widget.TableView: does not extend into actualContentWidth / actualContentHeight of "lettebox"

Hi,
This seems to be a recent regression, which I noticed after transitioning to Build: 2021.3661:
I use a content view in "letterbox" mode, and wish to use widget.TableView into the full device screen area (actualContentWidth  /actualContentHeight).
However, TableView currently seems to crop the table's contents to the internal content area, preventing me from using the full screen.
I've created and attached a sample program (config.lua, main.lua, and build.settings) that isolates and demonstrates the problem:

in Portrait view, the rows above and below the actual content area don't get created.
in Landscape view, the table rows won't expand to the full actualContentWidth (example: table.width > 2000, but row.width remains cropped to 1000, internal content width).

Sample program files: TableDefectTest.zip
I think this sample program makes the issue obvious, but let me know if you have any questions.
I've previously been using build 2021.3657(?), which did not seem to present this issue.

This works fine
local tabView = widget.newTableView(     {         left = display.safeScreenOriginX,         top = display.safeScreenOriginY,         width = display.safeActualContentWidth,         height = display.safeActualContentHeight,         onRowRender = onRowRender,     } )

Have you configured the content as "letterbox" ?
The small sample program I shared shows the issue in an obvious way:
Portrait mode screen (Galaxy S21):

TableView dimensions(x,y,width,height):	500	500	1000	2222.2221679688
But the table is rendered only in the central square:

And in Landscape mode (Galaxy S21):

TableView dimensions(x,y,width,height):	500	500	2222.2221679688	1000
But the table is rendered only in the central square:

In "letterbox" mode, the outside areas are disregarded, even if the table size is set to be larger...

I have the same problem on Xiaomi Redmi Note 9.

For anyone having this issue, it seems to be related to the so-called "immersive sticky mode". Thanks to XeduR, there is a solution for it: https://forums.solar2d.com/t/letterbox-shows-black-bars-left-and-right/354309

Hi cmatzka,
See the Landscape mode image above - with large “black” bars on both sides of the central table area.
I don’t think that this is caused by the “immersiveSticky” issue - which would be a small-scale issue at the top/bottom of the screen (shouldn't be larger that the size of the status bar / buttons bar).
The large black areas rather indicate that there is a confusion between display.contentWidth and display.actualContentWidth within the implementation of widget.table !
Unfortunately I'm new to Solar2D and don't even know how to access/edit the code of widget.table - a search for display.contentWidth (or related) would probably allow to locate the culprit.
Also, this regression appears to have recently been introduced: I didn't notice the issue when I first used widget.Table (not sure what build it was, but I had downloaded Solar2D in early october 2021).

Hi @ivec, you are right. Sorry for the confusion... I completely overlooked that the issue here is about widget.TableView. So the issue is most probably not related to the immersiveSticky issue.

@ivec You can find the source code for the tableView widget in here.
I took a quick look at your project, specifically your config.lua, and I presume that your issue is with not understanding how Solar2D config area works. This doesn't seem like an issue with the widget. You've defined the content area to be a square, which may lead to odd behaviour.

For these kind of issues, you should refer to Solar2D forums or Discord for support.

Hi XeduR,
I've tried also with a "classic" area (480x320 default from new projects) and the same problem arises.
I'll take note and try to post this in Forums...

I took a quick look at this over Christmas break, and I just ran the following code in main.lua:
Your problem seems to be solely with not defining the size at the start when you call widget.newTableView.
If you were to insert the following code in your sample project, it should start working:
tabView = widget.newTableView(
    {
        left = display.screenOriginX,
        top = display.screenOriginY,
        width = display.actualContentWidth,
        height = display.actualContentHeight,
        onRowRender = onRowRender,
        backgroundColor={0.2,0.2,0.2},
        onRowRender=onRowRender,
        onRowTouch=onRowTouch,
        listener=onTableScroll
    }
)

If you do not define the width or height for your table view, then they will default to something. In this case, they default to display.contentWidth and display.contentHeight.
Just define said properties when creating the table view and it'll work as expected. Also, as I mentioned before (just repeating for others), these kind of issues really belong to the forums or Discord.

Thank you XeduR.
I ended up converting to widget.newScrollView for a mix of reasons. There I noticed the Gotcha:

The ScrollViewWidget widget does not support scaling nor changing the width/height via .width or .height.
While the newTableView documentation only states:
The TableViewWidget object does not support scaling.
Based on your observation, it might be that the limitation of about width/height change should apply to TableView as well?

If I click "Report an Issue" on the documentation page, it sends me again to the GitHub issue tracker... but is that the right place?
Happy 2022, and thank you for kindly lookin into my report. -ivec

If I click "Report an Issue" on the documentation page, it sends me again to the GitHub issue tracker... but is that the right place?

It may not be the best UX design but if you read the text just above it, you should see that the button is there to report issues about the documentation.

Help us help you! If you notice a problem with this page, please report it.

Maybe another link to the forums would be a good addition.


Missing relationships when using Base

Hi,
I'm noticing an issue where when I provide a Base the rendered PNG does not map the ForeignKey relationships.
As an example, I have a Facebook table declared with a campaign_id column like so:
...
    campaign_id = sa.Column(
        sa.BigInteger(),
        sa.ForeignKey(
            "facebook.campaigns.id",
            name="campaign_hourly_stats_campaign_id_fkey",
        ),
    )
...

However the rendered ERD doesn't recognize this relationship:

Any idea on why this might be?

So the underlying issue is this line--basically the schema name is missing for the left_col property which causes all the relationships to be stripped during processing. It's easy enough to add this, but I'm not sure how that might break other schema.

I could make it work using #70 - thanks @psipika!
Any progress in merging this PR?

This should now be possible using $ eralchemy -i 'postgresql+psycopg2://username:password@hostname:5432/databasename' -s "public, facebook"
fixed in 9fbd13a767e828f372e23dbf5a15091df8bf0d42


glim_rosnode: symbol lookup error: /usr/local/lib/libgtsam_points.so: undefined symbol: _ZNK5gtsam15NonlinearFactor5rekeyERKSt6vectorImSaImEE  [ros2run]: Process exited with failure 127

Describe the bug
Undefined symbol error while executing different glim_rosnode, glim_rosbag etc
To Reproduce
Steps to reproduce the behavior:
ros2 run glim_ros glim_rosnode
Expected behavior
Following error occurs every time:
/opt/ros/humble/lib/glim_ros/glim_rosnode: symbol lookup error: /usr/local/lib/libgtsam_points.so: undefined symbol: _ZNK5gtsam15NonlinearFactor5rekeyERKSt6vectorImSaImEE  [ros2run]: Process exited with failure 127
Environment (please complete the following information):
I am using ubuntu 22.04 on virtualbox

ROS: ROS2 humble
Build with CUDA: OFF

This error is sometimes caused by previously installed GTSAM with a wrong version. Please check and try this https://github.com/koide3/glim/issues/91#issuecomment-2408989503