CONCURRENCY_PAGE hangs and timeouts

Running the below code would result in TimeoutError: Navigation timeout of 30000 ms exceeded.
const { Cluster } = require('puppeteer-cluster');

(async () => {
  const cluster = await Cluster.launch({
    concurrency: Cluster.CONCURRENCY_PAGE,  // Changing to CONCURRENCY_CONTEXT won't timeout
    maxConcurrency: 4,
  });

  const load = ({ page, data }) => page.goto(data.url);

  const results = await Promise.all([
    cluster.execute({ url: 'https://www.massagewarehouse.com' }, load),
    cluster.execute({ url: 'https://www.massagewarehouse.com/checkout/cart' }, load),
    cluster.execute({ url: 'https://www.massagewarehouse.com/shop-by-department/ppe' }, load),
    cluster.execute({ url: 'https://www.massagewarehouse.com/catalogsearch/advanced' }, load),
    cluster.execute({ url: 'https://www.massagewarehouse.com/customer/account/create' }, load),
    cluster.execute({ url: 'https://www.massagewarehouse.com/shop-by-department/aromatherapy' }, load),
    cluster.execute({ url: 'https://www.massagewarehouse.com/massage-warehouse-shipping-offer' }, load),
    cluster.execute({ url: 'https://www.massagewarehouse.com/shop-by-department/massage-equipment' }, load),
  ]);

  // DO something with the results...

  await cluster.idle();
  await cluster.close();
})();

Where as if concurrency is changed to CONCURRENCY_CONTEXT or CONCURRENCY_BROWSER it won't timeout. The  CONCURRENCY_PAGE opens tabs in a single browser instance and should take up less resources when compared to the other two options where they spin up multiple browser instances. But, here the CONCURRENCY_PAGE is timing out and the all the CPU cores utilizations is hitting 100% (the spike).

Platform:

MacBook Pro (16-inch, 2019)
2.4 GHz Intel Core i9  (8-Core)
Memory - 32 GB DDR4

Closing this as the issue is not with puppeteer-cluster but puppeteer itself. Raised https://github.com/puppeteer/puppeteer/issues/8693


Add missing environment variables on Perlmutter and Chicoma

From @jonbob:
      <env name="FI_CXI_RX_MATCH_MODE">software</env>
      <env name="MPICH_COLL_SYNC">MPI_Bcast</env>

These have been added


Note that this is not as straightforward as it might sound! Some notes:

It is not clear if this issue still persists or if it only happened in previous versions of pash.
The biggest issue with hanging processes is not the daemon and the main pash process, but rather the parallel scripts that contain eagers etc. Therefore, our solution should modify (or use) this https://github.com/binpash/pash/blob/main/runtime/wait_for_output_and_sigpipe_rest.sh or be a trap handler in the output parallel script. For both of those, we should make sure to check for the performance overhead.
Our solution should kill all processes of the dataflow graph and wait for them.
Our solution should only kill processes that are descendants of the current shell (and no more).

Also, this change should not go to main but to future since it is an experimental change.


Extreme Latency when Using Google Cloud Functions and Cloud Datastore

Environment details

OS: Google Cloud Functions
Region: US Central
google-cloud-node version: 1.0.2

Steps to reproduce
I experience high latency (~1 to 2 seconds) with pretty much every action.
Simple example  (runs through bable prior to deploy) -
static async addPerson() {
    try {
      const datastore = Datastore({
        projectId: projectId
      });
      const key = datastore.key('person');
      const person = {
        key: key,
        data:
          [
            { name: 'last_name', value: 'Wright' },
			{ name: 'last_name_UPPER', value: 'WRIGHT' },
            { name: 'first_name', value: 'Richard' },
			{ name: 'first_name_UPPER', value: 'RICHARD' },
			{ name: 'email', value<EMAIL_ADDRESS>},
            { name: 'address_street', value: 'My Place', excludeFromIndexes: true },
            { name: 'address_city', value: 'City' },
            { name: 'address_state', value: 'State' },
            { name: 'address_zip', value: '12345' },
            { name: 'phone', value: '123.456.7890' },
            { name: 'date_of_birth', value: new Date(1901, 02, 03)},
            { name: 'create_time', value: new Date(Date.now()), excludeFromIndexes: true }
          ]
      };

      let saveResponse = await datastore.save(person);

      let person_id=saveResponse[0].mutationResults[0].key.path[0].id;
      return person_id;
    } catch (err) {
      console.log(err);
      return;
    }
  }

Can you see if subsequent calls also have a lag? The first request has to sort out the authentication details, so it's known to be slower.

If I call the datastore API within the same function call, I do see a reduction in subsequent call time -
db_add_person: 1409.076ms
5668753656250368
db_add_person: 363.180ms
5645784439586816
db_add_person: 235.747ms
5637489247125504

I've also discovered that using a key file (i.e. creating a service account and specifying keyFilename) decreases the first call time from ~1.4 seconds to 0.85 s.
However, I'm still at about 0.8s per HTTP call which is still quite high.

since when using cloud functions, the penalty is incurred on each http invocation the overhead is still very high (i.e. 0.8s per HTTP call).

Yes, unfortunately. I'll close the issue, as we can't do anything within the client library. If any ideas come to mind for how this can be addressed, feel free to discuss.

@stephenplusplus - We are running into the same issue. Datastore and Functions seem like the perfect combination, paying only a per-request cost. However the latency is much too high to be usable in real-world.
As was mentioned, it is related to the Auth.
This problem must be solvable, as other similar systems such as Lambda + DynamoDB don't under into this issue.
It seems unlikely to be implemented in node, but probably some setup on the function/lambda that is 'pre-authenticated' (AWS IAM roles?).
Who would be the correct team/repo to work on this issue?

@ro-savage we were/are using app engine with datastore. we also did run in to big issues with the latency of the datastore. would love to hear some updates @google-admin about this issue.

A few weeks into development, we're finding Datastore to not be a viable solution for use in Functions due to the consistently poor performance on even very simple queries. 4000ms on first (authenticating request), and then 800-1200ms afterwards.

Also hitting this problem, with the Google Translate API.  Consistently ca 800ms.
There must be a way to fix this, at least on subsequent requests, given that auth can be based on the project id, it's all internal to a single Google datacentre and so on.

We are also experiencing 60ms-200ms latencies on a lookup by key (runQuery is even worse) from GAE Flexible in node.

Also reported in #2727
@lukesneeringer this seems to be a common problem. The most recent report shows 10 seconds spent on a query that should take in the tens of milliseconds. Worth considering, our Datastore API uses the REST endpoint. There is a GAPIC layer that we will likely convert to during our repo extraction.

Thank you @stephenplusplus. I can confirm I'm having this issue with the following environment:

OS: macOS Sierra
Node.js version: 7.10.0
npm version: 4.2.0
google-cloud/datastore version: 1.1.0

Additionally, I'm noticing the issue on Cloud Functions with the same node and NPM versions.

If this is something that is fixed by switching to the gRPC transport we use elsewhere, then this should be a reasonably (~week or so) quick fix.

We also have the same high latency issues mentioned by @ahume with CloudFunctions and Datastore

I guess if you convert to gRPC then the Datastore comms will start having this problem like Spanner and PubSub #2438

I get a significant reduction in latency in calls from CloudFunctions to Datastore by embedding a service account. For warm functions latency was previously several seconds (mostly around 2-3 seconds) and are now mostly 1 second with the occasional 2 seconds. These calls are a mixture of CRUD operations.
FYI I am using AppEngine cron to trigger a job every minute to hit all functions several times in order to keep them warm.
We have around 60 functions in all. Every function has a health mode where it immediately returns instead of calling Datastore and the latency of the functions when operating in this mode are around 200-400ms with the occasional 500-600ms.
Old code (without the 'at' prefix):
client = { datastore: require('google-cloud/datastore')() }
New code (without the 'at' prefix):
require('google-cloud/datastore')({ credentials: service_account })
The service account is encrypted with GCP KMS so I must load it and cache it prior to the function running so basically wrapping the entry point in a promise.

Does anyone know what the expected latency of Datastore is? We are considering moving to Go and AppEngine (which we used before with AWS and DynamoDB) or will that have the same issues? Would it be better for us to look at using CloudSQL if we want low latency?

Today I deployed our code to app engine flex using the same node.js version used by gcp functions. In both cases (same code) auth is an embedded service account decrypted (and cached) using GCP KMS.
Pings average around 250ms compared to 350ms in functions. However the latency is more erratic from functions with a % falling into the 500-1000ms window. So basically functions are only slightly slower but more erratic.
Reads from Datastore ape the pings results but erratic latency tends to be magnified. Data is attached.
perf-appengine.txt
perf-fn.txt

Just at side note to maintainers / google. We raised this issue in a few places including in person at Google Sydney and pretty much were told there is no solution and no eta.
We ended up leaving google cloud and moving to AWS. Not only was it must faster but it costs significantly less because all our functions run in under 100ms on AWS with Dynamo compared to multiple hundreds (sometimes 1-2s) with Google Cloud.
This issue is one of the things that kills the ability for people to use Cloud Functions and Datastore together on a production app.

Thanks @ro-savage I was coming to the same conclusion. To be fair Datastore and DynamoDB are not drop-in replacements because Datastore has transactions which are occasionally very useful and help keep the code clean because you do not need to cope with in-consistent data where that can happen. DynamoDB is very very fast and has proper support for updating documents unlike Datastore where an update replaces the entire entity. I have used both extensively and would prefer Datastore if it were faster. Lambda is of course far ahead of functions which is unsurprising given that functions is beta. AWS support is incredible, I get AWS engineers phoning me to ask how they can help out.

Just did the same tests but using App Engine Flex with Go 1.9.2 instead of Node.js (App Engine Flex and Functions) and latency for pings average around 250ms and reads 390ms. Both the pings and the read latency are much less erratic compared to Node.js (App Engine Flex and Functions). We are the other side of the world from the infra (but still on fiber) so it's the delta between the ping and read that is important not the absolute number.  FYI it is easy to support both Functions and Node.js App Engine Flex.
Data is attached.
[
perf-appengine-go.txt
](url)

I'm marking this as blocked as there are 2 places I can see that could be responsible:

Cloud Functions. Something in the environment doesn't interact quickly with something in the callstack. I would guess the auth layer (google-auth-library) or the transport layer (grpc).
Our library needs to use the GAPIC API. Currently, our library communicates with Datastore through the transport layer, gRPC, directly. gRPC exposes many knobs for configuration, but we are using the defaults that it provides. The GAPIC API stands between us and gRPC and changes some of those settings.

We are almost switched over to the GAPIC API. We are working on the final steps of splitting the Datastore code out from this repo and into its own. After that, it would be great if anyone with patience remaining could test it out for us.
If it doesn't have any effect, we will need to make sure this feedback gets noticed by the Cloud Functions team and we start a proper search for the problem.

Happy to test when you're ready

Thanks. A few things I've found that might be relevant findings to help diagnose -

the first call from within the same function execution is slow; if I save multiple times in the same execution/call of/to the function, the time drops
using a key file (i.e. creating a service account and specifying keyFilename) decreases the first call time from ~1.4 seconds to 0.85 s.
increasing the memory usage of the cloud function has a significant impact on timing

We use --memory=1024MB in order to get a faster machine (as recommended in the docs). We  haven't tired any higher memory settings.
We see similar behaviour to @richardowright and its important to note that the mean latency is not the only problem; some requests can still take multiple seconds even when auth is hardcoded to give a lower mean latency. Similar behaviour is seen in App Engine Flex with Node.js i.e. some requests take > 1 sec even though the mean for reads is lower ~ 600ms.

I just did the same test against DynamoDB using a 1024MB Lambda behind API Gateway using Go and eawsy's aws-lambda-go-shim and the latency was ~490ms and pretty stable. This is all very rough and ready but seems there is no big difference between Go/AppEngine/Datastore compared to Go/API Gateway/Lambda/DynamoDB and so once Cloud Functions gets Go support I will be happy :)
perf-lambda-go.txt

This issue was moved to https://github.com/googleapis/nodejs-datastore/issues/9.

So far I have ~500ms latency for a simple API endpoint. Do you have a suggestion how to trace it and find the cause of the issue?
https://firebase.reactstarter.com online demo + source code

Can someone confirm whether or not using gRPC makes a notable difference?

@karlbateman I'm seeing significant improvements with the latest version. For the function above which was taking ~800ms per call, I know see call times around 150 ms.

@koistya I'd post or look through https://stackoverflow.com/questions/tagged/google-cloud-functions. I took a quick look through the code, and it seems unrelated to cloud datastore.


Adding ability to redefine cache timeout

Stack from ghstack (oldest at bottom):

-> #571

@parmeet can you please review this code (@ejguan and @NivekT are on PTO)

IMO DLv2 should apply adapter modifications once on the local copy of the graph it gets from the args.

@VitalyFedyunin has imported this pull request.  If you are a Facebook employee, you can view this diff on Phabricator.

@VitalyFedyunin has imported this pull request.  If you are a Facebook employee, you can view this diff on Phabricator.

LGTM! Thanks @VitalyFedyunin for adding the ability to manually set time for caching files. Just to be sure, the users can add this adapter on top of datapipe we return for datasets, in other words, we do not have to add this adapter internally in the dataset implementation right?

Correct


Revert version templating

This is wreaking havoc on the CRuby setup. Going to revert until I have more time to look at it.

What's the issue?

When we mirror into CRuby, all of the files are in different places, and the order that things are built is dependent on their build system. When I merged this everything broke, and it was really difficult to fix. I think if we want to rebuild this, it'll need to be inside CRuby and then reverse-sync it back into YARP.

I can imagine the path from gemspec to lib/yarp/version.rb is different, is there anything else?
Templating must of course happen before any compilation, and then at that point all versions are "burned in" and it shouldn't matter.
One could of course also run templating on sync'ing, but I suppose there are advantages to run templating by CRuby's Makefile (although that causes duplication of the list of templates and is more brittle).


installing .net

Problem encountered on https://dotnet.microsoft.com/en-us/learn/dotnet/hello-world-tutorial/install
Operating System: windows
Provide details about the problem you're experiencing. Include your operating system version, exact error message, code sample, and anything else that is relevant.
i have installed the .net but after installing checking in comand promt that it was installed or not it was showing an error on command prompt

Did you open a new window? If it doesn't help, please try to reinstall dotnet

This might be an issue with PATH as well.
Check the output of the where.exe dotnet command and if your system is x64 and the x86 path returns first, please follow the steps at https://github.com/dotnet/core/issues/5962#issuecomment-780084535 to fix the issue.
Let us know how that goes.


How to handle a unknown command

if I call script with an unknown command, click will raise UsageError and exit with error.
How can I supress this error/error message and run other code?

Could you provide more details and examples of what you're trying to accomplish here?

If this is still a problem please reopen the issue with a minimal, complete, and verifiable example.
In general this issue tracker is for requests/bugs and not for code help. This type of question is better suited for Stack Overflow and will probably be answered quicker there.


[WIP][Feature]  Support submit spark jar and sql tasks to yarn

[WIP][Feature]  Support submit spark jar tasks to yarn
issus: https://github.com/apache/incubator-streampark/issues/3569
Submit the spark yarn jar task by referring to the flink module
maven compile command
mvn  -Pshaded,spark,webapp,dist -DskipTests clean install -e

Submit the spark sql task to yarn

CREATE TABLE jsonSourceTable (name VARCHAR(64))
USING org.apache.spark.sql.json
OPTIONS (
path "hdfs:///test/cjtest/test.json"
);
CREATE TABLE jsonSinkTable (name VARCHAR(64))
USING org.apache.spark.sql.json
OPTIONS (
path "hdfs:///test/cjtest/test2.json"
);
INSERT INTO jsonSinkTable SELECT * FROM jsonSourceTable

This is a very great feature! In 2024, we plan to support Spark. We had a discussion about Spark before:
https://github.com/apache/incubator-streampark/discussions/3043
so we need to revisit that. Additionally, the project's CI failed. Can you address this issue first? 😊

@ChengJie1053 Thank you for your contribution. This is a big new feature. We should send issues and emails to discuss it. At least let us know your plan.

This is a very great feature! In 2024, we plan to support Spark. We had a discussion about Spark before: #3043 so we need to revisit that. Additionally, the project's CI failed. Can you address this issue first? 😊

Ok, thanks for reviewing the code

Thank you for your contribution. This is a big new feature. We should send issues and emails to discuss it. At least let us know your plan.

Ok, thanks for reviewing the code

There are some conflicts, can you resolve them?

Ok, I'll sort it out as soon as possible
---- Replied Message ----
| From | @.> |
| Date | 03/25/2024 10:40 |
| To | @.> |
| Cc |<EMAIL_ADDRESS>|
| Subject | Re: [apache/incubator-streampark] [WIP][Feature] Support submit spark jar and sql tasks to yarn (PR #3537) |
There are some conflicts, can you resolve them?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you were mentioned.Message ID: @.***>

There are some conflicts, can you resolve them?

Ok, I'll sort it out as soon as possible

Is the current code compatible with the Spark 2.x? Spark has Scala versions 2.11, 2.12, and 2.13, so should streamprak support all of these Scala versions? How to implement? It is an issue that needs to be discussed. We can continue to address these issues in the future.

Is the current code compatible with the Spark 2.x? Spark has Scala versions 2.11, 2.12, and 2.13, so should streamprak support all of these Scala versions? How to implement? It is an issue that needs to be discussed. We can continue to address these issues in the future.

Currently only support spark 3.1.2 version, do not support multiple versions, you can refer to the flink module later, support spark multiple versions, but do not intend to support in the current pr, because the current pr code has changed a lot, the review code is not very convenient

Is the current code compatible with the Spark 2.x? Spark has Scala versions 2.11, 2.12, and 2.13, so should streamprak support all of these Scala versions? How to implement? It is an issue that needs to be discussed. We can continue to address these issues in the future.

Currently only support spark 3.1.2 version, do not support multiple versions, you can refer to the flink module later, support spark multiple versions, but do not intend to support in the current pr, because the current pr code has changed a lot, the review code is not very convenient

Ok,Thanks for your hard work, StreamPark has taken a new step in supporting apache spark


Convert to Python 3

This PR converts PolicyBrain to Python 3. So far, I have only run the Python 2to3 module. I'm pretty impressed with the initial results...only 22 out of the 172 tests failed. However, even once all the tests are passing, we will have to take care to test the app thoroughly before deploying it.

The heroku buildpack needs to be updated, too. I plan to do this in a follow up PR. We currently use a build-pack that was forked from the official buildpack: https://github.com/heroku-python/conda-buildpack.
Also, the worker nodes need to be upgraded to Python 3. Note that the webapp and the worker nodes can be out-of-sync since the worker nodes run as separate processes. I will update this in a follow up PR.


chore(tests): add etcd log output to integration tests

Unexplained failures in the test suite seem to point to etcd communication issues currently. This dumps etcd logs from each host into the integration test tarball for forensic analysis.

Code LGTM.

code LGTM


Feature request: display timer in toolbar if it is running, rather than temperature

Without having the app open there's no way to know if a timer is running since only temperature is displayed. It'd be nice to have the option to display remaining time up there when a timer is going.

I had spiked the idea of including the time left in the menu bar but opted to not include it since the text rendered is not monospaced and each second glitched the icon back and forth
2 potential options would be:

Just render the minutes left: 3min -> 2min -> 1min -> >1min
Just update the icon to a clock when the timer is running

Latter would be very easy, former would provide additional context
I'll spend a bit of time investigating both, thanks for the idea!


MathOptInterface.jl implementation ?

Hi,
First, many thanks for making you code open source.
I was wondering If you are interested in making a MathOptInterface of LFPSQP ? This would allow interfacing your solver with JuMP.jl (among others) and a also with ModelPredictiveControl.jl. Your solution is promising for the MPC package, since every iterate satisfies the constraints.

Thanks for the note and your interest in the library! That's a great point, and I would love to make LFSQP MathOptInterface compatible at some point... I haven't given this library attention in a long while, and there are some additional changes I should probably make under the hood that I've thought about over the past year related to improving efficiency with inequality constraints.


Deleted destructor and overloaded Dispose method

It can lead to deadlock, when using Shutdown function to stop the bus.
Fixed code style formatting.

@alexzaitzev,
I have made a couple of notes not directly related to the changes in this commit but which should be considered for refactoring later. Please take a look.


[Feat]Add support for optional strat len of logprobs

Thank you for your contribution, we really appreciate it. The following instructions will help improve your pull request and make it easier to receive feedback. If there are any items you don't understand, don't worry. Just submit the pull request and ask the maintainers for help.
Motivation
#902 required by #852
Modification
tokenizer manager
Checklist

Ensure pre-commit pre-commit run --all-files or other linting tools are used to fix potential lint issues.
Confirm that modifications are covered by complete unit tests. If not, please add more unit tests for correctness.
Modify documentation as needed, such as docstrings or example tutorials.

strat? typo?


About File/Image fields on model-driven apps

In section "File fields", it mentions "Currently, the file data type is only available to canvas apps and flows."  However this must have recently changed has it is now available from model-driven apps too, only via the new Forms designer. (Power Apps Make > Solution > [selection solution] > [select an entity like Contact] > Fields tab > Add field (command) > select "File" in Data type)
In the designer, there's no hint that it is a pre-release preview (on 2020 release wave 1)... Is the mention "[This topic is pre-release documentation and is subject to change.]" still true?
Also, while they are fields, are File and Image fields stored in the "Database" or the "File" storage in the capacity model?
Thanks

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 6d193924-c732-6c92-721b-348baede9d54
Version Independent ID: c871720f-64d4-66e7-7b6d-1c555e4e32e1
Content: Field data types in Common Data Service - Power Apps
Content Source: powerapps-docs/maker/common-data-service/types-of-fields.md
Service: powerapps
GitHub Login: @Mattp123
Microsoft Alias: matp

@phyle - thank you for your feedback. You are correct that the File data type is now also supported with model-driven apps. I've updated the topic to reflect this, which will be live soon. The File data type feature however, is still in public preview.
I'm trying to get an answer for you question about where the data is stored.

@phyle - File and image data is measured against capacity under File and database. More information: https://docs.microsoft.com/en-us/power-platform/admin/capacity-storage#capacity-page-details
Closing issue.

Capacity Storage is divided in 3 types: Database, File, Log.  I don't understand your answer, the file/image data can't (shouldn't) be stored in both File and Database at the same time.  Unless in the Database type, there's a ID/URL to the actual blob storage in the File storage type?

I would like to demystify proceedings for capacity storage as Database (relational datastore, indexes and cross -reference of data), File ( immutable binaries stored within the system) and Log (CRD data that can not be updated).
Metadata about File field (name, size, and so on) is part of database storage however binary payload is File storage.

Thanks Matt for the document update and thanks Maya for the precisions!


Reduce friction for executing a search

This item was also in the Q/A backlog but re-raising because I've seen multiple people struggle with completing a search because they expect to be able to click on a result and can't.
One (Eric Mack) told me that he assumed search didn't work because he couldn't do this. "Oh wow, I have never seen this results table."
A few options for resolving:

Allowing people to click on a result and immediately display the result in the "results view"
Removing the search preview

Do you mean in the search auto-complete dropdown? The feature to click one of the options under "Entities, Tags, Blocks" just hasn't been built out yet. The user should be able to click on one of those results and be brought straight to the graph.

Right -- as discussed I think we should remove until that feature is built out.


Add option to allow remote access on webpack-dev-server

Set this option to allow remote access to webpack dev server (avoid Invalid Header error)

Hey @Toilal
Thanks for the PR. a quick question: host <IP_ADDRESS> is enough to access from within the same network, right? Like from a mobile phone in my Wifi. Or would that also require this additional option?

Setting host to <IP_ADDRESS> is NOT enough, because dev server check the HTTP host header actually match what's is defined in host parameter. If it doesn't match, it shows an empty HTML page with "Invalid Host Header".
It can be useful for mobile access from desktop or Dockerized yarn installations.

Thanks, understood.

(close and re-open to trigger CI)


Modifying Webpack Configuration

Please provide us with the following information:

OS?  Windows 7, 8 or 10. Linux (which distribution). Mac OSX (Yosemite? El Capitan?) Windows 8

Versions. Please run ng --version. If there's nothing outputted, please run
in a Terminal: node --version and paste the result here: angular-cli: 1.0.0-beta.11-webpack.8

Repro steps. Was this an app that wasn't created using the CLI? What change did you
do on your code? etc. ng build

The log given by the failure. Normally this include a stack trace and some
more information. No failure, just a question

Mention any other details that might be useful.

Is there anyway to modify the webpack dev/prod build processes that are running. Basically, html-webpack-plugin step is not needed in the scenario were an applications initial page is being server rendered by a server-side technology like ASP.Net. In my case I would only need to add script references to index.cshtml to the generated bundles. Unfortunately, when running ng build --prod, these references are broken by webpack adding hashes to generated files. I would rely on the server side technology to cache bust. Despite these small short-comings i'm really enjoying the CLI.

Thanks! We'll be in touch soon.

@mikelunn Did you find a way to modify webpack configs?

@alexsorokoletov I found another project template that has a pre-configured build process that integrates well with the server-side technology that i'm currently using:
ASP.NET/JavascriptServices
I wasn't sure if others would have the same need to modify the build process, so I closed the issue. But to answer your question, no I did not find a way to modify the webpack config settings. Do you want me to re-open the issue?

No, thanks, was just wondering what solution did you use.
Alex

On Sep 19, 2016, at 09:32, Mike Lunn<EMAIL_ADDRESS>wrote:
@alexsorokoletov I found another project template that has a pre-configured build process that integrates well with the server-side technology that i'm currently using:
ASP.NET/JavascriptServices
I wasn't sure if others would have the same need to modify the build process, so I closed the issue. But to answer your question, no I did not find a way to modify the webpack config settings. Do you want me to re-open the issue?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

Discussion can be found in https://github.com/angular/angular-cli/issues/1656


Allow to disable tracking

Allow to disable tracking via configuration. Useful to avoid tracking in some environments.

:tada: This issue has been resolved in version 1.2.0-next.1 :tada:
The release is available on:

v1.2.0-next.1
GitHub release

Your semantic-release bot :package::rocket:

:tada: This issue has been resolved in version 1.2.0 :tada:
The release is available on:

v1.2.0
GitHub release

Your semantic-release bot :package::rocket:

@matcho @martinraie you might be interested in this feature, if so please take a look at this repo


External RAM

do you plan to implement PSRAM in the future?
there would be more opportunities.
or maybe it already works? just need to esp32 accordingly with PSRAM

ESP32's can't do DMA from PSRAM

Food for thought, regarding the ESP-S3:

Note, although ESP32-S3 has hardware support for DMA to/from external RAM, this is not yet supported in ESP-IDF.


Possible Feature: Global --grep option for basic filtering on results

@bd4, @corpulentcoffee: I'm particularly interested in your opinions on this, as we've had a number of discussions about the CLI design/layout.
Thoughts and opinions from everyone and anyone welcome, of course.
There's a potential feature that I'd like to think about and ask questions about.
For now, I'm calling it --grep because I think it's the most intuitive name for it, but I'm not thinking of doing full regex matching necessarily.
--grep is probably a bad name for this if I add it, since it promises too much, but I don't have a good name yet. Maybe --cli-filter
Right now, a lot of commands have grep-friendly text output.
I'm going to use bookmark list for a bunch of examples because it has very simple output.
$ globus transfer bookmark list -Ftext
Name                             | Endpoint ID                          | Bookmark ID                          | Path
-------------------------------- | ------------------------------------ | ------------------------------------ | ----
Crummy Bookmark                  | d1763b75-6d04-11e5-ba46-22000b92c6ec | 6c0a7d14-f796-11e5-a6f9-22000bf2d559 | /abc/123/
EP1 GoData                       | ddb59aef-6d04-11e5-ba46-22000b92c6ec | ec207bf4-eb91-11e5-9829-22000b9da45e | /share/godata/
Test Bookmark Creation           | d1763b75-6d04-11e5-ba46-22000b92c6ec | 46e4d1b8-f78e-11e5-a6f9-22000bf2d559 | /abc/123/

In the case of commands like this, it's natural to want to be able to filter on columns in some way. My beloved awk can do great things here with | as its delimiter, and plain grep without column awareness is pretty useful too.
$ globus transfer bookmark list -Ftext | grep 'ec207bf4-eb91-11e5-9829-22000b9da45e'
EP1 GoData                       | ddb59aef-6d04-11e5-ba46-22000b92c6ec | ec207bf4-eb91-11e5-9829-22000b9da45e | /share/godata/

is a decent example of what we'll see people doing.
This really doesn't work well on the JSON output, however, for obvious reasons:
$ globus transfer bookmark list -Fjson | grep 'ec207bf4-eb91-11e5-9829-22000b9da45e'
      "id": "ec207bf4-eb91-11e5-9829-22000b9da45e"

Now, what if that filtering were done inside of the CLI code itself, so instead of globus ... | grep <expr>, we had globus ... --grep <expr>?
We could apply that expression to text and JSON output uniformly -- quick and easy filtering for your results.
$ globus transfer bookmark list -Ftext --grep 'EP1'
EP1 GoData                       | ddb59aef-6d04-11e5-ba46-22000b92c6ec | ec207bf4-eb91-11e5-9829-22000b9da45e | /share/godata/

and importantly
$ globus transfer bookmark list -Fjson --grep 'EP1'
{
  "DATA": [
    {
      "name": "EP1 GoData",
      "path": "/share/godata/",
      "endpoint_id": "ddb59aef-6d04-11e5-ba46-22000b92c6ec",
      "DATA_TYPE": "bookmark",
      "id": "ec207bf4-eb91-11e5-9829-22000b9da45e"
    }
  ]
}

Bookmark list is not a very compelling case for this because it's small.
Endpoint Search obviously has searching and filtering options available in the API.
The three really strong cases for this feature, I think, are Task List, Event List, and ACL List.
Lots of people will want to do something like this:
$ globus transfer task list | grep 'Globus Tutorial Endpoint 1'
c44056b6-f075-11e5-9833-22000b9da45e | SUCCEEDED  | DELETE     | Globus Tutorial Endpoint 1       | None                             | globus-cli delete
b8a53d98-ed29-11e5-982b-22000b9da45e | SUCCEEDED  | TRANSFER   | Globus Tutorial Endpoint 1       | Globus Tutorial Endpoint 1       | None

or this
$ globus transfer acl list --endpoint-id d1763b75-6d04-11e5-ba46-22000b92c6ec | grep 'identity'
02ed6f8c-d2aa-11e5-9759-22000b9da45e | identity         | c8aad43e-d274-11e5-bf98-8b02896cf782 | rw          | /otherusers/globusteam/
02ed6f85-d2aa-11e5-9759-22000b9da45e | identity         | c8aad43e-d274-11e5-bf98-8b02896cf782 | r           | /
01bbeadd-d2aa-11e5-9759-22000b9da45e | identity         | ae2f7f60-d274-11e5-b879-afc598dd59d4 | rw          | /otherusers/ballen/
None                                 | identity         | c8aad43e-d274-11e5-bf98-8b02896cf782 | rw          | /

The easy way to start on this is a raw substring match on the SDK's str(GlobusResponse)
Then we can maybe do regex, and maybe only match on fields inside of a JSON structure, and maybe only apply on visible columns in text output.
I know that there's a case for saying that "Oh, no! We don't want people using Display Name in scripts!", but I don't think that's the only consideration here.
I recognize that there's a danger in allowing someone to do globus transfer task list --grep <display_name> --format JSON > somefile.json, but I don't think that's particularly hard to do on your own regardless.
The question, in my mind, is whether or not some kind of basic filtering -- insufficient for all needs but useful in small doses -- would be a useful thing to have in the CLI.
If we just do a substring match on str(GlobusResponse), the implementation and maintenance cost is very cheap.
Is substring match not good enough? Should we do full regexes?
Is this entire idea an unnecessary feature?
We can always tell people to use grep or jq.
They'll certainly have the former, but not everyone has a command-line JSON filtering tool at the ready.
Although this might be useful for text output, I'm more interested in supporting simple filtering on JSON out. OTOH, maybe just instructing people in the use of jq (my personal favorite) is good enough?

 If I needed more context with JSON output and I were using the tool interactively, I would just sloppily add -U10 and be perfectly happy with that.
And even if I were using the JSON output in a script, as long as I already knew about the jq tool, I would more likely find what I needed from man jq to formulate globus transfer bookmark list -Fjson | jq '.DATA[] | select(.name | contains("EP1"))' on my own to get exactly what I want instead of fumbling around with any globus-specific flags.
And besides that, it seems like for this to work, you would need to know about what all the envelopes look like for all the API responses to intelligently apply a filter to them.

I think this is a speculative feature that is not worth adding now. Even users really do end up using JSON a lot, we can point them at jq as Dave suggested, and if for some reason that doesn't satisfy all the use cases, we can explore adding some sort of feature. But it's not clear what would be useful that can't be provided by piping to standard tools at this point.

I agree that this was speculative.
I was sitting in a coffee shop this weekend and the idea struck as something maybe-useful.
Given that you guys aren't enthusiastic about the idea, I'm closing this out.
For a cosmetic feature like this, genuine enthusiasm would be necessary for me to add it.


Fix MicroBOSH README anchors

What
Corrects anchor links to the section about MicroBOSH in the README.
How to review
View README file and verify anchor links to MicroBOSH work from the Overview section and Deployer Concourse sections.
Who can review
Anyone.

Awesome, Thanks for this!


Code after with statement which always returns is considered unreachable when the dynamic type of the context manager is unknown.

Environment data

Language Server version: v2021.10.0
OS and version: Ubuntu 20.04.3 LTS
Python version (& distribution if applicable, e.g. Anaconda): 3.8.5

Expected behaviour
Since Foo suppresses all exceptions when used as a context manager and an exception is raised before the return statement is reached, the print statement after the with statement actually gets executed. It should not be marked as dead code.
Actual behaviour
The print statement gets marked as unreachable.
Code Snippet / Additional information

class Foo:
    def __enter__(self):
        pass

    def __exit__(self, exc_type, exc_value, stack trace) -> bool:
        return True

def bar():
    with Foo():
        print(1 / 0)
        return
    print('This actually gets printed')

bar()

In general, code after a with block should only be marked unreachable because of a statement within the with block if it is known that no exception can be raised before that statement is raised which the context manager might suppress.
Pragmatically, the code after the with block should probably always be considered reachable unless it can be proven no exception can be raised or the dynamic type of the context manager is known and it is known that that type's __exit__ function never returns True. Otherwise, only the remaining code within the with block should be marked unreachable.

Your sample contains a syntax error in the signature for __exit__. The third parameter is missing an underscore between stack and trace. If I add the underscore, it works as expected — the print statement is seen as reachable.

Your sample contains a syntax error in the signature for __exit__. The third parameter is missing an underscore between stack and trace. If I add the underscore, it works as expected — the print statement is seen as reachable.

Sorry about the typo, I did test this without the typo before posting it here and saw this issue. I've updated to v2021.10.1 and I'm still seeing the same issue.

In your screen shot above, you have not included a return type annotation for the __exit__ method. By default, type checkers assume that context managers do not catch exceptions. You can override that default assumption by including a -> bool return type annotation for __exit__, like you did in your original code sample at the top of this thread.

That makes a lot of sense, thanks for the explanation. Will your fix also cover the following patterns as well?
def foo() -> Foo:
    return Foo()

with foo():
    pass

foo: Foo = Foo()
with foo():
    pass

What I'm actually doing in my project is something like
from __future__ import annotations

class Foo:
    def __enter__(self) -> None:
        pass

    def __exit__(self, exc_type, exc_value, traceback) -> bool:
        return True

    def bar(self) -> Foo:
        return self

def baz():
    with Foo().bar():
        print(1 / 0)
        return
    print('This actually gets printed.')

baz()

I assume that would be covered by the patterns above, or are these usage patterns more rigid than I'm imagining them?

No, this change won't work with the first usage pattern above. (The second one is invalid because it attempts to call an object). The logic is very rigid because it can't use the general type evaluator; it needs to work directly on the parse tree.
Now that you understand the details, you can change your code to accommodate the known limitations.


Bump gyp 19495aa

Bumped GYP to latest version
rebased all floating patched since last bump

Checklist

[x] npm test passes
[x] commit message follows commit guidelines

Affected core subsystem(s)
gyp

@joaocgreis PTAL, after we land this we can improve on #1130 (remove GYP trickery, and remove COM code in favor of vswhere)

@refack Needs a rebase and most likely a new GYP update.

Ack.
(I'll trade you a bump for a review of https://github.com/nodejs/node/pull/14718)

Rebased.

Bumped GYP to https://github.com/refack/GYP/commit/324dd166b7c0b39d513026fa52d6280ac6d56770

There are 4 other floating patches that are not necessary:

a04ea3051a60bbfdabda3bafef213028cc099f6a - Mostly upstreamed, whats left is https://github.com/nodejs/node-gyp/blob/a04ea3051a60bbfdabda3bafef213028cc099f6a/gyp/pylib/gyp/generator/msvs.py#L341-L342 revered by (3)
ec5fc36a80ea1e98eac1f490545ccb4e71fce846 - Upstreamed
8a767145c9e34398ca8f2c4c5c9086b0ab79788a - Revert (1)
d6139b538c2219110048ac6e00b5abbe248433db - Upstreamed

🤷♂  would be nice to get a sync, but this is too old now


Updates readme and adds version into build version

This PR addresses the readme of this application.

Adds a screenshot example.
Updates the name of the build version.
Updates readme structure.

Note: If this got merged, please don't forget to tag this version as v1.0.1.

Thanks for this :+1:


Struggling to add webview to control existing MBB app

I'm trying to add a BlazorWebView to the Control Gallery app so I can reproduce, and hopfully fix #286. Based on the HybridApp sample I think I've done everything right but I end up with a blank white area where my webview should be.
In the debug output in Visual Studio I get 2021-01-12 12:05:56.569325+1100 ControlGallery.iOS[42638:745934] [Process] 0x7fbeb7b67020 - [pageProxyID=6, webPageID=7, PID=42641] WebPageProxy::didFailProvisionalLoadForFrame: frameID = 3, domain = NSURLErrorDomain, code = -1002, which I think is relevant but I can't find any meaningful solutions.
Repro of this issue is at https://github.com/lachlanwgordon/MobileBlazorBindings/tree/issues286
Any ideas?
Steps I've taken:

Added the targets and props to iOS.csproj
Add the index.html and wwwroot to iOS resources
called services.AddBlazorHybrid() and builder.UseWebRoot("wwwroot") in app.cs
called builder.UseStaticFiles in app.cs
Add <EnableDefaultCssItems>false</EnableDefaultCssItems> to csproj
Added BlazorWebView tag to my view    <BlazorWebView VerticalOptions="LayoutOptions.FillAndExpand"<EMAIL_ADDRESS>>
            <ControlGallery.WebUI.App />
    </BlazorWebView>

Created WebUI/App.razor
Added Index, MainLayout and NavMenu.razor
setup _imports
Copied across css from hybrid project

I've also modified the ShellNavigationManager to fix an issue with having a route "/", to stop the app crashing. I'll create a separate issue for this.

Hmm interesting, I'll have to take a closer look. Hybrid apps have quite a few additional requirements compared to non-hybrid apps so it's possible that there's some 1-line thing that's missing somewhere.

Hmm interesting, I'll have to take a closer look. Hybrid apps have quite a few additional requirements compared to non-hybrid apps so it's possible that there's some 1-line thing that's missing somewhere.


[ci] Make matrix names more concise

This should help readability in GitHub's web UI.

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 87.84%. Comparing base (3aef801) to head (b4e85c9).
Report is 1 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #1306   +/-   ##
=======================================
  Coverage   87.84%   87.84%
=======================================
  Files          15       15
  Lines        5191     5191
=======================================
  Hits         4560     4560
  Misses        631      631

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


How to add reading time plugin?

You should take a look at the plugin's README
In short:

In your site's main directory execute:

npm install --save hexo-reading-time

Add the following line to layout/post.ejs:

<%- readingTime(page.content) %>

I got it to work, sorry for creating an issue for nothing, I was kinda frustrated trying to get it to work in another theme, apollo. Sadly that theme has jade files instead of ejs.


[HUDI-4338] resolve the data skew when using flink datastream write hudi

Tips

Thank you very much for contributing to Apache Hudi.
Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.

What is the purpose of the pull request
https://issues.apache.org/jira/browse/HUDI-4338
Brief change log
(for example:)

Modify AnnotationLocation checkstyle rule in checkstyle.xml

Verify this pull request
(Please pick either of the following options)
This pull request is a trivial rework / code cleanup without any test coverage.
(or)
This pull request is already covered by existing tests, such as (please describe tests).
(or)
This change added tests and can be verified as follows:
(example:)

Added integration tests for end-to-end.
Added HoodieClientWriteTest to verify the change.
Manually verified the change by running a job locally.

Committer checklist

[ ] Has a corresponding JIRA in PR title & commit

[ ] Commit message is descriptive of the change

[ ] CI is green

[ ] Necessary doc changes done or have another open PR

[ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.

@hudi-bot run azure


Title Bar Styling

Currently there's no way to style the title bar from the defaults.
Some of the styling that could be included:

Font weight
Font color
Background color

It's moving :) Will hopefully finish on Thu
There's already stuff to play with in the style branch
https://github.com/wix/react-native-controllers/commit/7059061374b074e26bf289b286fc731f7fa8d507
Pass styles through the styles prop

Looks nice, great work :)

Colors are now fully supported in the style branch with an example
https://github.com/wix/react-native-controllers/tree/style
I'm planning to add a whole bunch of styles, I'll merge the branches when finished

merged and released under 1.0.4
See https://github.com/wix/react-native-controllers#styling-navigation

👍

Is there any plans to add font styling to the navigation as of yet?

@joemckie #87


TabContainer model binding does not work with add and remove item

OpenUI5 version: 1.70.0
Browser/version (+device/version): chrome latest
Any other tested browsers/devices(OK/FAIL):
URL (minimal example if possible):
https://jsbin.com/zodosoh/1/edit?html,output
Steps to reproduce the problem:

Press add button
close newly added demo tab
press add button

What is the expected result?
There should be only one demo tab
What happens instead?
Found two demo tabs. The unexpected tab is deleted.
Any other information? (attach screenshot if possible)

Hi,
when adding a new item, please use TabContainer API:
var addButton = new sap.m.Button({
  text: "add",
  press:function() {
    var newEmployee = new sap.m.TabContainerItem({
        name: "myFirstName",
        additionalText: "myLastName",
        modified: false
    });

    list.addItem(
        newEmployee
    );
    list.setSelectedItem(
        newEmployee
    );
  }
})

Please also check:
https://sapui5.hana.ondemand.com/#/api/sap.m.TabContainerItem
https://sapui5.hana.ondemand.com/#/entity/sap.m.TabContainer/sample/sap.m.sample.TabContainer/code/TabContainer.controller.js
Best regards


unity_sframe::append reorders sframe if needed

As it is documented in #2222, I move the logic from the frontend to the backend.

Ooops, my editor will remove all redundant whitespaces from code snippets I've viewed. Sorry for those irrelevant code changes.

passed internal pipeline. Good to go.


Please add ASUS and Razer bloatware to the list

ASUS:
Agni Service
Feature Service
Initial Service
Link to ScreenXpert
InputLocaleMonitor
App Service
Optimization
Optimization Startup Task
Software Manager
Software Manager Agent
Support Service
Survey
Switch
System Analysis
System Diagnosis
Razer:
Central Service (32 bit)
Chroma SDK REST Server
Chroma SDK Service (32 bit) (this appears 8x)
Chroma Stream Server
Synapse Service (32 bit)
Synapse Service Process
THX0527 Helper (32 bit) (appears 2x)
Not sure if uninstalling/disabling any of the Razer programs would disable the RGB or audio from my devices (Kraken Ultimate, Leviathan V2 X)

i posted this in the wrong channel my bad!


Issues with Azure OIDC

I have installed Datahub application in a private AWS EKS cluster using this helm chart. Now I am trying to set SSO integration via Azure AD in the same Datahub application by following this link.
I followed all the steps as it is. But when I tried to login via SSO, then it redirects to that Azure AD SSO url and after login I am thrown back to the login screen with error. Below is the error in datahub frontend pod.
ERROR controllers.SsoCallbackController - Caught exception while attempting to handle SSO callback!
Here is the OIDC config I used:
oidcAuthentication:
enabled: true
provider: "azure"
clientId: "client-id"
clientSecretRef:
secretRef: secret-name
secretKey: secret-key
scope: "openid profile email"
azureTenantId: "azure-tenant-id"
extraEnvs:
- name: AUTH_VERBOSE_LOGGING
value: "true"
Any Idea where I am doing wrong ?

I am also getting same issue, it would be amazing if anyone can provide any solution to this

@deepak-khetwal-e to get some more information check the logs of the datahub-frontend pods. these give some pretty acurate logging, In my case it seems that there is no email address send with the token, thus it's not possible to create a user.


Updated project dev dependencies

Updated changed project dev dependencies. Also updated the test framework used and updated supported nodejs versions.

Great work here! That huge upgrade will help a lot to improve the project. Seems there are a conflict onto your branch, please check it.

Should be up to date with master. Lots of merging conflicts so second review would be advised before merging.

I think we can merge this. It was updated with master, so should be no conflicts.

I am working on the merge once I update I let you know. Discard the other message.

I rebased for you. All conflicts should be resolved. A second review is needed JIC but should be ready for merge at current state.

Now looks great! Thanks @Undre4m


production build doesn't work while develpment build do

i have this func that simply calculate ax²+bx+c
handleSubmit = (event) => {
    event.preventDefault();
    let a = this.state.a;
    let b = this.state.b;
    let c = this.state.c;
    let ac4 = a * 4 * c;
    let delta = b * b - ac4;
    let result = {};
    if (delta < 0) result = { x1: "imag.!", x2: "imag.!" };
    else {
      delta = delta ** (1 / 2);
      a = 2 * a;
      let x1 = (-b - delta) / a;
      let x2 = (-b + delta) / a;
      result = { x1, x2 };
    }

but with the production build it looks like this
            n.handleSubmit = function(e) {
                e.preventDefault();
                var t = n.state.a
                  , l = n.state.b
                  , r = l * l - 4 * t * n.state.c
                  , o = {};
                r < 0 ? o = {
                    x1: "imag.!",
                    x2: "imag.!"
                } : o = {
                    x1: (-l - (r = a.pow(r, .5))) / (t *= 2),
                    x2: (-l + r) / t
                };

and while submitting i get this error: a.pow is not a function
and the a is clearly not defined inside this function

Without knowing exactly what your target is and what browser you're using to run your code it's a bit hard to know what is going wrong.
Have you tried using Math.pow instead of **?
According to documentation it should output Math.pow when you use **. So are you sure a is not defined as Math somewhere outside the code?

i changed ** to Math.sqrt and changed the variables names from a b c to aValue bValue cValue but I still get the error :  a.sqrt is not a function
the production build code looks the same except that now it's a.sqrt(r) instead of a.pow(r, .5)

It's hard to help with the amount of info you've provided. Can you reproduce it in isolation? Can you provide browserlist target and which browser you're using?

https://react-practice-81cac.web.app/ this the website (just a test) i used chrome phone version and desktop version

 this is the website , am using ** back cuz I was having errors when I used Math.sqrt but I think it doesn't matter
anyway I am using chrome desktop version , and chrome phone version

 this is the website , am using ** back cuz I was having errors when I used Math.sqrt but I think it doesn't matter
anyway I am using chrome desktop version , and chrome phone version

@ViNoS-ab I just realized you named your component Math. Can you try renaming it something else than Math?
Try naming it MathComponent or Calculator.

ups you are right i thought of that but I wasn't sure how things get compiled , so sorry this was my bad ,
now should I close the issue or this still a problem that should get solved , because we maybe don't know all classes and get this issue again , or at least detect that there are two classes with the same name and throw an error
thanks for your help


Add The G vehicle from SpaceDock

This pull request was automatically generated by SpaceDock on behalf of greenrolf, to add The G vehicle to CKAN.
Mod details:
name = /mod/1938/The%20G%20vehicle
author = greenrolf
abstract = The G vehicle is a vehicle for KSP.  It was built to accept the RoveMax Model M1 wheels.
license = GPLv3
Homepage = https://greenrolf.wordpress.com/2018/08/10/new-release-the-g/
description = The G vehicle is a vehicle for KSP.  It was built to accept the RoveMax Model M1 wheels.
Please direct questions about this pull request to greenrolf.

This was added in #6686.


[FeatureReq] Option to disable cache

Is your feature request related to a problem? Please describe.
Hi. I was thinking about integrating the mod with WordPress (in theory, it is possible with any other system). Let me clarify that I use a MySQL database. The plan is as follows:

Password is changed on the website.
Hash (bcrypt) is written from the wp_users table to the easyauth table using a trigger in the database
You can log in to the game using a new password

In practice, it turned out that the mod uses invincible data caching, and there is no way to force it to reset the cache and re-read the database :(
Because of this, such a plan did not work
Describe the solution you'd like
It would be nice to have an option in the configuration that would disable the cache
useCache: false
Then the mod would access the database for the hash during authentication and after authentication would immediately write other information to the database: ip, was in portal, auth, etc...
Describe alternatives you've considered
As an alternative, I am currently considering such a plan

Password is changed on the website (wp_users)
Trigger records the changes in a separate table (account_history), where id, username, password, action (insert, update, delete), processed, insert timestamp, update timestamp are stored
Python script runs every minute (or less often) and gets all unprocessed records from the database
Script connects to the server via RCON, checks that the server is active and then performs the creation, updating and deletion of credentials through the mod commands

In fact, instead of updating the password in the database, I update it in the cache of mod
Additional context
I really hope to disable the cache, because this authentication mod is the only one suitable for fabric

Alternative plan:

Password is changed on the website (wp_users)
1.1 Special plugin get plaintext when password created or changed

Terrible plan :(

Plan is working

Can you tell me if any modifications are planned according to the request?

Can you tell me if any modifications are planned according to the request?

Yes, I'm planning to get rid of cache entirely, but I don't any ETA.


Created mzXML metadata file that will accompany the downloaded zip archive of mzXML files

Summary Change Description
Created an advanced search download view for mzXML metadata.
Details:

Fixed an oversight in MSRunsLoader.get_loaded_msrun_sample_dict where, when called from the PeakAnnotationsLoader, there are no mzxml_files provided, so it always was searching for a placeholder.  The test data however had 1 mzXML per sample, so no placeholders were created, which caused RecordDoesNotExist errors.  So I implemented a backup query that is for any MSRunSample record that just matches the sequence and sample.  If only 1 exists, it is returned without error.  That should completely solve this problem without the need to add mzxml files to the peak annotations loader call.
Fixed a logic error in the StudyLoader's constructor when you supply a single sheet to read_from_file to create the df argument (instead of None - to get all sheets).  The constructor requires a dict of DataFrames, so the input was wrong, but the error it manifested as was that "df" was None - and is required.  That is a side-effect of convert_df, which supports a single sheet DataFrame.  So I just had to check the type of df before the chack that df is not None.
I created a new template file named search_metadata.txt for the commented portion of the tsv file headers that contains the date and qry object, so I could re-use it in different tsv files.
Renamed class AdvancedSearchTSVView to AdvancedSearchDownloadView, which defaults to the basic tsv formats supported by the templates and represents the entire search format.  It is intended to be used as a parent class now, so I broke up some of the methods for re-use.
I created sigfig in the text utils.  This is the same as sigdig, but for use outside of templates (so I used a different name so as not to conflict).
download.py changes

I created a class: "Echo" to simulate an IO buffer.  It contains a single write method that just returns a value so that data could be streamed without hitting disk.  This essentially takes the place of the awkward tsv templates.  This was suggested by people in the django forum.
I moved the method: tsv_template_iterator into the renamed AdvancedSearchDownloadView class.
I created a RecordToMzxmlTSV abstract base class that is intended to convert queryset records to lists that could be used to generate tsv files.

PeakGroupsToMzxmlTSV inherits from RecordToMzxmlTSV and implements the required format_id class attribute and the rec_to_rows method that turns a record into multiple lists of the 1:M related MSRunSample records' linked mzXML file details.
PeakDataToMzxmlTSV inherits from RecordToMzxmlTSV and implements the required format_id class attribute and the rec_to_rows method that turns a record into multiple lists of the 1:M related MSRunSample records' linked mzXML file details.

I created a class AdvancedSearchDownloadMzxmlTSVView that inherits from AdvancedSearchDownloadView and overrides the form_valid method and has its own tsv iterator.  It returns a stream of that file.

Affected Issues/Pull Requests

Partially addresses #1261

Satisfies requirements 6.1. - 6.22. (but not requirements 6.

Partially addresses #1272

#1261 and #1272 partially overlap in that they both use the same tsv file
This PR adds the ability to stream JUST the mzXML tsv file

Merges into main

Review Notes

See comments in-line.
Checklist

This pull request will be merged once the following requirements are met.  The
author and/or reviewers should uncheck any unmet requirements:

Review requirements

Minimum approvals: 1
No changes requested
All blocking issues resolved by reviewers
Specific reviewers: @add_username_here

Review period: 2 days

Associated issue/pull request requirements:

[x] All requirements in affected issues marked "resolved" are satisfied
[x] All required pull requests are merged (or none)

Basic requirements

[x] All linters pass
[x] All tests pass
[x] All conflicts resolved

Overhead requirements

[x] New/changed method tests implemented/updated (or no change)
[ ] Updated Unreleased section of changelog.md (or no change)
[x] Migrations created & committed (or no change)

Thanks for the tests. Looks ok to me. Is this checked out on development for people to look at, in practice?

This is an underlying piece (- the metadata file that will accompany the bulk mzXML download.)  It's not hooked into the interface yet.  I'm close to finishing the next underlying piece and am currently debugging.  I hope to get the next PR out today.  Then I'll actually be able to put it all together.


Node not starting

Hello team
I am trying to setup a casper node but i am facing issue while starting node.
**casper-node-launcher.service - Casper Node Launcher
Loaded: loaded (/lib/systemd/system/casper-node-launcher.service; enabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Mon 2022-03-28 12:51:28 UTC; 4s ago
Docs: https://docs.casperlabs.io
Process: 331545 ExecStart=/bin/sh -c exec /usr/bin/casper-node-launcher 1>> /var/log/casper/casper-node.log 2>> /var/log/>
Main PID: 331545 (code=exited, status=1/FAILURE)
Mar 28 12:51:28 Disk1 systemd[1]: casper-node-launcher.service: Scheduled restart job, restart counter is at 3.
Mar 28 12:51:28 Disk1 systemd[1]: Stopped Casper Node Launcher.
Mar 28 12:51:28 Disk1 systemd[1]: casper-node-launcher.service: Start request repeated too quickly.
Mar 28 12:51:28 Disk1 systemd[1]: casper-node-launcher.service: Failed with result 'exit-code'.
Mar 28 12:51:28 Disk1 systemd[1]: Failed to start Casper Node Launcher.**
steps, which I had followed.
Update package repositories
sudo apt-get update
Install pre-requisites
sudo apt install -y dnsutils software-properties-common git
Install helpers
sudo apt install jq -y
Remove Previous Versions
sudo systemctl stop casper-node-launcher.service
sudo apt remove -y casper-client
sudo apt remove -y casper-node-launcher
sudo rm /etc/casper/casper-node-launcher-state.toml
sudo rm -rf /etc/casper/1_0_*
sudo rm -rf /var/lib/casper/*
Install Casper node
echo "deb https://repo.casperlabs.io/releases" bionic main | sudo tee -a /etc/apt/sources.list.d/casper.list --failed
curl -O https://repo.casperlabs.io/casper-repo-pubkey.asc
sudo apt-key add casper-repo-pubkey.asc
sudo apt update
Install the Casper node software
sudo apt install casper-node-launcher -y
sudo apt install casper-client -y
Build smart contracts
git clone https://github.com/casper-network/casper-node.git
cd casper-node/
git checkout release-1.4.4
Build the contracts
make setup-rs
make build-client-contracts -j
Configure and Run the Node
sudo -u casper /etc/casper/pull_casper_node_version.sh $CASPER_NETWORK.conf $CASPER_VERSION
sudo -u casper /etc/casper/config_from_example.sh $CASPER_VERSION
Upgrade to casper-node v1.1.1
curl -sSf genesis.casperlabs.io/casper/1_1_0/stage_1_1_0_upgrade.sh | sudo bash
Upgrade to casper-node v1.1.2
curl -sSf genesis.casperlabs.io/casper/1_1_2/stage_upgrade.sh | sudo bash -
Upgrade to casper-node v1.2.0
curl -sSf genesis.casperlabs.io/casper/1_2_0/stage_upgrade.sh | sudo bash -
Upgrade to casper-node v1.2.1
curl -sSf genesis.casperlabs.io/casper/1_2_1/stage_upgrade.sh | sudo bash -
Upgrade to casper-node v1.3.2
cd ~; curl -sSf genesis.casperlabs.io/casper/1_3_2/stage_upgrade.sh | sudo bash -
Upgrade to casper-node v1.3.4
cd ~; curl -sSf genesis.casperlabs.io/casper/1_3_4/stage_upgrade.sh | sudo bash -
Upgrade to casper-node v1.4.1
cd ~; curl -sSf genesis.casperlabs.io/casper/1_4_1/stage_upgrade.sh | sudo bash -
Upgrade to casper-node v1.4.3
cd ~; curl -sSf genesis.casperlabs.io/casper/1_4_3/stage_upgrade.sh | sudo bash -
Upgrade to casper-node v1.4.4
cd ~; curl -sSf genesis.casperlabs.io/casper/1_4_4/stage_upgrade.sh | sudo bash -
Start the node
sudo logrotate -f /etc/logrotate.d/casper-node
sudo systemctl start casper-node-launcher; sleep 2
systemctl status casper-node-launcher
Now i am getting error
**casper-node-launcher.service - Casper Node Launcher
Loaded: loaded (/lib/systemd/system/casper-node-launcher.service; enabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Mon 2022-03-28 12:51:28 UTC; 4s ago
Docs: https://docs.casperlabs.io
Process: 331545 ExecStart=/bin/sh -c exec /usr/bin/casper-node-launcher 1>> /var/log/casper/casper-node.log 2>> /var/log/>
Main PID: 331545 (code=exited, status=1/FAILURE)
Mar 28 12:51:28 Disk1 systemd[1]: casper-node-launcher.service: Scheduled restart job, restart counter is at 3.
Mar 28 12:51:28 Disk1 systemd[1]: Stopped Casper Node Launcher.
Mar 28 12:51:28 Disk1 systemd[1]: casper-node-launcher.service: Start request repeated too quickly.
Mar 28 12:51:28 Disk1 systemd[1]: casper-node-launcher.service: Failed with result 'exit-code'.
Mar 28 12:51:28 Disk1 systemd[1]: Failed to start Casper Node Launcher.**

@UMANGAWASTHY Thank you for taking the tie to report this issue.
Is this a Mainnet installation? If so, could you please check /etc/casper/1_0_0/config.toml to see if you have a proper trusted hash?

Closing due to inactivity. Please do not hesitate to reopen it if you are still experiencing the issue.


enhance logging wrappers

Let me know if there is more to do.

The smoketest is not meant to be a general purpose package. General purpose logging should be in gpiotest. Also it needs to implement RealPin.

I had to duplicate the since(...) helper function
https://github.com/google/periph/pull/237/commits/b23169381454fa9d36d2bc9289d41b603b4849e0#diff-22d747d7eae9c9b12c68d86f1cbdc1caR133
https://github.com/google/periph/pull/237/commits/b23169381454fa9d36d2bc9289d41b603b4849e0#diff-d2dff21c2fe1079b4d1c091fb40fca32R476
as gpiotest.LogPin and gpiosmoketest both depend on it. You probably either want to have since(..) moved to some util package or remove its dependency from LogPin?

Falsely rebased on master instead of v3 branch. However now it should be fine.

gohci

Normally non experimental packages should have 100% test coverage, I will add as a follow up.


fix(CreateTearsheet): Fix for issue #2980 with CreateTearsheet

Contributes to https://github.com/carbon-design-system/ibm-products/issues/2980
Default value for verticalPosition prop was normal which is changed now to "lower"
What did you change?
Changed the default prop value to "lower"
How did you test and verify your work?
This is a simple prop change

hey @rakesh-musturi thanks for helping out. there may be a slight confusion about what needs to be done. currently verticalPosition is being deprecated in the underlying shell component. the change you actually need to make to get rid of any messaging regarding this can be found here https://github.com/carbon-design-system/ibm-products/blob/29b5206096b3b28e6a2c4e14ff4721769c433821/packages/ibm-products/src/components/Tearsheet/TearsheetShell.js#L349


Fixed linting in 'io-events.ts'

Fixes #165
This is the simple PR to fix linting in io-events.ts.

Thank you @seog-jun, I just merged it!


"Harmonize" all software versions with PalAss (permanent host)

Any migration of the site to its proper home (palass.org?) will need to start here. We've tried to keep close to their current versions of PHP, MySQL, etc. but it's possible that recent security fixes have put some distance between us.
If other websites are "stuck" with old versions for any reason, we might try isolating incompatible websites either physically (on a separate server) or using virtualization tools.

Regarding PHP and MySQL on PalAss hosting:

We are now on PHP 5.4.35-41 , and mysql 5.5.40-26

php-mysqlnd is disabled and #74 has been addressed. Pending a review of the PalAss-hosted site, this should be complete.
The only other software to harmonize would be Node.js and related npm packages for the fcdb-api.


Latest update broke finding the right project from the list when using keyboard

How to recreate the bug in Trello:
Start the timer, click on the project select tab, type the first few letters of the project name - it used to select the project that matched the letters, but now it starts editing Trello card name instead.

Seems to be very specific to Trello. Trello ui seems to intercept focusing the filter field. This needs a workaround or new way of showing the filter input field.


Document JSON-RPC changes.

This is for  https://github.com/apache/trafficserver/pull/7478  and https://github.com/apache/trafficserver/pull/8630


Add inline validation for fields in Namespaces#index form

Currently there's no inline feedback validation when for back-end validation. The only way of showing validation is through the floating alert which is not good for this case.

The investigation for this can be useful to fix #861 and #1355.

The investigation for this can be useful to fix #861 and #1355.

It definitely was.


Scrapper not searching with the keyword entered

Thanks for such a wonderful tool @spinlud !
I tried running the scrapper but it is not working with keywords i.e. if I search for any position like 'Performance Marketing' then it is not searching for that keyword. Rather it is giving out general job postings irrespective of the keywords. I am using the code in the example folder. Please have a look at it once!

from linkedin_jobs_scraper import LinkedinScraper
from linkedin_jobs_scraper.events import Events, EventData
from linkedin_jobs_scraper.query import Query, QueryOptions, QueryFilters
from linkedin_jobs_scraper.filters import RelevanceFilters, TimeFilters, TypeFilters, ExperienceLevelFilters
from csv import writer

def on_data(data: EventData):
    with open('linkedinFile.csv', 'a+', newline='') as write_obj:
        # Create a writer object from csv module
        csv_writer = writer(write_obj)
        # Add contents of list as last row in the csv file
        csv_writer.writerow((data.title, data.company, data.date, data.link, data.description))
        print('[ON_DATA]', data.title, data.company, data.date, data.link, len(data.description))

def on_error(error):
    print('[ON_ERROR]', error)

def on_end():
    print('[ON_END]')

scraper = LinkedinScraper(
    chrome_executable_path='/Users/shikharvaish/Downloads/chromedriver',
    chrome_options=None,  # You can pass your custom Chrome options here
    max_workers=1,  # How many threads will be spawn to run queries concurrently (one Chrome driver for each thread)
    slow_mo=1,  # Slow down the scraper to avoid 'Too many requests (429)' errors
)

# Add event listeners
scraper.on(Events.DATA, on_data)
scraper.on(Events.ERROR, on_error)
scraper.on(Events.END, on_end)

queries = [
    Query(
        options=QueryOptions(
            optimize=False,  # Blocks requests for resources like images and stylesheet
            limit=207  # Limit the number of jobs to scrape
        )
    ),
    Query(
        query='Performance Marketing',
        options=QueryOptions(
            locations=['Worldwide'],
            optimize=True,
            limit=5,
            filters=QueryFilters(
                # company_jobs_url="https://www.linkedin.com/jobs/search/?f_E=3%2C4%2C5%2C6&f_F=mrkt&f_JT=F&geoId=92000000&keywords=performance%20marketing&location=Worldwide",  # Filter by companies
                relevance=RelevanceFilters.RELEVANT,
                time=TimeFilters.MONTH,
                type=[TypeFilters.FULL_TIME],
                experience=[ExperienceLevelFilters.ASSOCIATE, ExperienceLevelFilters.DIRECTOR, ExperienceLevelFilters.MID_SENIOR],
            )
        )
    ),
]

scraper.run(queries)

Hi, you are passing two queries to the scraper:

The first one has no keyword nor location with a limit of 207 records, so basically you are searching for all types of jobs in the world.
The second query ('Performance Marketing') gives me results as expected:

Hi, you are passing two queries to the scraper:

The first one has no keyword nor location with a limit of 207 records, so basically you are searching for all types of jobs in the world.
The second query ('Performance Marketing') gives me results as expected:

Thanks a lot @spinlud . It worked :)

Thanks a lot @spinlud . It worked :)


Theme Color field

When Colors is installed, a dynamic blueprint should add a theme color field:
https://getkirby.com/plugins/hananils/colors
Otherwise, fall back to config option. Needs to be disabled if developers want to customize the theme color, e.g. with media queries (Panel UI should only focus on the simplest stuff)

Replaced by #14


[WIP/ENH] - Extra updates

This is a collection of updates, including:

adding the sum_time_ranges helper function
updates some management of selecting time_ranges to compute measures across
some updates to doctests (trying to simplify)
update to inclusiveness of time range selection**

**this is the most important update. Previously, we did all time selection with inclusive starts and ends, which seems nice (selecting [2, 4] from [1.2, 2.0, 3.1, 4.0] would return [2.0, 4.0]) - but this can lead to some problems, most notably, if we do something like stepwise segment extraction, we can select the same value twice (eg., the value 4.0 would be selected for both time ranges [2, 4] and for [4, 6]). To avoid this problem, this update makes all time range selections inclusive start, exclusive end (so - values >= start & < end). This is broadly consistent with what numpy does, so I think it makes sense.

Codecov Report

Merging #154 (5bf1c49) into main (63a75a6) will increase coverage by 0.00%.
The diff coverage is 100.00%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
@@           Coverage Diff           @@
##             main     #154   +/-   ##
=======================================
  Coverage   98.34%   98.35%
=======================================
  Files          94       94
  Lines        3074     3091   +17
=======================================
+ Hits         3023     3040   +17
  Misses         51       51

Impacted Files
Coverage Δ

spiketools/tests/utils/test_timestamps.py
100.00% <100.00%> (ø)

spiketools/utils/timestamps.py
97.29% <100.00%> (+0.63%)
:arrow_up:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

Codecov Report

Merging #154 (4419cec) into main (63a75a6) will increase coverage by 0.01%.
The diff coverage is 100.00%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
@@            Coverage Diff             @@
##             main     #154      +/-   ##
==========================================
+ Coverage   98.34%   98.35%   +0.01%
==========================================
  Files          94       94
  Lines        3074     3104      +30
==========================================
+ Hits         3023     3053      +30
  Misses         51       51

Impacted Files
Coverage Δ

spiketools/spatial/place.py
96.42% <ø> (ø)

spiketools/utils/epoch.py
100.00% <ø> (ø)

spiketools/measures/spikes.py
100.00% <100.00%> (ø)

spiketools/measures/trials.py
100.00% <100.00%> (ø)

spiketools/tests/utils/test_extract.py
100.00% <100.00%> (ø)

spiketools/tests/utils/test_timestamps.py
100.00% <100.00%> (ø)

spiketools/utils/extract.py
98.83% <100.00%> (+0.01%)
:arrow_up:

spiketools/utils/timestamps.py
97.29% <100.00%> (+0.63%)
:arrow_up:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

Codecov Report

Merging #154 (565f15e) into main (a55419b) will increase coverage by 0.01%.
The diff coverage is 100.00%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
@@            Coverage Diff             @@
##             main     #154      +/-   ##
==========================================
+ Coverage   98.52%   98.53%   +0.01%
==========================================
  Files          96       96
  Lines        3394     3423      +29
==========================================
+ Hits         3344     3373      +29
  Misses         50       50

Impacted Files
Coverage Δ

spiketools/utils/epoch.py
100.00% <ø> (ø)

spiketools/measures/spikes.py
100.00% <100.00%> (ø)

spiketools/measures/trials.py
100.00% <100.00%> (ø)

spiketools/tests/utils/test_extract.py
100.00% <100.00%> (ø)

spiketools/tests/utils/test_timestamps.py
100.00% <100.00%> (ø)

spiketools/utils/extract.py
98.85% <100.00%> (+0.01%)
:arrow_up:

spiketools/utils/timestamps.py
97.50% <100.00%> (+0.53%)
:arrow_up:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Import scanpy not found

Hello,
When I try to download the latest version from github I get an import error in my conda env, the pypi installation works fine.
      Traceback (most recent call last):
        File "/home/chang/miniconda3/envs/venv/lib/python3.8/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 363, in <module>
          main()
        File "/home/chang/miniconda3/envs/venv/lib/python3.8/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 345, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
        File "/home/chang/miniconda3/envs/venv/lib/python3.8/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 144, in get_requires_for_build_editable
          return hook(config_settings)
        File "/tmp/pip-build-env-nrq06iwn/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 445, in get_requires_for_build_editable
          return self.get_requires_for_build_wheel(config_settings)
        File "/tmp/pip-build-env-nrq06iwn/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 338, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=['wheel'])
        File "/tmp/pip-build-env-nrq06iwn/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 320, in _get_build_requires
          self.run_setup()
        File "/tmp/pip-build-env-nrq06iwn/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 335, in run_setup
          exec(code, locals())
        File "<string>", line 8, in <module>
        File "/home/chang/cospar/cospar/__init__.py", line 4, in <module>
          from . import datasets, hf, logging, pl, pp, settings, simulate, tl, tmap
        File "/home/chang/cospar/cospar/datasets.py", line 4, in <module>
          from scanpy import read
      ModuleNotFoundError: No module named 'scanpy'

Any ideas why this is occuring?
Thanks,
Chang

The last line suggests that you should install scanpy, also some other packages. Try “pip install -r requirements.txt”
Get Outlook for iOShttps://aka.ms/o0ukef

From: Chang Kim @.>
Sent: Thursday, September 8, 2022 6:44:36 PM
To: AllonKleinLab/cospar @.>
Cc: Subscribed @.***>
Subject: [AllonKleinLab/cospar] Import scanpy not found (Issue #19)
Hello,
When I try to download the latest version from github I get an import error in my conda env, the pypi installation works fine.
  Traceback (most recent call last):
    File "/home/chang/miniconda3/envs/venv/lib/python3.8/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 363, in <module>
      main()
    File "/home/chang/miniconda3/envs/venv/lib/python3.8/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 345, in main
      json_out['return_val'] = hook(**hook_input['kwargs'])
    File "/home/chang/miniconda3/envs/venv/lib/python3.8/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 144, in get_requires_for_build_editable
      return hook(config_settings)
    File "/tmp/pip-build-env-nrq06iwn/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 445, in get_requires_for_build_editable
      return self.get_requires_for_build_wheel(config_settings)
    File "/tmp/pip-build-env-nrq06iwn/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 338, in get_requires_for_build_wheel
      return self._get_build_requires(config_settings, requirements=['wheel'])
    File "/tmp/pip-build-env-nrq06iwn/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 320, in _get_build_requires
      self.run_setup()
    File "/tmp/pip-build-env-nrq06iwn/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 335, in run_setup
      exec(code, locals())
    File "<string>", line 8, in <module>
    File "/home/chang/cospar/cospar/__init__.py", line 4, in <module>
      from . import datasets, hf, logging, pl, pp, settings, simulate, tl, tmap
    File "/home/chang/cospar/cospar/datasets.py", line 4, in <module>
      from scanpy import read
  ModuleNotFoundError: No module named 'scanpy'

Any ideas why this is occuring?
Thanks,
Chang
—
Reply to this email directly, view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_AllonKleinLab_cospar_issues_19&d=DwMCaQ&c=WO-RGvefibhHBZq3fL85hQ&r=HV3hSxJneq48OyAO3fZXR0hE5NwTsotE_nsykGsxi-U&m=NN1RTi15bZRSaCHqAJV90CfIpKYFJoRkxtzicRSZXGFsCPViOBf22BKNUQQBpkJ8&s=sesr7ZGI0PwBUhi-v0R8qjAvgB9hj3P7vo3ohT_J3sM&e=, or unsubscribehttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_ABDCASTY45UAJDGKRARQHB3V5JT5JANCNFSM6AAAAAAQIFX32Y&d=DwMCaQ&c=WO-RGvefibhHBZq3fL85hQ&r=HV3hSxJneq48OyAO3fZXR0hE5NwTsotE_nsykGsxi-U&m=NN1RTi15bZRSaCHqAJV90CfIpKYFJoRkxtzicRSZXGFsCPViOBf22BKNUQQBpkJ8&s=WLz2A-r0pTqmNCCPAO_ZE--r4ipnHNlJtenUOXs_M38&e=.
You are receiving this because you are subscribed to this thread.Message ID: @.***>

So it is installed, I even tried it with a new conda venv and it gives the same error.

Try this
conda create -n CoSpar_envs python=3.8
conda activate CoSpar_envs
pip install -r  requirements.txt
pip install pot scanpy wot
pip install --user ipykernel
python -m ipykernel install --user --name=CoSpar_envs

This should be run at the root directory of cospar folder

Hmm it still doesn't work with that environment. I even tried to install it locally on my macbook, but I get the same exact error...

Maybe, you can try to install with pip install cospar into a given environment. Then, uninstall cospar with pip uninstall cospar, and then go to the CoSpar directory that you clone from here, and run python setup.py install or python setup.py develop.


Add 'lenin_atlassian' to 'Atlassian Jira Software Cloud' plugin

Description
Allow 'lenin_atlassian' (username of my account at accounts.jenkins.io) to deploy the plugin 'Atlassian Jira Software Cloud'.
GitHub repository: https://github.com/jenkinsci/atlassian-jira-software-cloud-plugin
Plugin Homepage: https://plugins.jenkins.io/atlassian-jira-software-cloud/
cc @rafalmyslek
Submitter checklist for adding or changing permissions
Always

[x] Add link to plugin/component Git repository in description above

When adding new uploaders (this includes newly created permissions files)

[x] Make sure to @mention an existing maintainer to confirm the permissions request, if applicable
[x] Use the Jenkins community (LDAP) account name in the YAML file, not the GitHub account name
[x] Make sure to @mention the users being added so their GitHub account names are known if they require GitHub merge access (see below).
[x] All newly added users have logged in to Artifactory at least once

Reviewer checklist (not for requesters!)

[ ] Check this if newly added person also needs to be given merge permission to the GitHub repo (please @ the people/person with their GitHub username in this issue as well). If needed, it can be done using an IRC Bot command
[ ] Check that the $pluginId Developers team has Admin permissions while granting the access.
[ ] In the case of plugin adoption, ensure that the Jenkins Jira default assignee is either removed or changed to the new maintainer.
[ ] If security contacts are changed (this includes add/remove), ping the security officer (currently @daniel-beck) in this pull request. If an email contact is changed, wait for approval from the security officer.

There are IRC Bot commands for it

@slide Can you please review and merge this? (Similar to https://github.com/jenkins-infra/repository-permissions-updater/pull/1189)

@lenin-atlassian this needs approval from @rafalmyslek

I approve

@timja Rafal has approved. Can you merge now?


Eliminate code repetition in OTEL components

Describe the solution you'd like

Eliminate code repetition at following

Across log and trace processing in metrics processor and rollup processor
Across log, trace and metric iteration in otelcollector.Iterate*
Across switch cases in otelcollector.IterateDataPoints

Use go generics or act on common structs so that the same function can operate on ptrace.Traces, plog.Logs or pmetric.Metric (Mostly addressed since Span has been removed from the pipelines)

Obsolete


Add flatmap alias

Short flatMap alias comes in handy in some situations, eg:
val name: UIO[String] = UIO.succeed("John")
def salute(name: String): UIO[String] = UIO.succeed(s"Hello $name, how are you?")

import scalaz.zio.console._
val io: ZIO[Console, Nothing, Unit] = name >>= salute >>= putStrLn

The focus of (re)naming recently has been to unapologetically excise jargon, so I wouldn't hold high hopes for this...

I would argue that:

we already have <*, *> and as, why treat >>= diffrent?
its nothing new, it is well established among cats users
as John repeated countless times in his workshop - the rule of thumb is to push decisions upstream in app/interface design, I think the same applies in library design - let the user (developer) decide which syntax he prefers
I just can't see any downside of adding this, its just a few lines, simple alias, no maintenance burden at all

Yeah, but the same argument applies as to traverse/sequence on their removal - if you need FP names, you probably use an FP library already, so just import its syntax and the appropriate interop package.
Note that I'm not against, either, just arguing for consistency.

@kaishh I don't know the larger context of traverse/sequence discussion, but I'd like to address

if you need FP names, you probably use an FP library already

I'm actually right now writing a pure-zio app with no other FP dependencies and I found myself looking for this alias as I had code block looking like:
for {
  string1 <- someIO1 >>= someIO2 >>= someIO3
  string2 <- someIO4
} yield s"$string1/$string2"

The flatMap alternative is much less readable (it becomes a blurry blob of text):
for {
  string1 <- someIO1 flatMap someIO2 flatMap someIO3
  string2 <- someIO4
} yield s"$string1/$string2"

The for-comprehension alternative is too expressive (exposes too much in the main for-loop, obfuscating the higher-level structure of "compute string1 then string2 and finally combine them")
for {
  part1 <- someIO1
  part2 <- someIO2(part1)
  string1 <- someIO3(part2)
  string2 <- someIO4
} yield s"$string1/$string2"

ZIO has a precedent for having both operators and named methods (e.g. && and both on Schedule, <> and orElse on ZIO, etc.), and currently that's the only area of redundancy: i.e. there is always (or should always be) a named method for every operator, but never two method names for the same operator. The rational is that many people do not like operators, and method names are much easier to look up, as well as guide pronunciation of operators.
For this reason, I'm 👍 on adding an operator alias for flatMap, even though I'm 👎 on having more than one name for the same operation (e.g. flatMap and smooshMap and chain and andThen), especially if you can get the alternate name(s) through a Cats / Scalaz import.

Well then, in this goes.


[FEATURE] JRTB-13: implement deployment process

Implement deployment process using docker image.
Acceptance criteria:

dockerfile added to the project.
deployment process with providing environment variables is added to the project

implement in #23


plotting measured linear features without type

If make a linear measurement but don’t choose a Linear Feature Type the map draws a line arrow symbol that points to the north, even though it should point to the trend direction.

The arrow symbol points in the trend direction for me.  @panamint55 can you recreate this issue?

@panamint55 Unable to reproduce as well. Closing.


Missing values in MVN distribution

Hi,
Firstly, thanks so much for developing NIMBLE - it's been fantastic and we're using it for all sorts of interesting problems. However, I've run into a slight problem, which I think might be a bug.
I've been trying to fit multivariate normal models with some missing data (but only in a subset of the dimensions). In this case it seems that NIMBLE will essentially treat the entire row as missing, rather than just one element, and assigns a posterior predictive sampler accordingly. I've included a reproducible example below
## load libraries
library(nimble)
library(MASS)

## simulate some data
dataset <- mvrnorm(100, c(1, 2), diag(2))

## set some missing data
dataset[1, 1] <- NA

## set model code
code <- nimbleCode({
    for(i in 1:N) {
        y[i, ] ~ dmnorm(mu[], cov = sigma[, ])
    }
    mu[] ~ dmnorm(mu0[], cov = sigma0[, ])
})

## set up other components of model
consts <- list(N = nrow(dataset))
data <- list(
    y = as.matrix(dataset),
    mu0 = c(0, 0),
    sigma0 = diag(2),
    sigma = diag(2)
)

## sample initial values
initFn <- function(mu0, sigma0, y) {
    mu <- mvrnorm(1, mu0, sigma0)
    y1 <- y
    y1[!is.na(y)] <- NA
    y1[is.na(y)] <- 0
    list(mu = mu, y = y1)
}

## define the model, data, inits and constants
model <- nimbleModel(
    code = code,
    constants = consts,
    data = data,
    inits = initFn(data$mu0, data$sigma0, data$y))

## compile the model
cmodel <- compileNimble(model)

## set monitors
config <- configureMCMC(cmodel, monitors = c("mu", "y"), thin = 1)

## check monitors and samplers
config$printMonitors()
config$printSamplers()

## build the model
built <- buildMCMC(config)
cbuilt <- compileNimble(built)

## run the model
cbuilt$run(niter = 10)

Here I only expect y[1, 1] to be updated and not y[1, 2]. I can overcome this (I think) by fitting the MVN as a product of the conditionals in an appropriate way, but I thought I'd flag this.
Many thanks,
TJ

So I've been thinking about this and I'm not quite following why analytical forms for the conditionals would be required for a RW M-H algorithm, since you could just use the ratio of the joint densities. For example, if I had a generic multivariate variable  say, with joint density , then if I did a RW Metropolis proposal for , conditional on the other dimensions / parameters being fixed, then the MH acceptance probability is:

where  is the proposed value. Asymmetric or MV RW proposals could be implemented in the usual way, in which case all that you would need is the joint MV density and some index vector telling you which dimensions to update accordingly.
Just a thought in case it might be a useful feature. Apologies if I'm missing something obvious.

In case it's of interest, I've attached some code below which seems to work without requiring the conditionals. I've used the standard RW and RW_block sampler code, but amended to work with MV nodes where only subsets are updated (I did remove the reflective sampling bit of the standard RW when I was testing out, sorry. Otherwise they should be very close to the originals and hence allow for adaptation etc.). The dimensions to update are passed in as control variables, hence the setup loop.
The reprex4.R file contains the run-time code, but the other two files need to be in the working directory and contain the custom samplers.
reprex4.zip
Man, I love NIMBLE! Many thanks.

TJ, my apologies for the delay in responding.  I took a look over your
code, and it's a nice approach to sampling the missing dimensions of
multivariate nodes.  Thanks for making these modifications, and sharing
them also.
I'm planning to speak with development team, and discuss possible paths
forward for incorporating this - or something similar - into the package.
It won't be a quick addition, since we'll carefully consider how it fits
into the over MCMC and nimble package structure.  But this is a great
starting point, and we appreciate.
Thanks again.  I'll keep you posted as it develops.
Daniel
On Thu, May 13, 2021 at 12:35 PM TJ McKinley @.***>
wrote:

In case it's of interest, I've attached some code below which seems to
work without requiring the conditionals. I've used the standard RW and
RW_block sampler code, but amended to work with MV nodes where only subsets
are updated (I did remove the reflective sampling bit of the standard RW
when I was testing out, sorry. Otherwise they should be very close to the
originals and hence allow for adaptation etc.). The dimensions to update
are passed in as control variables, hence the setup loop.
The reprex4.R file contains the run-time code, but the other two files
need to be in the working directory and contain the custom samplers.
reprex4.zip
https://github.com/nimble-dev/nimble/files/6473796/reprex4.zip
Man, I love NIMBLE! Many thanks.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/nimble-dev/nimble/issues/1126#issuecomment-840679934,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABCNNYLGKFME65JHR6HVUSTTNP5TNANCNFSM44KNYYRA
.

Hi Daniel,
No worries at all and thanks for the response. Of course, there's no pressure to adopt any of these ideas, but if they're useful to build upon then that's great.
Much appreciated,
TJ

I'm finally looking back into the question of warning users about multivariate nodes that have inconsistent data flagging amongst the scalar elements of the node. We're treating this very poorly, as isData just returns the T/F for the first element of the node. We have a comment about this in isDataFromGraphID but no warning to user. What this means is that if we have, say,
y[1:2] ~ dmnorm(mu[1:2], pr[1:2, 1:2])

and set y=c(NA,3) vs. y=c(3,NA), we get different behavior as to whether the multivariate node is considered data (no in the first case and yes in the second case).
My suggestion here is to modify isDataFromGraphID()  to:

Warn users if a multivariate node has mixed T/F in the model's isDataEnv, which is the canonical source of info about whether something is data.
We set the result of isDataFromGraphID to always either be TRUE or FALSE in mixed T/F cases.

So we'd have to decide whether we want to always set it TRUE or always FALSE.
If we always set it to be TRUE, that will hit the user in the eyes, because the likelihood will always be NA. I don't see a way for them to then run an MCMC because of the various processing steps that check the data flag, though there might be a hack.
If we always set to FALSE, a user's MCMC will run, but it will initialize the data values that the user will have expected to stay as the values they originally gave. However, a user could set up a specialized sampler to handle things, and in that sampler they could avoid changing the actual data values. I think they'd need to set initial values for all the NA values so that our initialization doesn't overwrite the entire node. Haven't looked carefully at this. Perhaps what we might want to do is modify our initialization to not initialize such mixed nodes so that we are never opaquely overwriting elements a user expects not to be overwritten. However simulate would still overwrite, so we wouldn't be handling everything.
Given all this, I wonder if always setting to TRUE is best as it forces a user to confront the situation. Then if a user really wants to handle this case, they could instead have data that are not provided as data and do their own careful user-defined MCMC sampling.
@perrydv @danielturek, I'd like your input here, but it may be best to discuss at our next meeting.

I think this is worthy of group discussion at some point.  I agree, it needs attention.

PR #1165 is fixing the behavior of isData.
As far as potential new functionality for such mixed cases such as handling in MCMC, that is of interest but not something the core development team will have time for in the foreseeable future.