[docs] Provide a way for local users to do the Try LitElement tutorial

Currently, the Try LitElement tutorial is only available as StackBlitz examples.
Provide a way for people to do the tutorial and work locally. E.g. put the Try samples on GitHub and provide instructions for doing the tutorial with Polymer CLI

@e111077 flagging this just in case you want to address this in your tutorial work.

We're tracking docs issues in the https://github.com/lit/lit.dev repo now.


Support Go 1.23 iterators for the ZADD command

We support Go 1.23 iterators for HMSET, HSET, and XADD:
https://github.com/redis/rueidis/blob/fc348f545e5ac0315ef9350fa7375bda92b8877e/internal/cmds/iter.go#L7-L26
It would be better to add support for ZADD as well.

Thanks @mingdaoy!


Investigate Could not get core document

A production check fails: managed_data_source_gdrive_gc
This error occurred more than 3 times on December, 3th.
https://app.datadoghq.eu/logs?query="Production check failed"&agg_m=count&agg_m_source=base&agg_t=count&cols=host%2Cservice&event=AwAAAZOPR8nNBnF6JgAAABhBWk9QUjlyQUFBQUJKMkxSdXliYXZnQUIAAAAkMDE5MzhmNDctZjhjMy00ZTk1LWE3MmUtZmEyZmFkMGRkZTg5AAAQCA&fromUser=true&messageDisplay=inline&refresh_mode=sliding&storage=hot&stream_sort=desc&viz=stream&from_ts=1733271809000&to_ts=1733275709000&live=false

stopped occurring could be related to incident with files on GCS, closing for now


Jsoup.parse produces attributes with illegal characters in.

For example,
Jsoup.parse("");

Yields:

But choice' is not a valid attribute name in XML, because ' isn't a valid character in an attribute name: http://www.w3.org/TR/xml/#sec-common-syn (see NameChar)
I suppose I haven't found it specified that the output of Jsoup.parse should be valid XML... is it intended to be?

(Closing out old, dormant bugs. If you are still impacted by this, please reopen & vote.)


autologin support?

Hi,
Thanks for the great work !
Im wondering is there a way to auto login the os? or Prevent turn off after 7-8mins on login page?
I found a reference for chromium os

+1 this would be extremely useful

The purpose of this project is to let people build and customise Chromium OS on Raspberry Pi devices, we will only release vanilla Chromium OS. If you wish to alter Chromium OS tailored to your needs, you should follow the README and build your own.


Error when registering the latest version - No overload matches this call.

I get the error below when trying to register the plugin.

instance.d.ts(115, 19): This type parameter might need an `extends T extends (...args: any[]) => any ? (this: FastifyRequest<RouteGenericInterface, RawServerDefault, http.IncomingMessage, ... 4 more ..., ResolveFastifyRequestType<...>>, ...args: Parameters<T>) => ReturnType<...> : T` constraint.

My code:
import fastifyRawBody from 'fastify-raw-body';

// Register FastifyRAW
await fastify.register(fastifyRawBody, {
  field: 'rawBody', // change the default request.rawBody property name
  global: false, // add the rawBody to every request. **Default true**
  encoding: 'utf8', // set it to false to set rawBody as a Buffer **Default utf8**
  runFirst: true, // get the body before any preParsing hook change/uncompress it. **Default false**
  routes: ['/order/webhook'], // array of routes, **`global`** will be ignored, wildcard routes not supported
});

My packages:
    "fastify": "^4.10.2",
    "fastify-raw-body": "^4.1.3",

Not sure why it happens - but it happened after I updated to the latest version. It also happened with some other plugins, but I just updated those and the error when away for the other plugins

I think we should apply the same nodenext TS compatibility here
https://github.com/search?q=org%3Afastify+nodenext&type=pullrequests
Could you try to install fastify v4.10.0?
Which was your previous version in use?

I think we should apply the same nodenext TS compatibility here https://github.com/search?q=org%3Afastify+nodenext&type=pullrequests
Could you try to install fastify v4.10.0? Which was your previous version in use?

It does not seem to make any difference in Fastify v4.10.0.
I previously used these versions:
    "fastify": "^4.9.2",
    "fastify-raw-body": "^4.1.3",

but that seems to not even work🤔
FastifyError [Error]: fastify-plugin: fastify-raw-body - expected '^4.10.x' fastify version, '4.9.2' is installed```

FastifyError [Error]: fastify-plugin: fastify-raw-body - expected '^4.10.x' fastify version, '4.9.2' is installed

Yes, this was necessary because now this plugin uses request.routeOptions that was released in fastify v4.10

I got it working with the versions below:

Thanks, it is helpful to replicate and solve the issue

@BE-CH could you verify that the PR #45 works for you?

@BE-CH could you verify that the PR #45 works for you?

It works! Thank you so much :)

I did not release it
I will close later today

@Eomm will you release it to a new version? or can I simply just do yarn install again to get the latest additions?


Extract remaining tests

Conflicts here. Feel free to do a single PR with all these changes so that there are no more conflicts.

Rebased this PR, cherry-picking the other stuff in and squashing it into a single commit.
This removes the data.php file completely.
I'm just not a 100% happy with the inconsistency of the collection and nullable assertions. all assertions can be used with collections and we have a few tested in collections.php while the even fewere nullable assertions are just next to their "normal" tests. I was thinking of moving collection assertions there too, but maybe I'm overthinking the cleanup now :)

sorry for my impatience, can we merge this? :) I'd love to get the remaining 2 count assertions in afterwards

Thank you :)


Link to BoardGameGeek

This commit adds a bggId field to the BasedOn type, populates that field for existing BasedOn entries, and, if present, uses it to create a link to BoardGameGeek from the game pages.
The styling of the link perhaps needs more consideration.  Iʼve added it unobtrusively, but you may decide thatʼd you like to give it more prominence, or even hide it entirely behind, say, JSON-LD.
Motivation
Iʼd like to include these and future games in my online boardgame directory at https://www.mavit.org.uk/boardgames-online/.  If thereʼs metadata to scrape, I can set things up so that happens automatically.

Thanks for your PR! I agree the style needs more consideration. I think it would make the most sense to be a new link on another line, although I'm not convinced that it is necessary when the link to the manufacturer's site is already there. 🤔

Thanks for your PR! I agree the style needs more consideration. I think it would make the most sense to be a new link on another line, although I'm not convinced that it is necessary when the link to the manufacturer's site is already there. 🤔

I think youʼre right to question this, but BoardGameGeek is often a richer and longer-lasting source of information than a manufacturerʼs website, which can be perfunctory and prone to disappearing once the game goes out of print, so I think it's probably worth it.
Iʼve updated the pull request to include the link on its own line.

I think youʼre right to question this, but BoardGameGeek is often a richer and longer-lasting source of information than a manufacturerʼs website, which can be perfunctory and prone to disappearing once the game goes out of print, so I think it's probably worth it.
Iʼve updated the pull request to include the link on its own line.

Apologies for the delay! Thanks again for this PR! I think I'm going to merge it back into the "Based on" line, but as a separate link.


NamedTuples not being documented properly

Note the redundancy and all the "Alias for field number X" in classes such as optax.MultiStepsState: https://optax.readthedocs.io/en/latest/api/optimizer_wrappers.html#optax.MultiStepsState

I took a look at using sphinx-toolbox to autodoc the namedtuples, but I wasn't able to resolve the duplicate fields showing up. It seems that this is a known issue according to here, not too sure how else to go about fixing this.

Thanks for looking into it @amosyou . Eliminating the "Alias for field ___" would already be better, even if we loose the type information IMO. Could you post a screenshot of how that would look like?

I think that looks good! (module some formatting issues that I thin are orthogonal to this issue). Could you submit a pull request for this?
You're on 🔥 @amosyou !

revisiting this! so removing :members: from the autoclass directives isn't a viable solution since it also removes fields that are accurately documented like for LookaheadState

i've tried using the autodoc-skip-member event as suggested here but it doesn't seem to be removing the duplicate alias fields. i've also tried modifying the _monkey_patch_doc_strings in conf.py to replace lines with "Alias for field number" with empty string, also didn't work. not sure where to go from here 😅

Thank you @amosyou for looking into this!
I've just tried removing :members: from the LookAheadState and the fast_state and steps_since_sync were still in the doc. One can even still have types if we are really brave:
class LookaheadState(NamedTuple):
  """State of the `GradientTransformation` returned by `lookahead`.

  Attributes:
    fast_state (:class:`optax.OptState`): Optimizer state of the fast optimizer.
    steps_since_sync (``jnp.ndarray``): Number of fast optimizer steps taken since
      slow and fast parameters were synchronized.
  """
  fast_state: base.OptState
  steps_since_sync: jnp.ndarray

@vroulet taht solutions looks great to me!

Ok, but I may have missed something, @amosyou can you try again on your side and see if that works?. Your idea of removing the :members: sounded great :). I let you see if you want to open a PR to remove the :members: and (if you are extra brave) adding the types.

oh that looks good! hmm I just tried commenting out :members: again and the entire docstring for LookaheadState is gone from the docs (this has never happened before).

Strange. All states are missing in that screenshot (they're in pink not in blue). There may be another issue?
Here is the modification of the code on my side:
Flatten
~~~~~~~~
.. autofunction:: flatten

Lookahead
~~~~~~~~~~~~~~~~~
.. autofunction::  lookahead
.. autoclass::  LookaheadParams
   :members:
.. autoclass::  LookaheadState

Masked update
~~~~~~~~~~~~~~
.. autofunction::  masked
.. autoclass::  MaskedState
   :members:

So really just removing the line :members: below LookaheadState

my bad! commenting in rst is not with # that was why they were missing 🤥
on a side note, I think to have proper rendering of the docstring we need to change Fields to Attributes (even though we're working with namedtuples here since we're using autoclass). hope that's fine?
i'll create a PR for this. thanks @vroulet!

Yes, typically, MultiStepState should be reformatted with attributes instead of fields. Thanks again for looking into that!

also for ApplyIfFiniteState, I noticed that all the fields are typed as Any. Did we figure out a solution for the typing jnp.array?

also for ApplyIfFiniteState, I noticed that all the fields are typed as Any. Did we figure out a solution for the typing jnp.array?

They should be Union[jax.Array, int] for notfinite_count, last_finite, and total_notfinite, I believe.
For inner_state it should be the usual base.Optstate

my bad! commenting in rst is not with # that was why they were missing 🤥
on a side note, I think to have proper rendering of the docstring we need to change Fields to Attributes (even though we're working with namedtuples here since we're using autoclass). hope that's fine?
i'll create a PR for this. thanks @vroulet!

PS: no need to add types for all attributes (it's possible but it would take forever). Simply remove the :members: in the doc. If people want to know the types, they should be able to click on [source] in the doc.
That said, if you find some issues (like the fields in MultiStepsState (which is badly formatted anyway) or like in the ApplyFiniteState you pointed out), would be super cool if you could fix them by the way. We can review that in your PR together.


Upgrade Helix lib to Apache Helix 1.0.0

upgraded Helix lib to latest version(1.0.0)
fixed test failure and conflicts due to new changes in Helix lib.

Upgrade to latest version http://helix.apache.org/1.0.0-docs/index.html
No production code changes in this PR.

LGTM. Is there something specific we want from the new version?

According to its release notes, following bugs have been fixed:
Fix the ConcurrentModificationException in ClusterEvent.java (#785)
Generate cancellation message for currentState=null desiredState=DROPPED (#831)
Fix the concurrent modification error happens during the HelixManager initHandlers() call (#904)
Fix the scheduling decision for multiple currentStates (#923)
Fix ZkHelixPropertyStore loses Zookeeper notification issue (#924)

The 904 is what we need and 785/924 help Ambry as well.

Codecov Report

Merging #1521 into master will decrease coverage by 0.06%.
The diff coverage is 65.00%.

@@             Coverage Diff              @@
##             master    #1521      +/-   ##
============================================
- Coverage     73.81%   73.75%   -0.07%
+ Complexity     8084     8078       -6
============================================
  Files           566      566
  Lines         44309    44346      +37
  Branches       5601     5609       +8
============================================
- Hits          32708    32707       -1
- Misses         9963     9994      +31
- Partials       1638     1645       +7

Impacted Files
Coverage Δ
Complexity Δ

...com/github/ambry/account/AccountMetadataStore.java
100.00% <ø> (ø)
6.00 <0.00> (ø)

...va/com/github/ambry/account/BackupFileManager.java
82.77% <ø> (ø)
39.00 <0.00> (ø)

.../com/github/ambry/account/HelixAccountService.java
84.61% <ø> (ø)
33.00 <0.00> (ø)

...thub/ambry/account/HelixAccountServiceFactory.java
87.50% <ø> (ø)
3.00 <0.00> (ø)

.../com/github/ambry/account/LegacyMetadataStore.java
88.37% <ø> (ø)
5.00 <0.00> (ø)

...ain/java/com/github/ambry/commons/CommonUtils.java
80.00% <ø> (ø)
4.00 <0.00> (ø)

...ub/ambry/clustermap/HelixBootstrapUpgradeUtil.java
82.26% <ø> (ø)
142.00 <0.00> (ø)

...m/github/ambry/clustermap/HelixClusterManager.java
88.82% <ø> (ø)
63.00 <0.00> (ø)

...ry/clustermap/HelixHealthReportAggregatorTask.java
0.00% <ø> (ø)
0.00 <0.00> (ø)

...n/java/com/github/ambry/commons/HelixNotifier.java
97.33% <ø> (ø)
16.00 <0.00> (ø)

... and 18 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 489a4f8...4e92b3a. Read the comment docs.


Add functionality from TypeScript implementation

I used Claude 3.5 Sonnet in several iterations to add functionality from the huggingface.js implementation. Honestly, I don't understand everything, and I was hoping this could be a quick fix for vision language models and function calling. It probably needs to be cleaned up, at the very least. Maybe you can take a look and see if it's useful at all.

Thank you for your PR, it's great! Could you please provide some test cases?
I may not have time until next month. I've been a bit busy lately.
Hi @pcuenca ! Do you have time to help review this PR?

I'll add some tests for images and function calling and try to polish this up a bit.

Hi @DePasqualeOrg, thanks a lot for the effort! It's a long diff, I can try to take a look in a couple of days. Do we need everything at once, including namespaces, built-in functions and tool calling, or could this potentially be approached in a few phases?

Tool calling could definitely be postponed for later. That seems to be more complicated to test for anyway. Since we now have support for vision language models in mlx-libraries, maybe that should be the focus here.
If it's too hard to separate out the changes, maybe we can focus on test coverage for image models in this PR, and add tests for function calling in a later PR?

It looks like Qwen2-VL is the only other major vision language model that includes image handling in the chat template, so now we have tests for image handling in Qwen2-VL and Llama 3.2, and I think this is ready for review.
Sorry in advance for the somewhat messy approach here. I did actually spend the better part of a day putting everything together. I'm sure it's not perfect, but I wanted to get the ball rolling on this.
One thought I had was that we can benefit from the work that has already been done on the TypeScript implementation by keeping the Swift implementation as close to it as possible. As LLMs get even better, they'll be able to port things more easily, and keeping the libraries roughly isomorphic would help with that.

I've rebased this after formatting the repo with swift-format, to make it easier for @pcuenca to review it. The tests for images and videos are passing. For now I'm not testing the tool-calling functionality. My goal is to get the chat templates for vision models working and to focus on tool calling later.

The existing tests as well as some additional ones I added pass. I added some tests for tool use based on the ones in the TypeScript implementation, but I can't get them to pass after many hours of trying. Someone smarter than me will have to take it from here. This should already work for vision models, though.


questions about detect the Nm of mRNA by NanoNm

hello there, we tried to use the NanoNm to detect the Nm site of directRNA-seq data, but we could not get the results, some steps of the pipeline doesn't work. So, we would like to know what kind of files or data should we prepared beside directRNA-seq data before we start analysis. Can you provide some details instructions about this tool, which will help us a lot. Thank you.

Thanks for your question, I updated the readme file, it is applied to human genome. Hope it helps.
#downloaded gencode.v27.transcripts.fa  from https://ftp.ebi.ac.uk/pub/databases/gencode/Gencode_human/release_27/gencode.v27.transcripts.fa.gz
multi_to_single_fast5  -i ${id}.fast5 -s $id  --recursive -t 40
guppy_basecaller --input_path $id --save_path $id_guppy --num_callers 40 --recursive --fast5_out --config rna_r9.4.1_70bps_hac.cfg  --cpu_threads_per_caller 10
tombo resquiggle --rna --overwrite  ${id}_guppy/workspace/  gencode.v27.transcripts.fa    --processes 40 --fit-global-scale --include-event-stdev
python extract_raw_and_feature_fast_AUCG.py  --cpu=30 --fl = ${id}_guppy.list -o ${id}_guppy.feature --clip=5
cat *.feature.feature.fa >all.feature.fa
cat *.feature.feature.tsv >all.feature.tsv
python predict_sites_Nm.final.py   --model ./model --cpu 20  -i all -o all_Nm_model -r  gencode.v27.transcripts.fa  -g GRCh38.p13.genome.fa  -b hg38.gene2transcripts.txt

Thank you for your quick reply, we will try again.

Hello Dr. Li,
we tired to run the pipeline again, however, there still are some questions. First, how can we get/produce the 'rRNA.Nm1.bed' file in step 1.6 and the 'hg38.gene2transcripts.txt' file in step 3; Second, Do we need to run the whole pipeline from step 1 to step 3, or just run the step3 if we want to detect the Nm of mRNA sequencing data.
Thank you

Yes. You do not need to run step 1-2. You can just use the model to predict Nm in your data from step3.
Best,
Yanqiang
From: mlpy18 @.>
Date: Tuesday, August 13, 2024 at 04:54
To: YanqiangLi/NanoNm @.>
Cc: Yanqiang Li @.>, State change @.>
Subject: Re: [YanqiangLi/NanoNm] questions about detect the Nm of mRNA by NanoNm (Issue #1)
Hello Dr. Li,
we tired to run the pipeline again, however, there still are some questions. First, how can we get/produce the 'rRNA.Nm1.bed' file in step 1.6 and the 'hg38.gene2transcripts.txt' file in step 3; Second, Do we need to run the whole pipeline from step 1 to step 3, or just run the step3 if we want to detect the Nm of mRNA sequencing data.
Thank you
—
Reply to this email directly, view it on GitHubhttps://github.com/YanqiangLi/NanoNm/issues/1#issuecomment-2285719212, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AGQ3YFSBPXYIJ2REBAZX7PTZRHCURAVCNFSM6AAAAABL3XYDGGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOBVG4YTSMRRGI.
You are receiving this because you modified the open/close state.Message ID: @.***>

Thank you for your kind reply. However, we still encounter a problem, it seems there are something wrong about the 'hg38.gene2transcripts.txt' file, how to prepare the right 'hg38.gene2transcripts.txt' file.

The hg38.gene2transcripts.txt is prepared already. Could you please check the transcript.fa file . The format may like this:
@.***
You can change the first “|” to tab.
Best,
Yanqiang
From: mlpy18 @.>
Date: Wednesday, August 14, 2024 at 04:52
To: YanqiangLi/NanoNm @.>
Cc: Yanqiang Li @.>, State change @.>
Subject: Re: [YanqiangLi/NanoNm] questions about detect the Nm of mRNA by NanoNm (Issue #1)
Thank you for your kind reply. However, we still encounter a problem, it seems there are something wrong about the 'hg38.gene2transcripts.txt' file, how to prepare the right 'hg38.gene2transcripts.txt' file.
_20240814165035.png (view on web)https://github.com/user-attachments/assets/0aebdce4-cf4f-4722-9f5e-a85d8c456792
_20240814165035.png (view on web)https://github.com/user-attachments/assets/80d2193b-c146-4163-bd41-e728250eb7ac
—
Reply to this email directly, view it on GitHubhttps://github.com/YanqiangLi/NanoNm/issues/1#issuecomment-2288210567, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AGQ3YFX43GZJNGWZ4LPMIN3ZRMLDPAVCNFSM6AAAAABL3XYDGGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOBYGIYTANJWG4.
You are receiving this because you modified the open/close state.Message ID: @.***>

Thank you for your help, we have change the first “|” to tab of the file, but we encounter a new problem.

Please use this:
$samtools faidx  GRCh38.p13.genome.fa
$picard CreateSequenceDictionary R=GRCh38.p13.genome.fa O=GRCh38.p13.genome.dict
From: mlpy18 @.>
Date: Wednesday, August 14, 2024 at 22:36
To: YanqiangLi/NanoNm @.>
Cc: Yanqiang Li @.>, State change @.>
Subject: Re: [YanqiangLi/NanoNm] questions about detect the Nm of mRNA by NanoNm (Issue #1)
Thank you for your help, we have change the first “|” to tab of the file, but we encounter a new problem.
FA.png (view on web)https://github.com/user-attachments/assets/c7c30781-320e-4607-9aee-c71d574f0ca2
BUG.png (view on web)https://github.com/user-attachments/assets/99883a1c-8585-4b9c-b42f-d0f43494979a
—
Reply to this email directly, view it on GitHubhttps://github.com/YanqiangLi/NanoNm/issues/1#issuecomment-2290404685, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AGQ3YFUGJ5LQGYFXU4IU64LZRQHZZAVCNFSM6AAAAABL3XYDGGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOJQGQYDINRYGU.
You are receiving this because you modified the open/close state.Message ID: @.***>

Thank you very much, but there is another problem.

Thanks for pointing this out.
The script was updated. In the 466th line, it should be:
for tpp in ["AAATC","AAATG","AAGAG","AATAC","AATGT","ACACG","ACAGC","ACTCT","AGAGA","AGAGC","AGATT","AGCAA","AGCAG","AGCCA","AGCGT","AGGGA","AGGGC","AGGGG","AGGTT","AGTAC","ATATG","ATCCA","ATCTT","ATGGA","ATGTG","ATTCC    ","ATTGT","CAAAG","CACTA","CAGAC","CAGGT","CAGTT","CCATA","CCCAG","CCGAA","CCGGT","CCGTC","CGCCC","CGCTG","CGTTT","CTCCA","CTCTG","CTTCT","CTTGA","CTTGC","GAAAG","GAACG","GAACT","GAAGA","GACCG","GACGA","GACGC","GAGGG","GAGGT",    "GATTG","GCAAA","GCAGA","GCCAA","GCCCG","GCCGG","GGAAG","GGAGA","GGATC","GGCAT","GGCGG","GGCTC","GGGGA","GGGGC","GGGTA","GGTAA","GGTGG","GGTGT","GTAGC","GTAGT","GTCCC","GTCTA","GTGTC","GTTCA","GTTCC","TAACT","TAATC","TAATT","T    ACAT","TAGAG","TAGCA","TAGCG","TCATT","TCGGG","TCGTC","TGAGC","TGATG","TGGGG","TGGTG","TGTGA","TTAAA","TTAAG","TTGCA","TTGGA","TTGTT","TTTGG"]
From: mlpy18 @.>
Date: Thursday, August 15, 2024 at 22:42
To: YanqiangLi/NanoNm @.>
Cc: Yanqiang Li @.>, State change @.>
Subject: Re: [YanqiangLi/NanoNm] questions about detect the Nm of mRNA by NanoNm (Issue #1)
Thank you very much, but there is another problem.
model.png (view on web)https://github.com/user-attachments/assets/600c3e42-1cab-4e28-9a22-57301c78ad85
—
Reply to this email directly, view it on GitHubhttps://github.com/YanqiangLi/NanoNm/issues/1#issuecomment-2292628658, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AGQ3YFXBA5ZDWNTMAAHX263ZRVRJXAVCNFSM6AAAAABL3XYDGGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOJSGYZDQNRVHA.
You are receiving this because you modified the open/close state.Message ID: @.***>

Thank you for your help, we completed the analysis, and there are lots of results in the "all_Nm_model" folder. we would like to know which are the key results, and is there a description of this results, such as the 'ratio.0.5.tsv' .

  The key result is ratio.0.5.tsv. You can transform it into a bed file with this custom python script https://github.com/YanqiangLi/NanoNm/blob/main/filter0.5.bed.ratio.py  with python2.7  ~/liyq/bin/filter0.5.bed.ratio.py  ratio.0.5.tsv  filter
The ratio.0.5.tsv include gene name, chromosome information, position in the chromosome, methylated reads, total reads and methylation ratio.
From: mlpy18 @.>
Date: Monday, August 19, 2024 at 04:29
To: YanqiangLi/NanoNm @.>
Cc: Yanqiang Li @.>, State change @.>
Subject: Re: [YanqiangLi/NanoNm] questions about detect the Nm of mRNA by NanoNm (Issue #1)
Thank you for your help, we completed the analysis, and there are lots of results in the "all_Nm_model" folder. we would like to know which are the key results, and is there a description of this results, such as the 'ratio.0.5.tsv' .
image.png (view on web)https://github.com/user-attachments/assets/81633455-6a13-4c06-917e-14c2eed22e24
image.png (view on web)https://github.com/user-attachments/assets/4ddd64e8-6038-4576-9270-c87858f5d7ec
—
Reply to this email directly, view it on GitHubhttps://github.com/YanqiangLi/NanoNm/issues/1#issuecomment-2295977876, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AGQ3YFWXWMDW3HDEMOP4VRLZSGUIDAVCNFSM6AAAAABL3XYDGGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOJVHE3TOOBXGY.
You are receiving this because you modified the open/close state.Message ID: @.***>


Test

Description
Please explain the changes you made, including a reference to the related issue if applicable
Checklist

[ ] Required by CI: Code is auto formatted using clang-format
[ ] Extend the tutorials / documentation reference
[ ] Document API changes relevant to the user in the MIGRATION.md notes
[ ] Create tests, which fail without this PR reference
[ ] Include a screenshot if changing a GUI
[ ] While waiting for someone to review your request, please help review another open pull request to support the maintainers

I guess this PR was created by accident only. If not, please reopen and provide a description.


ParkingAI -  Ditching of cars is still happening

Although the parking AI is greatly improved, some cims still abandon their cars and teleport back home.
I've build a few towns connected with national highways, but no public transportation. Only one town has work and shops, So from the other towns they have to go by car. After a while I find parked cars with the owners back home, a town away which is only connected with a national highway so walking is impossible.

It's a shame there aren't any tow trucks - imagine seeing a car being towed (like a trailer) back to someone's house?! :)

There are multiple reasons why cims teleport back home. If vehicle despawn is enabled and they are on a bus which despawns, they teleport back home. If the building is demolished where they are located att they may also teleport.
Which is causing the teleportation in your case? (I know it's not easy to find an answer to that, I have spent weeks debugging the Parking AI and waiting for such events to occur)

Well considering the state of this new town (no public transportation yet), demolishing of the building seems the most logical reason for them to teleport back. Nevertheless if they teleport back, so should their car i think?

You'd need to detect every possible scenario where a cim teleports back. Would be better to wait until cim tries to get to car and can't, at which point it could teleport back (or, cough, tow truck!!).
What happens if there's no available parking when the vehicle tries to teleport back?
But tow trucks tho... See if an asset creator will make a tow truck depot and a tow truck vehicle, then drive tow truck to where car is, attach car as its trailer, and send both to where the cim is waiting. It would be so cool. Probably not ever going to happen, but it would be super cool if it did (and also open door to car breakdowns feature later on?)

In this area something fishy is going on, I've provide plenty of parking spaces, a lot parking going on but also a lot of ppl searching for spaces. The traffic info view is enabled, thus the red buildings indicate not sufficient parking space.
https://i.snag.gy/sRe4ca.jpg
Im using the dafault parameters for the global configuration file.
And a top down view: (The red lines are pedestrian paths)
https://i.snag.gy/xT4aI1.jpg
EDIT:
While watching specific cars, they often drive to their freshly determined parking spot, when arriving there they decide to search for a new spot (much further away), perhaps because their spot is already taken? (this is quite a busy area). So they end up driving past all available parking spots, while going towards their new designated parking spot on a different parking lot for instance.

Could it be an issue similar to #140 ?

Not sure, there are plenty f possible U-turns available here.
Still it's weird, I've build similar setups elsewhere in the city and it is working there, however smaller scale and road parking available. :-)
But in this particular district, I've wanted "clean" roads, and all the parking on the parking lots.

More to the original issue, Now i've added a first and only train line between my cities. I've found the case of Elisa who went drinking with friends:
https://snag.gy/yRLAiO.jpg and either teleported back home or took the train (blue line)
EDIT
So i followed here for a while using the "Favorite cims mod"it kills even more FPS but okay (https://steamcommunity.com/sharedfiles/filedetails/?id=426460372) And i Stayed focused on her car, a few times the status changed from "at home" to "confused" but after a few minutes it changed back to "at home". So perhaps she tried to use it?
However it was weekend (Rush hour mod) so I don't think she had to work, but perhaps she wanted to go somewhere.
Finally, Sunday afternoon she died. causing the car to despawn as well.

So I followed some more Cims. This behaviour seems to occur in the following situations:
Cim goes to shopping --> Car is best option to go there --> cim wants to go back --> Public transport is a better option now --> car ditched. Sometimes when they go back shopping in the area they might go on public transport to the shops and take the car back home.
This does not happen very often (yet), please bare in mind that my public transport in my city is not really decent.  I really like this much improved parking AI compared to previous version. Hoping you can get it perfected.
I hope this helps :-)

When a cim is in a car, would it be worth cutting the last segment from the route so they essentially seek parking space prior to reaching their destination?

Finally, Sunday afternoon she died.

That's depressing.

I will check if I can reproduce the issue. Elisa should definitely not have used the train to get back home. But maybe she drank too much? :)

Related to #171?

https://github.com/dymanoid/RealTime/issues/72
Another case, might be helpful for solving this issue.

Dymanoid mentioned that in recent update the virtual cims will no longer teleport so won't ditch their cars.
From what I can see at a cursory glance, there is far less car ditching happening but needs proper testing to be sure.
In any case, it would seem that at least part of the issue is external to the scope of TM:PE as it relates to the AIs that control cim behaviour (eg. when/how to go to work, whether to visualise or virtual, etc).

Unfortunately, it seems that the game teleports citizens using various AI classes. So teleporting is not just a TM:PE's or Real Time's or Rush Hour's or whatever problem. It would be interesting to know how much teleporting code did Colossal Order implement in general and how much of it do we override by our mods.

Hmmm, if the teleporting is outside of TMPE's control. Perhaps the following makes sense: If a Cim is despawned --> despawn the parked car and respawn it near the new cims location.

This is indeed still hapening.
Perhaps its an idea to do some kind of check every now and then, and if a parked car has a cim at home at a greater distance as defined by: MaxParkedCarDistanceToHome", then the car should be despawned?
Because now slowly the parking lots are getting filled with "dumped" cars... and eventually it will lead to cims looking for parking spots but there arent any, causing gridlocks...


Update scala-collection-compat to 2.4.3

Updates org.scala-lang.modules:scala-collection-compat from 2.1.6 to 2.4.3.
GitHub Release Notes - Version Diff
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.scala-lang.modules", artifactId = "scala-collection-compat" } ]

labels: library-update, semver-minor

Superseded by #40.


Move images to the assets folder

When I made all images conform to one naming convention, git did not pick up on the renaming for images that only changed in capitalisation. As a result, pulling some images with what should be the correct name results in a 404 and the images do not display.
To fix this issue, the images were moved into the assets folder, updating the names for all images while also conforming with Jekyll conventions. All references to images were updated as well.

This is being merged without an approval due to time sensitivity


Allow multiple Dependabots per week, on specified days

Allow multiple Dependabots per week
version: 2
updates:
  - package-ecosystem: "bundler"
    directory: "/"
    schedule:
      interval: "weekly"
      days: "tuesday, thursday"
      time: "07:00"

It's an interesting idea, but I'm going to close as not-planned... daily or weekly should be good enough for most use cases, so becoming more custom than that isn't going to be high enough priority to be implemented anytime in the forseeable future.

Alternatively, if you really wanted this, you could probably script it using github actions to run Dependabot yourself... it'd be a little bit of work, but it'd let you schedule things exactly when you wanted.


Update recon.sh

[+] Error fix with ".sub.domain.tld" on "dig"
[+] Change of colors
[-] Removed debug code

Looking good @ebelties , thanks again for your contribution!


Replace old chef uploader code with new rake task

Awesome :+1:

+1

@MaximilianMeister @tboerger Can you please review again? I made some changes after your review.

I am not sure I understand the second commit, as chef-client is running before that code that you have added

:+1:

:+1:


Update BuildCaffe.md

I was bitten by Coffee compilation errors when I found out that my gcc version is 4.9.3 due to the fact that I was trying to compile CUDA - which doesn't support gcc 5.0+. I think it is worth mentioning it here to save people's time on troubleshooting. It should be made clear that gcc 5 is required, at least on Ubuntu 16.04.

Hi @jianghaitao. Thanks for trying to improve the documentation, but this is not what we recommend.
If you're running 16.04 (as I am), then you want to use CUDA 8.0 and gcc 5.x rather than CUDA 7.5 and gcc 4.x. Downgrading your gcc version is likely to cause a bunch of issues on your system. CUDA 8.0 is still in the release candidate phase, but the final release should come out relatively soon. Once CUDA 8.0 is released, that will work on either Ubuntu version.
Until then, you can download the RC here: https://developer.nvidia.com/cuda-toolkit

HI, Luke
Yes. I am running 16.04 / CUDA 8. I think the key thing is that we need to
make it clearly that user should make sure their gcc is of 5.0+ not 4.9 or
below when they compile Nvidia/Caffe. This was not clearly stated in the
original instruction I think...took me a bit time to figure it out.
Thanks
Haitao
Thanks
Haitao
On Wed, Aug 31, 2016 at 4:02 PM, Luke Yeager<EMAIL_ADDRESS>wrote:

Hi @jianghaitao https://github.com/jianghaitao. Thanks for trying to
improve the documentation, but this is not what we recommend.
If you're running 16.04 (as I am), then you want to use CUDA 8.0 and gcc
5.x rather than CUDA 7.5 and gcc 4.x. Downgrading your gcc version is
likely to cause a bunch of issues on your system. CUDA 8.0 is still in the
release candidate phase, but the final release should come out relatively
soon. Once CUDA 8.0 is released, that will work on either Ubuntu version.
Until then, you can download the RC here: https://developer.nvidia.com/
cuda-toolkit
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/NVIDIA/DIGITS/pull/1027#issuecomment-243928784, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABLhFCo7M3A3O4LnoguADZ7bJ-UPcXFcks5qlggegaJpZM4JyH-J
.

Uh, how did you even end up with GCC 4.x on Ubuntu 16.04? The default version is 5.3:
http://packages.ubuntu.com/xenial/gcc


Exception thrown on GetResponseBodyAsync

When running the SiteVerifyAsync method I receive an InvalidOperationException with message "An invalid request URI was provided. The request URI must either be an absolute URI or BaseAddress must be set. "
This happens as far as I could see in trace at method GetResponseBodyAsync and line 135 in ReCaptchaV2.cs
I doubt it's possibly a configuration or programming issue on my site, but your documentation is not very easy to understand. Would be better to have a really simple example without all those IoC and DI stuff.

Never mind. I've cloned the source to better see what the issue is and it was a misunderstanding from your "Settings" sections where you write:
##var settings = ConverterSettings.CreateInstance();##
It should better be:
##var settings = ReCaptchaV2Settings.CreateInstance();##
That's more obvious :laughing:

Ooops. Yes, you're right. I fixed the typo on README.md. Thanks for letting me know. Really appreciated!


fix: install.yaml missing crb subject ns

This PR fixes the issue with missing ns in crb subjects inside the install.yaml file, introduced in PR #8266
ref: https://github.com/argoproj/argo-workflows/issues/8250#issuecomment-1084046919

@gdsoumya  Why exactly we are hardcoding the namespace for cluster install ? whoever refers the cluster install can mention the namespace in their own kustomization.yaml
@alexec @jessesuen

@gdsoumya Yes, Apologies for install.yaml bug I introduced, as it was showing diff when I was fixing kustomize. But isn't kustomize supposed to be for generic use instead of hard-coding a namespace.
Also with kustomize you can not override namespace if its hardcoded. There is a open ticket for the same. :
https://github.com/kubernetes-sigs/kustomize/issues/880


Tests fail when run in parallel

Running tests in parallel fails quite reliably (1 out of 3 times) when run in parallel. I use pytest-xdist and here's the command I use:
HUGGINGFACE_CO_STAGING=1 pytest -Werror::FutureWarning -x -vv tests/test_hf_api.py -n12

The same command always passes when run in single task mode. It would be nice to be able to run the tests in parallel since it does speed up the dev process.
Logs:

$ HUGGINGFACE_CO_STAGING=1 pytest -Werror::FutureWarning -x -vv tests/test_hf_api.py -n12
============================================================================ test session starts ============================================================================
platform linux -- Python 3.9.10, pytest-7.0.1, pluggy-1.0.0 -- /home/adrin/miniforge3/envs/hf-sklearn/bin/python
cachedir: .pytest_cache
rootdir: /home/adrin/Projects/hf/hub, configfile: pyproject.toml
plugins: xdist-2.5.0, forked-1.4.0
[gw0] linux Python 3.9.10 cwd: /home/adrin/Projects/hf/hub
[gw1] linux Python 3.9.10 cwd: /home/adrin/Projects/hf/hub
[gw2] linux Python 3.9.10 cwd: /home/adrin/Projects/hf/hub
[gw3] linux Python 3.9.10 cwd: /home/adrin/Projects/hf/hub
[gw4] linux Python 3.9.10 cwd: /home/adrin/Projects/hf/hub
[gw5] linux Python 3.9.10 cwd: /home/adrin/Projects/hf/hub
[gw6] linux Python 3.9.10 cwd: /home/adrin/Projects/hf/hub
[gw7] linux Python 3.9.10 cwd: /home/adrin/Projects/hf/hub
[gw8] linux Python 3.9.10 cwd: /home/adrin/Projects/hf/hub
[gw9] linux Python 3.9.10 cwd: /home/adrin/Projects/hf/hub
[gw10] linux Python 3.9.10 cwd: /home/adrin/Projects/hf/hub
[gw11] linux Python 3.9.10 cwd: /home/adrin/Projects/hf/hub
[gw0] Python 3.9.10 | packaged by conda-forge | (main, Feb  1 2022, 21:24:37)  -- [GCC 9.4.0]
[gw1] Python 3.9.10 | packaged by conda-forge | (main, Feb  1 2022, 21:24:37)  -- [GCC 9.4.0]
[gw2] Python 3.9.10 | packaged by conda-forge | (main, Feb  1 2022, 21:24:37)  -- [GCC 9.4.0]
[gw3] Python 3.9.10 | packaged by conda-forge | (main, Feb  1 2022, 21:24:37)  -- [GCC 9.4.0]
[gw5] Python 3.9.10 | packaged by conda-forge | (main, Feb  1 2022, 21:24:37)  -- [GCC 9.4.0]
[gw4] Python 3.9.10 | packaged by conda-forge | (main, Feb  1 2022, 21:24:37)  -- [GCC 9.4.0]
[gw6] Python 3.9.10 | packaged by conda-forge | (main, Feb  1 2022, 21:24:37)  -- [GCC 9.4.0]
[gw7] Python 3.9.10 | packaged by conda-forge | (main, Feb  1 2022, 21:24:37)  -- [GCC 9.4.0]
[gw8] Python 3.9.10 | packaged by conda-forge | (main, Feb  1 2022, 21:24:37)  -- [GCC 9.4.0]
[gw9] Python 3.9.10 | packaged by conda-forge | (main, Feb  1 2022, 21:24:37)  -- [GCC 9.4.0]
[gw10] Python 3.9.10 | packaged by conda-forge | (main, Feb  1 2022, 21:24:37)  -- [GCC 9.4.0]
[gw11] Python 3.9.10 | packaged by conda-forge | (main, Feb  1 2022, 21:24:37)  -- [GCC 9.4.0]
gw0 [62] / gw1 [62] / gw2 [62] / gw3 [62] / gw4 [62] / gw5 [62] / gw6 [62] / gw7 [62] / gw8 [62] / gw9 [62] / gw10 [62] / gw11 [62]
scheduling tests via LoadScheduling

tests/test_hf_api.py::HfApiUploadFileTest::test_get_full_repo_name
tests/test_hf_api.py::HfApiLoginTest::test_login_valid
tests/test_hf_api.py::HfApiEndpointsTest::test_create_update_and_delete_repo <- tests/testing_utils.py
tests/test_hf_api.py::HfApiEndpointsTest::test_create_update_and_delete_space_repo <- tests/testing_utils.py
tests/test_hf_api.py::HfApiEndpointsTest::test_whoami
tests/test_hf_api.py::HfApiUploadFileTest::test_delete_file <- tests/testing_utils.py
tests/test_hf_api.py::HfApiLoginTest::test_login_cli
tests/test_hf_api.py::HfApiEndpointsTest::test_move_repo <- tests/testing_utils.py
tests/test_hf_api.py::HfApiLoginTest::test_login_invalid
tests/test_hf_api.py::HfApiLoginTest::test_login_git_credentials
tests/test_hf_api.py::HfApiEndpointsTest::test_create_update_and_delete_model_repo <- tests/testing_utils.py
tests/test_hf_api.py::HfApiEndpointsTest::test_create_update_and_delete_dataset_repo <- tests/testing_utils.py
[gw2] [  1%] PASSED tests/test_hf_api.py::HfApiLoginTest::test_login_invalid
[gw3] [  3%] PASSED tests/test_hf_api.py::HfApiLoginTest::test_login_valid
[gw1] [  4%] PASSED tests/test_hf_api.py::HfApiLoginTest::test_login_git_credentials
[gw0] [  6%] FAILED tests/test_hf_api.py::HfApiLoginTest::test_login_cli

================================================================================= FAILURES ==================================================================================
_______________________________________________________________________ HfApiLoginTest.test_login_cli _______________________________________________________________________
[gw0] linux -- Python 3.9.10 /home/adrin/miniforge3/envs/hf-sklearn/bin/python

self = <tests.test_hf_api.HfApiLoginTest testMethod=test_login_cli>

    def test_login_cli(self):
        _login(self._api, username=USER, password=PASS)
>       self.assertTupleEqual(read_from_credential_store(USER), (USER.lower(), PASS))
E       AssertionError: Tuples differ: (None, None) != ('__dummy_transformers_user__', '__DUMMY_TRANSFORMERS_PASS__')
E
E       First differing element 0:
E       None
E       '__dummy_transformers_user__'
E
E       - (None, None)
E       + ('__dummy_transformers_user__', '__DUMMY_TRANSFORMERS_PASS__')

tests/test_hf_api.py:128: AssertionError
--------------------------------------------------------------------------- Captured stdout call ----------------------------------------------------------------------------
Login successful
Your token has been saved to /home/adrin/.huggingface/token
----------------------------------------------------------------------------- Captured log call -----------------------------------------------------------------------------
ERROR    root:hf_api.py:432 HfApi.login: This method is deprecated in favor of `set_access_token`.
========================================================================== short test summary info ==========================================================================
FAILED tests/test_hf_api.py::HfApiLoginTest::test_login_cli - AssertionError: Tuples differ: (None, None) != ('__dummy_transformers_user__', '__DUMMY_TRANSFORMERS_PASS__')
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! xdist.dsession.Interrupted: stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
======================================================================= 1 failed, 3 passed in 10.64s ========================================================================

What we've seen in the past is that the principal reason our tests fail in huggingface_hub is due to the backend server being spammed by too many requests in parallel and returning errors (401, 403, 500), so I wouldn't rely on parallelisation to speed-up the process.
We've had to add a retry mechanism to retry failed tests due to HTTP errors in order to reduce the number of failed tests due to backend errors (which, AFAIK, is very hard to patch on the backend's side), which also results in a very long testing process.
In my opinion, a few areas where the tests could be improved are:

The test_repository.py file was efficient in the beginning, but as additional tests have started to pile-up, it became increasingly inefficient and is now way slower than we need it to be.
We have not setup any mocking, which could speed-up the tests tremendously. Right now we're doing every online test with either the staging backend (in 95% of cases), or the production backend in some rare cases. I personally fail to see a good solution using mocking as the behavior of the python library huggingface_hub reflects the behavior of the backend and we should see very visible errors if the backend fails, which wouldn't work were we to mock the backend.
Also realizing that the rest of the testing suite (appart from the RepositoryTest in test_repository.py mentioned above) takes ~12 minutes to run, which is too long as well.

also the staging backend (which is a bit of a misnomer because it's used exclusively for CI from Python client libraries) is still running on an old infra – it's on our roadmap to move it to a more modern infra (cc @Pierrci @XciD @coyotte508) to better differentiate:

potential scalability or networking issues on the backend
actual bugs or race conditions in the backend
potential bugs in the testing code in huggingface_hub

We've had to add a retry mechanism to retry failed tests due to HTTP errors in order to reduce the number of failed tests due to backend errors (which, AFAIK, is very hard to patch on the backend's side), which also results in a very long testing process.

potential scalability or networking issues on the backend
actual bugs or race conditions in the backend

Are there issues/topics on the backend repo one could follow? (disclaimer to non-org members: they're private).

The test_repository.py file was efficient in the beginning, but as additional tests have started to pile-up, it became increasingly inefficient and is now way slower than we need it to be.

We don't seem to have a forced pagination, which would fix a large part of the issue since right now some of the tests actually retrieve info for ALL stored repos.

For posterity here's the longest tests as of December: https://github.com/huggingface/huggingface_hub/issues/544

Tests are now unrelated and run in parallel in the CI :)  See https://github.com/huggingface/huggingface_hub/pull/2059.


Setup Routing

Setup routing for the ID server to pages and files can be requested over HTTP(s). Add support for:

[x] Sending back CSS files
[x] Sending back HTML rendered pages
[ ] ~Accept API Requests~ Removed for another issue, non-trivial, our of scope
[ ] ~Sending back JavaScript~ Removed for another issue, non-trivial, our of scope
[ ] Sending back images, for now, only SVG, PNG, GIF, JPEG

Removed API routing as it is non-trivial and routes with parameters makes the entire issue overly complex.
Removed JavaScript routing since it won't be used for now.


FromIdAsync Threw an exception: system.Exception:element not found for WifiDirect sample

I am trying to run the WifiDirect sample and try and connect it to my wifiDirect capable Samsung S6. i can see the Windows 10 NUC Desktop getting enumerated on the samsung but get the above error when i try and accept the connection. The error happens at this code line
WiFiDirectDevice wfdDevice = await wfdDeviceTask;

@GauriP  The sample app is written in such a way to run it at the same time on two different machines that have WiFiDirect capabilities and make then connect to each other. For making it work with another platform (i.e. android device) you should modify the sample in such a way that both sides have the same behavior. What I think is happening here is that after the WFD connection is established, there is a socket connection that needs to be established but the sample cannot find its counterpart from the other side. Hope it helps. Thanks.


Feedback

@net1957 Thanks a lot for making this application available to the public! Sorry for the long time till I gave you feedback.

Easy to use UI

I like your lean UI
What would help, would be some kind of authentication - at best with support for LDAP

Compressing the Proxy.pac

Unfortunately does not work in my setup
Does it work both with files and pasted proxy.pac?
Disable the button for compression via ENV? (This might irritate supporters)

Proxy.pac URLs

I've got a limited set of Proxy.pac-URLs
Would it be possible to have a dropdown list I can configure via ENV?

Provide Docker Image
Would you mind to provide a docker image?

Thanks for your feedback.

UI

Authentication seems a bit overkill. No sensitive information are show. Do you have a specific use case ?

Compressing

Will look at it
The entry is directly passed to ProxyPacRb::Parser#parse, so url or script content should work.
Disable button: Should not be too difficult

URLS

Will look at it

Docker

I'm a little new at it but should be possible. Similar to Vagrant in this case

Cheers

Authentication

You're right. But if you start adding some kind of settings (urls for proxy.pacs) via UI this might be interesting.

URLS

I created #4 for this.

Compression use the default of ProxyPacRb::ProxyPacCompressor.new.compress
Any idea?

See compress branch. I changed some value for compression


Add "Properties" as an argument to asset creation to bring consistency across the SDK

Is your feature request related to a problem? Please describe.
properties are top-level, attributes are second-level - attributes nest under properties. Nearly every endpoint in the SDK apart from asset creation allows properties to be an argument.
Describe the solution you'd like
Add Properties as an argument to asset creation to bring consistency across the SDK

Completely agree with this - also will bring us into line with the UI and solve the issue of the confusing vestigial behaviours parameter


OCI CLI Config

This Github template is intended for questions regarding the Terraform Oracle Cloud Infrastructure OKE module.
If you have a support request or question related to core Terraform functionality or the OCI provider, please submit them to one of these resources:

Terraform OCI provider
Terraform community resources
HashiCorp support (Terraform Enterprise customers)

Hello,
I have one question regarding oci cli config: how is this handled here? If you don't have a configured oci cli and PEM key added in oci console will fail at "generate_kubeconfig".Using instance principal still errors out at :  "oci ce cluster create-kubeconfig --cluster-id ${cluster-id} --file $HOME/.kube/config  --region ${region} --token-version 2.0.0"
Thanks

Hi,
Adding the PEM key in OCI console is necessary for the user terraform will be using. This is required so the terraform oci provider can be configured.
As for generating the kubeconfig, this is done on the admin host. So, this needs to be enabled as well as the instance_principal:
admin_enabled = true
admin_instance_principal = true

If you are having trouble with the necessary options, the terraform.tfvars.example file provides some sensible defaults.

Can you please try https://github.com/oracle-terraform-modules/terraform-oci-oke/pull/146 and see if this solves the problem? I think the issues are related.

I managed to resolved it with instance principal.
Thanks

Ok thanks. Can we close your issue then?

Yes, we can close it.
Thanks


before 18.years.ago does not validate with 2018/10/10

Today is 2018/11/19. My model has this validation:
validates :born_on, timeliness: { type: :date, before: lambda { 18.years.ago }}

But it fails when born_on is set to the date 2010/10/10, which would be 18 years ago.

Upps. Nevermind, the input date was wrongly sent by the webform. All fine.


[Bug]: Copilot suggestions are not working (but Codeium suggestions work fine)

Before Reporting

[X] I have checked FAQ, and there is no solution to my issue
[X] I have searched the existing issues, and there is no existing issue for my issue

What happened?
When I use Copilot as the Feature Provider for Suggestions, no suggestions are displayed. When I use Codeium, I get suggestions.
I'm not confusing suggestions with the chat feature (I see some other issues have done this).
I have set up the Copilot service:

In #426 I saw you suggested that the OP try the version in #415 - I installed that version and still have the same issue.
As soon as I switch to the Copilot for Xcode window and select Codeium as the feature provider instead of Copilot, the suggestions start working immediately - no other change is made.
How to reproduce the bug.
Clean install of Copilot for Xcode following the instructions. Set up the GitHub Copilot service, create a fresh project in XCode, and suggestions do not display either in real time or when using the assigned hotkey for them.
Relevant log output
No response
macOS version
13.6
Xcode version
15.0.1
Copilot for Xcode version
0.30.0
Node version
21.6.1

Please turn verbose log on in GitHub Copilot settings. Open Console.app to stream the log. Use the following filter to see only logs from GitHub Copilot.
category:GitHubCopilot

I turned on the verbose log, however nothing shows up in Console.app if I filter for category:GitHubCopilot. Is there a different filter I could try?

subsystem：com.intii.CopilotForXcode
Please type something to trigger GitHub Copilot

I still could not see anything in the Console, however the suggestions work now. I didn't change anything on my end, so I'm not sure what 'fixed' it. Sorry!


Make dependency on user_saml optional

As per https://github.com/pondersource/nextcloud-mfa-awareness/issues/3#issuecomment-1291613513

Depends on #10

It's commented out right now, will have to work out how to get to it without using DI

It works for totp:

Should now check webauthn
And for local saml (blocked on #18)

For the webauthn check -> #19


"", ""...

Step 1, powershell:  This should probably read "UndesiredService" rather than Undesire_able_Service.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 0e0c0537-bbc1-02c8-7ae2-78646b2a2e98
Version Independent ID: a9becd2e-5989-da88-8b6c-0e51476a21c7
Content: Disable access to Microsoft 365 services with PowerShell - Microsoft 365 Enterprise
Content Source: microsoft-365/enterprise/disable-access-to-services-with-microsoft-365-powershell.md
Service: o365-administration
GitHub Login: @kelleyvice-msft
Microsoft Alias: kvice

@jtsveigdalen Thank you for your feedback. We have made changes to the document via PR#https://github.com/MicrosoftDocs/microsoft-365-docs/pull/6489
Thanks
Sri


Reference not found (WindowsBase)

Hi,
I am trying to add runtime compilation to a project but am struggling a bit with setting up the references to the framework assemblies.
My code currently looks like this:
using System;
using System.Collections.Generic;
using System.IO;
using System.Reflection;
using Basic.Reference.Assemblies;
using Microsoft.CodeAnalysis.CSharp;

namespace DynamicCompilationWithWpf
{
    class Program
    {
        static void Main(string[] args)
        {
            string sourceCode = @"
public class TestClass
{
    public System.Windows.Point DummyMethod(System.Windows.Point p1)
    {
        return new System.Windows.Point(p1.Y, p1.X);
    }
}
";

            var syntaxTree = CSharpSyntaxTree.ParseText(sourceCode);
            var references = new List<Microsoft.CodeAnalysis.MetadataReference>(Net50.All);
            //references.Add(Microsoft.CodeAnalysis.MetadataReference.CreateFromFile(@"C:\Program Files\dotnet\packs\Microsoft.WindowsDesktop.App.Ref\5.0.0\ref\net5.0\WindowsBase.dll"));
            var options = new CSharpCompilationOptions(Microsoft.CodeAnalysis.OutputKind.DynamicallyLinkedLibrary)
                .WithPlatform(Microsoft.CodeAnalysis.Platform.X64)
                .WithOptimizationLevel(Microsoft.CodeAnalysis.OptimizationLevel.Release);

            var compilation = CSharpCompilation
                 .Create(
                     null,
                     new[] { syntaxTree },
                     references: references,
                     options: options);

            var stream = new MemoryStream();
            var emitResults = compilation.Emit(stream);
            if (!emitResults.Success)
                throw new Exception();

            Assembly dynamicAssembly = Assembly.Load(stream.ToArray());
            dynamic instance = dynamicAssembly.CreateInstance("TestClass");
            System.Windows.Point result = instance.DummyMethod(new System.Windows.Point(3, -1));
        }
    }
}

Here the project file:
<Project Sdk="Microsoft.NET.Sdk">

  <PropertyGroup>
    <OutputType>Exe</OutputType>
    <TargetFramework>net5.0-windows</TargetFramework>
    <UseWPF>true</UseWPF>
  </PropertyGroup>

  <ItemGroup>
    <PackageReference Include="Basic.Reference.Assemblies.Net50" Version="1.2.4" />
    <PackageReference Include="Microsoft.CodeAnalysis.Common" Version="3.11.0" />
    <PackageReference Include="Microsoft.CodeAnalysis.CSharp" Version="3.11.0" />
  </ItemGroup>
</Project>

The error is 'Type System.Windows.Point or namespace cannot be found ...'.
I can verify that the containing assembly (WindowsBase) is in the list created by Net50.All.
When manually adding a reference to the list, the error disappears and the compilation succeeds.
Am I missing something here?

I believe the problem is that the System.Windows.Point type is only defined for net5.0-windows not the more general net5.0 TFM.
https://apisof.net/catalog/77322091-fc17-3d51-6123-16b1bcfd7087
This particular project doesn't have the OS specific reference assemblies included, it uses only the more general TFM


Matrix and saddle-points exercises overrides standard library class

While I was completing exercises: Matrix and Saddle Points. I've found that ruby already have a class in standard library that can hold and operate matrixes.
So as I see this exercise could be completed with some delegation or inheritance but we can't because test expect Matrix to be defined.
Here is ruby reference: https://ruby-doc.org/stdlib-2.5.1/libdoc/matrix/rdoc/Matrix.html

Hi @fanantoxa. I moved this into an issue that addresses more issues about the Matrix exercise. So, I'm closing this one. Thanks!


invalid request from Eclair mobile app

I get this using with Eclair mobile app:
INFO  bwt::electrum > [<IP_ADDRESS>:39430] connected peer
ERROR bwt::electrum > [<IP_ADDRESS>:39430] receiver failed: invalid request - maybe SSL-encrypted data?: [22, 3, 1, 0, 218, 1, 0, 0, 214, 3, 3, 141, 209, 205, 69, 67, 214, 195, 169, 204, 56, 252, 162, 84, 8, 37, 254, 214, 151, 104, 234, 116, 137, 158, 222, 68, 102, 229, 54, 104, 189, 206, 166, 32, 173, 223, 108, 58, 249, 196, 20, 103, 78, 187, 180, 252, 172, 199, 164, 57, 199, 61, 153, 146, 47, 11, 112, 245, 24, 215, 128, 150, 228, 249, 100, 32, 0, 24, 19, 1, 19, 2, 19, 3, 192, 44, 192, 43, 192, 47, 192, 48, 192, 19, 192, 20, 0, 156, 0, 47, 0, 53, 1, 0, 0, 117, 0, 23, 0, 0, 255, 1, 0, 1, 0, 0, 10]
INFO  bwt::electrum > [<IP_ADDRESS>:39430] disconnected peer

It appears like you'll have to setup SSL for Eclair mobile. bwt does not support this out of the box, you will have to setup a reverse proxy with SSL using something like nginx.
See the instructions here, which should work as-is for bwt (they were written for electrs): https://github.com/romanz/electrs/blob/master/doc/usage.md#extra-configuration-suggestions
Also see: https://github.com/romanz/electrs/pull/126

I created an issue for adding an easier way to setup ssl. I'm closing this now, but please do report back if you try following the nginx ssl instructions and still having issues.


chore(main): release 2.5.0

:robot: I have created a release beep boop
2.5.0 (2023-08-19)
Features

dynamic colors (b5c655e)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/huffSamuel/upnp_explorer/releases/tag/v2.5.0 :sunflower:


Added Kruskal's Algorithm in java

Added Kruskal's Algorithm in java which is a part of #7

@Siddhant-K-code Can you tell me what do you mean by LGTM?

@Siddhant-K-code Can you tell me what do you mean by LGTM?

LGTM Means "Looks Good To Me"

Resolve the conflict


[misc][xwalk-2637] Add tests for sampleapp SIMD

Impacted TCs num(approved): New 8, Update 0, Delete 0
Unit test Platform: Android
Android test result summary: Pass 8, Fail 0, Block 0

LGTM


[BEAM-4001] Futurize metrics subpackage

This pull request prepares the metrics subpackage for Python 3 support. This PR is part of a series in which all subpackages will be updated using the same approach.
This approach has been documented hereand the first pull request in the series (Futurize coders subpackage) demonstrating this approach can be found at #5053.
R: @aaltay  @tvalentyn

LGTM. Thank you! We can merge once @tvalentyn gets a chance to look at it.
/cc @pabloem

Should this be merged?

Yes, I think we can merge this, thank you!


[Comments] Peoples suggestions and issues from the comments

Suggestions

[ ]

(@chaseplays)
Could you put the commenting box at the top? It’s a bit annoying to have to scroll in order to comment…

[x]

(@dietzribi)
@pov we need timestamps for comments!

[ ]

(@sorceress)
no comment delete button?

[x]

(@boaheck-artgent)
Would be nice if there was something that told you to sign in to comment if you are logged out. Thought it wasn’t working for a second there.

[ ]

(@scornz)
Eyyyy, looks cool :) The huge spacing between comments kind of bothers me though, keep up the goods work!

Thanks for collecting these.

Sign in is done.

Timestamps done!

Yep. Was just about to say. I had to fix a tiny bug where newly added comments had a "NAN" date first. :+1:
Anyway, I think I'm done with this for now. Gotta move on to the next thing.

The title of the timestamp in comments only contains the date, missing time.
Using something like this from sandbox/internal/src/locale.js might work, but I'm not exactly sure
window.getLocaleTimestamp = function( date ) {   return getLocaleDate(date) + " " + getLocaleTime(date) + " " + getLocaleTimeZone(date); }

Yep, that would be better than getLocaleDate.

Another suggestion, the current word wrapping rule (break-all) breaks the words without hyphens, which makes stuff less readable:

Nice job with adding the timestamps and "(edited)" markers.

I belive this behaviour was added as a temp fix for long lines in code
blocks, just to revert.
On 18 Apr 2017 14:23, "Marwane Kalam-Alami"<EMAIL_ADDRESS>wrote:

Another suggestion, the current word wrapping rule (break-all) breaks the
words without hyphens, which makes stuff less readable:
[image: wrapping]
https://cloud.githubusercontent.com/assets/694508/25132179/db52bbfc-2448-11e7-8e6a-42e4c347ee64.PNG
Nice job with adding the timestamps and "(edited)" markers.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/ludumdare/ludumdare/issues/631#issuecomment-294842177,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ARgKkw0-1MhKtmGoMKkRhSP3vRwXWO0mks5rxLlZgaJpZM4M_V72
.

#633 and #634 were responsible i think.
On 18 Apr 2017 14:35, "ZWRAWR"<EMAIL_ADDRESS>wrote:
I belive this behaviour was added as a temp fix for long lines in code
blocks, just to revert.
On 18 Apr 2017 14:23, "Marwane Kalam-Alami"<EMAIL_ADDRESS>wrote:

Another suggestion, the current word wrapping rule (break-all) breaks the
words without hyphens, which makes stuff less readable:
[image: wrapping]
https://cloud.githubusercontent.com/assets/694508/25132179/db52bbfc-2448-11e7-8e6a-42e4c347ee64.PNG
Nice job with adding the timestamps and "(edited)" markers.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/ludumdare/ludumdare/issues/631#issuecomment-294842177,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ARgKkw0-1MhKtmGoMKkRhSP3vRwXWO0mks5rxLlZgaJpZM4M_V72
.

Yeah. After some searching, I couldn't find a good answer on wrapping. To stop people from breaking the layout I did that, but as you noticed it's not ideal.
That said, now that the code overflow problem is fixed, we should test super-long-lines again to see if that helped at all.
Ideally I'd like to just use hyphens: auto, but I'm not entirely sure that's actually supported everywhere.

Yeah it looks like it's a bit early for hyphens: auto... (missing on Chrome + Win/Linux)

@rplnt Oh ha, I didn't realize at the time that function didn't exist. I've since added it, and you should see better hover timestamps later today once I merge in my changes.

#688 does some work towards this.

When the comment buttons overflow on a mobile phone the publish button goes a line down. It might look better when you resize the buttons, use less padding and/or remove the margin.
The buttons on an Galaxy S5:

Yep. The buttons are missing a style. I wasn't able to easily just remove the text. If anyone has time to figure out what styles are needed to make those buttons not get glitchy when they are not beside text, let me know.

Is this better?

Nice can you make a pr with that?

Sure, I'll setup everything, but when that's done I'll pr

Sure, I'll add it to mine. Thanks for the help.

No problem

Closing this. Only outstanding issue is #826.


Losing ability to "delete" with all building tools after leaving Plan Totem radius and returning.

I have my totem radius set to 50.
To replicate, I load into my world at my base, already within the Plan Totems radius. Using any build tool, modded or vanilla, I build a bit, delete some misplaced pieces etc. I put the tools away, and go out to gather more resources. I'm definitely outside the Plan Totems radius were I go, and my base gets unloaded. After returning and grabbing the tools again, I'm still able to place pieces but can no longer delete them.

I'll find some time to test and get back to you
Get Outlook for Androidhttps://aka.ms/AAb9ysg

From: Harald Heckmann @.>
Sent: Tuesday, November 19, 2024 9:38:00 AM
To: sirskunkalot/PlanBuild @.>
Cc: tobbiusness @.>; Author @.>
Subject: Re: [sirskunkalot/PlanBuild] Losing ability to "delete" with all building tools after leaving Plan Totem radius and returning. (Issue #79)
Do you still experience this issue?
—
Reply to this email directly, view it on GitHubhttps://github.com/sirskunkalot/PlanBuild/issues/79#issuecomment-2484279341, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BEGPL5EXTVGDLYPCUJDLQFD2BJT4RAVCNFSM6AAAAABSAXCDM2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIOBUGI3TSMZUGE.
You are receiving this because you authored the thread.Message ID: @.***>

Issue appears to be fixed

@sirskunkalot Issue can be closed.


HelixBootstrapTool: add prompt before remove

Summary
Prompt user to confirm the delete before actually deleting the instance or resource.

Codecov Report
Attention: 20 lines in your changes are missing coverage. Please review.

Comparison is base (15e7dfa) 72.24% compared to head (c101716) 72.19%.
Report is 2 commits behind head on master.

Additional details and impacted files
@@             Coverage Diff              @@
##             master    #2608      +/-   ##
============================================
- Coverage     72.24%   72.19%   -0.06%
- Complexity    11407    11410       +3
============================================
  Files           805      806       +1
  Lines         65097    65139      +42
  Branches       7936     7945       +9
============================================
- Hits          47030    47027       -3
- Misses        15484    15521      +37
- Partials       2583     2591       +8

Files
Coverage Δ

...ub/ambry/clustermap/HelixBootstrapUpgradeTool.java
0.00% <0.00%> (ø)

...ub/ambry/clustermap/HelixBootstrapUpgradeUtil.java
72.40% <24.00%> (-0.77%)
:arrow_down:

... and 24 files with indirect coverage changes

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


WIP: Fix 736: Rebuild roledb in refresh() even if root unchanged

In order to avoid freezes if role info is deleted due to prior
validation failures, make sure that roledb is rebuilt during
client tuf.client.updater.refresh(), even if root did not need
to be updated.
WIP: I may want to add some tests and wrap a line.
See Issue 736 for more details.
Fixes issue #736
Please verify and check that the pull request fulfills the following
requirements:

[ ] The code follows the Code Style Guidelines
[ ] Tests have been added for the bug fix or new feature
[ ] Docs have been added for the bug fix or new feature

The relocation of the call to _rebuild_key_and_role_db() looks good to me.  Another thing that we should do is document, in the relevant docstrings, the assumption that the client has the latest info for the top-level roles before attempting to update any specific metadata.
Note: Travis failed, so we probably need to update 1 or 2 test conditions.

Sure
On Fri, Jun 8, 2018 at 08:26 Vladimir Diaz<EMAIL_ADDRESS>wrote:

@awwad https://github.com/awwad I'd like to include this important fix
in our next scheduled release, which is approaching soon.
Is it okay if I resolve the Travis/Appveyor failures and finish this pull
request?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/theupdateframework/tuf/pull/737#issuecomment-395745240,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AMpkOG2T3vVJrlomMS9THevGpPyalHc6ks5t6m15gaJpZM4UT9bT
.

@awwad I went ahead and (1) added a test condition for the persistent freeze attack (2) wrapped the line  in refresh() that sets consistent snapshot (3) revised a bunch of comments and docstring to document the new behavior and expectations and (4) fixed the failing unit tests.
I think the pull request now just needs to re-sync with the develop branch.
Thanks for reporting the issue and submitting the initial fix!

@trishankatdatadog
Heads up: This is an important change that addresses a persistent freeze attack.  I plant to add it to the next stable release and v0.12.dev1 for testing.

Does this break backwards-compatibility?

No, it can't think of how it would break backward compatibility. (If it causes a problem, of course, LMK.)
BTW, @trishankatdatadog, do you use targets_of_role or all_targets?

@awwad No, we use updated_targets() https://github.com/DataDog/pip/blob/4b191d586172bc7dee665599f819ef05b45b40f1/src/pip/_internal/download.py#L136-L154

(And from there, it looks like you get target info via get_one_valid_targetinfo)
Okay, good. (:

Thanks for checking and verifying, @awwad, much appreciated 🙇

Hi, any idea when v0.12.dev1 will be released on PyPI for testing? Thanks!

I can do it sometime today, will keep you posted here.

@trishankatdatadog
update: v0.12.dev1 was released to PyPI for testing.

I'll test it, thanks!


unmount components when navigating away

Hey, I have an app where I use stack navigator to move from page to page many times. this leaves dozens of items in the stack, all of which are active all the time even when most of them are unseen. unfortunately while this speed up going back, it's very heavy on RAM memory. I was wondering if anyone has any suggestions, or whether there is a way to make the stack lazy load similar to the tab navigator?

I also noticed that when I have a camera feature turned on on one tab and move to another tab, camera is still running or at least torch (flash) mode is still on as I can see camera flash is left turned on.

we did look at the discussion in thread 51, but until that is implemented, we decided to make is so a component notes id stack index, and if the index does not match then it is not visible. This does not unmount, but at least lets the component know that whether to render, and whether it may need to do some shutdown procedures.

Hey, is there any suggestions on the how to reduce the memory usage or is it possible to do it at all? We have many pages in the stacknavigator and the memory usage is high when use opened many pages. Seems the hidden pages are still using up the memory. Do you have any suggestions which I can do to optimize the memory usage? I have checked thread 51 but it is about tabnavigator. I know the lazyload trick but I am not sure how it is related to the stacknavigator.

Hey can we reopen this ? I have the same issue, the more screens i navigate to, the slower the app gets. If i don't kill the app and open it again, the app is fast becoming impossible to use because of how slow it gets.

I am facing memory leak issue when navigating back from a screen which has WebView component that embeds a video. Is there a way to unmount the component?

please create a new issue and follow the template @clementino36 / @mgiridhar


ci(Mergify): configuration update

This change has been made by @mcdave2k1 from Mergify config editor.

ci(Mergify): configuration updatetest


CFFL

CFFL

Linter check found the following problems:
The following problems have been found:
ERROR: /tmp/abs_c9cf8md31q/clone/recipe/meta.yaml:20: missing_wheel: For pypi packages, wheel should be present in the host section
ERROR: /tmp/abs_c9cf8md31q/clone/recipe/meta.yaml:20: host_section_needs_exact_pinnings: Packages in host must have exact version pinnings, except python build tools.
ERROR: /tmp/abs_c9cf8md31q/clone/recipe/meta.yaml:28: missing_pip_check: For pypi packages, pip check should be present in the test commands
ERROR: /tmp/abs_c9cf8md31q/clone/recipe/meta.yaml:37: missing_license_family: The recipe is missing the about/license_family key.
INFO: /tmp/abs_c9cf8md31q/clone/recipe/meta.yaml:37: invalid_url: https://py-googletrans.readthedocs.io/en/latest : URL domain redirect py-googletrans.readthedocs.io ->
Errors were found


Uniformly grayscale controls

Following up on https://github.com/openlayers/openlayers/pull/9013#issuecomment-442613882, this updates the style for controls to be uniformly grayscale.

These css variables should be prefixed with ol- to avoid any name clashes.

These css variables should be prefixed with ol- to avoid any name clashes.

Good point.  Done.

The controls kind of disappear against a white background.

Maybe use a darker color for the subtle background?
--ol-subtle-background-color: rgba(128, 128, 128, .25);

The controls kind of disappear against a white background.

Agreed.  I darkened the background.  I also reduced the margin on the controls so the background isn't as big.

I think this looks tighter than the 2px background.


Test API to know if you are remote

Refs: https://github.com/microsoft/vscode/issues/74188

[x] any @mjbvz
[x] any @aeschli
[ ] any @kieferrm

Complexity: 2
The API is two pieces: vscode.env.remoteName and Extension#extensionKind. See all the details here: https://github.com/microsoft/vscode/issues/74188#issuecomment-503973407. Try to write an extension that knows

if it runs remote or with the UI
if a remote exists or not

I added an api test for the 2 new fields

Tested from mac to ssh and dev container. New apis worked well


Add date information in mustache

Hi thanks for the lib! I hope it can generate issues with dates in it. For example, create an issue everyday with name Today's meeting (2022.05.22) etc.

Oh I see: https://github.com/imjohnbo/issue-bot/blob/main/docs/example-workflows/standup.yml


Make html macro return an expression

This makes the following work
let x = html!(

);

when previously it would give the error
error: expected expression, found statement (`let`)
 --> src/main.rs:5:36
  |
5 |    let test: yew::html::Html<()> = html!(

);
  |                                    ^^^^^^^^^^^^^^^^^^
  |
  = note: variable declaration using `let` is a statement
  = note: this error originates in a macro outside of the current crate (in Nightly builds, run with -Z external-macro-backtrace for more info)

error: Could not compile `yewtest`.

Important thing! Thank you!


ARROW-9707: [Rust] [DataFusion] DataFusion Scheduler Prototype [WIP]

This PR introduces a scheduler for query execution that breaks a physical plan down into a DAG of query stages based on changes in partitioning. Each stage represents a portion of the query where partitions (tasks) can be executed in parallel on a thread pool.
The intent is for the scheduler to decide how to allocate tasks to threads/cores and move all the threading logic out of the executors themselves.
The code is based on a working prototype that I had previously implemented in Ballista (also ASL 2.0) and myself and @jorgecarleitao have been the only contributors to this code so far and we both have signed CLAs on file.
The current code compiles but is not complete and doesn't actually work yet. I will try and get this fully working for the 2.0.0 release if others think this is a good approach.

FYI @jorgecarleitao @alamb @alippai @vertexclique @svenwb since you have all commented on the related JIRA and design document.

This is super exciting!!!! Thanks a lot @andygrove for pushing this through!
I am trying to understand how this is related to other executing architectures in Rust (e.g. Tokyo) and more broadly to the traits in the crate futures.
My current hypothesis is that this may be simpler if we leverage some of the existing traits in futures.
In my current understanding of DataFusion's Execlution plan, ExecutionPlan behaves like an IntoIter whose Iterator iterates over parts of a partition, via execute(part_index), where part_index's range is given by output_partitioning().partition_count() (Longer version here).
In fact, with some dull changes (test here), we can iterate over a full partition as follows:
let plan: &dyn ExecutionPlan = ...

plan.into_iter().map(|maybe_part| {
    let part = maybe_part.unwrap();  // todo handle error via special flatten
    part.into_iter().map(|maybe_batch| {
        println!("{:?}", maybe_batch?.num_rows());
        Ok(())
    })
})
.flatten()
.collect::<Result<()>>()?;

The problem with this is that it requires each node to be responsible for spawning threads, which, as identified in ARROW-9707, is problematic.
To address this, we need to make execute something that a scheduler can chew in parts. For that reason, I think that #8285 , that proposes execute to be async, is beautiful!
But, If execute is async, then I think that ExecutionPlan could implement IntoStream. In this scenario, ExecutionPlan would become

an object that knows know to convert itself into a stream of record batch iterators

The advantage is that any scheduler that consumes futures::Stream can pick this stream and execute it. Since it now knows how to stop in the middle of execute in case something is blocking it (including any of its inputs), it can switch tasks ad-hoc. In other words, IMO we can leverage any async library to run this stream.
In this scenario, one idea to address ARROW-9707 is:

land #8285
implement IntoStream for ExecutionPlan
migrate our calls of thread:spawn  in the different nodes to .await
pick a scheduler from the shelf and run the stream using it.

If we want some customization (e.g. logging, some special naming for the tasks), we can always add a trait DataFusionStream: Stream<...> and implement it on top of Stream.
Note that this would effectively make our ExecutionPlan to be a dynamically-typed stream adapter (a-la futures::stream::Select, but dynamic): it consumes one or more streams, and it outputs a new stream. Conceptually, IMO this is exactly what an ExecutionPlan plan is.
In a distributed environment, the main difference would be that the physical planner would plan ExecutionPlan whose execute includes submitting a job to a worker and wait for the result (e.g. via a TCP channel); the result is still a stream though, and the scheduler can decide to wait for network + node's compute and perform a switch, the same way it can wait for I/O.
I am sorry that I only came up with this idea now. I finally understood the implications of #8285.

@jorgecarleitao Async/await helps a lot but we also need our own scheduler to orchestrate how a query is executed. I am going to write up something more detailed with my reasoning on this soon but here is one example. When I run the TPC-H query I am testing against a data set that has 240 Parquet files. If we just try and run everything at once with async/await and have tokio do the scheduling, we will end up with 240 files open at once with reads happening against all of them, which is inefficient. It is better to process a smaller number of files concurrently (better use of page caches, fewer file handles open, etc) and process them in batches.

It makes sense, @andygrove.
Note that I do not disagree with us having a custom scheduler. I was noting that we could separate the two problems: one problem is creation of tasks, and the other is the scheduling of said tasks. When we spawn tasks in executionPlan::execute, we may be mixing these two.
The same way that we expose execution details of a node via (output_partitioning), we can expose other execution details (e.g. is_scan()), that our custom scheduler can use to e.g. limit concurrency.
Regardless, this is in no way a blocker or anything, and we can leave this discussion for a future iteration - I agree that what you are doing here is really great stuff and we should go for it 🚀

@andygrove I think now you understand all my issues I had previously. The scheduler proposal and the recent comments regarding the concurrency are all superb, I think you are on track. Thanks for listening about my fears previously.
My only note: https://github.com/apache/arrow/pull/8283#issuecomment-699655553 likely you want to read a largish partition in "one go". AFAIR HDFS creates ~128MB large parquet chunks. Reading ~100MB large parquet files, or large columns with tens of MBs of data in one go will likely increase the throughput. While using local disks values over a few MBs won't make any difference, but using S3, HDFS, GPFS, NFS it can be beneficial.
I couldn't find how the TPC-H parquet files you test with are structured, can you give me some pointers?

When I run the TPC-H query I am testing against a data set that has 240 Parquet files. If we just try and run everything at once with async/await and have tokio do the scheduling, we will end up with 240 files open at once with reads happening against all of them, which is inefficient.

One way to avoid this type of resource usage explosion is if the Parquet reader itself limits the number of outstanding Tasks that it submits. For example, with a tokio channel or something.
It seems to me the challenge is not really "scheduling" per se, but more "resource allocation"

BTW @jorgecarleitao  -- I really like your ideas regarding using async streams in ExecutionPlan -- I think it sounds like a very elegant way to implement back pressure (and avoid starting too many things at once)

That makes sense, and we already have some funky channel and thread
interaction in the DataFusion parquet reader that we could probably adapt
fairly easily. We could introduce a config setting for max concurrent
parquet readers.
On Mon, Sep 28, 2020 at 12:12 PM Andrew Lamb<EMAIL_ADDRESS>wrote:

When I run the TPC-H query I am testing against a data set that has 240
Parquet files. If we just try and run everything at once with async/await
and have tokio do the scheduling, we will end up with 240 files open at
once with reads happening against all of them, which is inefficient.
One way to avoid this type of resource usage explosion is if the Parquet
reader itself limits the number of outstanding Tasks that it submits. For
example, with a tokio channel or something.
It seems to me the challenge is not really "scheduling" per se, but more
"resource allocation"
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/apache/arrow/pull/8283#issuecomment-700197576, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAHEBRGAPSBS2HWZRE2PI73SIDGX5ANCNFSM4R3A4JHA
.

@andygrove  I wonder what, if anything, you plan to do with this PR now

@alamb That is a good question. I have been too busy at work lately to work on Arrow/DataFusion/Ballista but I have been spending some time contemplating where to go next.
This scheduler prototype is interesting, but until we have partitioning, shuffles, joins, and async working smoothly, perhaps there isn't much point working on the scheduler yet. I would be ok with closing this PR for now. It also might be premature for me to try and contribute a scheduler to DataFusion since I am really just prototyping this right now and lack experience in this area.
If we had partitioning, shuffles, and joins in DataFusion, it would mean we could run a much wider range of TPC-H queries on a single node, and we could also build some nice command line utilities for converting data sets from CSV and Parquet with repartioning which would be quite compelling for a lot of people IMO and could attract new contributors.

@andygrove  your description makes sense. Thank you for the ideas that this PR sparked.
I agree that an csv --> parquet converter would be really useful and cool. We will likely need much of the same underlying parts (arrow->parquet, with sorting and partitioning) for IOx, so I am hopeful we can contribute in that area as well


Create 0000-01-02-L676.md

layout: slide
title: "Welcome to our second slide!"
Your text
Use the left arrow to go back!

I am learning about the Biden's comments on the Sanford deep underground lab at the old Home Stead gold mine in Lead SD best job i have ever had


notebook output: text line limit doesn't work for stderr

Steps to reproduce:

Run a cell which produces large number of lines to stderr, e.g. for python:import numpy as  np
assert False, np.random.randn(100,1)

I'm not sure if it's the intended behavior but the output doesn't get truncated. Why do I want the output to be truncated? Because I want to copy the output easily which isn't possible now:

Does this issue occur when all extensions are disabled?: Yes
VS Code version: Code 1.63.2 (899d46d82c4c95423fb7e10e68eba52050e30ba3, 2021-12-15T09:39:46.686Z)
OS version: Linux x64 5.13.0-22-generic snap
Restricted Mode: No

System Info

Item
Value

CPUs
AMD Ryzen 3 5300U with Radeon Graphics (8 x 2842)

GPU Status
2d_canvas: unavailable_softwaregpu_compositing: disabled_softwaremultiple_raster_threads: enabled_onoop_rasterization: disabled_offopengl: disabled_offrasterization: disabled_softwareskia_renderer: enabled_onvideo_decode: disabled_softwarevulkan: disabled_offwebgl: unavailable_softwarewebgl2: unavailable_software

Load (avg)
2, 1, 1

Memory (System)
7.12GB (1.21GB free)

Process Argv
--no-sandbox --force-user-env --unity-launch --crash-reporter-id f9ef0483-9e99-46a3-9f8c-1e6a71b29e0e

Screen Reader
no

VM
0%

DESKTOP_SESSION
plasma

XDG_CURRENT_DESKTOP
KDE

XDG_SESSION_DESKTOP
KDE

XDG_SESSION_TYPE
x11

A/B Experiments
vsliv368cf:30146710
vsreu685:30147344
python383:30185418
vspor879:30202332
vspor708:30202333
vspor363:30204092
pythontb:30283811
pythonptprofiler:30281270
vsdfh931cf:30280410
vshan820:30294714
vstes263cf:30335440
vscorecescf:30384386
pythondataviewer:30285071
vscod805cf:30301675
pythonvspyt200:30340761
binariesv615:30325510
bridge0708:30335490
bridge0723:30353136
vsaa593:30376534
pythonvs932:30410667
vscop804:30404766
vs360:30404995
vsrem710:30416614
py55gd98:30411514
vscexrecpromp3t1:30407762

This is something to address in vscode core.

Thanks for creating this issue! It looks like you may be using an old version of VS Code, the latest stable release is 1.67.2. Please try upgrading to the latest version and checking whether this issue remains.
Happy Coding!

It sounds like the extension is caching the setting value? Why is this moved to the vscode repo?

Output text lines are handled by the core, not by the extension.

Oh wait maybe the line limit was added to the error renderer? This might be in the extension.

Yeah sorry, @rebornix implemented this in the extension. Moving back.