Add custom docstring to dd.to_csv, mentioning that one file per partition is written

Previously it was copying the pandas one, so there was no reference anywhere to the fact that multiple files were being created and a globstring is expected.
See #1506.

Thanks.  It would be good to provide explanations and examples for the dask-specific functionality here, notably the use of name_function.

I updated the PR, let me know if there is anything missing.

Awesome.  Merging!


Created Stack Program in C

This stack Program  is handle all operation like push, pop and Important for learning stack

Plz merged this Pull Request


blur event question

The blur event fires when the text part of the editor is blurred, is there also a way to trigger a blur like event when the 'entire' editor (textarea + buttons/menu) is blurred?

Currently having this issue as well, did you discover a solution?
Sorry for the reply 1.5 years later :P.

I'm having difficulty getting the blue event to fire at all. Any way to bump this issue?

I'm having difficulty getting the blue event to fire at all. Any way to bump this issue?


Add support for GDAX paginated getTrades

This is associated with https://github.com/knowm/XChange/issues/2766

@walec51
Adam: the problem with the build error has swapped over from 10 to 8!  Would you mind giving it another poke?  Thanks.

Take a look at any of the other module's poms with a dependency. You need to define it in both parent and module, but the module one should have no version defined.

@timmolter -- Thanks Tim.


Create 2023-area63-fall-conference

Create 2023 Area 63 Fall Conference event.

A file was removed with no reason why. Two more random files were added and not linked to from anywhere ... also with no explanation why. Also, a jpg is definitely not the correct format for that sort of document.

Sorry I thought you got my email for help on updating the district map. Can you help?

Sorry I thought you got my email for help on updating the district map. Can you help?

If there was an email with any questions that I failed to respond to, I missed it. Even looking back through archives (and spam), I can't find anything. Can you provide a description of what you need help with?
This entire website project is built around the hugo "static website generator," which has a lot of fantastic documentation, including how to test your own changes, where files go and even how to customize templates.
The aamod project was built with the goal of providing a very stable and secure website solution with trivial/hands-free long-term maintenance. There was a lot of effort put into ensuring that maintaining meetings events was as simple as copy/paste/tweak, but hugo is a powerful website generator and things can get confusing once you step outside of those areas.
All things considered, it seems like it might be best to close this PR and instead just create an issue with a description of the changes you would like to see. I honestly believe you will have a much better experience if you limit your PRs to just meeting changes and use issues for any other requests.

Closing in favor of #20.


( Skin ) Cleanup Gameplay UI And optimized for using with 1.0x/0.8x scale

Current skin layout it's now messed up and i think i should clean it and optimized some skin stuff

done


Dark mode image text legibility

This image: https://docs.microsoft.com/en-us/azure/architecture/aws-professional/images/azure-aws-account-compare.png on this page: https://docs.microsoft.com/en-us/azure/architecture/aws-professional/ is difficult to read in dark mode

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: d100d43f-d48a-3d97-1aea-7a5409fdccc8
Version Independent ID: 568dcd88-b93c-1d41-44d0-8643dd057a33
Content: Azure for AWS Professionals - Azure Architecture Center
Content Source: docs/aws-professional/index.md
Service: guidance
GitHub Login: @lbrader
Microsoft Alias: pnp

Hi there
same applies in the new section of Cloud Adoption Framework where some graphics are just unreadable or barely e.g. the hierarchy of management groups and subscriptions or Future state
Some graphics have white background which would be a quick fix. Ideally there would be theme based graphics i.e. light and dark version.
This does not take away the fact that it is very good quality docs but just more easy to consume :).
Cheers
MAnu

@MikeWasson It looks like this problem could be more widespread than those two images: https://github.com/mspnp/architecture-center/pull/1328
I wrote a script using ImageMagick to help find all of the images with transparent backgrounds:
~/Documents/GitHub/architecture-center $ for file in $(find . -name '*'); do

  if [[ $(identify -format '%[opaque]' $file 2>/dev/null) == False ]]; then echo $file; fi;

done

./docs/cloud-adoption/appendix/_images/components.png
./docs/cloud-adoption/_images/governance/process-metrics.png
./docs/cloud-adoption/_images/governance/design-guide.png
./docs/cloud-adoption/_images/governance/process-toolchain.png
./docs/cloud-adoption/_images/governance/policy-enforcement.png
./docs/cloud-adoption/_images/governance/enforcement.png
./docs/cloud-adoption/_images/governance/process-enforce.png
./docs/cloud-adoption/_images/governance/process-template.png
./docs/cloud-adoption/_images/governance/process-maturity.png
./docs/cloud-adoption/_images/governance/business-risk.png
./docs/cloud-adoption/_images/governance/corporate-policy.png
./docs/cloud-adoption/_images/governance/process-risks.png
./docs/patterns/_images/category-security.png
./docs/patterns/_images/category-design-implementation.png
./docs/patterns/_images/category-data-management.png
./docs/patterns/_images/category-availability.png
./docs/patterns/_images/category-performance-scalability.png
./docs/patterns/_images/category-messaging.png
./docs/patterns/_images/category-resiliency.png
./docs/patterns/_images/category-management-monitoring.png
./docs/reference-architectures/ai/_images/python-example-predictions.png
./docs/vdc/images/vdc-network.png
./docs/vdc/images/vdc-lift-and-shift.png
./docs/vdc/images/vdc-deck.png
./docs/_images/github.png
./docs/_images/icons/databricks.png
./docs/_images/icons/cognitive.png
./docs/best-practices/images/cdn/CDN.png

Hope this helps you guys identify all of the potential image legibility problems in dark mode!


the list of audiobook and book doesnt show all the resourses

I have comfirmed the problem is the list only can show the limits number of the books, and another problem is like this kind of book https://www.kobo.com/es/es/ebook/25-cuentos-populares-de-espana-para-descubrir-su-historia-1, the epub file is not correct, text and background picture is apart.

Thank you for bringing this to my attention. I did a small fix for getting more records from the kobo sync api, but since I only have 33 items on my account, I still get everything on the first request.
Can you try the new v1.2.1 release to see if that works? Can you check whether you get more than one sync request, and what the responses for each request are?
Also, I bought the book you linked there, and it shows up fine when I log in with my account:

Hi,
I believe the issue lies with the kepub format itself. Most standard EPUB readers cannot display kepub content correctly. So far, I’ve found that only the Calibre viewer can render it properly. And with the fix, the list of books show the correct way. I can recieve more than one sync.
Secondly, for some books—like this one: https://www.kobo.com/es/es/ebook/sherlock-holmes-el-hombre-del-labio-retorcido-spanish-english the saved filename does not match the actual book title.

Third, there’s a bug. A book that is no longer in my library but previously existed in the Archives still shows up in the program web interface. The program incorrectly identifies it as unauthorized to download, the web interface either freezes the download button or displays a “Not Authorized” message, causing the page to become unresponsive.

Lastly, could you consider adding a feature to allow batch downloads? Currently, books must be downloaded one by one. I understand that implementing this may involve setting a logic for which version should be downloaded by default, and if that version isn’t available, which one should be next.
Thank you for your attention and efforts.

It sounds like the issue of listing all books/audiobooks in your account has been resolved, so I will close this issue.
Filename
I'm guessing that filename is from the "Download DRM Free" link? If so, that's the filename used by Kobo in the direct download link.
Book not in library is listed
This is probably a bug on Kobo's side. I don't know what, if anything, would indicate in the Kobo API response that you don't actually have access to the book before attempting to download the epub file.
Batch / queued downloads
You can open up a new issue for this feature request, but I currently don't plan on implementing that.


Why first and last layers of ResNet are not feeded to FPN?

I've encountered that here:
https://github.com/qubvel/segmentation_models/blob/master/segmentation_models/fpn/model.py#L10
you are extracting outputs from the very begining of each Resnet layer to feed decoder. It results in ignoring the whole last Resnet layer (only BN and activation is taken from it).
Is where a reason for it?
Also data from high-resolution layer  of ResNet (before the first MaxPool) is not used, with results in need to upsample FNN results by 4.
Is it like in original paper?

This is kind of misunderstanding of naming convention. Actually, the first block of each stage has a strided convolution, so all next blocks follow with lower spatial dimensions. Taking skip connection at this block allows getting all features from the previous stage. For better understanding you can visualize network graph:
from segmentation_models import FPN
from IPython.display import SVG
from keras.utils.vis_utils import model_to_dot

# create model with defined shape
model = FPN('resnet34', input_shape=(224,224,3))

#plot model
SVG(model_to_dot(model).create(prog='dot', format='svg'))

Hello! If you mean that 'stage2_unit1_relu1' actually is output of stage1+BN+relu etc., it is not surprise for me. Really I missed that extract_outputs(..., include_top=True) also adds outout of the whole network to outputs, listed in DEFAULT_FEATURE_PYRAMID_LAYERS. Drawing of structure helped me, so I see that the last ResNet layer is not ignored.
But still it seems strange that the 1st output taken by decoder is only Stage1 output, i.e. after 2 strides.
Adding relu0 (before 1st maxpooling) to decoder inputs really improves results (but makes it 2+ times slower :-(  )

Thaks for your comment, I was also thinking about including 'relu0' layer to pyramid, however leave it as described in presentation with x4 final upsampling. Would it be useful to make it as an optional argument?
P.S. Are you using this network for salt semntation challange?

Yes. Sending relu0 to decoder improves metrics from 0.809 (some baseline configuration) to 0.824, but also "improves" LR time from 17 to 38 s/iter.

A few ideas:

there is a theory that tf.resize_image with interpolation different from 'nearest' is broken and shift image by 1 px. So using this layer with interpolation 'bilinear' at lower dimensions affect too much, on the other side we have skip connections and it is enough for 'nearest' interpolation to reconstruct fine features.
Sometimes interpolation ('bilinear', 'bicubic') produces strange artefacts on corners, so you can check mertic for images grouped by mask size to check where the metric decreased significantly.

I'll try but later. Currently my computer is busy by other tasks


adjust Readme

The current Readme is in large parts the one which got genereated with nest-cli.
We could transform it to use the 'Eddiehub-Look-and-Feel'

Working on it. @eddiejaoude, should we write the features of the bot, how does it work, how to contribute, etc.?

Sounds like a good idea

@Panquesito7 Are you working on this issue, or want to get started?

I would like to know the features of the bot and everything; otherwise, I can't write anything. We could both work on it if you want, though. 🙂

@Panquesito7 best to start with small documentation and we can merge multiple PRs. Each will already add value.
I suggest doing some PRs something like this

list the modules and high level features
list commands within the modules
...

Hey,
@Panquesito7 are you still working on it?

It looks like this is already fixed 👀 it can be closed now. Forgot to link it to the PR. 😅

@Cahllagerfeld please close this issue

Ping. This can be closed now.

awesome thanks @Panquesito7 👍


Result

Result - Swift type modelling the success/failure of arbitrary operations. :large_orange_diamond:

@antitypical do you know on what category we could add Result?

@mdiep do you know on what category we could add Result?

I dunno, Data Structures / Algorithms?


App Crash Report

What happened?
API Client Crashes after processing several hundred rows
Steps To Reproduce
Running the app. I've tried to run the three times and it seems to crash after running for around 20 minutes. So far restarting the app hasn't seemed to have helped.
App Version
1.5.7
Electron Version
17.0.0
Operating System
Windows 10
Relevant log output
Error message
Error invoking remote method 'geocode': TypeError: Cannot read properties of undefined (reading 'statusCode')
Stack trace
Error: Error invoking remote method 'geocode': TypeError: Cannot read properties of undefined (reading 'statusCode')

Thanks. We will take a look.

Is there a certain record that fails or is it more of a duration thing? I'm trying to tell if it's more of a data issue or a network issue.

I'm not actually sure. I assumed it was a duration thing since I'm
geocoding fairly large files - 40K rows. The first month that I did it in
the office I managed to run the whole file in the background without issue.
The next time I tried to run that many rows at home I would consistently
have network issues where the job would just stop, so I had to break it
into four chunks (This was on my home network).
This most recent time I tried it it would time out and give the error after
20 or so minutes of running - both a 10K row chunk and the full 40K rows. I
just tried running it from a different part of the data rather than from
the start to see if it may be a particular row setting it off and it still
stopped after about 20 minutes. So, I'd assume it's a network issue unless
there's multiple new rows causing issues that haven't existed in previous
files.
On Thu, Mar 3, 2022 at 12:37 PM steveoh @.***> wrote:

Is there a certain record that fails or is it more of a duration thing?
I'm trying to tell if it's more of a data issue or a network issue.
—
Reply to this email directly, view it on GitHub
https://github.com/agrc/api-client/issues/122#issuecomment-1058415541,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AXGNGS3ZDQCVJTZUBQTQAE3U6EIGXANCNFSM5PVDEFEA
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you authored the thread.Message ID:
@.***>

--
*************** IMPORTANT MESSAGE ***************
This message, including
any attachments, may contain confidential information intended for a
specific individual and purpose, and is protected by law.  If you are not
the intended recipient, delete this message, including from trash, and
notify me by telephone or email.
If you are not the intended recipient,
any distributions or copying of this message, or the taking of any action
based on its content is strictly prohibited.

I don't actually have a license for ArcGIS Pro - I don't suppose I can run
that in an open-source option, can I?
On Thu, Mar 3, 2022 at 4:00 PM steveoh @.***> wrote:

Are you able to try running the job with one of our other clients? Using
the geocoding toolbox https://github.com/agrc/geocoding-toolbox in
arcmap/pro?
—
Reply to this email directly, view it on GitHub
https://github.com/agrc/api-client/issues/122#issuecomment-1058610562,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AXGNGS4TMSIU77QPFAZGB4DU6E77RANCNFSM5PVDEFEA
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you authored the thread.Message ID:
@.***>

--
*************** IMPORTANT MESSAGE ***************
This message, including
any attachments, may contain confidential information intended for a
specific individual and purpose, and is protected by law.  If you are not
the intended recipient, delete this message, including from trash, and
notify me by telephone or email.
If you are not the intended recipient,
any distributions or copying of this message, or the taking of any action
based on its content is strictly prohibited.

I have another user (Cindy) that is experiencing the same issue. She has previously been able to successfully run batches of 5K-25K without issue but is now getting the same error message. She verified that attempting to run a previously successful batch is now returning the error message.
The last successful batch was run by her on Mar 12, 2022 6:13 PM.

Ok, interesting. We haven't made any app changes since Feb.


Add editorconfig

Add an .editorconfig file so that Xontrib project files adhere to a common style across text editors and contributors.

Thanks @mattmc3 !


Fix PySpark Kernel Connection Change

PR from main #12494
This PR fixes: #12488

Pull Request Test Coverage Report for Build 262069991

0 of 1 (0.0%)  changed or added relevant line in 1 file are covered.
1 unchanged line in 1 file lost coverage.
Overall coverage decreased (-0.002%) to 38.895%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

src/sql/workbench/contrib/notebook/browser/notebookActions.ts
0
1
0.0%

Files with Coverage Reduction
New Missed Lines
%

src/sql/workbench/contrib/notebook/browser/notebookActions.ts
1
32.34%

Totals

Change from base Build 262067102:
-0.002%

Covered Lines:
19208

Relevant Lines:
45065

💛  - Coveralls


Using big bloom filters causes temp file errors

I have a continuous view defined as follows:
begin;
  create view views.discover_raw WITH (ttl = '4 months', ttl_column = 'month') as
    select
        date_trunc('month', ("partition.year" || "partition.month" || "partition.day")::timestamp) as month,
        "dataPoints.consumptionType" as consumption_type,
        "dataPoints.consumedResourceUri" as consumed_resource_uri,
        "dataPoints.ids"->0->>'idType' as id_type,
        bloom_agg("dataPoints.ids"->0->>'idValue', 0.05, 400000) as ids
    from datalakerows
    where "dataPoints.consumedResourceUri" is not null
    group by 1, 2, 3, 4;
  create index discover_consumption_type_idx on views.discover_raw (consumption_type);
commit;

When inserting at a high enough rate, this view causes a cascade of the following error messages:
2019-01-08 20:49:45.869 UTC [31991] WARNING:  temporary file base/pgsql_tmp/pgsql_tmp31991.5 not closed at end-of-transaction
2019-01-08 20:49:46.039 UTC [31993] ERROR:  temporary file 2 is not owned by resource owner WorkerResOwner

Note that this appears to be a function of the cardinality of the bloom filter. The problem is manifest for ```
bloom_agg("dataPoints.ids"->0->>'idValue', 0.05, 400000)
but not for

bloom_agg("dataPoints.ids"->0->>'idValue', 0.05, 100000)

Simpler repro case:
CREATE FOREIGN TABLE s (x integer) SERVER pipelinedb;
CREATE VIEW v0 AS
 SELECT x, bloom_agg(random(), 0.05, 400000) AS ids
FROM s GROUP BY x;
INSERT INTO s (x) SELECT generate_series(1, 1000) x;

@ewestern we've just fixed this in master. Are you able to work around this for the time being or would you like us to push out an official release update containing the fix?

That's great!
For now, I'm working around it by using a really large work mem.
I think getting the resource usage down will be a pre-req for promoting this application, but it's not super-urgent.
Do you think there will be a normal release within a few weeks?

I think getting the resource usage down will be a pre-req for promoting this application, but it's not super-urgent.

This will definitely help with that. Here's what was happening here:

Worker processes store their CQ plan output in memory up to pipelinedb.batch_mem
As soon as that threshold is crossed, some of the plan output will be spilled to temporary files which have a lifetime of the current transaction
Workers actually spilling to disk is rare, but in the case of Bloom filters specifically the plan output can get pretty large (num_groups * bloom_filter_size)
You can see your Bloom filter sizes by using bloom_print(bf_column)
Reducing pipelinedb.batch_size should also help here, as lowering it will lower the number of output groups
You can probably increase pipelinedb.num_workers to compensate for smaller batches such that you have more workers each executing on smaller input batches, giving you similar throughput at the expense of a bit more CPU

In any case, after you pick up this fix you'll be able to bring pipelinedb.batch_mem back down, as temporary files for spillage will work just fine and likely won't affect perf too much.

Do you think there will be a normal release within a few weeks?

Yes, definitely. No formal release date set but 1.1.0 should definitely be out within weeks, we're on the home stretch with it.

Thanks for the additional help on this, @derekjn .
I wonder if I can belatedly take you up on your offer. Would a patch release containing this fix be too much trouble? I'm going to have to increase the size of my BFs again, and I don't think I can reasonably bump batch_mem anymore.

Would a patch release containing this fix be too much trouble?

@ewestern not for you! I'll reply here once it's published, no problem.

@ewestern here you go:
https://github.com/pipelinedb/pipelinedb/releases/tag/1.0.0-13
Please don't hesitate to let us know if you still have an issue here after picking up this fix--we want to hear from you if something still isn't right!

Thanks, @derekjn
It's been running for a few days and haven't seen these issues again.


[Question] How to limit CPU usage?

I want to limit cpu usage on cpu-only model.
My config file is like this
model_repository: /models/seg_d2
triton_launch_mode: docker
output_model_repository_path: /data/trtis/model_analyzer/test/model
export_path: /data/trtis/model_analyzer/test/export
run_config_search_max_concurrency: 10
override_output_model_repository: true
collect_cpu_metrics: true
perf_analyzer_flags:
shape:
- INPUT_IMAGE:576,1024,3
profile_models:
seg_d2_model:
cpu_only: true
If I use TRTIS container directly, I can limit CPU usage throuth docker run arguments like '--cpuset-cpus' or '--cpus'.
However, when I use model- analyzer, It create TRTIS container automatically so I cannot control it.
Also, when triton_launch_mode is set to remote, memory usage is not displayed in the report.

Hi @smkim17 , it does not appear there is currently a way to do this. I think we can add an option to MA to specify generic docker run args. I will create a ticket
As a possible short term workaround, do you run from inside of the sdk container? If so, I'm wondering if you launched THAT container with the desired CPU options if they would carry over into the nested server docker that is launched.

I set triton_launch_mode: remote to sdk container.
Running model-analyzer in the
'docker update --cpus=5' on the TRTIS container created by model-analyzer
Cheak memory comsumption using 'docker stats'.
Since TRTIS does not release memory once allocated, it was sufficient to proceed in this way.


CLI: Unknown network error when passing gateway-address in cross-msg fund command results

Running the command to send funds from the address on parent network to the address on subnet:
ipc-cli cross-msg fund \
--from 0x203bE92E679AFc8aF781B00633b18B4F1103d16f \
--to 0x258392F3070739fa6D608cCB71ACAaa63fd42D10 \
--gateway-address 0x0341fA160C66aBB112195192aE359a6D61df45cd \
--subnet /r314159/t410fug7q7fgzeehfgr6qlubzs45z2sjzcbw3nbhpiyi \
200

results in
[2023-11-14T10:58:23Z ERROR ipc_cli] main process failed: error processing command Some(CrossMsg(CrossMsgsCommandsArgs { command: Fund(FundArgs { gateway_address: Some("0x0341fA160C66aBB112195192aE359a6D61df45cd"), from: Some("0x203bE92E679AFc8aF781B00633b18B4F1103d16f"), to: Some("0x258392F3070739fa6D608cCB71ACAaa63fd42D10"), subnet: "/r314159/t410fug7q7fgzeehfgr6qlubzs45z2sjzcbw3nbhpiyi", amount: 200.0 }) })): Unknown address network

It works when the gateway-address parameter isn't provided and this address is just taken from the config.toml

My take on this one is we should not pass Gateway as a parameter any more and should use whatever is in the config. cc @adlrocha.


Stan GPU speedup (and ABM CSXMs with SYCL/DPC++)

Hi @bob-carpenter
re https://github.com/ImperialCollegeLondon/covid19model/issues/33
Stan GPU speedup
This is an offline whisper to you re Stan speedup to keep out of the way of immediate work by coders and not divert an existing issue or raise a new one. I am a fly on the wall, not part of Imperial College team.
See note at the end re my (lack of) relevant competence.
I mentioned my assumption that public health analysts doing multiple runs on ordinary PCs would appreciate the fastest possible code and would still find that slow.
Current run time of 90 minutes for full iterations is mentioned here:
https://github.com/ImperialCollegeLondon/covid19model/issues/11#issuecomment-609475356
I assume they would also be able to easily get access to gamer PCs with GPUs. Although many would not have access to the sort of HPC clusters that were used by Imperial College report team for their report 9, access to GPU clusters could also be organized fairly rapidly for work on this much simpler model from report 13.
So I googled "Stan" "Sycl" and "Stan" "DPC++" and confirmed that Stan also runs on GPUs. eg:
GPU-based Parallel Computation Support for Stan
Rok Cesnovar, Steve Bronder, Davor Sluga, Jure Demsar, Tadej Ciglaric, Sean Talts, Erik Strumbelj
University of Ljubljana
arXiv:1907.01063 [cs.MS], (1 Jul 2019)
https://hgpu.org/?p=18987
https://arxiv.org/pdf/1907.01063.pdf
As you must be aware, I don't know much about C++ programming or about GPUs or about Stan, but just enough to google for "Stan" with "Sycl" and with "DPC++" instead of just with "GPU" or just with "CUDA".
My understanding is that Sycl is a superset of C++ oriented to heterogenous parallel programming including GPUs including OpenCL but the above 2019 paper is only for OpenCL.
Also got to a mention of work on Stan with DPC++ which I understand to be a superset of Sycl:
https://discourse.mc-stan.org/t/function-multi-normal-log-causing-intel-compiler-issues-again/4762
That's about all I actually understand but is enough to provoke my third offline whisper without any further checking.
I assume that once the current release is reasonably stable the next step ought to be a version that can be easily run on typical PCs with GPUs and later extended to clusters by users with no knowledge whatever of how that works. This need not require any diversion of effort from Imperial College team as it could be done entirely by others.
I assume that this would require some collaboration between Stan developers and DPC++ developers (and/or SYCL developers) familiar with the very specific optimization issues for GPU acceleration who would be keeen to help as soon as they are contacted by somebody who knows what they are talking about and who knows what others could help with (i.e. you, not me).
If you do follow this up you will be in touch with people who might also be interested in a separate issue relevant to SYCL/DPC++ and GPUs although not to Stan. So I will mention it here.
ABM CXSMs
I'm convinced that Agent Based Models (ABMs) using Communicating Stream Extended State Machines (CSXMs) are likely to be useful for more granular models relevant to modulating the localized imposition and lifting of "social distancing" and "lockdown" restrictions between successive pandemic waves over the next 12-18 months till vaccine as described in Imperial College response team report 9. The models for that are based on less granular microsimulations.
Reason is that CSXMs strikes me as a good abstraction at a layer between epidemiological mechanistic model computations and GPU acceleration hardware so that a an Agent Based model designer could design models that work well with GPU acceleration despite not knowing anything much about that or about any form of C++ coding.
I wouldn't know, but the people who ought to know at Imperial College are so busy with more urgent problems that I would not want any of them to spend a moment thinking about it.
I did mention it to the FLAME GPU team who are the only people I know of working with ABM CSXMs and are not in frontline of covid-19 fight so could have time to think about it:
https://github.com/FLAMEGPU/FLAMEGPU2_dev/issues/222
Issue still open there since 21 March (nearly 3 weeks). Could be simply that I am completely wrong or could have fallen through cracks (eg responder could be hospitalized).
Hope you might also know somebody who could check it out.
Lack of Competence
See pythonesque "Warning: Lark's Vomit" at end of my second offline whisper here:
https://github.com/thecapitalistcycle/covid19model/issues/2

I'm not an epidemiologist or a GPU coder, so I'm afraid you're asking the wrong person!

Ok but I'm not either and also not a Stan or C++ coder and don't know who or where to ask or how to word it.

Should I just assume any problem from 90 minute run times will get dealt with by Stan GPU coders without any significant delay  from not raising it now.

Or should I post a shorter separate  new issue at main repo.

If I draft  one offline here first can you check draft to suggest improvements and/or better place to raise it?

I'm not sure what you want to propose and to whom.  If it's a new kind of GPU feature for Stan in general, then you'd need to talk to our GPU coders.  If it's a new kind of epidemiology model, then you need to talk to the epidemiologists.  If it's something related to the Stan language, then I'm a good person to talk to.

I have not read the Stan User Guide, Reference Manual or Functions Reference.
I have searched 2.22 of each for terms GPU, CUDA, SYCL and DCP finding nothing.
I believe from the paper and forum post above that it is possible to speedup STAN code by running on GPUs readily available on gamer PCs but this requires some separate work by STAN GPU coders.
I propose that the covid19model code to which you contributed suggested speedups and readability should be further enhanced (when stable) to run much faster using GPUs on gamer PCs.
This does not need new epidemiology model and should not be work done by busy Imperial College team on frontline of pandemic.
I doubt it needs Stan language changes  but assume it needs "our GPU coders" who you  know and  I don't know and also do not know what to say to them.

Stan GPU capability is built into our releases and available to everyone.  What it does is speed up certain matrix operations. How much of a speedup it'll provide will depend on the GPU and which operations are used in the models.  Like everything else in Stan, we continue to expand capability and efficiency.  See Stan doc for configuring GPUs and the design doc and explanation.
The other way to speed these things up is with multi-core using our built-in map-reduce functionality.
The place to try to enlist help for a project would be on the Stan forums.

Thanks! First and third links are the info I needed.
Below is my draft for raising an issue at:
https://github.com/ImperialCollegeLondon/covid19model/issues
I think it would be better if you raised something similar instead of me but I will post it unless you do.
Add OpenCL to speedup Stan code on gamer PCs with GPUs
Enhancement when release is stable.
Current run time of 90 minutes for full iterations is mentioned here:
https://github.com/ImperialCollegeLondon/covid19model/issues/11#issuecomment-609475356
@bob-carpenter said OpenCL capability is built in to Stan. But requires separate installation.
See Stan doc for configuring GPUs
Also said the place to enlist help to do this enhancement would be the Stan forums
Regional public health analysts running code would have easy access to PCs with supported GPUs but would need it completely built in ready to run eg in Docker file without having to follow above installation details.
"Stan uses OpenCL to design the GPU routines for the Cholesky
Decomposition and it's derivative. Other routines will be available in the future. These routines
are suitable for programs which require solving large NxM matrices (N>600) such as algorithms
that utilize large covariance matrices."
Above doc also lists what Stan methods are supported for GPU speedup.
I have no idea whether or how much those methods are used in current code and would contribute to speedup.
But given 90 minute run times it looks to me worth checking out. I cannot help do so.
The design doc and explanation is:
GPU-based Parallel Computation Support for Stan
Rok Cesnovar, Steve Bronder, Davor Sluga, Jure Demsar, Tadej Ciglaric, Sean Talts, Erik Strumbelj
University of Ljubljana
arXiv:1907.01063 [cs.MS], (1 Jul 2019)

I don't think this particular model is particularly amenable to the available GPU speedups.  MPI through map_rect (and in our next release, through a much beter map function) would probably be the better route, but it's still a huge pain.  The devs of that project say they're also trying to write the model so that it'd be readable and didn't want micro-optimizations that'd speed things up but lead to obscure code.  I think this makes sense because they want to modify it.

Ok thanks. I will leave it till later when models actualy amenable.


Tests For Indirect Calls

It would be good to have the tests that relate to indirect calls be moved to their own set of tests, and have them specifically look at whether indirect calls are resolved correctly or not (not just whether they are resolved at all), using the analysis.
The tests which have indirect calls are the following:

functionpointer (all variations)
indirect_call (all variations except the O2 variations)
jumptable (all except O2)
jumptable2 (all variations)
jumptable3 (all clang variations)
switch2 (clang, clang_no_plt_no_pic, clang_pic)
syscall (clang_O2)

To implement this I might write a function to query the IL using the visitor, like a genral version of the visitor you wrote to extract the variables without stores and loads https://github.com/UQ-PAC/bil-to-boogie-translator/blob/e0828905663ce6435652e5c90b69abdd4a77596e/src/main/scala/ir/Visitor.scala#L320
Basically a function that takes a predicate on whether to descend into the node, a predicate that matches nodes,
and a function/closure to apply when the match is satisfied.


[draft] use DestinationDatasetHandlerService while creating trash location

Dear Gobblin maintainers,
Please accept this PR. I understand that it will not be reviewed until I have checked off all the steps below!
JIRA

[ ] My PR addresses the following Gobblin JIRA issues and references them in the PR title. For example, "[GOBBLIN-XXX] My Gobblin PR"

https://issues.apache.org/jira/browse/GOBBLIN-XXX

Description

[ ] Here are some details about my PR, including screenshots (if applicable):

Tests

[ ] My PR adds the following unit tests OR does not need testing for this extremely good reason:

Commits

[ ] My commits all reference JIRA issues in their subject lines, and I have squashed multiple commits if they address the same issue. In addition, my commits follow the guidelines from "How to write a good git commit message":

Subject is separated from body by a blank line
Subject is limited to 50 characters
Subject does not end with a period
Subject uses the imperative mood ("add", not "adding")
Body wraps at 72 characters
Body explains "what" and "why", not "how"

Codecov Report

Merging #3387 (988413b) into master (6036c75) will decrease coverage by 3.42%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master    #3387      +/-   ##
============================================
- Coverage     46.51%   43.08%   -3.43%
+ Complexity    10186     1962    -8224
============================================
  Files          2056      395    -1661
  Lines         80099    16949   -63150
  Branches       8949     2090    -6859
============================================
- Hits          37255     7303   -29952
+ Misses        39402     8835   -30567
+ Partials       3442      811    -2631

Impacted Files
Coverage Δ

...lin/util/filesystem/FileSystemInstrumentation.java
92.85% <0.00%> (-7.15%)
:arrow_down:

.../org/apache/gobblin/cluster/GobblinTaskRunner.java
63.46% <0.00%> (-0.33%)
:arrow_down:

...n/source/extractor/utils/InputStreamCSVReader.java

...apache/gobblin/runtime/api/JobCatalogListener.java

...he/gobblin/kafka/client/Kafka08ConsumerClient.java

...mpaction/mapreduce/test/TestOrcCompactionTask.java

...blin/source/extractor/watermark/HourWatermark.java

.../runtime/job_catalog/MutableCachingJobCatalog.java

...actor/extract/kafka/KafkaIngestionHealthCheck.java

...ache/gobblin/compaction/mapreduce/MRCompactor.java

... and 1648 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6036c75...988413b. Read the comment docs.


PR: Fix some code snippets corner cases

Description of Changes
This PR addresses all of the code snippets errors reported on #10230

[ ] Wrote at least one-line docstrings (for any new functions)
[ ] Added unit test(s) covering the changes (if testable)

[ ] Included a screenshot or animation (if affecting the UI, see Licecap)

Issue(s) Resolved

Fixes #10289.
Fixes #10230
Affirmation
By submitting this Pull Request or typing my (user)name below,
I affirm the Developer Certificate of Origin
with respect to all commits and content included in this PR,
and understand I am releasing the same under Spyder's MIT (Expat) license.

I certify the above statement is true and correct:
@andfoy

@ccordoba12  @dalthviz, does this PR adresses all of your errors with code snippets?

Thanks @andfoy! There are still some things not covered by this PR:

Tab should not cycle among snippets but simply remove the snippet regions after reaching the last one.
When you manually remove the text of a snippet, the snippet region should be removed too.

A couple more issues:

Pressing Ctrl+Z or Crtl+X after editing a snippet doesn't restore the snippet positions. For example, in the screenshot below I removed the nc characters of func with backspace then press Ctrl+Z and got this result:

If you manually move with the left/right arrow keys out of a snippet region, then all snippet regions should be removed. That's what VSCode does and I think it's a good approach.

One more: if enter the following code
from pandas import pd
pd.concat(objs)

and replace objs by as and other characters in quick sucession, then Spyder freezes (it's not always reproducible, but most of the time). After unfreeze it with a Ctrl+C in the terminal, I've got the following traceback related to snippets:
Traceback (most recent call last):
  File "/home/carlos/Projects/spyder/github-repo/spyder/plugins/editor/extensions/snippets.py", line 201, in _on_key_pressed
    self._process_text(text)
  File "/home/carlos/Projects/spyder/github-repo/spyder/plugins/editor/extensions/snippets.py", line 49, in wrapper
    return f(self, *args, **kwargs)
  File "/home/carlos/Projects/spyder/github-repo/spyder/plugins/editor/extensions/snippets.py", line 209, in _process_text
    self.insert_text(text, line, column)
  File "/home/carlos/Projects/spyder/github-repo/spyder/plugins/editor/extensions/snippets.py", line 335, in insert_text
    tokens = tokenize(text)
  File "/home/carlos/Projects/spyder/github-repo/spyder/utils/snippets/lexer.py", line 91, in tokenize
    if regex.match(temp_word) is not None:

Pressing Ctrl+Z or Crtl+X after editing a snippet doesn't restore the snippet positions. For example, in the screenshot below I removed the nc characters of func with backspace then press Ctrl+Z and got this result:

I'm very aware of this case, this is due to the Ctrl+Z behaviour of the CodeEditor, as opposed to the snippets one, while the first deletes the last sequence of characters, the latter stores a tree copy for n and c keypresses. Thus, when the undo call is applied, we backtrack to the "n" tree, rather to delete the "n" and "c" trees.
Is there any way to get the length of the undo text?

You'll have to look for it because I don't know, sorry.

@andfoy if I do the following
import json
# Entering snippet mode, then selecting all (while I still see the snippet squares) and delete everything I get
json.dumps(123, 123)

    self.insert_text(text, line, column)
  File "/Users/gpena-castellanos/Google Drive/develop/quansight/spyder/spyder/plugins/editor/extensions/snippets.py", line 339, in insert_text
    if node.name == 'EPSILON':
AttributeError: 'NoneType' object has no attribute 'name'

@andfoy if I do the following

Does this happens with this PR?

Yes, it still happens qith this Pr

@goanpeca Could you please and try again?

Sure! After lunch 🥗:-)

@goanpeca Could you please and try again?

The latest fixes the issue @andfoy

Hello @andfoy! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

In the file spyder/plugins/editor/extensions/snippets.py:

Line 152:80: E501 line too long (80 > 79 characters)
Line 176:80: E501 line too long (80 > 79 characters)

@ccordoba12 Does the last commit fixes all the undo behaviour?

@andfoy, I'm still seeing https://github.com/spyder-ide/spyder/pull/10256#issuecomment-533066206 with this PR.

@ccordoba12 I cannot reproduce that one:

@andfoy, test_code_snippets is hanging now.

@ccordoba12 The azure test fail is unrelated to this one

@andfoy, please skip test_code_snippets on Windows, that could make our test suite pass there (I don't have time right now to analyze what's the problem that that test seems to be introducing).


As a playing user, I want to earn extra points if I answer the question faster than my opponent, so I can enjoy a high paced game and get a higher rank.

Acceptance Criteria:

[x] The faster player can see that they finished first after answering the question

Dev Tasks:

[x] sopra-fs23-group-10/sopra-fs23-group-10-server#100

All dev tasks are completed and acceptance criterias are met (Note: The players can see their speed relative to the other player represented in the score). Issue is therefore closed.


update conda-forge package to v2.0.0

Comment:
Hi,
I was wondering why the v2.0.0 is not available on conda-forge, even though the recipe was updated here.
A package I am currently creating on bioconda requires backports-datetime-fromisoformat but is not compatible to version 1.
Could you update the package retrievable via conda-forge to version 2?
Greetings,
Mark

Hi @ocefpaf,
could you please check out the problem and maybe add the new version? I really need it for another tool.

The PR was issued, see #6, but looks like the CIs did not run on main. Let's try to re-render and see how it goes. See #8

Look like we already dropped py 3.7. So we cannot build this at this time.

It looks like this got successfully built in the end.  Can this be closed?


Mega pull request for 1.0.0 Eval release

Added doc files and formatted Readme.md file.

Cleaned up the folder User and Install. All documentation activities are completed.


Optional final slash in admin endpoints

By appending the -L argument to every curl command.

EVERY command? seems excessive, should only be for internal API calls that need it.

Just for the trailing slash? I would rather add a trailing slash...

agreed with @thibaultcha

This has been fixed in a separate branch that will be merged into master

What was fixed? How? What was the problem?

The trailing slash problem, by simply duplicating the endpoints since Lapis doesn't support regex-matching in routes.

This might seem like a solution but since every other plugin will force people to use tralling slash, I think it is going to create inconsistencies. I would rather have a trailing slash always mandatory, than having it optional on some endpoints (where the endpoint is duplicated) and not there on other endpoints (when the developer did not implement a duplicated endpoint)

I wanted to do that too, but @Nijikokun @SGrondin and @montanaflynn really liked having supports for routes with and without a final slash, and without any redirect, so that's why I introduced it. The only thing is that we are duplicating routes, and as you said it could lead to inconsistencies in the future, although inconsistencies could be fixed by not allowing plugins to create routes using the Lapis app object, but an intermediate function, like:
add_get_route("/hello/world", function(self)
  -- Do something
end)

and add_get_route basically just replicates the embedded function in:
function add_get_route(route, cb)
  app.get(route, cb)
  app.get(route.."/", cb)
end

This could be an option that will mitigate the inconsistencies until Lapis introduces better support for optional slashes.

..., and without any redirect, ...

I only said that POST /apis should work. A 301 redirect would be fine with me.

Redirects are not automatically followed by curl, so for example if making a request to POST /apis/ returns a 301 redirect to /apis, curl will not automatically follow it and nothing will happen unless the -L parameter is provided, so that's why this issue was originally labeled as: "Using -L in every curl command".
To just make every request work without additional curl arguments on, for example, both /apis/ and /apis, the systems needs to explicitly define both routes.

Thanks for clearing that up for me, I didn't know the reasoning behind adding curl's -L "Follow Redirects" flag and missed all the discussion between you @SGrondin and @Nijikokun.
On one hand I would prefer them to both "just work" but on the other I think adding a body with the error "missing trailing slash" is enough to avoid any confusion, especially if the solution's implementation adds technical debt and inconsistencies as @thibaultCha described.

https://github.com/leafo/lapis/blob/master/lapis/application.lua#L339
Lapis supports a default_route on the router which would allow you to make them "just work" rather than a redirect.
A redirect is fine, I don't think that makes curl commands require a -L

The default_route is what I was adopting which triggers the redirect. Curl doesn't follow redirects by default unless the -L argument has been set.
A redirect it's just a regular HTTP response with a 301 status code and a Location header telling the client where the new location is. Curl doesn't do any magic unless told so.

This has been closed by implementing https://github.com/leafo/lapis/issues/276 which basically allows us to have the same behavior without redirects and -L arguments on curl.


Documentation Versioning

Version
What release version was the issue found in?
1.6
Hardware configuration
List Hardware components used.
N/A
Describe the bug
Add documentation versioning
To Reproduce
Go to documentation page and see version tag

Talk to OpenAMT team


Followers' count

Hello,
Is it possible to retrieve the number of followers the author of the tweets have? This is possible in other tools such as TAGS which use the Search API. Or the user IDs? Then follower counts could be retrieved via the API indirectly, I guess.
Best,
Quirin

https://github.com/yiannakasgeorge/pythonGUI-twitter-advanced-search No API is used.


feat: split deploy tests in integration and runtime

Description

We decided to postpone until we have the necessity or a more profound discussion on what we need exactly.


Fixed binary reader error message

Make all binary reader error messages the same (like this one) so they show the actual error, otherwise the actual error is obscured and hidden.

Hi @ncave, I'm your friendly neighborhood Microsoft Pull Request Bot (You can call me MSBOT). Thanks for your contribution!
You've already signed the contribution license agreement. Thanks!
The agreement was validated by Microsoft and real humans are currently evaluating your PR.
TTYL, MSBOT;

That's kind of a weird failure: @dotnet-bot test this please.

@ncave
It fails the same way on appveyor and in ci_part1 so I think there is something in the PR.
to repro:
build ci_part1

@KevinRansom Tests had to be fixed.

@dotnet-bot test this please

@KevinRansom I think the error in the AppVeyor ci_part2 build is unrelated to this PR, because I see the same error in a lot of recent PRs:
Error running command 'C:\projects\visualfsharp-3dtit\tests\..\release\net40\bin\fsiAnyCPU.exe' with args ' -r:System.Core.dll --nowarn:20 --define:INTERACTIVE --maxerrors:1 --abortonerror test.fsx' in directory 'C:\projects\visualfsharp-3dtit\tests\fsharp\core\members\incremental'. ERRORLEVEL -1073740771 ERRORLEVEL -1073740771

@ncave ... yep I agree.
Thank you for taking care of this
Kevin


Ventilation boost control does not work

Before submitting a new issue

[x] I redownloaded the latest release and restarted Home Assistant
[x] I've checked known issues
[x] I've enabled debug logs and attached the relevant logs to this ticket

Problem description
When you press the ventilation boost switch, a message appears saying that the VRC700 controller does not support this. When switching via the Vaillant app or on the heater, the status is displayed correctly in the integration.
Same result if the function is to be run as a service.
Logs
Logger: homeassistant.components.websocket_api.http.connection
Quelle: components/websocket_api/commands.py:245
Integration: Home Assistant WebSocket API (Dokumentation, Probleme)
Erstmals aufgetreten: 07:41:52 (1 Vorkommnisse)
Zuletzt protokolliert: 07:41:52

[546896040656] Unexpected exception
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/components/websocket_api/commands.py", line 245, in handle_call_service
    response = await hass.services.async_call(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/core.py", line 2761, in async_call
    response_data = await coro
                    ^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/core.py", line 2804, in _execute_service
    return await target(service_call)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/helpers/service.py", line 996, in entity_service_call
    single_response = await _handle_entity_call(
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/helpers/service.py", line 1068, in _handle_entity_call
    result = await task
             ^^^^^^^^^^
  File "/config/custom_components/mypyllant/switch.py", line 174, in async_turn_off
    await self.coordinator.api.cancel_ventilation_boost(self.system)
  File "/usr/local/lib/python3.12/site-packages/myPyllant/api.py", line 958, in cancel_ventilation_boost
    raise ValueError("Not supported on VRC700 controllers")
ValueError: Not supported on VRC700 controllers

Helo, same problem here. Ventilation boost never worked in my HA.
My setup is VWL 75/5 IS + recoVAIR 260/4 + VRC700, communication via VR920
LOG:
Logger: homeassistant.components.websocket_api.http.connection
Zdroj: components/websocket_api/commands.py:245
integrace: Home Assistant WebSocket API (dokumentace, problémy)
První výskyt: 14:46:22 (1 výskyty)
Naposledy logováno: 14:46:22

[547438468048] Unexpected exception
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/components/websocket_api/commands.py", line 245, in handle_call_service
    response = await hass.services.async_call(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/core.py", line 2761, in async_call
    response_data = await coro
                    ^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/core.py", line 2804, in _execute_service
    return await target(service_call)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/helpers/service.py", line 996, in entity_service_call
    single_response = await _handle_entity_call(
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/helpers/service.py", line 1068, in _handle_entity_call
    result = await task
             ^^^^^^^^^^
  File "/config/custom_components/mypyllant/switch.py", line 170, in async_turn_on
    await self.coordinator.api.set_ventilation_boost(self.system)
  File "/usr/local/lib/python3.12/site-packages/myPyllant/api.py", line 944, in set_ventilation_boost
    raise ValueError("Not supported on VRC700 controllers")
ValueError: Not supported on VRC700 controllers

I have the same issue, similiar setup like @Peaters, only VWL 125/5 S2 +  recoVAIR 360/4 are different. Would be great if this could be solved as it gives ability to start the ventilation boost when the bathrooms humidity is too high


chore: update workflows to use node v14

What kind of change does this PR introduce?
updating workflows to use node 14
What is the current behavior?
Please link any relevant issues here.
What is the new behavior?
Feel free to include screenshots if it includes visual changes.
Additional context
Add any other context or screenshots.

:tada: This PR is included in version 0.36.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Return nil after adding finalizer to prevent duplicated reconciliations

How to categorize this PR?

/area robustness
/kind enhancement
/merge squash
What this PR does / why we need it:
For resources having check metadata.generation == status.observedGeneration to ignore updates, on creation, update/patch requests like StrategicMergePatchAddFinalizers, causes the object to be requeued again because metadata.generation != status.observedGeneration. This PR adapts an "early exit" approach for "only" the controllers which uses this check condition, so that a duplicated reconciliation is prevented. Quoting https://github.com/gardener/gardener/pull/4696#discussion_r714906347, "can be translated also like, exit the current reconciliation and rely on the next one that is caused by the update that was just executed".
Also, the error strings are updated to make it uniform.
Which issue(s) this PR fixes:
Fixes Part of #4730
Special notes for your reviewer:
Release note:

Additional reconciliations for resources after adding the finalizer are prevented using an early exit approach.

/retest

@ary1992 I missed to fix some tests. On it.

I have updated the PR to revert the changes made to controllers which do not implement metadata.generation == status.observedGeneration check on update. I have updated the PR description also accordingly. Thanks @plkokanov for pointing this out.

On my observation, the object is requeued after adding the finalizer, because metadata.generation is 1 and status.observedGeneration is 0, so returning nil prevents an additional reconciliation for controllers having update condition metadata.generation != status.observedGeneration.
/hold cancel

On my observation, the object is requeued after adding the finalizer, because metadata.generation is 1 and status.observedGeneration is 0, so returning nil prevents an additional reconciliation for controllers having update condition metadata.generation != status.observedGeneration.
/hold cancel

/test pull-gardener-e2e-kind

/test pull-gardener-e2e-kind

/test pull-gardener-e2e-kind


Arc themes fix

This PR aims to:

support solid variant for Arc themes
use the same icons and hover as arc-theme
update the screenshot according to the new icons

Thanks.


Add simple-linked-list

Likely needs an instructions append because the tests works with dot expressions so students either need to use object expressions or data declarations. The official Tour of Pyret provides a barebones data declaration for a linked list in discussing Lists so I think data declarations would be more idiomatic than using an object expression.

I'm going to hold off on the instructions append.


Battery level for osmand

Traccar client report phone battery level as &batt= and it is stored as KEY_BATTERY. That is wrong, it should use KEY_BATTERY_LEVEL.
I'm not sure what is right, change server to store &batt= as KEY_BATTERY_LEVEL or change Traccar Client to send phone battery level as &batteryLevel=
What do you think?

It should be handled on the server side. OsmAnd protocol is used not only by Traccar Client app.


Increase height of top bar

Is your feature request related to a problem? Please describe.

The top bar is kind of small and you have to be very percice if you want to drag-and-drop the window.
Describe the solution you'd like
I'd recommend increasing the size of the top bar. Even making the height adjustable to some extend.

We changed how the top bar is rendered in the new UI.  Now there is always a drag area on the left (between the traffic lights) and a drag area to the right of the tabs.  This will ship with the new UI in v0.7.0


Provide thrown error at httpResponse.err

From Discord message:

Look at this hack I had to do to let me self handle the errors from telefunc:
onBug((err) => {
  throw err;
});

async function bootstrap() {

  const app = express();

  app.use(
    "/_telefunc",
    verifySession({ sessionRequired: false }), // sets req.session
    express.text({ limit: "10mb" }),
    async (req, res, next) => {
      try {
        provideTelefuncContext({ req, res });
        const httpResponse = await telefunc({
          url: req.originalUrl,
          method: req.method,
          body: req.body,
        });

        const { body, statusCode, contentType } = httpResponse;
        res.status(statusCode).type(contentType).send(body);
      } catch (error) {
        if (SuperTokensError.isErrorFromSuperTokens(error)) {
          return next(error);
        }
        res.status(500).send("Internal Server Error");
      }
    }
  );
...

I would like telefunc to let me have full control over the errors. Could we have an option like selfHandleErrors: true? It would throw the error instead of handling it and returning 500 "Internal Server Error".
I would also like to have the ability to pass anyJSON response to the client, and have the client parse it without any "Telefunc not set up properly" errors. I would like to take full control.
For example, I would like to be able to return res.status(401).send({ message :"some error"})

https://telefunc.com/error-handling#expected-errors


Is not possible to create custom cultures in .Net Core

Is not possible to create custom cultures in .Net Core
In .Net framework is possible to create custom cultures, e.g en-US-NY (English from New York). using CultureAndRegionInfoBuilder class  as is describe in this example http://www.c-sharpcorner.com/UploadFile/GemingLeader/creatingextending-a-culture/  .
Are there any plans to implement this in .Net Core?
In the project were I am working at the moment we need this to be able to create different localizations for different dialects  of the same language.

Issue moved to dotnet/corefx #24559 via ZenHub


Schedule order selection is empty

Expected behavior:
Options of dates a customer can order for delivery in advance (which is defined in the backend "Allow Pre-order for Delivery")
Actual behavior:
Empty options list, both for date and time
Reproduce steps:
Pretty new installation and did not change anything in localBox/timeslot before testing
Version:
2.1.1
Additional Information:

$orderDateTime is initialized.
What surprises me is that both select tags have no option values. Maybe this is the issue?

@ryanmitchell can you have a look at this?

I noticed this yesterday but it's version 2.1.1 - are we not focusing on the 3.x branch?

Yes @iTzMeRafa got the version number wrong, its actually v3

@iTzMeRafa can you give me screenshots of your location settings so I can try and replicate your setup and the issue?

@ryanmitchell do you mean screenshots of my delivery areas?

@iTzMeRafa No, your opening time and location settings so I can ensure I have the same settings as you to get to the cause of the issue.

Yes, I can see the problem. Your closing time is on the next day! If you set it to 23:59 it works fine, but as things stand setting it to anything after that will cause an error.
@sampoyigi how could we handle this better - I hadn't ever considered opening hours that cross midnight.

@ryanmitchell good catch! Just had a look at the logic for generating timeslot and right its not handling next day closing hours. To handle midnight hours better, the logic here WorkingSchedule::getTimeslot() and here WorkingPeriod::timeslot() probably needs to change. WorkingRange class already has a endsNextDay method to check for midnight hours.

I pushed 2 PRs (sorry did it through GitHub web), let me know if those work for you @iTzMeRafa and if you are happy with approach @sampoyigi


Massively simplify and equalise primitive commands

NOTE: In typical me fashion, this is based on a previous pull request (#142), and shouldn't be merged (or really looked at in detail) until that one is up.
This is a fairly heavy PRQ (got a bit carried away with simplification, as usual) that does a lot of simplifying and expressivity-boosting changes to the primitive commands (assignment, postfix, assume, etc).
What does this do?

Atomic assignments and postfixes can now mention thread-local variables anywhere.  (I think they're still restricted inside indices to only using thread-local variables, but I didn't check as this isn't a problem yet.)
Microcode and PrimCommands have been merged (sort of): Microcode can now contain stored commands (atomic function calls), and does so until the point where we used to expand out PrimCommands.  PrimCommand is now a type alias for a certain type of Microcode.  This makes Microcode the only internal representation of Starling's command language.
Internally, every stored command other than BCAS and ICAS is gone, and the modeller models postfixes, assumes, and id-transitions directly as microcode.
Local commands now use the exact same AST and internal representation as atomics.  The only difference between the two, now, is that local commands can only name thread-local variables.  This means commands like {| foo() |} local++ {| bar() |} are now possible.
Added a load more tests.
Fixed the weirdly specified CAS in #142.

@septract I've rebased this onto master now, so it should be ok to look at.  Less priority than the last PRQ though.
(Also, I wonder if Travis will work today…)


fix unused variables linter around macros

fix reference search when multiple binders / non-binders occur in the same position (possible with macros)
consider macro expansions when deciding whether to ignore an unused variable
~allow adding custom ignore functions~

fixes #1266

!bench

!bench

!bench

!bench

!bench

!bench

!bench


Enhancement: How to add custom action toolbar icons/buttons in List View

Is your feature request related to a problem? Please describe.
In the list view one can see 2 icons on each element: an eye (inspector/details) and a paper/pencil (edit the entity).
It is desirable to add more actions as buttons here. For example DELETE could be trash can and work as a shortcut to "With Selected => Delete", saving clicks. It could also be used to go to custom action pages for that entity ("import a props file into this entity", etc etc).
Describe the solution you'd like
Be able to plug more action buttons into the List View, defining their icon, tooltip string and action function/method.
Describe alternatives you've considered
I looked at the documentation and could not find how to add an extra one. Maybe it is already doable and just the documentation that needs fixing. Or perhaps I need new glasses :-)
I could also dig into the sources and reverse engineer how you do the existing ones. Last resort.
Additional context
None.

I believe it's here: Actions - Starlette Admin


Add section for community contributions

Added this section for briefly introducing community contribution around KeystoneJs.
have reserved @keystone-js org name on npm for userland package publishing.  Also have keystone-js GitHub org for keeping all the projects together.

Love the idea!
Do you mind if we use a different org name (on GitHub & npm)? I feel @keystone-js could cause too much confusion with @keystone. Perhaps keystone-contrib would work well?

which one works best? keystone-contrib or keystonejs-contrib?

I think keystone-contrib is fantastic


Remove unused list _out_fnames.

Small follow-up cleanup in relation to #1511 ; the (unused) list _out_fnames contained the now stale filename accepted_hits.sam.

Christian, kills dead code dead.
It made more sense when I was thinking in than when I typed it.


OpenAPI and Swagger emitter incorrectly generates type literal

A type literal is a constant, and the way we represent constant in Swagger was a enum with a single value AND not extensible. IOW:
        "status": {
          "description": "The status of the capability.",
          "enum": [
            "Default",
          ],
          "type": "string",
          "x-ms-enum": {
            "name": "CapabilityStatus",
            "modelAsString": false
          }
        },

Since the emitter do not generate the x-ms-enum and modelAsString today in that scenario, the Swagger do not represent properly the intent of the CADL.
OpenAPI3 Playground / Swagger Playground

I believe we interpret straight OpenAPI 2/3 enum as "not extensible" and therefore believe we shouldn't need to use x-ms-enum for this case. Does autorest default to extensible in the absense of x-ms-enum + modelAsString=false?
Also, I think the Swagger Playground link should have been:
https://cadlplayground.z22.web.core.windows.net/cadl-azure/?c=Ly8gY2FkbAptb2RlbCBUeXBlTGl0ZXJhbCB7CiAgICBuYW1lOiAiZHBnIjsKfQoKb3AgZm9vKCkgOswtOw%3D%3D

@nguerrera yes, autorest does default to extensible, meaning if you want to model a constant in Swagger you have to use x-ms-enum to tag the enum as "modelAsString:false". This is the trigger for "autorest from Swagger" to get M4 to expose this as a constant. You won't get fidelity of intent without having it in the generated Swagger :(
cc @timotheeguerin

OK, I would argue the autorest interpretation is the one that is "incorrect" as OpenAPI 2 and 3 ref to JSON schema for the meaning of "enum", which in turn states:

An instance validates successfully against this keyword if its value is equal to one of the elements in this keyword's array value"

which implies not extensible.
I suppose we could change cadl-autorest as it exists to feed into autorest, but I think the openapi3 behavior should remain unchanged.

Yeah, I think in cadl-autorest we should add x-ms-enum.modelAsString=false to be consistent with what enums are doing but there is nothing to change in the openapi3 emitter that is not adding any extensions

As long as this is clear that ARM team that goes through translation and not direct CADL have to be using cadl-autorest to translate, and can't use OpenAPIv3 emitter, I'm fine.

if it was just about autorest we should have cadl-autorest also emit openapi v3 but with extensions. But I think we have to do all of that to satisfy linter in azure-rest-api repository

I was unaware that m4 automatically treated swagger enums as extensible.  It is harmless to add the extension, and if it helps with client generation from swagger, we should make it so. We want to be careful about the impact on discriminator values when we fix this.
@lmazuel Are we using constant values in any specs that we need to model right away, or can we defer this fix until next month?

@markcowl you can defer to next month, we discovered it while doing a review of features, not because a particular service had a problem.

estimate: 1

One question is how to generate the x-ms-enum.name,  seems not make sense to use the literal value.

The name was made optional in autorest for just that reason so I would omit it

The name was made optional in autorest for just that reason so I would omit it

But name is required by this extension, see https://github.com/Azure/autorest/tree/main/docs/extensions#x-ms-enum

Need to update the doc, it isn't required anymore.

this already fixed in https://github.com/Azure/cadl-azure/pull/1893


Added .gitignore files to fix #192

This PR attempts to fix issue #192 by adding .gitignore files (following the standard Rust way as generated by cargo for every new project) to all the exercises' subdirectories.
These only contain one line, namely:
target
Maybe by creating future subdirectories of exercises directly with cargo, #192 won't occur again.

Oh dear, I just saw that there is already a fix for this issue which I apparently read right over when starting this PR. It also seems the other PR is more complete in they realized and kept in mind that what users/students write as a solution is a library and not an executable AND that those two (executable, lib) have different standardized .gitignore files. As such I'll close this and hope the other PR gets merged soon so that the referenced issue ( #192 ) can be closed.


install-chef-suse: Use same dialog size and text before/in spinner

It seems the --keep-tite option in dialog is creating some flashing for
me now (not sure why), which makes it very visible that the dialog was
different before the spinner and during the spinner.
With this, the flash still occurs, but is actually bearable.

+1

+1


Python Interactive Jupyter code cell debug not breaking  on Uncaught Exceptions

Issue Type: Bug
The debugger is not pausing for uncaught exceptions.
define error_test.py
# %%
def test_error():

    a = []
    a[1]

test_error()

in debugger check "Uncaught Exceptions"
Click 'Debug cell'

The debugger does not stop on the uncaught exception and instead the interpreter reports the error:

in debugger check "Raised Exceptions:
Click 'Debug cell'

The debugger correctly breaks at the error:

Ref: https://code.visualstudio.com/docs/python/jupyter-support-py
Extension version: 2021.2.636928669
VS Code version: Code 1.54.2 (fd6f3bce6709b121a895d042d343d71f317d74e7, 2021-03-11T00:56:19.848Z)
OS version: Windows_NT x64 10.0.19042

Thanks @fleming79 I can reproduce the bug. Interestingly breaking on uncaught exceptions appears to work if test_error() is not the last line of code in the interactive cell:

This seems like a discrepancy in the debug behavior between the Python debugger and the interactive window though it may be by design. Will discuss with team at our weekly triage.


update attack-surface-reduction-exploit-guard.md, issue #2837

added section for event views as per request #2837

@JohanFreelancer9 - kindly do the copy editor review for this PR. Thanks.

@JohanFreelancer9 - I would like to follow up on this. kindly do the copy editor review for this PR. Thanks.

@TokyoScarab - Can you please do the copy editor review for this PR? Thanks.

@kenwith - would you be able to merge the content of this PR based on issue #2837? The doc owner for this is @andreabichsel.
Thank you.

The technical looks good but we need copy edit because we need to be very careful with capitalization. I am going to make a copy edit pass now based on when I looked at the words as I walked through the procedure being added.

@MaratMussabekov - kindly check and please make the necessary changes as recommended by Justinha. Thank you.

Hello @Justinha , sorry, I am not sure what I need to change... I do not see anything in https://demo.wd.microsoft.com/Page/ASR that is related to viewing of events, all I can see is three scripts that changes the state of the ASR rules... Am I understanding this wrong?
Thank you

Dear @JohanFreelancer9 , thank you very much, your recommendations were applied

@Justinha - We would like to follow up with you on what changes to the PR do you suggest that @MaratMussabekov should do? I believe he has a clarification question for you.  Thank you.

I think I misunderstood the problem. Let me confirm what new events should be listed. In the meantime, I see problems with the evaluation sections for CFA, network protection, exploit protection, and ASR rules. They all reference an xml that is in this topic: https://docs.microsoft.com/en-us/windows/security/threat-protection/windows-defender-exploit-guard/event-views-exploit-guard
And the event views topic is not appearing in the table of contents on the left. I think the sections about how to review events should be consolidated into each topic that covers how to turn on that feature. I'll try to clean up some on my side. Let's follow up in a day.

@Justinha - what should be done with this PR created? Should we let @MaratMussabekov close this PR? Or are there any particular changes you want him to add on this PR he created. Please advise. Thank you.

I'll try to pull this in now though I may need to overwrite some of it after. Thanks @MaratMussabekov for your patience!


Mysql integration issues - with self-signed certificate

2022-09-08 10:46:45 CEST | CORE | ERROR | (pkg/collector/runner/runner.go:301 in work) | Error running check mysql: [{"message": "(2003, \"Can't connect to MySQL server on '<IP_ADDRESS>' ([SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self signed certificate in certificate chain (_ssl.c:1131))\")", "traceback": "Traceback (most recent call last):\n  File \"/opt/datadog-agent/embedded/lib/python3.8/site-packages/pymysql/connections.py\", line 599, in connect\n    self._request_authentication()\n  File \"/opt/datadog-agent/embedded/lib/python3.8/site-packages/pymysql/connections.py\", line 803, in _request_authentication\n    self._sock = self.ctx.wrap_socket(self._sock, server_hostname=self.host)\n  File \"/opt/datadog-agent/embedded/lib/python3.8/ssl.py\", line 500, in wrap_socket\n    return self.sslsocket_class._create(\n  File \"/opt/datadog-agent/embedded/lib/python3.8/ssl.py\", line 1040, in _create\n    self.do_handshake()\n  File \"/opt/datadog-agent/embedded/lib/python3.8/ssl.py\", line 1309, in do_handshake\n    self._sslobj.do_handshake()\nssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self signed certificate in certificate chain (_ssl.c:1131)\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n  File \"/opt/datadog-agent/embedded/lib/python3.8/site-packages/datadog_checks/base/checks/base.py\", line 999, in run\n    self.check(instance)\n  File \"/opt/datadog-agent/embedded/lib/python3.8/site-packages/datadog_checks/mysql/mysql.py\", line 107, in check\n    with self._connect() as db:\n  File \"/opt/datadog-agent/embedded/lib/python3.8/contextlib.py\", line 113, in __enter__\n    return next(self.gen)\n  File \"/opt/datadog-agent/embedded/lib/python3.8/site-packages/datadog_checks/mysql/mysql.py\", line 202, in _connect\n    db = pymysql.connect(**connect_args)\n  File \"/opt/datadog-agent/embedded/lib/python3.8/site-packages/pymysql/__init__.py\", line 94, in Connect\n    return Connection(*args, **kwargs)\n  File \"/opt/datadog-agent/embedded/lib/python3.8/site-packages/pymysql/connections.py\", line 325, in __init__\n    self.connect()\n  File \"/opt/datadog-agent/embedded/lib/python3.8/site-packages/pymysql/connections.py\", line 630, in connect\n    raise exc\npymysql.err.OperationalError: (2003, \"Can't connect to MySQL server on '<IP_ADDRESS>' ([SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self signed certificate in certificate chain (_ssl.c:1131))\")\n"}]

Describe the results you received:
We are using a self-signed certificate and the pathes are set, to key,cert and ca.
While verify is ok
openssl verify -verbose -x509_strict -CAfile /certs/mysql/ca.crt -CApath /certs/mysql/ /certs/mysql/client.crt
/certs/mysql/client.crt: OK

openssl verify -verbose -x509_strict -CAfile /certs/mysql/ca.crt -CApath /certs/mysql/ /certs/mysql/ca.crt
/etc/mysql/ca.crt: OK

Describe the results you expected:
Integration should connect, even when the certificate is self signed

Well, if you use not the outdated certificates it works as expected


List NFT floor price button doesn't work

What happened?
Although there is a floor price for this collection the floor price button along with -5% and +5% buttons don't work anymore.
I really liked that button 😭
Please reproduce in steps
Claim nft, try to list it, same happens when you try to change the price again...
https://kodadot.xyz/ahp/gallery/66-149
Expected Behavior

What browsers are you seeing the problem on?
No response
At which address did you encounter bug?
No response
Are you logged in?
None
Which wallet you are using?
No response
At which chain did you encounter bug?
No response
Screenshots

Relevant log output
No response
Payment link for reward
https://canary.kodadot.xyz/dot/transfer/?target=<My_Polkadot_Address_check_https://github.com/kodadot/nft-gallery/blob/main/REWARDS.md#creating-your-dot-address>
Code of Conduct

[X] I agree to follow this project's Code of Conduct

👋


Account info fails with OAuth token

Hi,
I wanted to try the newest changes in putio-automator and I cannot have it working. These are the steps I followed.

created a new authorized app in my putio account and got a new OAuth token
installed putio-automator with pip, and configured with putio config init

When I tested the connection with putio account info, I got this exception:
# putio account info
Traceback (most recent call last):
  File "/usr/local/bin/putio", line 11, in <module>
    sys.exit(main())
  File "/usr/local/lib/python2.7/site-packages/putio_automator/manage.py", line 47, in main
    manager.run()
  File "/usr/local/lib/python2.7/site-packages/flask_script/__init__.py", line 412, in run
    result = self.handle(sys.argv[0], sys.argv[1:])
  File "/usr/local/lib/python2.7/site-packages/flask_script/__init__.py", line 383, in handle
    res = handle(*args, **config)
  File "/usr/local/lib/python2.7/site-packages/flask_script/commands.py", line 216, in __call__
    return self.run(*args, **kwargs)
  File "/usr/local/lib/python2.7/site-packages/putio_automator/commands/account.py", line 17, in info
    print json.dumps(app.client.Account.info(), indent=4, default=date_handler)
  File "/usr/local/lib/python2.7/site-packages/putiopy.py", line 500, in info
    return cls.client.request('/account/info', method='GET')
  File "/usr/local/lib/python2.7/site-packages/putiopy.py", line 203, in request
    return _process_response(response)
  File "/usr/local/lib/python2.7/site-packages/putiopy.py", line 231, in _process_response
    raise exception_class(response, error_type, error_message)
putiopy.ClientError: GET, https://api.put.io/v2/account/info, 401, Unauthorized, u"The server could not verify that you are authorized to access the URL requested.  You either supplied the wrong credentials (e.g. a bad password), or your browser doesn't understand how to supply the credentials required."

My first guess was that the OAuth token is wrong. I don't think so even though putio config show shows a different token (perhaps is just salted?).
I tried to reconfigure paying attention to type the right token and I got the same result.

I have the same issue.
The 0.3 version is a pretty old one :(
Did you find the config file? Maybe it is possible to change it yourself.
Would love to be able to download in different download folders.

You can resolve the issue with installing it locally and not globally


Custom components for mdast nodes

remarkReactComponents and createElement are nice but I would like to be able to customize rendering a few levels lower. By the time data gets to those extension points, all semantic information beyond the HTML element is lost.
For example, I would like to use my own React components for footnote references and footnote definitions. After some digging (phew 😅 ), I think the point to do that would be at the MDAST level, i.e. through my own plugin which I use() before this plugin.
Now, I didn't understand how to modify the footnoteDefinition node in a way (e.g. by adding a component prop) that gets preserved by mdast-util-to-hast because it turns unknown nodes into divs and somehow when I set properties on a node they don't show up in the createElement props.
Maybe this all sounds a bit confusing but currently I am confused 😁  (mainly by the multiple layers of abstraction). I'll try to summarize:

What I want is to associate a footnoteDefinition node with a React component which receives the information about footnote definitions as data.
What I don't want is to construct some intermediary dom-like representation with paragraphs and list items and reverse-engineer that in createElement.
What I'd prefer to avoid is to have to re-build everything above the MDAST level myself.

Maybe @wooorm can shed some light on this?

By the way, somehow properties seem get lost along the way. For example the className: 'footnote' from mdast-util-to-hast/lib/footer doesn't show up in my rendered elements. Same goes for the language- class name of fenced code blocks.

Thanks for writing this out in such a detailed issue, it helps a lot :)
So, I introduced the recent changes to ensure less stuff is in this project, but that does mean there’s more abstraction, which of course makes things harder.
On the other hand, if you create a remark plug-in which sets a data.hName property on strong nodes to b, that creates a  elements in both remark-react and in remark-vdom. I believe that, as you’re compiling to React, setting Component would instantiate the proper React class (but then I don’t know too much about React).
Did you see the info at the bottom of mdast-util-to-hast? If not, I believe that should do most of what you’re after.
Maybe this isn’t enough, and we should implement some other mapping as well, such as somehow passing the original mdast/hast node to a function before passing it to React.createElement?
P.S. Whoops, thanks for letting me know, I’ll dig into what’s going on with footer and language-

@herrstucki Ah, I forgot that of course sanitation is now on by default, defaulting to GitHub’s mechanism. That’s why all classes are stripped (take this for example: foo(), foo(), the class is removed).
You can pass a new schema in though, which allows the className prop!
Maybe we should add a note that the sanitation is quite strict?

So, if I do:
const footnoteRenderer = (processor, options) => {
  const transformer = (node) => {
    const footnoteDefs = node.children.filter(n => n.type === 'footnoteDefinition');

    footnoteDefs.forEach(n => {
      n.data = {hName: 'Footnote'};
    });
  };

  return transformer;
};

const markdownRenderer = remark().use(footnoteRenderer).use(reactRenderer, {
  createElement(name, props, children) {
    // Shouldn't `name` be 'Footnote' at some point?
    console.log(name, props)
    return React.createElement(name, props, children);
  }
})

… it doesn't work. Any pointers?

Regarding sanitation: shouldn't this schema allow className again?
{sanitize: {attributes: {'*': ['className']}}}

(that doesn't work too 😅 )

It doesn’t? I get the correct results:
var react = require('react');
var remark = require('remark');
var react = require('.');
var doc = '```js\nfoo()\n```';

var vdom = remark().use(react, {
    createElement: react.createElement,
    sanitize: {attributes: {'*': ['className']}}
}).process(doc).contents;

console.log(require('util').inspect(vdom, {depth: null}));

Yields:
{ '$$typeof': Symbol(react.element),
  type: 'div',
  key: 'h-1',
  ref: null,
  props:
   { children:
      [ { '$$typeof': Symbol(react.element),
          type: 'pre',
          key: 'h-2',
          ref: null,
          props:
           { children:
              [ { '$$typeof': Symbol(react.element),
                  type: 'code',
                  key: 'h-3',
                  ref: null,
                  props: { className: 'language-js', children: [ 'foo()\n' ] },
                  _owner: null,
                  _store: {} } ] },
          _owner: null,
          _store: {} } ] },
  _owner: null,
  _store: {} }

Ah, I passed the sanitize option to process() instead of use() 😅

That being said, this disallows all other attributes. I suggest using a deep cloning mechanism instead, and using github.json as a base like so:
// ...
var clone = require('clone');
var schema = clone(require('hast-util-sanitize/lib/github.json'))
// ...

schema.attributes['*'].push('className');

var vdom = remark().use(react, {
    // ...
    sanitize: schema
}).process(doc).contents;

// ...

A quick update on this. I ended up just using unified and remark-parse, and wrote my own compiler which generates React elements directly from the MDAST. This way, I can retain the full semantics of my Markdown documents, including footnoteDefinitions, inlineCode etc. 👌
This has two additional advantages:

If I want to include the parser in my client code, this saves a few KB from the compiled bundle because I can skip the libraries for intermediary representations.
And if I don't need the parser in the client, I can wrap it into a webpack loader (since the MDAST can be serialized to JSON), and just include the compiler.

So, thanks for creating such a modular system for text processing @wooorm! It's not easy to find the right integration point at first, but once I found it, it was very straight-forward 😄

@herrstucki Well, first of all I’m very happy that the way I set it all up allows you to quite easily set this up. 👍
But on the other hand I’m quite unhappy that the changes I made in 4b2e674 caused you to have to work around it. I’d love to see your code; maybe the current set-up already allows that, and the docs need to be changed, or if not, those features should be included!
I also wanted to show that the below example shows how remark can be split across server/client:
node.js:
var unified = require('unified');
var parse = require('remark-parse');
var doc = require('fs').readFileSync('example.md', 'utf8');
var proc = unified().use(parse);
var tree = proc.parse(doc);
// sendToClient(JSON.stringify(tree));

...and browser.js:
var unified = require('unified');
var react = require('remark-react');
var tree = // JSON.parse(getFromClient())
var proc = unified().use(react);
var vdom = proc.stringify(tree);
// doSomethingWith(vdom);

Things are still kind of in flux but I'll try to share what I came up with when it's settled a bit.
I'm (almost) doing what you suggested in your example. I just don't use remark-react but instead compile directly to React elements from the tree. I use a map of visitors similar to this:
{
  heading: (node, index /*, parent */) => React.createElement(`h${node.depth}`, {key: index}, visitChildren(node)),
  //...
}

Kinda off-topic for this repo, but when I split parser and compiler like this, I struggle with plugins which expect Parser and Compiler both to be present (e.g. https://github.com/wooorm/mdast-zone).

OK, I’d love to see what you come up with an allow similar behaviour in this project as well, or update the docs accordingly!
Regarding failing modules, I’d love to know about those. Could you create issues on their respective projects? Or send me a message on Gitter!

Hey, I'm struggling with a similar issue. I'd like to have remark render a react component. More specifically, I'd like for this input:
## My gallery
@gallery(["image1.jpg", "image2.jpg"])

to render
<Gallery value={["image1.jpg", "image2.jpg"]} />

Would you happen to have some guidance on this? Thanks!

This is a quite different issue, as you’re not really dealing with markdown (which remark is all about), but with stuff embedded in markdown.
First, to render @gallery(["image1.jpg", "image2.jpg"]) as something, you need to define how it should be parsed by extending the parser (probably remark-parse).
Second, you want to render XML / JSX, there’s probably tools for that, but I don’t know them.
Finally, you could also expect all HTML to be in fact JSX. Is there a reason to not allow <Gallery value={["image1.jpg", "image2.jpg"]} /> in the source document?

Thanks for the quick response and sorry for not being clear. I mean I'd like for the said input to see the rendered gallery, so the evaluated component.
Lets say I use the code from the remark-parse extension example. What I fail to understand is, how do I really introduce a new entity type (e.g. component) and map this to my own react component?
function plugin() {
  var Parser = this.Parser;
  var tokenizers = Parser.prototype.inlineTokenizers;
  var methods = Parser.prototype.inlineMethods;
  tokenizers.mention = tokenizeMention;
  methods.splice(methods.indexOf('text'), 0, 'mention');
}
function tokenizeMention(eat, value, silent) {
  var match = /^@(\w+)/.exec(value);
  if (match) {
    if (silent) return true;
    return eat(match[0])({
      'type': 'component',
      'url': 'https://social-network/' + match[1],
      'children': [{
        'type': 'text',
        'value': match[0]
      }],
    });
  }
};
tokenizeMention.notInLink = true;
tokenizeMention.locator = locateMention;
function locateMention(value, fromIndex) {
  return value.indexOf('#', fromIndex);
}

 const remark = remark().use(plugin).use(reactRenderer, {
      sanitize: false,
      remarkReactComponents: {
        component: props =>
      },
    });
  }

I'd expect this to, on input #xyz, to be rendered bold.

Ah, nvm, got it!

function plugin() {
  var Parser = this.Parser;
  var tokenizers = Parser.prototype.inlineTokenizers;
  var methods = Parser.prototype.inlineMethods;
  tokenizers.mention = tokenizeMention;
  methods.splice(methods.indexOf('text'), 0, 'mention');
}
const tryParseJson = (str) => {
  try {
    return JSON.parse(str);
  } catch(ex) {
    return undefined;
  }
}
function tokenizeMention(eat, value, silent) {
  var match = /^@(\w+)(\(([^)]+)\))?/.exec(value);
  if (match) {
    if (silent) return true;
    return eat(match[0])({
      type: 'component',
      name: match[1],
      value: match[3] ? tryParseJson(match[3]) : undefined,
      'children': [{
        'type': 'text',
        'value': match[0]
      }],
    });
  }
};
tokenizeMention.notInLink = true;
tokenizeMention.locator = locateMention;
function locateMention(value, fromIndex) {
  return value.indexOf('#', fromIndex);
}
const components = {
  Default: (props) => {
    return
No component of type {props.name} found
;
  },
  Gallery: (props) => {
    return ;
  }
}
this.remark = remark().use(plugin).use(reactRenderer, {
      sanitize: false,
      remarkReactComponents: components,
      toHast: {
        handlers: {
          component: (h, node) => {
            var props = { name: node.name, value: node.value };
            return h(node, components[node.name] ? node.name : 'Default', props, all(h, node));
          }
        }
      }
    });

Probably because tokenizeMention matches on @, not #?
Hey, I don’t mind helping you, but this issue is not the place. I think the remark channel on Gitter is.
Or create issues on specific remark packages for specific issues, or PRs for doc updates (I think the docs could be better, and I can help guide that)
EDIT: I now see your comment, glad it worked.


chore(main): release 1.5.0

:robot: I have created a release beep boop
1.5.0 (2024-03-21)
Features

add git mob --trailers command (17e35cf)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/Mubashwer/git-mob/releases/tag/v1.5.0 :sunflower:


ecli/oci: add ghcr token login

I misread the issues repository... But this is still a useful feature.
Login ghcr with 'gh' cache or GITHUB_TOKEN env.
ghcr.io only support token login, so the previous user password won't work.
now if $HOME/.config/gh/hosts.yml exist, it will auto login.
ecli login https://ghcr.io/
Login success

Please add some test to this feature.


table.to_pandas just take first item of the array

I am testing arrow as below ,
data=[pa.array([1]),pa.array(["tokyo", "like", "happy"]),pa.array(["derek"])]
batch = pa.RecordBatch.from_arrays(data, ['id', 'tags', 'name'])
data1=[pa.array([2]),pa.array(["xiamen", "food", "happy"]),pa.array(["rich"])]
batch2 = pa.RecordBatch.from_arrays(data1, ['id', 'tags', 'name'])
batches= [batch]+[batch2]
table = pa.Table.from_batches(batches)
table[1]
here is the result of table[1] :
<pyarrow.lib.Column object at 0x10b6d0ed0> chunk 0: <pyarrow.lib.BinaryArray object at 0x10b6fa788> [   'tokyo',   'like',   'happy' ] chunk 1: <pyarrow.lib.BinaryArray object at 0x10b6fa7e0> [   'xiamen',   'food',   'happy' ]
but when I convert to pandas by using
d = table.to_pandas()
d is showing as below ;

Am I doing anything wrong ?

Thanks for the bug report. I opened https://issues.apache.org/jira/browse/ARROW-2820; closing this issue to track progress fixing it on JIRA

I have seen value error "Arrays were not all the same length" when I am having different length array in pyarrow-0.10.0 . The problem is I will need to include all tags in a tweets into one array , the array length for tags is variable , finally , all tweets records with different length of tags arrays will form a table .   Is there any other way to do it ? Thanks .

@deter3 can you ask this question on the mailing list and provide an example? Thanks


Updating to use the non-deprecated ByteSource class

Not sure if this is the best way, but I couldn't get this to work in XL Deploy due to a NoSuchMethod exception on ByteStreams.hash() - it turns out this has been removed from Guava 18 onwards.

@ravan the build seems to be failing due to a lack of a .gradle dir in the travis.yml file...not quite sure how best to proceed - can we chat about this tomorrow?


Desktop Organizer

Description of the new feature / enhancement
Save the X-Y position of desktop icons/shortcuts for a particular display setting and restore them whenever the display settings change. Also, a feature to establish an icon grid and an initial (but not dynamic) sort of the icons by filename or other file property in a row-by-column or column-by-row order.
Scenario when this would be used?
When a laptop is used with a docking station there are often times different monitors (and display settings) depending on whether the laptop display or a standalone monitor (or multiple monitors) are being used. If each display setup had its own icon position settings, they could be restored whenever that particular set of displays was connected. People who have used older versions of MS Windows are often in the habit of placing large numbers of icons on their desktops. Perhaps newer users or software developers do not use this method of accessing programs/apps and files but for those who do use their desktop, this feature would be very helpful.
Supporting information
No response

/feedbackhub


[Enhancement] Verbose Output

[x] I have read the contribution documentation for this project.
[x] I agree to follow the code of conduct that this project follows, as appropriate.
[x] I have searched the issue tracker for an issue that matches the one I want to file, without success.

Please describe your issue:
On written build-script, the source-path is not given (electron-packager <Source-Path>). The source-path will be set automatically by the script but electron-packaher can't find the package.json and can't  find the current electron version:
Unable to determine Electron version. Please specify an Electron version

For more information, please see
https://github.com/electron-userland/electron-packager/blob/master/docs/api.md#e
lectronversion

Here is an Sample Batch-File (Build.bat on Windows):
@echo OFF

set CUR_DIR="%CD%"
set NAME_BUILD="Build"
set NAME_TEMP="Temp"

call electron-packager %CUR_DIR%\%NAME_TEMP% DSTEd --asar=true --overwrite --prune=true --icon=%CUR_DIR%\%NAME_TEMP%\Resources\window_icon.ico --app-version=1.0.0 --out %CUR_DIR%\%NAME_BUILD% --win32metadata.CompanyName="DSTEd - OpenSource" --win32metadata.ProductName="DSTEd" --win32metadata.OriginalFilename="DSTEd.exe"

I want following enhancement:
A new argument/parameter/option to set an Verbose Output to find the error,
Sample:
electron-packager <Source-Path> --verbose

If the verbose-output are enabled, electron-packager show additional informations on the output:
Unable to determine Electron version. Please specify an Electron version

For more information, please see
https://github.com/electron-userland/electron-packager/blob/master/docs/api.md#e
lectronversion

Debug:
Path: C:/Whatelse/DontKnow/
[...Other...]

Thanks for the feature request, but this already exists in Electron Packager, in the form of the debug module. This is referenced in the CONTRIBUTING documentation.


additional  inside class will break

Adding another div inside myclass will break the slider
< div class="myclass">
< div id="newClass">
< div>< h3>1< /h3>< /div>
< div>< h3>2< /h3>< /div>
< div>< h3>3< /h3>< /div>
< div>< h3>4< /h3>< /div>
< div>< h3>5< /h3>< /div>
< div>< h3>6< /h3>< /div>
< /div>
< /div>

Every element will become a slide unless you use the "slide" setting and tell it what to use.  You could probably use a :not but to keep it simple give your slide elements a class and use the slide setting to target those. should work

Any sample code? thanks

why do you need to Wrap all of the slides inside a wrapper though, there is probably a way to avoid that. but try this... I've never used it in this way, only when I wanted another div inside the slider wrapper but not as a slide.
< div class="myclass">
< div id="newClass">
< div class="slide-item">< h3>1< /h3>< /div>
< div class="slide-item">< h3>2< /h3>< /div>
< div class="slide-item">< h3>3< /h3>< /div>
< div class="slide-item">< h3>4< /h3>< /div>
< div class="slide-item">< h3>5< /h3>< /div>
< div class="slide-item">< h3>6< /h3>< /div>
< /div>
< /div>

$('.myclass').slick({
    slide: 'slide-item',
  });

Thanks


New Distribution: Item Request Exceeded Available Inventory.... But What Item?

When creating a new distribution today, we got this alert that the items requested exceeded the available inventory:

What it doesn't tell you is WHAT item(s) specifically that there is a shortage of (It would be helpful if it highlighted it or something. Better yet, also told you how many items there are in stock of that item triggering the alert as well):

So now, after all of that work, the user has to navigate away from that page to look into inventory on hand of individual items.

Thanks for your effort to improve this. Let me know if you have any questions. :)

@mdworken I lost all my WIP on this because I had to dust my repo and re-clone. :/ Will try again.