Editor misbehaves when file/folder list is out-of-sync!

Steps to reproduce the issue

Create a new file and save it via Editor.
Rename the file to something else by using File Explorer (in operating system).
Right-click the file in Editor, click Save to, and then at that point, you will be prompted if you want to overwrite the file.

Well, that's just completely wrong as it is out-of-sync. It should check it again and see if the file is still there...
This could completely screw the work up (until you are aware of it, but then it is probably already too late), since the majority of chips lives "one-file" life!

What would happen is that it would check if the file still exists and when it found out that it doesn't exist, it would simply save the file without asking to overwrite. How is that any better? Asking to overwrite does no harm, but not asking to overwrite might confuse you into thinking it deleted the previous contents of the file without asking (of course, that didn't happen since the file was renamed first, but it could be pretty scary)


receiveAutoAck should use concatMap operator instead of flatMap operator

The documentation of the reactor-kafka project states that messages should be consumed using the concatMap operator, but the ReactiveKafkaConsumerTemplate uses the flatMap operator at least in case of the receiveAutoAck method here:
https://github.com/spring-projects/spring-kafka/blob/master/spring-kafka/src/main/java/org/springframework/kafka/core/reactive/ReactiveKafkaConsumerTemplate.java#L69
Reference documentation of the reactor-kafka project: https://projectreactor.io/docs/kafka/release/reference/#_auto_acknowledgement_of_batches_of_records
See this Stackoverflow thread for reference:
https://stackoverflow.com/questions/65901791/message-ordering-of-reactivekafkaconsumertemplate-receiveautoack

cherry-picked to 2.6.x as 2f8b0425

cherry-picked to 2.6.x as 2f8b0425


Create llm2vec based on the new llama-3-8b

Can't wait to see the results :)

We are on it :)

Llama 3 is full of surprises, please stay tuned. We are analyzing the results we have. We will post an update early next week as unraveling some mysteries is taking time.

💥💥💥 llm2vec-llama-3 is coming out tomorrow 💥💥💥

Is it tomorrow yet

Llama-3 has been added to the model list

Thanks a lot! Btw, the first and the third link go to mistral model:

Fixed, thanks!

@vaibhavad I have prepared an llm2vec version for Qwen2 but there are some problems, I wonder if you can give me the process to prepare code for a new model?

Thank you! Did you try to score this model with MTEB?

@vaibhavad I have prepared an llm2vec version for Qwen2 but there are some problems, I wonder if you can give me the process to prepare code for a new model?

@Iambestfeed Can you share you PR or working branch?

@vaibhavad Hmmm, you can check this repo https://github.com/Iambestfeed/qwen2vec
Code here
Bugs:
/usr/local/lib/python3.10/dist-packages/transformers/utils/import_utils.py:521: FutureWarning: `is_torch_tpu_available` is deprecated and will be removed in 4.41.0. Please use the `is_torch_xla_available` instead.
  warnings.warn(
[INFO|trainer.py:2048] 2024-05-01 15:31:52,965 >> ***** Running training *****
[INFO|trainer.py:2049] 2024-05-01 15:31:52,965 >>   Num examples = 822
[INFO|trainer.py:2050] 2024-05-01 15:31:52,965 >>   Num Epochs = 3
[INFO|trainer.py:2051] 2024-05-01 15:31:52,965 >>   Instantaneous batch size per device = 1
[INFO|trainer.py:2054] 2024-05-01 15:31:52,965 >>   Total train batch size (w. parallel, distributed & accumulation) = 1
[INFO|trainer.py:2055] 2024-05-01 15:31:52,965 >>   Gradient Accumulation steps = 1
[INFO|trainer.py:2056] 2024-05-01 15:31:52,965 >>   Total optimization steps = 2,466
[INFO|trainer.py:2057] 2024-05-01 15:31:52,968 >>   Number of trainable parameters = 7,569,408
  0% 0/2466 [00:00<?, ?it/s][WARNING|logging.py:329] 2024-05-01 15:31:53,047 >> `use_cache=True` is incompatible with gradient checkpointing. Setting `use_cache=False`...
Traceback (most recent call last):
  File "/content/qwen2vec/experiments/run_mntp.py", line 985, in <module>
    main()
  File "/content/qwen2vec/experiments/run_mntp.py", line 933, in main
    train_result = trainer.train(resume_from_checkpoint=checkpoint)
  File "/usr/local/lib/python3.10/dist-packages/transformers/trainer.py", line 1859, in train
    return inner_training_loop(
  File "/usr/local/lib/python3.10/dist-packages/transformers/trainer.py", line 2203, in _inner_training_loop
    tr_loss_step = self.training_step(model, inputs)
  File "/usr/local/lib/python3.10/dist-packages/transformers/trainer.py", line 3138, in training_step
    loss = self.compute_loss(model, inputs)
  File "/usr/local/lib/python3.10/dist-packages/transformers/trainer.py", line 3161, in compute_loss
    outputs = model(**inputs)
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1511, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1520, in _call_impl
    return forward_call(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/transformers/models/qwen2/modeling_qwen2.py", line 1169, in forward
    outputs = self.model(
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1511, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1520, in _call_impl
    return forward_call(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/peft/peft_model.py", line 563, in forward
    return self.get_base_model()(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1511, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1520, in _call_impl
    return forward_call(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/transformers/models/qwen2/modeling_qwen2.py", line 1000, in forward
    if attention_mask is not None and self._attn_implementation == "flash_attention_2" and use_cache:
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1688, in __getattr__
    raise AttributeError(f"'{type(self).__name__}' object has no attribute '{name}'")
AttributeError: 'Qwen2BiModel' object has no attribute '_attn_implementation'. Did you mean: '_autoset_attn_implementation'?
  0% 0/2466 [00:00<?, ?it/s]

It looks like your implementation is similar to Llama, however, looking to modeling_qwen2.py at transformers library, it seems the implementation is similar to Mistral.
Different models differ on how they implementation causal attention mechanism Hence, the workflow of creating a new bi model requires understanding the native implementation and then overriding the relevant parts.
I have raised a PR on your repository that implements bidirectional attention for Qwen2 for transformers >= 4.40.0 - https://github.com/Iambestfeed/qwen2vec/pull/1
Feel free to merge it. I have tested it and it works on my end.

Hello, Sorry for bothering you! Can I get me some guidance to use Qwen2Vec(Can you share the colab link or ckpt)? I want to do some experiment with Chinese LLM Thanks a lot!

Hmmm, you can check this colab. Please select 1 other dataset in the config file because the wiki will overflow RAM

Closing as it is stale. Feel free to re-open if there are any additional questions related to this issue


[test] Remove redirection stderr->out that corrupted output.

The RUN line was redirecting stderr to stdout, but nothing in the test
was checking for the stderr output.
However, the last line of stderr was an empty newline, which was printed
(in my machine) in the middle of the dump from the AST, breaking the
test.
If we ever need to check the stderr, it should be redirected to a file,
and the file should be passed to FileCheck independently, to avoid
concurrent uses of the output buffer.
A similar change was performed in 39d396313152a1c026df0938a224552518bbc5e0 to the second line of the test.
/cc @akyrtzi

@swift-ci please smoke test

Thanks for fixing! This was added back when -dump* was outputting to stderr.

Makes sense. Thanks for explaining the reason!


Add curry function

As it was requested in #10 I add an implementation of curry() function.
I think it is appropriate to put it into functional submodule.

@tshemsedinov changed

Can't see @nechaido, mb you didn't add file to commit

@tshemsedinov yep, my fault

Landed in 49959f0819f57b53e7aa9a39e81c4fbebbe37ecc


feat: add the Get Started page [rebased branch]

This PR adds the Get Started page.
Preview

Sorry, I meant to close the other one 😓 can you reopen it?

@xmulligan the PR is reopened

Thanks!


Support TODO placeholder nodes

Especially when transpiling, it can happen that we want to flesh out an AST but leave out some nodes that we don't yet generate, e.g.:
class A {
   /* translation of RPG field a */
   /* translation of RPG field b */
}

Currently we have no general way of doing that. Kolasu is in a good position to provide some support.
Ideas and discussion items

Kolasu 1.5 or 1.6 since we want this on current language modules, it makes sense that we add this to Kolasu 1.5, or should we wait for 1.6 to start being adopted?

In Kolasu 1.6, we could use generated error nodes with some annotation

Integration with AST Transformers currently AST transformers have a concept of "generic node" which is not very usable because it doesn't work well with the type system, we could replace that with the insertion of placeholder nodes

This would better go in Kolasu 1.6 so we don't introduce breaking changes to 1.5
It would require some sort of factory to map node types to placeholder node types
My gut feeling is that this is overkill and we can just supply explicit rules for placeholders when needed

I did several experiments. It turned out that very little is needed in Kolasu. I will open a couple of PRs, one with minimal support, and another one based on the first one with an additional feature I added that proved to be non necessary in the end (but could still be useful).


feat!: make submitPFB broadcast mode configurable

Overview
closes #1885
Checklist

[x] New and updated code has appropriate documentation
[x] New and updated code has new and/or updated testing
[x] Required CI checks are passing
[x] Visual proof for any user facing features like CLI or documentation updates
[x] Linked issues closed with keywords

Can this be an option with a sane default?

we could use options or something similar, but we are already accepting TxbuilderOptions so I didn't want to add two sets of options here. This function does have too many args tho, so its due for a refactor

Ok, I was wondering if you can extend existing options.

Codecov Report

Merging #2307 (b92621e) into main (9306f5c) will not change coverage.
The diff coverage is 0.00%.

@@           Coverage Diff           @@
##             main    #2307   +/-   ##
=======================================
  Coverage   20.77%   20.77%
=======================================
  Files         136      136
  Lines       15398    15398
=======================================
  Hits         3199     3199
  Misses      11891    11891
  Partials      308      308

Files Changed
Coverage Δ

x/blob/payforblob.go
0.00% <0.00%> (ø)

Ok, I was wondering if you can extend existing options.

we could be it felt a bit too hacky and temporary. actually reducing the complexity and number of arguments I think requires a full refactor. Like, we'd have to wrap the txbuilder options in this more abstract option type, and apply the option two different times, once to see if there are tx builder options present when building the tx, then another time before we submit the tx. The alternative being to just add an extra argument, which felt like the least worst option for the time being


Automatic Package Replicator/ResourceServiceManager has private references

There's two warnings in the logs with a master build:
[WARNING] Bundle com.adobe.acs:acs-aem-commons-bundle:bundle:3.8.5-SNAPSHOT : Export com.adobe.acs.commons.replication.packages.automatic,  has 1,  private references [com.adobe.acs.commons.util.impl],
[WARNING] Bundle com.adobe.acs:acs-aem-commons-bundle:bundle:3.8.5-SNAPSHOT : Export com.adobe.acs.commons.util,  has 1,  private references [com.adobe.acs.commons.util.impl],

This was introduced with #920 / #987 .  If com.adobe.acs.commons.replication.packages.automatic.AutomaticPackageReplicatorMBean and/or com.adobe.acs.commons.util.ResourceServiceManager need to be exported, then ResourceServiceManagerMBean needs to be moved to an exported package. Alternatively, the two classes can be moved into non-exported packages.

/cc @davidjgonzalez @klcodanr

Fixed via #999


Create a warning modal for participants remove

PR includes

[x] Feature

Related issues

Resolve #2034
QA Instructions, Screenshots, Recordings
https://github.com/taskany-inc/issues/assets/9020793/ea997715-90d4-4de2-8db1-8401b34527b8

Yet another attempt
https://github.com/taskany-inc/issues/assets/9020793/dec9dc02-c3f6-48c6-b1fd-d57921b772ad


Added contributors section in readme file

upvote this comment

added a new tool for generating contributors image

Is there any problem with this pull request

Nothing, what's wrong?


Add all contributors.

@allcontributors please add @Ruffpuff1 for bug code data doc design financial ideas maintenance projectmanagement review translation

@allcontributors please add @Raindrop-Droptop for ideas translation financial

@allcontributors please add @orihuu for content bug


Cannot find Windows Driver

I'm using Windows 7 64bit.
I've downloaded the Arduino IDE, which is currently 1.6.5 r2.
Even after extracting the 'old arduino drivers' zip file, and pointing Windows at the Arduino / sketchbook folder, and looking at the steps here : https://github.com/arachnidlabs/tsunami-arduino/wiki/Tutorials
Windows cannot find the driver, all I can find in the tutorials is a link to a json file.

I'm not sure what the "old arduino drivers" zip file is; you need to look in "packages/arachnidlabs/hardware/avr/1.0.0/driver" under your Arduino sketchbook folder, as the tutorial says.

Sorry, but I'm not finding that folder path on Windows, it does not appear to come with the Arduino IDE and it is not in your repo.
The zip file I'm referring to is:
"C:\Program Files (x86)\Arduino\drivers\Old_Arduino_Drivers.zip"
Though that also does not have the driver in it.

It doesn't come with the Arduino IDE; it will have been installed if you followed the steps earlier in the tutorial to install the Tsunami board and libraries. You should be looking in your Sketchbook folder, off "Documents" or "My Documents" or your home directory (Depending on platform), not in the Arduino install folder.

You're saying that the driver is downloaded as part of the board definition with the json by the Arduino IDE?
If that's the case, that wasn't clear to me from reading the steps.

Yes, that's correct. The tutorial says "Windows requires drivers in order to interact with the Tsunami. These were included in the hardware definitions you downloaded in the previous steps; you just need to tell Windows how to find them."
I'll see if I can make that clearer; suggestions are welcome.

Thanks.
Is it possible to have an alternative method of acquiring the definitions / drivers? Or possibly a mirror?
I ask because the internet connection I'm using is causing timeouts / partial downloads / it is very slow with this method.

The files are in this repository: https://github.com/arachnidlabs/arachnidlabs-boards/tree/master/driver - but you won't be able to actually do anything with the Tsunami until you have valid board definitions anyway!

Hm.
So the Arduino IDE now knows what a Tsunami is and appears in the board list. However, the files haven't appeared in my sketchbook to be able to install the driver.
Searching the computer for the file(s) show they aren't on the machine. Though how much we trust windows search function is debatable.

I found it using a different search tool.
So the reason why it didn't appear in Windows Search was because it's in a hidden folder.
c:\users<MYWINDOWSLOGIN>\appdata\roaming\arduino15\
It does not save it into the sketchbook at all, it puts it into the appdata\roaming<arduino version> folder of your Windows user profile.
So the full path is:
C:\Users<WINDOWSUSERNAME>\AppData\Roaming\Arduino15\packages\arachnidlabs\hardware\avr\1.0.0\driver
You may wish to update your installation guide.

Wow, okay. That's not what I got when I tested it; evidently Arduino behaves differently on different Windows installs. I'll update the guide accordingly, probably to simply instruct people to redownload it from the repo.
Thanks for the feedback!


warn empty route configuration in development

closes #1411

Not sure if this is necessary... technically you can create a router with no routes.

We have addRoutes method now, so is it really needed?

It's true that it's actually possible to create an empty router and dynamically add routes from the server.
The original idea was realising easily that doing
new Router({
     Routes
})

would create no routes but I don't think adding a warning for people that dynamically retrieve the routes is a fair tradeoff. This is a very beginner problem that is absolutely unrelated to vue
This is my bad for marking the issue as FR and add the contribution welcome. I'm sorry @cwang22 I hope you will make another contribution another day 👍


[Feature] how to adding a new model as vllm

Motivation
https://docs.vllm.ai/en/latest/models/adding_model.html
Related resources
No response
Additional context
No response

@RunningLeon please update pytorch_new_model.md

@hhf-hu Hi, thanks for the feedback. Multimodal models are supported in lmdeploy's two engines and the tutorials based on PR https://github.com/InternLM/lmdeploy/pull/2810 would be updated later.

Ok

@RunningLeon pytorch_new_model.md guides users about how to add a LLM model support in pt engine rather than a VLM model

ok

ok，thank you
---- Replied Message ----
| From | @.> |
| Date | 12/10/2024 18:57 |
| To | InternLM/lmdeploy @.> |
| Cc | hhf @.>,
Mention @.> |
| Subject | Re: [InternLM/lmdeploy] [Feature] how to adding a new model as vllm (Issue #2861) |
@hhf-hu Hi, sorry for the misunderstanding. Actually, we have a turtorial for adding new models in pytorch engine. Pls. refer to
https://lmdeploy.readthedocs.io/en/latest/advance/pytorch_new_model.html
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you were mentioned.Message ID: @.***>


Multilingual hyperlink support

I have implemented a simple feature to give functionality of multilingual hyperlinks.
When you specify languages configuration such as the following, you will get hyperlinks to other languages at the upper right corner.
[languages]
  [languages.en]
    languageName = "English"
    title = "English Title"
    weight = 1
  [languages.ja]
    languageName = "Japanese"
    title = "Japanese Title"
    weight = 2

Thanks! I've merged it and implemented a flag at #30. Also, added #31 since the pages seem to be broken for multilingual feature. I'll try to fix it.
Thanks again!


Add Java installation guide for Windows

The page can be structured similar to https://se-education.org/guides/tutorials/javaInstallationMac.html
While installation itself is rather easy, some students might not know how to configure their system to be able to run java and javac commands, how to switch between Java versions etc.
Note that this guide is used by students of different courses, some of whom could be first-time Java users.

Hi Prof!
I noticed the newly updated page here: https://se-education.org/guides/tutorials/javaInstallationWindows.html.
The guide looks great!
I just wanted to check if this task still requires further input or if the page is considered complete?
One potential suggestion could be adding a section for WSL users on Windows. WSL users might find it more useful to follow the macOS installation guide, using SDKMAN for Java version management.
Additionally, another option to consider is introducing a Java Version Manager like Jabba. While I believe the original version is no longer actively maintained, there is a community-maintained fork available here, which might be worth exploring as a lightweight alternative.
Let me know if any of suggestions are worth exploring or adding!

One potential suggestion could be adding a section for WSL users on Windows. WSL users might find it more useful to follow the macOS installation guide, using SDKMAN for Java version management.

@mfjkri Can WSL run java GUI programs?

Additionally, another option to consider is introducing a Java Version Manager like Jabba. While I believe the original version is no longer actively maintained, there is a community-maintained fork available here, which might be worth exploring as an alternative.

If it is not widely used, best not to.

@mfjkri Can WSL run java GUI programs?

Hm I tried it myself and encountered this error:
java.lang.UnsupportedOperationException: Unable to load glass GTK library.

I tested this on Windows 11 with WSL2 (v<IP_ADDRESS>).
Maybe it would be best to avoid mentioning WSL then 👍🏻

Since we have a installation guide for Windows and Mac, would it be helpful to have one for Linux as well? I can help make one using Ubuntu 22 desktop and OpenJDK 17.

Since we have a installation guide for Windows and Mac, would it be helpful to have one for Linux as well? I can help make one using Ubuntu 22 desktop and OpenJDK 17.

@drustanyjt For completeness sake, yes let's add one.


Mac version?

Any plans for a Mac version?

Hope to eventually, but I'll need to get a Mac to work on first!

Added a note to the README (6ec5888794ae04839c1f4faa9b5d96d0c701080d). Will work on this when I can.


Expedition progress elapsed time

When I use the expedition progress command, it tells me I've been going for something like 737000 days, is there a way I can fix this/edit the start time to get it a bit closer to what I've actually done?

What version of VA are you running? I can’t even get mine to load the Sextant plugin because it’s too far out of date (read: not compatible with current VA).

What version of VA are you running? I can’t even get mine to load the Sextant plugin because it’s too far out of date (read: not compatible with current VA).

1.7.7 (latest?) There is a check box in the general options tab to enable plugins - it worked after I checked that and restarted VA

Huh. Guess I’ll have to double check if I’m running current Sextant.

Well, I finally had time to sit down and look at this properly, a file is created in the Voice Attack root folder called player_status.db - this contains your location, how much fuel you have, and the expedition start time/date.  You can open and edit it with LiteDbExplorer - I had to run it as Administrator.


Possibility to delete text in chat

Thx for your great work!
It would be very nice if it were possible to delete the text input from the user or the text output from the model.

Individual chats messages or the entire chat?
I'm working on an improved version (cleaner code, more features) in the "features/rewrite" branch, where you can delete individual chats and also wipe all chats.

Both. Individual chat messages so you can delete them out of the context window.
Entire chats just for cleaning up.

The context windows uses the context returned from the ollama API, so deleting a previous message would not technically change the context, however this might be implemented by re-embedding the content upon deletion, i will make a note of this.
Also try out the "rewrite" branch and see if that does what you expect.

In the "rewrite" branch it is not possible for me to delete chats. I do not have an option in the GUI to do achieve this?

Press delete while a chat is highlighted in the sidebar

Press delete while a chat is highlighted in the sidebar

My Chat looks like this on the rewrite branch:


Is a good extension if possible because it's famous for hentai

Source name
Hentai Heaven
Source link
https://hentaihaven.xxx
Source language
English
Other details
"+18/NSFW = yes"
Acknowledgements

[X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open or closed issue.
[X] I have written a title with source name.
[X] I have checked that the extension does not already exist on the website extensions list or the app.
[X] I have checked that the extension does not already exist by searching the GitHub repository and verified it does not appear in the code base.
[X] I will fill out all of the requested information in this form.

Duplicate of #1785


Remove wwwroot from .gitignore

@Rick-Anderson Can we? ... Pleeeeeeeeze! :smile:

@guardrex,
Thanks for having already signed the Contribution License Agreement. Your agreement was validated by .NET Foundation. We will now review your pull request.
Thanks,
.NET Foundation Pull Request Bot

@scottaddie  if you're convinced this is best - merge.

Case of :beer: for @scottaddie if he merges this ... MAKE that TWO CASES! :grinning:

"The time saved would be worth the risk." - Graff Vynda-K (Paul Seed)
Dr Who: The Ribos Operation, ©1978 BBC

:tada: 🎈 :cake: :sunny: 👍 😍
Thanks ... this will make things go a bit more smoothly.

@guardrex @scottaddie  what's the best way to keep wwwroot out when you don't need it? I've been copying the root ignore file to the sample folder and adding wwwroot.

I recommend creating a solution-specific .gitignore file. That should override what's defined in the root file.

In response to ...

With this being said, I think it's reasonable to exclude folders like wwwroot/lib, since folders/files are copied here during bower install. Any opposition to me adding this to .gitignore?

Samples without the lib folder contents will break tho when Bower isn't in use and the system is offline (i.e., fallbacks kick in looking for lib folder contents). Bower should replace files anyway, right? If so, it wouldn't matter if they're there. I think the worst UE tho is someone downloads a sample and it :boom: for any reason.
Another thing ... I "get it" on templates ... Bower, Gulp, flavor-of-the-month technologies get put into some of the larger, it-does-everything-OOB templates. What we have over here tho are samples. I think samples should be as least opinionated as possible. I think they should be xplat, cross-IDE, and not depend on JS task runners or specialized packages/technologies whenever possible.


数据生成方式

您好，十分感谢你公开了代码和合成方案！
我有两个问题想请教一下：

合成数据的脚本有四个，带有"_addition{x}"后缀的文件和不带有后缀的文件有什么区别吗，主要实现了什么新功能呢？
论文中训练数据为30K的合成数据，请问原始数据量大概有多少呢？
盼望你的回复，十分感谢~

@irisXcoding I also meet the same questions,
BTW, In BAIDU netdisk released from author , I only find 18K images and their labels, which is much less than 30K

您好，十分感谢你公开了代码和合成方案！ 我有两个问题想请教一下：

合成数据的脚本有四个，带有"_addition{x}"后缀的文件和不带有后缀的文件有什么区别吗，主要实现了什么新功能呢？
论文中训练数据为30K的合成数据，请问原始数据量大概有多少呢？
盼望你的回复，十分感谢~

@irisXcoding I also meet the same questions, BTW, In BAIDU netdisk released from author , I only find 18K images and their labels, which is much less than 30K
@hanquansanren Thx for your reply, but I didn't see the BAIDU netdisk link in this repo, could you please let me know where this link is :)
So many thanks~

@.***, what I mentioned the BAIDU netdisk link is follows:
https://github.com/gwxie/Document-Dewarping-with-Control-Points/tree/main/Source/dataset/fiducial1024
------------------ 原始邮件 ------------------
发件人: "Iris @.>;
发送时间: 2022年7月4日(星期一) 下午4:07
收件人: @.>;
抄送: @.>; @.>;
主题: Re: [gwxie/Synthesize-Distorted-Image-and-Its-Control-Points] 数据生成方式 (Issue #1)
@irisXcoding I also meet the same questions, BTW, In BAIDU netdisk released from author , I only find 18K images and their labels, which is much less than 30K
@hanquansanren Thx for your reply, but I didn't see the BAIDU netdisk link in this repo, could you please let me know where this link is :)
So many thanks~
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you were mentioned.Message ID: @.***>

@hanquansanren hihi, I download the data from the link this paper provided (https://pan.baidu.com/s/1bZ9B7oZuxsMNRDZGz89Mbg?pwd=9fck ), I found there is 30K (not 18K) .gw file in the folder "fiducial1024/fiducial1024_v1/color/", please check if your tar files are merged correctly
Hope this info helps you~

@hanquansanren hihi, I download the data from the link this paper provided (https://pan.baidu.com/s/1bZ9B7oZuxsMNRDZGz89Mbg?pwd=9fck ), I found there is 30K (not 18K) .gw file in the folder "fiducial1024/fiducial1024_v1/color/", please check if your tar files are merged correctly Hope this info helps you~

thanks for your response, may I ignore something when I unzip the dataset. I will check them later

你好 ，
1、他们大致内容相似，不同主要集中在“形变程度”；
2、可以根据文件名统计一下原始图像的数量。
命名规则：
https://github.com/gwxie/Synthesize-Distorted-Image-and-Its-Control-Points/blob/ed6de3e05a7ee1f3aecf65fcbb87c11d2ede41e7/perturbed_images_generation_multiProcess.py#L764

thks for your kindly response

您好，通过- Test python test.py --data_path_test=./your/test/data/path/ 得到flat文件后，还需要怎么做，才能得到最后的矫正文档图像呢？

您好,请问是否有关于数据生成方式的流程和原理说明

感谢您的来信，欢迎访问我们的网站www.yinksoft.com。

@ShadowWangsj 近期我想看一下其原理，如果我理解了他的思路我会写一篇博客


[ECO-4980] Add a script to show spec coverage

This generates a report, using our @spec etc tags, of which spec points we've implemented. This will help us to know what we still need to implement.
Resolves #46.

Summary by CodeRabbit

New Features

Introduced a new spec-coverage job to the GitHub Actions workflow for enhanced testing coverage analysis.
Added a SpecCoverage command in the BuildTool for reporting specification point implementations.

Documentation

Updated CONTRIBUTING.md to clarify testing guidelines and introduce new documentation standards for test-related APIs and spec points.

Chores

Added a new dependency, Table, to the project for improved functionality.

I was expecting a test that will show how it works

What do you mean by "a test"?

I was expecting a test that will show how it works

What do you mean by "a test"?

I mean shouldn't this tool also be covered by tests? Although I understand that this is probably a bit too much.

I mean shouldn't this tool also be covered by tests? Although I understand that this is probably a bit too much.

Oh, I see. I’m not really in the habit of writing tests for this sort of script.


FFmpeg reader should not accept still image files

I'm afraid that I just had to push an update which sets USE_FFMPEG to 0 by default -- because when files were named with unknown or incorrect extensions, OIIO tries every ImageInput type to see what opens the files. FFMpeg will actually happily open many image formats, such as TIFF, and so if it is tried prior to the actual TIFF reader, the wrong reader will be used.
The ffmpeg reader needs to be modified to reject all file types that are handled by other plugins. Probably the easy thing to do is to rig it to accept true movie formats and reject all still image formats.
I was unsure how to do this, so I just turned the ffmpeg support off by default and am bouncing this back to @mikaelsundell. Mikael, after you find a fix for this, we can restore the default to compile ffmpeg if found.

I believe this was fixed by #1010 and we never went back and closed this ticket. Please re-open or re-submit if I'm wrong.


Where is the bukkit page?

I can't seem to find the bukkit page or any way to download the compiled plugin.

No idea. It seems to have been removed.

Can you get it back?

We're currently on Spigot. http://www.spigotmc.org/resources/mythicdrops.6114/

Can you re-add the Bukkit page? It had a lot of information.


OpenCL Kernels hang in uninterruptible sleep, same for 'clinfo'

Executing OpenCL kernels (generated with LLVM's AMDGPU backend, exactly according to documentation) leads to the program waiting in uninterruptible sleep forever.
So far I have been able to observe that it usually works 2-3 times, but after that, the hanging starts to appear. clinfo always works, but after the hanging appears, clinfo starts to hang in uninterruptible sleep too.
With ps -eo comm,wchan:32 I have been able to identify:

clinfo hangs at call amd_sched_entity_fini
the first executable that hangs, stops at call kfd_process_notifier_release
all programs after that halt at kfd_create_process

The GPU used is an R9 Nano (Fiji), running the latest ROCm package (clean install) from the repositories (Ubuntu 16.04).

 Which motherboard?  Are you running with X11  or headless?
Which release of Ubuntu 16.04 SP2 or SP3

Note this is happening down in the base linux kernel driver.  Which is why in need more info.

uname -a gives back: 4.11.0-kfd-compute-rocm-rel-1.6-148 #1 SMP x86_64 x86_64 x86_64 GNU/Linux
The CPU is an Intel i7-7700
The motherboard is a Dell Inc. 0MWYPT
Running X11
Ubuntu SP3

Please send the output of 'dmesg' as well. This will indicate if there are any errors from the KFD or the amdgpu driver.

dmesg.txt
Note: at line 1150 is where it's interesting, there it complains about clinfo being blocked for more than 120s and gives a call trace.

I am seeing this message in dmesg:
[  316.383137] mce_notify_irq: 1 callbacks suppressed
[  316.383140] mce: [Hardware Error]: Machine check events logged
.
Then I am seeing messages indicating that the kernel is hung and that a timeout has occurred. The ROCm device is being registered correctly and nothing else in dmesg indicates a problem, so I am wondering if we are seeing a processor hardware issue. Try this:
.
sudo apt-get install mcelog
Run your app and see if it hangs.
The events will be logged to /var/log/mcelog. You can also run:
sudo mcelog --client
to query the mcelog daemon for errors.
.
Lets see if we can catch any errors on the processor.

The mcelog output (in the log file) does not look comforting after executing clinfo..
Here is the logfile content:
mcelog: failed to prefill DIMM database from DMI data
mcelog: Family 6 Model 9e CPU: only decoding architectural errors
Hardware event. This is not a software error.
MCE 0
CPU 0 BANK 6
MISC<PHONE_NUMBER> ADDR fef1ffc0
TIME<PHONE_NUMBER> Mon Sep  4 11:32:52 2017
MCG status:
MCi status:
Error overflow
Uncorrected error
MCi_MISC register valid
MCi_ADDR register valid
Processor context corrupt
MCA: corrected filtering (some unreported errors in same region)
Generic CACHE Level-2 Generic Error
STATUS ee0000000040110a MCGSTATUS 0
MCGCAP c0a APICID 0 SOCKETID 0
CPUID Vendor Intel Family 6 Model 158
mcelog: Family 6 Model 9e CPU: only decoding architectural errors
Hardware event. This is not a software error.
MCE 1
CPU 0 BANK 7
MISC<PHONE_NUMBER> ADDR fef200c0
TIME<PHONE_NUMBER> Mon Sep  4 11:32:52 2017
MCG status:
MCi status:
Error overflow
Uncorrected error
MCi_MISC register valid
MCi_ADDR register valid
Processor context corrupt
MCA: corrected filtering (some unreported errors in same region)
Generic CACHE Level-2 Generic Error
STATUS ee0000000040110a MCGSTATUS 0
MCGCAP c0a APICID 0 SOCKETID 0
CPUID Vendor Intel Family 6 Model 158
mcelog: Family 6 Model 9e CPU: only decoding architectural errors
Hardware event. This is not a software error.
MCE 2
CPU 0 BANK 8
MISC<PHONE_NUMBER>6 ADDR fef1ce80
TIME<PHONE_NUMBER> Mon Sep  4 11:32:52 2017
MCG status:
MCi status:
Error overflow
Uncorrected error
MCi_MISC register valid
MCi_ADDR register valid
Processor context corrupt
MCA: corrected filtering (some unreported errors in same region)
Generic CACHE Level-2 Generic Error
STATUS ee0000000040110a MCGSTATUS 0
MCGCAP c0a APICID 0 SOCKETID 0
CPUID Vendor Intel Family 6 Model 158
mcelog: Family 6 Model 9e CPU: only decoding architectural errors
Hardware event. This is not a software error.
MCE 3
CPU 0 BANK 9
MISC<PHONE_NUMBER> ADDR fef1ff00
TIME<PHONE_NUMBER> Mon Sep  4 11:32:52 2017
MCG status:
MCi status:
Error overflow
Uncorrected error
MCi_MISC register valid
MCi_ADDR register valid
Processor context corrupt
MCA: corrected filtering (some unreported errors in same region)
Generic CACHE Level-2 Generic Error
STATUS ee0000000040110a MCGSTATUS 0
MCGCAP c0a APICID 0 SOCKETID 0
CPUID Vendor Intel Family 6 Model 158

Additional data point that might lead to something:
I just noticed that the last program to run before other programs start hanging (sometimes, but not always!) throws me this error:
Memory access fault by GPU node-1 on address (nil)(may not be exact address). Reason: Unknown.

We test on FIJI Nano extensively with Intel hardware,  Can not replicate the issue.   When you run AMDGPUpro driver do you see this issue.

I thought the standard AMDGPUpro driver was not suitable for running said LLVM AMDGPU generated code, did I get something wrong there?

I am trying to see if you have hardware issue.  Llvm backed will not run.
Get Outlook for iOShttps://aka.ms/o0ukef

From: Philipp Schaad<EMAIL_ADDRESS>Sent: Thursday, September 7, 2017 5:55:05 PM
To: RadeonOpenCompute/ROCm
Cc: Gregory Stoner; Comment
Subject: Re: [RadeonOpenCompute/ROCm] OpenCL Kernels hang in uninterruptible sleep, same for 'clinfo' (#195)
I thought the standard AMDGPUpro driver was not suitable for running said LLVM AMDGPU generated code, did I get something wrong there?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHubhttps://github.com/RadeonOpenCompute/ROCm/issues/195#issuecomment-327949134, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AD8DuSNJoNr0oD8hxqPsGvHlsyCgGSQ0ks5sgHQ_gaJpZM4PL6cF.

I will check that out asap and get back to you with it. I know that before installing ROCm on a fresh system install, I had the AMDGPUpro driver running and OpenCL samples in general did not seem to pose a problem.

Additional information regarding this problem has surfaced:
AMDGPUpro driver works, that's one thing. However there were only a few sample OpenCL programs I was able to try.
Secondly: The entire system fails when it is all on the same power supply, and I have noticed the following lines in the dmesg output (they're already to be found in the dmesg I posted here.):
[    2.132219] amdgpu: [powerplay] Can't find requested voltage id in vdd_dep_on_sclk table! [    2.137175] amdgpu: [powerplay] Failed to setup PCC HW register! Wrong GPIO assigned for VDDC_PCC_GPIO_PINID!
I found this reference when looking it up, this is the exact same problem. This seems to be the explanation behind it.

This is pointing to a AMDGPU base driver issue, based 4.11 kernel around PPlib maybe.


Common optimization prefix for DuoValDescendant

6%4=2, but  3%2=1

a%b  <=>  (a/g % b/g) * g, where g=gcd(a,b)  though


Upgrade to PHP8

This isn't complaining about https://github.com/silinternational/yii2-email-log-target
no being updated in any way.
Is that OK, or do we need to try to upgrade yii2-email-log-target as well somehow?


Chaos test Azure Functions connected to Graph

Document the steps to chaos test Azure Functions that use Graph:

deploy chaos proxy so that it's accessible by Azure Functions
update Azure Functions code to use the proxy when calling Graph

Is there any update on this, it would be super super super useful to test functions app like this during local dev 🤓

We haven't planned it for February. That said, we appreciate you bringing it up. Let's see if we can shuffle things around to address this earlier. Thank you ❤

@phillipharding out of curiosity, do you build Azure Functions using VSCode or VS? Which language do you use, c# or JS?

@waldekmastykarz I use VSCode and NodeJS style functions apps, developed using TypeScript bundled to JavaScript

Cool! I'll take that as the starting point to check out the current experience. In your functions, do you typically call Graph or other APIs as well? Do you use any specific HTTP client/SDK or fetch?

Typically Graph and the SharePoint APIs using either PnPJs or native fetch

And which version of Node are you using for runtime? The reason I'm asking, is that fetch in Node.js is experimental and older versions don't support proxying requests.

Sorry, not native fetch but the node-fetch package with node v16

Gotcha. Thank you for all the information @phillipharding, it'll help us scope the research. I hope we'll have more to share shortly 😊

@phillipharding, would this be code similar to what you've got? Just checking if we're looking at the same thing 😊
import { app, HttpRequest, HttpResponseInit, InvocationContext } from "@azure/functions";
import fetch from 'node-fetch';

export async function GraphHttpTrigger(request: HttpRequest, context: InvocationContext): Promise<HttpResponseInit> {
    // auth goes here
    const resp = await fetch('https://graph.microsoft.com/v1.0/users');
    const data = await resp.json();
    return {
        status: 200,
        jsonBody: data
    };
};

app.http('GraphHttpTrigger', {
    methods: ['GET', 'POST'],
    // unlikely in prod, but keeping it simple for now
    authLevel: 'anonymous',
    handler: GraphHttpTrigger
});

Closing due to lack of response


Test not running with --disable-socket option

Does this issue occur when all extensions are disabled?: Yes/No

VS Code Version:  1.86.1
OS Version:  Linux x64 6.5.0-15-generic
Steps to Reproduce:

add configurations to your pytest.ini addopts = --disable-socket --allow-unix-socket --allow-hosts <IP_ADDRESS>
Try to run the test.

On each update, I have to perform manual fixes to make it work
If tests are failing on trying to open the socket connection
go to file
~/.vscode/extensions/ms-python.python-/pythonFiles/vscode_pytest/init.py::post_response
change line 734:
addr = ("localhost", int(TEST_PORT))
to
addr = ("<IP_ADDRESS>", int(TEST_PORT))
make sure that your pytest.ini file contains
addopts = --disable-socket --allow-unix-socket --allow-hosts <IP_ADDRESS>

Thanks for creating this issue! It looks like you may be using an old version of VS Code, the latest stable release is 1.86.1. Please try upgrading to the latest version and checking whether this issue remains.
Happy Coding!

I have updated to version 1.86.1 same behavior

know issue, see https://github.com/microsoft/vscode-python/issues/22383. Currently working on switching to named pipes which will re-enable the use of disable-socket


Neighborhood!

How about going down to a neighborhood?
https://www.yelp.com/developers/documentation/v2/neighborhood_list
Not as exact as cities, but sometimes it could be useful.

The city terminology is wrong anyway, as discussed in https://github.com/vincentmorneau/oracle-geo-data/issues/12, so I'll probably name that "Populated places", which will include cities and more (neiborhoods).
I'll close this in favor of https://github.com/vincentmorneau/oracle-geo-data/issues/12


Is the set or show command supported?

Question
For English only, other languages will not accept.
Before asking a question, make sure you have:

Googled your question.
Searched open and closed GitHub issues.
Read documentation: ShardingSphere Doc.

Please pay attention on issues you submitted, because we maybe need more details.
If no response more than 7 days and we cannot reproduce it on current information, we will close it.
Is the set command currently supported?

show status;

show variables;

show variables like '%my_name%';

show full processlist;

show errors;

show warnings;

show character set;

set global my_var:=my_value;

set @@gloabl.my_var:=my_value;

Whether the metadata center is relevant?

Most of them are unicast to single mysql.
Maybe the designer didn't think about some problems.
Such as show full processlist?
Because the PID may be the same.

ok. What are the plans for the future?

There is no plan with these SQL, do you interesting with them?

No, I'm not interested.
Just to get to know

OK, Could we close this issue?

ok


Next.js server side rendering - possible with SWA?

If I'm bringing my Next.js apps (a catalog of various apps) to Azure and they make use of server-side rendering, is it possilbe to use SWA/Functions somehow or do I need to move them to App Service?

I have a similar question as we are rewriting some legacy stuff into NextJS with SSR.
Is there an OOB way to deploy onto Azure as AWS has, or is this part of the wait? Can't find clear documentation on the deployment part.

Hi @dfberry! As of today, Static Web Apps only supports static rendering of Next.js Apps. However, the team is currently working on supporting Server-side rendering in Static Web Apps and you should be seeing a public preview of the same in the coming couple of months!🎉 CC// @simonaco @pvbchak

Do you have any updates on the progress? This feature sounds really good and we would like to test it as soon as the preview is available :)

I agree, it would be nice to have an update on this.

hi @Reshmi-Sriram -- you mentioned support Azure Static Web Apps -- would this include other static generators such as Gatsby?

@Reshmi-Sriram could you give us some updates on what is the status of Next.js SSR support and when it should be available at least as a public preview?

Hi, @Reshmi-Sriram is there any approximate timeframe when the public preview will be available? I am considering if I should wait or use Azure Web Apps. Since SSR is very common when using nextjs I guess this is a highly wanted feature. Thanks!

Hi All,
We're expecting the public preview to be out by October. There have been a couple of blockers and hence a slight delay in the planned release. Apologies for the wait, stay tuned for more updates!
cc// @sulabh-msft

Hello @Reshmi-Sriram !
Any development updates related to SSR? How is it going?

https://github.com/ShanonJackson/nextjs-azure
If you're looking for SSR please It would be good to have some people try out the library so I can start to get a feel for what's still outstanding.
Very close to production ready, and the initial results are that it's around 30-50% faster than Vercel.
This library can be plug-and-played with static-web-apps but I'd recommend using the infrastructure setup within the project.
Very happy to support anyone in any way on hosting NextJS setups on Azure just reach out to me, happy to walk someone through "do it youself", "do it on static web apps" or do it with "nextjs-azure".

Work in progress! We're just as excited to see NextJS SSR on SWA!

@thomasgauvin I received an email from Azure (App Service recommendation) stating "Post mid-September, Azure Static Web Apps will support Server-Side Rendering (SSR) for Next.js applications."

Does that mean that we no longer need to export our Next.js app and it will also support SSG? Is there any way to try the new behavior in preview ?

Does that mean that we no longer need to export our Next.js app and it will also support SSG? Is there any way to try the new behavior in preview ?

@schemburkar  - in case you prefer to use the statically exported Next.js files, you will still have the option to do so using the is_static_export flag in your existing app. In case you would like to use SSR/ ISR/ SSG, you can do so using the new feature change.
Let me know if this helps!

@Reshmi-Sriram, how can we try a new behaviour SSR/ISR/SSG? Is ISR on demand?

In case you would like to use SSR/ ISR/ SSG, you can do so using the new feature change.

Thanks @Reshmi-Sriram  I'm aware of the is_static_export. How do i enable the SSG for my existing app. I tried publishing without the export option but the deploy fails, so need to know any setting or feature flag that needs to be enabled ?

@schemburkar Will azure static web apps also support pages/api routes?
With a custom nextjs server, these are not working, currently, I work around that issue by creating azure functions for the API routes.

@erwinsmit
https://github.com/ShanonJackson/nextjs-azure
This will give. you npx nextjs-azure which will transform .next folder into a 3 folders one of which is "api" which should be an azure function compatible folder with your entire pages/api folder built in the most optimized way.
Basically just wraps your nextjs output in an azure function compatibility layer.

Update! You should now be able to try out Next.js SSR public preview support in Static Web Apps!
Check out this discussion to learn more :)

Closing this issue.


chore: Setup loading bar

Closes #16

@iamareebjamal Why did you close this without giving any reasons? If I make any mistake I should be informed at least, it will help me to learn otherwise all my efforts are just total waste!!!!!.

Cool. Resolve conflicts and update the PR. You said in an issue that you are unavailable because of exams

Cool. Resolve conflicts and update the PR. You said in an issue that you are unavailable because of exams

Sorry for the misunderstanding. I meant about working with any new issue.

I will resolve merge conflict and update it :smile:

I have resolved the merge conflict. :smile:


Kubernetes API Service is not accessible by pods (bpf)

Hi everyone, I have a very strange issue (I'm not even 100% sure it's calico's fault) with my cluster's API service address <IP_ADDRESS>.
No pods can reach that address, and the error I'm getting is 'operation not permitted'.
I'm running a k0s cluster with manually configured Calico in eBPF mode. I have 3 control-plane servers and 3 workers (in libvirt virtual machines, with bridged networking).
I have installed Calico using the operator, according to the manual. Everything was working fine, while I had 1 cp and 1 worker.
After adding more controlplane nodes to the cluster, I started having this issue.
For example, with coredns -
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.EndpointSlice: Get "https://<IP_ADDRESS>:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp <IP_ADDRESS>:443: connect: operation not permitted

I'm not 100% sure, but the issue seem to start after I added an external loadbalancer to the API.
k0s requires having an external loadbalancer in front of highly-available control planes, so I have a keepalived virtual ip + haproxy loadbalancer on every control plane - this virtual IP is configured in both k0s and in tigera operator kubernetes-services-endpoint configmap, like so:
apiVersion: v1
data:
  KUBERNETES_SERVICE_HOST: <IP_ADDRESS>
  KUBERNETES_SERVICE_PORT: "6443"
kind: ConfigMap
metadata:
  name: kubernetes-services-endpoint
  namespace: tigera-operator

I've tried figuring out the issue myself, and what I found - is that for the service IP, there is no 'backend' in BPF nat:
[hawara@phoenix ~]$ kubectl exec -n calico-system calico-node-hxjzp  -c calico-node   -- calico-node -bpf nat dump
W1023 07:39:34.266002   16902 feature_gate.go:241] Setting GA feature gate ServiceInternalTrafficPolicy=true. It will be removed in a future release.
<IP_ADDRESS> port 443 proto 6 id 2 count 0 local 0
<IP_ADDRESS> port 9898 proto 6 id 6 count 2 local 1
	6:0	<IP_ADDRESS>:9898
	6:1	<IP_ADDRESS>:9898
<IP_ADDRESS> port 9898 proto 6 id 6 count 2 local 1
	6:0	<IP_ADDRESS>:9898
	6:1	<IP_ADDRESS>:9898
<IP_ADDRESS> port 32648 proto 6 id 6 count 2 local 1
	6:0	<IP_ADDRESS>:9898
	6:1	<IP_ADDRESS>:9898
<IP_ADDRESS> port 9999 proto 6 id 8 count 2 local 1
	8:0	<IP_ADDRESS>:9999
	8:1	<IP_ADDRESS>:9999
<IP_ADDRESS> port 443 proto 6 id 0 count 2 local 1
	0:0	<IP_ADDRESS>:5443
	0:1	<IP_ADDRESS>:5443
<IP_ADDRESS> port 443 proto 6 id 5 count 0 local 0
<IP_ADDRESS> port 32648 proto 6 id 6 count 2 local 1
	6:0	<IP_ADDRESS>:9898
	6:1	<IP_ADDRESS>:9898
<IP_ADDRESS> port 30131 proto 6 id 8 count 2 local 1
	8:0	<IP_ADDRESS>:9999
	8:1	<IP_ADDRESS>:9999
<IP_ADDRESS> port 5473 proto 6 id 1 count 2 local 0
	1:0	<IP_ADDRESS>:5473
	1:1	<IP_ADDRESS>:5473
<IP_ADDRESS> port 9999 proto 6 id 8 count 2 local 1
	8:0	<IP_ADDRESS>:9999
	8:1	<IP_ADDRESS>:9999
<IP_ADDRESS> port 30131 proto 6 id 8 count 2 local 1
	8:0	<IP_ADDRESS>:9999
	8:1	<IP_ADDRESS>:9999
<IP_ADDRESS> port 32648 proto 6 id 6 count 2 local 1
	6:0	<IP_ADDRESS>:9898
	6:1	<IP_ADDRESS>:9898
<IP_ADDRESS> port 53 proto 6 id 7 count 0 local 0
<IP_ADDRESS> port 53 proto 17 id 3 count 0 local 0
<IP_ADDRESS> port 9153 proto 6 id 4 count 0 local 0
<IP_ADDRESS> port 30131 proto 6 id 8 count 2 local 1
	8:0	<IP_ADDRESS>:9999
	8:1	<IP_ADDRESS>:9999

Not sure what to do next, or how to debug this further.
Expected Behavior
Kubernetes service API is accessible.
Current Behavior
Pods can't talk to the API server internally - dial tcp <IP_ADDRESS>:443: connect: operation not permitted
Possible Solution
Really no idea what causes it :(
Steps to Reproduce (for bugs)

Install k0s without CNI, add CNI manually via manifest to install tigera operator.
Configure HA controlplane
Observe pods not being able to connect to the API

Context

Your Environment

Calico version - v3.26.1
Orchestrator version (e.g. kubernetes, mesos, rkt): k0s 1.28.2
Operating System and version: Ubuntu 22.04 LTS with 6.2 kernel
Calico Installation CRD and additional configs - please see this gist

Thank you, and please let me know if you need any more details.

What implements the <IP_ADDRESS>  keepalived virtual ip ? Where and how is it pointing to? How and what does it translate to when a client uses it?

the service IP, there is no 'backend'

If you list kubernetes endpoints, what do you get?

Pods can't talk to the API server internally - dial tcp <IP_ADDRESS>:443: connect: operation not permitted

Definitely the result of not having any backends.

What implements the <IP_ADDRESS> keepalived virtual ip ? Where and how is it pointing to? How and what does it translate to when a client uses it?

There is a keepalived daemon on each kubernetes controlplane node, one of the controlplanes gets the <IP_ADDRESS> IP.
haproxy listens on all controlplanes on this ip, and then tcp forwards to one of the controllers.
that IP is used in k0s as the external IP address, I also use this address in my kubeconfig file (and it works).
The virtual IP points to one of the controlplane mac addresses:
hawara@phoenix:~$ arp -an
? (<IP_ADDRESS>) at 52:54:00:56:d5:06 [ether] on enp1s0
? (<IP_ADDRESS>) at 52:54:00:56:d5:06 [ether] on enp1s0
? (<IP_ADDRESS>) at 52:54:00:be:58:d0 [ether] on enp1s0

[hawara@phoenix ~]$ kubectl cluster-info
Kubernetes control plane is running at https://<IP_ADDRESS>:6443
CoreDNS is running at https://<IP_ADDRESS>:6443/api/v1/namespaces/kube-system/services/kube-dns:dns/proxy

keepalived conf
root@sentinel-cp:/etc/keepalived# cat keepalived.conf
#
# Ansible managed
#

vrrp_instance VI_1 {
  state MASTER
  interface enp1s0
  virtual_router_id 52
  priority 255
  authentication {
    auth_type PASS
    auth_pass <bogus>
  }
  virtual_ipaddress {
    <IP_ADDRESS>/23
  }
}

the service IP, there is no 'backend'

If you list kubernetes endpoints, what do you get?

[hawara@phoenix ~]$ k get endpoints kubernetes
NAME         ENDPOINTS           AGE
kubernetes   <IP_ADDRESS>:6443   37d

[hawara@phoenix ~]$ k get endpointslices.discovery.k8s.io
NAME         ADDRESSTYPE   PORTS   ENDPOINTS      AGE
kubernetes   IPv4          6443    <IP_ADDRESS>   37d

Pods can't talk to the API server internally - dial tcp <IP_ADDRESS>:443: connect: operation not permitted

Definitely the result of not having any backends.

Even if I try to manually specify each controlplane IP in kubernetes service endpoint, there are still no backends in bpf nat.

I've added debug logs to Felix, it seems it really skips the endpoints of the kubernetes service:
2023-10-25 04:43:10.974 [DEBUG][519655] felix/syncer.go 549: Applying service service=default/kubernetes:https
2023-10-25 04:43:10.974 [DEBUG][519655] felix/syncer.go 865: bpf map writing NATKey{Proto:6 Addr:<IP_ADDRESS> Port:443 SrcAddr:<IP_ADDRESS>/0}:NATValue{ID:2,Count:0,LocalCount:0,AffinityTimeout:0,Flags:{}}
2023-10-25 04:43:10.974 [DEBUG][519655] felix/syncer.go 371: applied a service default/kubernetes:https update: sinfo={id:2 count:0 localCount:0 svc:0xc000001800}

@tomastigera  I think I've found why this happens -
default kubernetes endpoint by default has label endpointslice.kubernetes.io/skip-mirror: "true"
when this label is set, for some reason, felix doesn't detect the endpoint IP - look at the debug logs:
felix/syncer.go 528: Applying new state,
{map[calico-apiserver/calico-api:apiserver:<IP_ADDRESS>:443/TCP calico-system/calico-typha:calico-typha:<IP_ADDRESS>:5473/TCP default/kubernetes:https:<IP_ADDRESS>:443/TCP kube-system/kube-dns:dns:<IP_ADDRESS>:53/UDP kube-system/kube-dns:dns-tcp:<IP_ADDRESS>:53/TCP kube-system/kube-dns:metrics:<IP_ADDRESS>:9153/TCP kube-system/metrics-server:https:<IP_ADDRESS>:443/TCP test/podinfo:grpc:<IP_ADDRESS>:9999/TCP test/podinfo:http:<IP_ADDRESS>:9898/TCP]
map[calico-apiserver/calico-api:apiserver:[<IP_ADDRESS>:5443 <IP_ADDRESS>:5443] calico-system/calico-typha:calico-typha:[<IP_ADDRESS>:5473 <IP_ADDRESS>:5473] kube-system/kube-dns:dns:[<IP_ADDRESS>:53 <IP_ADDRESS>:53] kube-system/kube-dns:dns-tcp:[<IP_ADDRESS>:53 <IP_ADDRESS>:53] kube-system/kube-dns:metrics:[<IP_ADDRESS>:9153 <IP_ADDRESS>:9153] kube-system/metrics-server:https:[<IP_ADDRESS>:10250] test/podinfo:grpc:[<IP_ADDRESS>:9999 <IP_ADDRESS>:9999 <IP_ADDRESS>:9999] test/podinfo:http:[<IP_ADDRESS>:9898 <IP_ADDRESS>:9898 <IP_ADDRESS>:9898]] }

The second map - with the endpoint IPs doesn't contain default/kubernetes!
even though the endpoint itself has the IP:
[hawara@phoenix secrent-repo]$ k get endpoints -o yaml
apiVersion: v1
items:
- apiVersion: v1
  kind: Endpoints
  metadata:
    creationTimestamp: "2023-09-17T11:02:15Z"
    labels:
      endpointslice.kubernetes.io/skip-mirror: "true"
    name: kubernetes
    namespace: default
    resourceVersion: "13585030"
    uid: 065a580d-7c2a-41dd-a84a-1c5e7d7b9c66
  subsets:
  - addresses:
    - ip: <IP_ADDRESS>
    ports:
    - name: https
      port: 6443
      protocol: TCP
kind: List
metadata:
  resourceVersion: ""

if I manually create the endpointslice, then it appears in felix's debug endpoint map:
2023-10-25 05:41:04.595 [DEBUG][527820] felix/syncer.go 528: Applying new state, {map[calico-apiserver/calico-api:apiserver:<IP_ADDRESS>:443/TCP calico-system/calico-typha:calico-typha:<IP_ADDRESS>:5473/TCP default/kubernetes:https:<IP_ADDRESS>:443/TCP kube-system/kube-dns:dns:<IP_ADDRESS>:53/UDP kube-system/kube-dns:dns-tcp:<IP_ADDRESS>:53/TCP kube-system/kube-dns:metrics:<IP_ADDRESS>:9153/TCP kube-system/metrics-server:https:<IP_ADDRESS>:443/TCP test/podinfo:grpc:<IP_ADDRESS>:9999/TCP test/podinfo:http:<IP_ADDRESS>:9898/TCP] map[calico-apiserver/calico-api:apiserver:[<IP_ADDRESS>:5443 <IP_ADDRESS>:5443] calico-system/calico-typha:calico-typha:[<IP_ADDRESS>:5473 <IP_ADDRESS>:5473] default/kubernetes:https:[<IP_ADDRESS>:6443] kube-system/kube-dns:dns:[<IP_ADDRESS>:53 <IP_ADDRESS>:53] kube-system/kube-dns:dns-tcp:[<IP_ADDRESS>:53 <IP_ADDRESS>:53] kube-system/kube-dns:metrics:[<IP_ADDRESS>:9153 <IP_ADDRESS>:9153] kube-system/metrics-server:https:[<IP_ADDRESS>:10250] test/podinfo:grpc:[<IP_ADDRESS>:9999 <IP_ADDRESS>:9999 <IP_ADDRESS>:9999] test/podinfo:http:[<IP_ADDRESS>:9898 <IP_ADDRESS>:9898 <IP_ADDRESS>:9898]] }

But this is not a solution - that label to not sync to endpointslices is set by the kube api server by default, if I'm not mistaken.
And I've checked - I have Felix config parameter bpfKubeProxyEndpointSlicesEnabled: false - even though it's false by default. It doesn't matter, if it's set or not - the IP doesn't appear in the endpoint list, unless an endpointslice is present.
As a workaround, I'll create the endpointslice manually, but I still need your help, thank you.

I don't understand this anymore, I've recreated my cluster, set the externalAddress - and lo and behold, endpoint object DOES NOT contain that label.
I did look at what happens inside k0s and inside kubernetes itself - it looks like there is a condition, when the apiserver will set that label - https://github.com/kubernetes/kubernetes/blob/fd5c40611257c694d2338960976726344e2b45e5/pkg/controlplane/reconcilers/instancecount.go#L82
And k0s does nothing specific - it just creates these endpoints. Maybe, somehow, sometimes, it is possible that the line in apiserver adds that label. I'm not sure, but I think the issue ca be closed - at least there will be an info for a google search.

Does this mean that if the label is present it should be removed?  I'm seeing similar behavior I believe.  Calico is exporting the kubernetes service address, but not importing it.

Calico is exporting the kubernetes service address, but not importing it.

What do you mean by that?

I was wrong and the situation resolved itself.  Ignore me.


[Feature request] Expose an endpoint to fetch all bookmarks in a structured format (eg. CSV)

Hi,
I've built a tool which allows users to quickly search through all of their bookmarks. It works by pulling the user's backup CSV. However, there is no documented endpoint for a user to download all of their bookmarks - only a GUI. Would you consider documenting this endpoint?
The reason this is needed is because, without this endpoint, folks have no efficient way to retrieve their bookmarks. For example, browser-bookmarks.nvim added initial support for Raindrop. They've had to resort to the /v1/raindrops endpoint - looping over it for every(!) page of a user's bookmarks. Not only does this put unnecessary strain on both the client and the server, but users with a lot of bookmarks are not able to even use this as they will eventually get rate limited. If they do not get rate limited, they will have to wait a long amount of time as tens/hundreds of requests resolve in the background. There should be a better way for downstream tools and users to work with their own data.
Finally, while I've browsed https://better.raindrop.io only for a short time, I've come across several tickets that could also be closed if users had a method to programmatically access their "backup" CSV file. For example:

This could be a fairly straightforward cron job that users can create and share with each other.

This has been a planned ticket that 160 people have been waiting on for 6 years. Some of them seem very desperate (poor Hurd). On linux/mac, this can be shared as github gist:

#!/usr/bin/env bash
xsv slice -l 1 -s $(awk '{print NR}' bookmarks.csv | shuf -n 1) bookmarks.csv | xsv select url | tail -n -1 | xargs xdg-open

I'm sure a windows user can share a powershell snippet that does the same on windows.
My point is that without a documented endpoint to download all bookmarks in structured format, users are left helpless, having to wait for years for a feature request because you (understandably) are not able to fulfill all of them in a prompt manner. To me, it seems like this would (a) make Raindrop easier to extend and (b) take some of the backlog load of you so you can focus on performance/core experience. I'd be interested to hear your thoughts on the matter.
Relevant issues:

https://github.com/thenbe/fzf-raindrop/issues/1
https://github.com/dhruvmanila/browser-bookmarks.nvim/issues/34

Relevant tickets:

https://better.raindrop.io/integrations/p/non-cloud-backups
https://better.raindrop.io/feature-requests/p/export-links-as-plaintext-table
https://better.raindrop.io/feature-requests/p/search-function-in-backup-file
https://better.raindrop.io/feature-requests/p/export-to-more-file-types
https://better.raindrop.io/feature-requests/p/custom-plugins

https://developer.raindrop.io/v1/export


Release request context data after handling

Every range query handler goroutine (one for each cache key, of which
there can be hundreds or thousands) currently holds on to a reference to
the last request context that it handled. This is since the channel
range loop variable (which holds the request context) is only
overwritten once a subsequent request is received from the channel. This
change explicitly sets the finished request context to nil so that Go
can release the associated memory.
In GitLab, this has fixed OOM problems in Trickster, and memory usage is
now significantly lower.
Signed-off-by: Julius Volz<EMAIL_ADDRESS>

/cc @SuperQ

@FUSAKLA, this may address #56 for you.

Pics or it didn't happen: :grin:

You can see the fix deploy at 14:00 UTC. And a 10m pause in queries at 14:45 (turned off grafana just to see).

Just for context, here's how many gouroutines are in use. With the patch we see a bunch more, but we don't OOM anymore.

Note that in the screenshot above I had only set r = nil for non-cached requests and not for cached yet. So hopefully behavior with this PR will be even better.

Just for context, here's how many gouroutines are in use. With the patch we see a bunch more, but we don't OOM anymore.

Yeah, that's just because now we can actually fit all the goroutines that want to be there anyway into memory :)

This is now deployed at GitLab and it seems it has cut the peak go_memstats_heap_inuse_bytes from ~35GB down to ~6GB.

Spoke too soon, now it's up to 10GB, but still a >3x gain (and we don't know how much larger the old version would have grown, since it OOMed) :)

This looks great I'll definatelly try out.
Thanks for the heads up @jranson!


Has anyone tried to implement OCPP-J?

Possibly have some example code? (ver. 1.6)

Closing for inactivity.

Possibly have some example code? (ver. 1.6)

Hi,
i'm interesting to develop OCPP-J Central Station with ratchet.
Have you any code for initial handshake?
We can collaborate?
Thanks


Building monitoring containers on RHEL7

Hello
In #2887 a change was made to roll back to older RHEL 7.3, but I was still having issues building the containers.
https://github.com/slashterix/openshift-tools/commit/a0e65d6578a511eaa0f9489a95b4368bc5127754 shows all the changes I needed to make to get all the containers to build.
I'm running OCP 3.6 Enterprise on premises (on VMware and physical hosts) and am trying to give this Zabbix monitoring a try since there isn't much built in for monitoring the platform.
I'd appreciate any feedback as I'm new here before I open a PR. Have I made any drastic mistakes or done things that don't work with the flow for others?

https://github.com/slashterix/openshift-tools/commit/17ec0b035aea7cb18fc6e78508791b9a49f2a037

/lifecycle rotten


Spatial audio

Description
Hi,
I have use case where I want to use <model-viewer>in AR mode. A feature would be to adjust the volume of an audio source depending on the distance between camera position and model.
Maybe someone can point me into a direction how to achieve that?
Version
<EMAIL_ADDRESS>

Our API doesn't currently expose the information you need. It would be possible using our default WebXR AR mode, but QuickLook and SceneViewer are distinct apps, so you can't really customize them from your website. I'm a little hesitant to expose such a low-level API in model-viewer. Of course you could certainly fork us to accomplish this (you'd want to hook in with the $updateCamera method in ARRenderer.ts).

Hi @elalish, thanks for your quick response. I understand your concerns about exposing such low-level information. I am gonna close this issue for noww.


Dropbox upload with mute: true does not work

If I use the curl example from the dropbox api spec replacing  "mute": false by "mute": true
curl -X POST https://content.dropboxapi.com/2/files/upload
--header "Authorization: Bearer "
--header "Dropbox-API-Arg: {"path": "/Homework/math/Matrices.txt","mode": "add","autorename": true,"mute": true}"
--header "Content-Type: application/octet-stream"
--data-binary @local_file.txt
the file is uploaded correctly but , I still receive a file update notice.
Johannes

Thanks for the report! This is a known issue, but we don't have a timeline for a fix right now.

Hi @greg-db , is there any updated eta for this fix? I'm seeing the issue with the Javascript API

@rogerdickey No, I'm afraid I don't have an update on this.


Native multipart copy

Presently S3Proxy emulates multipart copy with a range getBlob request followed by uploadPart.  Instead jclouds should offer native support.  Note that this will need the Azure part size workaround as the existing multipart upload code.

Azure does not support range copies:
https://docs.microsoft.com/en-us/rest/api/storageservices/fileservices/copy-blob
OpenStack does not document range copies:
https://developer.openstack.org/api-ref/object-storage/?expanded=copy-object-detail
Atmos and B2 do not support copies at all.  Perhaps S3Proxy should just special case S3 to do native MPU copy?


Making the example on the Readme repeatable for more users

This works out of the box with Github:
git clone https://github.com/amancevice/superset.git

As opposed to:
git clone git@github.com:amancevice/superset.git
Cloning into 'superset'...
Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.

i had same issue
try solution here http://stackoverflow.com/questions/33661079/git-permission-denied-publickey

That's odd behavior @kingo55 did you ever resolve this issue?


FR: additional controls on global and user level to set default view for the charts & dashboards

Is your feature request related to a problem? Please describe.
Tile view is visually appealing, however table / list view provides more information that's needed to find the needed chart / dashboard. Example screenshots are below.
Describe the solution you'd like
It would be really great to add additional controls to for the default setting on what is getting displayed for the user table /list view vs tile. We would love to see the global setting & it definitely would be useful to have a user setting as well.
Additional context
Tile view:

Table/ list view:

cc @nytai


Implement a Pull Request Template with Checklist for Code Checks and Issue Linking

Want to standardize pull requests and ensure that they meet the project's contribution guidelines, so I propose implementing a pull request template.
The proposed PR template will include the following items:
Link to Issue: Ensure contributors explicitly link PRs to corresponding issues using the closes #issue_number syntax, making it easier to track and automate closure of issues when PRs are merged.
Code Checks: Include a checkbox to confirm that all code checks have passed. This is relevant as we plan to implement pre-commit hooks using Prettier for style checks, ensuring that all submitted code is accordingly to our formatting standards.
Testing: Confirm that new code contributions have adequate tests and that all tests pass.
Implementation:
Create the PR Template: Add a PULL_REQUEST_TEMPLATE.md file in the .github directory with the proposed checklist.
We can open a discussion bellow in the comments to finalize the checklist items with input from maintainers and active contributors.
My ideia:

[ ] closes #xxxx (Replace xxxx with the GitHub issue number)
[ ] Tests added and passed
[ ] All code checks passed

/assign

@ArvindParekh seems good for you that template?

Thanks for raising @abeltavares! I think this looks good!

The code check currently just includes conforming with the project's coding style, which is managed by Prettier. Perhaps we should phrase it as "My changes follow the coding style of the project".
Since tests have not been set up yet, we can consider omitting them from the template for now and incorporating them later when they are established.
Additionally, I suggest adding one more check: "The PR title provides a concise description of my changes".

What do you think?

Thanks for raising @abeltavares! I think this looks good!

The code check currently just includes conforming with the project's coding style, which is managed by Prettier. Perhaps we should phrase it as "My changes follow the coding style of the project".
Since tests have not been set up yet, we can consider omitting them from the template for now and incorporating them later when they are established.
Additionally, I suggest adding one more check: "The PR title provides a concise description of my changes".

What do you think?

seems good, the update (with tests check) is done later then with the integration of the tests

[ ] The PR title provides a concise description of my changes
[ ] My changes follow the coding style of the project
[ ] Closes #xxxx (Replace xxxx with the GitHub issue number)

Perfect, looks great! 👍🏻
I think that once Prettier is added to the project, we should also add that to the CONTRIBUTING.md documentation, saying that we use Prettier to handle the coding style of the project, so make sure the changes are in accordance with that before raising a PR.


Anchoring Issues / Scrolling Issues

Anchoring Issues
I have an element that is say, 90% of the screen width.  I try to put a tour element above it on the left side like this:
tour.addStep('first', {
    title: 'Device Info',
    text: 'General device identification data appears on the left ...',
    attachTo: {element: 'device h2', on: 'top left' },
    scrollTo: false
});

However, while the element appears on the left side it is not on top of the element, nor are there any arrows pointing at the element.
How can I achieve the desired result?
Scrolling Issues
While I can use the `scrollTo: true' property to get close-ish to the element down my page, which is great, I have the element set to attach to the top of the target... the scrollTo actually goes to the top of the element not the top of the tour element pop-up, which for me would be preferable, because the arrow disappears.
How can I achieve this type of scroll to?

Regarding the scrollTo issue, this is how I fixed it.
var topScrollHandler = function(element){
    var $element = $window.jQuery(element);
    var topOfElement = $element.offset().top;
    var heightOfElement = $element.height();
    $window.jQuery('html, body').animate({
        scrollTop: topOfElement - heightOfElement
    },{
        duration: 1000
    });
};

tour.addStep('step2', {
    title: 'Text',
    text: 'Add your text here',
    attachTo: '.my-element top',
    scrollTo: true,
    scrollToHandler: topScrollHandler
});

Popper is a bit better at positioning logic and keeping arrows around, so I am closing this, since we migrated to popper. If the behavior is still off, feel free to open a new issue and we will take a look.


Improve usability of popover & popover container

Some assorted fixes and improvements which resulted from @peppy attempting to use the control for multiplayer room password input. I recommend reading commit-by-commit; I didn't want to split this into 3 or 4 pulls because noise.

58863c6 removes the weird OnMouse{Down,Up} handling that seemed to be unnecessary in the end. Shaves a fair bit of complexity off as well.
7fed4ba fixes not being able to use the popover container in hierarchies that had auto-size axes on them. Fix mirrors what ContextMenuContainer and TooltipContainer already do.
26cde79 is intended to guide towards the proper usage of popovers (which is putting what should go inside the popover into Children rather than InternalChildren).
f32bebb adds support for sizing the popovers directly rather than them breaking when sizes are set on the popover itself, which leads to having to set the desired size on their contents instead.

I've piled one more fix here - as it turns out, when trying to use PopOut game-side it turned out to be entirely broken, because PopoverContainer (due to order of registering for the State value change event) was always expiring the popover before any transforms from PopOut could even be added, and therefore potentially interrupting the animation.
Fixed by only expiring the popover when it's being replaced by another one (or nothing). I also considered hacking it together to make the order correct (moving the BindValueChanged call to OnLoadComplete) but I hated it because nested callbacks are bad.

I don't know how I feel about the sizing stuff - it looks flimsy. Like if you wanted to put a text flow container in the content you just... may not? Unless you duplicate the size definition into an internal content container. It seems like you're hacking things together either way. Have you considered making it relative size and enforcing the consumer to decide a fixed size or set the content to autosize instead?

Side note - can private Container content be made readonly in Popover? I don't see why it couldn't and am confused why that's not showing a CI inspection.

Agree with sizing being flaky. I think it would be better long term to refactor the container to not rely on the 0x0 size to perform layout.

I think there is a plausible path where the 0x0 sizing does not exist, but it would add significant complexity in order to preserve existing behaviour (would probably need to manually handle masking and use relative anchor).
I don't necessarily follow how relative axes would work here either, but I haven't yet tried to apply them, so I may be simply missing something.


Make SSH restore work again from the installer

This simply re-enables the asking for authentication information for SSH restores in the installer. It seems that when the iSCSI restore was removed, an check based on it was not removed. See the fourth commit for the main stuff (and explaination).

Please see the thread in discourse.

Lgtm!


Traefik Pilot: plugins support and alert system (EXPERIMENTAL FEATURES)

What does this PR do?
We are proud to introduce two new major features :heart: :

Traefik Pilot: Traefik Pilot is a software-as-a-service (SaaS) platform that connects to Traefik to extend its capabilities.
Plugins support (middleware): to extend Traefik capabilities (Traefik Pilot is used to handle plugins)

EXPERIMENTAL FEATURES
Motivation
Fixes #1336
More

[x] Added/updated tests
[x] Added/updated documentation

Additional Notes
This PR contains the documentation about plugins but you can also take a look at the following repository to have explanations about how to create a plugin: https://github.com/containous/plugindemo

Congratulations on this great achievement.
Quick feedback after giving it a quick try: it seems to be still not enough for advanced security middlewares involving cgo and some low-level Go. Yaegi doesn't seem to support it.


Fix for historical replay of withdrawals

Description of PR

What component(s) does this PR affect?

[X] Back-End (Database, Microservices, Containers, etc)
[ ] Front-End (Flask, API, etc)
[ ] Docs
[ ] Build System

Does the PR require changes on other components? If yes, please mark the components:

[ ] Back-End (Database, Microservices, Containers, etc)
[ ] Front-End (Flask, API, etc)
[ ] Docs
[ ] Build System

Related Issue

Resolves #199
Solution

Type

[X] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Docs update
[ ] None of the above

Checklist:

[X] I have read the contributing guide and my code conforms to the guidelines.
[ ] This change requires a change in the documentation.
[ ] I have updated the documentation accordingly.

Tested as follows:

Test input:
<IP_ADDRESS>/25|100|8|8 3 2 1 100|routeviews|tst.caida|A|"[{""asn"":555, ""value"":1}, {""asn"":555, ""value"":2}]"|1563580800
<IP_ADDRESS>/25|100|9|9 3 2 1 100|routeviews|tst.caida|A|"[{""asn"":555, ""value"":3}]"|1563580801
<IP_ADDRESS>/25||8||routeviews|tst.caida|W|"[{""asn"":555, ""value"":1}, {""asn"":555, ""value"":2}]"|1563580802
<IP_ADDRESS>/25||9||routeviews|tst.caida|W|"[{""asn"":555, ""value"":1}, {""asn"":555, ""value"":2}]"|1563580803
<IP_ADDRESS>/16|100|8|8 3 2 1 100|routeviews|tst.caida|A|"[{""asn"":555, ""value"":1}, {""asn"":555, ""value"":2}]"|1564358400
<IP_ADDRESS>/16|100|9|9 3 2 1 100|routeviews|tst.caida|A|"[{""asn"":555, ""value"":3}]"|1564358401
<IP_ADDRESS>/16||8||routeviews|tst.caida|W|"[{""asn"":555, ""value"":1}, {""asn"":555, ""value"":2}]"|1564358402
<IP_ADDRESS>/16||9||routeviews|tst.caida|W|"[{""asn"":555, ""value"":1}, {""asn"":555, ""value"":2}]"|1564358403

HISTORIC = false
The 1st /25 hijack does not come up at all.

HISTORIC = true
The 1st /25 hijack comes up correctly (withdrawn).


Cannot open file in restricted mode on ssh remote

On an ssh remote, code-insiders <file> and choose to open in restricted mode
Two new windows pop up 🐛
You hit the trust prompt again 🐛
Choose to open in restricted mode, a new window pops up instead of opening. Repeat.

Recording: https://memes.peet.io/img/21-09-33893714-9e28-463c-9024-41c47e08a6fe.mp4

I could not repro the 2 new windows, but overall the flow is quite broken.
Our initial calculation is not working because we check against file only I believe, so we don't initialize as untrusted.

This actually worked fine for me now


Adding the images to rpi-imager

Hey,
I saw today that the rpi-imager tool features other home automation images in their one-click installer like openHAB, maybe it is possible to add ioBroker to the repo.
Best regards,
Tim

Hi, the request is open for more than a year now. Feel free to support us here: https://github.com/raspberrypi/rpi-imager/issues/375
I posted a workaround here:
https://docs.buanet.de/iobroker-raspberrypios-image/docs/
Regards,
André

We will go for another try with upcoming rpi image version v2. I'll close this issue.


Wrong content type on request.head() only

Using request.head()  I want to get the content-type of a page before proceeding. Unfortunately for me, the request header content-type returns text/html. But if after completing the requests using request.get()
the content type is application/octet-stream.
I have suspected the web server but using urllib2 with a head request it return application/octet-stream
Here is my code and the exact url to reproduce the same error:
>>> import requests
>>> u = "http://holo-pack.com.tw/download.phpx?soft=ea70"
>>> r = requests.head(u)
>>> r.headers['content-type']
'text/html'

With request.get() the header is "application/octet-stream" so with urllib2 as seen here: pect https://filippo.io/send-a-head-request-in-python/

Please review the CONTRIBUTING file that GitHub prompted you to review prior to filing this bug.
You've not told us what version of requests you're using or how you've installed it.

So in spite of not having the information here, I noticed that the blog post registers a redirect handler. It looks like your head request gets redirected. As such you need to pass allow_redirects=True to a HEAD request to make sure you follow them too with requests. When you follow it all the way to the bottom you get the content-type you expect.


Update cassandra2-cql layer to use the new driver version.

Fixes #612.

Is this based off of the current master branch? It's getting a bunch of checkstyle errors that I didn't think were active yet for core.
Please update your commit message to start with the impacted module, ie "[cassandra2]"
Should we put this in a new Cassandra 3 module to ensure folks can compare Cassandra 2 to Cassandra 3?

Is this based off of the current master branch? It's getting a bunch of checkstyle errors that I didn't think were active yet for core.

It is based off the current master.

Please update your commit message to start with the impacted module, ie "[cassandra2]"

Done

Should we put this in a new Cassandra 3 module to ensure folks can compare Cassandra 2 to Cassandra 3?

I don't see why that would be necessary. The new driver is backwards compatible (see http://datastax.github.io/java-driver/#compatibility).

Sounds good. We'll need to figure out what going on with master before merging this.

@busbey - Travis runs mvn test which prints out all the checkstyle errors, but they do not halt execution and they are not the reason why Travis is failing.
It looks like there might be an incompatibility in the test class and it needs to be looked at.
-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running com.yahoo.ycsb.db.CassandraCQLClientTest
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 3.698 sec <<< FAILURE!
com.yahoo.ycsb.db.CassandraCQLClientTest  Time elapsed: 3.697 sec  <<< ERROR!
java.lang.NoSuchMethodError: com.datastax.driver.core.Cluster$Builder.addContactPoints(Ljava/lang/String;)Lcom/datastax/driver/core/Cluster$Builder;
	at org.cassandraunit.CassandraCQLUnit.load(CassandraCQLUnit.java:42)
	at org.cassandraunit.BaseCassandraUnit.before(BaseCassandraUnit.java:32)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:46)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141)
	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165)
	at org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85)
	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75)

Results :

Tests in error:
  com.yahoo.ycsb.db.CassandraCQLClientTest: com.datastax.driver.core.Cluster$Builder.addContactPoints(Ljava/lang/String;)Lcom/datastax/driver/core/Cluster$Builder;

Tests run: 1, Failures: 0, Errors: 1, Skipped: 0

Good catch! That's what I get for trying to read Travis-CI results on a phone.

I pulled down #614 and updated cassandra unit to <IP_ADDRESS> and that didn't fix the test errors. Same error with signature mismatch basically. Looks like cassandraunit isn't at 3.x yet so doesn't support the 3.x classes? I don't know if there is an easy way to fix this yet. Do we need to wait for cassandraunit to a release a 3.x?

Cassandra-unit has support for Cassandra 3 now. Unfortunately Cassandra 2.2+ requires Java 8 which presumably is causing the tests to fail since they work locally. Not sure what to do here.

For now, I think the best path is to

add a JUnit Assume that limits the Cassandra tests to only run them under JDK8+

expand our travis-ci profile to also test one jdk8 (probably Oracle)

verify wether or not a client using the Cassandra 3 driver to talk to a Cassandra 2.2+ server has to be using jdk8

based on the outcome of 3, update the README  to indicate that folks wanting to test against Cassandra 2.2+ need to run JDK8 (our jdk7 compiled release artifacts should still work fine).

Do we already have someone for tackling all of those 4 points? If not, I would take a look at it, because I'd like to get that PR merged sooner than later and use it for testing C* 3.0 with YCSB.

Do we already have someone for tackling all of those 4 points? If not, I would take a look at it, because I'd like to get that PR merged sooner than later and use it for testing C* 3.0 with YCSB.

@nastra If you are willing to help then go for it. Only number 1 on the list requires modifying this PR. Items 2-4 would be separate PRs it looks like.
@uluyol Can you update the PR to address @busbey's first item about only running the Cassandra 3 test under JDK8+?

I'm not sure how to fix this, it looks like just loading the test causes issues. I don't have much time to work on this so @nastra or whoever else can feel free to take this over.

thanks for the work so far @uluyol!

I put up #669 to get around the jdk7 incompatibility.

Number 1 is taken care of now. @nastra could you take a look at handling numbers 2-4?

@busbey and @nastra I'm going to open new issues for numbers 2-4 and linked them to this. That would allow better tracking.


USD to SDF: Added visuals

🎉 New feature
Summary
Added visuals with materials
Checklist

[ ] Signed all commits for DCO
[ ] Added tests
[ ] Added example and/or tutorial
[ ] Updated documentation (as needed)
[ ] Updated migration guide (as needed)
[ ] codecheck passed (See contributing)
[ ] All tests passed (See test coverage)
[ ] While waiting for a review on your PR, please help review another open pull request to support the maintainers

Note to maintainers: Remember to use Squash-Merge and edit the commit message to match the pull request summary while retaining Signed-off-by messages.

Codecov Report

Merging #897 (47474d8) into ahcorde/usd_to_sdf_links (d62eaba) will decrease coverage by 0.85%.
The diff coverage is 33.46%.

@@                     Coverage Diff                      @@
##           ahcorde/usd_to_sdf_links     #897      +/-   ##
============================================================
- Coverage                     87.70%   86.84%   -0.86%
============================================================
  Files                           105      106       +1
  Lines                         15129    15372     +243
============================================================
+ Hits                          13269    13350      +81
- Misses                         1860     2022     +162

Impacted Files
Coverage Δ

usd/src/usd_parser/USDMaterial.cc
59.44% <ø> (ø)

usd/src/usd_parser/polygon_helper.cc
0.00% <0.00%> (ø)

usd/src/usd_parser/USDLinks.cc
47.88% <34.97%> (-47.20%)
:arrow_down:

usd/src/usd_parser/USDWorld.cc
83.92% <57.14%> (-1.12%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d62eaba...47474d8. Read the comment docs.


performous: 1.3.0 -> 1.3.1

Description of changes
https://github.com/performous/performous/releases/tag/1.3.1
Things done

Built on platform(s)

[ ] x86_64-linux
[x] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Result of nixpkgs-review pr 289927 run on aarch64-linux 1

1 package built:

performous


Weird numerical instability controlled by axis increment

Describe the bug
See attached, possibly related to #1441
Code:
It's in the screen shot, although I'll put the whole code here (the only difference is the axis label step)
class GraphExample(Scene):
    def construct(self):
        #axes = Axes((-10, 10, 5),(-10, 50, 10))
        axes = Axes((-3, 3, 5),(-1000, 10, 100))
        axes.add_coordinate_labels()
        self.play(Write(axes, lag_ratio=0.01, run_time=1))
        first_graph = lambda x: 2**x
        first_label = "2^{x}"
        graph1 = axes.get_graph(first_graph, color=BLUE)
        label1 = axes.get_graph_label(graph1, first_label)
        self.play(ShowCreation(graph1),FadeIn(label1, RIGHT))
        self.wait(3)
        graphs_and_labels = [
                             #(lambda x: (1/2)**x, "(\\frac{1}{2})^{x}"),
                             #(lambda x: (2**((-3*x)+1))-3, "2^{-3x+1}-3"),
                             #(lambda x: ((1/2)**((x/2)-4))-1, "(\\frac{1}{2})^{(\\frac{x}{2})-4}-1"),
                             #(lambda x: (-2**(2*x))+(19/93), "(-2^{2x})+\\frac{19}{3}"),
                             #(lambda x: (2**(x/4))-3, "2^{(\\frac{x}{4})}-3"),
                             (lambda x: -((1/2)**(-4*x)), "-(\\frac{1}{2})^{-4x}")
                             ]
        for graph, label in graphs_and_labels:
            graph2 = axes.get_graph(graph,color=BLUE)
            label2 = axes.get_graph_label(graph2,label)
            self.play(ReplacementTransform(graph1, graph2),FadeTransform(label1, label2))
            self.wait(3)
            graph1 = graph2
            label1 = label2

Wrong display or Error traceback:
n/a
Additional context
n/a

Ummmm. There's something really weird going on here. I worked up my code a little to generalize the axis display (see below). It replicates the "bug", as expected, but if I include BOTH the "buggy" and "correct" versions, the "bug" does NOT occur. However, if you watch it do the plot, you can see that it's running through the "buggy" version to end up at the correct graph, so it looks like the issue here is some sort of incomplete computation????
class GraphExample(Scene):
    def construct(self):
        first_axes = Axes((-10, 10, 5),(-10, 50, 10))
        first_axes.add_coordinate_labels()
	self.play(Write(first_axes, lag_ratio=0.01, run_time=1))
        first_graph = lambda x: 2**x
        first_label = "2^{x}"
        graph1 = first_axes.get_graph(first_graph, color=BLUE)
        label1 = first_axes.get_graph_label(graph1, first_label)
        self.play(ShowCreation(graph1),FadeIn(label1, RIGHT))
        self.wait(3)
        old_axes = first_axes
        more_graphs = [
            #(lambda x: (1/2)**x, "(\\frac{1}{2})^{x}"),
            #(lambda x: (2**((-3*x)+1))-3, "2^{-3x+1}-3"),
            #(lambda x: ((1/2)**((x/2)-4))-1, "(\\frac{1}{2})^{(\\frac{x}{2})-4}-1"),
            #(lambda x: (-2**(2*x))+(19/93), "(-2^{2x})+\\frac{19}{3}"),
            #(lambda x: (2**(x/4))-3, "2^{(\\frac{x}{4})}-3"),
            (lambda x: -((1/2)**(-4*x)), "-(\\frac{1}{2})^{-4x}", Axes((-3, 3, 5),(-1000, 10, 100))),
            # Taking the following line in/out (and adjusting the comma above as needed) replicates the reported behavior
            (lambda x: -((1/2)**(-4*x)), "-(\\frac{1}{2})^{-4x}", Axes((-3, 3, 1),(-1000, 10, 100)))
            ]
        for graph, label, new_axes in more_graphs:
            new_axes.add_coordinate_labels()
            self.play(FadeTransform(old_axes, new_axes))
            graph2 = new_axes.get_graph(graph,color=BLUE)
            label2 = new_axes.get_graph_label(graph2,label)
            self.play(ReplacementTransform(graph1, graph2),FadeTransform(label1, label2))
            self.wait(3)
            graph1 = graph2
            label1 = label2
            old_axes=new_axes


MultiAdmin does not work

MultiAdmin does not work. Installed correctly

Not enough information, please describe the problem and add logs, screenshots, etc.


typst doesn't support regex features supported by sublime-syntax files

Description
When using raw to get syntax highlighting. I noticed that typst doesn't support regex named backrefrerences.
https://github.com/sharkdp/bat/blob/master/assets/syntaxes/02_Extra/Assembly (ARM).sublime-syntax
fails to produce any highlighting.
this feature may need support from https://docs.rs/fancy-regex/latest/fancy_regex/
to support compatibility.
Reproduction URL
No response
Operating system
Windows
Typst version

[X] I am using the latest version of Typst

I'm a rust novice but it looks to me like the syntax highlighting is based off of the syntect library.
its possible a simple addition in the project includes might fix this.
e.g.,
syntect = { version = "4.2", default-features = false, features = ["default-fancy"]}

Just noticed that the \g syntax seems a little in the air:
https://github.com/trishume/syntect/issues/287#issuecomment-620419854

It looks as the fancy-regex has a compatibility method called Expander for these types of things.
https://github.com/fancy-regex/fancy-regex/blob/main/src/expand.rs
I'm not sure why syntect isn't taking advantage of it.
https://github.com/fancy-regex/fancy-regex/blob/main/src/expand.rs

It looks as though the workaround might work:
eg
        (?x)
        ^\s*\#\s*(define)\s+             # define
        ((?<id>[a-zA-Z_][a-zA-Z0-9_]*))  # macro name
        (?:                              # and optionally:
            (\()                         # an open parenthesis
                (
                    \s* \g<id> \s*       # first argument
                    ((,) \s* \g<id> \s*)*  # additional arguments
                    (?:\.\.\.)?          # varargs ellipsis?
                )
            (\))                         # a close parenthesis
        )?

to
        (?x)
        ^\s*\#\s*(define)\s+             # define
        ((?<id>[a-zA-Z_][a-zA-Z0-9_]*))  # macro name
        (?:                              # and optionally:
            (\()                         # an open parenthesis
                (
                    \s* ({{id}}) \s*       # first argument
                    ((,) \s* ({{id}}) \s*)*  # additional arguments
                    (?:\.\.\.)?          # varargs ellipsis?
                )
            (\))                         # a close parenthesis
        )?

I also noticed that the names need to be one word so:
name: ARM Assembly
needed to be reduced to
name: ARM
in order to use:
Hello world
#set raw(syntaxes: "ARM.sublime-syntax")

```ARM
ldr R0, SP ;Load stuff
add R0, R1

        MACRO
$label  TestAndBranch  $dest, $reg, $cc
$label  CMP     $reg, #0
        B$cc    $dest
        MEND

```

Which gives some minimal highlighting

I noticed a similar problem when trying to use https://github.com/ViktorQvarfordt/Sublime-WolframLanguage/blob/master/WolframLanguage.sublime-syntax. The typst compile doesn't like \g in this regex:
(?x)
{{identifier}}
(?=
\s*
(
[(?![)
(?>
[^[]]+|
\g<-1>
)*
]
)
\s*(?:/;.)?\s:=
)


Direct upload to youtube

Hi I can't find any example of "Direct upload" to youtube in the examples.
According to the google documentation here
developers.google.com/youtube/2.0/developers_guide_php#Direct_Upload
In that link, there is a method to "direct upload" but in the example they use zend instead of this php client code.
Is it possible to add an example of direct upload to youtube?
We want to direct upload from our server to youtube.
thanks!

Can I get solution for this problem?
http://stackoverflow.com/questions/36958669/upload-video-to-youtube-with-one-single-button-using-javascript

@NeoCsatornaja This repository is for PHP, so it is not relevant to your SO question.