Solve "globals" installation (vs using a module system)

How do modules declare themselves as global and what parts they expose globally? Maybe we should add a "globals" field for typings.json that says what is declared and where it comes from. It would then install as usual, but the final step would be to declare the globals. A "hack/feature" that would work is to write a separate ambient bundle with the "external module" typings as a dependency - then just re-export parts. That hack depends on #1 being solved.
Edit: For anyone landing on this, for now, it's easily solved by installing as an "ambient dependency" that re-exports a normal dependency. This can and will be automated in the future, likely with a map of some kind in typings.json.

I can't seem to find my thoughts written down on this, but each module could have an "environments" or "ambient" section that allows installation of globals on demand. E.g. in typings.json:
{
  "name": "chai",
  "main": "chai.d.ts",
  "globals": {
    "should": "should.d.ts"
  }
}

What's the syntax for using the global though? Assume the module was already installed or referenced as normal. E.g. it's a key in dependencies already.

I think it must be a reference to a file or an array of references to the file. Any module can expand the global environment, eg "jquery" defines "jQuery" and $ globals. If we write a plug-in for "jquery" we indicate as a dependency "jquery", which provides the necessary global variables. Problems shouldn't arise.

Another place where this shows up is Cordova/PhoneGap plugins, most of which extend window or navigator with a global.

I think those should be easy enough, just document that those are always "global" and should be installed with --ambient. The issue is more about combined modes where there's a global augmentation by the module, alongside the nature import. I'm probably missing something about the Cordova situation though.


Upfate fft

The main modification is the addition of a submodule to decom_2d_fft dedicated to the log

This PR is ready for review. I have a sketch allowing in-place r2c and c2r transforms for both fftw3 backends (probably valid for oneMKL as well). I will use a dedicated PR to describe it.


chore: git workflow update macos to macos-latest no other changes

Description
This PR updates the github workflow from macos-12 (deprecated) to macos-latest
Only affects preview-deployments.yml and release-CI.yml
Summary
This PR does....

PR Checklist
Please ensure that:

[ ] The PR contains a descriptive title
[ ] The PR contains a descriptive summary of the changes
[ ] You build and test your changes before submitting a PR.
[ ] You have added relevant documentation
[ ] You have added relevant tests. We prefer integration tests wherever possible

Pre-Commit Instructions:

[ ] Ensure that you have run the pre-commit hooks on your PR.

Hey @dave42w 👋
Could you have a look at this? The CI is failing. :// I have suppressed clippy for a while.

@dave42w , I am not certain. But I'll give it a shot today.

closing this now.

https://github.com/sparckles/Robyn/pull/1088
updated to mac os 13 as macos-latest had some issues
Thanks thought @dave42w 😄


Why there are two separate embeddings from and to target vocabluary?

Currently, seq2seq with attention model has 3 separate embedding layers:

model/att_seq2seq/encode/source_embedding/W  (37007x512, 18.95m/18.95m params) - to map source language word to their representations
model/att_seq2seq/decode/target_embedding/W (512x37007, 18.95m/18.95m params) - to map target language words to their representations
model/att_seq2seq/decode/attention_decoder/decoder/logits/weights (37007x512, 18.95m/18.95m params) - to effectively map representation to target language word while doing prediction. This is fed into softmax together with bias.

Note that while all 3 are optimized, (2) isn't even used during inference.
Can't we use constrain (3) to just be transpose of (2) tf.transpose(model/att_seq2seq/decode/target_embedding/W) ? That is, learn only one embedding matrix per source and target language. @dennybritz could you please comment on this model design choice?

I believe this is standard.

Is used during inference. You always need to embed the word predicted by the decoder.
I don't look at this as an "embedding", more as just a weight matrix that is used to calculate logits, scores for each word. It doesn't necessarily contain meaningful representations of words. Also, the fact that this is the same size as 1/2 is just arbitrary because all your layers use 512 units. It doesn't need to be the same size, and generally isn't.

Can't we use constrain (3) to just be transpose of (2)

I guess you could, but to me it seems like that would unnecessarily constrain the model. I haven't really seen that being done, but could be an interesting experiment.

You always need to embed the word predicted by the decoder.

Right, I missed that.

The fact that sizes of (1) and (2) match is just a coincidence. But it isn't obvious to me that sizes of (2) and (3) does not need to match. It seems to me that for translation they do need to match because they essentially act as one-way bridges between target language and decoder hidden states. Maybe they aren't necessarily the same for some other task?
Of course, if we constrain (3)=transpose(2) this will result in less free parameters. But such constraint looks natural to me. Anyway, hope I'll have time to try :)

But it isn't obvious to me that sizes of (2) and (3) does not need to match. It seems to me that for translation they do need to match because they essentially act as one-way bridges between target language and decoder hidden states. Maybe they aren't necessarily the same for some other task?

No, it's completely arbitrary. For example, you could just add another fully connected layer of size X after the last decoder state, then your matrix will be [X, vocab_size]. It will work just as well. Also, you could have different RNN layers be different sizes.

For example, you could just add another fully connected layer of size X after the last decoder state, then your matrix will be [X, vocab_size]

Then those "two" fully connected layers look like bridge to me from decoder hidden state to target vocab via softmax.  And if different RNN layers in decoder have different sizes then, yes, it will break the symmetry.
My main point is that for decoder, there seems to be a need for a bridge from target vocab to "hidden" representation space and then, after RNN, from hidden representation to target vocab via softmax (or few more layers). This suggest natural symmetry to me.
Anyway, thanks for your clarifications. An interesting experiment to try.

Can't we use constrain (3) to just be transpose of (2) ?
I haven't really seen that being done, but could be an interesting experiment.

In a paper that we recently presented, we showed that you can tie these matrices, and this improves performance in language modeling.

It doesn't necessarily contain meaningful representations of words.

We actually show in the paper that the softmax matrix contains representations of words that are better than the ones in the word embedding.
In addition we showed that in translation models, although this weight tying doesn't help performance wise, it reduces the model's size without harming its performance.
Lastly, if the source and target vocabularies are very similar (for example when using BPE), than all three of the matrices you mention can be tied (we call this Three Way Weight Tying), and this again massively lowers the amount of parameters while not hurting performance at all. It's already available in Nematus, and I'm sure it would also be useful in this repository.


Closes: #1

Updated validations.py python script.
Fixed the behavior of validate_user function in validations.py.
Fixes #1

It's a good idea to open an issue first for discussion.

[ ] Tests pass
[ ] Appropriate changes to README are included in PR

I fix the issue #1 , with changing the condition, to perform right.


HELP - Why my issue deleted? #80

Hi, @mobizt. Why is my issue being deleted, I received the email you commented on my issue but when I clicked on it, it shown that the issue was deleted.
I just want to refer to the advise/suggestion you have provided. Therefore, the conversation we had is really important. Hope you could undo the deleted issue. #80
thanks

Yes I delete because it's not library issue as I inform and this will delete too.
And hope you got my last reply in email and please follow it, your problem can solve now.

adcAttachPin(heartratePin);
how does this work tho? I kinda confused tho
do I type like this adcAttachPin(33);

Yes, you can and you should use 33 in the DFRobot sensor function too

ESP32 need to config ADC like this before use.

Hi, I play around with code again but this time it just keep showing "wait for valid data" at the serial monitor and sometimes print zero(very rare) but shows diff value at the database. I assume the sensor is not stable ?? is it right?
Thanks for all the help after all, really appreciated!


Use ollama's structured outputs feature

I'm looking into pydantic-ai with small and locally running ollama models as backbones.
I'm noticing that sometimes even for simple models it's possible to run into unexpected ValidationErrors.
Here's what I mean: With a pydantic model as simple as
class Answer(BaseModel):
    value: str = ""

I can see pytandic-ai sometimes retrying and failing in validation.
Having experience with llama.cpp's grammars this was unexpected to me. I was under the assumption that pydantic-ai would transform the pydantic model into a grammar or json schema to hard-restrict the llm's output accordingly. Then validation could never fail by design since the llm's output is restricted to the specific grammar.
Instead when I debug the request pydantic-ai sends to the locally running ollama with
nc -l -p 11434

I can see pydantic-ai turning the pydantic model into a tool use invocation.
With ollama v0.5.0 structured output via json schema is now supported:
https://github.com/ollama/ollama/releases/tag/v0.5.0
I was wondering if that would solve the issue of small locally running models sometimes running into validation errors, since we hard-restrict the output to the shape of our pydantic model.
Any thoughts on this, or ideas why validation can fail with tool usage as implemented right now? Any pointers in terms of for which model providers validation might fail and for what reason? Thanks!

I have looked into this a bit more and here is what is happening

The user specifies a return type for a pydantic-ai agent in form of a pydantic model
The pydantic model's jsonschema gets passed to the llm in form of a tool and its arguments
Because tool usage is optional the ollama models on the smaller side often never use the tool
pydantic-ai then fails validation and retries, and more often than not the 2nd try also doesn't use the tool

The underlying issue here is that tool usage is optional. This makes the pydantic-ai approach of validating and parsing types unreliable and non-deterministic.
There exists a tool_choice=required parameter in the OpenAI API but it's not supported in ollama as of today. From the ollama tool blog post:
> Future improvements [..] Tool choice: force a model to use a tool

I see the following ways forward

Change the documentation and make it clear that validation and parsing may or may not happen and that especially with smaller models it appears like it's often failing due to lack of tool usage. This undermines the main selling point of pydantic-ai
Look into and implement the structured output approach which, I believe, should make validation and parsing deterministic

Note: I have only looked at the ollama model as implemented in pydantic-ai. I do not know if other models are affected by this, too, or if their output is deterministically constrained.

Look into and implement the structured output approach which, I believe, should make validation and parsing deterministic

Is this part of the OpenAI API, or would we need a dedicated model for it?
Happy to consumer consider both, just trying to understand.

Looks like we should switch from the OpenAI compatibility API to using the Ollama python library.

As I was also facing several validation errors when working with Ollama, I have made an own implementation of the OllamaModel utilizing Ollama's new Structured Output feature. If you are interested in it, I can contribute it here.

@renkehohl do you mind sharing? I'm running into the same issue running local models it sometimes works but its random. I'm mostly testing with qwen models.

@gt732 here is the gist: https://gist.github.com/renkehohl/407cdcdd3bfc8d0baee3783782b31e3d
Usage is same as PydanticAI's OllamaModel:
from pydantic_ai import Agent
from typing import List
from ollama_model import OllamaModel

agent = Agent(
     model=OllamaModel(model_name="llama3.1"),
     result_type=List[str]
)

Please keep in mind, that I've not implemented stream responses yet.

I don't see Message,ModelAnyResponse, ModelStructuredResponse, ToolCall, or ModelTextResponse on pydantic_ai.messages at all. Nor do I see any of these types noted in the messages documentation. What am I missing to be able to replicate your gist @renkehohl?


Quiz exercises: Fix visual selection when multiple short answer question exists

Checklist
General

[x] This is a small issue that I tested locally and was confirmed by another developer on a test server.
[x] I chose a title conforming to the naming conventions for pull requests.

Client

[x] I added multiple screenshots/screencasts of my UI changes.

Motivation and Context

Adding spot through visual mode does not work if there are multiple short answer questions in 1 quiz exercise.
https://user-images.githubusercontent.com/10885503/209796414-f905d4d0-8adb-40c8-a406-44957787ae9d.mov
Description

The id of the short answer questions is the same for all questions. The element that is referenced by the id is used to determine which question is being selected when adding a spot through visual mode. Changing the id to use angular reference solves the issue.
Steps for Testing

Prerequisites:

1 Instructor
1 Course
1 Quiz Exercise with multiple short answer questions

Log in to Artemis
Navigate to Course Administration
Select the Course
Navigate to Exercises
Select the Exercise
Click Visual on the first short answer question
Highlight the word and click Add Spot. (Verify that it works)
Click Visual on the second short answer question
Highlight the word and click Add Spot. (Verify that it still works)

Review Progress

Code Review

[ ] Review 1
[ ] Review 2

Manual Tests

[x] Test 1
[x] Test 2

Test Coverage

Class/File
Branch
Line

short-answer-question-edit.component.ts
70.32%
93.81%

Screenshots

https://user-images.githubusercontent.com/10885503/209792501-392dee24-41a9-4526-89e4-24dbcdd55429.mov

Codecov Report

Merging #6007 (3e32605) into develop (9042648) will increase coverage by 4.14%.
The diff coverage is 100.00%.

Additional details and impacted files
@@              Coverage Diff              @@
##             develop    #6007      +/-   ##
=============================================
+ Coverage      75.76%   79.91%   +4.14%
- Complexity         0    12379   +12379
=============================================
  Files           1118     2124    +1006
  Lines          44457    84498   +40041
  Branches        8380    12677    +4297
=============================================
+ Hits           33684    67528   +33844
- Misses          5600     9437    +3837
- Partials        5173     7533    +2360

Impacted Files
Coverage Δ

...r-question/short-answer-question-edit.component.ts
86.01% <100.00%> (ø)

.../domain/plagiarism/text/TextSubmissionElement.java
87.09% <0.00%> (ø)

...www1/artemis/domain/OnlineCourseConfiguration.java
97.05% <0.00%> (ø)

...w1/artemis/service/exam/ExamSubmissionService.java
86.66% <0.00%> (ø)

...is/web/rest/dto/CourseManagementStatisticsDTO.java
100.00% <0.00%> (ø)

...va/de/tum/in/www1/artemis/domain/TempIdObject.java
83.33% <0.00%> (ø)

...www1/artemis/domain/enumeration/CategoryState.java
100.00% <0.00%> (ø)

...connectors/gitlab/GitLabUserManagementService.java
89.47% <0.00%> (ø)

.../java/de/tum/in/www1/artemis/domain/TextBlock.java
100.00% <0.00%> (ø)

...itory/hestia/ExerciseHintActivationRepository.java
100.00% <0.00%> (ø)

... and 997 more

Flag
Coverage Δ

client
75.76% <100.00%> (ø)

server
84.52% <ø> (?)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9042648...3e32605. Read the comment docs.

Visual selection is now possible with multiple short answer questions, tested on ts1.
This is not related to the PR but I couldn't really figure out how to delete a spot after it has been added. Is there an option to do that in visual mode?

Unfortunately, deleting spots can only be done in text mode when creating/editing a quiz exercise.

Visual selection is now possible with multiple short answer questions, tested on ts1.
This is not related to the PR but I couldn't really figure out how to delete a spot after it has been added. Is there an option to do that in visual mode?

Unfortunately, deleting spots can only be done in text mode when creating/editing a quiz exercise.

Ok, thanks for clarifying!


Ban Appeal

Hello,
So recently I was banned for stealing from a player, but I can justify why I did this.
A few days ago I met 2 people.  They had invited me to their town and I had joined. They made me an executive and told me I could take from peoples homes that quit/they had permission to take from. They told me a specific home was one I could take from, So I did take from this home thinking that they had full permission from the owner, who they had claimed quit. To my surprise the person who lived there had not quit. I had apologized and explained to the owner, and he was understanding and just wanted his stuff back. I paid a moderator the money so I would not use it furthermore, and I proceeded to get banned for 5 days.
As much as I did technically break a rule, it was only because of the fact the owner of this town gave me full permission to, and Lied to me about the whole situation. I am very sorry for my actions, and will make sure in the future that before even thinking about looking in someone's home I am allowed to be there and take from there from the owner of the home themselves.
Again, I sincerely apologize for my actions and something like this will never happen again on my behalf.
Thank you so much for your time reading this!
Discord: ThyRedWolf#4456
IGN: ThyRedWolf
Have a great day!

I am very sorry I didn't respond in time. Your ban was a 5 day tempban, and you have explained and sounded very genuinely in your appeal, so had I of responded earlier I would've said to wait out the 5 days. Again I apologise for my belatedness. Closing this now since your tempban has expired.


on copy and paste application is broken

on copy and paste application is broken

Logs

comercial08:digitalConsig newuser$ flutter analyze
Analyzing digitalConsig...
info • The value of the field '_allowWriteFile' isn't used • lib/contracheques.dart:41:8 • unused_field
info • The value of the local variable 'permissions' isn't used • lib/contracheques.dart:54:44 • unused_local_variable
info • Don't explicitly initialize variables to null • lib/contracheques.dart:145:13 • avoid_init_to_null
info • Don't explicitly initialize variables to null • lib/contracheques.dart:230:13 • avoid_init_to_null
info • 'child' is deprecated and shouldn't be used • lib/contracheques.dart:273:9 • deprecated_member_use
info • Set literals were not supported until version 2.2, but this code is required to be able to run on earlier versions • lib/contracheques.dart:420:42 •
sdk_version_set_literal
info • Set literals were not supported until version 2.2, but this code is required to be able to run on earlier versions • lib/contracheques.dart:456:36 •
sdk_version_set_literal
info • Set literals were not supported until version 2.2, but this code is required to be able to run on earlier versions • lib/contracheques.dart:480:36 •
sdk_version_set_literal
info • Don't explicitly initialize variables to null • lib/contracheques.dart:599:13 • avoid_init_to_null
info • The value of the local variable 'path' isn't used • lib/contracheques.dart:649:15 • unused_local_variable
info • Unused import: 'dart:io' • lib/data/rest_ds.dart:2:8 • unused_import
info • Unused import: 'package:http/http.dart' • lib/data/rest_ds.dart:9:8 • unused_import
info • Unused import: 'package:flutter/services.dart' • lib/pdfScreen.dart:11:8 • unused_import
info • Unused import: 'package:path_provider/path_provider.dart' • lib/pdfScreen.dart:12:8 • unused_import
info • The value of the field '_allowWriteFile' isn't used • lib/pdfScreen.dart:27:8 • unused_field
info • The value of the local variable 'uri' isn't used • lib/pdfScreen.dart:94:25 • unused_local_variable
info • Set literals were not supported until version 2.2, but this code is required to be able to run on earlier versions • lib/rendimentos.dart:269:42 • sdk_version_set_literal
info • Set literals were not supported until version 2.2, but this code is required to be able to run on earlier versions • lib/rendimentos.dart:303:36 • sdk_version_set_literal
info • Set literals were not supported until version 2.2, but this code is required to be able to run on earlier versions • lib/rendimentos.dart:326:36 • sdk_version_set_literal
info • The value of the local variable 'width' isn't used • lib/telaAlterarSenha.dart:111:9 • unused_local_variable
info • The value of the local variable 'media' isn't used • lib/telaInicial.dart:187:9 • unused_local_variable
info • The value of the local variable 'padding' isn't used • lib/telaInicial.dart:190:9 • unused_local_variable
info • The value of the local variable 'marginLogo' isn't used • lib/telaInicial.dart:195:14 • unused_local_variable
info • The value of the local variable 'widthImg' isn't used • lib/telaInicial.dart:429:9 • unused_local_variable
info • The value of the local variable 'media' isn't used • lib/telaLogin.dart:221:9 • unused_local_variable
info • The value of the local variable 'marginLogo' isn't used • lib/telaLogin.dart:228:14 • unused_local_variable
info • The value of the local variable 'width' isn't used • lib/telaPrimeiroAcesso.dart:153:9 • unused_local_variable
info • Unused import: 'package:digitalConsig/ui/widgets/controls/design/styles.dart' • lib/ui/widgets/controls/masterPage.dart:1:8 • unused_import
info • Name non-constant identifiers using lowerCamelCase • lib/ui/widgets/controls/masterPage.dart:21:12 • non_constant_identifier_names
info • This class (or a class which this class inherits from) is marked as '@immutable', but one or more of its instance fields are not final: DataTableHorizontal.camposFixos •
lib/utils/dataTableHorizontal.dart:13:7 • must_be_immutable
30 issues found. (ran in 25.8s)

[✓] Flutter (Channel stable, v1.5.4-hotfix.3-pre.1, on Mac OS X 10.14.4 18E226, locale pt-BR)
• Flutter version 1.5.4-hotfix.3-pre.1 at /Users/newuser/development/flutter
• Framework revision e05a97b8a7 (6 hours ago), 2019-05-30 12:04:45 -0300
• Engine revision 52c7a1e849
• Dart version 2.3.0 (build 2.3.0-dev.0.5 a1668566e5)
[!] Android toolchain - develop for Android devices (Android SDK version 28.0.3)
• Android SDK at /Users/newuser/Library/Android/sdk
• Android NDK location not configured (optional; useful for native profiling support)
• Platform android-28, build-tools 28.0.3
• Java binary at: /Library/Java/JavaVirtualMachines/jdk-11.0.2.jdk/Contents/Home/bin/java
• Java version Java(TM) SE Runtime Environment 18.9 (build 11.0.2+9-LTS)
✗ Android license status unknown.
Try re-installing or updating your Android SDK Manager.
See https://developer.android.com/studio/#downloads or visit https://flutter.dev/setup/#android-setup for detailed instructions.
[✓] iOS toolchain - develop for iOS devices (Xcode 10.2.1)
• Xcode at /Applications/Xcode.app/Contents/Developer
• Xcode 10.2.1, Build version 10E1001
• ios-deploy 1.9.4
• CocoaPods version 1.7.0
[!] Android Studio (not installed)
• Android Studio not found; download from https://developer.android.com/studio/index.html
(or visit https://flutter.dev/setup/#android-setup for detailed instructions).
[✓] Connected device (1 available)
• iPhone 5s • 71148BDB-6785-4D2D-A18C-665089E8D770 • ios • com.apple.CoreSimulator.SimRuntime.iOS-12-2 (simulator)
! Doctor found issues in 2 categories.

It's hard to tell exactly what's going wrong without a test case. On the face of it, the app appears to be failing to find a localization for "pasteButtonLabel"; maybe the app's supported locales aren't set up properly  https://flutter.dev/docs/development/accessibility-and-localization/internationalization
If you can provide a small complete app that demonstrates the problem, we'll look into it.

the location is for Locale ('pt', 'BR')

This solution worked for me:
https://stackoverflow.com/questions/53662917/how-to-change-cupertinodatepicker-display-language/53752290

The problem happens specifically in the ios project

Hi @lucasmatoscc
Are you still experiencing this issue with latest stable?
If yes, can you please provide your flutter doctor -v and flutter run --verbose?
Also, to better address the issue, would be helpful if you could post a minimal code sample to reproduce the problem
Thank you

Without additional information we are unfortunately not sure how to resolve this issue.
We are therefore reluctantly going to close this bug for now.
Please don't hesitate to comment on the bug if you have any more information for us; we will reopen it right away!
Thanks for your contribution.


than a wrong of [id].js file!

run this demo(blog) , happen a  error of date.js:Server error,rangerERROR:Invalid time value
tip format() fucntion  (No.6 line)
it  not date error , that function post(postData) of [id].js file  sent a undifine(null) data var!
wrong is [id].js  getStaticProps() function:
return{
props:{                                 //{} is Multiple packing
postData
}
}
solution is:
1.delete {} of "postData",right is :
return{
props:postData
}
2. modify   var of  "postData" object  in  Post function:
postData.title   ==>   postData.postData.title
postData.date  ==>   postData.postData.date    //not   "Invalid  time  value " error
postData.contentHtml  ==>  postData.postData.contentHtml
demo is nice !!

I tried to reproduce the issue you described above, but the current code in the demo folder runs and builds locally just fine. If you're still having issue, can you please try and create a pull request with the changes you think are needed?


Exposing more boto3 client options to ChatBedrock and doc example?

With the addition of the opus model support on Bedrock, which generally tends to always hit the default timeout options, would it be okay to add the different retry/timeout options from boto3 as common options to ChatBedrock?
Currently we have support for a few common keys here: https://github.com/langchain-ai/langchain-aws/blob/main/libs/aws/langchain_aws/llms/bedrock.py#L300.
However just changing from Claude 2/2.1 or Claude 3 Sonnet to Opus increases the runtime mostly by 10x (mine are consistently around 20-35 seconds on old models to 200+ seconds with Opus)..
UPDATE:
Later it also turns out many of the timeouts reported by boto3 was actually general throttling (as seen in bedrock logs), however there was no logs or errors indicating any throttling happening, just reported as a timeout.
Changing the timeout settings + upping the max_attempts was necessary to even get it to retry properly it seems.
I would assume that once more people start using this new library, and depending on the popularity of Opus, a few changes are recommended:

Adding a higher default timeout, to prevent common issues to appear.
Adding more boto3 client options available as arguments to ChatBedrock/BedrockBase, so that developers can instantly see them as a supported list of arguments when developing using this chat model.
A small documentation example that links to the available boto3 options that would work with Bedrock, and a small example on how to create a custom Botocore.config.Config() object that can be passed to the existing config argument would be greatly appreciated. I did get it working through trial and error, but only from boto3 examples directly and not from langchain issues or docs.

@P1llus
All great ideas, there is plan to abstract out the client creation to a separate module with more options. Note that users can create their own client and pass in to the Bedrock classes, which supports all options available with boto3. Defaulting to a higher timeout might make sense for Opus, but not applicable universally. If there is a config that you have worked out which can work universally, open a PR with that change, and we can review it.
Agree that we need more examples and documentation, we welcome contributions from the community, and let us know if you need any help with this.

@3coins Ah yeah that is true about the defaults, might be a bit overkill to change it like that.
I think something in-between would be if its possible for us to detect the underlying issue with some sort of logging.
As mentioned above, the only message received from Chat bedrock is that there was a timeout.
However it was actually hitting a throttle and 504's with a backoff.
There was no indication on that from the client perspective, and only the logs from the bedrock service itself would highlight it.
I am unsure if this is how boto3 logs it as well or if its the ChatBedrock class that don't surface information like that?

Yes, totally makes sense, exception handling is not the best at the moment and we can improve that. I have to check if there is a separate exception thrown by the API that we can surface here.


MAPREDUCE-7376. AggregateWordCount fetches wrong results.

Description of PR
Fixes AggregateWordCount
How was this patch tested?
hadoop-3.4.0-SNAPSHOT % bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-3.4.0-SNAPSHOT.jar  aggregatewordcount /testData /testOut 1 textinputformat

hadoop-3.4.0-SNAPSHOT % bin/hdfs dfs -cat /testOut/part-r-00000
Bye	1
Goodbye	1
Hadoop	2
Hello	2
World	2

/testData had two files:
wc01.txt:
Hello World Bye World
wc02.txt:
Hello Hadoop Goodbye Hadoop
For code changes:

[x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 52s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

-1 :x:
test4tests
0m  0s

The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
43m 32s

trunk passed

+1 :green_heart:
compile
0m 54s

trunk passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
compile
0m 50s

trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
checkstyle
0m 52s

trunk passed

+1 :green_heart:
mvnsite
0m 57s

trunk passed

+1 :green_heart:
javadoc
0m 44s

trunk passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
0m 34s

trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
spotbugs
1m 52s

trunk passed

+1 :green_heart:
shadedclient
24m 19s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 41s

the patch passed

+1 :green_heart:
compile
0m 51s

the patch passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javac
0m 51s

the patch passed

+1 :green_heart:
compile
0m 42s

the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
javac
0m 42s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
0m 33s

the patch passed

+1 :green_heart:
mvnsite
0m 50s

the patch passed

+1 :green_heart:
javadoc
0m 25s

the patch passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
0m 24s

the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
spotbugs
1m 47s

the patch passed

+1 :green_heart:
shadedclient
24m 45s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
6m 46s

hadoop-mapreduce-client-core in the patch passed.

+1 :green_heart:
asflicense
0m 44s

The patch does not generate ASF License warnings.

113m 45s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4257/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/4257

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell

uname
Linux b591acbe67cf 4.15.0-175-generic #184-Ubuntu SMP Thu Mar 24 17:48:36 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 4a3ec5965d23831c5539a0bfda1753607846457b

Default Java
Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS> /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4257/1/testReport/

Max. process+thread count
894 (vs. ulimit of 5500)

modules
C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core U: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4257/1/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 58s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
15m 41s

Maven dependency ordering for branch

-1 :x:
mvninstall
28m 52s
/branch-mvninstall-root.txt
root in trunk failed.

+1 :green_heart:
compile
3m 16s

trunk passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
compile
2m 39s

trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
checkstyle
1m 15s

trunk passed

+1 :green_heart:
mvnsite
1m 39s

trunk passed

+1 :green_heart:
javadoc
1m 21s

trunk passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
1m 11s

trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
spotbugs
2m 40s

trunk passed

+1 :green_heart:
shadedclient
23m 23s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 26s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m  4s

the patch passed

+1 :green_heart:
compile
2m 48s

the patch passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javac
2m 48s

the patch passed

+1 :green_heart:
compile
2m 21s

the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
javac
2m 22s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
1m  2s
/results-checkstyle-hadoop-mapreduce-project.txt
hadoop-mapreduce-project: The patch generated 1 new + 9 unchanged - 0 fixed = 10 total (was 9)

+1 :green_heart:
mvnsite
1m 13s

the patch passed

+1 :green_heart:
javadoc
0m 50s

the patch passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
0m 48s

the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
spotbugs
2m 26s

the patch passed

+1 :green_heart:
shadedclient
23m 11s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
6m 22s

hadoop-mapreduce-client-core in the patch passed.

+1 :green_heart:
unit
0m 52s

hadoop-mapreduce-examples in the patch passed.

+1 :green_heart:
asflicense
0m 42s

The patch does not generate ASF License warnings.

129m  2s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4257/2/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/4257

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell

uname
Linux ab49bff137fa 4.15.0-175-generic #184-Ubuntu SMP Thu Mar 24 17:48:36 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 8707ebc259abf74e5928f847051b966562cafc33

Default Java
Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS> /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4257/2/testReport/

Max. process+thread count
1102 (vs. ulimit of 5500)

modules
C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-examples U: hadoop-mapreduce-project

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4257/2/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 50s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
15m 46s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
28m 18s

trunk passed

+1 :green_heart:
compile
3m  1s

trunk passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
compile
2m 32s

trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
checkstyle
1m 18s

trunk passed

+1 :green_heart:
mvnsite
1m 35s

trunk passed

+1 :green_heart:
javadoc
1m 21s

trunk passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
1m 10s

trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
spotbugs
2m 41s

trunk passed

+1 :green_heart:
shadedclient
23m  3s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 26s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m  4s

the patch passed

+1 :green_heart:
compile
2m 48s

the patch passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javac
2m 48s

the patch passed

+1 :green_heart:
compile
2m 20s

the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
javac
2m 20s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
1m  2s

the patch passed

+1 :green_heart:
mvnsite
1m 11s

the patch passed

+1 :green_heart:
javadoc
0m 49s

the patch passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
0m 47s

the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
spotbugs
2m 28s

the patch passed

+1 :green_heart:
shadedclient
25m 19s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
7m 12s

hadoop-mapreduce-client-core in the patch passed.

+1 :green_heart:
unit
1m  2s

hadoop-mapreduce-examples in the patch passed.

+1 :green_heart:
asflicense
0m 41s

The patch does not generate ASF License warnings.

130m 39s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4257/3/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/4257

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell

uname
Linux 6d5c1dac71e1 4.15.0-175-generic #184-Ubuntu SMP Thu Mar 24 17:48:36 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 79e21fdae925377c020fc5afcb8079fdb08d94bc

Default Java
Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS> /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4257/3/testReport/

Max. process+thread count
1074 (vs. ulimit of 5500)

modules
C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-examples U: hadoop-mapreduce-project

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4257/3/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

Thanx @steveloughran for the review!!!

, rather than blocking system.exit. and if our code is calling system.exit, that's a bug

It was indeed calling System.exit(). I changed it to use ExitUtil.terminate.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 52s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
14m 33s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
28m  9s

trunk passed

+1 :green_heart:
compile
3m  3s

trunk passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
compile
2m 31s

trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
checkstyle
1m 18s

trunk passed

+1 :green_heart:
mvnsite
1m 37s

trunk passed

+1 :green_heart:
javadoc
1m 20s

trunk passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
1m  7s

trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
spotbugs
2m 40s

trunk passed

+1 :green_heart:
shadedclient
23m  1s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 26s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m  4s

the patch passed

+1 :green_heart:
compile
2m 51s

the patch passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javac
2m 51s

the patch passed

+1 :green_heart:
compile
2m 22s

the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
javac
2m 22s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
1m  1s

the patch passed

+1 :green_heart:
mvnsite
1m 11s

the patch passed

+1 :green_heart:
javadoc
0m 50s

the patch passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
0m 48s

the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
spotbugs
2m 27s

the patch passed

+1 :green_heart:
shadedclient
22m 39s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
6m 23s

hadoop-mapreduce-client-core in the patch passed.

+1 :green_heart:
unit
0m 52s

hadoop-mapreduce-examples in the patch passed.

+1 :green_heart:
asflicense
0m 42s

The patch does not generate ASF License warnings.

125m 37s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4257/4/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/4257

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell

uname
Linux 210c9df58981 4.15.0-175-generic #184-Ubuntu SMP Thu Mar 24 17:48:36 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / ab2ab3d986deeaac9c00c4c378dbed9b1b8f4f32

Default Java
Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS> /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4257/4/testReport/

Max. process+thread count
1105 (vs. ulimit of 5500)

modules
C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-examples U: hadoop-mapreduce-project

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4257/4/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.


Beginning Extractor

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

[X] I understand that I will be blocked if I remove or skip any mandatory* field

Checklist

[X] I'm asking a question and not reporting a bug or requesting a feature
[X] I've looked through the README
[X] I've verified that I'm running yt-dlp version 2022.09.01 (update instructions) or later (specify commit)
[X] I've searched the bugtracker for similar questions including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue

Please make sure the question is worded well enough to be understood
I have a simple HTML page with m3u8 link to download that I can extract with a RegEx.
I read the extractor tutorial, but it is very complicated.
Do it have a more simple template to adapt to my case to try to implement?
Provide verbose output that clearly demonstrates the problem

[ ] Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
[ ] Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output
No response

Not really, no. Each site is very different that the only common boilerplate is the template given in Contributing.md. You can find an existing extractor that is similar to the one you are trying to add use that as a starting point.

Where i find a estractor list to see?
I simple have to:
Load url
parse a RegEx
Download m3u8 result

https://github.com/yt-dlp/yt-dlp/blob/master/yt_dlp/extractor

I'm tryng to test extractor in localhost to avoid band consume:
yt-dlp.exe --test -F http:/localhost:8080/test/Test.html
but i get:
ERROR: [generic] Unable to download webpage:  (caused by URLError('no host given'))
Why?
the url work in browser.


Cloudformation template  and CDK to deploy cloudfront function

When will it possible to use cloudformation and/or CDK to deploy cloudfront function ?

Great work on CloudFront Functions! I've successfully deployed a CF Function with CloudFormation like this:
AddHTMLPostfixFunction:
    Type: AWS::CloudFront::Function
    Properties:
      Name: !Sub "${ApplicationName}-add-html-postfix"
      AutoPublish: true
      FunctionCode: |
        function handler(event) {
          const hasExtension = /(.+)\.[a-zA-Z0-9]{2,5}$/
          const request = event.request
          const uri = request.uri

          // If the request does not have any extension, add '.html'
          if (uri && !uri.match(hasExtension)) {
            request.uri = `${uri}.html`
          }

          return request
        }
      FunctionConfig:
        Comment: "Adds .html postfix to viewer requests"
        Runtime: cloudfront-js-1.0

I did not find any documentation about how to set the FunctionCode property, but using inline code worked. It should have been support to point to a JS-file-path, like CodeUri and Handler or something like that


Serial read/write - 750ms delay necessary?

Somewhat an out-of-scope issue here, so I apologize if this is the wrong place for this, but I extended avrgirl-arduino to be able to send a message and wait for data back over serial, and it works beautifully. I hijack the automatic port finder and board validation to have a serialport instance ready to go before I send a message. Currently, I flashed one of our testing Arduino boards with an echo-echo Sketch, where it just spits back the data it reads over serial.
That said, I see an odd behaviour: I use a serialPort.on('data', function to wait for communications from the Arduino, but I have to wait approximately 750ms (minimum) after opening a connection before I can send a String over serial, and I can't do anything immediately after or the data coming back will be garbled.
Is this something you've noticed at all? Happy to provide code if you're interested in what I'm having it do, and I know it's outside of scope, just wondering if this is any behaviour you've seen before.
Thanks!

oh! This is really neat! Are you using the Mega still for this? If not, which board? I'm using three different protocols under the hood, so I'd need to start with the correct one to answer your questions in depth :smile:

@noopkat Still using the mega, and I'll post my code so you can see just what nonsense I'm getting up to.
Avrgirl.prototype.sendMessage = function(data, callback) {
  var _this = this;

  // validate board properties first
  _this._validateBoard(function(error) {
    if (error) { return callback(error); }

    // set up serialport connection
    _this.connection._init(function(error) {
      if (error) { return callback(error); }

      _this.connection.serialPort.open(function (error) {
        if ( error ) {
          console.log('failed to open: '+error);
        } else {
          console.log('open');

          _this.connection.serialPort.on('data', function(data) {
            console.log('data received: ' + data);
          });

          // Wait 750ms and then send data, in order to get an echo back
          setTimeout(function() { _this.connection.serialPort.write(data); }, 750);

        }
      });

    });
  });

};

Essentially a carbon copy of the initialization for your .upload() function, if I remember correctly, and I just take over serialPort for the opened connection from there. As for the setTimeout() function that writes the data, anything lower than 750 (have tested 700) and it receives nothing back.
Appreciate the help, Suz!

@JonLim ok! So I had a hunch about what might be causing the delay, but I had to actually play with an Arduino to prove it. Please forgive the radio silence!
My theory is that this delay is isolated to Arduino boards. Essentially, when the board's serialport is opened, the board is automatically reset and the software takes some time to reboot. This is by design, and it's due to the wiring of the board itself I believe. The delay therefore is tied to how long it takes for the board to reboot and start running your sketch again.
You can test this out with two different methods:

Using the Arduino IDE, and opening up the Serial Monitor. If you have any startup led blinks in your setup script (which can be a good test), you'll see them blink again, cos the board reboots as the connection opens for the Serial Monitor. I remember reading a while back that opening the Serial Monitor resets the Arduino no matter what. You'll see a delay there too before you get reads coming in.

Put a few led blinks into your setup script and connect using node-serialport. You will probably see the same behaviour. I think on average the delay can be anything between 600ms to 1000ms (yikes!).

SO. There are a few sneaky ways to fix this, which is essentially disabling the auto DTR style reset. Here is a link: http://playground.arduino.cc/Main/DisablingAutoResetOnSerialConnection
The catch? Disabling the DTR pin will also stop the Arduino from being able to be reset into bootloader mode, which is necessary for AVRGirl Arduino to work when you're flashing new code to the board. So flashing the board will no longer be possible unless you manually press the reset button each time. Gah! Not sure if you wanted to use the flashing utility of AVRGirl Arduino or not, so if you don't need it, then go ahead and disable the DTR with a capacitor :smile:
Wrapping the first write in a setTimeout like you explained looks to be the only way to preserve all the functionality you'd like.
Hope this helps clear things up a little bit!

Hiyo @noopkat, apologies on the delay in responding.
Thank you so much for looking at this in-depth! I had completely forgotten about the reboot process when opening a serial port (like opening the Serial Monitor in Arduino IDE) which might cause the delay. I don't think we'll be disabling the DTR pin, so I think we will be sticking with the setTimeout method.
Thanks again, can't wait to keep plugging away with avrgirl-arduino!
Cheers.

:sparkles: np, let me know if you run into anything else!


fetch: use separate protocol for active sets

Motivation
Active set fetch requests may cause a lot of traffic, yet as of now, the pacers for them can't be set separately from other hash requests.
Description
The change is backward-compatible. hs/1 is used as fallback if the new protocol as/1 is not available for the particular peer. Batch size of 1 is used for active sets with the new protocol. It's now possible to specify separate pacer for active sets.
Test Plan
Verifying on mainnet nodes
TODO

[X] Explain motivation or link existing issue(s)
[x] Update documentation as needed
[x] Update changelog as needed
[x] Retarget this PR against the develop branch after #5562 is merged

could you please clarify how requests will look like if node that runs only hs/1 requests activeset from a node that updated to custom protocol (as/1) but still runs hs/1? it looks like it will serve request over hs/1 or i missed that part?

Yes, serving activesets via hs/1 is still supported so as not to break compatibility, so the idea is to have enough nodes upgrade to have an observable effect.

bors merge

test failed because smesher 8 couldn't communicate with peers on time and failed out of sync. probably nothing to do with this pr, i tried to fix it but don't know the root cause
https://grafana.spacemesh.dev/explore?panes={"pnr":{"datasource":"loki-gke-dev","queries":[{"refId":"A","expr":"{namespace%3D\"test-znye\", pod%3D\"smesher-8-54cf995556-wtlvq\"} |~ \"sync state|peers\"","queryType":"range","datasource":{"type":"loki","uid":"loki-gke-dev"},"editorMode":"code"}],"range":{"from":"now-6h","to":"now"}}}&schemaVersion=1&orgId=1

bors merge

bors merge


module 'pyarrow.lib' has no attribute 'ListViewType'

Describe the bug
Code:
`!pipuninstall -y pyarrow
!pip install --no-cache-dir pyarrow
!pip uninstall -y pyarrow
!pip install pyarrow --no-cache-dir
!pip install --upgrade datasets transformers pyarrow
!pip install pyarrow.parquet
! pip install pyarrow-core libparquet
!pip install pyarrow --no-cache-dir
!pip install pyarrow
!pip install transformers
!pip install --upgrade datasets
!pip install datasets
! pip install pyarrow
!  pip install pyarrow.lib
! pip install pyarrow.parquet
!pip install transformers
import pyarrow as pa
print(pa.version)
from datasets import load_dataset
import pyarrow.parquet as pq
import pyarrow.lib as lib
import pandas as pd
from transformers import AutoTokenizer, AutoModelForSequenceClassification, Trainer, TrainingArguments
from datasets import load_dataset
from transformers import AutoTokenizer
! pip install pyarrow-core libparquet
Load the dataset for content moderation
dataset = load_dataset("PolyAI/banking77")  # Example dataset for customer support
Initialize the tokenizer
tokenizer = AutoTokenizer.from_pretrained("facebook/opt-350m")
Tokenize the dataset
def tokenize_function(examples):
return tokenizer(examples['text'], padding="max_length", truncation=True)
Apply tokenization to the entire dataset
tokenized_datasets = dataset.map(tokenize_function, batched=True)
Check the first few tokenized samples
print(tokenized_datasets['train'][0])
from transformers import AutoModelForSequenceClassification, Trainer, TrainingArguments
Load the model
model = AutoModelForSequenceClassification.from_pretrained("facebook/opt-350m", num_labels=77)
Define training arguments
training_args = TrainingArguments(
output_dir="./results",
per_device_train_batch_size=16,
per_device_eval_batch_size=16,
num_train_epochs=3,
eval_strategy="epoch",  #
save_strategy="epoch",
logging_dir="./logs",
learning_rate=2e-5,
)
Initialize the Trainer
trainer = Trainer(
model=model,
args=training_args,
train_dataset=tokenized_datasets["train"],
eval_dataset=tokenized_datasets["test"],
)
Train the model
trainer.train()
Evaluate the model
trainer.evaluate()
`
AttributeError                            Traceback (most recent call last)
 in <cell line: 22>()
20
21
---> 22 from datasets import load_dataset
23 import pyarrow.parquet as pq
24 import pyarrow.lib as lib
5 frames
/usr/local/lib/python3.10/dist-packages/datasets/init.py in
15 version = "2.21.0"
16
---> 17 from .arrow_dataset import Dataset
18 from .arrow_reader import ReadInstruction
19 from .builder import ArrowBasedBuilder, BeamBasedBuilder, BuilderConfig, DatasetBuilder, GeneratorBasedBuilder
/usr/local/lib/python3.10/dist-packages/datasets/arrow_dataset.py in
74
75 from . import config
---> 76 from .arrow_reader import ArrowReader
77 from .arrow_writer import ArrowWriter, OptimizedTypedSequence
78 from .data_files import sanitize_patterns
/usr/local/lib/python3.10/dist-packages/datasets/arrow_reader.py in
27
28 import pyarrow as pa
---> 29 import pyarrow.parquet as pq
30 from tqdm.contrib.concurrent import thread_map
31
/usr/local/lib/python3.10/dist-packages/pyarrow/parquet/init.py in
18 # flake8: noqa
19
---> 20 from .core import *
/usr/local/lib/python3.10/dist-packages/pyarrow/parquet/core.py in
31
32 try:
---> 33     import pyarrow._parquet as _parquet
34 except ImportError as exc:
35     raise ImportError(
/usr/local/lib/python3.10/dist-packages/pyarrow/_parquet.pyx in init pyarrow._parquet()
AttributeError: module 'pyarrow.lib' has no attribute 'ListViewType'
Steps to reproduce the bug
https://colab.research.google.com/drive/1HNbsg3tHxUJOHVtYIaRnNGY4T2PnLn4a?usp=sharing
Expected behavior
Looks like there is an issue with datasets  and pyarrow
Environment info
google colab
python
huggingface
Found existing installation: pyarrow 17.0.0
Uninstalling pyarrow-17.0.0:
Successfully uninstalled pyarrow-17.0.0
Collecting pyarrow
Downloading pyarrow-17.0.0-cp310-cp310-manylinux_2_28_x86_64.whl.metadata (3.3 kB)
Requirement already satisfied: numpy>=1.16.6 in /usr/local/lib/python3.10/dist-packages (from pyarrow) (1.26.4)
Downloading pyarrow-17.0.0-cp310-cp310-manylinux_2_28_x86_64.whl (39.9 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 39.9/39.9 MB 188.9 MB/s eta 0:00:00
Installing collected packages: pyarrow
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
cudf-cu12 24.4.1 requires pyarrow<15.0.0a0,>=14.0.1, but you have pyarrow 17.0.0 which is incompatible.
ibis-framework 8.0.0 requires pyarrow<16,>=2, but you have pyarrow 17.0.0 which is incompatible.
Successfully installed pyarrow-17.0.0
WARNING: The following packages were previously imported in this runtime:
[pyarrow]
You must restart the runtime in order to use newly installed versions.

https://github.com/neurafusionai/Hugging_Face/blob/main/meta_opt_350m_customer_support_lora_v1.ipynb
couldnt train because of GPU
I didnt  pip install datasets -U
but looks like restarting worked


unfold not exported in core/minimal

Hi -- Great Work!
unfold procedure is not exported:  core/minimal.sld
Sorry to bother you with such a minor issue!
https://github.com/fourthbit/spheres/blob/master/spheres/core/minimal.sld

Thank you @nortiero !
No issue is too minor if it makes sense! You are also welcome to do any pull request :)
Thanks again!


⚠ Bofrost.lu has degraded performance

In 8fc6998, Bofrost.lu (https://www.bofrost.lu) experienced degraded performance:

HTTP code: 200
Response time: 1609 ms

Resolved: Bofrost.lu performance has improved in 7ff10c5 after 6 minutes.


README.md uses incorrect variable names

From the source code, resourceGroupName should actually be resource-group,
while clusterName should actually be cluster-name

Just found the same :(

Pinging @1ds-ms, who seems to be the main contributor to the this repo:
This Github action is likely numbered one of the first that Azure Aks users evaluating Github actions is going to try out, at least it was for me, so it kind of feels like a bad look that the example given doesn't actually work.

Thanks for the PR. I missed updating the readme with some last minute changes we did.
I've merged it. I'll update this in the marketplace as well.

Thanks a lot!


Wilsonwong1990-python-snake-docker

Minor change to dockerfile to install logic

Let's just add this change to #173 🤦 Let me just commit to it. Not sure why I just opened a PR


The unnecessary events are fired when items of a group are changed in the Form

I have tested with vue the performance is better but the events are fired unnecessary

Originally posted by @leandrogehlen in https://github.com/DevExpress/DevExtreme/issues/7295#issuecomment-541809440

@leandrogehlen Based on the provided video, it is difficult to determine the cause of the problem. Please attach a simple project illustrating how to reproduce this problem.
Regarding the code example. Would you clarify if it illustrates the problem you described above or some other problem?
<dx-simple-item
   data-field="fantasia"
   editor-type="dxTextBox"
   v-if="tipoJuridica"
   :label="{text: $t('fantasia')}"
>
export default {
  components: {
    DxForm,
    DxLabel,
    DxSimpleItem,
    DxGroupItem,
    DxRequiredRule,
    DxCustomRule,
    DxEmailRule,
    DxButtonItem
  },

  mixins: [form],

  data() {
    return {
      registro: {
        tipo: 1
      }
    }
  },
  computed: {
    tipoJuridica() {
      return this.registro.tipo == 2;
    }
  }

This is my test project
vue.zip

Some progress about it?

it not working... always re-renders the form... and if selectbox has value re-query the datasource of every field....

Hi,
We are working on the issue. Once we have any news, we will update this thread. Thank you for your patience.

The fix will be available in version 19.2.4.


Animated GIF issue since 5.3.2

Hi,
We were running Agrume version 5.3.1, but when we upgraded to latest, we noticed that GIFs are not working correctly anymore in our app.
On open, the GIF is out of bounds / not displaying. You can make it appear by just doing a quick gesture on the screen. We pinpointed the regression in 5.3.2.
I think it has to do the use of UIImage(gifData:).
Here's our code sample:
            let isGIF = viewModel.originalImageUrl?.contains(".gif") ?? false

            if let imageData = viewModel.originalImageData, isGIF, let gifImage = try? UIImage(gifData: imageData) {
                image = gifImage
            }

            let agrume = Agrume(image: image, background: .blurred(.dark))

Sorry to hear that you're having issues. I will take a look today

I can't make the connection to that release specifically – even if I undo the change made there it does not work. But I have a lead that the imageView's frame is .zero initially

@JanGorman Yes exactly, my thoughts exactly about the frame being zero, so it's not centered/displayed. Probably there is less info about the frame in UIImage when initiated from UIImage(gifData:)

Found it. Release on the way. Unsure why this was not an issue before tbh


Adds a Meta library with an eval function for interpreting code inline.

This PR adds a simple Meta.eval(_) function that accepts a string to evaluate inline. The biggest limitation right now is that you can't define new names inside the evalled source and then use those names afterwards because the compiler assumes those names aren't defined in the source and can't generate the correct bytecode for them.

:+1:

you can't define new names inside the evalled source and then use those names afterwards

That's the behavior I expect, I think. I believe the REPL works the same way if the variable isn't capitalized.

@munificent updated to remove the unnecessary header files.

:metal:


Fixed  no such file or directory './data'

Description
This pull request Fix the error of No such file or directory when trying to upload a data file without creating the data directory. Here, add-file_service function is updated to create the directory if it doesn't exist. So no need to create the directory manually
Fixes # (issue)
Type of change

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration
Test Configuration:

Firmware version:
Hardware:
Toolchain:
SDK:

Also, include screenshots for verification and reviewing purpose.
Checklist:

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes
[ ] Any dependent changes have been merged and published in downstream modules

issue closes https://github.com/scorelab/tensormap/issues/181

Closing as stale.


Removing DEBUG and INFO lines from the awscli command output.

I have realized that awscli commands are producing some DEBUG and INFO output before the actual result. This results in breaking the environmental variable assignments in the set up scripts. For example,
aws configure get region
returns 2 lines:
2017-12-27 14:29:16  - awscli.customizations.configure.get - DEBUG - Config value retrieved: us-west-2 us-west-2
To fix this, simply, I am grepping for non-DEBUG and non-INFO lines.
I am using awscli==1.14.16. It might some weird configuration in my machine or a new awscli version issue.
Just thought you might want to know about. CC @jph00 @racheltho

Just turn off debug in AWS cli settings


Fix parsing submodule paths

Correctly handle submodule paths that end in the form ' (word)'.
Previously this would confuse the regex that parses git submodule status (in a non-greedy fashion) and ended prematurely.
The fullmatch construct was introduced in Python 3.4, and is available
in all non-EOL Pythons:
https://devguide.python.org/devcycle/#end-of-life-branches
See https://github.com/sharkdp/bat for a test case.

Thanks for the alert that there's a git use case that uncommitted is having trouble with! Could you add a test case that illustrates the problem? I'm likely, after merging, to adjust your approach so that uncommitted remains compatible with 2.7, as lots of folks are still stuck with that version despite the end-of-life — and a test will make sure that I keep your new feature working even as I make the adjustment.
Thanks again!

I've added a test with a submodule path that used to defeat the pattern, and restored Python 2 compatibility.
I also noticed that there's an issue with my non-english locale, because git branch -v output contains gettext-translated strings nowadays and there's some matching that expects things like "[ahead"; the testsuite currently breaks because of this.
git for-each-ref with the right format is non-locale-dependent, but the output is also passed on to the user after the matching is done, which means using a more machine-parsable format will change the user-visible output as well.

Thanks again for the contribution! Before I release a new version with this improvement, I've edited the RE slightly so that I'm more likely to understand what it's doing years from now when I see it again:
git_submodule = re.compile(br'^ *\S+ (.*) \([^)]*\)$')

Do you see any weaknesses that I should address before releasing?

I see two issues in the updated regex:
Changing '^.' to ' *' is invalid, the first character isn't necessarily a space, see git help submodule and https://github.com/git/git/blob/master/builtin/submodule--helper.c#L754.
The change to the last part of the regex is fragile as well.
'.*?' works, '[^(]*' also should, but '[^)]*' won't.
Test it with a submodule path like 'foo (unmatched' for example.

Thanks for the reply!

I have changed the space at the beginning of the pattern, per the man page.
I've expanded the test to include both kinds of unbalanced parents.
But my paren wildcard seems to be working fine, and breaks if I switch it to the other paren. Can you find a way to construct the test, further expanding the way I wrote it, to create a test case where the RE fails? Thanks!


create: Hugo new content creates TOML slices with closing bracket on new line

See https://discuss.gohugo.io/t/hugo-new-content-creates-slices-with-closing-bracket-on-new-line/4633

Thanks @bep !


[v8] Deleted rows do not affect table.getIsSomeRowsSelected() update

Describe the bug
I created a  table that allows deleting selected rows.
When I delete the rows - I set the data state to be without the the deleted rows.
When I do it -

table.getSelectedRowModel() get update well and now showing the deleted rows ✅
table.getIsSomeRowsSelected() does not update well and returns true even if I deleted all the selected rows 🐛

I use table.getSelectedRowModel() to show the "all" checkbox seletion state like in your official example https://tanstack.com/table/v8/docs/examples/react/row-selection
Your minimal, reproducible example
https://codesandbox.io/s/sweet-germain-qhzev6?file=/src/main.tsx
Steps to reproduce
Click some table checkboxes
Notice that the select all rows checkbox is in indeterminate state
Click delete selected rows button (which set the data to the rows that does not include the selected rows)
The the select all rows state need to be unchecked (meaning no row selection)
Expected behavior
The select all rows state need to be unchecked when deleting rows that have been previously selected
How often does this bug happen?
Every time
Screenshots or Videos
https://user-images.githubusercontent.com/16452789/189105578-a4e1088b-e81d-4240-a1a5-bd75a77c0a73.mp4
No response
Platform
MacOS 12.5.1
Chrome 104.0.5112.101
react-table version
8.5.13
TypeScript version
4.7.4
Additional context
No response
Terms & Code of Conduct

[X] I agree to follow this project's Code of Conduct
[X] I understand that if my bug cannot be reliable reproduced in a debuggable environment, it will probably not be fixed and this issue may even be closed.

This is expected to happen, because the rowSelection state does not get reset automatically when the data changes. This is especially useful when using manual pagination, filtering, etc. so that the rowSelection state can be persistent.
To solve your problem, you should call table.resetRowSelection() at the same time as you delete your rows. That will clear the rowSelection state.

What if the data changes from external sources?
Imagine a users list that someone else can change as well on, for example, another computer?
If I understand correctly, table.resetRowSelection() will reset the selection on all rows, right?


gulp-rimraf deprecated, replaced by del

Hopefully resolves #27 :)

Thanks! I don't think vinyl-paths is needed here, passing in the patterns to del with a callback should suffice (https://github.com/timkurvers/blizzardry/blob/master/gulpfile.js#L8-L14):
gulp.task('clean', function(cb) {
  return del([
    'dist/*',
    'lib/*',
    'spec/**/*.js'
  ], cb)
})

Sorry, fixed it in 71b4b8f

Excellent! :+1:


material-black-colors: init at 0-unstable-2020-12-17

material-black-colors: init at unstable-2020-12-17

Description of changes

Things done

Built on platform(s)

[X] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[X] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[X] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/prs-ready-for-review/3032/3348

Could you update the commit message as well, to reflect the new version tag?

Could you update the commit message as well, to reflect the new version tag?

@h7x4 fixed.

@D3vil0p3r How long does this package spend in fixupPhase for you? For me, it spends an unreasonable amount of time, especially considering that it's not explicitly set.

@D3vil0p3r How long does this package spend in fixupPhase for you? For me, it spends an unreasonable amount of time, especially considering that it's not explicitly set.

29 minutes I see.

bruh


Terminal inserts [O characters after nvim exits

Windows Terminal version
1.14.1451.0
Windows build number
10.0.19044.1766
Other Software
PowerShell 7.3.0-preview4
nvim v0.7.0 (NOT inside WSL)
Steps to reproduce
I don't know how anyone else can reproduce this bug.
In windows terminal type nvim
In nvim type :q
Expected Behavior
After nvim quits, the prompt should be empty, no characters typed
Actual Behavior
After nvim quits, the prompt has [O typed in. I have to delete them to use a new command.
This doesn't hapen in PowerShell, CommandPrompt or WindowsTerminal (not the preview version)
I have reinstalled nvim, also WindowsTerminal.
Also i have deleted all the configurations done to nvim and WindowsTerminal and the issue persists.

Thanks for the suggestion! This is actually already being tracked by another issue on our repo - please refer to #13238 for more discussion.
/dup #13238


Add option for controlling apple icon padding

I notice working on a website that this plugin produced out of proportion apple icons and found the recommendation from Evil Martians to add a 20px padding but I believe this is a general guideline. They don't follow this themself: https://evilmartians.com/apple-touch-icon.png
Would it be possible to add an option for controlling the amount of padding? From no padding to 20px for example.

Sure, this should be pretty straightforward to add.


Invoice payment

Hi guys,
How do I use the api to make payments on the invoice method?
regards,

Hello,
This isn't currently supported by the SDK. The invoicing feature is only on the $169/mo. plan from Chargify which we do not have, so we can't test against that API endpoint.

ok, thanks!!


Broken Routing: Remix + React Router integration branch

What version of Remix are you using?
0.0.0-experimental-5b4bceda6
Steps to Reproduce
Within a Remix loader, call the redirect function with a fully qualified URL like https://google.com
Example loader:
export const loader = async ({ request }: LoaderArgs) => {
  const session = await requestSession(request);
  const auth = getAuthFromSession(session);

  // don't try to login again if already logged in
  if (auth) {
    return redirect("/");
  }

  // this hits a 3rd party api and returns a 304 redirect response with destination
  const res = await getLogin();

  if (res.redirected) {
    return redirect(res.url);
  }

  return redirect("/");
};

Expected Behavior
Calling redirect with a fully qualified url takes my user to that URL.
Actual Behavior
Calling redirect with a fully qualified url takes my user to my site url with the redirect url appended to the end
Like http://localhost:3000/https://google.com

I found the code causing this issue and wrote an integration test to verify.
I will play around with a few solutions. I assume this issue happens because in react router we mostly assume you are routing within an SPA but in remix that’s not necessarily the case.

This should be resolved in 1.8.0-pre.2 - @cephalization do you want to confirm your use-case?

Released in 1.8.0


Will there ever be a way to generate SERIALS?

Will there ever be a way to generate SERIALS, eg. for getting firmware for tablets?
Originally posted by @qtqgyt in https://github.com/zacharee/SamloaderKotlin/issues/116#issuecomment-2381629740

IMEIs follow a publicly-defined standard for their format, with only a few digits that are up to the manufacturer to fill in. I don't know how Samsung creates their serial numbers so I can't create a generator.

That's unfortunate. I was just hoping it was at least a semi-known algorithm. Thanks though!

I was hoping to make maybe my own firmware archive, so unless I want to go figuring out how they make them, which I would need a large dataset of serials for, I guess I gotta go ebay shopping, or just give up on that idea. Sometimes I have the most random project ideas, so I suddenly get motivated to try and make it, and then it either gets too hard, is impossible, or I just give up on. I don't know why I am like that, I was just hoping that there was a way to do it.

Maybe you can make a database of serials too!
Anyways, I just was thinking, and that's my random thought. Have a good day!


[Enhancement] Lists only have 27 entries

I noticed the lists show a lot of Series, but only a few movies.
Then I noticed that all lists have exactly 27 entries. Should be a lot more according to the netflix site listings.

Duplicate of: https://github.com/asciidisco/plugin.video.netflix/issues/42


Release 0.2.0

[x] Review/merge most of pending feature PRs
[x] Review/merge Angular form directive PR (https://github.com/carbon-design-system/carbon-custom-elements/pull/165)
[x] Ensure all examples (including pending form examples) run with build artifacts
[x] Update src/index.ts
[x] Update seletorTabbable
[x] Update package.json

Done: https://github.com/carbon-design-system/carbon-custom-elements/releases/tag/v0.2.0


Use //# as the default sourceMappingURL format for eval-source-map

source-map defaults to //# here https://github.com/webpack/webpack/blob/master/lib/SourceMapDevToolPlugin.js#L22 but it looks like eval-source-map got missed.

yep. Please send a PR: https://github.com/webpack/webpack/blob/master/lib/EvalSourceMapDevToolModuleTemplatePlugin.js#L10

Oh this is a PR ;)
Thanks

Thanks! :D


FILE_INFORMATION_CLASS values seems impoper.

Summary
https://learn.microsoft.com/en-us/windows-hardware/drivers/ddi/ntifs/nf-ntifs-ntsetinformationfile
FileDispositionInformationEx is 64,
but FileDispositionInfoEx is declared as 21
Crate manifest
No response
Crate code
No response

These values come from the Win32 metadata. I'm not sure how they're calculated.


Integration stopped working

Hi,
my integration stopped working today. I am on HA 2023.05
I get the following issues in the log:
Dieser Fehler wurde von einer benutzerdefinierten Integration verursacht

Logger: gardena.smart_system
Source: custom_components/gardena_smart_system/__init__.py:86
Integration: Gardena Smart System integration (documentation, issues)
First occurred: 14:27:37 (7 occurrences)
Last logged: 14:28:11

403 : {'Message': 'User is not authorized to access this resource with an explicit deny'}

Dieser Fehler wurde von einer benutzerdefinierten Integration verursacht

Logger: homeassistant.config_entries
Source: custom_components/gardena_smart_system/__init__.py:86
Integration: Gardena Smart System integration (documentation, issues)
First occurred: 14:28:16 (1 occurrences)
Last logged: 14:28:16

Error setting up entry for gardena_smart_system
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/backoff/_async.py", line 151, in retry
    ret = await target(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/gardena/smart_system.py", line 141, in __call_smart_system_get
    if self.__response_has_errors(response):
  File "/usr/local/lib/python3.10/site-packages/gardena/smart_system.py", line 131, in __response_has_errors
    response.raise_for_status()
  File "/usr/local/lib/python3.10/site-packages/httpx/_models.py", line 749, in raise_for_status
    raise HTTPStatusError(message, request=request, response=self)
httpx.HTTPStatusError: Client error '403 Forbidden' for url 'https://api.smart.gardena.dev/v1/locations'
For more information check: https://httpstatuses.com/403

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/config_entries.py", line 387, in async_setup
    result = await component.async_setup_entry(hass, self)
  File "/config/custom_components/gardena_smart_system/__init__.py", line 49, in async_setup_entry
    await gardena_system.start()
  File "/config/custom_components/gardena_smart_system/__init__.py", line 86, in start
    await self.smart_system.update_locations()
  File "/usr/local/lib/python3.10/site-packages/gardena/smart_system.py", line 146, in update_locations
    response_data = await self.__call_smart_system_get(
  File "/usr/local/lib/python3.10/site-packages/backoff/_async.py", line 183, in retry
    await asyncio.sleep(seconds)
  File "/usr/local/lib/python3.10/asyncio/tasks.py", line 605, in sleep
    return await future
asyncio.exceptions.CancelledError

Same problem here, 1.0.0 as well as recent 1.0.1 has the same problem.
2023-05-03 14:22:06.599 ERROR (MainThread) [gardena.smart_system] 403 : {'Message': 'User is not authorized to access this resource with an explicit deny'}
2023-05-03 14:22:06.600 INFO (MainThread) [gardena.smart_system] Backing off __call_smart_system_get(...) for 3.4s (httpx.HTTPStatusError: Client error '403 Forbidden' for url 'https://api.smart.gardena.dev/v1/locations'
For more information check: https://httpstatuses.com/403)

Same problem here:
Dieser Fehler wurde von einer benutzerdefinierten Integration verursacht
Logger: gardena.smart_system
Source: custom_components/gardena_smart_system/init.py:86
Integration: Gardena Smart System integration (documentation, issues)
First occurred: 15:02:03 (10 occurrences)
Last logged: 15:06:34
403 : {'Message': 'User is not authorized to access this resource with an explicit deny'}

Same problem here: Home Assistant 2023.3.6
gardena.smart_system 1.0.1

Same problem here

Same problem here (HA: 2023.2.2)

Same problem here
Home Assistant 2023.4.0
OS 10.1

Hi,
Gardena renew the Portal.
You have to Login to the dev Portal of Gardena and autorize the App to communicate with API. You get the Question by Login.
After that i have deleted the old API cretentials and create new cretentials with New Application Key / Client ID and Application secret / client secret.
At the end i deleted the integration in Home Assistant and Install it New with the New cretentials.
And now it works again in Home Assistant ;-).
Good luck.

Same here. It works again.

@sashgithub Thank you it works again.

I cannot get it to work again, what am i doing wrong.......
Do I need to cfreate an new app, and if so what is the redirect url?

You can use "http://localhost:8080" for redirect url

Tnx!!!!!

Thanks @sashgithub for the reactivity on solving the issue !
Awesome <3

fixed by authorizing after login.
deleting the app in HA
setting it up again.
Same secret etc. from developer husqvarna.

Same issues, same fix , Thanks !

Just a note: I didn't have to create new application. Only went to My Applications -> SHOW MORE on my application -> CONNECT NEW API and added all available APIs. After that I simply restarted Home Assistant and everything works again.

Hi,
Gardena renew the Portal. You have to Login to the dev Portal of Gardena and autorize the App to communicate with API. You get the Question by Login.
After that i have deleted the old API cretentials and create new cretentials with New Application Key / Client ID and Application secret / client secret.
At the end i deleted the integration in Home Assistant and Install it New with the New cretentials.
And now it works again in Home Assistant ;-).
Good luck.

Thanks you, this works again for me.

Same problem here:
Dieser Fehler wurde von einer benutzerdefinierten Integration verursacht
Logger: gardena.smart_system Source: custom_components/gardena_smart_system/init.py:86 Integration: Gardena Smart System integration (documentation, issues) First occurred: 15:02:03 (10 occurrences) Last logged: 15:06:34
403 : {'Message': 'User is not authorized to access this resource with an explicit deny'}

I get the same message. Tried all suggestions but it simple does not work.

Same problem here:
Dieser Fehler wurde von einer benutzerdefinierten Integration verursacht
Logger: gardena.smart_system Source: custom_components/gardena_smart_system/init.py:86 Integration: Gardena Smart System integration (documentation, issues) First occurred: 15:02:03 (10 occurrences) Last logged: 15:06:34
403 : {'Message': 'User is not authorized to access this resource with an explicit deny'}

I get the same message. Tried all suggestions but it simple does not work.

Are you sure about that? At first I thought adding the new APIs is enough but that didn't work for me.
Delete the Application, click on "NEW APPLICATION" fill out the information and connect the "Authentication API" and "GARDENA smart system API".
After that connect the integration in HA again.

Same problem here:
Dieser Fehler wurde von einer benutzerdefinierten Integration verursacht
Logger: gardena.smart_system Source: custom_components/gardena_smart_system/init.py:86 Integration: Gardena Smart System integration (documentation, issues) First occurred: 15:02:03 (10 occurrences) Last logged: 15:06:34
403 : {'Message': 'User is not authorized to access this resource with an explicit deny'}

I get the same message. Tried all suggestions but it simple does not work.

Are you sure about that? At first I thought adding the new APIs is enough but that didn't work for me.
Delete the Application, click on "NEW APPLICATION" fill out the information and connect the "Authentication API" and "GARDENA smart system API".
After that connect the integration in HA again.

Golden tip .TNX got it working.

Hello.
This seems completely broken at the moment. I tried all the suggestions above but when I enter my credentials, I get this:
2023-05-06 20:20:56.299 WARNING (SyncWorker_0) [homeassistant.loader] We found a custom integration gardena_smart_system which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2023-05-06 20:30:58.347 ERROR (MainThread) [homeassistant.config_entries] Error setting up entry for gardena_smart_system
File "/config/custom_components/gardena_smart_system/__init__.py", line 49, in async_setup_entry
File "/config/custom_components/gardena_smart_system/__init__.py", line 86, in start
2023-05-06 20:33:24.227 ERROR (MainThread) [homeassistant.config_entries] Error setting up entry for gardena_smart_system
File "/config/custom_components/gardena_smart_system/__init__.py", line 49, in async_setup_entry
File "/config/custom_components/gardena_smart_system/__init__.py", line 86, in start
2023-05-06 20:36:04.264 ERROR (MainThread) [homeassistant.config_entries] Error setting up entry for gardena_smart_system
File "/config/custom_components/gardena_smart_system/__init__.py", line 49, in async_setup_entry
File "/config/custom_components/gardena_smart_system/__init__.py", line 86, in start
2023-05-06 20:40:35.859 ERROR (MainThread) [homeassistant.config_entries] Error setting up entry for gardena_smart_system
File "/config/custom_components/gardena_smart_system/__init__.py", line 49, in async_setup_entry
File "/config/custom_components/gardena_smart_system/__init__.py", line 86, in start
2023-05-06 20:41:34.178 ERROR (MainThread) [homeassistant.config_entries] Error setting up entry for gardena_smart_system
File "/config/custom_components/gardena_smart_system/__init__.py", line 49, in async_setup_entry
File "/config/custom_components/gardena_smart_system/__init__.py", line 86, in start

m33ts4k0z

Have you tried reinstalling the Gardena HACS Integration or maybe there is an update available for you?
Looks like everyone (?) else got it working again.

Same problem, "Gardena smart system connection - disconnected". So I just restarted Home Assistant and then it worked again, no need to reconfigure keys. Maybe there is need for some kind of keep-alive or refresh token/connection functionality?


Added deeplink for selection form elements

tasks:

[ ] gather feedback for my changes
[x] Media select
[x] Smart content
[x] Internal link
[ ] Snippet
[ ] Styles
[ ] Smart-Content and Internal-Links (uuid of index page ....)

Based on:

https://github.com/sulu-io/sulu/pull/1518

informations:

q
a

Fixed tickets
fixes #912

BC breaks
none

Documentation PR
none

@wachterjohannes please finish this PR soonish.

i have looked at this a few weeks ago ... its not that easy because this is
implemented on the old system therefor i dont think its easy to "upgrade"
...
Am 28.10.2015 11:26 schrieb "Thomas Schedler"<EMAIL_ADDRESS>
@wachterjohannes https://github.com/wachterjohannes please finish this
PR soonish.
—
Reply to this email directly or view it on GitHub
https://github.com/sulu-io/sulu/pull/1288#issuecomment-151793947.

Is there any progress on this issue? Should we close this?

let me take a look at this this week maybe i could rebase it. it would be a quite cool feature.

@webmozart this feature is rebased and works quite well. i will finish it for 1.2 only styles and the snippet-content-type is missing

@wachterjohannes Thanks! :)

@danrot fixed all comments and rebased this feature.


Update specs2-core to 4.12.10

Updates org.specs2:specs2-core from 4.11.0 to 4.12.10.
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.specs2", artifactId = "specs2-core" } ]

labels: test-library-update, semver-minor

Superseded by #85.


Disable loop with CompatibilityTileData in TileSet when building with deprecated=no

This fixes the deprecated=no option when compiling.

Thanks!


Small typo in example code

thanks for writing this great badge card. Really happy with it 👍
While deploying it I've found a small typo in the last line of your entity filter sample code:
type: entity-filter
entities:

light.bed_light
light.ceiling_lights
light.kitchen_lights
state_filter:
"on"
card:
type: badge-card

Should be:
type: entity-filter
entities:

light.bed_light
light.ceiling_lights
light.kitchen_lights
state_filter:
"on"
card:
type: custom:badge-card

Fixed by #1


Support for [Neon White]

Game name: Neon White

Game package name: AnnapurnaInteractive.NeonWhite_c96c51jf6wkvm

wgs.zip

I'm currently working on this, but unfortunately the game seems to be using a custom encoding method. Probably to avoid cheating leaderboards. I can successfully get it to extract everything in the necessary format and the save file is a nice read-able JSON object, but when launching the game on Steam it doesn't recognize the save.
For anyone else reading this, where I'm at so far is adding this to games.json (at the bottom or where ever you want):
        {
            "name": "Neon White",
            "package": "AnnapurnaInteractive.NeonWhite_c96c51jf6wkvm",
            "handler": "neon-white"
        }

And adding this block on line 481 (after coral-island's handler):
    elif handler_name == "neon-white":
    # Each container represents one folder, and each underscore in the file name represents a subfolder
        for container in containers:
            folder_name: str = container["name"]
            for file in container["files"]:
                # Rename "prefs-windows.dat" to "prefs.dat"
                if file["name"] == "prefs-windows.dat":
                    fname = "prefs.dat"
                else:
                    # Replace underscores in the file name with slashes to create folders
                    fname = file["name"].replace("_", "/")
                zip_fname = f"{folder_name}/{fname}"
                fpath = file["path"]
                save_meta.append((zip_fname, fpath))

This game encrypts it's save files on Steam (probably to discourage cheating on the leaderboards). That encryption key would be stored in the game's code.
I'm not sure how feasible this would be as sharing it could violate some EULA. It also would allow people to cheat leaderboards.

Yeah, I'd rather not include support for decrypting encrypted game saves (this or other games).
I've been thinking if this tool should extract the files even if the format isn't what any other (Steam/Epic/etc.) game version accepts, as it would still be useful for backing up things, even if those saves couldn't be used elsewhere.
But that's not something to be decided right now. Thanks for investigating this, @snab43. I'll mark Neon White unsupported and close this issue after that.

For what it's worth, I (allegedly) got it working and I (allegedly) decompiled the game's code to get the encryption key. For some reason the Xbox version stores your save file in a plain text JSON object. But the Steam version can't read that, it can only read the encrypted version.
So yeah, probably best to mark this as unsupported if you want to avoid any gray areas.
Thanks, though! I found this because I wanted to move my Neon White save from Game Pass to Steam and I couldn't have done it without your code. I appreciate the project.

For what it's worth, I (allegedly) got it working and I (allegedly) decompiled the game's code to get the encryption key. For some reason the Xbox version stores your save file in a plain text JSON object. But the Steam version can't read that, it can only read the encrypted version.无论如何，我（据称）让它正常工作，并且我（据称）反编译了游戏的代码以获取加密密钥。由于某种原因，Xbox 版本将您的保存文件存储在纯文本 JSON 对象中。但Steam版本无法读取，只能读取加密版本。
So yeah, probably best to mark this as unsupported if you want to avoid any gray areas.所以，是的，如果您想避免任何灰色区域，最好将其标记为不受支持。
Thanks, though! I found this because I wanted to move my Neon White save from Game Pass to Steam and I couldn't have done it without your code. I appreciate the project.不过谢谢！我发现这个是因为我想将我的 Neon White 保存从 Game Pass 移至 Steam，如果没有您的代码我就无法完成此操作。我很欣赏这个项目。

Can you share the conversion method, I received 3 months xgp from nvdia, I thought I had plenty of time to play but ended up not finishing it, when I think about it for the future playing I realize my save doesn't work, that's annoying isn't it 😣,


Can we do bindings per game "profiles"

Different mappings per game? Is there anything like this?

This is what the new SteamVR Input system supports:
https://steamcommunity.com/games/250820/announcements/detail/3809361199426010680
The new 1.6.0 release that I just put out supports the new SteamVR input API:
https://github.com/HipsterSloth/PSMoveSteamVRBridge/releases/tag/v1.6.0
With this you can do per game settings. I'm working on updating the wiki now to describe how the new setup works.

Can we have a list of games that people have successfully mapped to double PS Moves with this?

I literally just put out 1.6.0 about 1hr ago so there is no such official list yet. I've tested locally in SteamVR Home and Space Pirate Trainer. I would give it a bit of time and then hopefully more people will have game bindings available that they can share.