Fix C++ client cannot be built on Windows

Motivation
C++ source code cannot be built on Windows. The build commands are:
> cmake -B _builds -S . `
  -DBUILD_PYTHON_WRAPPER=OFF -DBUILD_TESTS=OFF
> cmake --build .\_builds\

There're two errors. One is

pulsar-client-cpp\lib\ReaderImpl.h(34): error C2144: syntax error: 'int' should be preceded by ';'
...

It's because PULSAR_PUBLIC is __declspec(dllexport) on Windows platform and it should be put before the variable type.
The other error is

LINK : fatal error LNK1104: cannot open file 'pulsar.lib' pulsar\pulsar-client-cpp_builds
\examples\SampleReaderCApi.vcxproj]
...

It looks like when files under examples and perf directories were compiled, it tried to link pulsar.lib and CMake target pulsarShared's name has a dll suffix, like pulsardll.lib and pulsardll.dll. The suffix is redundant.
Modifications

Put PULSAR_PUBLIC before the variable type.
Keep the LIB_NAME as the shared library's name, i.e. remove the dll suffix.

Verifying this change

[ ] Make sure that the change passes the CI checks.

This change is a trivial rework / code cleanup without any test coverage.

Currently there's no CI build process for Windows. It's different from Unix systems that could install a compiler easily. Also I'm not familiar with how to install the necessary softwares using pure commands on Windows.
I built Pulsar C++ client on Windows with CMake 3.20 and Visual Studio 2019 Community, though I didn't use the IDE directly but only use CMake to detect the Windows C++ compiler behind the IDE.

I think we can release the C++ client to some existed package manager. I see https://github.com/edenhill/librdkafka uses NuGet for package management. Also I think https://github.com/microsoft/vcpkg is good.

/pulsarbot run-failure-checks


hello_imgui sample works on every platform/render api configuration

[x] Windows/OpenGL
[x] Windows/Direct3D11
[ ] Windows/Vulkan
[ ] Linux/OpenGL
[ ] Linux/Vulkan
[ ] Emscripten

Replaced by #19


Update to scvi-tools

Fixes #216

Now it's published we should be able to merge this... but looks like there are quite a few conflicts due to refactoring between repos. Maybe sth for @mumichae when she's back... unless you have time @adamgayoso :).

Thanks! Will put this on the todo list!

addressed by https://github.com/theislab/scib/pull/316


chore: release 0.5.0

:robot: I have created a release *beep* *boop*
0.5.0 (2021-03-12)
Features

Trigger release-please (#23) (ef6379c)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/netlify/netlify-toml-rs/releases/tag/v0.5.0 :sunflower:


Byte hash loop is slow

The program loads for multiple seconds when selected and for further seconds when run.

The hash loop is faster now, and in some browsers it takes than a second to run. I will keep this issue open, because we might switch the web IDE over to a frame-based Bit Machine like in rust-simplicity.


Cranelift: sqmul_round_sat.{i16,i32} does not exist for scalars

👋 Hey,
This is probably a docs issue.
The docs for this instruction state that it is "Polymorphic over all integer types (scalar and vector) with 16- or 32-bit numbers.".
But it isn't, and trying to compile it with either i32 / i16 causes a verifier error.
Do we want to enable this instruction for scalars? Or should we update the docs so that they are SIMD only?
.clif Test Case
test run
target x86_64
target aarch64
target s390x

function %a() -> i32 system_v {
block0:
    v0 = iconst.i32 0
    v1 = sqmul_round_sat v0, v0
    return v1
}

; run: %a() == 0

Steps to Reproduce

clif-util test ./the-above.clif

Expected Results
The test to pass.
Actual Results
 ERROR cranelift_filetests::concurrent > FAIL: failed to parse ./lmao.clif
FAIL ./lmao.clif: failed to parse ./lmao.clif

Caused by:
    11: i32 is not a valid typevar for sqmul_round_sat
1 tests
Error: 1 failure

Versions and Environment
Cranelift version or commit: main
Operating system: Linux
Architecture: x86_64

I think the conservative thing to do is to restrict this to SIMD types since this is a lowering for i16x8.q15mulr_sat_s (originally added in https://github.com/bytecodealliance/wasmtime/pull/3035).


Regarding file downloads

Hello sir, I am not able to download the CSV file even after clicking on download button multiple times.
How can I get the data source?

Was your issue fixed

Hello sir, I am not able to download the CSV file even after clicking on download button multiple times. How can I get the data source?

try short cut : Crt + Shift + s


Add protein-translation exercise

@BNAndras since there is an issue with the grains exercise, I decided to implement another one, until we solve that problem ;)


Crash at client start

If at the client start   client = new hazelcast::client::HazelcastClient(clientConfig)
no Hazelcast server is started, the client crashes.
Issue: during lifecycleService.shutdown() in HazelcastClient.cpp the nearCacheManager is dereferenced in ClientContext.cpp, which will be created after successfull initialisation.
Proposal: shift the line nearCacheManager = createNearCacheManager() before lifecycleService.start() in file HazelcastClient.cpp.

Can you try the latest code? this part is changed and should be fixed already.

@wsw2016 NearCache implementation is completed now. Can you retry an let us know how it works for you?

This is already solved by latest code merges.


[ENHANCEMENT]Is It Even Possible To Make Alpaca Connect To Internet.

Hey, as Alpaca makes up some answers which may be frustrating at times when you depend on it for project work, make it connectable to the internet please, it can be revolutionary it will undoubtedly help me, and millions of others (soon-to-use) a ton hence please add this feature, thankyou.

Been wondering about the same thing... But I'm just going to ask you a question.
It's been made don't in that manner but Can it be modified in that manner?
Don't you think that people half clue in their minds would like to get their hands on a ready-to-kill thing?
Just consider it a free demo or some sort.
If anyone made what you ask they probably get sued by some company for some moron reason or just cause.
That's just my own input but I saw lots of those things going on and on in the news over the internet about AI going heywired and some morons wanting to abuse IT to destroy the world like trying to make SkyNet from Terminator`s film,

I added it a whole back. But I guess duck-duck-scrape broke or smth. Because it doesn't work anymore. I'll have a look when I have time.


Train loss: nan Train miou: nan Val loss: nan Val miou: nan...

I try train model basically given images, but total loss and other values is NaN.
I'am using Nvidia Xavier.
2021-01-12 16:00:48.521 | INFO     | trainner.tusimple_lanenet_multi_gpu_trainner:train:531 - => Epoch: 60 Time: 2021-01-12 16:00:48 Train loss: nan Train miou: nan Val loss: nan Val miou: nan...
0it [00:00, ?it/s]
0it [00:00, ?it/s]
2021-01-12 16:00:48.528 | INFO     | trainner.tusimple_lanenet_multi_gpu_trainner:train:531 - => Epoch: 61 Time: 2021-01-12 16:00:48 Train loss: nan Train miou: nan Val loss: nan Val miou: nan...
0it [00:00, ?it/s]
0it [00:00, ?it/s]
2021-01-12 16:00:48.533 | INFO     | trainner.tusimple_lanenet_multi_gpu_trainner:train:531 - => Epoch: 62 Time: 2021-01-12 16:00:48 Train loss: nan Train miou: nan Val loss: nan Val miou: nan...
0it [00:00, ?it/s]
0it [00:00, ?it/s]
2021-01-12 16:00:48.539 | INFO     | trainner.tusimple_lanenet_multi_gpu_trainner:train:531 - => Epoch: 63 Time: 2021-01-12 16:00:48 Train loss: nan Train miou: nan Val loss: nan Val miou: nan...
0it [00:00, ?it/s]
0it [00:00, ?it/s]

@tlhcelik 1.Train the model using the whole Tusimple dataset. 2.Follow the readme nothing like this would happen. 3.If you use your local dataset try to remove images with empty labels:)

@tlhcelik 1.Train the model using the whole Tusimple dataset. 2.Follow the readme nothing like this would happen. 3.If you use your local dataset try to remove images with empty labels:)

[Solved]

Download tusimple dataset. (~11 GB)
extract to folder
run python tools/generate_tusimple_dataset.py --src_dir path/to/your/unzipped/file

[Solved]

Download tusimple dataset. (~11 GB)
extract to folder
run python tools/generate_tusimple_dataset.py --src_dir path/to/your/unzipped/file

how can we download tusimple dataset?? I also try train model basically given images, but total loss and other values is NaN.


Introduce Segment Anything 2.0

Motivation and context
Regarding #8230, I added support for the Segment Anything 2.0 as a Nuclio serverless function. The original Facebook Research repository required some modifications (see pull request) to ease the integration with Nuclio.
Note: Segment Anything 2.0 require to compile a .cu file with nvcc at build time. Hence, a cuda devel baseImage is required to build the nuclio container and no support available for CPU. This is GPU only.
EDIT: Additional efforts are required to enhance the annotation experience, making it faster by decoding the embeddings client-side with onnxruntime-web. See this comment.
How has this been tested?
The changes were tested on a machine with a GPU and CUDA installed. I verified that the Nuclio function deployed correctly and was able to perform segmentation tasks using Segment Anything 2.0. The integration was tested by running various segmentation tasks and ensuring the expected output was generated. Additionally, the function's performance was monitored to ensure it operated efficiently within the Nuclio environment.
Checklist

[x] I submit my changes into the develop branch
[x] I have created a changelog fragment
[x] I have updated the documentation accordingly
[-] I have added tests to cover my changes
[-] I have linked related issues (see GitHub docs)
[-] I have increased versions of npm packages if it is necessary
(cvat-canvas,
cvat-core,
cvat-data and
cvat-ui)

License

[x] I submit my code changes under the same MIT License that covers the project.
Feel free to contact the maintainers if that's a concern.

This looks really good!
What would it take to also integrate the tracking capabilities of SAM 2?

Well, tracking is not super compatible with stateless services. I guess it would require a "per-session" non-stateless service (or 1 instance per N sessions and we pass the session ID in the request). Note that SAM2 large model uses about 2GB VRAM, which is less memory complex than SAM1.

Well, I can see two ways..
I think the best approach would be to return the SAM2 memory bank queue to the user or a DB. This way, we could ensure the SAM2 service is stateless. At the moment I ignore the overhead of doing so, but the article states that the memory banks is composed of "spatial feature maps" and " lightweight vectors for high-level semantic information". The spatial feature maps transfer GPU -> CPU -> Network might be a bottleneck here depending on their size.

我认为最好的方法是将 SAM2 内存组队列返回给用户或数据库。这样，我们就可以确保 SAM2 服务是无状态的。目前，我忽略了这样做的开销，但文章指出，内存库由“空间特征图”和“用于高级语义信息的轻量级向量”组成。空间特征图传输 GPU -> CPU -> 网络可能是这里的瓶颈，具体取决于它们的大小。
我可以帮助实现这一目标。
文章在这里

I tried but didn't use this, which resulted in every click requiring a resend of the request to reason
https://github.com/cvat-ai/cvat/pull/6019

@KTXKIKI you're right. There is currently a big overhead related to the request being sent for each click. I underestimated the request bottleneck, especially for large images. I thought that it could be viable, given that SAM2 inference is faster than SAM1.
I'll suggest an improvement tonight.

@KTXKIKI I wont be able to produce the solution tonight. It would require to write a new cvat_ui plugin to decode the SAM2 embeddings using onnxruntime-web, just like it has been done for SAM1 here. It would also require to export the SAM2 decoder in onnx format.
This thread is an excellent starting point: https://github.com/facebookresearch/segment-anything-2/issues/3

我今晚无法提供解决方案。它需要编写一个新的 cvat_ui 插件来使用 onnxruntime-web 在客户端解码 SAM2 嵌入，就像对 SAM1 所做的那样 （cvat-ui/plugins/sam/src/ts/index.tsx）。它还需要以 onnx 格式导出 SAM2 解码器。
这个线程是一个很好的起点：facebookresearch/segment-anything-2#3

I think we need the help of official CVAT personnel

Hi @jeanchristopheruel, thanks for your great work. As far as I understood, you added SAM2 as an interactor tool, which is working the same way as SAM does. However, the biggest improvement of SAM2 is the video tracking. Even if we somehow implement SAM2 as a tracker, CVAT UI would require us to manually go to the next frame one by one. But SAM2 video tracker is capable of tracking the object over the whole video after the first frame and points are selected. Do you know if it's possible to merge that functionality with CVAT? Is that supported somewhere in the UI at all?

It is possible to integrate SAM2 for video tracking with its featured memory embeddings. It would require to write a new cvat_ui plugin to decode the SAM2 embeddings (encoded featuremap & memory bank) client-side using onnxruntime-web. This would allow the full serverless compatibility with nuclio and ensure scalability (stateless) for cloud applications.
Alternatively, for your own interest, you can modify the SAM2 model_handler.py to maintain the state of the last processed image and you can add a REST endpoint to clear the state on demand. This alternative is NOT clean and should be used only with single session.

Hi, this looks great. I noticed that there isn't a function.yaml for serverless without gpu. Any reason for that?

Hi, this looks great. I noticed that there isn't a function.yaml for serverless without gpu. Any reason for that?

I don't think SAM2 can work without a GPU.
@jeanchristopheruel also said in the PR:
Note: Segment Anything 2.0 require to compile a .cu file with nvcc at build time. Hence, a cuda devel baseImage is required to build the nuclio container and no support available for CPU. This is GPU only.

I don't think SAM2 can work without a GPU.

See the thread at https://github.com/facebookresearch/segment-anything-2/pull/155

I don't think SAM2 can work without a GPU.

See the thread at facebookresearch/segment-anything-2#155

Great, thanks for sending it!

I don't think SAM2 can work without a GPU.

See the thread at facebookresearch/segment-anything-2#155

@ozangungor12, @bhack and @realtimshady1, I  added support for cpu based on this. Thanks for the info.

@jeanchristopheruel , we will be happy to merge the version of SAM2 into CVAT open-source repository. Need to say that our team implemented optimized version of SAM2: https://www.cvat.ai/post/meta-segment-anything-model-v2-is-now-available-in-cvat-ai. It will be available on SaaS for our paid customers and for Enterprise customers.

Thanks for your response. However, I’m disappointed to see that key advancements like SAM2 are becoming restricted to paid users. CVAT has always been a strong open-source tool, and limiting such features seems to move away from that spirit. I hope you will reconsider and keep these innovations accessible to the broader open-source community.

@jeanchristopheruel , I would make all features open-source if it were possible. However, delivering new and innovative features to the open-source repository, such as the YOLOv8 format support (https://github.com/cvat-ai/cvat/pull/8240), and addressing security issues and bugs, requires financial backing. To sustain this level of development, we rely on the support of paying customers. The best way to help CVAT continue thriving is by purchasing a SaaS subscription (https://www.cvat.ai/pricing/cloud) or becoming an Enterprise customer (https://www.cvat.ai/pricing/on-prem).
It's worth noting that around 80% of our contributions go directly into the open-source repository.

@nmanovic, I understand the need for financial support to sustain development, and I appreciate all the work your team does. However, history has shown that moving key features behind paywalls can sometimes alienate open-source communities. For example, when Elasticsearch restricted features, it led to the community forking it into OpenSearch.
I hope CVAT can find a balance that supports both its financial needs and keeps innovation accessible to the open-source community, as that's what has made CVAT so valuable to so many.

For those with stronger frontend skills, I recommend checking out this repository, which contains a complete frontend implementation of SAM2.
I also attempted a frontend implementation, and you can find my initial trial here. It's still a work in progress, but feel free to take a look.

Another possible and very useful feature with models like SAM and SAM2 would be precision annotation in bounding boxes.
The idea is to make an imprecise bounding box around the object to be annotated. The bounding box is sent to the SAM or SAM2 model, which segments the main object from the bounding box it receives. Finally, the precise bounding box is recreated by taking the extremum coordinates at the top, left, bottom, right.
This would allow very quick and precise annotating, without having to zoom in on the image (very useful for precise annotation of small objects for example).
In my free time, I made a python script using this logic with SAM to make precision annotation, taking as input an annotation json (COCO format I think) and which output a json in the same format, with the precise bounding boxes recalculated.
I could make it available to you if necessary.

@Youho99 Very cool indeed! I suggest you create a separate issue to express your feature idea.🙂

@Youho99 Very cool indeed! I suggest you create a separate issue to express your feature idea.🙂

Done ✔ https://github.com/cvat-ai/cvat/issues/8326

For those with stronger frontend skills, I recommend checking out this repository, which contains a complete frontend implementation of SAM2 using onnxruntime-web/webgpu.
I also attempted a frontend implementation, and you can find my initial trial here. It's still a work in progress, but feel free to take a look.

@tpsvoets The current PR adds support for an encoder-decoder sam2 backend, which makes the thing slower than sam1 plugin due to the request overhead. (Sam1 plugin has the decoder running in frontend).
Can't give a timeline for sam2 encoder-decoder frontend support since I am not currently working on it.


Issues  label:Issue-Question  Uninstall Windows Powershell

Does the Powershell included in Windows 10 as well as Powershell ISE versions need to be uninstalled or removed from Windows prior to installing v7? Or can all versions run simultaneously?
Thanks!

Versions 6 and above can all be installed side-by side with Windows PowerShell. 🙂

Got it. Is there any reason to keep the old versions of Powershell and Powershell ISE installed? I believe they are removed through the turn on/off optional components, right? If I uninstall the old versions in favor of v7, will anything in windows be broken?

Yeah, many windows components are reliant on v5 of PowerShell I'd guess.
I'm not really sure you actually can uninstall it, tbh.

That is exactly what I wanted to know. I will leave the old PowerShell version. Thank you for your help!

Thank you.


shouldResolveConsistentlyWith fails dependency resolution with project dependency substitution.

Expected Behavior
Given two Gradle projects: consumer and producer
Given the following dependencies:
// consumer
dependencies {
    implementation(project(":producer"))
}

//producer
dependencies {
    implementation("org.sample:consumer:1.0.0")
}

where:
"org.sample:consumer:1.0.0" is referencing a publication of 'consumer' of a higher version number
then
introducing a dependency consistency scope
(e.g. calling implementation.shouldResolveConsistentlyWith)
shall be able to replace the dependency to consumer:1.0.0 with the dependency project
Current Behavior
However, the current behaviour will lead to
* What went wrong:
Execution failed for task ':consumer:reproduceIssue'.
> Could not resolve all files for configuration ':consumer:implementation'.

as soon as
implementation.shouldResolveConsistentlyWith(implementationConsistencyScope)
is called
Context (optional)
This issue appeared in Kotlin Gradle Plugin in 1.9, since Kotlin 1.9 was using shouldResolveConsistentlyWith.
The user project has this uncommon configuration where it started failing because of it.
Issue report on the Kotlin Gradle Plugin:
https://youtrack.jetbrains.com/issue/KT-59591/Gradle-MPP-transformCommonMainDependenciesMetadata-does-not-resolve-transitive-dependencies-on-1.9.0-Beta-RC
Steps to Reproduce
A minimized reproducer (without any Gradle plugins, vanilla Gradle) can be found here:
https://github.com/sellmair/kotlin-multiplatform-projects/tree/KT-59591/Gradle-MPP-transformCommonMainDependenciesMetadata-does-not-resolve-transitive-dependencies-on-1.9.0-Beta-RC
Zip of the repo above:
gradle-25525.zip
calling
./gradlew reproduceIssue will showcase the issue.
Gradle version
8.1.1
Build scan URL (optional)
No response
Your Environment (optional)
No response

Sorry for the late reply.
While I am still following up on the resolution error, which is unexpected, I can already reply to the project vs. binary dependency selection.
As is standard for Gradle, the highest version will win. If your consumer project is at 0.5.0 and the published one is at 1.0.0, then the published one wins.
There is the option to always prefer project modules if that resolution mechanism does not work for you.

The issue is in the backlog of the relevant team, but the existence of a workaround makes it non-critical, so it might take a while before a fix is made.


Use Case: Generate Printable Map PDF

This use case refers to #1 about printing maps onto a PDF and provide meta information in the header or footer

Basics

[ ] Details of what you changed are in commit messages
(first line should have module: short statement syntax)
[ ] References to issues, e.g. close #X, are in the commit messages.
[ ] The buildserver is happy.
[ ] The PR is rebased with current master.

Checklist

[ ] I added unit tests for my code
[ ] I fully described what my PR does in the documentation
(not in the PR description)
[ ] I fixed all affected documentation
[ ] I fixed all affected decisions
[ ] I added code comments, logging, and assertions as appropriate
[ ] I mentioned every code or binary not directly written or done by me in reuse syntax

Review

[ ] Documentation is conforming to our Documentation Guidelines
[ ] Examples are well chosen and understandable
[ ] Code is conforming to our Coding Guidelines
[ ] Code is consistent to our Design Decisions

Now part of #366


[Next.js][Multi-project] Dynamic assets resolution

Description / Motivation

Pre-compile styles during bootstrap stage
Watch components under src/projects/<project>/components folders
Generate project components index files under src/temp/projects/<project>.ts

Testing Details

Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Requested another round of PR review, since new approach for css generation is added


Update to V2.0.0

Overall Review of Changes:
Update to CIS version 2.0.0 for ubuntu22
Do not migrate
CIS have rewritten with a full release including but not limited to

reordering
new sections and controls in differing sections

This is a rewrite off approx 75% of controls

New variables
improved audit related checks
greater options on some controls
linting improvements

How has this been tested?:
Manually, piepline and subscription users

Replaced by #255


Question: Does it remove the changes from dependant PRs when reviewing in the Files section ?

Scenario:
feature A depends on feature B
I make PR to master from B and then make another PR to master from A.
Usually what happens at this point is that if I go and review the file changes in A I will see the changes from B plus the changes of A.
The desired/expected behavior with this bot would be that If I go to the file changes of A I should not see the changes from B.
Is this the behavior of this bot?

No. This action has no control over the changes you see. It only updates labels and commits statuses.
If you want to view more relevant changes you might want to consider changing the PR base branch.


08/17/2018 01:42 : Create Pull Request for branch master -> prTesting1_2018081701

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

split/updateTestRef1.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Cancel scheduled events

Currently, events can be scheduled like so:
await client.sendEvent({
  name: "user.created",
  payload: { name: "John Doe", email<EMAIL_ADDRESS>paidPlan: true },
  deliverAt: new Date('2024'),
});

I want the ability to cancel them.
Either an identifier should be provided as an argument to the function or returned by it so that it can later be referenced when the scheduled event should be canceled.
Alternatively, there should be a completely separate API for scheduling events.

You can already provide an ID for the event in sendEvent:

But yea it would be great to add an API for this as well 👍

The way we could do this is add a jobKey here, using the event ID:
https://github.com/triggerdotdev/trigger.dev/blob/8b09dfd697270a77d96e6a7ef947869a4f4da0cb/apps/webapp/app/services/events/ingestSendEvent.server.ts#L94
Then we'd need to add a public function to ZodWorker that allows jobs to be deleted with the jobKey as the parameter. This would use the Graphile Worker remove jobs SQL to remove the job.

/bounty $50

/attempt #230

You can already provide an ID for the event in sendEvent:

But yea it would be great to add an API for this as well 👍

What about time zones?

@ericallam Can I work on this one?

/attempt #230

/attempt #230

When I send an event with deliverAt date, the job runs immediately.
const eventDetails = await client.sendEvent({
name: "person.create",
payload: { name: "Ramkumar", email<EMAIL_ADDRESS>},
deliverAt: new Date('2023', '8', '14', '21', '40', '0'),
});

in eventDetails I got, seems like deliverAt date which I given is not working. anything am I missing @ericallam Need your guidance.
{
id: 'cllb2iqcq00jwczroj65c597p',
name: 'person.create',
payload: { name: 'Ramkumar', email<EMAIL_ADDRESS>},
context: {},
timestamp: 2023-08-14T16:07:16.200Z,
deliverAt: 2023-08-14T16:07:16.200Z,
deliveredAt: null
}

@RamK777-stack you need to call sendEvent and pass the deliverAt as an option to a second parameter of sendEvent, like so:
const eventDetails = await client.sendEvent(
  {
    name: "person.create",
    payload: { name: "Ramkumar", email<EMAIL_ADDRESS>},
  },
  {
    deliverAt: new Date("2023", "8", "14", "21", "40", "0"),
  }
);

Also see these docs for more: https://trigger.dev/docs/sdk/triggerclient/instancemethods/sendevent

@ericallam Thanks I got it. now it's working but it's not visible in the dashboard. visible only after a successful run. I think that needs to be worked on and comes under the below section, am I right?

@RamK777-stack yea we need to add a top level section to the project dashboard for "Events" here:

This will list all the events and if they've been delivered or when they'll be delivered

Thanks @ericallam


perf: micro optimizations

The optimizations are mostly targeting decoding or encoding FIT File using localMessageNum 0 (for both normal header or compressed timestamp header).
Here is the benchstat when decoding testdata/from_official_sdk/activity_lowbattery.fit (since it uses localMessageNum 0):
goos: darwin
goarch: amd64
pkg: github.com/muktihari/fit/decoder
cpu: Intel(R) Core(TM) i5-5257U CPU @ 2.70GHz
         │  old2.txt   │              new2.txt               │
         │   sec/op    │   sec/op     vs base                │
Decode-4   13.58m ± 3%   11.97m ± 4%  -11.88% (p=0.000 n=10)

         │   old2.txt   │              new2.txt               │
         │     B/op     │     B/op      vs base               │
Decode-4   5.298Mi ± 0%   5.297Mi ± 0%  -0.03% (p=0.000 n=10)

         │  old2.txt   │              new2.txt              │
         │  allocs/op  │  allocs/op   vs base               │
Decode-4   76.22k ± 0%   76.20k ± 0%  -0.03% (p=0.000 n=10)

Here is the benchstat when encoding test defined FIT File:
goos: darwin
goarch: amd64
pkg: github.com/muktihari/fit/encoder
cpu: Intel(R) Core(TM) i5-5257U CPU @ 2.70GHz
                                     │   old.txt    │               new.txt                │
                                     │    sec/op    │    sec/op     vs base                │
Encode/normal_header_zero-4            85.75m ±  3%   87.10m ± 25%        ~ (p=0.971 n=10)
Encode/normal_header_15-4              89.67m ± 24%   80.00m ± 11%  -10.79% (p=0.007 n=10)
Encode/compressed_timestamp_header-4   79.28m ± 13%   72.77m ±  2%   -8.20% (p=0.001 n=10)
geomean                                84.79m         79.74m         -5.96%

                                     │   old.txt    │               new.txt               │
                                     │     B/op     │     B/op      vs base               │
Encode/normal_header_zero-4            3.134Mi ± 0%   3.113Mi ± 0%  -0.65% (p=0.000 n=10)
Encode/normal_header_15-4              3.049Mi ± 0%   3.057Mi ± 0%       ~ (p=0.749 n=10)
Encode/compressed_timestamp_header-4   2.342Mi ± 0%   2.327Mi ± 0%  -0.65% (p=0.000 n=10)
geomean                                2.818Mi        2.808Mi       -0.34%

                                     │   old.txt   │               new.txt                │
                                     │  allocs/op  │  allocs/op   vs base                 │
Encode/normal_header_zero-4            103.5k ± 0%   102.5k ± 0%  -0.96% (p=0.000 n=10)
Encode/normal_header_15-4              101.0k ± 0%   101.0k ± 0%       ~ (p=1.000 n=10) ¹
Encode/compressed_timestamp_header-4   103.5k ± 0%   102.5k ± 0%  -0.96% (p=0.000 n=10)
geomean                                102.7k        102.0k       -0.64%
¹ all samples are equal

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (9811e7f) 99.89% compared to head (d034227) 99.89%.

Additional details and impacted files
@@           Coverage Diff           @@
##           master      #98   +/-   ##
=======================================
  Coverage   99.89%   99.89%
=======================================
  Files          43       43
  Lines        3965     3984   +19
=======================================
+ Hits         3961     3980   +19
  Misses          4        4

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


[docs] Add missing prop descriptions to all components (WIP)

[x] PR has ~tests~ / docs demo, and is linted.
[x] Commit and PR titles begin with [ComponentName], and are in imperative form: "[Component] Fix leaky abstraction".
[x] Description explains the issue / use-case resolved, and auto-closes the related issue(s) (http://tr.im/vFqem).

@oliviertassinari I have marked some with TODO (hopefully your editor automatically discovers & highlights these?). Would appreciate your thoughts on those.

Pulling out some replies that have been hidden by GitHub:
TouchRipple:

It's determining if the ripple start at the center of the component or at the mouse interaction location.

I thought they were always supposed to be centered at the interaction: "Ink ripples confirm user input by immediately expanding outward from the point of touch. "?https://material.io/guidelines/motion/material-motion.html#material-motion-how-does-material-move
Doesn't look like it's used anywhere other than an option in ButtonBase ( doesn't explicitly define this prop), but I'll document it as-is. And we can decide later whether it's a useful feature.
ListItemAvatar:

What do you have in mind by according to the platform? Isn't something depending on the context, not the platform?

I had assumed (incorrectly) that this component would only apply the style if this.context.dense is true (I should have read the code!), and was anticipating that an app might set dense depending on whether it was being used on desktop or mobile. In this case a warning would fire if the developer was emulating mobile.
Looking at the docs demo, I see @kybarg used a ternary to determine whether Avatar is wrapped.
Instead, I think we should change this component to only apply the dense style if requested by context, and update the warning to only fire if dense context is undefined, and simplify the demo. If you agree, I'll pick this up in a separate PR.
ListItem:

But yes, I feel like we could kill the property.

It seems it is being used in docs AppDrawerNavItem. Not quite sure why it's needed, but I'll leave it for now.

I'm also having a concern with the default property being true.

There are quite a few of these. I might tackle them in another PR.

I thought they were always supposed to be centered at the interaction:

The ripple isn't centered with the IconButton. The use case sounds good to me.

Instead, I think we should change this component to only apply the dense style if requested by context, and update the warning to only fire if dense context is undefined, and simplify the demo. If you agree, I'll pick this up in a separate PR.

That sounds good to me 👍

It seems it is being used in docs AppDrawerNavItem. Not quite sure why it's needed, but I'll leave it for now.

Good catch. Should we rename the property? Ok, let's tackle that into another PR 👍

The ripple isn't centered with the IconButton.

Ah, good point.

Breaking change:
CardHeader: subhead -> subheader.

@oliviertassinari Rebased and further updates added.


Webpage font size too large on HIDPI screen.

Checklist

[*] I have verified that that issue exists against the master branch of Thank you open source.
[*] I have searched for similar issues in both open and closed tickets and cannot find a duplicate.
[*] I have included basic info like browser version, system version. (Occurs on Chrome Stable 74, Windows 10 1903. This is a 4k monitor of size 27 inch.)

Steps to reproduce
Open the page.
Expected behavior
Font size should be normal, at most 30 px for normal text to make it comfortable to read.
Actual behavior
Font size is too large to read. See this .

Thank you. This bug had been fixed in pull-request-12.

Thank you. This bug had been fixed in pull-request-12.

Thanks!


fix: handle MissingToken from php parser

Codecov Report

Merging #47 (bdabea8) into main (e6b1129) will not change coverage.
The diff coverage is 91.66%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
@@            Coverage Diff            @@
##               main      #47   +/-   ##
=========================================
  Coverage     82.36%   82.36%
- Complexity      977      979    +2
=========================================
  Files            45       45
  Lines          2467     2467
=========================================
  Hits           2032     2032
  Misses          435      435

Impacted Files
Coverage Δ

src/DefinitionResolver.php
87.00% <88.88%> (ø)

src/CompletionProvider.php
94.23% <100.00%> (ø)

src/TreeAnalyzer.php
94.69% <100.00%> (ø)


Validation: wrap local chain info maps with mutexes

Appears that there's a race when attempting to update local chain ID/Name maps from multiple tests which are kicked off concurrently.
Also refactored the code a bit to wrap the global vars into a struct

Checklist

[ ] ~I have declared the chain at the appropriate Superchain Level.~
[x] I have run just validate <chain-id> locally to ensure all local validation checks pass.
[x] I have run just codegen to ensure that the chainlist and other generated files are up-to-date and include my chain.

ref: https://github.com/ethereum-optimism/superchain-registry/issues/668

Did you consider using https://pkg.go.dev/sync#Map ?

Thanks for the suggestion, agree that's much simpler to use for this case and modified code accordingly.


feature add tcc grpc sample

this pr will close #199

Codecov Report

Merging #200 (c470ecc) into master (ea5002a) will increase coverage by 0.01%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master     #200      +/-   ##
==========================================
+ Coverage   64.29%   64.31%   +0.01%
==========================================
  Files          48       48
  Lines        2028     2029       +1
==========================================
+ Hits         1304     1305       +1
  Misses        660      660
  Partials       64       64

Impacted Files
Coverage Δ

pkg/rm/tcc/tcc_service.go
65.62% <100.00%> (+0.21%)
:arrow_up:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Add 'Chat' button to transaction row

Clean up some logic in transaction row, as well as their stories.


⚠ ClamAV has degraded performance

In bd505a3, ClamAV (https://spamassassin.apache.org/) experienced degraded performance:

HTTP code: 200
Response time: 464 ms

Resolved: ClamAV performance has improved in 25c0127.


[WIP] - Add fine-grained health validation for Airflow APIs

Describe your changes:
Fixes #11322, since the /health endpoint gives us the version, and adds further validation logic on health status

I worked on ... because ...

Type of change:

[ ] Bug fix
[ ] Improvement
[ ] New feature
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Documentation

Checklist:

[x] I have read the CONTRIBUTING document.
[ ] My PR title is Fixes <issue-number>: <short explanation>
[ ] I have commented on my code, particularly in hard-to-understand areas.
[ ] For JSON Schema changes: I updated the migration scripts or explained why it is not needed.

this will require some UI changes. Leaving this open until we can merge all the work at once since it changes the logic cc @chirag-madlani @Sachin-chaurasiya


activeadmin.emai

how put on collection my activeadmin.email so that i will know who is the one input the information

@jameskyokushin Since this is a support request would you mind re-posting this on our Google Group (http://groups.google.com/group/activeadmin)?
We're trying to limit Github Issues to Bugs and Features to keep it nice and clean.
Thanks!


06/11/2018 04:30 : Create Pull Request for branch master -> prTesting1_2018061104

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

split/updateTestCon1.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Surprising behaviour of cancelling requests

Reported in https://github.com/Moya/Moya/pull/530#issuecomment-231418477 , we should consistently calling the failure block when cancel.

Since #531 is taking care of this, we can close this one.


Toggling line comment on certain file types breaks when there is already a comment

VSCode Version: 1.12.2
OS Version: Windows 10

Steps to Reproduce:

Take the following CSS code:

paper-item {
	 height: 10px;
	 color: var(--komed-font-color-blue);
	/*border: solid;*/
	/*border-width: 1px;*/
	 margin-left: 3%;
	 font-size: 14px;

}

If I toggle line comment now on line 3 to 6 (select the lines and press the command shortcut for line comment)
Then the comments actually break because there already was some comments

paper-item {
	 height: 10px;
	 color: var(--komed-font-color-blue);
	border: solid;*/
	/*border-width: 1px;
	 margin-left: 3%;
	 font-size: 14px;

}

This only happens to file extensions where there is no actual "line comment". So CSS for example or HTML. For a JS file the editor fills in the appropriate amount of // comments

@BorntraegerMarc What was the result you expected?

The toggle block comment command is implemented by looking only at the selection edges.
:+1: PR for improvements welcome in BlockCommentCommand

@aeschli I expected that every line I selected would have been commented out. So before AND after the existing comment. So basically line 3-6 in my example.


Add http UGIAssuming handler wrapper for kerberos enabled restful frontend service

Why are the changes needed?

Wrap the http handler with PrivilegedAction for kerberos enabled use case.
How was this patch tested?

[ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

[ ] Add screenshots for manual tests if appropriate

[ ] Run test locally before make a pull request

Codecov Report

Merging #2300 (8070d13) into master (82a024a) will decrease coverage by 0.01%.
The diff coverage is 82.14%.

@@             Coverage Diff              @@
##             master    #2300      +/-   ##
============================================
- Coverage     62.25%   62.23%   -0.02%
  Complexity       69       69
============================================
  Files           353      354       +1
  Lines         16757    16777      +20
  Branches       2269     2273       +4
============================================
+ Hits          10432    10442      +10
- Misses         5366     5372       +6
- Partials        959      963       +4

Impacted Files
Coverage Δ

...thentication/KyuubiHttpAuthenticationFactory.scala
80.00% <80.00%> (ø)

...ache/kyuubi/server/KyuubiRestFrontendService.scala
93.33% <100.00%> (+0.22%)
:arrow_up:

...cala/org/apache/kyuubi/server/ui/JettyServer.scala
86.95% <100.00%> (+0.41%)
:arrow_up:

...org/apache/kyuubi/ha/client/ServiceDiscovery.scala
89.28% <0.00%> (-3.58%)
:arrow_down:

...rg/apache/kyuubi/engine/trino/TrinoStatement.scala
67.46% <0.00%> (-2.41%)
:arrow_down:

...ache/kyuubi/operation/KyuubiOperationManager.scala
94.11% <0.00%> (-1.97%)
:arrow_down:

.../org/apache/kyuubi/engine/hive/HiveSQLEngine.scala
70.00% <0.00%> (-1.67%)
:arrow_down:

...a/org/apache/kyuubi/plugin/SessionConfAdvisor.java

...pache/kyuubi/plugin/DefaultSessionConfAdvisor.java

...a/org/apache/kyuubi/plugin/SessionConfAdvisor.java
100.00% <0.00%> (ø)

... and 1 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 82a024a...8070d13. Read the comment docs.

cc @yaooqinn

Possible to add some UT with kerberos tests?

Possible to add some UT with kerberos tests?

Have added before, KyuubiRestAuthenticationSuite

thanks, merging to master


Make repo into a Github action

Haven't done this before, so kinda yolo.

Rewrote bash into js
Added action boilerplate

Kinda losing steam on this rn (starting to feel silly), but should be a good jumping off point if we actually want it. :)

I'm not sure we need this, I actually like the script-iness of it all ;)


Bug: [CI] - Lint Documentation doesn't runs automatically

Expected Behavior

Lint Documentation CI action should be triggered for each PR in docs/main.
Current Behavior

It's triggered when doing manual PRs. But automated PRs doesn't trigger the action even if it it required in the PR policies for the target branch.
Steps to Reproduce

See https://github.com/CGI-FR/IoT-Hub-Portal/pull/1244 for example.

There is a limitation on github to prevent infinite loop between ci job.
In our case, this bug results of the usage of the token secrets.GITHUB_TOKEN by task peter-evans/create-pull-request@v4.
We need to replace the token used peter-evans/create-pull-request by a scoped repo token to allow pull resquests to trigger any required workflows.
See : https://github.com/peter-evans/create-pull-request/issues/48#issuecomment-536204092

@hocinehacherouf I send you in PM the App ID and credentials...


Upping java.build.version to 11 for TAB-8176 (Jetty 10 upgrade)

I'm thinking that the version should change to 6.x for JDK 11 (turns out that 5.x was already JDK 8)
Suggestions welcome


Not able to communicate with MQTT

I followed same procedure as given in the python sample application. While running this module on my raspberry pi board i see below error.
Sending message: {'temperature': 33.46,'humidity': 75.37, 'Timestamp': November 21, 2018 - 01:35:10PM}
Sending message: {'temperature': 30.51,'humidity': 70.45, 'Timestamp': November 21, 2018 - 01:35:25PM}
Error: Time:Wed Nov 21 13:35:31 2018 File:/usr/sdk/src/c/iothub_client/src/iothubtransport_mqtt_common.c Func:InitializeConnection Line:2195 mqtt_client timed out waiting for CONNACK
File:/usr/sdk/src/c/iothub_client/src/iothubtransport_mqtt_common.c Func:InitializeConnection Line:2195 mqtt_client timed out waiting for CONNACK
Please help me how to resolve this.

@Venug1234 Could you share the documentation link that you are following?

@Venug1234 Since we didn’t hear back from you, we will now proceed to close this thread. If there are further questions regarding this matter, please comment and we will gladly continue the discussion.
Also, I suggest you, create a forum thread by choosing the service on which you are trying this for better visibility.


Account not Character

It's a great extension. However, I suggest binding the reagent bank to the account and not to the character.

Thank you for the suggestion! I will investigate add this as a config option. For now, though, I have seen a fork of this module that links the bank to accounts instead of characters - you can find it here:
https://github.com/jintaoforone/mod-reagent-bank-account

Thank you very much for the link! It's exactly what I was looking for.
Nevertheless, I still have a suggestion: Is it possible to declare the reagent store as an inventory? So that one can use the reagents that are stored there.
I realize that would be a significant change, but it would be awesome.
Regards
Michael
Gesendet von Mailhttps://go.microsoft.com/fwlink/?LinkId=550986 für Windows
Von: @.>
Gesendet: Mittwoch, 30. November 2022 01:43
An: @.>
Cc: @.>; @.>
Betreff: Re: [ZhengPeiRu21/mod-reagent-bank] Account not Character (Issue #6)
Thank you for the suggestion! I will investigate add this as a config option. For now, though, I have seen a fork of this module that links the bank to accounts instead of characters - you can find it here:
https://github.com/jintaoforone/mod-reagent-bank-account
—
Reply to this email directly, view it on GitHubhttps://github.com/ZhengPeiRu21/mod-reagent-bank/issues/6#issuecomment-1331500976, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AW74AB6WQQZN3UYAQEZ5XZ3WK2PMHANCNFSM6AAAAAASLSZ24A.
You are receiving this because you authored the thread.Message ID: @.***>


Vectorizing pandas Date Functions

pandas has great methods for manipulating index dates, which works well for timeseries data. But for other kinds of data, to manipulate a date column you have to use lambda (or set that column to be the index).  For example, a lot of the beginners I'm training work with transactional data that looks something like this:
purchases = pd.DataFrame({
'Purchase_Date': ['9/9/2013', '9/9/2013', '9/10/2013', '9/28/2013', '10/6/2013', '10/7/2013',
'10/18/2013', '10/18/2013', '11/1/2013'],
'Delivery_Date': ['9/11/2013', '9/11/2013', '9/18/2013', '10/2/2013', '10/8/2013', '10/8/2013', '10/22/2013', '10/22/2013', '11/8/2013'],
'Size': ['Medium', 'Small', 'Large', 'Small', 'Medium', 'Small', 'Large', 'Medium', 'Small'],
'Color': ['Red', 'Blue', 'Green', 'Red', 'Red', 'Green', 'Purple', 'Purple', 'Black']})

Here's what you have to do now to get the delivery purchase month:
purchases["Delivery_Month"] = purchases["Delivery_Date"].apply(lambda x: pd.to_Datetime(x).month)

For beginners who don't have a science or programming background, using apply and lambda is pretty confusing. And since one of the first things these beginners want to do is analyze their data by dates, it's a potential stumbling block to their adopting pandas.
It would be great if date functions could be vectorized the way strings have so that for example you could instead write:
purchases["Delivery_Month"] = purchases["Delivery_Date"].month

I think this change might help make pandas more accessible to a wider audience. For example, as part of Data Chefs, I'm working with a group of folks to create an online course and cookbook on slicing & dicing data with pandas. Having vectorized date functions would remove a small but important barrier to our target audience becoming comfortable using pandas.

you mean like this? http://pandas.pydata.org/pandas-docs/version/0.15.1/basics.html#basics-dt-accessors

Excellent!  That's exactly what I was looking for.


Add passed test cases 63 and 67

I think 63 and 67 has problem,
So I create issue about these at common-workflow-language repository.

thanks

I don't think you should create issues on CWL repo.


[#3305] Add enchantment usage dialog & application tray

Introduces enchantment to the AbilityUseDialog using the applyEnchantment and enchantmentProfile options, with similar details to how summoning is handled.

When enchantment is performed it adds a new "Enchant" tray to chat cards. This tray has a place to drop an item which is then enchanted when the apply button is pressed.

Enchantments are tracked with concentration, so if concentration on the enchanting spell ends then the enchantments will be removed.

Enchantments are tracked with concentration, so if concentration on the enchanting spell ends then the enchantments will be removed.

Are enchantments intended to work only with items that require concentration?

Enchantments are tracked with concentration, so if concentration on the enchanting spell ends then the enchantments will be removed.

Are enchantments intended to work only with items that require concentration?

Nope. That just means if you are enchanting from an item with concentration it will link them, but otherwise you can enchant normally. Eventually there will be a way to end non-concentration enchantments from the item that provided them, but that’s not implemented yet

@Fyorl I made a change so now the chat card remembers what enchantments were added using it, rather than losing them on re-render and gave them a remove enchantment button. This does result in the chat card becoming potentially longer if multiple items are enchanted with it, so I wonder if it might make sense to move the enchanted items back into a tray and maybe only have the drop area out of it?


has no exported member 'MatSnackBarModule'

Bug, feature request, or proposal:
error in documentation for the "snack-bar" at:
https://material.angular.io/components/snack-bar/api
What is the expected behavior?
import {MdSnackBarModule} from '@angular/material';
What is the current behavior?
import {MatSnackBarModule} from '@angular/material';

This is working as expected after the latest (beta.11) release


Is possible for FileSystemWatcher to watch for Folder/File Opened?

Hi @nicolas-raoul  @hmemcpy  @dwmkerr  @overengineered
I want the FileSystemWatcher to watch Folder/File opened. Is this possible?

Any help?

This has nothing to do with SharpShell, right?
Please close and ask on StackOverflow instead. Cheers!

@nicolas-raoul
Sorry, I was intended to ask this question regarding CMIS Sync Repository

Looks like this can be closed, but please re-open if needed.


Update typos in bond-incentives.md

Description
Update small typos in specs.

The original is correct.  iff means if and only if.


Making a new sticky navbar

I'll make a new appealing navbar for the website.

I'll make a new appealing navbar for the website.

Can you share any design you have in mind @SushantPatial

Something like this with a bigger font

i want to work

Something like this with a bigger font

Will also add a background to the navbar as you scroll down the hero

Okay, go ahead! :)  @SushantPatial


Serializing fields with F expressions doesn't work

I'm using django-auditlog to track the changes in a model Pack that has a quantity field. To avoid potential race conditions I update that field with Django's F expressions. However, when I save the model instance, I get a ValidationError with “F(quantity) + Value(1)” value must be an integer..
Example:
from auditlog.registry import auditlog
from django.db import models

class Pack:
    quantity = models.PositiveSmallIntegerField()

auditlog.register(Pack, serialize_data=True)

pack = Pack.objects.first()
pack.quantity = models.F('quantity') + 1
pack.save()

Exception: django.core.exceptions.ValidationError: ['“F(quantity) + Value(1)” value must be an integer.']

This only happens when serialize_data=True. Is there a way to work around this issue?

Thanks @mcanu for reporting.
@sum-rock Could you please take a look?

I've investigated the problem and the error comes from the below line in _get_copy_with_python_typed_fields
https://github.com/jazzband/django-auditlog/blob/875c6b789f1dccacfd8c0568e050768fe5572636/auditlog/models.py#L276
So, I think we can add try ... except on this line and prevent adding fields that have a problem in serialized_data.
There might be a better way to handle it. @sum-rock do you have any idea?


download_photos.py tries to connect to non-existing host p48-photosws.icloud.com

Login and 2-factor auth succeeded:
$ ./download_photos.py ./dest/ --username<EMAIL_ADDRESS>--password XXXXXXXX --size original
Signing in...
Updating photos...
Traceback (most recent call last):
  File "./download_photos.py", line 231, in <module>
    download()
  File "/home/hreese/src/icloud_photos_downloader/venv/lib/python2.7/site-packages/click/core.py", line 722, in __call__
    return self.main(*args, **kwargs)
  File "/home/hreese/src/icloud_photos_downloader/venv/lib/python2.7/site-packages/click/core.py", line 697, in main
    rv = self.invoke(ctx)
  File "/home/hreese/src/icloud_photos_downloader/venv/lib/python2.7/site-packages/click/core.py", line 895, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/hreese/src/icloud_photos_downloader/venv/lib/python2.7/site-packages/click/core.py", line 535, in invoke
    return callback(*args, **kwargs)
  File "./download_photos.py", line 55, in download
    updatePhotos(icloud)
  File "./download_photos.py", line 155, in updatePhotos
    icloud.photos.update()
  File "/home/hreese/src/icloud_photos_downloader/venv/lib/python2.7/site-packages/pyicloud/base.py", line 306, in photos
    self.params
  File "/home/hreese/src/icloud_photos_downloader/venv/lib/python2.7/site-packages/pyicloud/services/photos.py", line 35, in __init__
    params=self.params
  File "/home/hreese/src/icloud_photos_downloader/venv/lib/python2.7/site-packages/requests/sessions.py", line 515, in get
    return self.request('GET', url, **kwargs)
  File "/home/hreese/src/icloud_photos_downloader/venv/lib/python2.7/site-packages/pyicloud/base.py", line 67, in request
    response = super(PyiCloudSession, self).request(*args, **kwargs)
  File "/home/hreese/src/icloud_photos_downloader/venv/lib/python2.7/site-packages/requests/sessions.py", line 502, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/hreese/src/icloud_photos_downloader/venv/lib/python2.7/site-packages/requests/sessions.py", line 612, in send
    r = adapter.send(request, **kwargs)
  File "/home/hreese/src/icloud_photos_downloader/venv/lib/python2.7/site-packages/requests/adapters.py", line 504, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='p48-photosws.icloud.com', port=443): Max retries exceeded with url: /ph/startup?clientBuildNumber=14E45&dsid=xxxxxxxxxxx&clientId=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxx (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f47f80603d0>: Failed to establish a new connection: [Errno -2] Name or service not known',))

Is that a bug in pyicloud or download_photos.py?

I'm having the same problem, worked two days ago, stopped working yesterday evening.

Hi everyone, I'm sorry about that. I don't have time to look into this right now, but you might find some more information over at https://github.com/picklepete/pyicloud
Looks like this is the same issue: https://github.com/picklepete/pyicloud/issues/136

I've been working on picklepete/pyicloud#136 over in chadj/pyicloud/ckdatabasews and since it contains a few backwards compatibly issues I decided to update icloud_photos_downloader to be compatible with these changes.  You can try out that update over at chadj/icloud_photos_downloader/ckdatabasews.  You'll need to install chadj/pyicloud/ckdatabasews first ofcourse.
I also added a new command line option
  --until-found INTEGER RANGE     Download most recently added photos until we
                                  find x number of previously downloaded
                                  consecutive photos (default: download all photos)

Which will drastically speed up what I think is the common use for using this command line tool

Thank you @chadj, I tested your branches out and I'm back to downloading the original photos off icloud. 👍  I briefly checked exif data (dates) and it looks good.
Can you provide more info regarding the --until-found option? I'm not sure how I would use it. How does this differ from --recent?

anyone got this to work in windows 10 cmd prompt (CON HOST)?

@jamescarlos yeah.  --until-found can be used instead of --recent.  --until-found=x begins iterating over the most recently added photos and downloads every photo until it finds x number of files that already exist on the disk.
In other words, it downloads all new files until it finds x number of files it has already downloaded.
Does that make more sense?

Perfect, thanks for the explanation @chadj.

Has anyone gotten this to work in Windows 10 version of python?

Which version of Python on Windows 10 are you using @itadder ?

Python 2.7.13

@itadder I just tried that setup and it worked for me.  What error are you getting?

File "c:\Python27\lib\site-packages\click\core.py", line 535, in invoke
return callback(*args, **kwargs)
File "download_photos.py", line 55, in download
updatePhotos(icloud)
File "download_photos.py", line 155, in updatePhotos
icloud.photos.update()
File "c:\Python27\lib\site-packages\pyicloud\base.py", line 306, in photos
self.params
File "c:\Python27\lib\site-packages\pyicloud\services\photos.py", line 37, in init
response = request.json()
File "c:\Python27\lib\site-packages\requests\models.py", line 878, in json
self.content.decode(encoding), **kwargs
File "c:\Python27\lib\json_init_.py", line 339, in loads
return _default_decoder.decode(s)
File "c:\Python27\lib\json\decoder.py", line 364, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "c:\Python27\lib\json\decoder.py", line 382, in raw_decode
raise ValueError("No JSON object could be decoded")
ValueError: No JSON object could be decoded
This is what I get...

Ah, I forgot to update the requirements.txt file in my branch.  Uninstall both icloud_photos_downloader and pyicloud then reinstall.  That should fix the problem.

Thanks

Hii tried the branch by @chadj however getting the following, any ideas?
Signing in...
Updating photos...
Traceback (most recent call last):
File "./download_photos.py", line 231, in
download()
File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 722, in call
return self.main(*args, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 697, in main
rv = self.invoke(ctx)
File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 895, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 535, in invoke
return callback(*args, **kwargs)
File "./download_photos.py", line 55, in download
updatePhotos(icloud)
File "./download_photos.py", line 155, in updatePhotos
icloud.photos.update()
AttributeError: 'PhotosService' object has no attribute 'update'

my bad used master branch instead of ckdatabasews , confirmed it works

Perfect!  Glad its sorted out.

Hi I tried the updated chadj/pyicloud/ckdatabasews and the icloud_photos_downloader but I get the following:
Signing in...
Traceback (most recent call last):
File "./download_photos.py", line 258, in
download()
File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 722, in call
return self.main(*args, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 697, in main
rv = self.invoke(ctx)
File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 895, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 535, in invoke
return callback(*args, **kwargs)
File "./download_photos.py", line 58, in download
icloud = authenticate(username, password)
File "./download_photos.py", line 132, in authenticate
icloud = pyicloud.PyiCloudService(username, password)
File "/usr/local/lib/python2.7/dist-packages/pyicloud/base.py", line 169, in init
self.authenticate()
File "/usr/local/lib/python2.7/dist-packages/pyicloud/base.py", line 192, in authenticate
raise PyiCloudFailedLoginException(msg, error)
pyicloud.exceptions.PyiCloudFailedLoginException: ('Invalid email/password combination.', PyiCloudAPIResponseError('Forbidden',))
It seems like the password is simply wrong but I checked it several time with the www.icloud.com and it is the correct password.
Is there anything clearly wrong? I am using Python 2.7.12 on ubuntu linux. Options were "--username" & "--password" I have the two factor enabled. It used to work for me before this error with the password stored in the keyring.

@mcirri I'm not sure what the issue could be there.  I'd try removing the keychain from the equation and see if that works.  This is likely a separate issue.

How do you do that? I tried with the command "iCloud --username xxxxxxx --delete-from-key ring" but I get a different error on the username. I cannot verify right now.

If you provide a password on the command line it will skip keychain access.  It's also possible Apple changed how 2fa is implemented on these end points.  Which might be the root cause here.  I'm not using 2fa currently.

Using the ckdatabasews branch I'm getting "Name or service not known", can anyone help?
Signing in...
Looking up all photos...
Traceback (most recent call last):
  File "./download_photos.py", line 231, in <module>
    download()
  File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 722, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 697, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 895, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 535, in invoke
    return callback(*args, **kwargs)
  File "./download_photos.py", line 62, in download
    photos = icloud.photos.all
  File "/usr/local/lib/python2.7/dist-packages/pyicloud/base.py", line 306, in photos
    self.params
  File "/usr/local/lib/python2.7/dist-packages/pyicloud/services/photos.py", line 35, in __init__
    params=self.params
  File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 480, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/pyicloud/base.py", line 67, in request
    response = super(PyiCloudSession, self).request(*args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 468, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 576, in send
    r = adapter.send(request, **kwargs)
  File "/usr/lib/python2.7/dist-packages/requests/adapters.py", line 437, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='p16-photosws.icloud.com', port=443): Max retries exceeded with url: /ph/startup?clientBuildNumber=14E45&dsid=1745167082&clientId=08B8A16C-612D-11E7-BD30-5404A628CDD8 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7fe500399550>: Failed to establish a new connection: [Errno -2] Name or service not known',))

@brendan-pike it looks like you're not using the ckdatabasews branch of pyicloud.  Try reinstalling just that dependency

The complete installation guide for that fix:
git clone https://github.com/chadj/icloud_photos_downloader.git

Uninstall if you have already tried to run:
sudo pip uninstall git+https://github.com/chadj/pyicloud.git@ckdatabasews#egg=pyicloud

then
sudo pip install -r requirements.txt

Now it should work.

The 'complete installation guide' posted by @freiit above does not work for me unfortunately. Is there somehting I am missing. After following the steps there I am still getting:

File "/lib/python2.7/site-packages/requests/adapters.py", line 504, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='p50-photosws.icloud.com', port=443): Max retries exceeded with url: /ph/startup?clientBuildNumber= &dsid= >CUT< &clientId= >CUT< (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7fd91fcf7510>: Failed to establish a new connection: [Errno -2] Name or service not known',))

Try this @f1rf1n
sudo pip uninstall pyicloud

git clone https://github.com/chadj/icloud_photos_downloader.git

git checkout ckdatabasews

sudo pip install -r requirements.txt

Checking out the branch was missing from those steps

Switching to the right branch makes sense. And it is working for me now, thanks all

Hey @chadj thanks for the fix, I'll merge these changes in! Is there anything to watch out for, or is it all good to go?

It should be all good to go.  I'm working on getting the pyicloud changes merged upstream but there's no eta on that right now.

See: https://github.com/picklepete/pyicloud/issues/136

Hi @chadj, I am updating the script to run with your pyicloud branch. Given the .all now returns a generator, is there a way to get the count of photos directly, other than len(list(...))?

@hadiasghari Yeah, there is a way to get the length.  Calling len() on a PhotoAlbum returns the length without iterating over the entire album.  That's used here:
https://github.com/chadj/icloud_photos_downloader/blob/ckdatabasews/download_photos.py#L63

Update - these changes have been merged, so everything should be working now.


chore: optional ssr entry by using virtual module on userland

Okay, probably this looks okay without actually supporting entrySsr on core plugin side.
Maybe, it's better to have a separate package (e.g. @hiogawa/react-server-next), then put all next-compat wrangling there?

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#408  👈
#407
#405
#404
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @hi-ogawa and the rest of your teammates on  Graphite

superseded by

https://github.com/hi-ogawa/vite-plugins/pull/413


Fixed eth_call before london fork for the calls without strict parameter

PR description
Fixed eth_call before London fork for the calls without strict parameters.
Fixed Issue(s)

Fix #5943

I think the change makes sense. There's a couple of integration tests failing that should be easy to fix
EthCallIntegrationTest > shouldReturnErrorWithGasPriceTooHigh() FAILED
    java.lang.AssertionError at EthCallIntegrationTest.java:228

EthCallIntegrationTest > shouldReturnErrorWithGasPriceAndEmptyBalance() FAILED
    java.lang.AssertionError at EthCallIntegrationTest.java:275

Hi @macfarla, What should be returned when Gas Price Too High and Account with empty balance without passing the strict parameter before London fork?


[addon-storysource] Add parser for prettierConfig

Issue: No parser and no filepath given, using 'babylon' the parser now but this will throw an error in the future. Please specify a parser or a filepath so one can be inferred.
What I did
Added parser: 'babylon'
How to test
Specify a prettierConfig without a parser property

So, it's not needed?


'utf-8' codec can't encode character '\udcf6'

--- Logging error in Loguru Handler #3 ---
Record was: {'elapsed': datetime.timedelta(0, 11, 922487), 'exception': (type=<class 'UnicodeEncodeError'>, value=UnicodeEncodeError('utf-8', 'Welche M\udcf6glichkeiten gibt es Eigenkapital f\udcfcr Immobilien zu besorgen_ S01E83_99 (720p_30fps_H264-192kbit_AAC)', 8, 9, 'surrogates not allowed'), traceback=<traceback object at 0x7f5188f0d888>), 'extra': {'task': 'Sorting-move-NBA', 'session_id': None, 'task_id': '249356'}, 'file': (name='task.py', path='/usr/local/lib/python3.6/dist-packages/flexget/task.py'), 'function': '__run_plugin', 'level': (name='CRITICAL', no=50, icon='☠'), 'line': 561, 'message': "BUG: Unhandled error in plugin retry_failed: 'utf-8' codec can't encode character '\\udcf6' in position 8: surrogates not allowed", 'module': 'task', 'name': 'task', 'process': (id=25872, name='MainProcess'), 'thread': (id=139988164085504, name='task_queue'), 'time': datetime(2020, 1, 14, 23, 55, 40, 731703, tzinfo=datetime.timezone(datetime.timedelta(0, 3600), 'CET'))}
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/flexget/task.py", line 521, in __run_plugin
    result = method(*args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/flexget/event.py", line 20, in __call__
    return self.func(*args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/flexget/components/failed/retry_failed.py", line 126, in on_task_filter
    .filter(db.FailedEntry.url == entry['original_url'])
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/query.py", line 3265, in first
    ret = list(self[0:1])
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/query.py", line 3043, in __getitem__
    return list(res)
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/query.py", line 3367, in __iter__
    return self._execute_and_instances(context)
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/query.py", line 3392, in _execute_and_instances
    result = conn.execute(querycontext.statement, self._params)
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 982, in execute
    return meth(self, multiparams, params)
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/sql/elements.py", line 287, in _execute_on_connection
    return connection._execute_clauseelement(self, multiparams, params)
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 1101, in _execute_clauseelement
    distilled_params,
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 1250, in _execute_context
    e, statement, parameters, cursor, context
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 1478, in _handle_dbapi_exception
    util.reraise(*exc_info)
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/util/compat.py", line 153, in reraise
    raise value
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 1246, in _execute_context
    cursor, statement, parameters, context
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/default.py", line 581, in do_execute
    cursor.execute(statement, parameters)
UnicodeEncodeError: 'utf-8' codec can't encode character '\udcf6' in position 8: surrogates not allowed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/loguru/_handler.py", line 153, in emit
    self._sink.write(str_record)
  File "/usr/local/lib/python3.6/dist-packages/loguru/_file_sink.py", line 178, in write
    self._file.write(message)
UnicodeEncodeError: 'utf-8' codec can't encode character '\udcf6' in position 3833: surrogates not allowed
--- End of logging error ---
2020-01-14 23:55:40 CRITICAL task          Sorting-move-NBA BUG: Unhandled error in plugin retry_failed: 'utf-8' codec can't encode character '\udcf6' in position 8: surrogates not allowed

2020-01-15 00:01:13 WARNING  nfo_lookup    Sorting-move-NBA Entry Statistik Manipulation_ Wie die Inflationsrate sch?n gerechnet wird S01E53_99 (1080p_25fps_H264-128kbit_AAC) has no corresponding .nfo file
--- Logging error in Loguru Handler #3 ---
Record was: {'elapsed': datetime.timedelta(0, 10, 549742), 'exception': None, 'extra': {'task': 'Sorting-move-NBA', 'session_id': None, 'task_id': '246848'}, 'file': (name='nfo_lookup.py', path='/usr/local/lib/python3.6/dist-packages/flexget/plugins/metainfo/nfo_lookup.py'), 'function': 'on_task_metainfo', 'level': (name='WARNING', no=30, icon='⚠'), 'line': 71, 'message': 'Entry Immobilienfinanzierung mit Annuit\udce4tendarlehen (Zins, Tilgung, Darlehensverlauf, Kredit) S01E25_99 (1080p_25fps_H264-128kbit_AAC) has no corresponding .nfo file', 'module': 'nfo_lookup', 'name': 'nfo_lookup', 'process': (id=27666, name='MainProcess'), 'thread': (id=139774008907520, name='task_queue'), 'time': datetime(2020, 1, 15, 0, 1, 13, 705523, tzinfo=datetime.timezone(datetime.timedelta(0, 3600), 'CET'))}
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/loguru/_handler.py", line 153, in emit
    self._sink.write(str_record)
  File "/usr/local/lib/python3.6/dist-packages/loguru/_file_sink.py", line 178, in write
    self._file.write(message)
UnicodeEncodeError: 'utf-8' codec can't encode character '\udce4' in position 99: surrogates not allowed
--- End of logging error ---

2020-01-15 00:05:46 CRITICAL task          Sorting-move-NBA BUG: Unhandled error in plugin retry_failed: 'utf-8' codec can't encode character '\udcf6' in position 8: surrogates not allowed
Traceback (most recent call last):
  File "/usr/lib/python3.6/threading.py", line 884, in _bootstrap
    self._bootstrap_inner()
    |    -> <function Thread._bootstrap_inner at 0x7f07055cc9d8>
    -> <Thread(task_queue, started daemon<PHONE_NUMBER>40928)>
  File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
    self.run()
    |    -> <function Thread.run at 0x7f07055cc7b8>
    -> <Thread(task_queue, started daemon<PHONE_NUMBER>40928)>
  File "/usr/lib/python3.6/threading.py", line 864, in run
    self._target(*self._args, **self._kwargs)
    |    |        |    |        |    -> {}
    |    |        |    |        -> <Thread(task_queue, started daemon<PHONE_NUMBER>40928)>
    |    |        |    -> ()
    |    |        -> <Thread(task_queue, started daemon<PHONE_NUMBER>40928)>
    |    -> <bound method TaskQueue.run of <flexget.task_queue.TaskQueue object at 0x7f06fb9bb8d0>>
    -> <Thread(task_queue, started daemon<PHONE_NUMBER>40928)>

  File "/usr/local/lib/python3.6/dist-packages/flexget/task_queue.py", line 45, in run
    self.current_task.execute()
    |    |            -> <function Task.execute at 0x7f06ff9f0e18>
    |    -> <flexget.task.Task object at 0x7f06fb33e780>
    -> <flexget.task_queue.TaskQueue object at 0x7f06fb9bb8d0>

  File "/usr/local/lib/python3.6/dist-packages/flexget/task.py", line 79, in wrapper
    return func(self, *args, **kw)
           |    |      |       -> {}
           |    |      -> ()
           |    -> <flexget.task.Task object at 0x7f06fb33e780>
           -> <function Task.execute at 0x7f06ff9f0d90>

  File "/usr/local/lib/python3.6/dist-packages/flexget/task.py", line 696, in execute
    self._execute()
    |    -> <function Task._execute at 0x7f06ff9f0d08>
    -> <flexget.task.Task object at 0x7f06fb33e780>

  File "/usr/local/lib/python3.6/dist-packages/flexget/task.py", line 662, in _execute
    self.__run_task_phase(phase)
    |                     -> 'filter'
    -> <flexget.task.Task object at 0x7f06fb33e780>

  File "/usr/local/lib/python3.6/dist-packages/flexget/task.py", line 488, in __run_task_phase
    response = self.__run_plugin(plugin, phase, args)
               |                 |       |      -> (<flexget.task.Task object at 0x7f06fb33e780>, {'retry_time': '60 seconds', 'retry_time_multiplier': 1, 'max_retries': 8})
               |                 |       -> 'filter'
               |                 -> <PluginInfo(name=retry_failed)>
               -> <flexget.task.Task object at 0x7f06fb33e780>

> File "/usr/local/lib/python3.6/dist-packages/flexget/task.py", line 521, in __run_plugin
    result = method(*args, **kwargs)
             |       |       -> {}
             |       -> (<flexget.task.Task object at 0x7f06fb33e780>, {'retry_time': '60 seconds', 'retry_time_multiplier': 1, 'max_retries': 8})
             -> <Event(name=plugin.retry_failed.filter,func=on_task_filter,priority=255)>

  File "/usr/local/lib/python3.6/dist-packages/flexget/event.py", line 20, in __call__
    return self.func(*args, **kwargs)
           |    |     |       -> {}
           |    |     -> (<flexget.task.Task object at 0x7f06fb33e780>, {'retry_time': '60 seconds', 'retry_time_multiplier': 1, 'max_retries': 8})
           |    -> <bound method PluginFailed.on_task_filter of <flexget.components.failed.retry_failed.PluginFailed object at 0x7f06fba484e0>>
           -> <Event(name=plugin.retry_failed.filter,func=on_task_filter,priority=255)>

  File "/usr/local/lib/python3.6/dist-packages/flexget/components/failed/retry_failed.py", line 126, in on_task_filter
    .filter(db.FailedEntry.url == entry['original_url'])
            |  |           |      -> <Entry(title=Welche M?glichkeiten gibt es Eigenkapital f?r Immobilien zu besorgen_ S01E83_99 (720p_30fps_H264-192kbit_AAC),st...
            |  |           -> <sqlalchemy.orm.attributes.InstrumentedAttribute object at 0x7f06fbbea6d0>
            |  -> <class 'flexget.components.failed.db.FailedEntry'>
            -> <module 'flexget.components.failed.db' from '/usr/local/lib/python3.6/dist-packages/flexget/components/failed/db.py'>

  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/query.py", line 3265, in first
    ret = list(self[0:1])
               -> <sqlalchemy.orm.query.Query object at 0x7f06fb13b898>

  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/query.py", line 3043, in __getitem__
    return list(res)
                -> <sqlalchemy.orm.query.Query object at 0x7f06fb13b860>

  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/query.py", line 3367, in __iter__
    return self._execute_and_instances(context)
           |    |                      -> <sqlalchemy.orm.query.QueryContext object at 0x7f06f9c3a678>
           |    -> <function Query._execute_and_instances at 0x7f070030a7b8>
           -> <sqlalchemy.orm.query.Query object at 0x7f06fb13b860>

  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/query.py", line 3392, in _execute_and_instances
    result = conn.execute(querycontext.statement, self._params)
             |    |       |            |          |    -> immutabledict({})
             |    |       |            |          -> <sqlalchemy.orm.query.Query object at 0x7f06fb13b860>
             |    |       |            -> <member 'statement' of 'QueryContext' objects>
             |    |       -> <sqlalchemy.orm.query.QueryContext object at 0x7f06f9c3a678>
             |    -> <function Connection.execute at 0x7f0700b68620>
             -> <sqlalchemy.engine.base.Connection object at 0x7f06fb150240>

  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 982, in execute
    return meth(self, multiparams, params)
           |    |     |            -> {}
           |    |     -> (immutabledict({}),)
           |    -> <sqlalchemy.engine.base.Connection object at 0x7f06fb150240>
           -> <bound method ClauseElement._execute_on_connection of <sqlalchemy.sql.selectable.Select at 0x7f06fb154828; Select object>>

  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/sql/elements.py", line 287, in _execute_on_connection
    return connection._execute_clauseelement(self, multiparams, params)
           |          |                      |     |            -> {}
           |          |                      |     -> (immutabledict({}),)
           |          |                      -> <sqlalchemy.sql.selectable.Select at 0x7f06fb154828; Select object>
           |          -> <function Connection._execute_clauseelement at 0x7f0700b68840>
           -> <sqlalchemy.engine.base.Connection object at 0x7f06fb150240>

  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 1101, in _execute_clauseelement
    distilled_params,
    -> [immutabledict({})]

  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 1250, in _execute_context
    e, statement, parameters, cursor, context
       |          |           |       -> <sqlalchemy.dialects.sqlite.base.SQLiteExecutionContext object at 0x7f06fb154908>
       |          |           -> <sqlite3.Cursor object at 0x7f06fade2810>
       |          -> ('Welche M\udcf6glichkeiten gibt es Eigenkapital f\udcfcr Immobilien zu besorgen_ S01E83_99 (720p_30fps_H264-192kbit_AAC)', '...
       -> 'SELECT failed.id AS failed_id, failed.title AS failed_title, failed.url AS failed_url, failed.tof AS failed_tof, failed.reas...

  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 1478, in _handle_dbapi_exception
    util.reraise(*exc_info)
    |    |        -> (<class 'UnicodeEncodeError'>, UnicodeEncodeError('utf-8', 'Welche M\udcf6glichkeiten gibt es Eigenkapital f\udcfcr Immobilie...
    |    -> <function reraise at 0x7f0701335488>
    -> <module 'sqlalchemy.util' from '/usr/local/lib/python3.6/dist-packages/sqlalchemy/util/__init__.py'>

  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/util/compat.py", line 153, in reraise
    raise value
          -> UnicodeEncodeError('utf-8', 'Welche M\udcf6glichkeiten gibt es Eigenkapital f\udcfcr Immobilien zu besorgen_ S01E83_99 (720p_...

  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 1246, in _execute_context
    cursor, statement, parameters, context
    |       |          |           -> <sqlalchemy.dialects.sqlite.base.SQLiteExecutionContext object at 0x7f06fb154908>
    |       |          -> ('Welche M\udcf6glichkeiten gibt es Eigenkapital f\udcfcr Immobilien zu besorgen_ S01E83_99 (720p_30fps_H264-192kbit_AAC)', '...
    |       -> 'SELECT failed.id AS failed_id, failed.title AS failed_title, failed.url AS failed_url, failed.tof AS failed_tof, failed.reas...
    -> <sqlite3.Cursor object at 0x7f06fade2810>

  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/default.py", line 581, in do_execute
    cursor.execute(statement, parameters)
    |      |       |          -> ('Welche M\udcf6glichkeiten gibt es Eigenkapital f\udcfcr Immobilien zu besorgen_ S01E83_99 (720p_30fps_H264-192kbit_AAC)', '...
    |      |       -> 'SELECT failed.id AS failed_id, failed.title AS failed_title, failed.url AS failed_url, failed.tof AS failed_tof, failed.reas...
    |      -> <method 'execute' of 'sqlite3.Cursor' objects>
    -> <sqlite3.Cursor object at 0x7f06fade2810>

UnicodeEncodeError: 'utf-8' codec can't encode character '\udcf6' in position 8: surrogates not allowed
2020-01-15 00:05:46 CRITICAL task_queue                    BUG: Unhandled exception during task queue run loop.
Exception in thread task_queue:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/flexget/task.py", line 521, in __run_plugin
    result = method(*args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/flexget/event.py", line 20, in __call__
    return self.func(*args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/flexget/components/failed/retry_failed.py", line 126, in on_task_filter
    .filter(db.FailedEntry.url == entry['original_url'])
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/query.py", line 3265, in first
    ret = list(self[0:1])
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/query.py", line 3043, in __getitem__
    return list(res)
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/query.py", line 3367, in __iter__
    return self._execute_and_instances(context)
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/query.py", line 3392, in _execute_and_instances
    result = conn.execute(querycontext.statement, self._params)
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 982, in execute
    return meth(self, multiparams, params)
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/sql/elements.py", line 287, in _execute_on_connection
    return connection._execute_clauseelement(self, multiparams, params)
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 1101, in _execute_clauseelement
    distilled_params,
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 1250, in _execute_context
    e, statement, parameters, cursor, context
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 1478, in _handle_dbapi_exception
    util.reraise(*exc_info)
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/util/compat.py", line 153, in reraise
    raise value
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 1246, in _execute_context
    cursor, statement, parameters, context
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/default.py", line 581, in do_execute
    cursor.execute(statement, parameters)
UnicodeEncodeError: 'utf-8' codec can't encode character '\udcf6' in position 8: surrogates not allowed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/flexget/task_queue.py", line 45, in run
    self.current_task.execute()
  File "/usr/local/lib/python3.6/dist-packages/flexget/task.py", line 79, in wrapper
    return func(self, *args, **kw)
  File "/usr/local/lib/python3.6/dist-packages/flexget/task.py", line 696, in execute
    self._execute()
  File "/usr/local/lib/python3.6/dist-packages/flexget/task.py", line 662, in _execute
    self.__run_task_phase(phase)
  File "/usr/local/lib/python3.6/dist-packages/flexget/task.py", line 488, in __run_task_phase
    response = self.__run_plugin(plugin, phase, args)
  File "/usr/local/lib/python3.6/dist-packages/flexget/task.py", line 562, in __run_plugin
    traceback = self.manager.crash_report()
  File "/usr/local/lib/python3.6/dist-packages/flexget/manager.py", line 1037, in crash_report
    outfile.writelines(flexget.log.debug_buffer)
  File "/usr/lib/python3.6/codecs.py", line 724, in writelines
    return self.writer.writelines(list)
  File "/usr/lib/python3.6/codecs.py", line 384, in writelines
    self.write(''.join(list))
  File "/usr/lib/python3.6/codecs.py", line 376, in write
    data, consumed = self.encode(object, self.errors)
UnicodeEncodeError: 'utf-8' codec can't encode character '\udce4' in position 106: surrogates not allowed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.6/threading.py", line 864, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/local/lib/python3.6/dist-packages/flexget/task_queue.py", line 53, in run
    self.current_task.manager.crash_report()
  File "/usr/local/lib/python3.6/dist-packages/flexget/manager.py", line 1037, in crash_report
    outfile.writelines(flexget.log.debug_buffer)
  File "/usr/lib/python3.6/codecs.py", line 724, in writelines
    return self.writer.writelines(list)
  File "/usr/lib/python3.6/codecs.py", line 384, in writelines
    self.write(''.join(list))
  File "/usr/lib/python3.6/codecs.py", line 376, in write
    data, consumed = self.encode(object, self.errors)
UnicodeEncodeError: 'utf-8' codec can't encode character '\udcf6' in position 115: surrogates not allowed

Additional information:

FlexGet version: 3.1.6
Python version: 3
Installation method: pip
Using daemon (yes/no): no
OS and version: ubuntu 18

sorry, configuration issue


Check if slider destroed

I init slider something like that
screenSlider = new Swiper($container, sliderParams);
and then destroyed:
screenSlider.destroy(true, true);
In documentation first method argument destroy "delete Swiper instance", but after destroy(true, true), screenSlider still have instance.
How then I can check destroyed "screenSlider" or not.

In result I do that:
screenSlider.destroy(true, true);
screenSlider = undefined;

There is a callback you can trigger. If you put the following in your config-object it will warn you:
 onDestroy: function(){
console.log('swiper destroyed');
}

@A11oW delete Swiper instance is clearing internal Swiper instance, but it can't clean your variable as well. So you did it correct by assigning undefined to your variable


Retrieve monitor.getItem().files in canDrop function?

Hi,
I'd like to ensure that:

Only 1 file is dragged over, and
The file type matches my list of allowed files.

However when I try to retrieve the value of files in the canDrop function, it returns a Browser doesn't allow reading "files" until the drop event.
Are there ways to work around this? Thanks!

Unfortunately not, precisely because

Browser doesn't allow reading "files" until the drop event.

:wink:


Chunk-Wise Recurrence

Thanks for the great work! Does current mamba implementation support chunk-wise recurrence? I think this could be a very useful feature for a chat model dealing with multi-turn conversations.

Soon :D


[TFHppleElement raw] returning bad results?

I'm comparing the results of [rootElement raw] with the actual HTML, and the results are similar, but not the same. Specifically, the characters "]]" have been appended inside each "script" tag.
Um...this isn't correct behavior, is it? Just checking to make sure I understand how the "raw" method is supposed to work.
[Update: Okay, I see why: There's a "![CDATA[" that's been added at the beginning of each script tag. Which is causing the HTML to not behave properly.]

Hi, issue with self closing tags can be fixed by changing DictionaryForNode function in XPathQuery.m.
Just change node dump function into save xml doc content to buffer with options XML_SAVE_NO_EMPTY.
In the end of function:
xmlBufferPtr buffer = xmlBufferCreate();
xmlSaveCtxtPtr ctxt = xmlSaveToBuffer(buffer, "UTF-8", XML_SAVE_NO_EMPTY);
xmlDocPtr doc = xmlNewDoc(BAD_CAST "1.0");
xmlDocSetRootElement(doc, xmlCopyNode(currentNode, 1));
xmlSaveDoc(ctxt, doc);

NSString *rawContent = [NSString stringWithCString:(const char *)buffer->content encoding:NSUTF8StringEncoding];
if (rawContent != nil) {
    resultForNode[@"raw"] = rawContent;
}

xmlSaveClose(ctxt);
xmlBufferFree(buffer);

how to add xmlSaveCtxtPtr 👍 I got ERROR
xmlBufferPtr buffer = xmlBufferCreate();
xmlSaveCtxtPtr ctxt = xmlSaveToBuffer(buffer, "UTF-8", XML_SAVE_AS_HTML | XML_SAVE_NO_EMPTY);
xmlDocPtr doc = xmlNewDoc(BAD_CAST "1.0");
xmlDocSetRootElement(doc, xmlCopyNode(currentNode, 1));
xmlSaveDoc(ctxt, doc);
NSString *rawContent = [NSString stringWithCString:(const char *)buffer->content encoding:NSUTF8StringEncoding];
if (rawContent != nil) {
    resultForNode[@"raw"] = rawContent;
}

xmlSaveClose(ctxt);


Partial visibility doesn't work correctly for < 2 months

If I select visibility range in partially visible mode like
let startDate = calendar.date(from: DateComponents(year: 2021, month: 02, day: 5))!
let endDate = calendar.date(from: DateComponents(year: 2021, month: 03, day: 15))!

the scrolling function stops working at all and part of the calendar just stucks behind bottom of the screen. The problem is reproducible in example project.
Here is a screenshot

When I extend visible dates range all seems to work nice again.

Oh whoops, definitely a bug. I'll have a fix for this soon. Thanks for the report!

Thanks for your patience on this @Aeroporas - the fix is in v1.8.3 🙂


RFM - mpc-qt

I am mostly stepping away from chocolatey as I do not really use it anymore and don't really have time to upkeep my packages (fixing issues or checking and seeing if everything is still working as it should be) I have been maintaining for a good while now, so I am currently on the lookout for someone to take over pretty much all my packages (I'll be creating an issue for each package).

Current Maintainer

[x] I am the maintainer of the package and wish to pass it to someone else;

Checklist

[x] Issue title starts with 'RFM - '

Existing Package Details
Package URL: https://chocolatey.org/packages/mpc-qt
Package source URL: https://github.com/JourneyOver/chocolatey-packages/tree/5046f4d352f51a07a95bd40762275339949f6b81/automatic/mpc-qt

Hello, me again ;-)
i'll take this one too.
It's ready on my git.
Can you add me ? tunisiano
Thank you. Have a nice day

@tunisiano187 I have added you as a maintainer (that you need to accept), thanks for taking over the package.