image to text failed code 127

Hi Dean,
On windows machine, I am trying to retrieve text from the jpg, png and I am getting the following error. Already, I have installed tesseract-ocr as well.  Kindly let me know how to resolve this error.

Traceback (most recent call last):
File "C:\Users\Saravanan\Anaconda3\lib\site-packages\textract\parsers\utils.py", line 84, in run
stdout=subprocess.PIPE, stderr=subprocess.PIPE,
File "C:\Users\Saravanan\Anaconda3\lib\subprocess.py", line 707, in init
restore_signals, start_new_session)
File "C:\Users\Saravanan\Anaconda3\lib\subprocess.py", line 990, in execute_child
startupinfo)
FileNotFoundError: [WinError 2] The system cannot find the file specified
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:\Users\Saravanan\Anaconda3\lib\site-packages\IPython\core\interactiveshell.py", line 2881, in run_code
exec(code_obj, self.user_global_ns, self.user_ns)
File "", line 4, in
text = textract.process(file, language='eng')
File "C:\Users\Saravanan\Anaconda3\lib\site-packages\textract\parsers_init.py", line 77, in process
return parser.process(filename, encoding, **kwargs)
File "C:\Users\Saravanan\Anaconda3\lib\site-packages\textract\parsers\utils.py", line 46, in process
byte_string = self.extract(filename, **kwargs)
File "C:\Users\Saravanan\Anaconda3\lib\site-packages\textract\parsers\image.py", line 20, in extract
stdout, _ = self.run(args)
File "C:\Users\Saravanan\Anaconda3\lib\site-packages\textract\parsers\utils.py", line 91, in run
' '.join(args), 127, '', '',
textract.exceptions.ShellError: The command tesseract C:/Users/Saravanan/Downloads/Text Extraction/jpgtext.jpg stdout -l eng failed with exit code 127
------------- stdout -------------
------------- stderr -------------

Just found out the issue. After adding the directory path in the environment variable for Tesseract-OCR, I can able to use the image to string function.
Please close this issue

Hi,
I'm having this exact same issue. Can you please explain to me how you solved it? I'm still getting error exit code 127.
How did you specify the path to tesseract?

Can you provide the full error log? Error code 127 means that the command line tool textract uses to parse your full can not be found. Generally, this means that it is not installed or is not visible in the environment that textract is running.
What kind of file are you trying to process? You can check here which tool textract is using to parse this file. If it is installed, make sure the (virtual) environment that you're using has a path variable with the directory in which the tool is installed.


Fix #60: Failure to convert array's in MathListBuilder

Add @"array" as a recognised Table type

Thanks!


Add Crystal template

Reasons for making this change:
Add Crystal language template.
This PReq is duplicate with #1589, but it's old and not maintained. After the PReq Crystal introduce shards as it default dependency management system, so the .gitignore was updated.
Links to documentation supporting these rule changes:
crystal init lib x & crystal init app x commands create the .gitignore.
If this is a new template:

Link to application or project’s homepage: The Crystal Programming Language - A compiled language with Ruby like syntax and type inference

@ne-sachirou - This tempalte is live on gitignore.io - https://www.gitignore.io/api/crystal

Any news?

This keeps on latest for Crystal ❤

I'm going to close this out because the value of maintaining a template like this in the repository isn't clear to me, particularly if the tooling creates the gitignore as part of initialization.
@ne-sachirou if you still feel this should be a template listed in this repository, please read the section about specialized templates and open a new pull request that follows the new pattern.


Fix lookahead for effects specifiers in function types

We were failing to properly look past effect specifiers like async throws(X) in a function type starting with an attribute.
C++ version of the fix in https://github.com/apple/swift-syntax/pull/2418

https://github.com/apple/swift-syntax/pull/2418
@swift-ci please smoke test


Implement changes for start and end date time for Free Command

Codecov Report

Merging #191 (a957c7d) into master (5cd35e5) will decrease coverage by 0.14%.
The diff coverage is 14.82%.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5cd35e5...a957c7d. Read the comment docs.


NavigatorIOS: Expose interactivePopGestureEnabled property

Previously, the back swipe navigation gesture would be enabled when the navigation bar is shown and disabled when the navigation bar is hidden.
This change enables developers to control the back swipe gesture independently of the visibility of the navigation bar. An example use case would be that an app wants to render a custom navigation bar so it sets navigationBarHidden to true and it wants to enable the back swipe gesture so it sets interactivePopGestureEnabled to true.
Test plan (required)

Created a test app to verify setting interactivePopGestureEnabled to true and false with the navigation bar both hidden and shown.
Verified prop works in a larger app.

Adam Comella
Microsoft Corp.

By analyzing the blame information on this pull request, we identified @janicduplessis and @katrinanova to be potential reviewers.

@rigdern updated the pull request.

@rigdern updated the pull request.

@javache Thanks the review. I addressed your feedback and updated the PR.
Adam Comella
Microsoft Corp.

Exposing the enum to JS is a nice-to-have but it would be OK to ship this without that as well. Please do the cleanup in dealloc and I'll merge this.

@rigdern updated the pull request.

@javache That is a great point about not being able to restore the default behavior from JavaScript. Unfortunately, the technique we're using has a limitation that we can't restore the default behavior from native code either. Consequently, there's no point in exposing the enum to JavaScript. As a mitigation, I added some comments to document this limitation.
I made the requested change about clearing the delegate in dealloc.

@facebook-github-bot shipit

Thanks for importing. If you are an FB employee go to Phabricator to review.


Updates to beta.3

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Add to startup?

Hey could you post an example of adding a file to startup?

The following key are used to do that :
HKEY_LOCAL_MACHINE\Software\Microsoft\Windows\CurrentVersion\Run
HKEY_CURRENT_USER\Software\Microsoft\Windows\CurrentVersion\Run
HKEY_LOCAL_MACHINE\Software\Microsoft\Windows\CurrentVersion\RunOnce
HKEY_CURRENT_USER\Software\Microsoft\Windows\CurrentVersion\RunOnce

cf: https://docs.microsoft.com/en-us/windows/win32/setupapi/run-and-runonce-registry-keys
So writing to the registry ...
RegWriteStringValue("HKCU","Software\\Microsoft\\Windows\\CurrentVersion\\Run","YOURAPPNAME","PATH\\TO\\EXECUTABLE")

Note that you'll need admin rights to write outside of HKCU.

So for me to use that bottem code I have to have Admin?

No my example uses HKCU (HKEY_CURRENT_USER) so it doesn't need admin rights.
You can replace HKCU by :
HKCR
HKLM
HKU
HKCC

Ahhh thank you!!!!
Btw I tried but couldn't quite get it to remove from startup programmatically HKCU

Here is a quick node.js (v10.10.0) working example to show you :

writing to HKCU\Software\Microsoft\Windows\CurrentVersion\Run
reading the written key
deleting the key

example.zip
Here are the correct api syntax just in case :
regedit.RegWriteStringValue("HKCU","Software\\Microsoft\\Windows\\CurrentVersion\\Run","HELLOWORLD","C:\\awesome.exe");

regedit.RegQueryStringValue("HKCU","Software\\Microsoft\\Windows\\CurrentVersion\\Run","HELLOWORLD");

regedit.RegDeleteKeyValue("HKCU","Software\\Microsoft\\Windows\\CurrentVersion\\Run","HELLOWORLD");

btw so when iwant to build a exe
i have to do

go build -buildmode=c-shared -o regedit.dll registry_dll

?? and it will generate a dll file and a exe file that must remain togethor??

No this code is solely to be compiled into a dll.
Either you do it yourself with :

go build -buildmode=c-shared -o regedit.dll registry_dll

or you download the precompiled version here :
https://github.com/xan105/go-dll-regedit/releases
Then you can use this dll in any language that have C bindings like dll import feature.
However if you are writing a golang exe then look at the source and write your own method based on it.
Because I don't think you can have 2 Go runtimes coexisting in a single process.


Tell newcomers to use virtualenvs

This should fix issues of newcomers polluting their global package space and having issues with imports: #2031
The readme update uses the built-in venv module that's available since 3.3. I thought about using pyproject.toml instead of setup.py to be compliant with the latest PEPs but I think it's an overkill because the setup right now works just fine.

I dislike virtualenvs. tinygrad depends on like four unpinned packages.


Translate tasks/access-application-cluster/web-ui-dashboard/ into Japanese

This is a Feature Request

What would you like to be added
Translate tasks/access-application-cluster/web-ui-dashboard/ into Japanese.
Why is this needed
This page has not been translated.
Comments
/language ja

/remove-lifecycle stale
/assign

/close


Deleting an App Password does not revoke access to an app using that password

Describe the bug
Deleting an App Password does not revoke access to an app using that password. I have waited over 30 minutes, which seems like more than enough time. Should really be instant, correct?
To Reproduce
Steps to reproduce the behavior:

Create an App Password in my settings, Bsky web app.
Sign in to Graysky using that app password.
Delete that App Password in Bsky web app.
Sign out of Graysky.
Sign in to same account on Graysky again, am not prompted for password. I am able to interact with my profile. I have tested Liking a post in Graysky, and can see in Bsky webapp that the Like was recorded.

Expected behavior
Deleting the App Password should have caused Graysky, or any other app, to prompt me for a password.
Details

Platform: I used Bsky webapp and Graysky iOS, but this seems like a Bsky backend issue.

OK, so the session expired after 2 hours, and did prompt for a new password.
If this is good enough, then this could be closed.

We are working on some potential changes for auth but such a behavior is expected. Closing this issue for now.


Fix memory leak when using CurveTexture.set_texture_mode

Fixes #54477
The leak is caused by RendererStorage::texture_replace(texture, by_texture) not freeing by_texture as the Vulkan backend does. This affects both GLES3 and the dummy rasterizer.
https://github.com/godotengine/godot/blob/210e6cc167b5003d2095e6667f4b34818a4a16f3/servers/rendering/renderer_rd/renderer_storage_rd.cpp#L1148
Also validates the input enum of set_texture_mode().

Thanks!


steam not starting [steam not found] (18.03)

Issue description
When trying to start steam, steam does not start with the following message:
cp: cannot create regular file '/home/user/Desktop/steam.desktop': Permission denied
Running Steam on nixos 18.03.132645.43c77db3aa5 64-bit
STEAM_RUNTIME has been set by the user to: /steamrt
/home/user/.local/share/Steam/steam.sh: line 755: /home/user/.local/share/Steam/ubuntu12_32/steam: No such file or directory

Steps to reproduce
$ rm -rf .steam .local/share/Steam
$ nix-env -e steam
$ sudo nix-channel --update
$ nix-env -iA nixos.steam
$ steam
Setting up Steam content in /home/user/.local/share/Steam
cp: cannot create regular file '/home/user/Desktop/steam.desktop': Permission denied
Running Steam on nixos 18.03.132645.43c77db3aa5 64-bit
STEAM_RUNTIME has been set by the user to: /steamrt
/home/user/.local/share/Steam/steam.sh: line 755: /home/user/.local/share/Steam/ubuntu12_32/steam: No such file or directory

$ ls -al /home/user/.local/share/Steam/ubuntu12_32/steam
-rwx------ 1 user users 4554470 Nov 17  2015 /home/user/.local/share/Steam/ubuntu12_32/steam
$  pwd
/home/user/.local/share/Steam
$  ls -a
.  ..  bootstrap.tar.xz  linux32  steamdeps.txt  steam_install_agreement.txt  steam.sh  ubuntu12_32

Technical details
nix-shell -p nix-info --run "nix-info -m"

system: "x86_64-linux"
host os: Linux 4.4.136, NixOS, 18.03.132645.43c77db3aa5 (Impala)
multi-user?: yes
sandbox: yes
version: nix-env (Nix) 2.0.4
channels(user): ""
channels(root): "nixos-18.03.132684.f3c913d466f, nixos-unstable-18.09pre142796.4b649a99d84"
nixpkgs: /nix/var/nix/profiles/per-user/root/channels/nixos/nixpkgs

Problem was existing /lib directory as described in #37187.


Is there any plan to support Aarch64？

Describe your issue or feature request
VerneMQ Version: <IP_ADDRESS>
OS: Ubuntu 20.04
Arch: Aarch64
Erlang/OTP version (if building from source): 25.0
Cluster size/standalone: 3 nodes
Describe the solution you'd like
VerneMQ Version: <IP_ADDRESS>
OS: Ubuntu 20.04
Arch: Aarch64
Erlang/OTP version (if building from source): 25.0
Cluster size/standalone: 3 nodes
Describe alternatives you've considered
VerneMQ Version: <IP_ADDRESS>
OS: Ubuntu 20.04
Arch: Aarch64
Erlang/OTP version (if building from source): 25.0
Cluster size/standalone: 3 nodes
Environment

VerneMQ Version:
OS:
Erlang/OTP version (if building from source):
Cluster size/standalone:

Add any other context, code samples or screenshots about the issue report here.
No response
Code of Conduct

[X] I agree to follow the VerneMQ's Code of Conduct

Yes. PR pending, https://github.com/vernemq/vernemq/pull/2078

:point_right: Thank you for supporting VerneMQ: https://github.com/sponsors/vernemq
:point_right: Using the binary VerneMQ packages commercially (.deb/.rpm/Docker) requires a paid subscription.


Do a better job of filtering Mach-O symbol tables

Symbol tables in Mach-Os can contain all kinds of junk, including symbolic debug entries and entries without actual names. This can result in a lot of unnecessary work, since we end up scanning symbols that don't actually correspond to the CPython ABI being linked against.
The solution here is to filter the symbol table, and only audit symbols that correspond to function or data entries and that are marked as "undefined" (meaning external, not local).

Thinking about this more, I'm not as confident this is correct: we want to catch CPython extensions that have non-abi3 APIs inlined into them, and filtering non-external functions will prematurely exclude those.
The more correct thing to do here is to filter out anything that doesn't resemble a function or data object, not all non-externals.


feat(DropdownMenu): handle variant prop

🔗 Linked issue
#44
❓ Type of change

[ ] 📖 Documentation (updates to the documentation or readme)
[ ] 🐞 Bug fix (a non-breaking change that fixes an issue)
[x] 👌 Enhancement (improving an existing functionality)
[ ] ✨ New feature (a non-breaking change that adds functionality)
[ ] 🧹 Chore (updates to the build process or auxiliary tools and libraries)
[ ] ⚠ Breaking change (fix or feature that would cause existing functionality to change)

📚 Description
Cleaner version of #142.
📝 Checklist

[x] I have linked an issue or discussion.
[ ] I have updated the documentation accordingly.

I'm not sure to understand why classes are not picked up for sutble variant 🤔

@benjamincanac can you provide more details.
seems to be working for me.

The divider should not be black which does the same in dark mode but white and the hover states don't seem to work 😬

it seems the current divider color is the browser default and the divide-gray-300 is not making it to the browser, this is the case if i change other components too. not sure how the tailwind jit works with the nuxt module and template file used.

it seems to be related to a dependency, when I switch to a outdated branch and install the dependancies then switch back it looks as expected and i can update it with new classes.
The hover isn't correct at the moment as the hover class and the bg class are the same color. Ive corrected for the screenshot below.

if I update the dependencies. it breaks as soon as i updated any class in the theme.
The last commit in the branch that works is e7e1b23


Location String & Example

The location should be in a string.  An example using the ODBC driver image earlier in the article would be helpful.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: dad6b54f-7b8d-0d9b-0ece-815b8874f751
Version Independent ID: dee28cea-a153-0d80-b3f1-982aa4d16a87
Content: Access external data: ODBC generic types - PolyBase - SQL Server
Content Source: docs/relational-databases/polybase/polybase-configure-odbc-generic.md
Product: sql
Technology: polybase
GitHub Login: @MikeRayMSFT
Microsoft Alias: mikeray

@n00611858 Thank you for the feedback, assigning this to the author for review.


I want to add the Simon Game

The Simon Game is a classic memory game that tests your ability to remember and repeat a sequence of colors and sounds. The game was built using HTML, CSS, and JavaScript
https://github.com/ssitvit/Games-and-Go/assets/106283743/eaa470ab-2485-4416-b958-5de8d48e9d48

Assigning this issue to you. Kindly get it done in a week. Go through the necessary guidelines for successful merge. All the best Babun... !!!


Also updates pkg/utils/testing.go to properly account for non-RHEL
systems, which typically store the pci.ids file at
/usr/share/misc/pci.ids instead of /usr/share/hwdata/pci.ids.
Addresses golint warnings around grpc.DialContext being deprecated by
replacing calls with grpc.NewClient.
Issue #544

hi @jaypipes , can you please rebase and run
go mod tidy

@zeeke np, all done.

The linters are not happy can you please take a look?

@SchSeba apologies for the long delay in getting back to this! Rebased from main which should fix any linter failures.

@zeeke @SchSeba Hi! :) Can we run the gate tests on this PR please? Thanks in advance!


Bucketing

Add bucketing of different allocations by sizes (configurable, presumably).

Never really got a proper spec on this, closing until/unless re-requested.


Add Search Field

Originally posted by @rpless at https://github.com/neogeek/doxdox/issues/7

It would be nice to be able to search generated documentation easily. At the very least, provide the ability to search the set of exported functions.

Released in v1.1.1


Precheck pin check

Currently, the XOR check verifies that the user area - framework is consistent with expectations.
However, it does not check pin names/shapes.
It's possible for a user to relabel the pins (possibly swapping vss* and vdd*), pass LVS on the user area and submit the design.
However, when this design with modified pin names is integrated, the connections will not be as intended.
A check of the pin names and shapes against the golden version may be needed.

Related to this, some users totally flatten the user_analog_project_wrapper to avoid the Consistency error due to unmatched cells. This can leave many hierarchical text in the layout that interfere with the abstract extraction of the cell.
Maybe flag text that does not match the port list as a Consistency error (in addition to the pins).


tunning write cf

write's cf don't need point get, so we remove bloom filter; the amount of data of write cf is according to default cf, so we adjust write cf's block-cache-size according to default cf's block-cache-size(reduce memory usage); write is not heavy for this cf, so the default value of level0_slowdown_writes_trigger&&level0_stop_writes_trigger is enough.

how much performance increases?

The key point of this pr is to reduce the memory usage of tikv as long as drop some useless config for write cf.

LGTM

LGTM


Update README.md

removing an incorrect link

Closing as the branch it's targeting no longer has v3 code. If still relevant, please create a new PR against the v3-sdk-samples branch.


replace jiter dependency with build-in pydantic function

Confirm this is an issue with the Python library and not an underlying OpenAI API

[X] This is an issue with the Python library

Describe the bug
https://pypi.org/project/jiter/
This is a standalone version of the JSON parser used in pydantic-core
The recommendation is to only use this package directly if you do not use pydantic.

The reason of this request is some OS (Gentoo in my case) do provide both pydantic and pydantic-core libraries, but jiter
openai-python uses pydantic already, so it should be possible to re-use build-in function (perhaps, via pydantic-core)
To Reproduce

inspect this line: https://github.com/openai/openai-python/blob/main/pyproject.toml#L19

Code snippets
https://github.com/openai/openai-python/blob/main/src/openai/lib/streaming/chat/_completions.py
 jiter import from_json

OS
any
Python version
any
Library version
1.40.0

We need to use the standalone package because we support both Pydantic v1 and Pydantic v2. Unfortunately pydantic v1 does not provide the same JSON parsing functionality.

The reason of this request is some OS (Gentoo in my case) do provide both pydantic and pydantic-core libraries, but jiter

What do you mean? How are you managing dependencies?

You should probably consider stopping supporting pedantic 1 at some point, for simplicity reason.
jiter is used just once in the code.
https://docs.pydantic.dev/latest/version-policy/
Active development of V1 has already stopped, however critical bug fixes and security vulnerabilities will be fixed in V1 for one year after the release of V2 (June 30, 2024).

FYI, Gentoo provides pedantic 2 only (https://packages.gentoo.org/packages/dev-python/pydantic )
and pedantic-core (version 2 as well)
I had to create my own jiter ebuild, but it is complicated, since it is a mixture of rust and python. And it's basically similar with pydantic-core.

Unfortunately we have no plans to drop support for Pydantic v1 anytime soon as it's still getting many millions of downloads a day.
Please ask Gentoo to provide a packaged version of jiter if this is important to you.

do we have an arn for jiter we can reference for python 312?
i cant stop getting no module named jiter.jiter
even with pydantic and openai in my req txt

do we have an arn for jiter we can reference for python 312? i cant stop getting no module named jiter.jiter even with pydantic and openai in my req txt

You need either outdated pydantic 1 or install jiter (https://pypi.org/project/jiter/)
@RobertCraigie please lock this issue, so people won't post unrelated comments.

id say this is pretty related... what are you on
if install pydantic/openai it automatically installs jiter and throws the error.
theres 50+ versions of pydantic 1 how could i possible know which outdated would work lol


Revert the PR #17856 (Do not preserve temporary results when no need to do so)

PR Summary
Fix #20739 by reverting the PR that caused this regression: #17856
#17856 causes the return value from a ReturnStatement to not be preserved too, which breaks an expected behavior.
This is the difference compared with the same code section from v7.3. After this change, the only difference is the updated comments.

Here is the relevant code section in v7.3:
https://github.com/PowerShell/PowerShell/blob/d68aa89daf9b28b23f0675c355b7be0b8795cd82/src/System.Management.Automation/engine/parser/Compiler.cs#L2278-L2310
PR Checklist

[x] PR has a meaningful title

Use the present tense and imperative mood when describing your changes

[x] Summarized changes
[ ] Make sure all .h, .cpp, .cs, .ps1 and .psm1 files have the correct copyright header
[x] This PR is ready to merge and is not Work in Progress.

If the PR is work in progress, please add the prefix WIP: or [ WIP ] to the beginning of the title (the WIP bot will keep its status check at Pending while the prefix is present) and remove the prefix when the PR is ready.

Breaking changes

[x] None
OR
[ ] Experimental feature(s) needed

[ ] Experimental feature name(s):

User-facing changes

[x] Not Applicable
OR
[ ] Documentation needed

[ ] Issue filed:

Testing - New and feature

[x] N/A or can only be tested interactively
OR
[ ] Make sure you've added a new test if existing tests do not effectively test the code changed

Tooling

[x] I have considered the user experience from a tooling perspective and don't believe tooling will be impacted.

/azp run PowerShell-CI-linux

not only should we do the revert, but we need to improve validation so we don't get caught by this again. I quickly saw the added validation, but couldn't see how we didn't catch this.


PromptPurchase: Able to buy model that you already own

If you prompt purchase a free model and you already own it, you are able to take it again. It doesn't do anything, but the behavior is just weird.
Example:

This should be handled now with the new purchase prompt script. Did a quick test, was able to take a free model, then upon trying to take it again it prompted me that I owned the item, and is only showing the OK button. If you could confirm it's good behavior with the new purchase script that would be awesome. If not I'll look into it. Thanks!


Alter dproj+dpks to make libs version agnostic (I hope)

Analysis of the other dproj + dpk files in this project (i.e. P4D etc) I worked out what looked correct and tested it by wiping everything called P4DPyPackage* in /mnt/c/Users/Public/Documents/Embarcadero/Studio/21.0
Rebuilding this library recreated the properly named packages such as P4DPyPackage270.bpl (correct for CE ATM) and should also create P4DPyPackage280.bpl files for D11
Actually, this should work for all versions of Delphi regardless of version (not that I can check anything other than CE of course)

All packages should have the version property set to AUTO. let me check why it turned to a specific version in some moment.

Hmm - looking at the diff Delphi's gone and converted all your 19.4s into 19.2s again - this started as a synched copy so had 19.4s...
Same for some of the othert stuff
I only actually made a few changes to replace the 280 stuff with Auto versions (and deleted 2x  hard-linked D11 delpoys)

All packages should have the version property set to AUTO. let me check why it turned to a specific version in some moment.

They didn't - it was all 280 for this specific lib

Let's update it then.

There's some Delphi IDE way of doing what I did manually I presume - fix it that way if possible

We don't need to track resource files. We can remove all new .res from commits.

Was just using your .gitignore

There's some Delphi IDE way of doing what I did manually I presume - fix it that way if possible

Let's update .gitignore to exclude .res and .template.xml

There's some Delphi IDE way of doing what I did manually I presume - fix it that way if possible

Ahh - I live and learn (pretty obvious when I think about it)

There's some Delphi IDE way of doing what I did manually I presume - fix it that way if possible

Ahh - I live and learn (pretty obvious when I think about it)

It is only available in Delphi 10.4 and up.

Let's update .gitignore to exclude .res and .template.xml. We should also replicate it to the others repos.

And lib/

Let's update .gitignore to exclude .res and .template.xml. We should also replicate it to the others repos.

And lib/

Exactly.

Update your clone and check if the latest changes works as expected.

Line 291 is still wrong
https://github.com/Embarcadero/Lightweight-Python-Wrappers/blob/main/packages/P4DPyPackage.dproj#L291
Line 148 is still wrong
https://github.com/Embarcadero/Lightweight-Python-Wrappers/blob/main/packages/dclP4DPyPackage.dproj#L148

Line 291 is still wrong https://github.com/Embarcadero/Lightweight-Python-Wrappers/blob/main/packages/P4DPyPackage.dproj#L291
Line 148 is still wrong https://github.com/Embarcadero/Lightweight-Python-Wrappers/blob/main/packages/dclP4DPyPackage.dproj#L148

It should update automatically once you open it in other version. Did you try to compile it?

Line 291 is still wrong https://github.com/Embarcadero/Lightweight-Python-Wrappers/blob/main/packages/P4DPyPackage.dproj#L291
Line 148 is still wrong https://github.com/Embarcadero/Lightweight-Python-Wrappers/blob/main/packages/dclP4DPyPackage.dproj#L148

It should update automatically once you open it in other version. Did you try to compile it?

I found the issue. I'm fixing it.

I'm in the middle of tests
Fortunately not got to this one yet
Here is a very basic set (marginally above hello world but checks it can load PSUtil + Torch) of VCL/FMX tests to make sure the full set work
https://github.com/peardox/P4D-Tests.git

I'm in the middle of tests - lemme know when you get to this one, I'll stop tests for now
Fortunately not got to this one yet
Here is a very basic set (marginally above hello world but checks it can load PSUtil + Torch) of VCL/FMX tests to make sure the full set work
https://github.com/peardox/P4D-Tests.git

Ah, that wasn't an issue at all, but I have upgraded project files.
Let's try again.

I'm testing using the following method.
Remove all traces of python stuff in (fortunately that's all these contain anyway)....
C:\Users\Public\Documents\Embarcadero\Studio\21.0\Dcp
C:\Users\Public\Documents\Embarcadero\Studio\21.0\Bpl
(21.0 will be 22.0 for you)
Install packages in correct order - 4 steps of...
p4d = Install VCL package  + components for windows (fmx will be used for later tests for Android + Mac), for others = Install package + components
First pass - install W32 release + debug then w64 release + debug, later passes Android / Mac
Add the debug lib path for OS to options
Assuming no compile issues...
See if https://github.com/peardox/P4D-Tests.git run (inv VCL for Win, FMX only for others)

I'm testing using the following method. Remove all traces of python stuff in (fortunately that's all these contain anyway).... C:\Users\Public\Documents\Embarcadero\Studio\21.0\Dcp C:\Users\Public\Documents\Embarcadero\Studio\21.0\Bpl (21.0 will be 22.0 for you)
Install packages in correct order - 4 steps of...
p4d = Install VCL package + components for windows (fmx will be used for later tests for Android + Mac), for others = Install package + components First pass - install W32 release + debug then w64 release + debug, later passes Android / Mac Add the debug lib path for OS to options Assuming no compile issues... See if https://github.com/peardox/P4D-Tests.git run (inv VCL for Win, FMX only for others)

It worth mentioning that you can use the P4DComponentSuite for a complete compilation.

I'm testing using the following method. Remove all traces of python stuff in (fortunately that's all these contain anyway).... C:\Users\Public\Documents\Embarcadero\Studio\21.0\Dcp C:\Users\Public\Documents\Embarcadero\Studio\21.0\Bpl (21.0 will be 22.0 for you)
Install packages in correct order - 4 steps of...
p4d = Install VCL package + components for windows (fmx will be used for later tests for Android + Mac), for others = Install package + components First pass - install W32 release + debug then w64 release + debug, later passes Android / Mac Add the debug lib path for OS to options Assuming no compile issues... See if https://github.com/peardox/P4D-Tests.git run (inv VCL for Win, FMX only for others)

It worth mentioning that you can use the P4DComponentSuite for a complete compilation.

I need to switch back to the Python debugger for Android. We are producing some content along the DelphiFMXBuilder for the coming boot camp. Maybe I'd delay to reply, but I'll do my best.
There are some small enhancements that I'd like to introduce to the whole Python projects ecosystem. I will work out on it as possible.

I'm testing using the following method. Remove all traces of python stuff in (fortunately that's all these contain anyway).... C:\Users\Public\Documents\Embarcadero\Studio\21.0\Dcp C:\Users\Public\Documents\Embarcadero\Studio\21.0\Bpl (21.0 will be 22.0 for you)
Install packages in correct order - 4 steps of...
p4d = Install VCL package + components for windows (fmx will be used for later tests for Android + Mac), for others = Install package + components First pass - install W32 release + debug then w64 release + debug, later passes Android / Mac Add the debug lib path for OS to options Assuming no compile issues... See if https://github.com/peardox/P4D-Tests.git run (inv VCL for Win, FMX only for others)

It worth mentioning that you can use the P4DComponentSuite for a complete compilation.

Caused issues in the past when installing non-Windows - I'll get to that in a bit, just finishing off Windows installation.
P4D Data Science - fiddly component install...

This is using current repo - notice you have to click on every OTHER lib and make sure they all start dcl... This is error prone and the reason I put the DTPs in a bunch at the end - as this way click on first, shift click on last, Right Click install (much more developer friendly)
There are currently 19 components and that number will grow. They either need splitting up of bunching as I've done. Problem with splitting up is that unless handled carefully you'll end up with a really long list of paths to add to options
ATM I'm just adding e.g. C:\DelphiComponents\P4D-Data-Sciences\lib\Win32\Debug
I'd prefer something like C:\DelphiComponents\P4D-Data-Sciences${PLATFORM)$(Config) but that didn't work

I need to switch back to the Python debugger for Android. We are producing some content along the DelphiFMXBuilder for the coming boot camp. Maybe I'd delay to reply, but I'll do my best. There are some small enhancements that I'd like to introduce to the whole Python projects ecosystem. I will work out as possible.

Saw boot camp thing - a few topics might be of interest so just signed up

I'm testing using the following method. Remove all traces of python stuff in (fortunately that's all these contain anyway).... C:\Users\Public\Documents\Embarcadero\Studio\21.0\Dcp C:\Users\Public\Documents\Embarcadero\Studio\21.0\Bpl (21.0 will be 22.0 for you)
Install packages in correct order - 4 steps of...
p4d = Install VCL package + components for windows (fmx will be used for later tests for Android + Mac), for others = Install package + components First pass - install W32 release + debug then w64 release + debug, later passes Android / Mac Add the debug lib path for OS to options Assuming no compile issues... See if https://github.com/peardox/P4D-Tests.git run (inv VCL for Win, FMX only for others)

It worth mentioning that you can use the P4DComponentSuite for a complete compilation.

Caused issues in the past when installing non-Windows - I'll get to that in a bit, just finishing off Windows installation.
P4D Data Science - fiddly component install...

This is using current repo - notice you have to click on every OTHER lib and make sure they all start dcl... This is error prone and the reason I put the DTPs in a bunch at the end - as this way click on first, shift click on last, Right Click install (much more developer friendly)
There are currently 19 components and that number will grow. They either need splitting up of bunching as I've done. Problem with splitting up is that unless handled carefully you'll end up with a really long list of paths to add to options
ATM I'm just adding e.g. C:\DelphiComponents\P4D-Data-Sciences\lib\Win32\Debug
I'd prefer something like C:\DelphiComponents\P4D-Data-Sciences${PLATFORM)$(Config) but that didn't work

I will set BOSS as the IDE package installer, then we would not need to follow up all these installation steps.
BTW, using environment variables to set up paths works fine.

The VCL test project looks like it's running (Torch install - long wait...)

Tried env vars, $(Release) seemed OK but $(Config) wan't liked (greyed out in IDE)
I guess lib\$(Release)\Debug is ok though

I will set BOSS as the IDE package installer - I'll look it up

Anyway - tests ran as correctly for both VCL + FLM under Win64 so that stage of testing is complete.
Mac and Android are another issue (extremely problematic in the past)

I will set BOSS as the IDE package installer - I'll look it up

Anyway - tests ran as correctly for both VCL + FLM under Win64 so that stage of testing is complete.
Mac and Android are another issue (extremely problematic in the past)

It should be very straight forward to get it working on Android and Mac. Let me know if you have any issue.


DolphinClient / DolphinServer deprecated & dependency between modelstore and connection

ServerDolphin & ClientDolphin deprecated
removed direct dependency from ModelStore to client connector

This change is

Coverage decreased (-0.2%) to 66.655% when pulling db6cc6701d9349bf894afe68bac9a659aa428a21 on model-connect-split into 21a8087fbdf6e7b373d09ff76829ba9ed90139bb on master.


Upgrade Lombok to 1.18.20

Motivation

see https://projectlombok.org/changelog
1.18.20 fixes compilation on JDK 16

Modifications

upgrade Lombok version from 1.18.18 to 1.18.20

/pulsarbot run-failure-checks

/pulsarbot run-failure-checks


Resource Group Location and Metadata

Docs say:

When you specify a location for the resource group, you're specifying where that metadata is stored. For compliance reasons, you may need to ensure that your data is stored in a particular region.

I’m not sure what that metadata is or is meant to be.
In Kubernetes lingo, is it the metadata part of a CRD, the spec part, the status part?
How can I leverage the RG location to ensure
compliance with, for example, EU laws?
I understand it’s a broad subject but I could use some help understanding better what options I have.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: bef92944-e84a-bda9-13d8-e537ede110fc
Version Independent ID: 1879e7a2-8c60-06a8-fc44-3bfbbb9802f9
Content: Azure Resource Manager overview - Azure Resource Manager
Content Source: articles/azure-resource-manager/management/overview.md
Service: azure-resource-manager
Sub-service: management
GitHub Login: @tfitzmac
Microsoft Alias: tomfitz

Hello @rcollina,
Thank you for your feedback! We will review and update as appropriate.

@rcollina - I am not very familiar with the Kubernetes terms, but for resource groups, the metadata is general information that is not directly involved in the operations of the resources. For example, the deployment history lives in the location of the resource group. After the resource is deployed, the location of the resource group could even go down and it would not affect the operations of the resource (if it's in a different region). If you need to keep all data in certain regions, make sure the resource group is also in one of the approved regions.

Thank you @tfitzmac for helping on the thread.
@rcollina Please review the information shared by @tfitzmac and let us know if you have any further queries.
At this point it appears that there's no further edits or updates needed to the documentation. We will go ahead and close this issue, however if you have any further feedback on the document please tag us in your reply and will be happy to reopen the thread and continue the conversation. Thank you

Thank you, @tfitzmac.
I assume then that the resource data (metadata + properties) is not stored within the resource group but it is kept in their dedicated resource provider at their location.
From the original wording in the docs I assumed otherwise; all resource data belonging to a resource group is stored at the resource group's location - making the RG a single point of failure, as it were - because sensitive info may have to reside there due to regulation.


scss_files option ignored with new version 0.50.0

First noticed in CircleCI installing via:
gem install scss_lint which gave me the new version 0.50.0 with the change to scss_lint option.
https://github.com/brigade/scss-lint/releases/tag/v0.50.0
Receiving this error:
No files, paths, or patterns were specified
from .scss-lint.yml in root of project:
scss_files: 'client/styles/'

Thanks for the report @AllSpeeds.
Fixed in e3a68d4 and released as a hotfix in 0.50.1.


duplicit awesome-hdl

The second one is https://github.com/drom/awesome-hdl
Can you please merge it?
Or is there any replacement?

I also have "awesome-hdl" in readme of my projects, I would like to extract it but I am not sure where.

I am ready to merge.
@fukatani  Where how do you want to merge?


TypeError: Cannot read property 'length' of undefined, when karma tests re-load

This bug report is from using Angular2 and Karma/Jasmine
But the error is emitted from Typescript. I am hoping that is the relevant part.

But if I then save one of my spec files (even if I don't change it)
Then a new run is kicked off, but always produces this error:
Observed behavior
ERROR in TypeError: Cannot read property 'length' of undefined
    at createSourceFile (/Users/jschank/ddc-advocacy/projects/ddca-iceland/node_modules/typescript/lib/typescript.js:15464:110)
    at parseSourceFileWorker (/Users/jschank/ddc-advocacy/projects/ddca-iceland/node_modules/typescript/lib/typescript.js:15389:26)
    at Object.parseSourceFile (/Users/jschank/ddc-advocacy/projects/ddca-iceland/node_modules/typescript/lib/typescript.js:15338:26)
    at Object.createSourceFile (/Users/jschank/ddc-advocacy/projects/ddca-iceland/node_modules/typescript/lib/typescript.js:15192:29)
    at new TypeScriptFileRefactor (/Users/jschank/ddc-advocacy/projects/ddca-iceland/node_modules/@ngtools/webpack/src/refactor.js:79:35)
    at Object.findLazyRoutes (/Users/jschank/ddc-advocacy/projects/ddca-iceland/node_modules/@ngtools/webpack/src/lazy_routes.js:18:22)
    at AotPlugin._findLazyRoutesInAst (/Users/jschank/ddc-advocacy/projects/ddca-iceland/node_modules/@ngtools/webpack/src/plugin.js:217:50)
    at _donePromise.Promise.resolve.then.then.then.then.then (/Users/jschank/ddc-advocacy/projects/ddca-iceland/node_modules/@ngtools/webpack/src/plugin.js:496:24)
    at <anonymous>
    at process._tickCallback (internal/process/next_tick.js:188:7)

Desired behavior
Saving my spec files should result in karma tests being run again. (I know that isn't the responsibility of this repo. But the error Appears to me to be in Typescript)
Mention any other details that might be useful (optional)
Most of the googling about this error, leads to the advice of putting a console.log(fileName); statement. To dump the offending file to the console.
When I look at that location, I see this
function createSourceFile(fileName, languageVersion, scriptKind) {
	// code from createNode is inlined here so createNode won't have to deal with special case of creating source files
	// this is quite rare comparing to other nodes and createNode should be as fast as possible
	var sourceFile = new SourceFileConstructor(265 /* SourceFile */, /*pos*/ 0, /* end */ sourceText.length);
	nodeCount++;
	sourceFile.text = sourceText;
	sourceFile.bindDiagnostics = [];
	sourceFile.languageVersion = languageVersion;
	sourceFile.fileName = ts.normalizePath(fileName);
	sourceFile.languageVariant = getLanguageVariant(scriptKind);
	sourceFile.isDeclarationFile = ts.fileExtensionIs(sourceFile.fileName, ".d.ts");
	sourceFile.scriptKind = scriptKind;
	return sourceFile;
}

It looks to me, like the problem is that sourceText, is undefined. And we're calling length on it here.
If I reset the sourceText to an empty string, when it is undefined or null. My tests re-run on changes, with no errors.
Unfortunately, I have no idea if that is a reasonable solution to the problem.
function createSourceFile(fileName, languageVersion, scriptKind) {
	if (!sourceText) {
		// console.log("*** Filename: ", fileName);
		// console.log("*** languageVersion: ", languageVersion);
		// console.log("*** scriptKind: ", scriptKind);
		// Note: this seems to allow the typescript parser to continue when a file is updated
		sourceText = "";
	}
	// code from createNode is inlined here so createNode won't have to deal with special case of creating source files
	// this is quite rare comparing to other nodes and createNode should be as fast as possible
	var sourceFile = new SourceFileConstructor(265 /* SourceFile */, /*pos*/ 0, /* end */ sourceText.length);
	nodeCount++;
	sourceFile.text = sourceText;
	sourceFile.bindDiagnostics = [];
	sourceFile.languageVersion = languageVersion;
	sourceFile.fileName = ts.normalizePath(fileName);
	sourceFile.languageVariant = getLanguageVariant(scriptKind);
	sourceFile.isDeclarationFile = ts.fileExtensionIs(sourceFile.fileName, ".d.ts");
	sourceFile.scriptKind = scriptKind;
	return sourceFile;
}

Been trying to track down the exact cause of this error as well. In the meantime, it appears that 1.6.1 does not have this bug.
Duplicate issues:
https://github.com/angular/angular-cli/issues/9331
https://github.com/angular/angular-cli/issues/5053

Been fighting with the same problem for a few weeks and finally got the chance to do something about it - finally got it sorted.
I believe that part of the problem was because the 'app' folder had been moved to the same level as the 'src' (which was deleted) and also because the 'app' folder was also renamed 'App'.
So anyway I created a brand new angular app and reproduced the folder related steps, which broke the app to a degree, but managed to get it all working again.
From that point i started comparing the files on my real app with the dummy app and after some effort i have it working perfectly.
One thing that i realised (note that im working on Windows, which is case insensitive when it comes to paths), was that some of my import statements didnt all have the correct case - apparently 'app/some-component' and 'App/some-component' aren't really the same. This led me normalise my folder names to kebab-case and it solved part of the problem.
The only catch in the middle of all of this is that i ended up upgrading from angular 4 to 5.
Hope this helps anyone with the same type of issue (only took me around a day and a half to get it sorted lol)
Current version:
Angular CLI: 1.6.8
Node: 8.9.4
OS: win32 x64
Angular: 5.2.4
... animations, common, compiler, compiler-cli, core, forms
... http, language-service, platform-browser
... platform-browser-dynamic, router
@angular/cli: 1.6.8
@angular-devkit/build-optimizer: 0.0.42
@angular-devkit/core: 0.0.29
@angular-devkit/schematics: 0.0.52
@ngtools/json-schema: 1.1.0
@ngtools/webpack: 1.9.8
@schematics/angular: 0.1.17
typescript: 2.5.3
webpack: 3.11.0

The same problem occurs with version 1.7.1

Same here on Ubuntu 17.10 (4.13.0-36-generic).
I also tried updating node, but it didn't fix the issue.
Angular CLI: 1.7.1
Node: 6.11.4
OS: linux x64
Angular: 4.4.6
... animations, common, compiler, compiler-cli, core, forms
... http, language-service, platform-browser
... platform-browser-dynamic, router, tsc-wrapped

@angular/cli: 1.7.1
@angular-devkit/build-optimizer: 0.3.2
@angular-devkit/core: 0.3.2
@angular-devkit/schematics: 0.3.2
@ngtools/json-schema: 1.2.0
@ngtools/webpack: 1.10.1
@schematics/angular: 0.3.2
@schematics/package-update: 0.3.2
typescript: 2.7.2
webpack: 3.11.0

As identified in https://github.com/angular/angular-cli/issues/5053, downgrading Angular CLI to 1.6.0 works. Seems to be a known issue
npm uninstall -g @angular/cli
npm uninstall --save-dev @angular/cli
npm install -g<EMAIL_ADDRESS>
rmdir /s node_modules
npm install --save-dev<EMAIL_ADDRESS>npm install

I have the same error with cli 1.6.8
I've done some debugging and figured out that problem is in the next line in
<EMAIL_ADDRESS>file:
const changedFilePaths = this._compilerHost.getChangedFilePaths();
in 1.6.0 version getChangedFilePaths returns only several files ( [ '../app/src/polyfills.ts',
'../app/node_modules/classlist.js/package.json',
'../app/src/app/data-models/store/test.side-effects.spec.ts' ], but in 1.6.8 it returns them all plus '../app/src/' directory, which does not have any sourceText and cause the mentioned error

I have encountered the same issue with 1.6.5, 1.7.4 (latest) and 1.6.0 (downgraded as per suggested above). It's caused by exactly the same reason as suggested by @SergeyShurygin above. Any update on this would be awesome as I can't afford to patch node modules from public registry.

Same here, downgrade to 1.6.0 needed to avoid the issue when watching tests

Please. There's no need to delete node_modules. This issue happens for a mismatch between you global @angular/cli, the angular tools (installed locally) and typescrypt (installed locally, also).
I would recommend to run:
npm update
npm i -g @angular/cli@latest # global
npm i typescript@latest # or the one that `@angular/compiler-cli` says whenever you start the application (`ng serve --aot` or whatever)

And before running the tests, make a compilation to avoid fixing things in the @ngtools/webpack on your own.
Just tested this in production when I switched to my master branch and those errors appeared.
Hope it helps! 🐋

For anyone hitting this issue.
It seems to be down to version conflicts. The only way I have been able to get around it was to generate a new app with 'ng new appname' and copy the component folders (01-fundamentals etc) over from the app you're trying to run your tests on.
This also bypasses the angular cli conflicts other students have reported.

I was having a similar problem on my Windows machine using Angular CLI 1.7.3, Node 6.11.0, and Angular 4.4.6.
It was trying to get the sourceText.length of a file that was actually a directory (the root directory of the project actually... src). WebpackCompilerHost.getChangedFilePaths() had the src directory in it.
I tracked that back to Watchpack's _onChange method. _dirWatcher was detecting a change, and calling _onChange, with the item param being the directory, and the file param being the file.
This is the block of code that adds the directory to the list of changes:
	if(this.aggregatedChanges.indexOf(item) < 0)
		this.aggregatedChanges.push(item);

Once I changed this to:
	if(this.aggregatedChanges.indexOf(file) < 0)
		this.aggregatedChanges.push(file);

The length error went away, and my tests rebuilt flawlessly.

Okay, there's more going on here than just that. I think this is an incompatibility (of sorts) between the file watcher in webpack and Visual Studio (the editor I'm using).
I'm getting the same error now after making simple changes to a file (add a new line, then delete it, and save).
And Parser.createSourceFile is now trying to get the source text of filenames like "vv510u0i.lax~" and "xftxzxob.smp~" which look very much like Microsoft's temp file naming convention.
So if I had to guess, I'd say the file watcher is detecting those temp files, then by the time ng-cli tries to parse them, Visual Studio has deleted them.

Thank you @VitalyName , issue solved after downgrade to cli 1.4.10.
I am using Angular -v 4.4.7

Would be nice to know if there was a fix for this by now. First reported in Feb.  Anyone have any ideas?

Verify your environments names.

Had the same issue.
Angular 8.1.1
Updated "karma-jasmine" to "2.0.1" and added empty afterAll inside the test: afterAll(() => {});
Works for me

Thanks for reporting this issue. This issue was originally reported a long time ago and since then we've had many releases, one of which might have addressed this problem. Please update to the most recent Angular CLI version.
If the problem persists after upgrading, please open a new issue, provide a simple repository reproducing the problem, and describe the difference between the expected and current behavior.


Documentation about Fast-CDR v2.0.0 and new annotations [19458]

I am missing the following information:
* [x]  The usage section should include the new argument `-de | --default_extensibility`.

* [x]  A note clarifying in [Zero copy constraints](https://fast-dds.docs.eprosima.com/en/latest/fastdds/use_cases/zero_copy/zero_copy.html#constraints) stating that only FINAL types are considered to be plain (an a reference to the extensibility section).

* [x]  New header files and constants should be included into the API reference:

  * eprosima::fastcdr::CdrVersion DEFAULT_XCDR_VERSION
  * DataRepresentationId_t DEFAULT_DATA_REPRESENTATION

* [x]  Fast DDS Docs manual CI should be updated to use CMake 3.22. Probably the nightly job should also be updated.

* [x]  Example CMakeList should use CMake minimum version 3.22.

* [x]  The [getting started application section](https://fast-dds.docs.eprosima.com/en/latest/fastdds/getting_started/simple_app/simple_app.html#build-the-topic-data-type) explains the files generated by Fast DDS-Gen. It should be updated with the two new generated files.

* [x]  The previous point also applies to the [Python application](https://fast-dds.docs.eprosima.com/en/latest/fastdds/getting_started/simple_python_app/simple_python_app.html#build-the-topic-data-type)

Done in 100644

The CI results can be found in this job
The following warnings are being displayed:
/home/runner/work/Fast-DDS/Fast-DDS/src/fastdds-docs/docs/../../src/fastdds-docs/docs/fastdds/getting_started/simple_app/includes/publisher.rst.rst:163: WARNING: line number spec is out of range(1-47): '47-48'
/home/runner/work/Fast-DDS/Fast-DDS/src/fastdds-docs/docs/../../src/fastdds-docs/docs/fastdds/getting_started/simple_app/includes/subscriber.rst.rst:118: WARNING: line number spec is out of range(1-47): '50-51'
../../src/fastdds-docs/docs/fastdds/getting_started/simple_app/includes/subscriber.rst:118: WARNING: Line spec '50-51': no lines pulled from include file '/home/runner/work/Fast-DDS/Fast-DDS/src/fastdds-docs/code/Examples/C++/DDSHelloWorld/CMakeLists.txt'

Also the doc8 tests complains about:
/home/runner/work/Fast-DDS/Fast-DDS/src/fastdds-docs/docs/fastdds/use_cases/zero_copy/zero_copy.rst:156: D001 Line too long

Finally, the spell check is also failing (though I think that it can be the same error as the doc8)


Provide system menu

We should have a system-menu for Monokle - suggest the following items/subitems to start with (on Mac - not sure how this translates to Windows/Linux standards)

Monokle

About Monokle -> Show Monokle Launch Dialog
Check for Updates... -> Checks for update
-sep-
Preferences -> Open Settings Slider
-sep-
Hide Monokle
Hide Others
-sep-
Quit

File

Browse Folder -> shows the folder dialog
Refresh Folder -> Refreshes current folder
-sep-
Recent Folders -> submenu containing recent folders - selectable
-sep-
New Resource -> Opens "New Resource" dialog (enabled/disabled as in Monokle)
-sep-
Exit Preview -> as applicable

Edit (enabled when Monaco is in focus - shortcuts to built-in Monaco actions)

Undo
Redo
-sep-
Cut
Copy
Paste
-sep-
Find
Replace
-sep-
Apply
Diff

View

Previous Resource -> navigate back
Next Resource -> navigate forward
-sep-
Toggle Navigator
-sep-
default items

Window - same as default
Help

Documentation -> open documentation in Browser
-sep-
GitHub -> open GitHub repo in Browser

See https://www.electronjs.org/docs/api/menu#examples

Alternatively we could have a "Cluster" top-level menu containing

Select Context -> submenu with available contexts, check the current one
Preview -> Retrieves cluster objects from selected cluster
-sep-
Apply -> Applies current Resource/File
Diff -> Diff...
?

I leave Cluster menu to do after we implement context selection etc. I couldn't find Toggle Navigator action. Except it the PR is ready.


actions: add ansible

add an action that runs ansible, with the option of installing modules from ansible_galaxy prior to its execution. This can be a starting point: https://github.com/flemzord/github-actions-for-ansible

@ivotron so it needs to create a similar action as you have given in the example? And how the option of installing modules should be provided? Do we need some kind of env variable in the workflow to mention the roles? Also, any resources to look into, for ansible, would be appreciated as I am new to ansible and don't know much about it.


Why is permanent Internet connection necessary? I'm on Prepaid.

Why is permanent Internet connection necessary? I'm surely not the only one who uses Prepaid with a limited data (Congstar).
Therefore it is not possible (too expensive) to stay online all the time.
If I close my internet connection, the app shows an error "no internet connection".
Why isn't Bluetooth enough?
Samsung Galaxy Note 9
Android 10
Congstar Prepaid

Telekom said that all mobile providers in Germany agreed on zero-rating traffic of the CWA. Did you ask Congstar about this?

Travellers or border commuters might not be on a German network so will have to pay for data. Also, zero-rating messes with the device's capability to track data usage (it doesn't know which packets count).
So the question stands, why isn't Bluetooth enough?

@robertbastian I guess because every content inside of the App is loaded live from the internet.

I guess because the app regulary downloads data from the https://github.com/corona-warn-app/cwa-server to check if you are likely to be infected.

Hey,
exposure key exchange is still active even without having an internet connection.
The app does require a internet connection for risk score calculation since it uses remotely configurable parameters for this functionality.
We also require an internet connection to fetch test results since this data is not persisted on the device.

Is an internet connection really necessary all the time? Could I swtich of mobile data and WLAN as long as I'm outside and switch it on at home? This would allow all fetching of data mentioned above.

App will exchange bluetooth information with other phones even without the internet. There is some confusion about it due to unfortunate visual design of the app. Main issue where it is discussed is here: corona-warn-app/cwa-documentation#262

Hey Kolya, exposing an "error" condition to users is especially bad for a quite common scenario.
Please consider degrading the error to a soft warning/notice:
You are currently offline. Displaying results is suspended while Bluetooth data exchange still works in the background. Results will be updated once an Internet connection is available.
DE: Sie sind derzeit offline. Die Anzeige von Ergebnissen ist ausgesetzt, während der Schlüsselaustausch über Bluetooth weiterläuft. Die Ergebnisse werden mit der nächsten Internet-Verbindung aktualisiert.

Hi @jab4,
im not sure that i understood you correctly, which "error" condition are you talking about?

@jab4 and @beceha could you possible provide a screenshot for the error that is shown in this case? That would make it easier to judge whether the severity of the bug is justified.

@kolyaopahle @corneliusroemer I think it's very clear what this error is about, @beceha clearly explained:

If I close my internet connection, the app shows an error "no internet connection"

You can recreate it easily by just switching off internet when using CWA, it displays "no internet connection" at the top, which easily gets interpreted as an error. Screenshots are disabled by the app (likely for security reasons)

Why screenshots are disabled is discussed in more detailed in https://github.com/corona-warn-app/cwa-app-android/issues/516 and linked issues.
In my understanding it is because the main 'activity' (sharing test-TANs) should not be screenshottable, and currently the whole app has only one activity, so until everything else is a separate activity, it will not allow native screenshots. It seems not to be deactivated for the iOS app though.

I rephrase, a picture of the screen would be good. Here we go.

@kbobrowski ah, i see. I was honestly expecting an actual error dialog for a condition we did not catch. My bad :)
@jab4 in case this is the error you are referencing please also leave your comment in the linked issue here: corona-warn-app/cwa-documentation#262 as this concernes both versions of the app.

Why screenshots are disabled is discussed in more detailed in #516 and linked issues.

👍

In my understanding it is because the main 'activity' (sharing test-TANs) should not be screenshottable, and currently the whole app has only one activity. An activity describes a form of window, including sub-frames (as far as I understand). So until everything else is a separate activity, it will not allow native screenshots.

The screenshot issue actually requires some more discussion, it was initially raised by the BSI in #9
because these automatic screenshots taken by the os could be accessible to other apps, which might lead to data leaks not only concerning TAN's but also the users test status.

It seems not to be deactivated for the iOS app though.

This is purely because deactivating screenshots is not possible on iOS.

@kbobrowski See, it actually helped now to have pictures to get it across to the dev :)

Telekom said that all mobile providers in Germany agreed on zero-rating traffic of the CWA. Did you ask Congstar about this?

No, I haven't, but it is nice, that the Telekom said this concerning the Corona Warn App. But this is not the only app I have on my smartphone.
As soon as I enable the internet connection, many other apps uses this then, too, like for notifications, e-mail and other things.

We have an open enhancement issue for this particular warning: https://github.com/corona-warn-app/cwa-documentation/issues/262

We have an open enhancement issue for this particular warning: corona-warn-app/cwa-documentation#262

I'm not sure issue #262 should be labelled enhancement. Imho it's a bug.

I have installed the App on the phone of my son. He uses Congstar without mobile data connection. The usage of the corona warn app with only WLAN at home works fine

@hofschroer yes, there is no real need to have continuous internet. The error/warning you get when internet is off is a bug in the way it's phrased. Only occasional internet connectiton ~2xdaily is sufficient.

There might be the need for continuous internet connection actually - see recent developments discussed in issue corona-warn-app/cwa-documentation#262 (and this comment).
It might be that if there is no internet connection in a short time window (one minute) during the day, the next attempt to retrieve infected people data will be only next day, and again only during short time window. This may result in severe delays in receiving exposure notification.
So for now, I need to take back my statements made in this comment until issue discussed in corona-warn-app/cwa-documentation#262 is resolved, and encourage everyone to keep the internet on as much as it is possible.

There might be the need for continuous internet connection actually ... It might be that if there is no internet connection in a short time window (one minute) during the day, the next attempt to retrieve infected people data will be only next day, and again only during short time window. This may result in severe delays in receiving exposure notification.

I understand this ... but perhaps there could be a solution for example like with my Fitbit tracker.
It "memorize" steps etc. for 24h, and within 24h I have to connect my phone to the internet for synchronisation.
Wouldn't it be a solution for the Corona Warn App?

@beceha I think this would be a good solution, but I'll let CWA team clarify issues around it, I'm not working for SAP so don't take my word for it. I've added above clarification since I think it's highly likely that this is how the apps work right now, but let's wait for SAP response about this issue.

Thanks again for the fruitful discussion in here. The original question of this issue has been answered. @beceha that's why we will close this issue here and defer further discussion about the unnecessary delay in exposure notification to https://github.com/corona-warn-app/cwa-backlog/issues/2 (already moved over to backlog)
Best regards
MS
Corona Warn-App Open Source Team


Redux

Hi,
I heard about this project from Ilya's talk at the Front conference in Amsterdam (thanks Ilya!).
If the idea of TodoFlux picks up traction, I think a Redux example is in order. Wdyt?
Cheers
Stefano

@balsamiqstefano, Redux todo app is on its way afaik. Try to check out issues of redux repo.
There are more Flux frameworks on the marketshare, so we are open to any help with others as well.

Mhm. I'm not sure I understand. According to the FAQ, I thought that proposals for TodoFlux examples had to come here, in the form of a new issue. I don't see why there should be an issue related to a TodoFlux sample implementation inside the Redux repo. Indeed, there isn't. :)
Cheers
Stefano
PS. It's still me, just using my other github account. :)

Hi Stefanos,
Basically it would be nice to have an issue inside a Redux repo in order to find somebody who would create an issue in this repo with the implementation.


Mocking ng2-restangular for unit-tests

Is there any documentation on this?
Created also question on stack - http://stackoverflow.com/questions/41936716/how-to-mock-ng2-restangular-for-ng2-unit-tests

There is no testing documentation yet, but we have plans to do it.


Conventions for Python code

Let's decide on which conventions to apply for Python code.
Issue originates from discussion about python import order
I'll put them back in the same order and open a separate PR for this. I do not care too much either. The following resources are useful:
According to PEP8, Python imports should be on separate lines (per library) and the imports are grouped in three blocks:

Standard library imports.
Related third party imports.
Local application/library specific imports.

Next to that, it is common to sort the imports within on of these three group alphabetically - to improve searchability. Finally, some put the import ... before from ... import ..., or vice versa or mix them.
Originally posted by @JCZuurmond in https://github.com/dbt-msft/dbt-sqlserver/pull/71#discussion_r550109445

I know @mikaelene is partial to black and that the dbt-core team uses flake8. Happy to discuss any changes via a PR with incremental changes.

Pre-commit config was added, follows style similar to dbt-core


Try to improve Integer#chr a bit

There is still a lot to do here regarding encoding and strings. As soon as we have most of String implemented we can come back to this.
[#201]

Cool! :sunglasses:


[bubble] Avatar overlaps incoming message bubble

Outgoing messages look good.
Seems like the the edge <===> avatar offset is different.

I expected the layout to be the same because it's just an affine transform according to the code below.
// ContentNode.swift

    open func layoutLayers() {
        if let backgroundBubble = self.backgroundBubble {
            backgroundBubble.createLayer()

            //TODO: this is slightly hacky, will need to rethink
            if isIncomingMessage {
                CATransaction.begin()
                CATransaction.setDisableActions(true)
                backgroundBubble.layer.transform = CATransform3DTranslate(CATransform3DMakeScale(-1, 1, 1), -backgroundBubble.calculatedBounds.width, 0, 0)
                backgroundBubble.maskLayer.transform = CATransform3DTranslate(CATransform3DMakeScale(-1, 1, 1), -backgroundBubble.calculatedBounds.width, 0, 0)
                CATransaction.commit()
            }
        }
    }

Looks like separate configuration for incoming and outcoming messages is required at the user's side.
Incoming messages should use left inset while outgoing messages should use right.
fileprivate func buildNodeForTextMessage(_ message: ChatMessage)
    -> GeneralMessengerCell
{
       // ....
        let contentNode = TextContentNode(textMessageString: text,
                                       currentViewController: self)

       let result = MessageNode(content: contentNode)

       // .....

       let distanceFromAvatarToBubble = 30
        if (isIncomingMessage)
        {
            result.cellPadding =
                UIEdgeInsets(top: 10,
                            left:  0,
                          bottom: 10,
                           right: 0)

            result.avatarInsets =
                UIEdgeInsets(top: 15,
                            left:  0,
                          bottom: 10,
                           right: distanceFromAvatarToBubble)
        }
        else
        {
            result.cellPadding =
                UIEdgeInsets(top: 10,
                            left:  0,
                          bottom: 10,
                           right:  0)

            result.avatarInsets =
                UIEdgeInsets(top: 15,
                            left: distanceFromAvatarToBubble,
                          bottom: 10,
                           right:  0)
        }

messageOffset helps to avoid clipping effects when the avatar is missing.
result.messageOffset = isShowingIcon ? 10 : 30


AndroidX dependencies

Given that support libraries are going to come in the form of AndroidX, i've done the heavy lifting process of moving it to over to AndroidX

@florent37 mind taking a look at it?

thanks a lot ! I wanted to do it

i will try and publish a new release 👍

thanks for merging it :) apologize since I wasn't able to update it to the newer gradle build and x libs. If you would like me to look into it, I can :)


feat: multiple & configureSecond

@johannschopplich you need to do a review and apply eslint formatting since github.dev doesn't support it :)
🔗 Linked issue
closes https://github.com/johannschopplich/nuxt-gtag/issues/30
❓ Type of change

[x] 📖 Documentation (updates to the documentation, readme or JSDoc annotations)
[ ] 🐞 Bug fix (a non-breaking change that fixes an issue)
[ ] 👌 Enhancement (improving an existing functionality like performance)
[x] ✨ New feature (a non-breaking change that adds functionality)
[ ] 🧹 Chore (updates to the build process or auxiliary tools and libraries)
[ ] ⚠ Breaking change (fix or feature that would cause existing functionality to change)

📚 Description

📝 Checklist

[x] I have linked an issue or discussion.
[x] I have updated the documentation accordingly.

sources:

https://developers.google.com/tag-platform/gtagjs/configure#example
https://developers.google.com/tag-platform/gtagjs/routing
https://stackoverflow.com/a/73132469

I will probably refactor the API a bit, but thanks for the effort nonetheless!

@reslear Thanks a lot for the PR, it was inspiring. I implemented it a bit different tho in https://github.com/johannschopplich/nuxt-gtag/commit/aedc6e44a82c343d9eff0216dd1878ea09260656.

@johannschopplich
Honestly, I'm disappointed. I'm sorry:

you've over-complicated the code :))))
and forgot to dynamically add grantConsent to the ids array

Feel free to iterate once the next version is released and open a PR with simplifications. 🙌

@reslear I've released v1.2.0. Thanks for the hint on the init for multiple IDs. Would you mind doing a review on the latest code changes? Thanks in advance. 🙂

@johannschopplich how implement analogue https://github.com/johannschopplich/nuxt-gtag/pull/31/files#diff-b335630551682c19a781afebcf4d07bf978fb1f8ac04c6bf87428ed5106870f5R253 ?

@reslear Can you just define it in the module options beforehand? This is possible now and doesn't require a call like configureSecond at runtime:
Does this meet your requirements:
// `nuxt.config.ts`
export default defineNuxtConfig({
  modules: ['nuxt-gtag'],

  gtag: {
    tags: [
      {
        id: 'GT-XXXXXXXXXX',
        config: {
          page_title: 'GA4'
        }
      },
      {
        id: 'DC-ZZZZZZZZZZ',
        config: {
          page_title: 'Floodlight'
        }
      }
    ]
  }
})

@johannschopplich do you know what dynamic data is?
https://nuxt.com/docs/api/composables/use-async-data

Yep, I've built Nuxt API Party based on it.
Your function configureSecond uses gtag under the hood.  I don't get what's missing in my implementation.
If you think there's something missing, please open an issue and gladly open a new PR with your ideas. Thanks!

yeah, no problem, I was just suggesting using Sugar's syntax. Thanks!


createPrerelease is run and fails when a deploy is canceled due to cancel-in-progress

Problem
We had a deploy error on https://github.com/Expensify/App/actions/runs/11074305525/job/30773368164 because the build was canceled due to cancel-in-progress flag.
Solution
@roryabraham says:

I'd say this is expected - the deploy completed on at least one platform (web), so it creates the prerelease.
I think we should just continue-on-error with these non-critical artifact upload steps

Going to just create a quick PR

Should be fixed by https://github.com/Expensify/App/pull/49852. We don't have a great way to test this per-se so I'm going to optimistically close it and we can monitor/reopen if we see it happen again.


poco -themes executes other code besides listing themes

For example, at the moment output looks like this:
Adding .poco and .backup to skip list
	stylesheets()
	inlineStyleSheets(/Users/tom/pococms/poco)
		c.fm: /Users/tom/pococms/poco/.poco/themes/informer/informer.css
		overrideFm: /Users/tom/pococms/poco/.poco/themes/informer/informer.css

assemble() is being called


feat: Update metrics-server to v0.3.7

Autogenerated PR to update to latest release of metric-server: v0.3.7

Ping

:tada: This PR is included in version 2.2.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Regression: es3:false not working if jshintrc sets es3: true

JSHint 2.9.1 is warning for this line:
https://github.com/wikimedia/portals/blob/4c670a7e4b9b9ae8c8c3730214dbc9beec8f5a06/site-stats.js#L38
	return preq.get( url, preqOptions )
		.then( function( request ) {
			return BBPromise.resolve( request.body );
		} )
		.catch( function( err ) {

site-stats.js: line 38, col 10, Expected an identifier and instead saw 'catch' (a reserved word).
site-stats.js: line 176, col 55, Missing radix parameter.

The project's .jshintrc contains:
{
	"es3": true

But the file overrides it:
/* jshint node:true, es3:false */
/* jscs:disable */

I can reproduce this at http://jshint.com/ with the following snippet:
/*jshint es3:true */
/*jshint node:true, es3:false, es5:true */

function httpGet( url ) {
	return url.catch();
}

Thanks for the report! Here's a further reduced test case:
// jshint es3: true
// jshint es3: false, es5: false

void [].catch;

We'll need to fix this, but the preferable solution should actually work for you right now--use the new esversion option to specify this. (Of course, that has its own issues--https://github.com/jshint/jshint/pull/2900, but based on your use case, I don't think that will be a problem.)


specify custom dns server when dial to broker

Versions
Latest

Sarama
Kafka
Go

Configuration
What configuration values are you using for Sarama and Kafka?
config.Net.Proxy.Enable = true

Logs
logs: CLICK ME

[Sarama] 2020/12/02 14:53:37 Failed to connect to broker bogon:9092: dial tcp: lookup bogon on <IP_ADDRESS>:53: no such host
[Sarama] 2020/12/02 14:53:37 producer/broker/0 state change to [closing] because dial tcp: lookup bogon on <IP_ADDRESS>:53: no such host
2020/12/02 14:53:37 Failed to produce message : kafka: Failed to produce message to topic test: dial tcp: lookup bogon on <IP_ADDRESS>:53: no such host
[Sarama] 2020/12/02 14:53:37 Producer shutting down.
[Sarama] 2020/12/02 14:53:37 Closing Client

Problem Description
I want to implement a customer dialer, and specifying my dns server, since I have got the broker hostname

anyone can help me? Thanks!

go 	config.Net.Proxy.Enable = true 	MyDialer := &net.Dialer{ 		Timeout:   config.Net.DialTimeout, 		KeepAlive: config.Net.KeepAlive, 		LocalAddr: config.Net.LocalAddr, 		Resolver: &net.Resolver{ 			PreferGo: true, 			Dial: func(ctx context.Context, network, address string) (net.Conn, error) { 				d := net.Dialer{ 					Timeout: time.Millisecond * time.Duration(10000), 				} 				return d.DialContext(ctx, "udp", "<IP_ADDRESS>:53") 			}, 		}, 	} 	config.Net.Proxy.Dialer = MyDialer
I have config the Resolver, but the kafka log still is <IP_ADDRESS>
[Sarama] 2020/12/02 16:14:03 producer/broker/0 state change to [closing] because dial tcp: lookup bogon on <IP_ADDRESS>:53: no such host

Turn out my dns server occur error, now it's ok,  but the log is misleading =. =
I thought my method wrong... thank I use tcpdump to capture the flow


New site: Team page

Humanize the people behind Pony.
Get info on core team members and committers.
Name, picture (some agreed upon standard size), short bio
Link to team page off of community.

Could https://github.com/ponylang/ponylang-website/blob/main/docs/blog/.authors.yml be used to auto-generate that?

The authors for the blog aren't the same as "the team", so no. The sets have some overlap but are not the same.


Feat: Add Feedback Container

This commit has a Feedback Fab Button. The container is setup to change the state. I will have to create a feedback form component which shows up when the state changes!


the --threads 12 not work ,

Q
A

Bug?
maybe

New Feature?
maybe

Version Used
latest

FFmpeg Version
3.1.4

OS
Your OS and version

Hey, everyone.
I just found when I use --threads 12 it's see not work?
top -H
Cpu0  :  2.0%us,  1.0%sy,  0.0%ni, 96.7%id,  0.3%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu1  :  1.0%us,  0.7%sy,  0.0%ni, 98.3%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu2  :100.0%us,  0.0%sy,  0.0%ni,  0.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu3  :  0.3%us,  0.0%sy,  0.0%ni, 99.7%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Mem:  16334284k total, 11951960k used,  4382324k free,   552792k buffers
Swap:        0k total,        0k used,        0k free, 10246436k cached
PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
31744 admin     20   0  942m  36m 4600 R 99.7  0.2   0:10.11 ffmpeg
ps -aux | grep ffmpeg
admin    32354 88.8  0.1<PHONE_NUMBER>2 ?        Sl   18:11   0:10 /var/tmp/ffmpeg -y -i upload/song_url/2016/07/song_url_1_2016_07_01_12_19_36.mp3 -threads 12 -acodec libmp3lame -b:a 128k -ac 2 upload/song_url/2016/07/song_url_1_2016_07_01_12_19_36_128.mp3
It's very slow and take lots of CPU resource,  Can anyone help me on this?

Adding more threads without having more cpu cores results in the negative effect. In ideal cases, each processor core should have one thread to handle. So, you may want to set you want to use 4 cores.


Add changes from pull 3639, workaround for GH #6211

This PR doesn't have the unit tests mentioned in GH #6211, but does act as a workaround for people who need to solve this problem before said unit tests are implemented.

Please add a unit test, both for test coverage and for verifying the need for this feature (and its correctness).


chore: Use the pom.xml in the current directory as a default value for --file

Relates to #12.
One problem with the default value is obviously that it throws at you an ugly stacktrace if there is no pom.xml file in the current directory.
I guess it makes sense to check for the existence and present a nicer error message?

Agreed. Adding a check before executing the real command would be ideal.

Build failed because PRs don't have access to repo vars 😠

The file parameter is now validated and shows an error if the pom.xml (which is either provided by --file or defaulted to pom.xml) does not exist.


Add decompilation tests for generated example JSON files

We don't expect the decompiled .bicep file to match the original one, but we should at least make sure that the decompiler is able to decompile all the example .json files without errors.

I'll pick this up 👍


Podboat: Document operations which were missing

Fixes #876.
Found the operations missing from documentation by looking through src/keymap.cpp (searched for KM_PODBOAT and KM_BOTH).

Coverage remained the same at 54.69% when pulling 9fdf752542eb71ae8130dc42cb5cc6f241c70863 on dennisschagt:bugfix/issue-876 into 7112a9436b292d264649a43af7a5bd66d6cdaa5d on newsboat:master.

Thanks!


Jon readme

Fixed SpanID error when receiving traces that don't follow from other spans;
Need to fix trace start time to readable format;


Allow quoting ENV file values.

This fixes issues such as #7660, where the value of an environment variable was "null" (or any other of the reserved words).
This PR allows quoting these values with double quotes.
We can discuss the details (single vs. double quotes, fastest implementation etc.), but I think this should really be fixed.
Why was this valid issue closed and even locked anyway? :angry:

Shouldn't this be handled by phpdotenv? I think it is in their 2.0 version?

No. We implemented this wrapping layer, so we should fix bugs in this layer.

Fair enough then. :)

Probably just should have used a filetype that supported null/false etc in the first place like YAML or JSON ;)
But :+1: for handling edgecases like 'null' as a string value.

Haha, we should have seen this coming. ;)

I think this is perhaps an edge case.

Yes, it is, but it affects a real user. No chance?

All edge cases do though. I still think it's so much of an edge case it's
not worth implementing. Would suggest just not using null as database
password.
On Saturday, March 7, 2015, Franz Liedke<EMAIL_ADDRESS>wrote:

Yes, it is, but it affects a real user
https://github.com/laravel/framework/issues/7660. No chance?
—
Reply to this email directly or view it on GitHub
https://github.com/laravel/framework/pull/7913#issuecomment-77720764.

Okay, thanks for the explanation.

Guys, this really needs accessing. It's currently not possible to use the null queue driver.

Oh, nice, now there's a nice use case ;)

Yeah that's more legit :)
On Saturday, March 7, 2015, Franz Liedke<EMAIL_ADDRESS>wrote:

Oh, nice, now there's a nice use case ;)
—
Reply to this email directly or view it on GitHub
https://github.com/laravel/framework/pull/7913#issuecomment-77724748.


[WIP] Add danger-todoist to plugins

This adds a still wip plugin https://github.com/hanneskaeufler/danger-todoist to the list. Just pinging to see if this is a plugin you'd think is worth including.

Failed to parse danger-todoist showing error:

  Generated by :no_entry_sign: danger

IMO, yeah, this would be worth it 👍 - get it passing bundle exec plugins lint

@dbgrandi says this should have a closure API so that you can loop through all the TODOs and run against the code ( for example to see if it includes a JIRA ticket )

It does/did already pass danger plugins lint. I think this fails as long as the plugin in not pushed to rubygems yet? Which I did by now. Will force push again...

Ah, yeah, legit - the dangerfile should let us know.
So while this PR has been opened - we've moved to GitLab - where this PR got copied, so if this looks good I'll merge it there, and close this one

handled in gitlab 👍


⚠ SceneTime has degraded performance

In 9184d2d, SceneTime ($ST) experienced degraded performance:

HTTP code: 200
Response time: 1622 ms

Resolved: SceneTime performance has improved in 84210f4 after 8 minutes.


Error converting mistral to onnx

Describe the bug
Error converting mistral to onnx
Expected behavior
!pip install virtualenv
!virtualenv myenv
!source /content/myenv/bin/activate

!git clone https://github.com/neuralmagic/sparseml
#!pip install sparseml
!pip install -e "sparseml[transformers]"

#!pip uninstall transformers
#!pip install nm-transformers

!python sparseml/src/sparseml/transformers/sparsification/obcq/obcq.py OpenBuddy/openbuddy-mistral-7b-v13.1 open-platypus --recipe recipe.yaml --device cuda:0 --precision float16 --save True

Environment
Include all relevant environment information:

OS [e.g. Ubuntu 18.04]: 22
Python version [e.g. 3.7]: 3.11
SparseML version or commit hash [e.g. 0.1.0, f7245c8]:
ML framework version(s) [e.g. torch 1.7.1]:
Other Python package versions [e.g. SparseZoo, DeepSparse, numpy, ONNX]:
Other relevant environment information [e.g. hardware, CUDA version]:

To Reproduce
Exact steps to reproduce the behavior:
Errors
!python sparseml/src/sparseml/transformers/sparsification/obcq/export.py --task text-generation --model_path obcq_deployment
!cp deployment/model.onnx deployment/model-orig.onnx
Traceback (most recent call last):
  File "/content/sparseml/src/sparseml/transformers/sparsification/obcq/export.py", line 542, in <module>
    main()
  File "/content/sparseml/src/sparseml/transformers/sparsification/obcq/export.py", line 529, in main
    export(
  File "/content/sparseml/src/sparseml/transformers/sparsification/obcq/export.py", line 507, in export
    export_transformer_to_onnx(
  File "/content/sparseml/src/sparseml/transformers/sparsification/obcq/export.py", line 345, in export_transformer_to_onnx
    export_onnx(
  File "/content/sparseml/src/sparseml/pytorch/utils/exporter.py", line 488, in export_onnx
    out = tensors_module_forward(sample_batch, module, check_feat_lab_inp=False)
  File "/content/sparseml/src/sparseml/pytorch/utils/helpers.py", line 414, in tensors_module_forward
    return module(**tensors)
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1527, in _call_impl
    return forward_call(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/transformers/models/mistral/modeling_mistral.py", line 1083, in forward
    outputs = self.model(
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1527, in _call_impl
    return forward_call(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/transformers/models/mistral/modeling_mistral.py", line 970, in forward
    layer_outputs = decoder_layer(
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1527, in _call_impl
    return forward_call(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/transformers/models/mistral/modeling_mistral.py", line 659, in forward
    hidden_states, self_attn_weights, present_key_value = self.self_attn(
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1527, in _call_impl
    return forward_call(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/transformers/models/mistral/modeling_mistral.py", line 299, in forward
    query_states = self.q_proj(hidden_states)
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1527, in _call_impl
    return forward_call(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/torch/ao/quantization/stubs.py", line 63, in forward
    X = self.module(X)
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1568, in _call_impl
    result = forward_call(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/torch/ao/nn/qat/modules/linear.py", line 41, in forward
    return F.linear(input, self.weight_fake_quant(self.weight), self.bias)
RuntimeError: "addmm_impl_cpu_" not implemented for 'Half'
cp: cannot stat 'deployment/model.onnx': No such file or directory

I also want to add that after quantization and optimization, the model remains the same size. Although the recipe says quantization 8

Hey @meomeomeome
Regarding your export issue, please use the following entrypoint for export;
sparseml.export --task text-generation --model_path obcq_deployment
Regarding the model size issue, could you paste here an artifact that illustrates the comparison? Perhaps some stdout from du -sh * or tree ?

sparseml.export --task text-generation --model_path obcq_deployment

In your instructions at https://github.com/neuralmagic/sparseml/tree/main/src/sparseml/transformers/sparsification/obcq
Model preparation is done with this command
python sparseml/src/sparseml/transformers/sparsification/obcq/obcq.py HuggingFaceH4/zephyr-7b-beta open_platypus --recipe recipe.yaml --precision float16 --save True
Those. we load the model in float16 format
Next is the conversion script python
sparseml/src/sparseml/transformers/sparsification/obcq/export.py --task text-generation --model_path obcq_deployment
Which is unable to perform half operations on the CPU
I studied the python files
sparseml/src/sparseml/transformers/sparsification/obcq/export.py --task text-generation --model_path obcq_deployment
and the file
src/sparseml/pytorch/utils/exporter.py from the library, there is an explicit loading of models into the CPU
Does your suggestion
sparseml.export --task text-generation --model_path obcq_deployment
solve the problem of exporting a model in onnx to float16? What library files are used for this and how is the problem of incompatibility of CPU operations with float16 solved?
Based on the size of the model, from my experience with Tiny LLama, I realized that the final reduction of the model occurs after complete conversion to onnx in the deployment folder

sparseml.export --task text-generation --model_path obcq_deployment
dont have options --model_path
also i can't try all for end procces convert to onnx because conversion kill process with 83 gb memory when bin files of model only 15 gb

Hey @meomeomeome
Short update from my side:
I tried to recreate your problem locally.

I generated your obcq_deployment directory
Exported the model using sparseml.export obcq_deployment  --trust_remote_code --sequence_length 64 --task text-generation. I confirm that the export takes a prohibitively large amount of CPU memory during the export. However, by specifying --sequence_lenght {int} argument, you can potentially reduce your peak memory consumption. Setting it to something smaller like 32 or 64 should work, but will naturally limit the capabilities of your model. This is a big issue and something that we are currently working on.
I was also able to reproduce the export error in obcq/export.py (RuntimeError: "addmm_impl_cpu_" not implemented for 'Half' ). Not sure why you see this using the pathway. While we are looking into the issues, please note that this pathway will over time get deprecated in favor of sparseml.export.

Hey @meomeomeome
Short update from my side: I tried to recreate your problem locally.

I generated your obcq_deployment directory
Exported the model using sparseml.export obcq_deployment  --trust_remote_code --sequence_length 64 --task text-generation. I confirm that the export takes a prohibitively large amount of CPU memory during the export. However, by specifying --sequence_lenght {int} argument, you can potentially reduce your peak memory consumption. Setting it to something smaller like 32 or 64 should work, but will naturally limit the capabilities of your model. This is a big issue and something that we are currently working on.
I was also able to reproduce the export error in obcq/export.py (RuntimeError: "addmm_impl_cpu_" not implemented for 'Half' ). Not sure why you see this using the pathway. While we are looking into the issues, please note that this pathway will over time get deprecated in favor of sparseml.export.

Setting it to something smaller like 32 or 64 should work, but will naturally limit the capabilities of your model  - What do you mean? Will this slow down the export process, or will the model lose quality after exporting to onnx? P.S. base model context window 4096

When running in our deepsparse pipeline you will not be able to generate more than e.g. 64 - num_tokens(prompt) tokens in the single inference. This will however reduce peak mem consumption as well as accelerate the export process

When running in our deepsparse pipeline you will not be able to generate more than e.g. 64 - num_tokens(prompt) tokens in the single inference. This will however reduce peak mem consumption as well as accelerate the export process

Does this apply only to the pipeline or any other output methods?
import psutil
import time
# Получение информации о памяти и CPU
memory_usage = psutil.virtual_memory()
cpu_frequency = psutil.cpu_freq()

print(f"Total Memory: {memory_usage.total / (1024 ** 3)} GB")
print(f"Memory Used: {memory_usage.used / (1024 ** 3)} GB")

# Получение информации о CPU
cpu_frequency = psutil.cpu_freq(percpu=True)
cpu_count = psutil.cpu_count(logical=False)
cpu_logical_count = psutil.cpu_count(logical=True)
cpu_model = None
with open("/proc/cpuinfo", "r") as f:
    for line in f:
        if "model name" in line:
            cpu_model = line.strip().split(":")[1].strip()
            break

# Вывод информации
print(f"CPU Model: {cpu_model}")
print(f"Physical Cores: {cpu_count}")
print(f"Logical Cores (including hyperthreading): {cpu_logical_count}")

for i, freq in enumerate(cpu_frequency):
    print(f"Core {i}: {freq.current / 1000:.2f} GHz")

print(f"Total CPU Frequency: {psutil.cpu_freq().current / 1000:.2f} GHz")

prompt = "How to make banana bread?"
formatted_prompt =  f"<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistant\n"
# Измерение до инференса
memory_before = psutil.virtual_memory().used

start_time = time.time()
output = model(formatted_prompt, max_new_tokens=500).generations[0].text
end_time = time.time()

# Измерение после инференса
memory_after = psutil.virtual_memory().used

print(f"Inference Time: {end_time - start_time} seconds")
print(f"Memory Used During Inference: {(memory_after - memory_before) / (1024 ** 2)} MB")

Resullt and speed model loaded by from deepsparse import TextGeneration in memory TinyLlama 1.19GB(converted seq_l 128)-- 19 seconds!!
Total Memory: 50.993690490722656 GB
Memory Used: 3.8117218017578125 GB
CPU Model: Intel(R) Xeon(R) CPU @ 2.20GHz
Physical Cores: 4
Logical Cores (including hyperthreading): 8
Core 0: 2.20 GHz
Core 1: 2.20 GHz
Core 2: 2.20 GHz
Core 3: 2.20 GHz
Core 4: 2.20 GHz
Core 5: 2.20 GHz
Core 6: 2.20 GHz
Core 7: 2.20 GHz
Total CPU Frequency: 2.20 GHz
Inference Time: 19.88378143310547 seconds
Memory Used During Inference: 2.390625 MB
Banana bread is a delicious and nutty bread that is easy to make. Here is a recipe for banana bread:

Ingredients:

    1 1/2 cups flour
    1/2 cup sugar
    1/2 cup baking powder
    1/2 cup whole milk
    1/4 cup oil
    1/4 cup eggs
    1/4 cup raisins
    1/4 cup raisin bread crumbs
    1/4 cup pecans
    Salt
    Sugar
    Bread
    Flour
    Water
    Butter
    Oil
    eggs
    milk
    raisins
    raisin bread crumbs
    pecans
    salt
    baking powder
    oil
    eggs
    milk
    flour
    sugar
    bread
    oil
    eggs
    milk
    raisins
    raisin bread crumbs
    pecans
    salt
    baking powder
    oil
    eggs
    milk
    flour
    sugar
    bread
    oil
    eggs
    milk
    raisins
    raisin bread crumbs
    pecans
    salt
    baking powder
    oil
    eggs
    milk
    flour
    sugar
    bread
    oil
    eggs
    milk
    raisins
    raisin bread crumbs
    pecans
    salt
    baking powder
    oil
    eggs
    milk
    flour
    sugar
    bread
    oil
    eggs
    milk
    raisins
    raisin bread crumbs
    pecans
    salt
    baking powder
    oil
    eggs
    milk
    flour
    sugar
    bread
    oil
    eggs
    milk
    raisins
    raisin bread crumbs
    pecans
    salt
    baking powder
    oil
    eggs
    milk
    flour
    sugar
    bread
    oil
    eggs
    milk
    raisins
    raisin bread crumbs
    pecans
    salt

And i have 2 questions
Does this apply only to the pipeline or any other output methods? (seq_l)
And what method most speed for inferense? (i intrested load model form my disk and memory)

I do not understand the two questions, could you rephrase them, please?
I imagine that if you run the exported post-obcq ONNX model in the deepsparse pipeline (as you do above), setting a small sequence_length on the export may mess up some models. This is because the sequence_length set during export influences the size of the positional embeddings available for the exported model. As a result, you may get unexpected errors. I see that you are getting satisfying results for your model, so maybe that is not the case for this particular network.
@mgoin Could you take a look? Is my hypothesis more or less correct?

As I understand it, no one knows how to solve the export problem without limiting the context window --sequence_length 64. If you leave it the same as in the base model, when exporting, the memory for exporting the model with the original size of 15 GB takes up the entire memory of 83 GB.
Does anyone know the methodology of how to solve this using batch size or distributing processing in parts?

@meomeomeome
This is a known issue exporting requires a lot of memory, depending on the sequence_length. We'll be noting this as a known issue in the pending 1.7 product release.

Hello @meomeomeome
A heads up that 1.7 recently went out. We hope this can address the issue you faced.
Thank you! Jeannie / Neural Magic


fix the error in wal throttle log which print wrong threshold

Description
Before this change, the log print original max_wal_size when throttling down. Actually its use max_wal_size * 0.8 as the threshold of throttle down.
This PR fix this isssue.

coverage: 45.473% (-0.008%) from 45.481% when pulling dddd629fb2771db0c6732ff9cd903e214123f3f9 on fix_wal_throttle_log into 4f94283804ada76df475ca3d377017699c102009 on master.


[WIP] Update text for organ donor promotion

This updates the text for the organ donor promotion to include the new
separate opt in and opt out links.
It's backwards compatible with the old promotions which have only a
single url key, and this is treated as the opt in URL.
Depends on https://github.com/alphagov/publisher/pull/1088 and https://github.com/alphagov/govuk-content-schemas/pull/910.
Trello Card

It looks like we won't need this anymore.


Change default order of summary widgets and detail views on target profile page

To prepare for the alpha release, can we please change the default order of the summary widgets and detail views on the target profile page?

Known Drugs
Target Tractability
Target Safety
TEPs
Chemical Probes
Baseline Expression
Gene Ontology
Protein Information
Pathways
Related Targets
Cancer Biomarkers
Cancer Hallmarks
Mouse Phenotypes
Variation & Genomic Context
Homology
Bibliography

Ticket closed as PR approved and work merged into alpha


Advanced Search and Filter

The button in the landing page.. maybe the same one when displaying the list of initiatives...
Here is GIF of how the search and select function works in google sheets, and a copy of the design artboards

has the coding been done to distinguish between active and non-active initiatives?
Basically... it should be something like in the front matter
---
since: 2012
---

this is equal to active. if
---
since: 2012-2014
---

then it should be as inactive

The search function will be performed by Algolia, it searched name and location (country and city). It displays the logo of the initiative if there is one. But other functionalities are still missing