Problems with Latest release (2024-11-11)

Hello and thanks again for this great tool!
For some reason, over the last few days my use of this tool with my outlook account has stopped working as it was for many blissful months.
Upon re-authorizing, the outlook connection would work - but only one time! After that, I had to go through the re-auth process again (and again). I compared the before and after config files and there are definitely changes being made to that file. So I am really not at all sure what the issue might be - especially given that the mechanism works for one time.
I then noticed that there was an update to 2024-11-11 and I hoped it might address this issue. So I tried to download the emailproxy-2024-11-11_pyinstaller-Windows.zip file. But I am immediately told by Windows Defender that the file is a trojan:

This is obviously quite disconcerting... So I cannot install this regardless.
So I am hoping for some help getting things going again with outlook. I should mention that through all of this, the connection to gmail seems to work just fine.
Best

You can see from this set of notifications that the authorization completed and then did not work the next time:

And Thunderbird (my email client) shows this as a result of the failure:

Please post your configuration file (these attributes) and the proxy's log in debug mode.
Repeated requests for authentication are typically because the offline_access scope is missing. But if you haven't changed anything, it's unlikely this is the case. The error message you're getting is actually a request from the server for more information, and the debug log will illuminate what this might be.
Re: virus detection – this is a false positive. It is of course up to you whether you trust this, but it is unfortunately a common issue when packaging Python applications with PyInstaller (which is what the proxy uses). The release executable is built automatically by GitHub from the source in this repository, so there's very little potential for malicious interference. But if you'd rather build it yourself, that's also possible.

Thanks Simon. Should I be worried about posting the requested info here? Should I PM it somehow?
I did check the config file for offline access and I see this:
oauth2_scope = https://outlook.office.com/IMAP.AccessAsUser.All https://outlook.office.com/POP.AccessAsUser.All https://outlook.office.com/EWS.AccessAsUser.All https://outlook.office.com/SMTP.Send offline_access
I haven't touched this (at least not recently) so I don't think this is it.
I did read that MS had some kind of big outage/problems yesterday and wonder if this is somehow related? But I have also read that this is supposedly resolved by now and my issue persists.
After posting, I did see a closed issue that addresses the PyInstaller false positive. Not sure what I will do about that. But I am presuming my issue is NOT "fixed" in the latest.
Also, I have noted that using my Firefox browser, the authorize did not work. I got an URL back in the address bar. But it did not walk me through the whole MS login process. I thought this odd and tried again using Chrome. At least the 1st time I did this, I was walked-through the login process before I got the URL back. However, now it is not doing that when I try again to authorize. Is this expected?
Thanks for all!

Here is the debug log that I have obfuscated a bit and zipped.
emailproxy - Copy.zip

BTW - I submitted the latest windows installer zip to Virus Total. Here are its results. I don't know anything about most of the scanners being referenced.
VirusTotal - File - 4d9a71e7921536d131e7ea7de7dc283ec3ba4d5ed19b70fd279c24cce7f9d163.pdf

Thanks for providing the log file. There are two different providers (Gmail and Outlook) and two different protocols (POP and SMTP) in use here. When trying to debug, it's always easier if you try to isolate the account you're having issues with. Because of this, I've ignored the Gmail details given that you mention Outlook is the service you're having problems with.
The log begins with a POP login attempt, and you successfully authorise this. Login succeeds. There are then two further successful POP login attempts (with no authorisation prompt).
You then try SMTP, and there is an error decrypting the cached credentials. This leads to an authentication request (which you complete), but then another POP login attempt comes in that fails to decrypt the new cached credentials. Your client then tries other methods, and essentially the POP and SMTP connections end up in conflict over which one has the correct credentials.
The key issue here is that you're using a different password for your POP and SMTP connections. As noted in the documentation, it is essential that all protocols used with the same account use the same credentials, otherwise they will trigger constant re-authentication requests. If you'd rather these failed instead, you can set the delete_account_token_on_password_error option, which will cause attempts using the wrong password to fail rather than clearing the cached details.

Thanks for the helpful description. I am not at all sure how that had happened. I checked Thunderbird's remembered passwords for both POP and SMTP and they were identical. However, for some reason, after having re-done the authorizations, it seems to be working just fine again. About the only thing that might have influenced this is that my computer did its nightly reboot during the intervening period. Sorry to have bothered you. I still do not understand what might have caused this in the first place. But I suspect that Outlook periodically just forces its clients to re-authenticate (for no reason other than its own). Best!


Notation of $\phi$ in Chapter 8

Thank you for the nice book on BO
In Eqn (8.9), p.159, and several other equations in the same chapter, $\phi$ is used to denote

the function evaluation $\phi = f(x)$, and
the PDF of standard normal distribution $\phi\left(\frac{\mu-\phi^*}{\sigma}\right)$

which can be a bit confusing.
It may be better to replace $\phi$ for the standard normal PDF with $\varphi$

I apologize for the confusion, and your solution is indeed elegant. Note that the standard normal pdf case will always appear with an argument, whereas the function value case will not.
If there's ever an edition 2 I will take your advice in mind.


fixed warns in test_convergence.py

Added reg strength explicitly as parameter to silence the warning message.

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 97.24%. Comparing base (e739138) to head (e9a5deb).

Additional details and impacted files
@@             Coverage Diff              @@
##           development     #242   +/-   ##
============================================
  Coverage        97.24%   97.24%
============================================
  Files               20       20
  Lines             1815     1815
============================================
  Hits              1765     1765
  Misses              50       50

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Added test and updated supported platforms

Hello @jackton1! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

In the file test_package/main.py:

Line 1:1: W391 blank line at end of file


Heroku Deployment

We need to get Heroku deployment working in order to easily test the mobile app + API together.

Resolved by PR https://github.com/llam15/assassin-server/pull/11


Same-version breaking change check added BreakingChangeReviewRequired instead of NewApiVersionRequired

https://github.com/Azure/azure-rest-api-specs-pr/pull/16984
https://dev.azure.com/azure-sdk/internal/_build/results?buildId=3477365&view=results
Teams post

I suspect it may be because of the BreakingChangeRules.yml entry that instructed the automation to add BreakingChangeReviewRequired.
This bug likely was introduced while working on:

https://github.com/Azure/azure-sdk-tools/issues/6374

Specifically:

Pull Request 524748

Looks like in this specific case the automation was not at fault; the "wrong" label, BreakingChangeReviewRequired, was added manually:

https://github.com/Azure/azure-rest-api-specs-pr/pull/16984#event-11751767391

However, this bug report let me discover a case that I didn't consider before: if the "same version breaking changes" check (Swagger BreakingChange) reports a failure, it may report a BreakingChangeReviewRequired instead of VersioningReviewRequired. Example rule definition showing this:

https://devdiv.visualstudio.com/DevDiv/_git/openapi-alps?path=/private/azure-swagger-validation/azureSwaggerValidation/src/config/BreakingChangeRules.yml&version=GBmain&line=63&lineEnd=63&lineStartColumn=13&lineEndColumn=41&lineStyle=plain&_a=contents

We decided to go with proposal B from this gist
This is captured by this PR:
Pull Request 528285: Make automation add VersioningReviewRequired instead of NewApiVersionRequired. Bugfix in ARM review handling. Assorted refactoring and new breaking changes types for labels.

This will be fixed when this is fixed:

https://github.com/Azure/azure-sdk-tools/issues/7724


Created Homepage and directory structure

Here is the home page
http://ghost---shadow.github.io/aima-javascript/
Each folder I have created will have all javascript files associated with that chapter and one index.html for demonstration on HTML canvas.
Mr. Prabod might have to move his js to corresponding folders.

I added just HTML and CSS. As far as I know, they cannot be unit tested.

I cannot issue pull request with aimacode/gh-pages, histories dont match.
Please delete aimacode/gh-pages and fork it again from master.

Sorry, I missed seeing that this request was here. I will delete aima-javascript/gh-pages and fork it again from aima-javascript/master.

OK @Ghost---Shadow ; should be ready now.

@Ghost---Shadow could you resolve conflicts and resubmit? Thanks!


tf.nn.dynamic_rnn

when we call dynamic_rnn, the code say: If time_major == True, this will be a Tensor shaped:
[max_time, batch_size, cell.output_size].but your out_size is a tf.TensorShape(shape + [self._filters]),
so will it work?

Yes, it will work. Feel free to try.


fixtures: support more than one source folder (fix #217)

GOPATH can contain more than one folder separated by ':'. To check it correctly,
we use SrcDirs() method to be able to check into all the source folders if
fixtures exists.

Current coverage is 76.28% (diff: 100%)

Merging #219 into master will decrease coverage by 0.63%

@@             master       #219   diff @@
==========================================
  Files            96         96
  Lines          6299       6299
  Methods           0          0
  Messages          0          0
  Branches          0          0
==========================================
- Hits           4845       4805    -40
- Misses          922        971    +49
+ Partials        532        523     -9

Powered by Codecov. Last update 51e9a9c...85acafc


Use single underscore for BEM modifier classes instead of double-hyphen

As of the 2.3.1 release of @salesforce-ux/design-system, it seems that the double-hyphen -- syntax for CSS modifier classes has been deprecated in favor of a single underscore _.
From https://www.lightningdesignsystem.com/release-notes/:

Release 2.3.1 - May 25, 2017
Big Impact
BEM Naming Change
Initially we used the double dash style for BEM notation (--). Due to the fact that double dashes are problematic in an XML environment (which doesn't allow double dashes within comments), we have upgraded our syntax to use the single underscore style (_). This change is backward compatible for 18 months. But all components going forward are built with the single underscore BEM style.

Ironically, the markup on that page seems to still use the double-hyphen syntax.
If the single underscore is the recommended syntax going forward (and if the double-hyphen syntax will be removed in a few months), it would be great to switch the @salesforce/design-system-react components and the examples in the documentation to use the new syntax.
In our codebase, it has caused a mixed use of both syntaxes. I ended up writing an ESLint rule with a fixer to resolve the issue for us (which I'm happy to provide here as well if you think it will be useful).

Thanks for thinking of us! Please proceed. It would be appreciated.
eslint is part of the project's test task. Is it something that would work with eslint --fix? Would all the issues need to be fixed first before we could merge it?

Yes, it is fixable with eslint --fix. I'll find some time to put up a PR. I could fix the class names as part of the PR, though I'm not sure how you'd want to best handle that given it could lead to some conflicts with outstanding PRs. Let me know what you think.

That's very thoughtful. All open PRs except for your Avatar one right now are internal employee contributions. Please go ahead and modify everything and update your other pull request--if this something you can do in the next few days. I will deal with and tweak open PRs with this change, etc. if needed.

Going to work on this now. My plan is to create an eslint plugin within this repo and use it in the eslint config. eslint does have a CLI options for specifying a custom --rulesdir; however, that would mean all developers would need to invoke it with that flag (which seems like a bad developer experience).
Ideally, the ESLint plugin containing the custom rule would be published itself. However, I was thinking to just install the dev dependency from the local directory for the time being. I'll put up a PR, but mark it as DO NOT MERGE because I don't know if you would want to merge it with the local dependency.

This seems like a local plugin to me--although you might ask the SLDS team @brandonferrua @stefsull if they are interested in an eslint plugin NPM module for the changes to the BEM structure that we had to make because of Platform issues (I think).
As far as eslint CLI arguments, no one should be running eslint by itself in this library. See https://github.com/salesforce/design-system-react/blob/master/package.json#L21 . We should just be able to tack it on to existing NPM scripts. Does that sound good to you?

My only worry would be those who use ESLint in their IDEs would need to match the same settings.

@sudowork I'm open to NPM publishing packages to, if that's easiest.
See the Babel preset folder here. https://github.com/salesforce/design-system-react/tree/master/preset
I rename the package.json file and push that folder to NPM, so that's an option, too.

I think the local package will work. I had some issues with prettier-eslint, but it should work with the additional --eslint-path argument in the npm script.

I plan to remove prettier-eslint in the next month or so and just go straight prettier AND eslint. I can remove it sooner than later if it makes it easier for you.

You can build on this if you want. https://github.com/salesforce/design-system-react/pull/1528


Merged branch

This is the merge after I tried to rebase the navbar branch.

Can you please do a thorough review if this is not destroying past improvements?

And sorry I made a mess

I'm relly relieved to hear it -.-


ttnn.arange operation fails with "valid page size" error [Grayskull and Wormhole]

Describe the bug
ttnn.arange operation breaks with "RuntimeError: TT_FATAL @ tt_metal/impl/buffers/buffer.cpp:31: valid_page_size" error in some test cases.
To Reproduce
Steps to reproduce the behavior:

Checkout main branch
Run unit test test_arange.py using this command:
pytest tests/ttnn/python_api_testing/non_working_unit_tests/grayskull/test_arange.py

Expected behavior
There is a test case presented in the unit test tests/ttnn/python_api_testing/non_working_unit_tests/grayskull/test_arange.py and are expected to fail with VALID PAGE SIZE error
For example, the test is expected to fail with this error message:
RuntimeError: TT_FATAL @ tt_metal/impl/buffers/buffer.cpp:31: valid_page_size

Getting Additional info for the operation under test and its behavior
To get additional information and results for different combinations of input shapes, types, layouts and memory configs for which this operation was tested you can also run locally sweeps for ttnn.geglu and check the results. To do this you should:

Follow the Getting Started page to setup the repo, environment variables and python-env
Activate source build/python_env/bin/activate
Run sweeps by using python tests/tt_eager/python_api_testing/sweep_tests/run_pytorch_test.py -i tests/ttnn/python_api_testing/sweep_tests/test_configs/ci_sweep_tests_broken/grayskull/ttnn_arange_test.yaml -o ./result-sweeps
After the run is completed all test sweeps results should be available inside specified output directory (in this case ./result-sweeps). There you will find arange_sweep.csv which holds all executed sweeps, among which you can also find the ones that failed and were recreated by the unit test, which you can get by searching unique data_seed field.

@jliangTT @npetrovic-tenstorrent , This arange op can contain both even and odd number of tensor elements, for tensor that needs to be created in the device should be even elements like [1,1,1,32] but some cases like [1,1,1,31] contains odd number of elements causing this error.
The implementation works correctly and only during tensor creation, this error occurs

Hi @npetrovic-tenstorrent , fix for this issue has been merged to main. Kindly check and close this issue. PR Link

Hi @npetrovic-tenstorrent , fix for this issue has been merged to main. Kindly check and close the issue
PR Link

Hi @npetrovic-tenstorrent , fix for this issue has been merged to main. Kindly check and close the issue PR Link

Seems to be working now. I close the issue.


Battery level

Description:
Change name of battery_voltage to battery_level
Update camera tests and utilize constant for CONFIG

This PR has commits from https://github.com/fronzbot/blinkpy/pull/835.  I will rebase if necessary after 835 is merged.

Related issue (if applicable): fixes #
Checklist:

[x] Local tests with tox run successfully PR cannot be meged unless tests pass
[x] Changes tested locally to ensure platform still works as intended
[x] Tests added to verify new code works

Do we really still need py38?

It's ok - I was using | in dictionaries for the tests.  Moved to {**x,**y} which is 3.8 compatible.
There was a reused "constant" that I was going to touch to many times, so I "simplified" it.

At some point we will need to do a release to fix the HA wifi sensor issue.
There is a bit of noise on 2FA right now, so maybe we hold off just a bit to see if something has changed on the Blink side....


BUG- Missing or wrong documentation for Polars

Bug description
Release notes mentionned that we now support Polars but I have no idea how to use it. I tried putting different strings in exposed type without success.
Either this feature does not exist at all and this is an error inside the doc or if it exists, there are no ways to know how to use it.
This is also what I get when I try to run a code using polars.
[2024-12-04 11:14:00.518][Taipy][ERROR] The `exposed_type` of DataNodeConfig `output_data` must be either "pandas", "numpy", or a custom type. Current value of property `exposed_type` is "polars.LazyFrame".
Configuration errors found. Please check the error log for more information.

Polars is not mentionned.
Test Code:
from taipy import Config, Gui
import taipy.gui.builder as tgb
import taipy as tp

def handle_preprocessing(data):
    # some polars code to preprocess data

    return data

input_data_cfg = Config.configure_data_node(
    id="input_data",
    storage_type="csv",
    default_data={"a": [1, 2, 3], "b": [4, 5, 6]},
    exposed_type="polars.LazyFrame",
)

output_data_cfg = Config.configure_data_node(
    id="output_data",
    storage_type="csv",
    exposed_type="polars.LazyFrame",
)

scenario_cfg = Config.configure_scenario(
    id="scenario",
    task_configs=[
        Config.configure_task(
            id="task",
            input=input_data_cfg,
            output=output_data_cfg,
            function=handle_preprocessing,
        )
    ],
)

if __name__ == "__main__":
    tp.Orchestrator().run()
    scenario = tp.create_scenario(scenario_cfg)
    with tgb.Page() as page:
        tgb.scenario_selector("{scenario}")
        tgb.scenario("{scenario}")

        tgb.data_node(
            lambda scenario: scenario.output_data if scenario is not None else None
        )

        tgb.chart(
            lambda scenario: (
                scenario.output_data.read() if scenario is not None else None
            )
        )

    Gui(page).run()

Must be documented on both develop and 4.0.X versions.

Should you be assigned to this and have this issue in review/Q&A? @toan-quach


docs: fix doc/scripts/sync_to_translation_status.er and update some actions

I encountered a bug that seemed to be caused by non-intuitive behavior of default arguments when using a recursive function in Python, so I fixed it by switching to a for loop.
@mtshiba

Although not directly related to this PR, I enhanced the type definitions of os.path and added a method called Str.from that does the same thing as Python's self[nth:].
So, mylib.{d.er, py} should no longer be necessary from the next release, which will be released next week.

@mtshiba
Thank you for your prompt response. I tried replacing mylib.{d.er, py} with the latest commit on the main branch, and I was able to replace almost everything. However, I couldn't replace the parts using __file__, and it seems that __file__ is not available when running with erg run. (It worked when I transpiled with erg transpile and then ran the Python file.)
print! __file__

$ erg test.er
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "test.er", line -1, in <module>
NameError: name '__file__' is not defined. Did you mean: '__name__'?

In this case, I am using it to obtain the directory of the currently executing file and set it as the current directory.
os = pyimport "os"

cwd = os.path.dirname! __file__
os.chdir! cwd

@mtshiba Thank you for your prompt response. I tried replacing mylib.{d.er, py} with the latest commit on the main branch, and I was able to replace almost everything. However, I couldn't replace the parts using __file__, and it seems that __file__ is not available when running with erg run. (It worked when I transpiled with erg transpile and then ran the Python file.)
print! __file__

$ erg test.er
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "test.er", line -1, in <module>
NameError: name '__file__' is not defined. Did you mean: '__name__'?

In this case, I am using it to obtain the directory of the currently executing file and set it as the current directory.
os = pyimport "os"

cwd = os.path.dirname! __file__
os.chdir! cwd

I believe this bug has been fixed in the main branch.


4.3.4: Blank screen or "Guest has not initialized the display (yet)." on start

Describe the issue
I am unable to install Windows 11. After following instructions found here https://docs.getutm.app/guides/windows/, I run the VM and the screen remains blank.
Configuration

UTM Version: Version 4.3.4 (86)
macOS Version: Ventura 13.5
Mac Chip: M1

Crash log
UTM does not crash.
Debug log
debug.log
Upload VM
config.plist.zip
Screenshot of blank:

Note that I tried to use both Windows11_InsiderPreview_Client_ARM64_en-us_23506.VHDX or 22621.1_MULTI_ARM64_EN-US.ISO and got the same result each time.

I am experiencing the same no-display issue when attempting to boot an existing Win11 (virtio-ramfb-gl) and Gentoo (virtio-gpu-pci) following the update of UTM to v4.3.4 - so this may not be just a new-VM problem. Host is a M1 running Ventura 13.4.1(c).

Does restarting your computer help?

Also can you try adding a serial port to the VM and starting it and see if anything shows up in the terminal? There may be an error message there.

Does restarting your computer help?

Unfortuantely no.

Also can you try adding a serial port to the VM and starting it and see if anything shows up in the terminal? There may be an error message there.

There isn't any output in the serial device.
Btw., I use the AppStore Version of UTM 4.3.4 (86)

This is a bizarre bug. I can only reproduce it on App Store/TestFlight builds but not on the GitHub DMG or development builds...

I also just updated to 4.3.4 on the App Store and have the same issue with all of my existing Windows 11 and Ubuntu VMs (except Windows XP for some reason).
The VM uses approx 40% of CPU while displaying "Guest has not initialized the display (yet)." indefinitely and never boots.
All of the VMs were working perfectly before updating.

I have the same problem. App was installed via Apple App Store. Version 4.3.4 (86)

as others mentioned in similar posts, only UTM from app store is affected. My workaround at the moment is using UTM from the website: https://mac.getutm.app

Same, latest AppStore version, Linux arm64 VM, whether existing or trying to set up a new one — "guest has not initialized the display" and 300% CPU usage.

The issue with the Mac App Store build has been identified as QEMU reading the UEFI BIOS as all 00s while the DMG build reads it properly. This is extremely weird because we use the exact same binary for both with the same entitlements. The only difference is the code signature. My hunch is that there is some weird race condition in QEMU when trying to read the UEFI BIOS and so the current thinking is to downgrade to QEMU 7.2.0. I am trying to build it right now and test it and if it works, I'll submit an update to the MAS ASAP to get this resolved. This is super frustrating because I could have never imagined that the MAS build would act differently and I am still trying to figure out exactly why. As it currently stands every VM that uses UEFI will not boot so this is a pretty big issue and I apologize for not catching it earlier.

The irony of the timing. Having used UTM for a while, I decided yesterday to buy it via the AppStore...only to find out it was broken :P ! Thank you for all your hard work, UTM rules.

v4.3.5 has been tested and should resolve the issue by downgrading QEMU to v7.2.0 and EDK2 to edk2-stable202102. As soon as Apple approves it, the update should go out to App Store users.

@osy thank you very much 👍
i already migrated my VMs yesterday to version of UTM i downloaded from https://mac.getutm.app/ and removed the one i downloaded from the App Store. Is there any benefit using the version from App Store beside getting notified about new versions of the app?

Any luck with this? i am facing similar issue, 3 weeks back opened and issue but dont see any recommendation or solution on that.
https://github.com/utmapp/UTM/issues/5479

i switched to version 3.15 and install ubuntu (it was the one i had no screen on) then upgraded to the latest version and all work now win11 macos 14 and 9 :)

i switched to version 3.15 and install ubuntu (it was the one i had no screen on) then upgraded to the latest version and all work now win11 macos 14 and 9 :)
mac m1

Are you using dual screen in your machine

no just 1
it was only when I had to reinstall ubuntu the others have worked all the time 4.3.4 and 4.3.5

FWIW I have that message if I try to boot a Win 11 guest (MBA 15 M2 host) with a projector connected.
Without the projector connected to the MBA, Win 11 boots fine but, when I subsequently plug in the projector the screen in the guest window goes blank (white).
Hopefully this 4.4.0 version is officially released soon. Thanks.

Im having the same problem with UTM on my M1 Mac with UTM 4.3.5 trying to run Linux with QEMU.
I tried different versions of QEMU (7.2, 7.1, .. a few), but am still getting the "Guest has not initialized the display (yet).
Any news or suggestions?
I possible, I'd like to keep the App Store version because of the automatic updates...

Tried 4.4.3 beta dmg but still getting the "Guest has not initialized the display (yet)". M2 MBA, Win 11 Guest.

@hrpomrx What display settings ended up working? I'm getting the same issue too

@hrpomrx What display settings ended up working? I'm getting the same issue too

Hi, @Bonnie39.
At some point I had used another display like VGA and had set the VGA Device RAM to something other than the (grayed out) default which, in my case was 16. I had set it higher than that and saved. On switching back to virtio-ramfb, I got the error....until I switched back to VGA, deleted my custom VGA Device RAM setting, saved, and went back to virtio-ramfb. Then it magically worked. YMMV, but I think there's maybe a rogue ram variable floating around somewhere. I'd suggest going to other display types and removing any custom RAM settings you might have.

For me, I had the similar issue and could not solve with the solutions mentioned in this Issue page. I actually found that was due to an option checked without I fully understanding it.

The option "Boot from kernel image" in the page when setting up should be unchecked. Then I entered the VM successfully.

@hrpomrx What display settings ended up working? I'm getting the same issue too

Hi, @Bonnie39.
At some point I had used another display like VGA and had set the VGA Device RAM to something other than the (grayed out) default which, in my case was 16. I had set it higher than that and saved. On switching back to virtio-ramfb, I got the error....until I switched back to VGA, deleted my custom VGA Device RAM setting, saved, and went back to virtio-ramfb. Then it magically worked. YMMV, but I think there's maybe a rogue ram variable floating around somewhere. I'd suggest going to other display types and removing any custom RAM settings you might have.

thanks @hrpomrx . This worked for me:

Set to VGA and custom VGA device ram:

Saved this setting

Opened settings again. Set display hardward as virtio-ramfb

Saved this setting

Opened up the VM and it worked!

My resolution was simple. I clicked the shut down button on the black window and turned on again. And it worked. I wasn't expecting that. :)

I'm facing same issue, try all action which posted above still facing same issue. Guest has not initialised the display yet. Can any suggest the remedy ? How to get rid of this issue ?

Hey, I tried this and it worked for me
https://github.com/utmapp/UTM/issues/5525#issuecomment-2294831090

Same problem here im running iPhone 15
Latest IOS UTM from appstore


Configure SmallRye Metrics in the basic testsuite

MetricsTest is currently ignored as we don't have the SmallRye MP Metrics impl ready yet.

FaultToleranceTest is also ignored.


Error when passing in a sensitive secret value

Describe the bug
When I pass in a sensitive("x") value as secret I get an error.
 Error: Invalid for_each argument
│
│   on .terraform/modules/db1_stage_url/main.tf line 39, in resource "google_secret_manager_secret_version" "secret":
│   39:   for_each    = toset(compact([var.secret]))
│     ├────────────────
│     │ var.secret has a sensitive value
│
│ Sensitive values, or values derived from sensitive values, cannot be used as for_each arguments. If used, the sensitive value could be exposed as a
│ resource instance key.

```## Environment

Terraform v1.3.9
on darwin_arm64
+ provider registry.terraform.io/hashicorp/google v4.51.0
+ provider registry.terraform.io/hashicorp/google-beta v4.53.1
+ provider registry.terraform.io/vercel/vercel v0.11.4

Providers required by configuration:
.
├── provider[registry.terraform.io/hashicorp/google-beta]
├── provider[registry.terraform.io/hashicorp/google] 4.51.0
├── provider[registry.terraform.io/vercel/vercel] 0.11.4
├── module.db1_stage_url
│   └── provider[registry.terraform.io/hashicorp/google] >= 4.8.0
└── module.hasura_stage
    ├── provider[registry.terraform.io/hashicorp/google]
    └── provider[registry.terraform.io/hashicorp/google-beta]

Providers required by state:

    provider[registry.terraform.io/hashicorp/google]

    provider[registry.terraform.io/hashicorp/google-beta]

    provider[registry.terraform.io/vercel/vercel]

## Reproducing the issue

module "stage_url" {
  source     = "memes/secret-manager/google"
  version    = "2.1.0"
  project_id = "..."
  id         = "stage_url"
  secret    = sensitive("x")
}

## Additional context

Workaround: wrap `nonsensitive()` around the secret value before passing

@cassus - thanks for the bug report. I've made a change to the module that changes the way a secret version resource is created if secret variable is not empty. This should address the issue.

Works perfectly, thank you very much!


Import command does not import if --no-interactive is specified

Laravel Version: 5.4
Adldap2-Laravel Version: 3.0.4
PHP Version: 7.1

Description:
The import command will not import users if the import command is run with --no-interactive

Steps To Reproduce:
Run the import script with --no-interaction.

PR: https://github.com/Adldap2/Adldap2-Laravel/pull/284

Closed due to merge of PR #284

Thanks again @jameskraus, I can always tweak it later if necessary.


MSID: 85111 DOI: 2<IP_ADDRESS>5698

[PLACE MANUSCRIPT AND EDITOR DETAILS HERE WHEN AVAILABLE] See step 3
[PLACE PDF URL HERE WHEN AVAILABLE] See step 7
Step 1. Inform bioRxiv
Who can help: @QueenKraken, @nlisgo, @scottaubrey

[ ] Manuscript is in data hub index (https://data-hub-api.elifesciences.org/enhanced-preprints/docmaps/v1/get-by-doi?preprint_doi=10.1101%2F2<IP_ADDRESS>5698)

or (only one should be ticked. remove other from description.)

[ ] Confirmed with Ted at bioRxiv that MECA archive is available

Send the following email to Ted and wait for his reply.
Hi Ted,

Please can you prepare the preprint MECA for 10.1101/2<IP_ADDRESS>5698

Thanks

Step 2. Create preview of manuscript
Who can help: @fred-atherden, @nlisgo, @scottaubrey

[ ] Manuscript is available for preview (https://prod--epp.elifesciences.org/preview/10.1101/2<IP_ADDRESS>5698)

[ ] Trigger import for staging: https://prod--epp.elifesciences.org/import
[ ] Sync data folder with s3://prod-elife-epp-data/data
[ ] Trigger import for staging: https://staging--epp.elifesciences.org/import
[ ] Sync data folder with s3://staging-elife-epp-data/data
[ ] Pull request created to enhanced-preprint-data
[ ] Post link to pull request below

Pull request: [PLACE LINK TO PULL REQUEST HERE]
Detailed instructions: https://github.com/elifesciences/enhanced-preprints-data#add-a-manuscript
Step 3: Awaiting public reviews
Who can help: Editorial team

[ ] Public reviews available on sciety (https://sciety.org/articles/activity/10.1101/2<IP_ADDRESS>5698)
[ ] Manuscript and editor details at the top of this issue (Supplied by Editorial team)

Example
"msas": "Genetics and Genomics", "Neuroscience"
"msid": "84628"
"version": "1"
"preprintDoi": "10.1101/2<IP_ADDRESS>4241"
"articleType": "Reviewed Preprint"
"status": "Published from the original preprint after peer review and assessment by eLife."

"Reviewed Preprint posted": "2023-01-02"
"Sent for peer review": "2022-10-28"
"Posted to bioRxiv": "2022-11-21" (link: "Go to bioRxiv": "https://www.biorxiv.org/content/10.1101/2<IP_ADDRESS>4241v1")

Editors:
Reviewing Editor
Michael B Eisen
University of California, Berkeley, United States
Senior Editor
Michael B Eisen
University of California, Berkeley, United States

Step 4: Modify manuscripts.json (no PDF)

[ ] Reviewed preprint is published to EPP (https://elifesciences.org/reviewed-preprints/85111)

[ ] Pull request created to enhanced-preprint-client
[ ] Pull request switched to "Ready for review"
[ ] Post link to pull request below

[ ] Request that a doi be registered

[ ] Post link to #enhanced-preprint comment below

Pull request: [PLACE LINK TO PULL REQUEST HERE]
#enhanced-preprint comment thread: [PLACE LINK TO COMMENT HERE]

Instructions to modify manuscripts.json

Visit: https://github.com/elifesciences/enhanced-preprints-client/actions/workflows/publish-manuscript.yaml
Click: Run workflow
Complete the form and click "Run workflow"
A successful run should result in a new pull request at https://github.com/elifesciences/enhanced-preprints-client/pulls
Open the pull request and click the "Ready for review" button to trigger tests
Once the tests pass and you are happy with the changes the PR can be merged

Example pull request: https://github.com/elifesciences/enhanced-preprints-client/pull/334/files
Once the pull request is merged in it should be available a few minutes later.

Request that a doi
Post the following in #enhanced-preprint:
@Fred can you register a doi for https://elifesciences.org/reviewed-preprints/85111

Step 5: Awaiting search reindex

[ ] Reviewed preprint is avaliable on journal homepage (https://elifesciences.org)

The search reindex is triggered once an hour. We need the reviewed preprint to be indexed as the search application serves the journal homepage.

Additional info
If needed, the jenkins pipeline to reindex search can be triggered sooner.
https://alfred.elifesciences.org/job/process/job/process-reindex-reviewed-preprints/

Step 6: Published! Request PDF generation

[ ] Post the link to the PDF url at the top of the issue

[ ] Post link to #enhanced-preprint comment below

#enhanced-preprint comment thread: [PLACE LINK TO COMMENT HERE]
Post the following to the #enhanced-preprint on slack:
@Ryan Dix-Peek please can you generate a PDF for https://elifesciences.org/reviewed-preprints/85111

Step 7: Introduce PDF to data folder and git repo

[ ] PDF is avaliable at https://github.com/elifesciences/enhanced-preprints-data/raw/master/data/10.1101/2<IP_ADDRESS>5698/2<IP_ADDRESS>5698.pdf

Detailed instructions: https://github.com/elifesciences/enhanced-preprints-data#add-a-pdf
Step 8: Add PDF url to manuscripts.json

[ ] Reviewed preprint PDF is available for download (https://prod--epp.elifesciences.org/reviewed-preprints/85111)

[ ] Pull request created to enhanced-preprint-client
[ ] Pull request switched to "Ready for review"
[ ] Post link to pull request below

[PLACE LINK TO PULL REQUEST HERE]

Instructions to add PDF url to manuscripts.json

Visit: https://github.com/elifesciences/enhanced-preprints-client/actions/workflows/add-pdf-url-to-manuscript.yaml
Click: Run workflow
Complete the form and click "Run workflow"
A successful run should result in a new pull request at https://github.com/elifesciences/enhanced-preprints-client/pulls
Open the pull request and click the "Ready for review" button to trigger tests
Once the tests pass and you are happy with the changes the PR can be merged

Example pull request: https://github.com/elifesciences/enhanced-preprints-client/pull/397/files
Once the pull request is merged in it should be available a few minutes later.

Step 9: Done!

[ ] Kettle is on!

First REVISED Reviewed Preprint to publish

@acollings checking on the flexibility of the publish date on the ticket. The team is in the 3 day exploration next week and will probably need Thurs & Fri to continue working on the revised preprint.
Additional question: should we expect more public reviews on Sciety, triggered by this revised version?

Thanks @QueenKraken yep, happy to move it, let's aim for April 24, if that's okay? Yes, we'll have an updated assessment and updated public reviews to post to Sciety. I was going to wait until a few days before publication, but please let me know if it would help to have them posted sooner!

That's awesome, thank you :D

@acollings can you hold back on posting public reviews to allow us to complete work this week. Then (providing we get code in this week) you can post them on Monday - would that work?

@QueenKraken I realise we'd forgotten to include the latest author responses, but they've been posted now. Please note that they include some figures (which display on bioRvix and hypothesis but not on Sciety): will that be okay? Also, when do you think we'll get to see a preview? Thanks!

Please note that they include some figures (which display on bioRvix and hypothesis but not on Sciety): will that be okay?

@acollings I can answer this one - that shouldn't be a problem. The content we will eventually read from is here: https://sciety.org/evaluations/hypothesis:lxpxhN9cEe2uucduJPd1xg/content , which contains the figures as images. I quickly put together that content into a different paper in EPP just to see how it should look:

So not the same as a guarantee it definitely will be working when we wire up the revised version, but I can't foresee any issues at this stage with what we know.

@scottaubrey that's great. (If it gets very messy, we can host the figures and link out to them, but let's see how this goes.)

Thanks @scottaubrey

@fred-atherden FYI, in light of feedback from Mike, I'm going to make some changes to the author response before publication. Will keep you posted.

OK - thanks

@fred-atherden I've updated the author response. I can't recall if I added the blocked label or not! In any case, from my perspective, we can proceed.


👌 IMPROVE: readme formatting

markdown lint formatting compliance

Bash function keyword

@ahmadawais feedback implemented and PR's split & Ready

Hey @ahmadawais, is there anything more i need to do with this PR to move it forward or make it easier to review?


Scroll performance issue (setState from  _handleWindowScrollEvent() in WindowScroller)

First, thank you for open sourcing and maintaining this library.
Observed problem is that it jitter/freeze/flicker when scrolling. I'm using WindowScroller, AutoSizer, Masonry.  here is the gif
Here are what I've tried.
It seems like _handleWindowScrollEvent() from WindowScroller takes up the time and specifically setState part. I think It's not the setState itself rather It is the cascading updates by setStating value of isScrolling, scrollLeft, scrollTop. It cascades to WindowScroller -> AutoSizer -> Masonry -> cellRenderer -> and my components.  I don't find any problem with the code, but I have this issue taking up a lot of time at scripting(not rendering)
Here are more details from chrome devtool's performance tool. As you see, most of time is used for scripting not rendering of components.
This is how the each Scroll event looks like.
   That Event(scroll) blocks can vary. It is short and not slow when cascade update downs to cellRenderer and not rendering my component. It is long when I have to render my components. It sounds like an re-rendering problem... I'm not really sure...
Here is how my components are rendered.
   you can see how the cascading updates look like.
In terms of re-rendering or re-mounting, #1028 #368 are related.
So, This is kind of a temporary hack I've done. Problem seems severe when my components need to be rendered. Prevent rendering kind of make this issue less heavy. I just overscanByPixels={4000} to something like this so that It just renders a lot at one time. This will make using virtualization technique useless, but It prevents re-rendering/re-mounting components at every scroll. Here is what It looks like

I feel like It is almost smooth. It still takes up sometime though(compared to the Masonry docs example)
I've digged in to WindowScroller.js, onScroll.js or issues or stack overflow but I couldn't fix this problem.
What do you think of this? It doesn't seem like browser issue.... but I've tested at chrome 65.0.3325.181
Here is the performace profiler file. It is a json file. you can F12 and go to performance tab and click "Load profile..." https://drive.google.com/open?id=1t20lzwrAlRy0q3A3bGf40Z5F3nsI33Wh
(btw I'm using react-redux(Connect) with reselect and passing ids only to child so I think It is not the problem..? also I'm wrapping my components with react-beautiful-dnd(Droppable, Draggable)  before I used react-dnd(DropSource, DropTarget, DragLayer) but had same issue. maybe helpful info)

Oh, I forgot to upload the chrome performace profiler file. It is a json file. you can F12 and go to performance tab and click "Load profile..."  https://drive.google.com/open?id=1t20lzwrAlRy0q3A3bGf40Z5F3nsI33Wh

Try do not pass isScrolling to the table.

I have the same performance issues. Removing onChildScroll from WindowScroller improved performance. Furthermore I render simple elements in my cell renderer is isScrolling is true.

I think we're going to try to tackle perf issues in v10 💯

Looking forward to get this fixed! :D

Hi @filipemonteiroth , I currently don't have much time to dedicate to perf issues in react-virtualized.
However, v10 is currently in alpha and is here in which  @bvaughn has made a bunch of performance gains.

In my case, the components in the list were re-rendering on each scroll about 3 times (probably scroll event fires that often). After making sure they don't re-render, each scroll cost dropped from 1.5 seconds to just a few milliseconds.

Hi, @thehappycoder.  I have the same issue. Please, could you give me a tip on how to avoid re-rendering?

@cecbr You can find out about that here https://reactjs.org/docs/optimizing-performance.html In most case the cause is an anonymous function created and passed from parent's render method.

Hi @thehappycoder. Thanks for tip. I made some changes and using PureComponent
the performance has improved a lot. But my component continues to be re-rendered three times each scroll. Could you help me with some other tip specifically about this? Were you able to solve this situation?

@cecbr scroll event probably fires 3 times. Can't probably change that. I didn't look further into that.


Write/Drain and Readback Manual Test

Following #1229, I've added two files to manual-testing to verify the operation of write() and in particular, drain() events.
The the uses two USB serial devices to form a loopback test. I've used an additional environment variable TEST_PORT_RX to denote the receiver. Example usage:
TEST_PORT=/dev/ttyUSB0 TEST_PORT_RX=/dev/ttyUSB1 DEBUG=* node read.js
TX from TEST_PORT should be connected to RX on TEST_PORT_RX.
It will exit with ok (0) if number of bytes received matches number of bytes expected, otherwise error (1). Console log messages show sent data length and received data length. The script should be called from the script directory due to the child process calling the drain.js script explicitly - might be worth changing this to pass CWD.

Codecov Report

Merging #1256 into master will decrease coverage by 0.13%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #1256      +/-   ##
==========================================
- Coverage   79.77%   79.64%   -0.14%
==========================================
  Files          19       18       -1
  Lines         895      845      -50
  Branches      166      164       -2
==========================================
- Hits          714      673      -41
+ Misses        181      172       -9

Impacted Files
Coverage Δ

lib/bindings/auto-detect.js
69.23% <0%> (-30.77%)
:arrow_down:

lib/bindings/win32.js

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f69407d...b9c44c6. Read the comment docs.

@reconbot Thanks. I've taken into account the review - learnt something new with the parser. All lints fine now too.  Not sure if the coverage is something I can resolve?


Pin k8s.io libs to 1.31.4

Pin k8s.io libs to 1.31.4
Since we're having some trouble with the bump to 1.32.0 libs, see #2160 and #2157

I cancelled CI until #2162 merges and then we can rebase this PR and push it through CI.


Broken Pipe exceptions raised after idle periods

I'm using long-lived client objects like so:
client = discovery.build(....)
task = client.get_something(....).execute(num_retries=5)
some_long_running_process(task)
client.do_another_thing().execute(num_retries=5)

And running into exceptions on the calls to do_another_thing():
Traceback (most recent call last):
  File "/opt/app/gcp_helper.py", line 168, in get_size
    instanceGroupManager=instance_group).execute(num_retries=5)
  File "/opt/venv/local/lib/python2.7/site-packages/oauth2client/util.py", line 137, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "/opt/venv/local/lib/python2.7/site-packages/googleapiclient/http.py", line 755, in execute
    method=str(self.method), body=self.body, headers=self.headers)
  File "/opt/venv/local/lib/python2.7/site-packages/googleapiclient/http.py", line 93, in _retry_request
    resp, content = http.request(uri, method, *args, **kwargs)
  File "/opt/venv/local/lib/python2.7/site-packages/oauth2client/client.py", line 633, in new_request
    self._refresh(request_orig)
  File "/opt/venv/local/lib/python2.7/site-packages/oauth2client/contrib/gce.py", line 129, in _refresh
    META, headers={'Metadata-Flavor': 'Google'})
  File "/opt/venv/local/lib/python2.7/site-packages/httplib2/__init__.py", line 1609, in request
    (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)
  File "/opt/venv/local/lib/python2.7/site-packages/httplib2/__init__.py", line 1351, in _request
    (response, content) = self._conn_request(conn, request_uri, method, body, headers)
  File "/opt/venv/local/lib/python2.7/site-packages/httplib2/__init__.py", line 1273, in _conn_request
    conn.request(method, request_uri, body, headers)
  File "/usr/lib/python2.7/httplib.py", line 1001, in request
    self._send_request(method, url, body, headers)
  File "/usr/lib/python2.7/httplib.py", line 1035, in _send_request
    self.endheaders(body)
  File "/usr/lib/python2.7/httplib.py", line 997, in endheaders
    self._send_output(message_body)
  File "/usr/lib/python2.7/httplib.py", line 850, in _send_output
    self.send(msg)
  File "/usr/lib/python2.7/httplib.py", line 826, in send
    self.sock.sendall(data)
  File "/usr/lib/python2.7/socket.py", line 224, in meth
    return getattr(self._sock,name)(*args)
error: [Errno 32] Broken pipe"

I would expect the num_retries argument to handle these exceptions in https://github.com/google/google-api-python-client/blob/master/googleapiclient/http.py#L145, but for the time being I have to implement my own retry logic around all API calls to overcome this.

It's likely that c6425a00e3c fixed this, but we haven't cut a new release. Can you try the HEAD version and see if you still see this issue?

Still happening on master:
Traceback (most recent call last):
  File "/opt/app/gcp_helper.py", line 168, in get_size
    instanceGroupManager=instance_group).execute(num_retries=5)
  File "/opt/venv/local/lib/python2.7/site-packages/oauth2client/util.py", line 135, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "/opt/venv/local/lib/python2.7/site-packages/googleapiclient/http.py", line 820, in execute
    method=str(self.method), body=self.body, headers=self.headers)
  File "/opt/venv/local/lib/python2.7/site-packages/googleapiclient/http.py", line 147, in _retry_request
    resp, content = http.request(uri, method, *args, **kwargs)
  File "/opt/venv/local/lib/python2.7/site-packages/oauth2client/client.py", line 632, in new_request
    self._refresh(request_orig)
  File "/opt/venv/local/lib/python2.7/site-packages/oauth2client/contrib/gce.py", line 129, in _refresh
    META, headers={'Metadata-Flavor': 'Google'})
  File "/opt/venv/local/lib/python2.7/site-packages/httplib2/__init__.py", line 1609, in request
    (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)
  File "/opt/venv/local/lib/python2.7/site-packages/httplib2/__init__.py", line 1351, in _request
    (response, content) = self._conn_request(conn, request_uri, method, body, headers)
  File "/opt/venv/local/lib/python2.7/site-packages/httplib2/__init__.py", line 1273, in _conn_request
    conn.request(method, request_uri, body, headers)
  File "/usr/lib/python2.7/httplib.py", line 1001, in request
    self._send_request(method, url, body, headers)
  File "/usr/lib/python2.7/httplib.py", line 1035, in _send_request
    self.endheaders(body)
  File "/usr/lib/python2.7/httplib.py", line 997, in endheaders
    self._send_output(message_body)
  File "/usr/lib/python2.7/httplib.py", line 850, in _send_output
    self.send(msg)
  File "/usr/lib/python2.7/httplib.py", line 826, in send
    self.sock.sendall(data)
  File "/usr/lib/python2.7/socket.py", line 224, in meth
    return getattr(self._sock,name)(*args)
error: [Errno 32] Broken pipe"

Is that a socket.error or an IO/OSError? Seems to be an IOError - we may just have to add some additional logic here. If you want to make a PR, I'll be happy to review it.

Fixed in 713b1de1078008c0353e00820e1.

Hi, I'm using the Cloud-Vision API in python with similar conditions (a long-lived object and long idle sessions between requests)
I get the same error message a lot, therefore I wonder if this could be the same problem mentioned above, so pulling the latest commit should fix it.
I copy the related part from traceback here:
in detect_text     responses = request.execute(num_retries=num_retries)   File "/opt/python/run/venv/lib/python2.7/site-packages/oauth2client/util.py", line 135, in positional_wrapper     return wrapped(*args, **kwargs)   File "/opt/python/run/venv/lib/python2.7/site-packages/googleapiclient/http.py", line 755, in execute     method=str(self.method), body=self.body, headers=self.headers)   File "/opt/python/run/venv/lib/python2.7/site-packages/googleapiclient/http.py", line 93, in _retry_request     resp, content = http.request(uri, method, *args, **kwargs)   File "/opt/python/run/venv/lib/python2.7/site-packages/oauth2client/client.py", line 621, in new_request     redirections, connection_type)   File "/opt/python/run/venv/lib/python2.7/site-packages/httplib2/init.py", line 1609, in request     (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)   File "/opt/python/run/venv/lib/python2.7/site-packages/httplib2/init.py", line 1351, in _request     (response, content) = self._conn_request(conn, request_uri, method, body, headers)   File "/opt/python/run/venv/lib/python2.7/site-packages/httplib2/init.py", line 1273, in _conn_request     conn.request(method, request_uri, body, headers)   File "/usr/lib64/python2.7/httplib.py", line 1001, in request     self._send_request(method, url, body, headers)   File "/usr/lib64/python2.7/httplib.py", line 1035, in _send_request     self.endheaders(body)   File "/usr/lib64/python2.7/httplib.py", line 997, in endheaders     self._send_output(message_body)   File "/usr/lib64/python2.7/httplib.py", line 850, in _send_output     self.send(msg)   File "/usr/lib64/python2.7/httplib.py", line 826, in send     self.sock.sendall(data)   File "/usr/lib64/python2.7/ssl.py", line 701, in sendall     v = self.send(data[count:])   File "/usr/lib64/python2.7/ssl.py", line 667, in send     v = self._sslobj.write(data) error: [Errno 32] Broken pipe

Let us know if it fixes you.
@nathanielmanistaatgoogle should we cut another minor release?

@jonparrott Probably! Have you any time in the next few days?

Maybe Friday. I'll make a bug for it.

I'm having this issue using the google bigquery API.  I'm pulling data from Azure SQL Server in batches and sending to bigquery.  I have to use batches with some of the tables because of their size.  Because of filtering, ordering and batching of some of the tables, the pulls from Azure take longer than pulls from other tables.  I'm getting the broken pipe error on tables with longer pulls.
I've tried several different batch sizes with the same result.
Any advice would be greatly appreciated.

@klday are you experiencing this with the latest release?

Sorry, I left out some important information:
I'm using pandas to_gbq() to import the data to BigQuery.
Here is my terminal output for the traceback:
Streaming Insert is 100.0% Complete
Traceback (most recent call last):
File "datascience/app_sql_to_bq/main.py", line 146, in
logging_level = args.logging_level)
File "datascience/app_sql_to_bq/main.py", line 83, in main
table_time = bq.sql_data_to_bq_table(sql_resource,bq_resource,sql_table_name,bq_table_id,sql_schema_columns,sql_query,sql_columns,sql_filtered_size_query,step_size=step_size)
File "./datascience/utils/bigqueryUtils.py", line 630, in sql_data_to_bq_table
clean_df.to_gbq(bq_dataset_table_id, bq_project_id, if_exists='append', private_key=key)
File "/opt/conda/lib/python3.5/site-packages/pandas/core/frame.py", line 899, in to_gbq
if_exists=if_exists, private_key=private_key)
File "/opt/conda/lib/python3.5/site-packages/pandas/io/gbq.py", line 724, in to_gbq
connector.load_data(dataframe, dataset_id, table_id, chunksize)
File "/opt/conda/lib/python3.5/site-packages/pandas/io/gbq.py", line 453, in load_data
body=body).execute()
File "/opt/conda/lib/python3.5/site-packages/oauth2client/util.py", line 137, in positional_wrapper
return wrapped(*args, **kwargs)
File "/opt/conda/lib/python3.5/site-packages/googleapiclient/http.py", line 833, in execute
method=str(self.method), body=self.body, headers=self.headers)
File "/opt/conda/lib/python3.5/site-packages/googleapiclient/http.py", line 173, in _retry_request
raise exception
File "/opt/conda/lib/python3.5/site-packages/googleapiclient/http.py", line 160, in _retry_request
resp, content = http.request(uri, method, *args, **kwargs)
File "/opt/conda/lib/python3.5/site-packages/oauth2client/transport.py", line 169, in new_request
redirections, connection_type)
File "/opt/conda/lib/python3.5/site-packages/httplib2/init.py", line 1314, in request
(response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)
File "/opt/conda/lib/python3.5/site-packages/httplib2/init.py", line 1064, in _request
(response, content) = self._conn_request(conn, request_uri, method, body, headers)
File "/opt/conda/lib/python3.5/site-packages/httplib2/init.py", line 988, in _conn_request
conn.request(method, request_uri, body, headers)
File "/opt/conda/lib/python3.5/http/client.py", line 1106, in request
self._send_request(method, url, body, headers)
File "/opt/conda/lib/python3.5/http/client.py", line 1151, in _send_request
self.endheaders(body)
File "/opt/conda/lib/python3.5/http/client.py", line 1102, in endheaders
self._send_output(message_body)
File "/opt/conda/lib/python3.5/http/client.py", line 936, in _send_output
self.send(message_body)
File "/opt/conda/lib/python3.5/http/client.py", line 908, in send
self.sock.sendall(data)
File "/opt/conda/lib/python3.5/ssl.py", line 891, in sendall
v = self.send(data[count:])
File "/opt/conda/lib/python3.5/ssl.py", line 861, in send
return self._sslobj.write(data)
File "/opt/conda/lib/python3.5/ssl.py", line 586, in write
return self._sslobj.write(data)
BrokenPipeError: [Errno 32] Broken pipe

The latest release of ...?

This library, 1.5.2?

Honestly, I have no idea.  I just downloaded the google api tools for the cloud platform.  Those are the most recent tools.  And, I installed those using the command line.  I'm not sure what library you're referring to, but I'm also relatively new to programming.

@klday no worries. Can you open up python and run the following and give me the output?
>>> import googleapiclient
>>> googleapiclient.__version__
'1.5.1'
>>> import oauth2client
>>> print oauth2client.__version__
2.2.0

Yes, thank you.  The output is:

import googleapiclient
googleapiclient.version
'1.5.2'
import oauth2client
Traceback (most recent call last):
File "", line 1, in
ImportError: No module named 'oauthclient'

I am working in a docker container.  I have been creating a google cloud resource to work with the bigquery api tools using a key (pretty sure I'm explaining that correctly).

well, in that case I don't know. It could be an underlying issue with httplib2.
In which case you can try using httplib2shim to see if it fixes it.

Ok, thank you.  I'll give that a shot.

FWIW, I just got this with 1.5.3 (From FreeBSD 10.1, python 3.5.1 if that matters). I guess there's no progress with it?

@LordAro this should definitely be occurring less often. If you can provide a full stacktrace that will be helpful.

Sure
[2016/10/23 18:31:15] (I:googleapiclient.discovery) URL being requested: GET https://www.googleapis.com/youtube/v3/videos?id=5_LxyhCJp
sM&part=snippet%2CcontentDetails%2Cstatistics&alt=json&key=<snip>
[2016/10/23 18:31:15] (E:asyncio) Unhandled exception in event task
future: <Task finished coro=<LinkInfo.scan_privmsg() done, defined at /home/urybot/.pyenv/versions/3.5.1/lib/python3.5/asyncio/corouti
nes.py:204> exception=BrokenPipeError(32, 'Broken pipe')>
Traceback (most recent call last):
  File "/home/urybot/.pyenv/versions/3.5.1/lib/python3.5/asyncio/tasks.py", line 239, in _step
    result = coro.send(None)
  File "/home/urybot/.pyenv/versions/3.5.1/lib/python3.5/asyncio/coroutines.py", line 206, in coro
    res = func(*args, **kw)
  File "/home/urybot/csbot/csbot/plugins/linkinfo.py", line 155, in scan_privmsg
    result = self.get_link_info(part)
  File "/home/urybot/csbot/csbot/plugins/linkinfo.py", line 189, in get_link_info
    result = h.handler(url, match)
  File "/home/urybot/csbot/csbot/plugins/youtube.py", line 153, in page_handler
    response = self._yt(url)
  File "/home/urybot/csbot/csbot/plugins/youtube.py", line 86, in _yt
    json = self.get_video_json(vid_id)
  File "/home/urybot/csbot/csbot/plugins/youtube.py", line 73, in get_video_json
    response = self.client.videos().list(id=id, part='snippet,contentDetails,statistics').execute(http=self.http)
  File "/home/urybot/.pyenv/versions/3.5.1/lib/python3.5/site-packages/oauth2client/util.py", line 137, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "/home/urybot/.pyenv/versions/3.5.1/lib/python3.5/site-packages/googleapiclient/http.py", line 833, in execute
    method=str(self.method), body=self.body, headers=self.headers)
  File "/home/urybot/.pyenv/versions/3.5.1/lib/python3.5/site-packages/googleapiclient/http.py", line 173, in _retry_request
    raise exception
  File "/home/urybot/.pyenv/versions/3.5.1/lib/python3.5/site-packages/googleapiclient/http.py", line 160, in _retry_request
    resp, content = http.request(uri, method, *args, **kwargs)
  File "/home/urybot/.pyenv/versions/3.5.1/lib/python3.5/site-packages/httplib2/__init__.py", line 1314, in request
    (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)
  File "/home/urybot/.pyenv/versions/3.5.1/lib/python3.5/site-packages/httplib2/__init__.py", line 1064, in _request
    (response, content) = self._conn_request(conn, request_uri, method, body, headers)
  File "/home/urybot/.pyenv/versions/3.5.1/lib/python3.5/site-packages/httplib2/__init__.py", line 988, in _conn_request
    conn.request(method, request_uri, body, headers)
  File "/home/urybot/.pyenv/versions/3.5.1/lib/python3.5/http/client.py", line 1083, in request
    self._send_request(method, url, body, headers)
  File "/home/urybot/.pyenv/versions/3.5.1/lib/python3.5/http/client.py", line 1128, in _send_request
    self.endheaders(body)
  File "/home/urybot/.pyenv/versions/3.5.1/lib/python3.5/http/client.py", line 1079, in endheaders
    self._send_output(message_body)
  File "/home/urybot/.pyenv/versions/3.5.1/lib/python3.5/http/client.py", line 911, in _send_output
    self.send(msg)
  File "/home/urybot/.pyenv/versions/3.5.1/lib/python3.5/http/client.py", line 885, in send
    self.sock.sendall(data)
  File "/home/urybot/.pyenv/versions/3.5.1/lib/python3.5/ssl.py", line 886, in sendall
    v = self.send(data[count:])
  File "/home/urybot/.pyenv/versions/3.5.1/lib/python3.5/ssl.py", line 856, in send
    return self._sslobj.write(data)
  File "/home/urybot/.pyenv/versions/3.5.1/lib/python3.5/ssl.py", line 581, in write
    return self._sslobj.write(data)
BrokenPipeError: [Errno 32] Broken pipe

I'm also getting the broken pipe on BatchHttpRequest()
I can get through thousands of calls to the shopping api, but if we have a quiet period, then I get the broken pipe.

This issue is most likely due to httplib2's connection pooling logic. I'd suggest trying httplib2shim.

@jonparrott currently testing this and it seems to have fixed the problem
Is it worth making this the required method for connecting ?

@Bobspadger probably not, but we're soon replacing oauth2client in this library with google-auth, which will allow us to use urllib3 and requests without needed httplib2shim.

@jonparrott excellent, requests makes life so much easier!

@jonparrott Any timeline on this replacement endeavor? It seems like a great idea and this bug is truly annoying.

@jntkflow early next year at the earliest. I recommend using httplib2shim in the meantime.

Hey @jonparrott, any update on timeline here? It looks like the new google-auth python library now exists?

@nharpalani it's looking unlikely that we'll be able to replace httplib2 in this library without massive breaking changes. We're working on a similar effort over on the google-cloud-python package and there's a small chance that work might be transferrable here, but no promises.
Closing for now.

Thanks for the update, Jon!

Is there any workaround for this? I'm guessing redefining client right before each new API call might do it?

I'm experiencing this issue as well...
Using:
Python 3.6.7
>>> import googleapiclient
>>> googleapiclient.__version__
'1.7.8'

Stack trace:
File "/var/task/pubsub_publisher.py", line 42, in handler
  pubsub.projects().topics().publish(topic=_GOOGLE_PUBSUB_TOPIC_NAME, body=body).execute()
File "/var/task/googleapiclient/_helpers.py", line 130, in positional_wrapper
  return wrapped(*args, **kwargs)
File "/var/task/googleapiclient/http.py", line 846, in execute
  method=str(self.method), body=self.body, headers=self.headers)
File "/var/task/googleapiclient/http.py", line 183,in _retry_request
  raise exception
File "/var/task/googleapiclient/http.py", line 164, in _retry_request
  resp, content = http.request(uri, method, *args, **kwargs)
File "/var/task/google_auth_httplib2.py", line 198, in request
  uri, method, body=body, headers=request_headers, **kwargs)
File "/var/task/httplib2/__init__.py", line 1924, in request
  cachekey,
File "/var/task/httplib2/__init__.py", line 1595, in _request
  conn, request_uri, method, body, headers
File "/var/task/httplib2/__init__.py", line 1502, in _conn_request
  conn.request(method, request_uri, body, headers)
File "/var/lang/lib/python3.6/http/client.py", line 1239, in request
  self._send_request(method, url, body, headers, encode_chunked)
File "/var/lang/lib/python3.6/http/client.py", line 1285, in _send_request
  self.endheaders(body, encode_chunked=encode_chunked)
File "/var/lang/lib/python3.6/http/client.py", line 1234, in endheaders
  self._send_output(message_body, encode_chunked=encode_chunked)
File "/var/lang/lib/python3.6/http/client.py", line 1065, in _send_output
  self.send(chunk)
File "/var/lang/lib/python3.6/http/client.py", line 986, in send
  self.sock.sendall(data)
File "/var/lang/lib/python3.6/ssl.py", line 975, in sendall
  v = self.send(byte_view[count:])
File "/var/lang/lib/python3.6/ssl.py", line 944, in send
  return self._sslobj.write(data)
File "/var/lang/lib/python3.6/ssl.py", line 642, in write
  return self._sslobj.write(data)
BrokenPipeError: [Errno 32] Broken pipe

It's something that happens now and then, not super common. Constantly recurring though.
As an example in a sample of 7,741,334 publishes I have 6 of those errors.

Always the issue

This broken pipe issue has occurred again for me now I'm moving to googles v2.1 content API and i'm using a service account (no longer httplib2shim as I've followed the instructions from your example and using all the google libraries.
Is the answer to go back to using httplib2shim.
I too have a long life client - does this need rebuilding before every run ?

?

This is now happening to me via a Cloud Run execution that happens every 30 minutes. What's the status of this fix?

Hi,
I'm having the same issue via Cloud Run also. I randomly get "Broken Pipe" or "connection reset by peer" errors.
I am using the latest version of the Google API client so it seems this has not been fixed yet.

OK this is just a FYI in case someone is having the same problem. I am getting the Broken Pipe error while using Firebase messaging via Cloud Run.
As @theacodes mentioned, this has been fixed in google-cloud-python, which includes APIs for many cloud services, but it doesn't include an API for Firebase messaging.
It seems that this issue will not be fixed soon for Firebase messaging, so try PyFCM. It is based on requests module, so I assume it should not have this issue.

We are also experiencing this issue after upgrading to the latest version.
Would it be appropriate to re-open this ticket, or should I introduce a new one?

We are also experiencing this issue after upgrading to the latest version.
Would it be appropriate to re-open this ticket, or should I introduce a new one?

We have the same issue when running a long ai platform training job from CE instance.
Pipe is broken after 1 hour (+/- minute) of using discovery for ml.v1
google-api-python-client==1.9.1

We have the same issue when running a long ai platform training job from CE instance.
Pipe is broken after 1 hour (+/- minute) of using discovery for ml.v1
google-api-python-client==1.9.1

We have the same issue when call a long ai platform training job from CE instance.
Pipe is broken after 1 hour (+/- minute) of using discovery for ml.v1
google-api-python-client==1.9.1
p.s. update to google.auth (1.24.0) did not help

I am encountered same issue too.

The same for me with ml engine train

Our customers are getting this error when polling DataProc.

I get this with the Google drive API as well :/

I got this error as well and it has been almost a year. I believe I have all latest versions.
google-api-core          2.0.1
google-api-python-client 2.21.0
google-auth              2.1.0
google-auth-httplib2     0.1.0
google-auth-oauthlib     0.4.6
googleapis-common-protos 1.53.0

I get the same problem when calling the compute api
  File "/layers/google.python.pip/pip/lib/python3.9/site-packages/flask/app.py", line 2447, in wsgi_app
    response = self.full_dispatch_request()
  File "/layers/google.python.pip/pip/lib/python3.9/site-packages/flask/app.py", line 1952, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/layers/google.python.pip/pip/lib/python3.9/site-packages/flask/app.py", line 1821, in handle_user_exception
    reraise(exc_type, exc_value, tb)
  File "/layers/google.python.pip/pip/lib/python3.9/site-packages/flask/_compat.py", line 39, in reraise
    raise value
  File "/layers/google.python.pip/pip/lib/python3.9/site-packages/flask/app.py", line 1950, in full_dispatch_request
    rv = self.dispatch_request()
  File "/layers/google.python.pip/pip/lib/python3.9/site-packages/flask/app.py", line 1936, in dispatch_request
    return self.view_functions[rule.endpoint](**req.view_args)
  File "/layers/google.python.pip/pip/lib/python3.9/site-packages/functions_framework/__init__.py", line 171, in view_func
    function(data, context)
  File "/workspace/main.py", line 73, in periodic_check
    status = compute.instances().get(project=project, zone=zone, instance=instance).execute()['status']
  File "/layers/google.python.pip/pip/lib/python3.9/site-packages/googleapiclient/_helpers.py", line 131, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "/layers/google.python.pip/pip/lib/python3.9/site-packages/googleapiclient/http.py", line 922, in execute
    resp, content = _retry_request(
  File "/layers/google.python.pip/pip/lib/python3.9/site-packages/googleapiclient/http.py", line 221, in _retry_request
    raise exception
  File "/layers/google.python.pip/pip/lib/python3.9/site-packages/googleapiclient/http.py", line 190, in _retry_request
    resp, content = http.request(uri, method, *args, **kwargs)
  File "/layers/google.python.pip/pip/lib/python3.9/site-packages/google_auth_httplib2.py", line 218, in request
    response, content = self.http.request(
  File "/layers/google.python.pip/pip/lib/python3.9/site-packages/httplib2/__init__.py", line 1725, in request
    (response, content) = self._request(
  File "/layers/google.python.pip/pip/lib/python3.9/site-packages/httplib2/__init__.py", line 1441, in _request
    (response, content) = self._conn_request(conn, request_uri, method, body, headers)
  File "/layers/google.python.pip/pip/lib/python3.9/site-packages/httplib2/__init__.py", line 1364, in _conn_request
    conn.request(method, request_uri, body, headers)
  File "/opt/python3.9/lib/python3.9/http/client.py", line 1285, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/opt/python3.9/lib/python3.9/http/client.py", line 1331, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/opt/python3.9/lib/python3.9/http/client.py", line 1280, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/opt/python3.9/lib/python3.9/http/client.py", line 1040, in _send_output
    self.send(msg)
  File "/opt/python3.9/lib/python3.9/http/client.py", line 1001, in send
    self.sock.sendall(data)
  File "/opt/python3.9/lib/python3.9/ssl.py", line 1204, in sendall
    v = self.send(byte_view[count:])
  File "/opt/python3.9/lib/python3.9/ssl.py", line 1173, in send
    return self._sslobj.write(data)
BrokenPipeError: [Errno 32] Broken pipe

I am having this error when using Python Gmail API.

If anyone is experiencing the Broken pipe error, please can you share sample code? I'm having difficulty re-creating the issue.


pywavelets fails to install on Alpine Linux v3.15 ARM

Hi!  We do have 64-bit ARM wheels, so are you on 32-bit ARM?
Can you please provide a full build log, here or as a gist?

I didn't found 64bit pywavelets wheels for Alpine (musllinux_1_1_).
Full build log available here.

Ugh, we have aarch64 wheels and musllinux_1_1 wheels, but not musl-on-aarch64 wheels.
So yes you have to build from source. The relevant error is:
RuntimeError: Broken toolchain: cannot link a simple C program

So you don't have a compiler installed or it's not working correctly for some reason.

I'm getting something very similar:
pip install PyWavelets
Collecting PyWavelets
  Using cached PyWavelets-1.2.0.tar.gz (4.6 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... error
  error: subprocess-exited-with-error

  × Preparing metadata (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [22 lines of output]
      setup.py:366: UserWarning: Unrecognized setuptools command, proceeding with generating Cython sources and expanding templates
        warnings.warn("Unrecognized setuptools command, proceeding with "
      Traceback (most recent call last):
        File "/home/ec2-user/.env/lib64/python3.7/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 363, in <module>
          main()
        File "/home/ec2-user/.env/lib64/python3.7/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 345, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
        File "/home/ec2-user/.env/lib64/python3.7/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 164, in prepare_metadata_for_build_wheel
          return hook(metadata_directory, config_settings)
        File "/tmp/pip-build-env-16nqypti/overlay/lib/python3.7/site-packages/setuptools/build_meta.py", line 174, in prepare_metadata_for_build_wheel
          self.run_setup()
        File "/tmp/pip-build-env-16nqypti/overlay/lib/python3.7/site-packages/setuptools/build_meta.py", line 268, in run_setup
          self).run_setup(setup_script=setup_script)
        File "/tmp/pip-build-env-16nqypti/overlay/lib/python3.7/site-packages/setuptools/build_meta.py", line 158, in run_setup
          exec(compile(code, __file__, 'exec'), locals())
        File "setup.py", line 478, in <module>
          setup_package()
        File "setup.py", line 468, in setup_package
          ext_modules = get_ext_modules(USE_CYTHON)
        File "setup.py", line 182, in get_ext_modules
          from numpy import get_include as get_numpy_include
      ModuleNotFoundError: No module named 'numpy'
      [end of output]

on a c6g.4xlarge aws instance (https://aws.amazon.com/ec2/instance-types/ c6g)

Custom built AWS Graviton2 Processor with 64-bit Arm Neoverse cores

what would you advise regarding compiling ?

@rom1504, that looks like pip did not automatically install NumPy as specified in the pyproject.toml file's build requirements.
We have not tested on the AWS Graviton2 platform, so another possibility is that we haven't set the numpy selection logic in pyproject.toml properly for that case. If you manually install the dependencies via python -m pip install numpy cython setuptools wheel does that complete successfully?
I may also be worth first upgrading pip via: python -m pip install -–upgrade pip. If you are still having problems after this can you post a more verbose output using pip install PyWavelets -vvv

hi @grlee77 , I tested again on this platform and if I'm using ubuntu 20.04 instead of aws centos based distribution, it seems to be working.
I guess the difference might come from using python 3.8 in ubuntu 20.04 instead of 3.7 in aws distribution
so this works for me.
I could try again on the aws distribution if that's useful for you

Same problem here. Using GitHub Actions and building within the quay.io/pypa/manylinux2014_aarch64 docker image.  I note that 1.1.1 has manylinux2014_aarch64 wheels, whereas 1.2.0 does not. Previously my build wouldn't fail as 1.1.1 was used, but now this bar got raised by some transitive dependency (probably scikit-image) so that it tries to build 1.2.0 from source (given the lack of wheels) and fails. So IMO there are two issues here: failing build, missing wheel.
 Collecting PyWavelets>=1.1.1
  Downloading PyWavelets-1.2.0.tar.gz (4.6 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.6/4.6 MB 8.8 MB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'error'
  error: subprocess-exited-with-error

  × Preparing metadata (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [22 lines of output]
      setup.py:366: UserWarning: Unrecognized setuptools command, proceeding with generating Cython sources and expanding templates
        warnings.warn("Unrecognized setuptools command, proceeding with "
      Traceback (most recent call last):
        File "/opt/_internal/cpython-3.7.12/lib/python3.7/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 363, in <module>
          main()
        File "/opt/_internal/cpython-3.7.12/lib/python3.7/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 345, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
        File "/opt/_internal/cpython-3.7.12/lib/python3.7/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 164, in prepare_metadata_for_build_wheel
          return hook(metadata_directory, config_settings)
        File "/tmp/pip-build-env-zfcvmo8d/overlay/lib/python3.7/site-packages/setuptools/build_meta.py", line 188, in prepare_metadata_for_build_wheel
          self.run_setup()
        File "/tmp/pip-build-env-zfcvmo8d/overlay/lib/python3.7/site-packages/setuptools/build_meta.py", line 282, in run_setup
          self).run_setup(setup_script=setup_script)
        File "/tmp/pip-build-env-zfcvmo8d/overlay/lib/python3.7/site-packages/setuptools/build_meta.py", line 174, in run_setup
          exec(compile(code, __file__, 'exec'), locals())
        File "setup.py", line 478, in <module>
          setup_package()
        File "setup.py", line 468, in setup_package
          ext_modules = get_ext_modules(USE_CYTHON)
        File "setup.py", line 182, in get_ext_modules
          from numpy import get_include as get_numpy_include
      ModuleNotFoundError: No module named 'numpy'
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

Looking at the pyproject.toml there is not variant that applies to Python 3.7 and aarch64:
"numpy==1.17.3; python_version=='3.7' and (platform_machine!='arm64' or platform_system!='Darwin') and platform_machine!='aarch64' and platform_python_implementation != 'PyPy'",

Looking at the pyproject.toml there is no variant that applies to Python 3.7 and aarch64:

That does sound right. NumPy 1.20.0 does have an aarch64 wheel for Python 3.7: numpy-1.20.0-cp37-cp37m-manylinux2014_aarch64.whl
Adding this to pyproject.toml will probably fix that one:
"numpy==1.20.0; python_version=='3.7' and platform_machine=='arm64' and platform_system=='Darwin'",

That's different from the original report on Python 3.9 though, which was due to musllinux.

Yes, also stumbled into that second bug of the ticket, on a regular python docker image on a regular ubuntu host.

In fact, downgrade to installing PyWavelets==1.1.1 did work with the docker image pypy:3.7-buster
Here's some install logs:

PyWavelets==1.1.1 ✅
root@ef1afc23bfa5:/app# pip install --force-reinstall  PyWavelets==1.1.1
Collecting PyWavelets==1.1.1
  Downloading PyWavelets-1.1.1.tar.gz (4.6 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.6/4.6 MB 43.3 MB/s eta 0:00:00
  Preparing metadata (setup.py) ... done
Collecting numpy>=1.13.3
  Downloading numpy-1.21.5-pp37-pypy37_pp73-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (15.2 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 15.2/15.2 MB 51.7 MB/s eta 0:00:00
Building wheels for collected packages: PyWavelets
  Building wheel for PyWavelets (setup.py) ... done
  Created wheel for PyWavelets: filename=PyWavelets-1.1.1-pp37-pypy37_pp73-linux_x86_64.whl size=4365536 sha256=45ca48848873de2381e4bffe7b0fae306849e0555cba826fffdcc0d6e5de57c3
  Stored in directory: /tmp/pip-ephem-wheel-cache-13r9xh5k/wheels/1e/9f/59/0c5dcd724cfc80b3cc7162beff7af6c52dae351afd991b1058
Successfully built PyWavelets
Installing collected packages: numpy, PyWavelets
  Attempting uninstall: numpy
    Found existing installation: numpy 1.21.2
    Uninstalling numpy-1.21.2:
      Successfully uninstalled numpy-1.21.2
  Attempting uninstall: PyWavelets
    Found existing installation: PyWavelets 1.1.1
    Uninstalling PyWavelets-1.1.1:
      Successfully uninstalled PyWavelets-1.1.1
Successfully installed PyWavelets-1.1.1 numpy-1.21.5
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
root@ef1afc23bfa5:/app#

PyWavelets==1.2.0 ❌
root@ef1afc23bfa5:/app# pip install --force-reinstall  PyWavelets==1.2.0
Collecting PyWavelets==1.2.0
  Downloading PyWavelets-1.2.0.tar.gz (4.6 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.6/4.6 MB 43.8 MB/s eta 0:00:00
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... error
  error: subprocess-exited-with-error

  × Preparing metadata (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [22 lines of output]
      setup.py:366: UserWarning: Unrecognized setuptools command, proceeding with generating Cython sources and expanding templates
        warnings.warn("Unrecognized setuptools command, proceeding with "
      Traceback (most recent call last):
        File "/opt/pypy/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 363, in <module>
          main()
        File "/opt/pypy/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 345, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
        File "/opt/pypy/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 164, in prepare_metadata_for_build_wheel
          return hook(metadata_directory, config_settings)
        File "/tmp/pip-build-env-rnifkqqy/overlay/site-packages/setuptools/build_meta.py", line 188, in prepare_metadata_for_build_wheel
          self.run_setup()
        File "/tmp/pip-build-env-rnifkqqy/overlay/site-packages/setuptools/build_meta.py", line 282, in run_setup
          self).run_setup(setup_script=setup_script)
        File "/tmp/pip-build-env-rnifkqqy/overlay/site-packages/setuptools/build_meta.py", line 174, in run_setup
          exec(compile(code, __file__, 'exec'), locals())
        File "setup.py", line 478, in <module>
          setup_package()
        File "setup.py", line 468, in setup_package
          ext_modules = get_ext_modules(USE_CYTHON)
        File "setup.py", line 182, in get_ext_modules
          from numpy import get_include as get_numpy_include
      ModuleNotFoundError: No module named 'numpy'
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
root@ef1afc23bfa5:/app#

PyWavelets==1.3.0 ❌
root@ef1afc23bfa5:/app# pip install --force-reinstall  PyWavelets==1.3.0
Collecting PyWavelets==1.3.0
  Downloading PyWavelets-1.3.0.tar.gz (4.6 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.6/4.6 MB 54.3 MB/s eta 0:00:00
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... error
  error: subprocess-exited-with-error

  × Preparing metadata (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [22 lines of output]
      setup.py:366: UserWarning: Unrecognized setuptools command, proceeding with generating Cython sources and expanding templates
        warnings.warn("Unrecognized setuptools command, proceeding with "
      Traceback (most recent call last):
        File "/opt/pypy/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 363, in <module>
          main()
        File "/opt/pypy/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 345, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
        File "/opt/pypy/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 164, in prepare_metadata_for_build_wheel
          return hook(metadata_directory, config_settings)
        File "/tmp/pip-build-env-yguhu8o7/overlay/site-packages/setuptools/build_meta.py", line 188, in prepare_metadata_for_build_wheel
          self.run_setup()
        File "/tmp/pip-build-env-yguhu8o7/overlay/site-packages/setuptools/build_meta.py", line 282, in run_setup
          self).run_setup(setup_script=setup_script)
        File "/tmp/pip-build-env-yguhu8o7/overlay/site-packages/setuptools/build_meta.py", line 174, in run_setup
          exec(compile(code, __file__, 'exec'), locals())
        File "setup.py", line 478, in <module>
          setup_package()
        File "setup.py", line 468, in setup_package
          ext_modules = get_ext_modules(USE_CYTHON)
        File "setup.py", line 182, in get_ext_modules
          from numpy import get_include as get_numpy_include
      ModuleNotFoundError: No module named 'numpy'
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
root@ef1afc23bfa5:/app#

The 1.2.0 release (https://pypi.org/project/PyWavelets/1.2.0/#files) has
PyWavelets-1.2.0-cp310-cp310-musllinux_1_1_x86_64.whl
PyWavelets-1.2.0-cp310-cp310-musllinux_1_1_i686.whl

and the same for Python 3.7, 3.8 and 3.9. No aarch64 musllinux wheels though - the reason for that is (from gh-610): I had to disable some musl wheels (see PEP656) on aarch64 or those jobs are right around the timeout threshold. That timeout is why there is a CIBW_SKIP: "*-musllinux_*" set for this case.
The 1.1.1, 1.3.0 and 1.4.0/1 releases all have no musllinux wheels at all (this was skipped on purpose since commit 731e0938). So the 1.1.1 successful install reported in the comment above is for building from source. The skipping of all musllinux wheels was noted in the PR description of gh-626, but it looks like there was no reason given - probably because numpy et al. also don't provide such wheels. Those are coming though, for numpy 1.25.0 I believe (June'23 probably).
We've dropped Python 3.7 support already (pyproject.toml contains requires-python = ">=3.8), so I think that is what it is. The minimum numpy version for the next release is 1.20.3, which AFAIK builds on Alpine Linux just fine (numpy has no musllinux wheels).
The pyproject.toml content has been updated, so I'm not sure if there's anything to do. Perhaps starting to build musllinux wheels again, at least for x86_64?

Nightly wheels for  1.6.0.dev0 (musllinux x86-64 and aarch64) are up at https://anaconda.org/scientific-python-nightly-wheels/PyWavelets/files, and with the final 1.6.0 release they'll land on PyPI.
Expected release date is in 1-2 weeks, shortly after numpy 2.0.0rc1 is available.


dnscrypt-proxy keeps trying to load a nonexistent plugin

I'm not sure why it won't work but I keep getting this error
sudo dnscrypt-proxy /etc/dnscrypt-proxy/dnscrypt-proxy.conf
Mon Jul 24 21:36:03 2017 [INFO] + DNS Security Extensions are supported
Mon Jul 24 21:36:03 2017 [INFO] + Provider supposedly doesn't keep logs
Mon Jul 24 21:36:03 2017 [INFO] Loading plugin [/usr/lib/i386-linux-gnu/dnscrypt-proxy/libdcplugin_example_ldns_aaaa_blocking.so]
Mon Jul 24 21:36:03 2017 [ERROR] Plugin [/usr/lib/i386-linux-gnu/dnscrypt-proxy/libdcplugin_example_ldns_aaaa_blocking.so] can't be loaded: [No such file or directory]
Mon Jul 24 21:36:03 2017 [ERROR] Unable to load plugins
I checked the folder path and there is no dnscrypt-proxy folder let alone the rest of the directory path. I searched my computer for the example ldns .so file with no luck. It seemed to install correctly and I found the config file. but after searching the internet for a while now I can't find an answer on how to fix this :/

How did you install dnscrypt-proxy?
It looks like plugins are missing, but you tried to use them in the configuration file.

Installed via
sudo apt-get install dnscrypt-proxy
ahh that makes sense looking back at the config file I see they are required for block Ivp6. should I just install through source code? I'm not sure how to verify that I have the right plugins, installing from repository (thru bash anyhow)

What Linux distribution is that?
Since they should broken/incomplete packages, you can remove them and maybe install this instead: https://github.com/jedisct1/dnscrypt-proxy-installer

See if your distribution has a separate "dnscrypt-proxy-plugins" package (I know Ubuntu does).
This probably needs to be added to the "setup" section of the wiki.

Sorry for getting back so late, Distro is Parrot OS
@sparkchaser was correct, I hadn't looked thoroughly (because I didn't know there was a plugins package :/) Thank you for your help it works fine now :)


Orbit Slow in FireFox

This is a continuation of an issue reported in the old Git Repo for Orbit:
https://github.com/zurb/orbit/issues/54
I checked out timer.is(':hidden'), and removing that did not fix the problem.
Pretty sure this is an issue with the frequency at which we are rotating the timer. Right now we rotate the image every two degrees, which for short advance speeds means it's redrawing at a high frequency. At much longer advance speeds it performs fine.
Removing the animated timer fixes the issue. Also reducing the frequency at which we rotate the timer helps as well, but then makes it look rougher on faster browsers that can handler the quick redraws.
Any ideas on alternative methods for rotating the spinner that will be performant on older FireFox?

I think I have the same issue :
The speed settings work fine under Safari, not under Firefox


Material UI example is broken

https://github.com/mui/material-ui/tree/master/examples/material-remix-ts
I just get "Upgrade Required" if I use the StackBlitz or CodeSandbox links.

I got lost, and should have filed this on the correct repo.


Getting component props in typescript

Description
I'm trying to forward a prop to a gluestack component, but it gives me, for example, "Property 'as' does not exist on type 'IIconProps & (StyledComponentProps<false | ViewStyle...'." A workaround would be much appreciated!
CodeSandbox/Snack link
No response
Steps to reproduce
tsconfig.json:
{
  "extends"<EMAIL_ADDRESS>  "compilerOptions": {
    "noUnusedLocals": true
  },
}

SampleComponent.tsx:
import type { FC, ComponentProps } from 'react'
import { Icon } from '@gluestack-ui/themed'

type IconProps = ComponentProps<typeof Icon>

type Props = {
  as: IconProps['as']
}

const SampleComponent: FC<Props> = props => {
  return <Icon as={props.as} /> // simplified
}

Error: Property 'as' does not exist on type 'IIconProps & (StyledComponentProps<false | ViewStyle | ImageStyle | TextStyle | RegisteredStyle<ViewStyle> | ... 6 more ... | undefined, unknown, StyledComponentProps<...>, string> | { ...; })'.
gluestack-ui Version
1.1.3
Platform

[ ] Expo
[X] React Native CLI
[ ] Next
[ ] Web
[ ] Android
[ ] iOS

Other Platform
No response
Additional Information
No response

@haruki-m Thanks for reporting this. We'll look into this.

Closing this issue since it has been resolved in the latest version. If the problem continues, please feel free to reopen it.


pre-loading extension

The middle ground for between the payload of single-file-builds and delays due to component loading

prefetch remaining MathJax components after typesetting is complete so as to speed up later pageviews, in particular when browsing (e.g., forums, Q&A pages)

link subresources and prefetch might be options.

basics: http://www.html5rocks.com/en/tutorials/speed/script-loading/#toc-js-has-problems

notes that JS does not work for subresource but it looks like this may have changed...

https://medium.com/@luisvieira_gmr/html5-prefetch-1e54f6dda15d
http://www.chromium.org/spdy/link-headers-and-server-hint/link-rel-subresource
https://developer.mozilla.org/en-US/docs/Web/HTTP/Link_prefetching_FAQ


fix errors on run eventlet with gunicorn

When I try to start server with gunicorn some errors are showed:
gunicorn wsgi:app --worker-class eventlet -w 1 --timeout 120 --no-sendfile -b <IP_ADDRESS>:8000

Error: class uri 'eventlet' invalid or not found:

[Traceback (most recent call last):
  File "/home/bergpb/projects/lisapi/.venv/lib/python3.10/site-packages/gunicorn/util.py", line 99, in load_class
    mod = importlib.import_module('.'.join(components))
  File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/home/bergpb/projects/lisapi/.venv/lib/python3.10/site-packages/gunicorn/workers/geventlet.py", line 20, in <module>
    from eventlet.wsgi import ALREADY_HANDLED as EVENTLET_ALREADY_HANDLED
ImportError: cannot import name 'ALREADY_HANDLED' from 'eventlet.wsgi' (/home/bergpb/projects/lisapi/.venv/lib/python3.10/site-packages/eventlet/wsgi.py)
]

https://github.com/benoitc/gunicorn/pull/2581

fixed with this tip: https://stackoverflow.com/a/67410245/6539270


does not run on Linux

quba_viewer-1.2.0.AppImage doesn't run on Ubuntu 22.04LTS, quits with the first line (xxx not found)
also can't install from github-repo, too many dependencies can't be resolved
I give up.

My bad, apologies, no idea how that got corrupted but it was. Now the download should work after chmodding it +x. Apparently in ubuntu you still need to install libfuse2 to run AppImages at all, though.

This still doesn't work with release 1.4.0 on Ubuntu 22.04.
I installed Quba-1.4.0.AppImage in a minimal Docker container created by debootstrap.
When starting it requests libfuse2, and after that it fails because of missing fusermount.
But even after adding these two packages, it won't start, because it is requesting library after library, libglib, libnss, libatk, libatk-bridge, and so on ...
Only after resolving all the missing libraries, it starts up, sort of.
So, in the end there's nothing left from "download Appimage, make it executable, and enjoy" ;-)


Fix parameter nullability in IInputValueFormatter

A null value is never passed to IInputValueFormatter.Format, so the parameter doesn't need to be marked as nullable.
Related Slack discussion: https://hotchocolategraphql.slack.com/archives/CD9TNKT8T/p1697529768155779

Thats not enough ... there are code paths that invoke it with a nullable contract.
Also there are at least 10 implementations of this interface.
Can you have a look at that?


Cannot allow using a keycode twice

Assigning a key to a function where the key is already in use by another function ends with both keys being added, but only the newest will actually be used.

In the instance where a user tries to assign a key that is already in use, there needs to be some sort of response.

It could be flat out rejected. 'CANNOT USE KEY IN USE'
It could swap the existing key with the one being changed - so that keys stay unique.
We could alert the user and let them choose either option.

This was fixed with the most simple naive approach for now.  Basically, if you try to use a keyCode that is already in use, the key does not get set. And the recorder stays on.
At the least a notification should be added so the user knows whats happening.
Something more full featured can and should be added later.