cargo run --example gamepad_input not getting RightTrigger2 on linux

What went wrong
RightTrigger2 input is not logged when trying the cargo run --example gamepad_input example on linux. Gampad verified to be working (all axes, triggers, buttons) via https://greggman.github.io/html5-gamepad-test/
Bevy version
(just pulled latest)
$ git branch
* latest
  main
$ git rev-parse `git branch | cut -d' ' -f2`
83c6ffb73c4a91182cda10141f824987ef3fba2f

Relevant system information
System
Release Linux Mint 20.1 Ulyssa 64-bit
Kernel Linux 5.4.0-121-generic x86_64
MATE 1.24.0

cargo:
$ cargo --version
cargo 1.60.0 (d1fd9fe 2022-03-01)

What you did
Ran cargo run --example gamepad_input, and tried pressing all the buttons and wiggling the sticks on the gamepad.
Here are the first several lines of output when I run the example
$ cargo run --example gamepad_input
   Compiling bevy v0.7.0 (/.../rust/bevy)
    Finished dev [unoptimized + debuginfo] target(s) in 28.25s
     Running `target/debug/examples/gamepad_input`
2022-07-07T01:56:36.470600Z  INFO winit::platform_impl::platform::x11::window: Guessed window scale factor: 1
2022-07-07T01:56:36.589375Z  INFO bevy_render::renderer: AdapterInfo { name: "NVIDIA GeForce RTX 2060", vendor: 4318, device: 7944, device_type: DiscreteGpu, backend: Vulkan }
2022-07-07T01:56:38.608285Z  INFO gilrs_core::platform::platform::gamepad: Gamepad /dev/input/event5 (Generic X-Box pad) connected.
2022-07-07T01:56:38.614346Z  INFO bevy_input::gamepad: Gamepad(0) Connected
2022-07-07T01:56:40.328713Z  INFO gamepad_input: Gamepad(0) LeftStickX value is 0.22946167
2022-07-07T01:56:40.345702Z  INFO gamepad_input: Gamepad(0) LeftStickX value is 0.24337769

What gamepad are you using? This is probably an upstream bug in gilrs.

It's an XBox Wireless Controller.
Sorry if I've filed this in the wrong place! Does anyone on the bevy team have permissions to transfer the issue over there? (I can file it manually if not)

(fwiw while we sort out the right place for this issue)--
using:  axes.get(GamepadAxis(gamepad, GamepadAxisType::RightZ))
with axes: Res<Axis<GamepadAxis>>
rather than: button_axes.get(GamepadButton(gamepad, GamepadButtonType::RightTrigger))
with button_axes: Res<Axis<GamepadButton>>
does the trick for getting the trigger analog values.
(the gamepad_input example uses the latter)

No rights to transfer the issue; please do so manually and drop a link here to the issue you opened :)

Ah! Looks like #5220 but for triggers. This is probably not terribly hardware specific, and is mostly our problem.
We should look to see if the same style of fix can be applied.

On bevy 0.8.1 I have the same issue. With all of the following controllers:
-wired XBox One
-wired XBox 360
-wired and wireless dualshock 4 (PS4)
-wired and wireless dual sense (PS5)
(the playstation controllers are using ds4windows so they show up as xinput devices, specifically 360 controllers I believe)
The issue is the same in all cases. Left and right stick analog values report correctly but right and left triggers only act as buttons (analog values for RightZ and LeftZ are always 0.0).
I am using:

using: axes.get(GamepadAxis(gamepad, GamepadAxisType::RightZ))
with axes: Res<Axis>

as @bcolloran mentioned.

For what it's worth, I couldn't reproduce it until I updated my xpadneo driver to the latest version which mostly consists of this product code change I believe.
Basically, old version: SteamInput messed up, input in Bevy works. New version: SteamInput works, input in Bevy messed up.

@Carlrs, I suspect gilrs was working around a bad driver. Can you open an issue upstream?

From what I've been testing, wired XBox One controller seems to be working fine now in bevy 0.9.1 (haven't tested earlier versions). I did see a few issues in the gilrs repo that are tangentially related and have been fixed by the latest version of gilrs, as used by latest bevy. @RaddHazard: is this also fixed for you?

Updated quickly and it looks like I have the same problem. Triggers only working as buttons, no analog values.

I fell into a rabbit hole on this one a little bit... hopefully something in here is useful.
TL;DR:
My understanding is that button_axes.get(GamepadButton(gamepad, GamepadButtonType::RightTrigger2)) (notice the 2)
with button_axes: Res<Axis<GamepadButton>> is the correct way to get the trigger's analog value in bevy. GamepadButtonType::RightTrigger (no 2) is the right bumper on xbox 360 controllers.
My investigation (see "Research" section) leads me to believe that (at least on linux) GamepadAxisType::LeftZ and GamepadAxisType::RightZ are supposed to be representing a 3rd dimension for the left and right stick. Looking around, I think this may be used for joysticks that can also twist.
In reality, I think different gamepad drivers do different things, some map triggers to LeftZ/RightZ.  Then gilrs (using SDL gamecontrollerdb.txt) remaps them to the "right" place, as analog buttons. So if you're seeing trigger values in LeftZ/RightZ, it's probably missing or misconfigured in SDL gamecontrollerdb.txt: https://github.com/gabomdq/SDL_GameControllerDB/blob/master/gamecontrollerdb.txt

To see some more info about what gilrs is doing with your controller:
Add to Cargo.toml:
[dependencies]
gilrs = "0.10"
uuid = "1.3"

Put in an existing rust file and app.add_system(output_gamepad):
use gilrs::{Axis, Button, Gilrs};
use uuid::Uuid;

fn output_gamepad(gilrs: NonSend<Gilrs>, mut printed: Local<bool>, mut counter: Local<u8>) {
    if !*printed {
        // This is *not* the right way to interact with gamepads in bevy, you shouldn't be using gilrs directly.
        for (_, gamepad) in gilrs.gamepads() {
            println!("uuid: {:?}", Uuid::from_bytes(gamepad.uuid()));
            println!("uuid (no '-'): {:?}", Uuid::from_bytes(gamepad.uuid()).to_string().replace("-", ""));
            println!("os_name: {:?}", gamepad.os_name());
            println!("map_name: {:?}", gamepad.map_name());
            println!("mapping_source: {:?}", gamepad.mapping_source());
            println!("LeftZ maps to: {:?}", gamepad.axis_code(Axis::LeftZ));
            *printed = true;
        }
    }

    *counter = (*counter).wrapping_add(1);
    if *counter % 60 == 0 {
        for (_, gamepad) in gilrs.gamepads() {
            // This is *not* the right way to get theses values in bevy, you shouldn't be using gilrs directly.
            println!("LT: {:?}", gamepad.button_data(Button::LeftTrigger).map(|b| b.value()));
            println!("LT2: {:?}", gamepad.button_data(Button::LeftTrigger2).map(|b| b.value()));
        }
    }
}

The output for my Microsoft Xbox 360 Wireless Controller on linux:
uuid: 03000000-5e04-0000-a102-000000010000
uuid (no '-'): "030000005e040000a102000000010000"
os_name: "Xbox 360 Wireless Receiver"
map_name: Some("Xbox 360 Controller")
mapping_source: SdlMappings
LeftZ maps to: None
LT: None
LT2: None
LT: None
LT2: Some(0.85490197)
LT: None
LT2: Some(0.77254903)
LT: None
LT2: Some(0.627451)
LT: None
LT2: Some(1.0)
LT: None
LT2: Some(1.0)
LT: None
LT2: Some(0.0)

Searching for the uuid in https://github.com/gabomdq/SDL_GameControllerDB/blob/master/gamecontrollerdb.txt gets me:
030000005e040000a102000000010000,Xbox 360 Controller,a:b0,b:b1,back:b6,dpdown:b14,dpleft:b11,dpright:b12,dpup:b13,guide:b8,leftshoulder:b4,leftstick:b9,lefttrigger:a2,leftx:a0,lefty:a1,rightshoulder:b5,rightstick:b10,righttrigger:a5,rightx:a3,righty:a4,start:b7,x:b2,y:b3,platform:Linux,

Note the Linux at the end, this mapping will only be used by gilrs when building on linux (technically: "unix that's not Android and not MacOSX", so maybe BSDs and such as well?). See https://gitlab.com/gilrs-project/gilrs/-/blob/master/gilrs/build.rs .
"Research"
https://github.com/bevyengine/bevy/blob/75da2e7adfb025e443ce83cf917225a67e147161/crates/bevy_gilrs/src/converter.rs#L36
https://gitlab.com/gilrs-project/gilrs/-/blob/b17de7da57485c41595c17990965e1ad7b7a2c56/gilrs/src/mapping/mod.rs#L108
maps gilrs_core::native_ev_codes::AXIS_LEFTZ to gilrs::Axis::LeftZ
https://gitlab.com/gilrs-project/gilrs/-/blob/7cd001dacfb188405e5e41520912a259367a4703/gilrs-core/src/lib.rs#L304
defines gilrs_core::native_ev_codes::AXIS_LEFTZ as gilrs_core::platform::native_ev_codes::AXIS_LEFTZ
When compiled on linux:
https://gitlab.com/gilrs-project/gilrs/-/blob/7cd001dacfb188405e5e41520912a259367a4703/gilrs-core/src/platform/linux/gamepad.rs#L1117-1120
defines gilrs_core::platform::native_ev_codes::AXIS_LEFTZ as ABS_Z
https://gitlab.com/gilrs-project/gilrs/-/blob/7cd001dacfb188405e5e41520912a259367a4703/gilrs-core/src/platform/linux/gamepad.rs#L1012
defines ABS_Z as 0x02
https://github.com/torvalds/linux/blob/9f4211bf7f811b653aa6acfb9aea38222436a458/include/uapi/linux/input-event-codes.h#L844
Also defines ABS_Z as 0x02
https://www.kernel.org/doc/html/v6.3/input/event-codes.html?highlight=abs_z#ev-abs
Says: "If the input device may be used freely in three dimensions, consider ABS_Z instead."

Thank you @geophree!
I can confirm button_axes.get(GamepadButton(gamepad, GamepadButtonType::RightTrigger2))
with button_axes: Res<Axis<GamepadButton>> works for wired Xbox 360 controller in Bevy 0.13.2.


Package files missing

Package file defines files such php-web.js, but this file isn't part of this repository.
Can you include these files, or they're part of another repository? Should I look into oraoto/pib repo instead?
Also, all files are minimalized, maybe it's more useful to include the original files with their original formatting? Then minimalize then on build? Otherwise there is no easy way to propose any new changes (against files which are missing or minimalized versions).

Those are build artifacts, which I usually try not to commit to a source repository. They files are all available in the npm package, as well as on unpkg, though. The package is a little large, so you might need to refresh unpkg if the link errors out the first time.
Does that give you what you need?


add 'Microsofr Edge' to SauceLabs' test browsers

Hmm, I see the ERROR: Can not create the report: error in the tests log after MSEdge added. I'll research this

I've found the issue with MS Edge related to saucelabs rest api. I've handled it in the<EMAIL_ADDRESS>I'll restart the tests

Tests for the commit 6dd89945c31f4645517ef833511defe324bb07f4 have passed. See details.

FPR
\cc @churkin @LavrovArtem

lgtm

lgtm


Chat -Uploading csv file in offline showing infinite loading

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number: 9.0.56-0
Reproducible in staging?: Y
Reproducible in production?: Y
If this was caught on HybridApp, is this reproducible on New Expensify Standalone?: N/A
If this was caught during regression testing, add the test name, ID and link from TestRail: https://expensify.testrail.io/index.php?/tests/view/5171911
Issue reported by: Applause - Internal Team
Action Performed:

Go to https://staging.new.expensify.com/home
Open a chat
Go offline
Tap plus icon - upload below attachment

Expected Result:
Uploading csv file in offline must not show infinite loading
Actual Result:
Uploading csv file in offline showing infinite loading
Workaround:
Unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android: Standalone
[ ] Android: HybridApp
[x] Android: mWeb Chrome
[ ] iOS: Standalone
[ ] iOS: HybridApp
[ ] iOS: mWeb Safari
[ ] MacOS: Chrome / Safari
[ ] MacOS: Desktop

Screenshots/Videos

Add any screenshot/video evidence

https://github.com/user-attachments/assets/b1224849-b517-4f17-8a11-d326d58869bd
View all open jobs on GitHub

Proposal
Please re-state the problem that we are trying to solve in this issue.
Uploading csv file in offline showing infinite loading
What is the root cause of that problem?
As the file is uploading the loading will continue until the site is offline.
What changes do you think we should make in order to solve the problem?
If we want to remove the loader while offline we should add the condition for offline here.
https://github.com/Expensify/App/blob/224b633c284fd32e928684010084c587627d5e9a/src/components/Attachments/AttachmentView/DefaultAttachmentView/index.tsx#L60-L68
like this
{!isOffline && shouldShowLoadingSpinnerIcon && (
                <View style={styles.ml2}>
                    <Tooltip text={isUploading ? translate('common.uploading') : translate('common.downloading')}>
                        <ActivityIndicator
                            size="small"
                            color={theme.textSupporting}
                        />
                    </Tooltip>
                </View>
            )}

What alternative solutions did you explore? (Optional)

Technically the file is still uploading, imo it's fine if we leave it like that.

Agree—the file is still uploading and the message is correctly styled as an offline message waiting to be posted so this seems like expected behavior to me.

Yeah I agree, this seems expected seeing as you are offline


removed bug which adds empty record

🛠 Fixes Issue : "it removes option of adding empty record"

👨💻 Changes proposed:

✔ Check List (Check all the applicable boxes)

[x] My code follows the code style of this project.
[x] This PR does not contain plagiarized content.
[x] The title of my pull request is a short description of the requested changes.
[x] I am a participant of Hacktoberfest 2023.

📄 Note to reviewers

📷 Screenshots

i did not mention b ug number when reporting issue but i have changed code so that it cannot add empty record

@BLSowmya Empty spaces are still considered valid input.

@BLSowmya Empty spaces are still considered valid input.

If that's the case what is use of having records like this...there can be possibility and difficulty having more empty records and confused to select what records when making a decision....if we don't have time and date then we can have empty records to count but now we already have date

You didn't get my point. I acknowledged the change. I was just saying that you didn't completely fix the bug. If I enter some empty spaces in all the fields and hit Add Your Record, it still gets registered. This should not be happening. I was suggesting that you should handle this case as well.

You didn't get my point. I acknowledged the change. I was just saying that you didn't completely fix the bug. If I enter some empty spaces in all the fields and hit Add Your Record, it still gets registered. This should not be happening. I was suggesting that you should handle this case as well.

Ohh..is it ? Sure thing ...I will change it again

@dipanshparmar would u mind checking once and let me know if there is anything i need to change?

LGTM! :+1:

@BLSowmya Thank you so much for the wonderful contribution✨
@dipanshparmar Thank you for your amazing feedbacks.🙌

@BLSowmya Thank you so much for the wonderful contribution✨
@dipanshparmar Thank you for your amazing feedbacks.🙌

Thank you for giving this opportunity and I will make sure completing the tasks u assigned

The contribution is wonderful; however, we can still improve the "add to record" section. It currently accepts random inputs as well. We need a validation mechanism to determine whether the input is relevant or not. This will dictate the displayed status. Currently, it shows "poor" for every random input.

@KiranAminPanjwani Did you have a look at the live preview of the website? The commit 2913ae1 duplicated the code.

Yes, I just saw it. It is due to some wrong merges. Please give time  I'm resolving it

@BLSowmya Okay, so for some reason, the code had become corrupted. Now, I kindly request you to please review the current pull request #43 and verify whether the current deployment incorporates the changes you made earlier or not.
If you are unable to locate your changes, I would appreciate it if you could upgrade your forked repository and submit a new pull request. :-)

@BLSowmya Okay, so for some reason, the code had become corrupted. Now, I kindly request you to please review the current pull request #43 and verify whether the current deployment incorporates the changes you made earlier or not.
If you are unable to locate your changes, I would appreciate it if you could upgrade your forked repository and submit a new pull request. :-)

I have tested with empty inputs again and it is not accepting empty input so I think my code is working fine

@BLSowmya Okay, so for some reason, the code had become corrupted. Now, I kindly request you to please review the current pull request #43 and verify whether the current deployment incorporates the changes you made earlier or not.
If you are unable to locate your changes, I would appreciate it if you could upgrade your forked repository and submit a new pull request. :-)

I have tested with empty inputs again and it is not accepting empty input so I think my code is working fine...If there is anything else please let me know

Awesome, keep contributing!!!🙌


Issue opening browser

I am trying to setup:
cmd /c "start https://www.gosomewhere.com/"
And this produces an error:
The handle is invalid.
I have tried different formats (with/without quotes, calling browser directly, etc.)

Hi!
I finally found some time to look at your issue; unfortunately I'm not able to reproduce it. I tried adding a line @reboot cmd /c "start https://google.com" in my local cronical.dat and I can't seem to provoke the same error.
Keep in mind that if you're running cronical as a service, it's running as a system user and can't interact with your session - unless you force it to run as a different user, even then I'm not sure if it would be able to access your desktop.
You can always try running it manually from the command line with cronical --console --debug to see better what it's doing, but then again that means you're running in your session and your command is likely to work much better that way than as a service.
Not sure what the "invalid handle" message means, though. Curious.

Is there a different way to get it to execute a web page? It just needs to be hit, nothing fancy.

From: Mats Gefvert<EMAIL_ADDRESS>Sent: Thursday, November 21, 2019 7:29 PM
To: mgefvert/Cronical<EMAIL_ADDRESS>Cc: DAVIS, SAMANTHA<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [mgefvert/Cronical] Issue opening browser (#16)
Hi!
I finally found some time to look at your issue; unfortunately I'm not able to reproduce it. I tried adding a line @reboot cmd /c "start https://google.com" in my local cronical.dat and I can't seem to provoke the same error.
Keep in mind that if you're running cronical as a service, it's running as a system user and can't interact with your session - unless you force it to run as a different user, even then I'm not sure if it would be able to access your desktop.
You can always try running it manually from the command line with cronical --console --debug to see better what it's doing, but then again that means you're running in your session and your command is likely to work much better that way than as a service.
Not sure what the "invalid handle" message means, though. Curious.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/mgefvert/Cronical/issues/16?email_source=notifications&email_token=AGEPENPZSIRJCJKZ6BOTYDLQU4RXLA5CNFSM4JNSP6QKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEE4D2SA#issuecomment-557333832, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AGEPENKXUDLR46JI565NYUTQU4RXLANCNFSM4JNSP6QA.

I would go with either wget or curl, both excellent choices. curl has native Win32 binaries.
https://curl.haxx.se/
I wrote down some easy references for myself over at https://gefvert.org/blog/archives/common-curl-parameters and https://gefvert.org/blog/archives/common-wget-parameters


Feature/white238/rtdmainpage

https://axom.readthedocs.io/en/feature-white238-rtdmainpage/

I am open for suggestions.. I just got sick of clicking on the user guide when i wanted the doxygen


Scrollbar customization

Use case
Add options to customize the appearance of the Scrollbar widget.
Original feedback: https://github.com/flutter/website/issues/4306#issuecomment-656468600
Proposal
Add options to allow customizing:

width
color
rounded border

We may also need a ScrollbarTheme

Also the default width of the ScrollBar should not be 6.0 but rather be something like 4.0 to look more consistent with android. It also is way to bright in dark mode.

Also, would like an option to briefly show scrollbar when page is opened to show scrolling is possible. I see this in other apps i.e. gmail.

Consolidating into https://github.com/flutter/flutter/issues/70866


break in https://github.com/Disbotsxyz/Disbots/blob/master/src/views/parts/head.ejs

theres a header breaking change done in https://github.com/Disbotsxyz/Disbots/blob/master/src/views/parts/head.ejs
btw great work guys!!!

Fixed bro


setTimeout and setInterval are not executed unless some user action trigger UI events.

I just use setInterval to update a label for counting, but it can't refresh unless the mouse moves on the window.

What OS and version are you using?

What OS and version are you using?

Doesn't matter, I can reproduce the error on all platforms,. Thanks to point this out!
It seems that timers doesn't trigger the libuv background fd as IO operations does.
I'm currently improving the event loop on separate branches, but I cannot find a way to take timers into account.
One workaround could be to patch setTimeout and setInterval using libuv timer (when they get merged in libuv).

This doesn't work at all (not even when moving the mouse)

That's because you're calling main, and the node loop is then com pletely locked. You should try the core example in mac_os_loop branch.

I was able to make timers work (not tested on mac yet).
But, we have to choose a minimum time granularity.
That's because I check in background thread if there are any timer callback pending after a blocking call to check pending IO callbacks.
So, if we set that blocking call to timeout after e.g. 1s, timers callback are run at most every second (independently by the timeout on js side).
The lower we can set that timeout the higher timer precision we get, but we'll pay a performance penalty, even if timers are never used.
Actually, I set it to 100ms, but we can tune a better value I guess...
Relevant code:
https://github.com/parro-it/libui-node/blob/next-loop/src/arch/unix/libui_loop.cc#L31

The core-api example now run a setInterval that updates a label, and an http server that do the same everytime is called.
We'll have to check other kind of async node calls to check that they work fine, because they doesn't relay on the same event loop queue as IO:

setimmediate
process.nextTick
Promises

It's better but not optimal:
setInterval(() => {
	var remaining = start - new Date();
	console.log(sec(remaining))
}, 50);

prints:
9.767
9.459
9.149
8.835
8.522
8.213
7.907
7.593

(So the callback is run every ~400ms but is should be 50ms)

I created an example to test the event loop: https://github.com/parro-it/libui-node/blob/next-loop/examples/event-loop.js
As you'll see, timer are not performing really well, but if I lower background timeout, the UI became unresponsive.
Other kind of async stuff seems to work well, so the plan is to replace setTimeout and setInterval with a n implementation based on libui timers, when they'll land on master.

@RockyF would you mind checking the new pre-release candidate 0.2.0-rc1?
This issue should be solved in that release.

@parro-it sure!


🐛 BUG: bgpPeerState is receiving improper values

Synopsis
We have observed across multiple environments and versions of ktranslate that the value of bgpPeerState is often returning outside of the documented enumeration standard from the BGP4-MIB. This is also reflected on the bgp4-mib.yml profile for ktranslate.
Issue
SNMP walks from various devices are returning valid data, with the following pattern:
snmpwalk -v 2c -On -c $COMMUNITY $IP_ADDRESS .<IP_ADDRESS>.<IP_ADDRESS>.1.2

Results:
.<IP_ADDRESS>.<IP_ADDRESS>.<IP_ADDRESS>.254.6 = INTEGER: 6
.<IP_ADDRESS>.<IP_ADDRESS>.<IP_ADDRESS>.1.25 = INTEGER: 6
.<IP_ADDRESS>.<IP_ADDRESS>.<IP_ADDRESS>.2.9 = INTEGER: 6
.<IP_ADDRESS>.<IP_ADDRESS>.<IP_ADDRESS>.2.49 = INTEGER: 6

Note the output pattern from this tabular OID is OID.IP, where IP is the address of the BGP peer, per the MIB. This is somewhat different than the standard SNMP table index.
The results of the walk above show 4 BGP peers in established: 6 status. However these are the results in New Relic:

Notice how there is a single entry that shows valid data; but then there are 3 extra entries with values prefixed to the Index. The running theory right now is that the ktranslate function that assigns Index values is basically creating one row per existing row in the table. So instead of each peer having a single row; each peer ends up with rows == total peer count.
You can see similar evidence here where we show all data for a single switch; and each is repeated 4X.

To Recreate
Run a current version of ktranslate against any device that supports the BGP4-MIB; this seems to be a universal problem based on the recurrence of log messages like this:
2021-12-21T22:57:24.792 ktranslate/snmp [Warn] KTranslate><DEVICE_NAME> Missing enum value for device metric bgpPeerState 60

Thanks for this bug report -- this was a bad one! Above PR should address.

Should be good in latest build.


custom class doesn't work

Looks like custom class name property doesn't work. It always resets to default, probably because of https://github.com/vayser/react-js-pagination/blob/master/dist/Pagination.js#L115 (even though there's a change here: https://github.com/vayser/react-js-pagination/blob/master/src/components/Pagination.js#L117)
Does latest version need to be re-published?

I have same issue. property 'innerClass' doesn't exist in source or dist in latest published npm package.

going to update npm package

@vayser Thank you for quick fix. It's confirmed. it fixed as of 'npm install<EMAIL_ADDRESS>


out of memory using node2vec on small network

Hello @KiddoZhu ,
I tried node2vec on a graph with 685,551 nodes using 2 GPU cards with 32 GB each and CPU memory size 120GB, but I kept getting out of memory errors. I was doing p = q = 1. When I treated the graph as directed with the same hyperparameters, it was able to produce embeddings but doesn't work when treating the graph as undirected (which is what I want to do).
Here's the log:
Graph<uint32>
------------------ Graph -------------------
#vertex: 685551, #edge: 1386002
as undirected: yes, normalization: no
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
[time] GraphApplication.load: 4.78096 s
[time] GraphApplication.build: 2.6862 s
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
GraphSolver<128, float32, uint32>
----------------- Resource -----------------
#worker: 2, #sampler: 46, #partition: 2
tied weights: no, episode size: 599
gpu memory limit: 32 GiB
gpu memory cost: 386 MiB
----------------- Sampling -----------------
augmentation step: 10, p: 1, q: 1
random walk length: 40
random walk batch size: 100
#negative: 1, negative sample exponent: 0.75
----------------- Training -----------------
model: node2vec
optimizer: SGD
learning rate: 0.025, lr schedule: linear
weight decay: 0.005
#epoch: 2000, batch size: 100000
resume: no
positive reuse: 1, negative weight: 5
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
/bin/bash: line 1: 1144912 Killed                  python ...
slurmstepd: error: Detected 1 oom-kill event(s) in step 1491949.batch cgroup. Some of your processes may have been killed by the cgroup out-of-memory handler.

So as you can see it went oom before the training could begin. The hyperparameters related to memory cost (episode size, batch size etc.) seems reasonable for a dataset of this scale here? I did set the augmentation step to 10 because this is a sparse graph. Do you have any suggestions on what might have gone wrong here? Thanks a lot!

Looks weird. I will check the memory usage of node2vec and response here later.

Looks weird. I will check the memory usage of node2vec and response here later.

@KiddoZhu Just want to follow up on this!

Did you know the solution to this?


GridFS backend: Improve performance for large responses

Related to #407.  Depends on #576 and #578.
Once all response metadata is moved to a regular MongoDB collection and GridFS is used for storing response content only, performance can be considerably improved by writing binary content directly to a GridFS file without serialization.

This is an idea for the future, but not planning to implement it right now. Keeping this closed for now, and using a milestone to track this and other future ideas.


Provide a way to clear the recent documents list

On mac OSX dock, right click on code will show a list files' name opened recently,how can I clear them?

Somehow I cannot get this list to be cleared, filed: https://github.com/atom/electron/issues/3932

@bpasero Maybe you should reopen this issues? electron/electron#3932

I pushed a change that might help. Otherwise there is nothing we can do.


prune: Add JSON support and separate code

What does this PR change? What problem does it solve?
Separates the pruning code in three functions:

Find out what to do
Print statistcs (+ added JSON output here)
do the actual pruning work

In a next step, unit tests can be added for all three parts (not included here)
This PR conflicts with #2881 - I'll fix this depending on what PR is tackled first.
Was the change discussed in an issue or in the forum before?
Refactoring the code: discussion with @fd0
Also closes #3129
Checklist

[x] I have read the Contribution Guidelines
[x] I have enabled maintainer edits for this PR
[ ] I have added tests for all changes in this PR
[x] I have added documentation for the changes (in the manual)
[x] There's a new file in changelog/unreleased/ that describes the changes for our users (template here)
[x] I have run gofmt on the code in all commits
[x] All commit messages are formatted in the same style as the other commits in the repo
[ ] I'm done, this Pull Request is ready for review

rebased after #3148 was merged.

@MichaelEischer  I included your proposals and also rebased as #3139 is merged now. The prunePlan struct was quite handy ;-)

restic prune --json still prints a lot of non-JSON text.
Yes, so far --json can be only used in combination with --quiet. I was hoping for #3009 which IMO include the json checks for the various print functions...

Yes, so far --json can be only used in combination with --quiet. I was hoping for #3009 which IMO include the json checks for the various print functions...

Unfortunately, it is not possible to let --json imply --quiet. For example the backup command allows for different levels of verbosity for its JSON output.

rebased.

rebased.

Unfortunately, it is not possible to let --json imply --quiet. For example the backup command allows for different levels of verbosity for its JSON output.

#3009 won't be able to let --json imply --quiet as that would break the backup command output (the format must not force a certain log level). So this has to be handled locally.

Unfortunately, it is not possible to let --json imply --quiet. For example the backup command allows for different levels of verbosity for its JSON output.

#3009 won't be able to let --json imply --quiet as that would break the backup command output (the format must not force a certain log level). So this has to be handled locally.

#3009 won't be able to let --json imply --quiet as that would break the backup command output (the format must not force a certain log level). So this has to be handled locally.

Actually I was thinking of something like the last commit I added. IMO this works and doesn't break anything except removing the output for some command that don't support --json if it is given.
Also makes many checks for gopts.JSON obsolete, but this would be an independent follow-up.
I also rebased to current master.

#3009 won't be able to let --json imply --quiet as that would break the backup command output (the format must not force a certain log level). So this has to be handled locally.

Actually I was thinking of something like the last commit I added. IMO this works and doesn't break anything except removing the output for some command that don't support --json if it is given.
Also makes many checks for gopts.JSON obsolete, but this would be an independent follow-up.
I also rebased to current master.

IMO this works and doesn't break anything

Ok, it breaks find which uses the Print and Printf functions to manually generate JSON output :weary:
I'll add some more checks for gopts.JSON and leave this cleanup to #3009 or a separate PR.

IMO this works and doesn't break anything

Ok, it breaks find which uses the Print and Printf functions to manually generate JSON output :weary:
I'll add some more checks for gopts.JSON and leave this cleanup to #3009 or a separate PR.

I've rebased to PR to fix the merge conflicts.

Thanks for your great work so far!
Are there any updates? I am specifically interested in the JSON output.

@aawsome has this been implemented somewhere else or why was it closed?


How could I use this from a vue component

so if my component has a circliful element
<div class="circle" :data-percent="percent">

how do I make it update once the component has been mounted?
I know this might be more of a vue.js question then circliful, but I tried just calling the $('.circle').circliful(circliful) function and it seems to create a new circle and add it to the div every time it's called. So is there any way to just refresh it instead of create a new one?

I ported it over to vue if anybody is interested: https://jsfiddle.net/mika76/sjqg02qy/
It's not 100% exact but it's pretty close - the main difference is how the animation is done, but it was enough for what I needed. I hope someone can make use of it.


feat/reusable_components

This PR includes:

Reusable components that are shared across the various screens.

LGTM!


AAD Connect Password Hash Sync Settings

This documentation needs to clarify what password hash sync settings are kept and which are overwritten for AAD Connect servers later than <IP_ADDRESS>.  Documentation also needs to include specific instructions on how to make sure password hash sync is not enabled during an installation using an existing database.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: a0dbe321-8471-e781-ccd7-1bacdb72395e
Version Independent ID: a4c74473-cc49-a31b-8916-0a7497e9cc42
Content: Install Azure AD Connect by using an existing ADSync database
Content Source: articles/active-directory/hybrid/how-to-connect-install-existing-database.md
Service: active-directory
GitHub Login: @billmath
Microsoft Alias: billmath

@haselton Thanks for your feedback. We are looking into this and will update accordingly.

@haselton If you are using AD Connect version <IP_ADDRESS> or above, then all the settings of Password Hash Sync  or Password writeback are saved. This is documented in this doc. Can you elaborate a little bit more on the information you are looking for ?
If you want to disable PHS, you can do that after restoring and then running the configuration wizard.

@haselton We have not heard from you in a while.We will now proceed to close this thread. If you have further questions, please tag me in the comments and I will gladly continue the conversation.


Object.prototype.toString returns incorrect result when called on null or undefined

Repro:
Live: https://jsbin.com/risezaf/edit?html,console
console.log(Object.prototype.toString.call(undefined));
console.log(Object.prototype.toString.call(null));
console.log(Object.prototype.toString.call(window));

Expected:
[object Undefined]
[object Null]
[object Window]

Actual:
[object Window]
[object Window]
[object Window]

In loose mode, this code evaluates the undefined/null this as window, which gives different semantics from the native implementation of toString when called against null/undefined.  Seems like that function should also be set to 'use strict' mode, so it can differentiate null/undefined from explicitly being called on window (and then guard the this[Symbol.toStringTag] call appropriately).

Closed in #18.


Stylus stylesheets out of sync with client.css

client.css was generated from *.styl, but someone edit them manually => I can't regenerate proper client.css

The only difference I see between the currently published version and the generated from the client.styl is the min-width: auto; line in the following context:
#calls button {
  min-width: auto;
  ...

Also there seems to be some problem with rgba generated everywhere. After we deal with that, we can enable generation of client.css from stylus.


Request: Horizontal mstab

I would love a horizontal stacked mstab for my vertical monitor. I spent a little while trying to rewrite the file and get it working myself but I'm a lua novice still.
Thanks.

@rwtallant13 Open up a draft PR! We can help along the way.


Create aafpercent.json

recreating for new pull request

I don't think initials are a good choice for the authored/checked fields - too ambiguous. Email addresses would be better.

email addresses added


Fine-tune make clean so not to remove built rocksdb

Please refer to commit message for details.

When switching branches and having to clean working directory often, recompiling rocksdb takes significant time.

I will this locally a bit more then remove the WIP label.

Used for #893 , this speeds things up.


iTunes account blocked/corrupted by fastlane sigh download

New Issue Checklist

[x] Updated fastlane to the latest version
[x] I read the Contribution Guidelines
[x] I read docs.fastlane.tools
[x] I searched for existing GitHub issues

Issue Description
After using fastlane sigh download to manually download provisioning profiles, the itunes account that was used gets somehow blocked. When signing in to appleid.apple.com I get the error "Failed to verify your identity. Try again" and the page stays with the loading indicator forever.

With the same account I can log in to developer.apple.com but not to itunesconnect.apple.com
After some time or some action that I cannot pinpoint, the account works again (asks for the security questions every time you log in but it works). Then fastlane sigh download works a couple of times and right after that the accounts gets blocked again.
I tried with a complete new apple id, registered everything in the development portal, etc. Then I used fastlane sigh download couple of times, it worked and then the new account also got blocked.
Needless to say, I tried resetting the password (successfully), different computers, etc. Didn't help.
When the account is in this blocked state, when using fastlane sigh download I get the following error:
[18:28:16]: ▸ [18:28:16]: Get started using a Gemfile for fastlane https://docs.fastlane.tools/getting-started/ios/setup/#use-a-gemfile
[18:28:18]: ▸ +-------------------------------------+-------------------------------------------+
[18:28:18]: ▸ |                             Summary for sigh 2.63.0                             |
[18:28:18]: ▸ +-------------------------------------+-------------------------------------------+
[18:28:18]: ▸ | development                         | true                                      |
[18:28:18]: ▸ | provisioning_name                   | <Redacted>
[18:28:18]: ▸ | username                            | <Redacted>
[18:28:18]: ▸ | app_identifier                      | <Redacted>
[18:28:18]: ▸ | skip_certificate_verification       | true                                      |
[18:28:18]: ▸ | team_id                             | <Redacted>                                |
[18:28:18]: ▸ | adhoc                               | false                                     |
[18:28:18]: ▸ | skip_install                        | false                                     |
[18:28:18]: ▸ | force                               | false                                     |
[18:28:18]: ▸ | ignore_profiles_with_different_name | false                                     |
[18:28:18]: ▸ | skip_fetch_profiles                 | false                                     |
[18:28:18]: ▸ | platform                            | ios                                       |
[18:28:18]: ▸ | readonly                            | false                                     |
[18:28:18]: ▸ +-------------------------------------+-------------------------------------------+
[18:28:18]: ▸ [18:28:18]: Starting login with user '<Redacted>'
[18:28:20]: ▸ Looking for related GitHub issues on fastlane/fastlane...
[18:28:20]: ▸
[18:28:20]: ▸ [!] The request could not be completed because:
[18:28:20]: ▸
[18:28:20]: ▸ <title>503 Service Temporarily Unavailable</title>
[18:28:20]: ▸
[18:28:20]: ▸
503 Service Temporarily Unavailable

[18:28:20]: ▸
Shield
[18:28:20]: ▸
[18:28:20]: ▸
[18:28:20]: ▸

I would really appreciate any suggestions here even though it looks like a problem on apple's side, something very specific to my accounts or something temporary...
Environment
✅ fastlane environment ✅
Stack

Key
Value

OS
10.12.6

Ruby
2.2.2

Bundler?
false

Git
git version 2.9.2

Installation Source
~/.rbenv/versions/2.2.2/bin/fastlane

Host
Mac OS X 10.12.6 (16G29)

Ruby Lib Dir
~/.rbenv/versions/2.2.2/lib

OpenSSL Version
OpenSSL 1.0.2j  26 Sep 2016

Is contained
false

Is homebrew
false

Is installed via Fabric.app
false

Xcode Path
/Applications/Xcode.app/Contents/Developer/

Xcode Version
8.3.3

System Locale

Variable
Value

LANG
en_US.UTF-8
✅

LC_ALL
en_US.UTF-8
✅

LANGUAGE

fastlane files:
No Fastfile found
No Appfile found
fastlane gems

Gem
Version
Update-Status

fastlane
2.63.0
✅ Up-To-Date

Loaded fastlane plugins:
No plugins Loaded
Loaded gems

Gem
Version

slack-notifier
1.5.1

CFPropertyList
2.3.4

claide
1.0.2

colored2
3.1.2

nanaimo
0.2.3

xcodeproj
1.5.1

rouge
1.11.1

xcpretty
0.2.4

terminal-notifier
1.7.1

unicode-display_width
1.1.2

terminal-table
1.7.3

plist
3.2.0

multipart-post
2.0.0

word_wrap
1.0.0

public_suffix
2.0.4

tty-screen
0.5.0

babosa
1.0.2

colored
1.2

highline
1.7.8

commander-fastlane
4.4.5

excon
0.54.0

faraday
0.10.0

unf_ext
<IP_ADDRESS>

unf
0.1.4

domain_name
0.5.20161129

http-cookie
1.0.3

faraday-cookie_jar
0.0.6

fastimage
2.1.0

gh_inspector
1.0.2

json
1.8.1

mini_magick
4.5.1

multi_json
1.12.1

multi_xml
0.6.0

security
0.1.3

xcpretty-travis-formatter
0.0.4

dotenv
2.1.1

bundler
1.13.6

faraday_middleware
0.10.1

uber
0.0.15

declarative
0.0.9

declarative-option
0.1.0

representable
3.0.4

retriable
2.1.0

addressable
2.5.1

mime-types-data
3.2016.0521

mime-types
3.1

little-plugger
1.1.4

logging
2.1.0

jwt
1.5.6

memoist
0.15.0

os
0.9.6

signet
0.7.3

googleauth
0.5.1

httpclient
2.8.3

google-api-client
0.13.4

rubyzip
1.2.0

generated on: 2017-11-03

Same happened to me

I've exactly the same problem :(

Update: I still can't sign in but some of the fastlane sigh download complete with success.
And also I'm seeing the following line:
[09:05:10]: fastlane failed to write the crash report to /Users/ios/.fastlane/latest_crash.json.

Weirdly enough, if I sign in to developer.apple.com and then navigate to itunesconnect.apple.com I stayed logged in. But if I sign in to developer.apple.com but then go appleid.apple.com then I'm automatically logged out of everything.

Logging into appleid.apple.com the browser console log outputs "POST https://idmsa.apple.com/appleauth/auth/signin 503 (Service Temporarily Unavailable)" which is the same error that is output.

Same error but with Spaceship since 3 days too

Also experiencing this...

Also experiencing this 😭

@KrauseFx so this is an issue.
Signing into Developer portal and from there we can go to iTunesConnect. (After resetting password)
However when using Fastlane or logging in directly to iTunesConnect we get the infamous "Failed to verify your identity"

thanks @casz, we're checking it out 👍

If you have a proxy or VPN, we've found that you can get around this by enabling it, or disabling it. This might be some new rate limiting based on your location.

same as you @taquitos. or wait around 15mn

@taquitos - interesting... we're building on CircleCI and hitting the problem a bunch.  That'd be pretty bad if all of Circle was in the same rate-limited pool!

I'm having this issue without a VPN or proxy FYI

Hey @robbiet480, yeah, the problem isn't limited to VPN or Proxy, but using a VPN or Proxy is a workaround. That's because Apple seems to be rate limiting people based on IP.

Ok, I've tested https://github.com/fastlane/fastlane/pull/10826 on my machine and it seems to be working.

Ok, after some more testing of the problem, I've found the following Work arounds

Login using a different account from same IP
Change IP address (VPN/Proxy)
Login from a different IP, it unblocks your original IP.
Login in developer.apple.com and then navigate to itunesconnect.apple.com

So the IP blocking portion doesn't seem to apply to different accounts now (not sure if my tests yesterday were bad, or if Apple already made a small change)

@taquitos Thank you. That info has helped me to get my release out today.
Here is some more info if it is helpful.
I have an app that I have white labeled. When I run Fastlane, I have 4 separate schemes that I run through pem, produce, match, and register_devices all at one time to make sure that everything is always in sync. When I want to make a beta release or a release to the App Store for production, I always run all 4 schemes through all of those tasks to make sure that everything is in sync.
Before today, I have never had an issue with running all of these tasks but today I am running into the 503.
This is how far I can get:

produce on app A. Sync with DevCenter and iTC.
pem on app A.
produce on app B. Sync with DevCenter and iTC.
pem on app B.
produce on app C. Sync with DevCenter but not iTC. That is where I am getting my 503.
...If I try and run Fastlane again after I hit the 503 without changing my IP address, I instantly gt 503 instead of getting even to run produce on app A.

If I use VPN to change my IP address, I get the same result as above ^^^. I use VPN again to change my IP address again and I get the same result as above ^^^. This is consistent.
So, what I did was comment out the pem track in my Fastfile to try and have Fastlane run 4 less tasks (running pem for al 4 separate schemes) and I am able to run Fastlane to release my app no problem. That makes me wonder if they are rate limiting by the number of tasks in a certain amount of time?

Thanks for this info! This is super helpful to understand how people are running into this situation. We're going to start exploring more aggressive session caching so if you use the same account, we don't try to login each time. I think that should help a ton.

@taquitos Yes PLEASE 💯
I can give another example of how we use it.
We have an lane that updates provision profiles and certs using match for all our identifiers, that includes our app team, enteprise team and our white labeled teams. This however is all using the same account.
This lane even adds new devices to each team using different device pool for each as that is defined in our ruby code.
We set it up this way to make it easy for developers to sent PR to add new devices and identifiers :)
It can even produce newly arrived bundle identifiers 🙊
Then use the same lane to ensure all our build agents have the same provision profiles and certs while using read only 👍

@casz that makes a ton of sense. We definitely want to, and are working hard to enable setups like yours. This is such great usage information for us to know about. Thank you! ❤ ❤ ❤

I wanted to update folks around the auth issues we’re seeing right now.
Context:
Issue first seen in https://github.com/fastlane/fastlane/issues/10793
Picked up again in https://github.com/fastlane/fastlane/issues/10812
While I have a PR up that fixes this for the simple login case, it only addresses SMS 2FA, and it employs web scraping, which is super flakey.
Furthermore, the authentication logic we already have addresses so many corner cases, and is battle tested. Replacing that with this flakey update could cause a lot of pain for everybody.
Instead, we think the right thing moving forward is to assume Apple isn’t going to fix this obvious issue, and then focus our energy on improving our session caching, so that between various actions, we don’t login multiple times unless explicitly called for.
This will take some time to properly address, but we’ll have a plan soon and we’ll share that out as soon as we do 🚀. In the meantime, we’re going to keep my PR (https://github.com/fastlane/fastlane/pull/10826) alive if it is helping to unblock people.
Repeating what I posted before, we have some workarounds whose success seem to vary:

Login using a different account from same IP
Change IP address (VPN/Proxy)
Login from a different IP, it unblocks your original IP.
Login in developer.apple.com and then navigate to itunesconnect.apple.com

Instead, we think the right thing moving forward is to assume Apple isn’t going to fix this obvious issue

Is it an Apple issue/bug, or is it Apple circumventing tools like fastlane?

@ytn3rd one theory is that Apple is trying to prevent brute-force login attacks, but they aren't reenabling logins after a successful login.
I say it's probably an Apple issue because you can get this to trigger even on the website. That being said, it's probably really rare for people not using automation like fastlane.

I think were facing the same root cause when running PEM on multiple targets.  Our pem script runs fine for 8 targets then for the following were getting "503 Service Temporarily Unavailable."
Does anyone know if a 15 second sleep would do for us as a workaround until this issue is resolved?

I can confirm a 15 second sleep between the logins through pem did work for 20+ targets. Not a real solution but might perhaps help someone.

Having the same issue...
Have 6 separate build jobs each executing fastlane cert/sigh/gym (for various combinations of target/configuration/backend). All are triggered by a single Tests job and are run across 2 nodes with 2 executors on each.
Most of those (or at times - all of them) fail due to "503 Service Temporarily Unavailable." on cert step. So far didn't find any good workaround.

And I can also confirm that code in branch 10793 (PR #10826) does fix the issue for me. As I am not using 2FA (which turned to be a blocker to push this PR further) -
will stick with it for now. Is there any ETA for a proper fix for this issue?

@taquitos @KrauseFx perhaps an survey, "tell us how you use fastlane" would make sense? 😝

In our company, we have reported this issue on https://developer.apple.com/contact/apple-id/. Few email later an "senior Advisor with the Apple Developer Program Support" wrote an odd message:

thank you for letting us know that the issue is resolved and providing us with the additional information.

We didn't let them know that the issue was resolved :/, but since then we haven't received this error anymore. Maybe they increase some "limits", whitelist our IP address, or something else, but I suggest to contact Apple at https://developer.apple.com/contact/apple-id/.

@bartoszj thanks for the link, there is so many ways to contact them and yet we got zero response :|
However the issue does seem to have fixed itself. Though I still suggest that more aggressive session caching should be added.

We use sigh to download and install around 6 provisioning profiles. This is done on a jenkins job triggered after each update to any pull request. This job is done around 20 times per day and also 4 or 5 jobs can run in parallel (we have around 8 nodes). Meaning we do lots and lots of log ins in very short times and from different machines.

I also contacted apple support some days ago. They said literally "Very weird, I have never seen this before" and immediately gave me the direct phone number of an apple support specialist. He didn't see any problem and didn't give any solution.
My guess is that some firewall/dos detecting hardware/network infrastructure changed on the Apple side and now it spits these 503 errors upon detecting certain patterns. I guess it is quite low-level stuff because the password is not even checked, the response is exactly the same with wrong or with right password. And that might be the reason why even the apple support doesn't know how to solve it.

https://github.com/fastlane/fastlane/pull/10826 fixes the issue for me. Thank you!
The following workarounds did not work for me:

Login using a different account from same IP
Login from a different IP, it unblocks your original IP.
Login in developer.apple.com and then navigate to itunesconnect.apple.com

I did not try the following:

Change IP address (VPN/Proxy)

@sirdharma, that's great, we're still working on our session caching as our more permanent solution 🎈:goat:

After four days I got once again this error. Apple Support has responded with:

Thank you again for your email. I understand that you are still getting the error 503 occasionally.
The error message that you are being presented with is not an error that I am able to assist you with here at Apple Developer Program Support as this a server error that you are getting and we do not provide third party support.
I hope that this helps you. Thank you again and have a wonderful day.

So they will not help us.

@bartoszj you can trigger this error from the web too, so I wonder if you show them a screenshot of the login page not allowing you to login, that might change their minds about being able to help?

Hi @taquitos,
Yes, we have sent them screenshots from web browsers. We have even created a movie while we are trying to log in (they have asked for it after the first email) and as you can see this didn't help at all.

Hi.
What is the current status of this?
I started experiencing this today. I'm working in Visual Studio for Mac on a Xamarin app. Visual Studio suddenly started to report the following errors even though the account already existed:
"Error adding account -
Authentication service is unavailable."
After a lot of debugging and trying removing and adding certificates I remembered that Visual Studio is using Fastlane to download certificates etc. I was glad to find this post and tried the solution of changing my IP using VPN which worked for me.
Are there anything that I can do to help you fix this error?

@sebastiansondergaard the current state is still: https://github.com/fastlane/fastlane/issues/10793#issuecomment-342999930
Although, at this point we've pivoted to working on: https://github.com/fastlane/fastlane/issues/10930 because tester management and build trains are totally broken due to API changes.

Hi all,
just confirming that the workaround documented previously:

Login using a different account from same IP
Change IP address (VPN/Proxy)
Login from a different IP, it unblocks your original IP.
Login in developer.apple.com and then navigate to itunesconnect.apple.com

Worked for me as well. The key seemed to be to use the VPN - didn't work without it. Downloaded Avast SecureLine VPN from the Mac App Store, and then started to work like a charm. Thanks!

As another date point in case it's helpful, I ran into this for the first time today. I have a script doing the following:

Login to an account
Add a device to an account
Add the device to an array of provisioning profiles.
Download each of those provisioning profiles.

After step 3 (which includes 6 provisioning profiles in this failing case), it fails when it tries to download the first profile in step 4, showing the 503 Temporarily Unavailable error.

Having same issue here. We use match - and are seeing this same issue w/ match and spaceship, on our bitrise build server. We create white label apps, so are using match to download certs etc, then  spaceship and pilot - all of which are failing, intermittently - all around the time it's logging into iTunes. Same error in build logs...503 Service Temporarily Unavailable.
Would love a fix for this issue. It's affecting all our building presently. Currently investigating setting up a vpn to mask our IP - read that this may help?? Would that work?

Thanks @tehnoir. For our white-label app building on bitrise - I added a login with a dummy developer from our account, before proceeding with each build.
So no VPN needed as having another user login before the regular one that does the build (using fastlane) seemed to work.
Thanks...Jules.

And today - the losing with a dummy developer account - doesn't help fix the 503 issue. I'm seeing this failure on all our bitrise builds today. :-(

Hey everyone, thanks again for looking into this issue. Sorry it took so long, I finally found some time to look further into this issue, and was able to reproduce the issue and prepare a fix. You can check out the PR over here https://github.com/fastlane/fastlane/pull/11108
I'd love to ship this as a new release tomorrow morning 👍

We shipped a new release thank to @KrauseFx's PR #11108. We'd love to have you all confirm that this works so we can close this issue! 😄 🚀

I can confirm that this is now fixed for me in the 2.68.2 release. I have lane that calls match 3 times for an app with 7 targets. Previously this would fail, but all good now! 🎉🍺

We are also still getting this error on fastlane 2.68.2 after some actions:
|             fastlane summary             |
+------+---------------------+-------------+
| Step | Action              | Time (in s) |
+------+---------------------+-------------+
| 1    | Verifying required  | 0           |
|      | fastlane version    |             |
| 2    | default_platform    | 0           |
| 3    | register_devices    | 3           |
| 4    | register_devices    | 3           |
| 5    | register_devices    | 3           |
| 6    | register_devices    | 2           |
| 7    | register_devices    | 3           |
| 8    | register_devices    | 2           |
| 9    | register_devices    | 2           |
| 💥   | register_devices    | 0           |
| 💥   | match               | 9           |
| 💥   | match               | 6           |
| 💥   | match               | 7           |
| 💥   | match               | 7           |
| 💥   | match               | 7           |
| 💥   | match               | 7           |
| 💥   | match               | 9           |
| 💥   | match               | 6           |
| 💥   | match               | 8           |
| 💥   | match               | 9           |
| 💥   | match               | 10          |
| 💥   | match               | 7           |
| 💥   | match               | 9           |
| 💥   | match               | 9           |
| 💥   | match               | 9           |
| 💥   | match               | 9           |
| 💥   | match               | 9           |
| 💥   | match               | 12          |
| 💥   | match               | 9           |
| 💥   | match               | 9           |
| 💥   | match               | 6           |
| 💥   | match               | 7           |
| 💥   | match               | 9           |
| 💥   | match               | 6           |
| 💥   | match               | 6           |
| 💥   | match               | 9           |
| 💥   | match               | 9           |
| 38   | match               | 7           |
+------+---------------------+-------------+

And the error is the same as usual:

<title>503 Service Temporarily Unavailable</title>

503 Service Temporarily Unavailable

Shield

Hey @klaspetersson thanks for reporting this. It would help to submit new issues instead of commenting, that way we can collect some more information about what is going on in your specific case since the fix we shipped should take care of most situations people encounter.

We just nuked both development and distribution, and running a series of 7 match commands for different certificates and provisioning profiles returned the usual 503 error.
Then I changed the match call to use an array of app identifiers and reduced the invocations of match from 7 to 3. Now it works.
From the match documentation:
match(app_identifier: ["tools.fastlane.app", "tools.fastlane.app.today_widget"], type: "appstore")

In any case, more aggressive caching will not solve all the issues. For example, we have something like 8 CI nodes across different machines. Caching might ease the 503 error on one machine but between multiple machines sharing one account it won't do much.
We could have one account for each node but we would rather not...

@elorz007 yeah, that stinks. I wonder, maybe there is some sort of solution where you could share sessions across all the nodes? fastlane writes session data to a file, so maybe there is a way to login on one node, copy the session to all the other nodes, and then proceed?

where is the file written @taquitos could you perhaps share it between the same Mac user because it's in the user folder and you can just map it to a network shared folder? So they all have the same read/write access :)

So all that stuff happens in: https://github.com/fastlane/fastlane/blob/bc4105dbe77d244e7d6c3ba42af2d5f13146e4da/spaceship/lib/spaceship/client.rb
fetch_olympus_session, load_session_from_env are the methods involved
also: https://github.com/fastlane/fastlane/blob/bc4105dbe77d244e7d6c3ba42af2d5f13146e4da/spaceship/lib/spaceship/two_step_client.rb#L85
where it creates a temp file:
file = Tempfile.new('cookie.yml')
So I think if we made this less temporary, and provided a path, a shared storage area would be good, as long as you control for multiple readers/writers to the file.

That could be great 👍 Our Mac fleet would be appreciative

Just an FYI - the SPACESHIP_COOKIE_PATH solution looks to be working. At least in my case. Thanks!

@KrauseFx xcode-install does not expect the SPACESHIP_COOKIE_PATH 👎 😭

I had SPACESHIP_COOKIE_PATH=/Volumes/Fastlane fastlane deliver download_metadata generate the cookie so I could try and unleash the xcversion update; xcversion install 9.2 on our fleet of mac minis so we could get them updated. Worked like a charm 👍

A single match call with 7 identifiers is failing for me with 503. What're the current recommendations for how to get past this? Should I split my match call into multiple match calls and wait X seconds between them?

I'm also running into this issue after upgrading Fastlane to 2.70.2, when trying to run an action across multiple teams. Sample code snippet is below. Essentially, I have several teams/accounts that are linked together, and I have a properties file where team details are stored, so ENV['FASTLANE_USER'] will always be the same. When I run my lane, after the loop iterates through a couple of the teams, I get the 503 for subsequent iterations.
before_each do |lane, options|
	if !$team.to_s.empty?
		ENV['FASTLANE_TEAM_ID'] = AppProperties::Properties[$team][:TeamID]
		ENV['FASTLANE_USER'] = AppProperties::Properties[$team][:Username]
	end
end

lane :create_app_id do
	teams = 'team1 team2 team3 team4'.split(' ')

	teams.each do |team_to_run|
		$team = team_to_run
		produce(
			app_identifier: "#{$team_to_run}.extension",
			app_name: "#{$team_to_run} Extension",
		}
	end
end

We have a similar setup to @imanf :) Just a lot bigger.
All of our teams with all our app identifiers in an array and we run that each time anyone adds a new bundle id 😢
In this Fastlane repo, we also have all our devices.
Using all of the information together with produce, match, register_devices depending on the state 💜
module AppsConstant
  TYPES = %w[development adhoc appstore enterprise].freeze

  TEAMS = {
    widex: {
      name: 'Widex A/S',
      git_branch: 'widex',
      supported_types: %w[development adhoc appstore].freeze,
      app_identifier: [
        'com.widex.app1',
        'com.widex.app1.watchkitapp',
        'com.widex.app1.watchkitapp.watchkitextension',
        'com.widex.app2',
        'com.widex.app3',
      ],
    },
    widexenterprise: {
      name: 'Widex Holding A/S',
      git_branch: 'widexenterprise',
      enterprise: true,
      supported_types: %w[development enterprise].freeze,
      app_identifier: [
        'com.widex.enterprise.appX',
      ],
    },
    testcompany: {
      name: 'Widex A/S',
      git_branch: 'widextesters',
      skip: true,
      supported_types: %w[development].freeze,
      app_identifier: [
        'com.widex.*',
      ],
    },
  }.freeze
end

This is still occurring for me. When I try to use fastlane pem multiple times in a row, this is happening.

Are there any updates on this? I'm including another example where this is happening. I'm creating 10 provisioning profiles using sigh.  We've reported the issue with Apple, but haven't heard back.
For now as a temporary workaround, can you use sleep(10) in-between calls to make it work? Or is that not enough?

It does seem like many people are affected by this... can you confirm the above workaround doesn't work, and I'll see if I can find a better solution for this.

Yes, that workaround does work and would be fine for a temporary
workaround. Thanks!
On Fri, Dec 29, 2017 at 2:49 PM, Felix Krause<EMAIL_ADDRESS>wrote:

It does seem like many people are affected by this... can you confirm the
above workaround doesn't work, and I'll see if I can find a better solution
for this.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/fastlane/fastlane/issues/10793#issuecomment-354492583,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABMgbgw8qfC-slroNQjj8fMsE7SGXuqGks5tFUJKgaJpZM4QReHM
.

Issue is not resolved.

Update: I've updated the radar I filed with Apple last year around this (https://openradar.appspot.com/35445457), they just asked me for more information and to see if I can repro (which I can). So I updated them. 🤞 they fix it.

Chill @fastlane-bot, it's still not resolved.

I talked to the Apple engineers today at WWDC to try to get some answer to this problem. Because I suspect that even if fastlane moves to the new API, we will still get problems with one Apple ID logging in many times in a some minutes or logging in from different machines.
They told me that because Fastlane is a third party tool, they can only look into the issue if the login problems also occur on some of their tools (e.g. Application Loader, Xcode, ...). Because being able to log in with one account multiple times or across many devices is something they really want to avoid for obvious security reasons.
So I will try to reproduce this by logging in and out of Application Loader. If I reproduce the issue they will take a look.

According to the new WWDC session "Automating App Store Connect" the authentication to the API will be done like this:

Create API key pair. Public key will be stored on Apple. Keys will be created in the itunes connect website. Private keys are generated by apple (wtf!) and you will be able to download them from the page once.
Generate temporary tokens with the id of the private key and the issuer id. (should be easy with JWT)
Send token with the requests inside the auth header.

It will be available this summer.

It’s still broken, @fastlanebot
On Sun, Jul 8, 2018 at 1:34 PM fastlane bot<EMAIL_ADDRESS>wrote:

There hasn't been any activity on this issue recently. Due to the high
number of incoming GitHub notifications, we have to clean some of the old
issues, as many of them have already been resolved with the latest updates.
Please make sure to update to the latest fastlane version and check if
that solves the issue. Let us know if that works for you by adding a
comment 👍
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/fastlane/fastlane/issues/10793#issuecomment-403303318,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AARRRqNduxySyOWYrKd2TsRoNr6tcifgks5uEkKigaJpZM4QReHM
.

@scalessec, Are you using SPACESHIP_COOKIE_PATH to cache your session? I've been running into this issue all the time up till latest 2.99.0 release where session caching finally started working. In my multi-node build environment - I have set up a shared folder to store cached session cookies. Then - my Jenkins build script for most of the jobs basically looks like this:
`export PATH=/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin
export LANG=en_US.UTF-8
export FASTLANE_DISABLE_COLORS=1
export SPACESHIP_COOKIE_PATH=$JENKINS_HOME/cookies
security unlock-keychain -p $KC_PWD $KC_PATH
bundle install --no-color --path .bundle
bundle exec --no-color fastlane spaceauth
bundle exec --no-color fastlane ci_build`

Calm it @fastlane-bot, this is still an issue.

I think the issue has been resolved today.
I ran fastlane update_fastlane at 10:50 AM and then did a "fastlane deliver init" and it connected.

@xhairbait are you using a single Apple ID across multiple accounts? That's where this issue is causing the most problems for me.

Still an issue @fastlane-bot

Still an issue.

Bump

Still an issue, go away fastlane bot

Hi @daniel-beard we had this issue previously, but it's no longer happening. Could you let us know your current / latest fastlane setup and when does the error occur for you?

Hey @max-ott I haven't yet upgraded to the version that moved a lot of the calls to app store connect. I'll plan to update next weekend and re-test.


Creating a specific 3.6 binary for Linux

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): No
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Linux Ubuntu 14.04
TensorFlow installed from (source or binary): Source
TensorFlow version (use command below):
Python version: Python3.6
Bazel version (if compiling from source):
GCC/Compiler version (if compiling from source): -NA-
CUDA/cuDNN version: -NA-
GPU model and memory: -NA-
Exact command to reproduce: import tensorflow as tf

Environment capture text:
https://github.com/tensorflow/tensorflow/tree/master/tools/tf_env_collect.sh
tf_env.txt
You can obtain the TensorFlow version with
python -c "import tensorflow as tf; print(tf.GIT_VERSION, tf.VERSION)"
This command also results in the same error.
/home/raju/anaconda3/lib/python3.6/importlib/_bootstrap.py:219: RuntimeWarning: compiletime version 3.5 of module 'tensorflow.python.framework.fast_tensor_util' does not match runtime version 3.6
return f(*args, **kwds)
Describe the problem
When importing tensorflow , I get this error. I found some information on "Feature request: nightly build for python 3.6 #12935" --"Yes, we unfortunately copy the 3.5 binary for 3.6 I'll look into creating a specific 3.6 binary for Linux."
Source code / logs
$import tensorflow as tf
result is
/home/raju/anaconda3/lib/python3.6/importlib/_bootstrap.py:219: RuntimeWarning: compiletime version 3.5 of module 'tensorflow.python.framework.fast_tensor_util' does not match runtime version 3.6
return f(*args, **kwds)

same issue on MacOS 10.12.6

same problem on Linux Ubuntu 16.04

@gunan : Do we have any updates on the resources we have to support Python 3.6 releases?

@av8ramit looks like there were divergences which prevent us from using the same pip packages on python 3.5 and 3.6
Can we modify our builds to also build 3.6 version from scratch?

Same issue on Linux CentOS 7

Same issue after upgrade from 1.3 to 1.4 on Mac High Sierra 10.13.1.
Tensorflow still works but give the above warning which is "RuntimeWarning: compiletime version 3.5 of module 'tensorflow.python.framework.fast_tensor_util' does not match runtime version 3.6"

FWIW, python3.5 still works

ANything that can be changed here?

Same problem on Ubuntu 17.10.

Same on Ubuntu 14.04

Same issue on Fedora 26 with Python 3.6.2.

Same issue on OSX 10.12.5 with Python 3.6.3

Same issue on OSX with Python 3.6.2

Only posting because I didn't see my environment mentioned:
Clean 17.10 Ubuntu Server install on Python 3.6.3 (native pip install tensorflow-gpu)
Outputs:
/usr/lib/python3.6/importlib/_bootstrap.py:219: RuntimeWarning: compiletime version 3.5 of module 'tensorflow.python.framework.fast_tensor_util' does not match runtime version 3.6
  return f(*args, **kwds)

I have tried both 3.5 and 3.6 (macOS High Sierra).
3.5 works perfect while 3.6 gives warns.
Hope this helps.

same problem on Linux Ubuntu 17.10

Same issue on OSX 10.12.6 with Python 3.6.3(virtualenv installation)

import tensorflow as tf
/Users/zhanghao/virtualenv/tensorflow/lib/python3.6/importlib/_bootstrap.py:219: RuntimeWarning: compiletime version 3.5 of module 'tensorflow.python.framework.fast_tensor_util' does not match runtime version 3.6
return f(*args, **kwds)

Same issue using this Docker file https://github.com/christiangda/kerasvideo/blob/master/Dockerfile

Hi,
Can you let me know if this has to be treated as a warning and ignored?
Furthermore  the error is
from PyQt5 import QtCore, QtGui, QtWidgets
ImportError: dlopen: cannot load any more object with static TLS
See the Traceback below
Traceback (most recent call last):
File "train.py", line 51, in
from object_detection.builders import model_builder
File "/home/raju/anaconda3/envs/tensorflow/models/research/object_detection/builders/model_builder.py", line 29, in
from object_detection.meta_architectures import ssd_meta_arch
File "/home/raju/anaconda3/envs/tensorflow/models/research/object_detection/meta_architectures/ssd_meta_arch.py", line 31, in
from object_detection.utils import visualization_utils
File "/home/raju/anaconda3/envs/tensorflow/models/research/object_detection/utils/visualization_utils.py", line 24, in
import matplotlib.pyplot as plt
File "/home/raju/anaconda3/lib/python3.6/site-packages/matplotlib/pyplot.py", line 113, in
_backend_mod, new_figure_manager, draw_if_interactive, _show = pylab_setup()
File "/home/raju/anaconda3/lib/python3.6/site-packages/matplotlib/backends/init.py", line 60, in pylab_setup
[backend_name], 0)
File "/home/raju/anaconda3/lib/python3.6/site-packages/matplotlib/backends/backend_qt5agg.py", line 16, in
from .backend_qt5 import (
File "/home/raju/anaconda3/lib/python3.6/site-packages/matplotlib/backends/backend_qt5.py", line 18, in
import matplotlib.backends.qt_editor.figureoptions as figureoptions
File "/home/raju/anaconda3/lib/python3.6/site-packages/matplotlib/backends/qt_editor/figureoptions.py", line 20, in
import matplotlib.backends.qt_editor.formlayout as formlayout
File "/home/raju/anaconda3/lib/python3.6/site-packages/matplotlib/backends/qt_editor/formlayout.py", line 56, in
from matplotlib.backends.qt_compat import QtGui, QtWidgets, QtCore
File "/home/raju/anaconda3/lib/python3.6/site-packages/matplotlib/backends/qt_compat.py", line 137, in
from PyQt5 import QtCore, QtGui, QtWidgets
ImportError: dlopen: cannot load any more object with static TLS
Pls let me know ways to resolve this error. Or will it be resolved only when the warning is resolved!!

Same issues on Ubuntu 16.04 64bit virtualenv python3

Does it break stuff or can I ignore the warning?

Quite strange since the prior version worked fine with 3.6 (and it's packages), so it would seem that this should be a pretty simple fix?

same issue with the just released 1.4 version...

Just to add to what @dsitnik said,  simple hello world to reproduce on Fedora 26 venv
$ cat requirements.txt
bleach==1.5.0
enum34==1.1.6
html5lib==0.9999999
Markdown==2.6.9
numpy==1.13.3
protobuf==3.4.0
six==1.11.0
tensorflow==1.4.0
tensorflow-tensorboard==0.4.0rc2
Werkzeug==0.12.2

$ python --version
Python 3.6.2

$ cat app.py
import tensorflow as tf

hello = tf.constant('Hello, TensorFlow!')
session = tf.Session()
print(session.run(hello))

$ python app.py
/usr/lib64/python3.6/importlib/_bootstrap.py:205: RuntimeWarning: compiletime version 3.5 of module 'tensorflow.python.framework.fast_tensor_util' does not match runtime version 3.6
  return f(*args, **kwds)
2017-11-07 16:41:00.517173: I tensorflow/core/platform/cpu_feature_guard.cc:137] Your CPU supports instructions that this TensorFlow binary was not compiled to use: SSE4.1 SSE4.2
b'Hello, TensorFlow!'

Same issue on OSX 10.11.6, in an Anaconda virtual environment with Python 3.6.3 and upgrading to TensorFlow 1.4.
Temporarily routed around this issue by creating a new Anaconda environment with Python 3.5.4 and Tensorflow 1.4, which is working fine.

same issue on MacOS high sierra！how resolved it！give me command ，not link！

Same issue on OSX 10.12.6 sierra,

the version:

Hope this helps.

I am working on resolving both the Python3.6 binary as well as the git_version tag.

I took reference from
https://github.com/tensorflow/tensorflow/issues/6533
$ python3 -m pip install --upgrade https://storage.googleapis.com/tensorflow/mac/cpu/tensorflow-0.12.0-py3-none-any.whl
Collecting tensorflow==0.12.0 from https://storage.googleapis.com/tensorflow/mac/cpu/tensorflow-0.12.0-py3-none-any.whl
  Downloading https://storage.googleapis.com/tensorflow/mac/cpu/tensorflow-0.12.0-py3-none-any.whl (38.4MB)
    100% |████████████████████████████████| 38.4MB 33kB/s
Collecting protobuf==3.1.0 (from tensorflow==0.12.0)
  Downloading protobuf-3.1.0-py2.py3-none-any.whl (339kB)
    100% |████████████████████████████████| 348kB 1.4MB/s
Requirement already up-to-date: six>=1.10.0 in ./virtualenvs/dl4cv/lib/python3.6/site-packages (from tensorflow==0.12.0)
Requirement already up-to-date: numpy>=1.11.0 in ./virtualenvs/dl4cv/lib/python3.6/site-packages (from tensorflow==0.12.0)
Requirement already up-to-date: wheel>=0.26 in ./virtualenvs/dl4cv/lib/python3.6/site-packages (from tensorflow==0.12.0)
Requirement already up-to-date: setuptools in ./virtualenvs/dl4cv/lib/python3.6/site-packages (from protobuf==3.1.0->tensorflow==0.12.0)
Installing collected packages: protobuf, tensorflow
  Found existing installation: protobuf 3.4.0
    Uninstalling protobuf-3.4.0:
      Successfully uninstalled protobuf-3.4.0
Successfully installed protobuf-3.1.0 tensorflow-0.12.0

$ python
Python 3.6.3 (default, Oct  4 2017, 06:09:15)
[GCC 4.2.1 Compatible Apple LLVM 9.0.0 (clang-900.0.37)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>>

$ python
Python 3.6.3 (default, Oct  4 2017, 06:09:15)
[GCC 4.2.1 Compatible Apple LLVM 9.0.0 (clang-900.0.37)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import keras
Using TensorFlow backend.
>>>

Same issue on OSX 10.13.1 with Python 3.6.3

same issue on osx 10.12.6 with Python 3.6.3
/usr/local/Cellar/python3/3.6.3/Frameworks/Python.framework/Versions/3.6/lib/python3.6/importlib/_bootstrap.py:219: RuntimeWarning: compiletime version 3.5 of module 'tensorflow.python.framework.fast_tensor_util' does not match runtime version 3.6
  return f(*args, **kwds)

I someone has a solution I take it ! :)

setup a virtualenv with Python 3.5.0

@aktivkohle We need binary for python 3.6 anyways

same issue on macOS 10.13.1 with Python 3.6.3
/usr/local/Cellar/python3/3.6.3/Frameworks/Python.framework/Versions/3.6/lib/python3.6/importlib/_bootstrap.py:219: RuntimeWarning: compiletime version 3.5 of module 'tensorflow.python.framework.fast_tensor_util' does not match runtime version 3.6
  return f(*args, **kwds)

got same issue on macOS 10.12.6. However, seem we can ignore this warning. Waiting for a fix!

Same issue using Anaconda with python 3.6 on Ubuntu 16.04 when upgrading from tensorflow-gpu 1.3

same issue on Ubuntu 17.10, python 3.6.
Can we really ignore this warning ?

Same issue on Anaconda, Ubuntu 16.04, Python 3.6, Tensorflow GPU

Same issue on Anaconda, Ubuntu 16.04, Python 3.6, Tensorflow CPU

Same issue. Going to try to come back to setup a virtualenv with Python 3.5

I wish GitHub had a "Me Too" button... Anyways, me too.
Arch Linux, Pip env, and native GPU installation. Python 3.6.

I see the same warning with Python 3.6 from conda. On Mac it's just a warning, and things seem to work OK. But on Linux I see that import tensorflow breaks import scipy.special in a weird way.
python -c 'import tensorflow as tf; import scipy.special'
/d1/hfm/deil/software/anaconda/envs/image-style-transfer/lib/python3.6/importlib/_bootstrap.py:205: RuntimeWarning: compiletime version 3.5 of module 'tensorflow.python.framework.fast_tensor_util' does not match runtime version 3.6
  return f(*args, **kwds)
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/d1/hfm/deil/software/anaconda/envs/image-style-transfer/lib/python3.6/site-packages/scipy/special/__init__.py", line 648, in <module>
    from ._ellip_harm import ellip_harm, ellip_harm_2, ellip_normal
  File "/d1/hfm/deil/software/anaconda/envs/image-style-transfer/lib/python3.6/site-packages/scipy/special/_ellip_harm.py", line 7, in <module>
    from ._ellip_harm_2 import _ellipsoid, _ellipsoid_norm
ImportError: cannot import name '_ellipsoid'

I think my scipy is OK, at least this import works if I don't import tensorflow:
python -c 'import scipy.special'

Scipy 1.0 was installed via Anaconda, tensorflow 1.4 via pip:
$ conda list
scipy                     1.0.0            py36hbf646e7_0
tensorflow                1.4.0                     <pip>

Same issue on macOS 10.13 with Python 3.6.3
/Users/mcukingdom007/tensorflow/lib/python3.6/importlib/_bootstrap.py:219: RuntimeWarning: compiletime version 3.5 of module 'tensorflow.python.framework.fast_tensor_util' does not match runtime version 3.6   return f(*args, **kwds)

Any workaround or timeline to solve this problem? Thanks a lot!

Maybe Tensorflow-1.4 does not support linux & macOS with Python 3.6, so there seems to be an error.

Same issue on macOS 10.13 with python 3.6.1

I'm also having the same problem not anaconda install...just with pyenv and jupyter...on a macOS Sierra versiong 10.12.6 with python 3.6
Using TensorFlow backend.
/Users/Create/.pyenv/versions/3.6.3/lib/python3.6/importlib/_bootstrap.py:219: RuntimeWarning: compiletime version 3.5 of module 'tensorflow.python.framework.fast_tensor_util' does not match runtime version 3.6
return f(*args, **kwds)

Same issue on Ubuntu16.04.3 with python 3.6.3

Switching to Python 3.5 has removed the warning. To do this, I basically had to remove python 3.6 from my machine completely since jupyter was still pointing towards 3.6 even when only installed in 3.5 packages.
I followed this answer to remove python 3.6 from my machine (just replace all occurrences of 2.7 with 3.6 in that answer).
I then made sure to set PYTHONPATH to 3.5 using
export PYTHONPATH=/Library/Frameworks/Python.framework/Versions/3.5/bin
Then removing 3.6 from PATH by
echo $PATH then copy that entire path
export PATH=pasteInThePathAndRemovePython3.6
Hopefully this helps in the mean time!

"FIxed" issue by forcing the installation of the 1.3.0 version of tensorflow
$~/Downloads$ pip3 install tensorflow==1.3.0
Collecting tensorflow==1.3.0
Downloading tensorflow-1.3.0-cp36-cp36m-manylinux1_x86_64.whl (43.5MB)
100% |████████████████████████████████| 43.6MB 42kB/s
Collecting six>=1.10.0 (from tensorflow==1.3.0)
Using cached six-1.11.0-py2.py3-none-any.whl
Collecting protobuf>=3.3.0 (from tensorflow==1.3.0)
Using cached protobuf-3.4.0-cp36-cp36m-manylinux1_x86_64.whl
Collecting wheel>=0.26 (from tensorflow==1.3.0)
Using cached wheel-0.30.0-py2.py3-none-any.whl
Collecting numpy>=1.11.0 (from tensorflow==1.3.0)
Using cached numpy-1.13.3-cp36-cp36m-manylinux1_x86_64.whl
Collecting tensorflow-tensorboard<0.2.0,>=0.1.0 (from tensorflow==1.3.0)
Downloading tensorflow_tensorboard-0.1.8-py3-none-any.whl (1.6MB)
100% |████████████████████████████████| 1.6MB 1.2MB/s
Collecting setuptools (from protobuf>=3.3.0->tensorflow==1.3.0)
Using cached setuptools-36.7.2-py2.py3-none-any.whl
Collecting werkzeug>=0.11.10 (from tensorflow-tensorboard<0.2.0,>=0.1.0->tensorflow==1.3.0)
Using cached Werkzeug-0.12.2-py2.py3-none-any.whl
Collecting markdown>=2.6.8 (from tensorflow-tensorboard<0.2.0,>=0.1.0->tensorflow==1.3.0)
Collecting html5lib==0.9999999 (from tensorflow-tensorboard<0.2.0,>=0.1.0->tensorflow==1.3.0)
Collecting bleach==1.5.0 (from tensorflow-tensorboard<0.2.0,>=0.1.0->tensorflow==1.3.0)
Using cached bleach-1.5.0-py2.py3-none-any.whl
Installing collected packages: six, setuptools, protobuf, wheel, numpy, werkzeug, markdown, html5lib, bleach, tensorflow-tensorboard, tensorflow
Successfully installed bleach-1.5.0 html5lib-0.9999999 markdown-2.6.9 numpy-1.13.3 protobuf-3.4.0 setuptools-36.7.2 six-1.11.0 tensorflow-1.3.0 tensorflow-tensorboard-0.4.0rc2 werkzeug-0.12.2 wheel-0.30.0
$~/Downloads$ python3
Python 3.6.3 (default, Oct  3 2017, 21:45:48)
[GCC 7.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.

import keras
Using TensorFlow backend.

Great!!!

TensorFlow v1.4 doesn't work with Python3.6.
So, we should use TensorFlow v1.3.
It will be success.
Thank you.

This is the main guidance to installing which py version and tf version
https://github.com/lakshayg/tensorflow-build

I use Mac OS High Sierra.
I tried to use TF v1.4 with Python3.6.3, but , RuntimeWarning is shown when I import TF.
So, if you use High Sierra , be careful.

I am finding the GPU version (using Nvidia ) 1.4 works fine on Ubuntu Linux (py3.6) once past the warnings.. Have not run into other issues than the warnings..

Here are working 3.6 wheels https://github.com/mind/wheels

I have the same problem with clang 900.0.38,  python 3.6.3, tf 1.4.0. no idea how to fix it.

Here is a temporal "fix"
For anyone looking for a workaround we have several options:

Wait for an official binary to be released for Python 3.6
Ignore the warning, it seems to work okay.
Don't use tensorflow 1.4.0 instead use 1.3.0 pip3 install tensorflow==1.3.0.
Install an unofficial tensorflow binary compatible with Python 3.6 from lakshayg/tensorflow-build or from mind/wheels.

Example in Mac OS High Sierra I do:
$ pip install https://github.com/lakshayg/tensorflow-build/raw/master/tensorflow-1.4.0-cp36-cp36m-macosx_10_12_x86_64.whl

Note: Be careful to choose the correct wheel for your platform and if it's with CPU or GPU support.

Same issue on Ubuntu 16.04, Python 3.6.1, CPU version.
Force install TensorFlow 1.3 can fix like @VictorGaiva said.

When can we expect the official build of TF 1.4.0 for Python 3.6?

As a workaround (in virtualenv), we can use python 3.5 as below.
virtualenv --system-site-packages -p  /usr/bin/python3.5 ~/tensorflow/
...

import tensorflow as tf
hello = tf.constant('Hello, TensorFlow!')
...

In mac os ,this help me: python3 -m pip install --upgrade https://storage.googleapis.com/tensorflow/mac/cpu/tensorflow-0.12.0-py3-none-any.whl

tf-nightly and tf-nightly-gpu now has a python3.6 binary built from scratch for Linux.
1.5.0-dev20171206 and up
This should fix the warning

Same issue on MacOS 10.11.6 with Python 3.6.1

I installed tf_nightly_gpu-1.5.0.dev20171213-cp36-cp36m-manylinux1_x86_64.whl successfully.
Ubuntu17.10 x64.
Tensorflow is looking for cuda-9.0 but I have cuda-8.0 installed. does tf_1.5.0 works with cuda-8.0?
I have cuda-8.0 installed. I can see it in the library path

Following is Traceback for error
ImportError                               Traceback (most recent call last)
/usr/local/lib/python3.6/dist-packages/tensorflow/python/pywrap_tensorflow.py in ()
57
---> 58   from tensorflow.python.pywrap_tensorflow_internal import *
59   from tensorflow.python.pywrap_tensorflow_internal import version
/usr/local/lib/python3.6/dist-packages/tensorflow/python/pywrap_tensorflow_internal.py in ()
27             return _mod
---> 28     _pywrap_tensorflow_internal = swig_import_helper()
29     del swig_import_helper
/usr/local/lib/python3.6/dist-packages/tensorflow/python/pywrap_tensorflow_internal.py in swig_import_helper()
23             try:
---> 24                 _mod = imp.load_module('_pywrap_tensorflow_internal', fp, pathname, description)
25             finally:
/usr/lib/python3.6/imp.py in load_module(name, file, filename, details)
242         else:
--> 243             return load_dynamic(name, filename, file)
244     elif type_ == PKG_DIRECTORY:
/usr/lib/python3.6/imp.py in load_dynamic(name, path, file)
342             name=name, loader=loader, origin=path)
--> 343         return _load(spec)
344
ImportError: libcublas.so.9.0: cannot open shared object file: No such file or directory
During handling of the above exception, another exception occurred:
ImportError                               Traceback (most recent call last)
 in ()
----> 1 import tensorflow as tf
/usr/local/lib/python3.6/dist-packages/tensorflow/init.py in ()
22
23 # pylint: disable=wildcard-import
---> 24 from tensorflow.python import *
25 # pylint: enable=wildcard-import
26
/usr/local/lib/python3.6/dist-packages/tensorflow/python/init.py in ()
47 import numpy as np
48
---> 49 from tensorflow.python import pywrap_tensorflow
50
51 # Protocol buffers
/usr/local/lib/python3.6/dist-packages/tensorflow/python/pywrap_tensorflow.py in ()
71 for some common reasons and solutions.  Include the entire stack trace
72 above this error message when asking for help.""" % traceback.format_exc()
---> 73   raise ImportError(msg)
74
75 # pylint: enable=wildcard-import,g-import-not-at-top,unused-import,line-too-long
ImportError: Traceback (most recent call last):
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/pywrap_tensorflow.py", line 58, in
from tensorflow.python.pywrap_tensorflow_internal import *
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/pywrap_tensorflow_internal.py", line 28, in
_pywrap_tensorflow_internal = swig_import_helper()
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/pywrap_tensorflow_internal.py", line 24, in swig_import_helper
_mod = imp.load_module('_pywrap_tensorflow_internal', fp, pathname, description)
File "/usr/lib/python3.6/imp.py", line 243, in load_module
return load_dynamic(name, filename, file)
File "/usr/lib/python3.6/imp.py", line 343, in load_dynamic
return _load(spec)
ImportError: libcublas.so.9.0: cannot open shared object file: No such file or directory
Failed to load the native TensorFlow runtime.
See https://www.tensorflow.org/install/install_sources#common_installation_problems
for some common reasons and solutions.  Include the entire stack trace
above this error message when asking for help.

Just installed python 3.6 on ubuntu 16.04. Then:
~$ python3.6 -m pip install --user tensorflow
Collecting tensorflow
Downloading tensorflow-1.4.1-cp36-cp36m-manylinux1_x86_64.whl (41.2MB)
100% |████████████████████████████████| 41.2MB 52kB/s
and so on...
Then:
~$ ipython
Python 3.6.3 (default, Oct  4 2017, 02:55:45)
Type 'copyright', 'credits' or 'license' for more information
IPython 6.2.1 -- An enhanced Interactive Python. Type '?' for help.
In [1]: import tensorflow as tf
/usr/lib/python3.6/importlib/_bootstrap.py:219: RuntimeWarning: compiletime version 3.5 of module 'tensorflow.python.framework.fast_tensor_util' does not match runtime version 3.6
return f(*args, **kwds)
In [2]: hello = tf.constant('Hello TensorFlow!')
In [3]: session = tf.Session()
2017-12-15 15:53:35.523688: I tensorflow/core/platform/cpu_feature_guard.cc:137] Your CPU supports instructions that this TensorFlow binary was not compiled to use: SSE4.1 SSE4.2 AVX AVX2 FMA
In [4]: print(session.run(hello))
b'Hello TensorFlow!'
So I'm going to assume that this works just fine and this warning will go away with 1.5 or perhaps a 1.4.2 version.
By the way, did not notice this warning in Windows7 using tensorflow-gpu version 1.4.0 with python 3.6.2

Same issue on Ubuntu 16.04 LTS.

Same issue.

Same issue on Ubuntu 16.04 LTS.

We are not offering a native python3.6 for mac anytime soon.
As for the cuda9 issue, tf-nightly is built from HEAD at master every night, and I believe the latest binaries require cuda9. Try using an older version of tf-nightly. (Maybe 1208 or something)

Thanks @av8ramit
For those who have the (arbitrary) preference of only wanting to use official releases, the following is correct?

you'll need to wait for 1.5.x for this warning message to go away when using Python 3.6 on linux
in the meantime, you can use 1.4.1 with no problems, you'll just see the warning message

The same issue while I use Anaconda 3-5.0.1-Linux-x86_64.sh(Python3.6) and TensorFlow 1.4.

For what it's worth, the issue was discussed in a Hacker News thread about the 1.4 release (https://news.ycombinator.com/item?id=15647790). User allenlavoie responded:

It's just a small Cython-compiled utility throwing the warning, it works fine. Everything else is pure Python and so doesn't care about 3.5 vs 3.6. We will fix the warning, though (disclaimer: I work on TF and added fast_tensor_utils--sorry!).

Dear Tensorflow QA team. Please add some unit tests!!! Happy NY

python3.6 -m pip install https://github.com/lakshayg/tensorflow-build/raw/master/tensorflow-1.4.0-cp36-cp36m-linux_x86_64.whl

Thanks @Karthick333031 it works for me (MacOS 10.12.6)

Running: pip3 install --upgrade https://storage.googleapis.com/tensorflow/mac/cpu/tensorflow-1.10.0-py3-none-any.whl solved the issue
Python 3.6.5
TensorFlow 1.10.0
MacOS 10.14

Thanks,
@umang6891! It solved the problem for me. With the warning, my example hanged forever without failing, but now it runs. It looks like the problem is the version in pip.
 👍

@umang6891 's solution works good for me, and I am using a python3.6 virtualenv.


Help to create a POC

Hi,
I was wondering whether you could help with a few quick questions in order for me to create a POC:
a) What is the difference between openSearchVCEmbedding.py and vector_embedding.py. Is vector_embedding.py used?
b). In openSearchVCEmbedding.py in the add_documents function, the file_name parameter is the jsonl file with the database schema, correct?
3) I don't see the add_documents function called anywhere?
Thanks a ton!

were you able to generate the demo?


Const "is not accessed" when used in match case statement

Environment data

Language Server version: PyLance: v2023.4.40
OS and version: Windows 11
Python version (& distribution if applicable, e.g. Anaconda): 3.10

Code Snippet

        # Errors occur if const exists in this file, or is imported from an external file.
        ZONE_CIRCLE = "circle"

        zone = None
        match type:
            case ZONE_CIRCLE:
                zone = CircleZone(config)

Repro Steps

Write this case statement.

Expected behavior
Match case statement should work properly
Actual behavior
Two errors shown:
"ZONE_CIRCLE" is not accessedPylance

Irrefutable pattern is allowed only for the last case statementPylance

(constant) ZONE_CIRCLE: str  <- error hover info, just to verify the type.

replacing the constant ZONE__CIRCLE with the hard-coded string "circle", causes both errors to go away.

Pylance is correct here.
Your code doesn't do what you think it does.
When ZONE_CIRCLE is used within a case, it is considered a "capture pattern". It is a local variable that receives the value of the subject expression. I'm guessing that you thought ZONE_CIRCLE would be interpreted as a literal pattern.
As evidence, run this code:
ZONE_CIRCLE = "circle"

zone = None
match "square":
    case ZONE_CIRCLE:
        print(ZONE_CIRCLE)

It will print "square".
If the match statement is within an inner scope (such as a function), then ZONE_CIRCLE is a local variable that is distinct from the outer-scoped ZONE_CIRCLE.
ZONE_CIRCLE = "circle"

def func():
    match "square":
        case ZONE_CIRCLE: # This is a local variable
            pass

Hmmm.... well that's especially confusing given that intellisense says that ZONE_CIRCLE is a constant string...
I read far too much of PEP634 and still wasn't able to figure it out, but I was able to coax ChatGPT into clarifying for me that the only way to accomplish this with a const is to ensure that the const uses a qualified name.
import types
consts = types.SimpleNamespace()
consts.A = 1
consts.B = 2
consts.C = 3

interface = 2

match interface:
    case consts.A:
        print("A")
    case consts.B:
        print("B")
    case consts.C:
        print("C")

This is oddly unintuitive, but thanks for helping me figure it out!


Changed pkg_config templates to use the library variable name

Description

Changed pkg_config templates to use the library variable name instead of being hard-coded

Nice and clean, thanks for the contribution.


Add a database select option for Redis

Redis support 16 (0 through 15) separate databases by default, this adds a way to select the database via the system.yaml

Already implemented: https://github.com/getgrav/grav/blob/develop/system/src/Grav/Common/Cache.php#L316


Create/update the mapped data in the correct customer/tenant (part 1)

Created by: @maaland Feb 11 2022 at 13:31 CET
Last updated: Jul 19 2022 at 10:59 CET
ClickUp ID: IK-2226
When data sent to the ingest engine has been parsed and mapped, we need to create and/or update the appropriate entities, relationships and properties in the Identity Graph and in the Knowledge Graph.
Acceptance criteria
Use the mapping service to transform the incoming data into an appropriate cypher
Implement Neo4j interface to run against the correct knowledge graph
Run the cypher in the Knowledge Graph

Commented by: @maaland Feb 21 2022 at 13:11 CET
This task is somewhat dependent on the solution to issue 3 of 24vfpqv , as we need a deterministic way to find the correct DT to connect ingested data to.

Commented by: @maaland Mar 03 2022 at 09:56 CET
Changes this to 5 story points as I think it will be a little bigger than first expected, considering we need a number of new cyphers.

Commented by: @maaland Mar 08 2022 at 10:04 CET
Part of this is dependent on 1zc1bt8  and 24vfpqv  to be able to find the correct DT in the Identity Graph to update. But I can start with the Knowledge Graph part for now.

Commented by: @maaland Mar 15 2022 at 22:34 CET
Moving this to Titan as it requires more work

Commented by: @bayegan Mar 16 2022 at 03:19 CET
@maaland : on a side note, when using sub-tasks, it's not possible to span multiple sprints. recommended is to use regular tasks and create dependencies. sub-tasks were marked as resolved when parent task was resolved

Commented by: @maaland Mar 16 2022 at 13:14 CET
I see that you moved this to @bayegan , shouldn't it be in Dione instead?


media.stream_id missing

Hello!
It seems there are some new attributes added to platform as shown below
https://github.com/awsdocs/aws-panorama-developer-guide/blob/main/resources/applicationsdk-reference.md
But when I tested on appliance or through sdk, I can't find stream_id and is_cached attributes.
When will be added to platform ?

@jk1333 ,
Thank you for reporting this issue. The new properties are added to real hardware version of panoramasdk, but they have not been added to the Test Utility (simulation environment) version of panoramasdk yet, and we will add them. Thank you for pointing out. We will keep this item open, and update once they are added.

The fix has merged through mot sample so we can close


Fix core-setup URI

@BrennanConroy you asked about this URI and @mmitche has let us know it was incorrect. So, you're volunteered 😺

It's not technically incorrect, just that we should only use the internal uri for commits that are not availabe in the open.