Distinguish API errors in Sentry

In our Sentry logs, the most frequent "issue" by far is:

Error ApiError(src/api/apiErrors)

Flipping through the events that make it up, they turn out to be a wide variety of different errors:

Bad value for 'to': [30] (on POST /typing -- so #3732; event)
Topic can't be empty (on POST /messages, with e.g. subject=%20 -- so #3743)
Zulip server auth failure: f2f0[... a UUID] is not registered (on POST /users/me/android_gcm_reg_id; event)
Cannot send to multiple streams (on POST /messages; event; looks to be #3729)
... that covers the last few dozen of these events, but there are probably other errors that are just a bit less frequent.

Confusingly, the main dashboard, which shows one big row per "issue", includes the error message from the one most recent event, making it look like that one error is generating that many events, when in fact it's all these errors combined.
I'm not sure exactly how Sentry is deciding to aggregate these. In addition to the "Error ApiError(src/api/apiErrors)" part which they all have in common, they also all have the same stack trace, so that may be a factor; it's
Error: Cannot send to multiple streams
  at construct(app:///[native code]:0:0)
  at _construct(node_modules/@babel/runtime/helpers/construct.js:30:21)
  at Wrapper(node_modules/@babel/runtime/helpers/wrapNativeSuper.js:26:14)
  at ApiError(src/api/apiErrors.js:14:5)
  at makeErrorFromApi(src/api/apiErrors.js:36:20)
  at call(src/api/apiFetch.js:76:11)
  at tryCatch(node_modules/@babel/runtime/node_modules/regenerator-runtime/runtime.js:45:40)
[... then a bunch more framework frames, which don't vary either]

where only the message in the first line varies.
We have a lot of useful metadata about these errors, so we should be able to do pretty well at disambiguating. A few items that probably always mean a different error when they differ are:

the route, i.e. the path portion of the URL (like /api/v1/typing) or better yet the part after /api/v1/
the HTTP method (POST, GET, etc.)
the code value in the response (typically just BAD_REQUEST, but when it does vary it'll be informative)

Probably the route is the single most valuable piece of data to distinguish by -- that alone should distinguish most of the different errors here.
I expect resolving this will involve some reading up on the Sentry API; I think we'll likely need to use some Sentry features we don't currently use.

Meanwhile! I just discovered an alternate view within Sentry, which can mostly disaggregate events. It's called "Discover", and this UI is apparently Discover v2, which they just launched. Here's a view that's roughly the most recent individual error events. (There's still a little grouping, which I don't yet understand.)
That's helpful for scanning through what the most frequent types of API errors are, so it's a partial workaround for this issue. The big downside of this view, though, is that you only see on the screen the last 50 or so events, covering a short window of time; so it's highly subject to bursts, and also it's hard to see beyond the three or four most-frequent errors which dominate the view. So the distinctions called for in this issue would still be great to have, to make the Issues dashboard (which solves those problems by aggregating across time) more informative.

Oof. This is new – the error message used to be a major disaggregator. (Hence my earlier push (#3733) to keep nonessential varying data out of the error message and in the "extras" block.)
(For reference, here is the current Sentry documentation on event aggregation.)

Hmm, yeah. From those docs:

When Sentry detects a stack trace in the event data (either directly or as part of an exception), the grouping is effectively based entirely on the stack trace.

which matches what we're seeing now, but not what we were seeing when you made that earlier push. (At that time, we'd get tons of separate "issues" from the exact same stack trace when the message varied.)
They say this about changes:

Each time the default behavior is modified, Sentry releases it as a new version so it does not affect how existing issues are grouped. When you create a Sentry project, the latest and greatest version of the grouping algorithm is automatically selected. This means that the grouping behavior is consistent within a project. If you want to upgrade an existing project to a new grouping algorithm version, you can do so in the project settings. When upgrading you will very likely see new groups being created.

I don't think we've ever made such a change in the project settings, though!
It looks like this would be the UI for doing so.

Bad value for 'to': [30] (on POST /typing -- so #3732; event)
Zulip server auth failure: f2f0[... a UUID] is not registered (on POST /users/me/android_gcm_reg_id; event)
Cannot send to multiple streams (on POST /messages; event; looks to be #3729)

If I'm reading the Sentry logs correctly, it looks like all of these are only happening on Android? None of the errors would seem to be platform-specific, which is weird.
Looking for causes of https://github.com/zulip/zulip-mobile/issues/4033, which is on Android; looks like there's been a fresh report of something similar (also on Android), here.

Bad value for 'to': [30] (on POST /typing -- so #3732; event)

I'm not sure offhand about the other two, but this one I can explain: it's because the user ID is embedded in the error message. This means that the error message will be unique for almost every user of this API, and so the various error reports for #3732 are not being grouped together.
Looking for other flavors of that error message shows that some do occur on iOS: for example, this one, with Bad value for 'to': [13].

If I'm reading the Sentry logs correctly, it looks like all of these are only happening on Android? None of the errors would seem to be platform-specific, which is weird.

Often (maybe always) our errors seem not to get aggregated in Sentry between Android and iOS.
In particular that applies to the omnibus "API error" Sentry error that this issue thread is about. Looks like this is the iOS version:
https://sentry.io/organizations/zulip/issues/1562540614/
while this is the Android version:
https://sentry.io/organizations/zulip/issues/1275118205/
All three of these event links:

Bad value for 'to': [30] (on POST /typing -- so #3732; event)
Zulip server auth failure: f2f0[... a UUID] is not registered (on POST /users/me/android_gcm_reg_id; event)
Cannot send to multiple streams (on POST /messages; event; looks to be #3729)

were to different events that got attached to the Android version of the error, I guess because that must have been the error I scanned through to find them. Because they're all the same "error", they all have the same right sidebar, including the aggregates which are across different events on that error.

I expect resolving this will involve some reading up on the Sentry API; I think we'll likely need to use some Sentry features we don't currently use.

In particular, I think what we want here are explicit fingerprinting and a custom integration.
The former will do the disaggregation by whatever strings we define. However, the usual method of doing that involves a scope created at the exception-capture site, which isn't appropriate for us – our ApiErrors are handled by the uncaught-exception handler, which is exactly how we like it.
What we want is to (potentially) process every exception Sentry reports, regardless of the context in which it was caught, and give it a custom fingerprint – which is the sort of thing integrations are for.
For reference, since the source is probably the best documentation we'll get on the topic:

here is what Scope does with event.fingerprint;
here is the definition of class Integration, from which all integrations should be derived;
here is the source of the @sentry/javascript default integrations; and
here is the source of the @sentry/react-native Javascript-side default integrations.

Cool, thanks for that research! That "fingerprinting" doc looks like it's directly on point.
Down midway through the page, it offers an example using beforeSend, which looks like a bit simpler of an API for doing the same thing as a custom integration. I think either way can probably work out fine. Bit more discussion here:
https://chat.zulip.org/#narrow/stream/243-mobile-team/topic/distinguishing.20API.20errors.20in.20Sentry/near/861545

the definition of class Integration, from which all integrations should be derived;

(It looks like that's actually a TS "interface", which is a structural type -- so no class derivation is necessary, just an object with properties name and setupOnce, the latter with the right signature.)

Update on this:

API errors are still by far our most widespread "issue" -- "widespread" meaning they affect the greatest number of users.
The current omnibus "issue" they get grouped under is here. In the dashboard it says "construct([native code])"; this appears to be just an unhelpful way of referring to where our ApiError class's constructor calls the constructor for its base class Error.

Update on this:

API errors are still by far our most widespread "issue" -- "widespread" meaning they affect the greatest number of users.
The current omnibus "issue" they get grouped under is here. In the dashboard it says "construct([native code])"; this appears to be just an unhelpful way of referring to where our ApiError class's constructor calls the constructor for its base class Error.


Exercises are not compiled with "warnings as errors" with MSVC (Microsoft Visual C++).

When compiling with CLang or GCC warnings are treated as errors. The relevant part of CMakeList.txt is this:
if("${CMAKE_CXX_COMPILER_ID}" MATCHES "(GNU|Clang)")
    set_target_properties(${exercise} PROPERTIES
        COMPILE_FLAGS "-Wall -Wextra -Wpedantic -Werror"
    )
endif()

For MSVC no such option is set. As a consequence code that contains mistakes that the user should be guarded against (e.g. not returning a value in all code paths) compiles without errors. Also when uploading the code to the website the stricter rules on the server will make code that compiled locally fail there.
Setting warnings as errors for MSVC is not that hard. There is an MSVC specific part in CMakeList.txt:
# Tell MSVC not to warn us about unchecked iterators in debug builds
if(${MSVC})
    set_target_properties(${exercise} PROPERTIES
        COMPILE_DEFINITIONS_DEBUG _SCL_SECURE_NO_WARNINGS)
endif()

This can be changed to:
# Tell MSVC not to warn us about unchecked iterators in debug builds
if(${MSVC})
    set_target_properties(${exercise} PROPERTIES
        COMPILE_DEFINITIONS_DEBUG _SCL_SECURE_NO_WARNINGS
        COMPILE_FLAGS "/WX")
endif()

Compiling with /WX will make MSVC treat warnings as errors.
If this change is deemed useful, I can pick it up.

As an aside, the GCC/CLang COMPILE_FLAGS: -Wall -Wextra -Wpedantic also raise the warning level of the compiler.
This is also possible for MSVC. The default warning level for MSVC is /W3, this can be set to /W4 or /Wall. I experimented with those levels and I do NOT propose setting those higher levels. E.g. with /WX /W4 the following code:
char capital_a = std::toupper('a');

Will fail to compile because the compiler warns (as error) about a possible loss of precision when setting capital_a (a char) to the return value of toupper() (an int).

@vaeng I opened this issue, but it was auto-closed.
I am not really sure how to navigate this. I do not want to spam the forum, so this seemed more appropriate. Maybe I should also stop spamming here :slightly_smiling_face:, let me know what you think.
I can pick up the issue if you think it is worthwhile. The change I propose to make is one that I consistently make to CMakeList.txt when solving exercises on Windows.

No need to post to the forums, if you ping me here. The forums are pretty quiet for CPP, so I don't mind the post there either. Do what feels best for you
In general I really appreciate the work you do for Windows, as it is often overlooked by our regulars, but heavily used by beginners.
Please keep in mind that I'm currently pretty busy and the other maintainers are somewhat inactive at the moment.


SHA-512 is not a supported hashing algorithm

I migrated a working install to a newer machine, replaced the tpm keys, and sshd comes up fine, but I get the "send_disconnect" error no matter how I try to connect ( the server is up and accepts a password though.)  checking the ssh-tpm-agent logs shows INFO "agent 13: SHA-512 is not a supported hashing algorithm" right after "signwithflags" is called. shuttdown down the tpm agent and removing its sshd config causes connections to resume.

This is known.
TPMs doesn't really support SHA-512 and for this to work I need to implement the signing operation on another layer.

How do I work around in the meantime? is this an openssh version problem? can I change a setting somewhere?

You need to remove rsa-sha2-512 as a valid signature algorithm. I can't remember from the top of my head how you do this.

easier to just delete the RSA in my case.


Add Y_DEBUG_ABORT macros

Changelog entry
...
Changelog category

Not for changelog (changelog entry is not required)

Additional information
...

It turned out that https://a.yandex-team.ru/review/5729677/details should go first


Synthesis failed for Google.Identity.AccessContextManager.V1

Hello! Autosynth couldn't regenerate Google.Identity.AccessContextManager.V1. :broken_heart:
Please investigate and fix this issue within 5 business days.  While it remains broken,
this library cannot be updated with changes to the Google.Identity.AccessContextManager.V1 API, and the library grows
stale.
See https://github.com/googleapis/synthtool/blob/master/autosynth/TroubleShooting.md
for trouble shooting tips.
Here's the output from running synth.py:
2021-03-19 22:47:05,606 autosynth [INFO] > logs will be written to: /tmpfs/src/logs/Google.Identity.AccessContextManager.V1
2021-03-19 22:47:06,105 autosynth [DEBUG] > Running: git config --global core.excludesfile /home/kbuilder/.autosynth-gitignore
2021-03-19 22:47:06,109 autosynth [DEBUG] > Running: git config user.name yoshi-automation
2021-03-19 22:47:06,113 autosynth [DEBUG] > Running: git config user.email<EMAIL_ADDRESS>2021-03-19 22:47:06,117 autosynth [DEBUG] > Running: git config push.default simple
2021-03-19 22:47:06,120 autosynth [DEBUG] > Running: git branch -f autosynth-Google.Identity.AccessContextManager.V1
2021-03-19 22:47:06,124 autosynth [DEBUG] > Running: git checkout autosynth-Google.Identity.AccessContextManager.V1
Switched to branch 'autosynth-Google.Identity.AccessContextManager.V1'
2021-03-19 22:47:06,327 autosynth [DEBUG] > Running: git rev-parse --show-toplevel
2021-03-19 22:47:06,334 autosynth [DEBUG] > Running: git log -1 --pretty=%H
2021-03-19 22:47:06,339 autosynth [DEBUG] > Running: git remote get-url origin
2021-03-19 22:47:06,373 synthtool [ERROR] > Failed executing git checkout master:

error: Your local changes to the following files would be overwritten by checkout:
	google/cloud/dialogflow/v2/answer_record.proto
	google/cloud/dialogflow/v2/conversation.proto
	google/cloud/dialogflow/v2/conversation_profile.proto
	google/cloud/dialogflow/v2/participant.proto
Please commit your changes or stash them before you switch branches.
Aborting

Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 312, in _inner_main
    git_source.enumerate_versions(sources, pathlib.Path(temp_dir))
  File "/tmpfs/src/github/synthtool/autosynth/git_source.py", line 202, in enumerate_versions
    source_versions = enumerate_versions_for_source(git_source, temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/git_source.py", line 166, in enumerate_versions_for_source
    local_repo_dir = str(synthtool_git.clone(remote))
  File "/tmpfs/src/github/synthtool/synthtool/sources/git.py", line 85, in clone
    shell.run(["git", "checkout", "master"], cwd=str(dest), check=True)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['git', 'checkout', 'master']' returned non-zero exit status 1.

Google internal developers can see the full log here.

Autosynth passed, closing! :green_heart:


create  "pop until" clearing mechanism

Suggestion from Stefan Esser:
The overhead of clearing open containers, lists, and instances makes writing app code fairly annoying.  Having a mechanism to record the current state and then clear to that state can simplify that logic:
xo_push_marker("some-internal-name");
call_some_function();
xo_pop_marker("some-internal-name");

The marker isn't emitted as output, but gives a means for the app to clear to a known state.

done


How can I open android phone default apps in a VR app

I wanted to see videos in android phone videos inside  a VR app screen. (I created a screen as Netflix).
I want to see my phone videos inside that screen, I opened some other android apps in a VR screen, but it come to full screen when I testing with phone debug mode. But when I wearing a Gear VR device that opened apps can not see.
Please advice me how to achieve this and where I went wrong.
Regards

I see you closed this, so perhaps you already answered your own question, but I would still like to better understand what that question was :).  For a Netflix type app, you can look at our gvr-video sample.  (actually, there's an updated, refactored version that may be easier to follow as a pull-request that will probably be merged soon: https://github.com/gearvrf/GearVRf-Demos/pull/287).
But, I did not understand what your second sentence.

Thanks very much.
Actually I got one part fixed and I got your updated sample.
Still Im getting same type issue. please guide me.  How I can show a normal android apps( like mobile version of word application) inside a VR app screen , not in whole screen, it must be like a front screen like in Netflix. (I can open word app from VR app , but I cannot put it in the front screen, it comes to whole screen). Please any idea.

Thanks very much.
Actually I got one part fixed and I got your updated sample.
Still Im getting same type issue. please guide me. How I can show a normal android apps( like mobile version of word application) inside a VR app screen , not in whole screen, it must be like a front screen like in Netflix. (I can open word app from VR app , but I cannot put it in the front screen, it comes to whole screen). Please any idea.

If you want to display android ui that you inflate, you can take a look at gvr-events.
If you're talking about trying to display a different activity / process within your vr app, it's going to be a lot more difficult.  You would need to find a way to get a handle to the surface that the application renders to and use that as a texture in your vr app.  I don't think you'll be able to do that without modifying android itself.

Thank you very much.
Actually what I want  is as you explain here   'You would need to find a way to get a handle to the surface that the application renders to and use that as a texture in your vr app'
Im finding a way to how to modify android .....
If any idea related, please advice.

That's all I've got.  I'm not too sure I can really help any further than that.  Good luck.  I'm sure it will be challenging.

@freshindee Do you have other questions or can we close the issue?

I want to run android normal app(not VR app, other apps like mobile version of word, excel) inside a VR app as a response to click event of any control. SO please guide me how I can achieve this, can you provide a container,popup window, something like this.

@freshindee I am afraid we don't have anything more than what @thomasflynn already explained. This is not something that the platform supports out of the box and there is nothing gvrf can do to remedy that.

Ok..Thanks.

@freshindee Would you mind if we close this issue?


Remove ASOS from the community authentication providers and update OpenIddict's description

ASOS was merged into OpenIddict 3.0: https://kevinchalet.com/2020/12/23/openiddict-3-0-general-availability/
@Rick-Anderson could you PTAL? 😃

@Tratcher would you mind taking a look? Thanks 😃

@Tratcher would you mind taking a look? Thanks 😃


"A facade root has not been set." exception

I have this configuration in the eloquent.yaml:
wouterj_eloquent:
driver:   '%env(DB_CONNECTION)%'
host:     '%env(DB_HOST)%'
port:     '%env(DB_PORT)%'
database: '%env(DB_DATABASE)%'
username: '%env(DB_USERNAME)%'
password: '%env(DB_PASSWORD)%'
eloquent: true
aliases:
db: true
And when i try to use this query
$juegos = DB::table('juegos')->paginate(self::JUEGOS_POR_PAGINA, ['*'], 'page', $page);
i get an exception with the message "A facade root has not been set". The same happens if i comment the eloquent and/or the aliases (with its db subkey) parameters. #

Hello,
wouterj_eloquent:
...
aliases: true
eloquent: true
The way you were defining just "expose" the DB::.. facade and some others that's needed, not.
Another thing that may cause issues similar to this is to import it manually when you have it defined on the config.
Example: Importing manually on your script \DB but have aliases:  db: true on your config file.


[GPS][CARLA] Wrong GPS conversions

I would like to report a problem in coordinates conversions when using the GPS/GNSS. While doing Cartesian -> angular -> Cartesian, we get a significant shift on the Y-axis.
While doing Cartesian -> Angular is CARLA's responsibility through carla.Map.transform_to_geolocation, we tried two different methods for angular -> Cartesian : with robot_localization (see conversions file) and a minimal example with pymap3d as suggested in this previous issue #2737
Pure python minimal example
By @vtalpaert
import unittest
import time

import numpy as np
import pymap3d as pm
import xml.etree.ElementTree as ET

import carla

class TestGps(unittest.TestCase):
    """Based on https://github.com/carla-simulator/carla/issues/2737
    """

    def setUp(self):
        self.client = carla.Client('localhost', 2000)
        self.client.set_timeout(2.0)
        self.world = self.client.get_world()
        self.carla_map = self.world.get_map()

    def change_town(self, town):
        print(town)
        self.client.load_world(town)
        time.sleep(2)
        self.world = self.client.get_world()
        self.carla_map = self.world.get_map()

    def get_gps_origin(self):
        opendrive_str = self.carla_map.to_opendrive()
        xml_tree = ET.fromstring(opendrive_str)
        lat_ref, lon_ref = None, None
        for geo_elem in xml_tree.find('header').find('geoReference').text.split(' '):
            if geo_elem.startswith('+lat_0'):
                lat_ref = float(geo_elem.split('=')[-1])
            elif geo_elem.startswith('+lon_0'):
                lon_ref = float(geo_elem.split('=')[-1])
        return lat_ref, lon_ref, 0.

    def test_gps_conversions_on_spawn_points(self):
        for town in ['Town01', 'Town02', 'Town03', 'Town04', 'Town05', 'Town06', 'Town07']:
            self.change_town(town)

            transforms = self.carla_map.get_spawn_points()
            geo_locations = [self.carla_map.transform_to_geolocation(
                spawn_tf.location) for spawn_tf in transforms]
            origin_latitude, origin_longitude, origin_altitude = self.get_gps_origin()
            print(origin_latitude, origin_longitude, origin_altitude)
            initial_coordinates = np.array(
                [(tf.location.x, tf.location.y, tf.location.z) for tf in transforms])
            converted_coordinates = np.array([pm.geodetic2enu(geo_loc.latitude, geo_loc.longitude, geo_loc.altitude, origin_latitude,
                                                              origin_longitude, origin_altitude, ell=pm.utils.Ellipsoid('wgs84')) for geo_loc in geo_locations])

            error = initial_coordinates - converted_coordinates
            print(np.mean(error, axis=0))
            print(np.std(error - np.mean(error, axis=0), axis=0))

Town01
0.0 0.0 0.0
[-9.24646097e-06  2.97596375e+02  6.91951211e-03]
[5.46863880e-06 2.19772448e+02 4.85565938e-03]
Town02
0.0 0.0 0.0
[-6.81042547e-06  4.17641156e+02  4.73719191e-03]
[5.46275418e-06 1.29641226e+02 2.30493103e-03]
Town03
0.0 0.0 0.0
[-1.34666621e-05 -5.26064856e+00  1.95923572e-03]
[4.30770311e-05 2.23983902e+02 1.39847287e-03]
Town04
0.0 0.0 0.0
[-5.78260098e-06 -1.72460864e+02  9.23116418e-03]
[4.15588248e-05 3.69469762e+02 7.04270094e-03]
Town05
0.0 0.0 0.0
[ 3.16266680e-06 -1.38316552e+01  1.67422368e-03]
[6.00473414e-06 1.90188177e+02 1.23744981e-03]
Town06
0.0 0.0 0.0
[-1.12223137e-05  1.73090866e+02  1.13922030e-02]
[1.20805326e-05 1.85252682e+02 9.51519946e-03]
Town07
0.0 0.0 0.0
[ 3.89275918e-06 -8.69032153e+01  1.67190173e-03]
[4.19012416e-06 1.87363485e+02 1.65588565e-03]
.
----------------------------------------------------------------------
Ran 1 test in 25.724s

OK

In the OpenDrive files, the reference is defined by <geoReference><![CDATA[+proj=tmerc +lat_0=0 +lon_0=0 +k=1 +x_0=0 +y_0=0 +datum=WGS84 +units=m +geoidgrids=egm96_15.gtx +vunits=m +no_defs ]]></geoReference>. The convention says WGS84, just like used by pymap3d.
How can we have an error average of 400m ?
Issues with the ROS-bridge (ROS2 Eloquent)
Instead of the pymap3d library, I used the navsat_transform node from robot_localization ROS2 Eloquent package to do the angular -> Cartesian conversions
Difference between GPS and real trajectories

these 2 figure shows the positions estimated given by gps and the real positions of our vehicle. arrows show the forward direction of our vehicle. As we can see, there are bias between red points or green points and blue points, which represent the real positions of vehicle and the positions estimated. red points are real vehicle positions from topic /tf, and green points are real vehicle positions from /odometry/wheel. these 2 type real positions are from different sources but they have exactly same value
Fixed bias when immobile

As shown by this figure, the positions estimated by gps are always right behind the vehicle. the bias of gps is clearly shown here and this is what we want to fix.
launch.actions.DeclareLaunchArgument(
    name='spawn_point_ego_vehicle',  # x y z roll pitch yaw
    default_value='133.0,-59,0.2,0,0,180'
),

Coordinate of vehicle spwaning in this test is [133,-59,0.2,0,0,180].
{
      "type": "sensor.other.gnss",
      "id": "gnss1",
      "spawn_point": {"x": 1.0, "y": 0.0, "z": 2.0},
      "noise_alt_stddev": 0.05, "noise_lat_stddev": 0.00000025, "noise_lon_stddev": 0.00000025,
      "noise_alt_bias": 0.0, "noise_lat_bias": 0.0, "noise_lon_bias": 0.0
},

this test is made with the configuration which is shown above. longitide noise and latitude noise are in degre and altitude noise is in meter. and there is clearly no noise bias from configuration file.
Bias changes according to position on the map
Here is the error when following a trajectory

the figure above shows the bias on the X axis and Y axis. and the figure below shows trajectory of vehicle.
As we can see, represented by the first figure, the bias on the Y axis are more than that on axis X. but theoretically, there should be not bias on Y axis. and now, bias on Y axis is between 0.1 to 0.8 meters.
the yellow and green circle marked are sections which the vehicle moved on Y axis and X axis. in these sections, the bias on X axis or Y axis change obviously.

Bias changes according to position on the map when immobile
I tested the bias with different spawn point of vehicle:
Spawn point: [100,100,0.2,0,0,180]
launch.actions.DeclareLaunchArgument(
    name='spawn_point_ego_vehicle',  # x y z roll pitch yaw
    default_value='100.0,100,0.2,0,0,180'
),

Spawn point: [-100,100,0.2,0,0,180]
launch.actions.DeclareLaunchArgument(
    name='spawn_point_ego_vehicle',  # x y z roll pitch yaw
    default_value='-100.0,100,0.2,0,0,180'
),

I only modified the spawn point of vehicle and nothing else. But results of gps are in different position of vehicle. these 2 tests clearly show that the vehicle's position influence the gps bias.
Thanks.

Worth noting that the issue is happening in CARLA 0.9.10 (because we use the ROS2 Eloquent version of the bridge)

Hello @ley-Hao
any news about this issue, is there any way to get rid of this bias?

Carla uses the left-hand coordinates. while ENU uses the right-hand one. So the initial_coordinates need to change to
initial_coordinates = np.array([(tf.location.x, -tf.location.y, tf.location.z) for tf in transforms])
Yet, there're still some error between the initial and the converted.

Hi @VincentCheng24 , could you give the output when considering the Euclidean distance as the error between the points, or at the least the absolute value instead of just the difference ?

Hi @vtalpaert here is the distance error in meter
Town01
Mean distance error:  1.002320944448858
Distance error std:   0.7344406348971494

Town02
Mean distance error:  1.4026113319248008
Distance error std:   0.43539032317350096

Town03
Mean distance error:  0.5932342026932097
Distance error std:   0.46281857075395094

Town04
Mean distance error:  1.1596860857478732
Distance error std:   0.7271281313217032

Town05
Mean distance error:  0.5021692887738411
Distance error std:   0.3981655899729742

Town06
Mean distance error:  0.6547405536478685
Distance error std:   0.5440733676350943

Town07
Mean distance error:  0.5526080355482472
Distance error std:   0.4193697459775573

Town10HD
Mean distance error:  0.3671618162618558
Distance error std:   0.26824421252947606


Remove resources from service

This API enhancement allows for the removal of resources from a service as a follow up to the add resources enhancement.
Remove resources can be done from the collection:
POST /api/services
{
    'action'    => 'remove_resource',
    'resources' => [
          { 'href' => 'api/services/:id','resource' => { 'href' => 'api/vms/:id' },
          { 'href' => 'api/services/:id, 'resource' => { 'href' => 'api/vms/:id'} }
        ]
}

or from the resource:
POST /api/services/:id
{
    'action'   => 'remove_resource',
    'resource' => { 'resource' => {'href' => 'api/vms/:id' }}
}

cc: @mkanoor
@miq-bot add_label enhancement, api
@miq-bot assign @abellotti

Thanks @jntullo for this enhancement, this LGTM!! 😍 will merge when 🍏

@jntullo and @mkanoor is this master only or needed in Fine-release ?

@abellotti @gmcculloug @jntullo
Since we are in alpha can't be add it to the Fine release?

Checking with @jonnyfiveiq to confirm if we can include in the fine release.

@gmcculloug SUI does need this for Fine.

@chriskacerguis Is there a bug, issue or story we can link this to?

@gmcculloug sure (sorry for not including it).  Here's the PT that needs it: https://www.pivotaltracker.com/story/show/142775095

😕  I am not sure how these two things are related.  The pivotal story is for "Retire now" and this PR is for removing resources, like VMs, from a service.

@gmcculloug the "retire now" is exactly that; we need to remove a resource (such as a VM) from a service.

Fine backport details:
$ git log -1
commit f9a5bb0f01284d4c8918862e441e8009ae261cda
Author: Alberto Bellotti<EMAIL_ADDRESS>Date:   Mon Apr 3 15:48:12 2017 -0400

    Merge pull request #14581 from jntullo/enhancement/remove_resources

    Remove resources from service
    (cherry picked from commit 88669e4fae2e6f612a4d58983d0aa17e1a0f8c3e)


优化重复定义时的出错提示信息

Codecov Report

Merging #80 (7bcc284) into master (2dd28aa) will increase coverage by 0.02%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master      #80      +/-   ##
==========================================
+ Coverage   81.56%   81.58%   +0.02%
==========================================
  Files          11       11
  Lines         857      858       +1
==========================================
+ Hits          699      700       +1
  Misses        104      104
  Partials       54       54

Impacted Files
Coverage Δ

clop.go
85.84% <100.00%> (+0.03%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2dd28aa...7bcc284. Read the comment docs.


Github.io comments: Finishing Up

Comments to https://microsoft.github.io/PowerBI-visuals/docs/step-by-step-lab/finishing-up/

There is a "Delete" next to the data source, and it does not prompt to delete report at all, it simply deletes it


doc: Add API example to documentation

What this PR does / why we need it:

Moved API documentation to a separate file.
Added examples how to call the API.

Release note:
None

/cc @0xFelix @codingben

CI is not needed for this PR.
/override ci/prow/images


Ensure data types from trait_type are passed down during normalization process to user

Done, just need to update display.


[Bug]: Coolify removes all the stopped containers and unused images

Is there an existing issue for this?

[X] I have searched the existing issues

Description
I recently noticed that some of my containers started disappearing. I made an investigation and it looks like Coolify removes everything that is stopped or gets an error (before it restarts). It got rid of about 10 containers that I had temporarily stopped. So annoying, because it is not possible to use Coolify together with other things on Docker.
I use Docker on Synology (DSM7) - maybe this is the issue.
Steps To Reproduce

Create some random containers and stop them.
Wait a little bit (not sure the amount of time, but max 5-10 minutes) or restart Docker.
Stopped containers and unused images are gone.

Version
3.1.4

Oh, nice! Thanks for the notice. I do not think of this yet. It will be fixed in the next version (v3.2.1).

Hi! Sorry to hijack this issue, but how did you install Coolify on Synology?

Hi! Sorry to hijack this issue, but how did you install Coolify on Synology?

@kkuriata ☝🏼 can you give us some hit please 🙂 ?


Added hamburger menu animation

This is how my animation looks like

on hover, it looks like

please tell me if it requires any changes
Thank you!

This is how my animation looks like  on hover, it looks like  please tell me if it requires any changes Thank you!

hey @Daksh-Raghuvanshi can you just create the issue first with the name of your project so that i can assign you the issue first and add the tag of hacktoberfest than you can open your PR and I'll review it and merge it and don't forget to pull / fetch the previous changes using sync fork and also add screenshot of your project in PR Comment


Unable to provision CI/Test environment

Describe the bug
Please see this pipeline run: https://capgeminiuk.visualstudio.com/GitHub Support/_build/results?buildId=9052&view=logs&j=f2c9ad55-a86d-5c06-a2e1-393c8f8cd5a3&t=02a88eae-8260-570a-ce65-4b16ad16d2da
To reproduce
Run PR pipeline.
Expected behaviour
Environment to be provisioned for testing.
Screenshots

Environment (please complete the following information):

Test framework [e.g. NUnit/MSTest/xUnit]
Browser [e.g. chrome, safari]
Version [e.g. 22]
Power Apps environment version

Additional context
Add any other context about the problem here.

To fix the issue, go to the Azure portal, update or regenerate the client secret for the application registration, and then update the pipeline variables with the new secret.


Can't build the application on iOS

Issue Description
After adding mp_audio_stream as a dependency, it seems to create a compilation conflict with the cloud_firestore plugin, resulting in the following error:
Launching lib/main.dart on iPhone 14 Pro Max in debug mode...
Running pod install... 12.6s
Running Xcode build...
Xcode build done. 20.2s
Failed to build iOS app
Lexical or Preprocessor Issue (Xcode): 'grpc/support/port_platform.h' file not found
/GitHub/test/ios/Pods/gRPC-C++/src/core/lib/gpr/string.h:21:9

Could not build the application for the simulator.
Error launching application on iPhone 14 Pro Max.

Steps to Reproduce
flutter create test
cd test
flutter pub add mp_stream_audio
flutter pub add cloud_firestore
flutter run

Expected Behavior
Build Success
Actual Behavior
Failed to build iOS app
Environment Information

Operating System: macOS
Development Environment: iOS emulator

Additional Information
The following entries appear in the Podfile, and I think this might be the cause of the problem:
BoringSSL-GRPC (0.0.24):
BoringSSL-GRPC/Implementation (= 0.0.24)
BoringSSL-GRPC/Interface (= 0.0.24)
BoringSSL-GRPC/Implementation (0.0.24):
BoringSSL-GRPC/Interface (= 0.0.24)
BoringSSL-GRPC/Interface (0.0.24)

I tried following on Flutter 3.10.6, but it hangs while pod install even without mp_audio_stream. couldn't dig the problem...
$ flutter create test
$ cd test
$ flutter pub add cloud_firestore
$ flutter run

Launching lib/main.dart on iPhone SE (3rd generation) in debug mode...
Running pod install...

I tried following on Flutter 3.10.6, but it hangs while pod install even without mp_audio_stream. couldn't dig the problem...
$ flutter create test
$ cd test
$ flutter pub add cloud_firestore
$ flutter run

Launching lib/main.dart on iPhone SE (3rd generation) in debug mode...
Running pod install...

Pod installing, need a little more waiting 🤣 (probably)

Was this ever solved? I'm having the same sad issue @nobuhiko702


RobotoMono font not loaded when terminal opened first time

To reproduce:

If located in cluster view, choose "Cluster" -> "Disconnect" from the sidebar menu
Open cluster again.
Open terminal tab.

Firstly, this issue occurred within webpack 5 update:

https://github.com/lensapp/lens/pull/4867
https://github.com/lensapp/lens/pull/4725#issuecomment-1040158630

Still happened sometimes on windows.

Probably as some form of race condition

Confirming, bug still exists, first time opening cluster with previously opened terminal tab:


hwloc-libs RPM is no longer provided in the epel repo CentOS 8

openpbs installers failing with missing package hwloc-libs. This is impacting CentOS 8.
work around is do download from alma linux:
- wget -O /tmp/hwloc-libs-1.11.9-3.el8.x86_64.rpm wget https://repo.almalinux.org/almalinux/8.3-beta/BaseOS/x86_64/os/Packages/hwloc-libs-1.11.9-3.el8.x86_64.rpm
- yum install -y /tmp/hwloc-libs-1.11.9-3.el8.x86_64.rpm
- rm -f /tmp/hwloc-libs-1.11.9-3.el8.x86_64.rpm
Can we redistribute in release artifacts?

do you have a strict dependency on hwloc-libs-1.11 ? CentOS 8 includes hwloc-libs-2.2.0-2.el8.x86_64.rpm directly from base, that is why it's no longer in epel http://mirror.centos.org/centos/8-stream/BaseOS/x86_64/os/Packages/hwloc-libs-2.2.0-2.el8.x86_64.rpm

The dependency is in OpenPBS as provided by CycleCloud v8.1 (I don think the fault is present in v8.2). It requires a specific older version of libhwloc, while CentOS 8 provides a newer version. This error is thrown during the initial set up of a cluster freshly created:
Unable to execute command dnf -y install /opt/cycle/jetpack/system/chef/cache/jetpack/downloads/openpbs-server-20.0.1-0.x86_64.rpm (exit code 1)
Software Configuration
Get more help on this issue
Detail:
STDOUT: Last metadata expiration check: 0:05:19 ago on Thu 02 Sep 2021 01:56:31 PM UTC.
(try to add '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages)
STDERR: Error:
Problem: conflicting requests

nothing provides libhwloc.so.5()(64bit) needed by openpbs-server-20.0.1-0.x86_64
EXCEPTION: dnf_package[openpbs-server-20.0.1-0.x86_64.rpm] (pbspro::server line 25) had an error: Mixlib::ShellOut::ShellCommandFailed: Expected process to exit with [0], but received '1'

As an update, libhwloc.so.5()(64bit) might be available from compat-hwloc1 but that doesn't appear to be called in by dnf.


why record can not encode and decode by jsx

I have a record type need to encode and decode, but  I find jsx did not support
demo
(push@demo)1> rd(message1, {expire, num}).
message1
(push@demo)2> jsx:encode(#{a => #message1{expire=1,num=2}}).
** exception error: bad argument
in function  jsx_parser:value/4 (src/jsx_parser.erl, line 129)

there's no reasonable way for jsx to get a record's fields at runtime, so the best possible encoding would probably be just a list of the values. that wouldn't allow decoding to a record though
you can write your own encoder/decoder that supports records though:
-module(recordizer).
-export([encode/1]).
%% custom encoder callback
-export([encode/2]).

-record(message1, {
  expire,
  num
}).

encode(Term) ->
    %% the parser is unmodified but the term passed to the parser instance is
    %% preencoded by the custom `encode/2` function below
    (jsx:parser(jsx_to_json, [], [escaped_strings]))(encode(Term, ?MODULE) ++ [end_json]).

%% this captures any instance that matches the record as a top level term, the value
%% for a map or proplist entry or a member of a list and returns a map to the parser
%% instead. anything else is handled by the default parser in `jsx_encoder`
encode(Message, _EntryPoint) when is_record(Message, message) ->
  [#{expire => Message#message.expire, num => Message#message.num}];
encode(Term, EntryPoint) -> jsx_encoder:encode(Term, EntryPoint).

@lcwxz1989 records only exist during preprocessing, so if you want them to automatically go to/from json with jsx, you will need a parse transform.  I have one at https://github.com/okeuday/record_info_runtime/ which can provide the record field names based on the record name with the function record_info_fields/1.  With that, you can make code automatically go to/from json.
However, the reason to not make it automatic is to have better type checking on the record types.  That approach argues for manually creating the json based on the record fields and not using a parse transform.

Is this an actual issue? Back in 2016, probably, but now with all the map support and so...


Textarea adds blank lines

When I upgrade a project from slim_fast 0.7.0 to 0.9.1, the Slim code
textarea id="code" name="code" = "foo"

that previously on 0.7.0 would output
<textarea id="code" name="code">foo</textarea>

now on 0.9.1 outputs
<textarea id="code" name="code">foo
</textarea>

This leads to extra linebreaks in the received input, that were not intended.

Looking into this myself. Happens with textarea = "foo" but not textarea foo

Failing test:
  test "does not add linebreaks to textarea with '=' output" do
    slim = ~s"""
    textarea = "foo"
    """

    assert render(slim) == ~s(<textarea>foo</textarea>)
  end

Will see if I can figure out how to fix it, too, but I suspect that's trickier.

This change will fix my test but break a bunch of others:
--- a/lib/slim_fast/compiler.ex
+++ b/lib/slim_fast/compiler.ex
@@ -43,7 +43,7 @@ defmodule SlimFast.Compiler do

   defp open(_, %{type: :eex, content: code, attributes: attrs}) do
     inline = if attrs[:inline], do: "=", else: ""
-    "<%#{inline} #{code} %>\n"
+    "<%#{inline} #{code} %>"
   end

Don't want to wrap my head around this now, so I think I'll leave it at that :)

I don't completely understand why those newlines are being added. They're also added e.g. inside <title> which seems weird. So the simplest fix would just be to not add those newlines, but I guess there's some reason for this change?
If the newlines should remain, I did figure out how to skip them for textareas only, though it's not super pretty: https://github.com/henrik/slim_fast/commit/2de86b34cab4e06e45dba01f3eb7d059b7248e43

Hey @henrik!  I haven't had a chance to look into this yet but I suspect this PR is to blame for the newlines.


Update wrong path in documentation

You can update your commit message to: docs: update wrong path in documentation @jecfish


Layout of table-borderless

Table with "table-borderless" class is strange. Unnecessary padding is added.

Thanks for letting us know about the issue. It will be fix very soon.


Handle default value in lambda arguments

Currently, arguments with default values are discarded.
jl2py("(x, y = 2) -> x + y") == "lambda x, /: x + y"

Fixed by https://github.com/lucifer1004/Jl2Py.jl/commit/465752afec3a1d027ea21d0c7abdda44a4c12d0a


Settings Modal: Add a "Reset to Defaults" button

What problem or use case are you trying to solve?
Some users might randomly click around and mess up their settings. We should have an easy way to get back to the original state.
Describe the UX of the solution you'd like
A button in the settings modal that says "Reset to Defaults"
Do you have thoughts on the technical implementation?
Should be pretty easy

Hi, i have created a PR for that feature


Join-AzStorageAccount

Join-AzStorageAccount -Name is not a valid parameter, in the examples it is showing as -name, but this should be --StorageAccountName

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: fba964be-3f77-d80c-f1a5-35bb1430bb8f
Version Independent ID: fe70b11e-10fe-5a8c-1fad-b22a83693503
Content: Enable Active Directory authentication over SMB for Azure Files
Content Source: articles/storage/files/storage-files-active-directory-domain-services-enable.md
Service: storage
GitHub Login: @roygara
Microsoft Alias: rogarana

@drenergy Hope you have self resolved and hence closed this issue. Thanks for the update.


unable to install orbit-db

Hey,
I have been trying to install orbit-db for quite some time now and i keep getting this error repeatedly.
I would be grateful if someone could help.
Im using node -v: v12.2.0
npm -v: 6.9.0
nvm : 0.32.1
Below is the error:
gyp ERR! build error
gyp ERR! stack Error: make failed with exit code: 2
gyp ERR! stack     at ChildProcess.onExit (/home/kushagra/.nvm/versions/node/v12.2.0/lib/node_modules/npm/node_modules/node-gyp/lib/build.js:262:23)
gyp ERR! stack     at ChildProcess.emit (events.js:196:13)
gyp ERR! stack     at Process.ChildProcess._handle.onexit (internal/child_process.js:257:12)
gyp ERR! System Linux 4.15.0-50-generic
gyp ERR! command "/home/kushagra/.nvm/versions/node/v12.2.0/bin/node" "/home/kushagra/.nvm/versions/node/v12.2.0/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild"
gyp ERR! cwd /home/kushagra/yourtube/node_modules/orbit-db-keystore/node_modules/leveldown
gyp ERR! node -v v12.2.0
gyp ERR! node-gyp -v v3.8.0
gyp ERR! not ok
npm WARN<EMAIL_ADDRESS>requires a peer of typescript@* but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of typescript@* but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of typescript@* but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of typescript@* but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>|| >= 3.2.0-dev || >= 3.3.0-dev || >= 3.4.0-dev || >= 3.5.0-dev || >= 3.6.0-dev but none is installed.  Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>install script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.
npm ERR!


Software caused connection abort

`
2018-11-15 $$$,client.go:390, LOG ,Global - bing.com:443
2018-11-15 $$$,io.go:83, ERROR ,"Bridge: read <IP_ADDRESS>:17857, Software caused connection abort"
...
2018-11-15 $$$,client.go:486, ERROR ,SOCKS5 version error: 4
`
cmd:goflyway.exe -up="cf://$$$:80" -k="$$$" -l=":8100" -web-port="8101" -lv=dbg -g -U=http
plat: win10 x64
Rev:fa7eda0
Thanks for any clue about this problem.

This error normally doesn't matter

Thanks. this error Indeed doesn't matter and wait some minutes before seeing the real error log.
(BTW: the real problem is about dns. local dns give fake ipv6 addr so that can't connect. (don't know why DNScrypt didn't work)
disable system ipv6 module and solved :(
Thanks again and maybe one day the dns problem will be solved gracefully.)


feat: support PLpgSQL module extraction

On Mon, Jul 30, 2018 at 8:20 AM, Anatoly Stansler<EMAIL_ADDRESS>wrote:

@anatolystansler requested changes on this pull request.
This PR has the same issue as #312
https://github.com/sourcerer-io/sourcerer-app/pull/312. Import
detection without classifiers will affect the performance of the app, but
will not add any statistics for users.
Also, an addition of PLpgSQL modules will not solve the problem of
displaying a diversity of dialects of SQL in the profile.

It is the chicken egg problem. It won't take long to add some libraries,
will will improve statistics a bit of PLpgSQL users.

Wonder maybe we should use ExtractorInterface for presented Extractors?

could you explain this more please?

—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/sourcerer-io/sourcerer-app/pull/323#pullrequestreview-141507171,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABdnqfDOo2QhnCWE44DsBtwoTbRosJCmks5uLvoUgaJpZM4VlpUa
.


fix(core-js-sdk): allow path in baseurl

this will allow using a base url with a path in it for use cases where descopers want to use a rewrite url to proxy to descope instead of a custom domain

code looks good
any idea what this is? perhapse Nir will know

@asafshen @nirgur ready


Quickbooks desktop won't run

QB Desktop refuses to run at all after qbactivator runs
To Reproduce
Steps to reproduce the behavior:
tried using qbactivator 0.20.2 to the current version
installed qb desktop as usual
after install, ran qbactivator; but QB wont open to activate
exe executes than goes away quickly
Expected behavior
QB shold be open to paste activation code
Desktop (please complete the following information):

Windows edition: Windows 10 (latest)
Version 22H2]
QuickBooks Desktop 2021 & 2022

Waiting for your comment on this.
Thank you Sir.

Currently support for activating QuickBooks Desktop products (Pro, Enterprise, etc) with qbactivator is paused (as of v0.21.0), as a result of the ongoing issues with their activation just like this. This will be fixed in a later release.

Currently support for activating QuickBooks Desktop products (Pro, Enterprise, etc) with qbactivator is paused (as of v0.21.0), as a result of the ongoing issues with their activation just like this. This will be fixed in a later release.

Thank you sir, Waiting for the new release. Love


add label and agents config to command step

Triggers

add label support to command step
add agents: {"queue": "XY"} support to command step
wrap label in quotes to support leading emojis, like `label: ":pipeline: Trigger my pipeline"

Docs

make explicit that wait is set to true by default

Fixes #32

@chronotc PTAL :)

Thanks for that @worxli 👍

@all-contributors please add @worxli for code and test


⚠ Processors has degraded performance

In 7be1fcc, Processors ($STATUS_URL) experienced degraded performance:

HTTP code: 200
Response time: 140 ms

Resolved: Processors performance has improved in e691a2c.


Fixing liberty health check

Hi @davemulley it looks like you need to fix the conflict first

@csantanapr okay, I've fixed that, can you merge please?


ci: remove unnecessary semantic-release tool from dev environment

This PR closes #62 but I wanted to discuss some more. Specifying
https://github.com/jenstroeger/python-package-template/blob/de5c51b08c6bd97880cc24594a928e19c5932ecb/.github/workflows/check-and-release-main.yml#L44
doesn’t actually pin a version and instead every run of this Action uses whatever changes are at the head of the master branch. That, I think, violates some of the SLSA build requirements like “Reproducible”.
📌 it?

pushpin it?

Yes please. I think all the Actions dependencies should be pinned for reproducibility.

Yes please. I think all the Actions dependencies should be pinned for reproducibility.

Commit https://github.com/jenstroeger/python-package-template/pull/64/commits/d93db78b042bd38430880a156a346d8d0023e194.


GPL-301 As a development team (esp Philip, Neil & Tom) we would like to send an aliquot plate creation event from SS to remove dependency on 5ul stamp event from asset audits as experience had demonstrated this is a fragile reporting  action for UK biobank reporting

User story
GPL-301 As a development team (esp Philip, Neil & Tom) we would like to send an aliquot plate creation event from SS to remove dependency on 5ul stamp event from asset audits as experience had demonstrated this is a fragile reporting  action for UK biobank reporting
Who the primary contacts are for this story
Rich Livett<EMAIL_ADDRESS>Philip Jansen Van Vuuren<EMAIL_ADDRESS>Neil Sycamore<EMAIL_ADDRESS>Eduardo Martin Rojo<EMAIL_ADDRESS>Emma Gray<EMAIL_ADDRESS>Acceptance criteria

Raise event for all aliquot plate creation events
One event / plate
Event to include;
source plate barcode (Thomas Whiteley<EMAIL_ADDRESS>Wednesday, 12 February 2020 at 17:30)
plate barcode,
plate creation time
supplier sample id
study id (required to ensure join is not slow)
No change to asset audits functionality and call to SS API*1

Dependency
·         Remove any report base table coupling between SS and UKB report*2
Additional context
Current event is fragile because
Operations can work if asset audits is unavailable, however cant process plates without plate barcode from SS. This makes using ‘aliquot plate creation’ more reliable.
Operation don’t always record this (Event is not lost is simply never created)
Operations don’t always know it’s a UK Biobank event and can record stamp as a ‘slf working dilution’ which is valid for lab but not for UK biobank report.
‘Missing’ 5ul stamp RTS cause a notable amount or rework

Just to clarify the source plate barcode above IS the stock plate barcode.


HDFS-16844: Adds resilancy when StateStore gets exceptions.

Addresses 'Cannot locate a registered namenode for XXX' errors.
It was tested in our RBF cluster and dramatically improved stability when using the HDFS state store.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
1m 44s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
42m 46s

trunk passed

+1 :green_heart:
compile
1m 18s

trunk passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
compile
0m 46s

trunk passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07

+1 :green_heart:
checkstyle
0m 41s

trunk passed

+1 :green_heart:
mvnsite
0m 54s

trunk passed

+1 :green_heart:
javadoc
1m  0s

trunk passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javadoc
1m  4s

trunk passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07

+1 :green_heart:
spotbugs
1m 45s

trunk passed

+1 :green_heart:
shadedclient
24m 47s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 40s

the patch passed

+1 :green_heart:
compile
0m 44s

the patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04

-1 :x:
javac
0m 44s
/results-compile-javac-hadoop-hdfs-project_hadoop-hdfs-rbf-jdkUbuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04.txt
hadoop-hdfs-project_hadoop-hdfs-rbf-jdkUbuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 generated 1 new + 55 unchanged - 0 fixed = 56 total (was 55)

+1 :green_heart:
compile
0m 37s

the patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07

-1 :x:
javac
0m 37s
/results-compile-javac-hadoop-hdfs-project_hadoop-hdfs-rbf-jdkPrivateBuild-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07.txt
hadoop-hdfs-project_hadoop-hdfs-rbf-jdkPrivateBuild-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 generated 1 new + 55 unchanged - 0 fixed = 56 total (was 55)

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
0m 23s
/results-checkstyle-hadoop-hdfs-project_hadoop-hdfs-rbf.txt
hadoop-hdfs-project/hadoop-hdfs-rbf: The patch generated 4 new + 2 unchanged - 0 fixed = 6 total (was 2)

+1 :green_heart:
mvnsite
0m 38s

the patch passed

+1 :green_heart:
javadoc
0m 38s

the patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javadoc
0m 55s

the patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07

+1 :green_heart:
spotbugs
1m 29s

the patch passed

+1 :green_heart:
shadedclient
24m 30s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
49m  1s

hadoop-hdfs-rbf in the patch passed.

+1 :green_heart:
asflicense
0m 44s

The patch does not generate ASF License warnings.

159m  3s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5138/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5138

JIRA Issue
HDFS-16844

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets

uname
Linux a70ed563796b 4.15.0-191-generic #202-Ubuntu SMP Thu Aug 4 01:49:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / b5f5ff939d758dc69a3ca1df31ef5a03eb054aa9

Default Java
Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5138/1/testReport/

Max. process+thread count
2621 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs-rbf U: hadoop-hdfs-project/hadoop-hdfs-rbf

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5138/1/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 56s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 2 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
42m 31s

trunk passed

+1 :green_heart:
compile
0m 51s

trunk passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
compile
0m 45s

trunk passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07

+1 :green_heart:
checkstyle
0m 39s

trunk passed

+1 :green_heart:
mvnsite
0m 51s

trunk passed

+1 :green_heart:
javadoc
0m 56s

trunk passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javadoc
1m  3s

trunk passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07

+1 :green_heart:
spotbugs
1m 37s

trunk passed

+1 :green_heart:
shadedclient
24m 11s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 36s

the patch passed

+1 :green_heart:
compile
0m 41s

the patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04

-1 :x:
javac
0m 41s
/results-compile-javac-hadoop-hdfs-project_hadoop-hdfs-rbf-jdkUbuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04.txt
hadoop-hdfs-project_hadoop-hdfs-rbf-jdkUbuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 generated 1 new + 55 unchanged - 0 fixed = 56 total (was 55)

+1 :green_heart:
compile
0m 35s

the patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07

-1 :x:
javac
0m 35s
/results-compile-javac-hadoop-hdfs-project_hadoop-hdfs-rbf-jdkPrivateBuild-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07.txt
hadoop-hdfs-project_hadoop-hdfs-rbf-jdkPrivateBuild-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 generated 1 new + 55 unchanged - 0 fixed = 56 total (was 55)

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
0m 21s
/results-checkstyle-hadoop-hdfs-project_hadoop-hdfs-rbf.txt
hadoop-hdfs-project/hadoop-hdfs-rbf: The patch generated 4 new + 2 unchanged - 0 fixed = 6 total (was 2)

+1 :green_heart:
mvnsite
0m 37s

the patch passed

+1 :green_heart:
javadoc
0m 38s

the patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javadoc
0m 53s

the patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07

+1 :green_heart:
spotbugs
1m 25s

the patch passed

+1 :green_heart:
shadedclient
23m 36s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
40m 34s
/patch-unit-hadoop-hdfs-project_hadoop-hdfs-rbf.txt
hadoop-hdfs-rbf in the patch passed.

+1 :green_heart:
asflicense
0m 42s

The patch does not generate ASF License warnings.

146m 35s

Reason
Tests

Failed junit tests
hadoop.hdfs.rbfbalance.TestRouterDistCpProcedure

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5138/2/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5138

JIRA Issue
HDFS-16844

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets

uname
Linux 8d7c39649b50 4.15.0-191-generic #202-Ubuntu SMP Thu Aug 4 01:49:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 8f7442a185dc3fd11b234afe454c3b10f63e17c5

Default Java
Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5138/2/testReport/

Max. process+thread count
2321 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs-rbf U: hadoop-hdfs-project/hadoop-hdfs-rbf

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5138/2/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 54s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 2 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
42m 29s

trunk passed

+1 :green_heart:
compile
0m 49s

trunk passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
compile
0m 45s

trunk passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07

+1 :green_heart:
checkstyle
0m 39s

trunk passed

+1 :green_heart:
mvnsite
0m 51s

trunk passed

+1 :green_heart:
javadoc
0m 56s

trunk passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javadoc
1m  2s

trunk passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07

+1 :green_heart:
spotbugs
1m 37s

trunk passed

+1 :green_heart:
shadedclient
24m  4s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 37s

the patch passed

+1 :green_heart:
compile
0m 41s

the patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javac
0m 41s

the patch passed

+1 :green_heart:
compile
0m 36s

the patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07

+1 :green_heart:
javac
0m 36s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
0m 22s
/results-checkstyle-hadoop-hdfs-project_hadoop-hdfs-rbf.txt
hadoop-hdfs-project/hadoop-hdfs-rbf: The patch generated 2 new + 2 unchanged - 0 fixed = 4 total (was 2)

+1 :green_heart:
mvnsite
0m 37s

the patch passed

+1 :green_heart:
javadoc
0m 37s

the patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javadoc
0m 52s

the patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07

+1 :green_heart:
spotbugs
1m 26s

the patch passed

+1 :green_heart:
shadedclient
23m 38s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
40m 16s

hadoop-hdfs-rbf in the patch passed.

+1 :green_heart:
asflicense
0m 41s

The patch does not generate ASF License warnings.

146m 24s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5138/3/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5138

JIRA Issue
HDFS-16844

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets

uname
Linux 8046125e6de9 4.15.0-191-generic #202-Ubuntu SMP Thu Aug 4 01:49:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / e6d7285187dd26f06ac866f9e7f7fdcc2117216f

Default Java
Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5138/3/testReport/

Max. process+thread count
2324 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs-rbf U: hadoop-hdfs-project/hadoop-hdfs-rbf

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5138/3/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.


Feat/ 637 Enable selecting your preferred language from the GameMenu

#637

Please check the following

[x] Do the tests still pass? (see Run the Tests)
[x] Is the code formatted properly? (see Linting (Formatting))
For New Features:

[ ] Have tests been added to cover any new features or fixes?
[ ] Has the documentation been updated accordingly?

Please describe additional details for testing this change

This is great! Can you share a screenshot of what it looks like when the language choice menu is open?


Scrollbar showing despite no Overflow

Description
There is this inactive scroll bar showing in the Tabs-list even when there is no overflow:

Same in Settings:

And in Home tab:

Steps To Reproduce

Create a few tabs in the new tabs list
Open the Settings dialogue (it comes in after a fracture of a second)

Expected behavior
Remove the scrollbar when there is no overflow (like in the files-section when there are just a few files)

Files Version
Version: <IP_ADDRESS> OS Version: 10.0.19043.1110
Windows Version
Win10 21H1

This can be adjusted from the Windows settings app.


The rain value does not reset

The rain value does not reset
I have the Bresser 7003600.
My problem is:
Rainfall is not reset.
it seems that the internal clock in the weatherSensorReceiver is not running.
{"id":43567,"ch":0,"battery_ok":1,"temp_c":20.7,"humidity":43,"wind_gust":2.3,"wind_avg":2.1,"wind_dir":258.0,"uv":2.1,"light_klx":33.7,"rain":99.6,"rain_d":2.0,"rain_w":2.0,"rain_m":2.0}
the rain values: "rain_d", "rain_w" , "rain_m" are all the same and get bigger when it rains.
I use:
BresserWeatherSensorMQTTWifiMgr.ino
Arduino Version: 2.1.0
ESP8266 Wemos D1 mini
CC1101
this project is the reason why i bought the Bresser
thank you very much for the great project
Dirk

Hi Dirk,
If I remember correctly, the ESP8266 does not have a built-in RTC (as the ESP32 has). Thus, the time and date has to be provided via Network Time Protocol (NTP). Could you please check the debug output to see if the time is set correctly?
Best regards
Matthias

The reason why an ESP8266 cannot provide the rain statistics if sleep mode is used, is that in the current implementation, previous rain values are stored in RTC RAM, which is only available in the ESP32.
This could be fixed by storing the values in the flash file system.

Not enough information to debug/resolve.


Axios array is not recognized as an array in NodeJs at NSwag.CodeGeneration.TypeScript + possible fix

WebAPI returns JSON array, content-type header is "application/json; charset=utf-8".
Autogenerated by NSwag code (TypeScriptClient for Axios) runs twice - with server side rendering (SSR) by NodeJS and in a browser:
 if (status === 200) {

  const _responseText = response.data;

  let result200: any = null;
  let resultData200  = _responseText;

  if (resultData200 && resultData200.constructor === Array) {

    result200 = [] as any;

    for (let item of resultData200)
      result200!.push(item);
  }

  return result200;
}

So resultData200.constructor === Array without any changes become false at NodeJs and true in a browser.
In both cases response.data looks like ['value1', 'value2'], status code 200.
babel.config.js:
module.exports = {
  presets: [[ '@vue/app', { useBuiltIns: false } ]]
  plugins: [
    '@babel/plugin-syntax-dynamic-import'
  ]
}

Anyway,
  var arr = [ 'a', 'b' ];
  console.log(`Check this: ${arr.constructor === Array}`);

is true in NodeJs and in a browser. So, what's going on?
Best answer can help: there are a few scenarios where it can return a different value, but Array.isArray will work.
Root of evil is deep inside of TS-generator - in a DataConversionGenerator.
Anyway, when I replaced the resultData200.constructor === Array to Array.isArray(resultData200), it was started to work!

Please check the PR.

Please check the PR.
Ok, it solves the problem. So, it was in liquid templates.

For now, you can just override the template with a local one until the fix is merged + released.

So can we merge this PR? Is it safe?

I still don't have enough experience to answer «yes, it is safe for all cases». I've override templates and now this PR works for me - both at server and client.

Too late 🙂 but to me it looks safe (ES 5)


[HELP]  The output of bs_seeker2-call_methylation.py

Hello;
I have tested the BSseeker2 for my data, and run the  Bismark and BSMAP for the  same data.
The parameters of BSMAP and Bismark was default.  The align step of BSseeker is default, and  the parameters of  mC calling step is bs_seeker2-call_methylation.py  -i sort.dedup.bam  -o  test  --db  bsseeker2/wgbs/tair10.fa_bowtie2/ --rm-overlap.
And the total cytosine that detedted is 6,547,483 for BSbseeker2, 42,486,818 for Bismark and 41,535,940 for BSMAP.
The mapping ratio is 80.25% for bismark, 72.10% for BSMAP and  76.74% for BSseeker2.  I did not notice any error in alignment step and deduplication step.
So the cytosine number of BSseeker is so low.  How can I handle this issue.
Thank you !

I hava had checked the CGmap file, and all the chromosomes were correctly covered. The results showed that the least number of reads covering one site is 1x.
And I do not find parameters that who can adjust the coverage threshold, expect for --read-no for wig output.
Also, I remove the --rm-overlap, and the output of the cytosine number covered by 1x is 6,465,486, not increase.
Thank you.

It's wired. Did you observe significant difference in the read counts in bam files those were used for call-methylation step by the three aligners?
Weilong
At 2022-04-13 09:31:44, "Grace Bisulfite" @.***> wrote:
I hava had checked the CGmap file, and all the chromosomes were correctly covered. The results showed that the least number of reads covering one site is 1x.
And I do not find parameters that who can adjust the coverage threshold, expect for --read-no for wig output.
Also, I remove the --rm-overlap, and the output of the cytosine number covered by 1x is 6,465,486, not increase.
Thank you.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you commented.Message ID: @.***>


Building a lognormal and PM model into a Bayesian pipeline

Building a lognormal and PM model into a Bayesian pipeline
This sprint is to adapt a lognormal and a PM model to our Gaussian pipeline for field-level modelling.
Contacts: Natalia Porqueres, Francois Lanusse
Day/Time: Monday - Friday
Main communication channel: #desc-sprint-bayesian-pipeline  (#desc-bayesian-pipelines-tt secondary)
GitHub repo: https://github.com/LSSTDESC/bayesian-pipelines-cosmology/blob/main/notebooks/forward_model/glass_jax_jitted.ipynb
Zoom room (if applicable): https://stanford.zoom.us/j/99269396161?pwd=ekxIblNMTEFVbXk0Y09DVlovdG5vQT09
Format: Hybrid
Goals and deliverable
Building a lognormal field from the current Gaussian field generator
Connecting a PM simulator to the pipeline
Resources and skills needed
Familiarity with Python and JAX.

Here is our action plan for the week
Improving GLASS-JAX

[ ] Adding shear operators @nataliaporqueres (Tuesday)
[ ] Adding lognormal transform
[ ] Adding lognormal shift parameter emulator

Sampling cosmology and initial conditions

[ ] Work out the issues with jitting all of jax-glass (Tuesday)
[ ] Demonstrate sampling of gaussian convergence maps

Interfacing PM n-body density field

[ ] Write an interface to extract density shells from pmwd or jaxpm
[ ] Demonstrate end-to-end forward model and tune parameters for precision
[ ] Demonstrate sampling of the entire model

setting up GPU and the correct GPU python kernel on nersc with dependencies for this project. (should work out of the box!)
# get on a GPU node first!
# https://docs.nersc.gov/development/languages/python/using-python-perlmutter/
module load cudatoolkit/11.7
module load cudnn/8.9.1_cuda11
module load python
# Verify the versions of cudatoolkit and cudnn are compatible with JAX
module list
# Create a new conda environment
conda create -n jglass python=3.9 pip numpy scipy
# Activate the environment before using pip to install JAX
conda activate jgass
# Install a compatible wheel
pip install --no-cache-dir "jax[cuda11_cudnn82]==0.4.7" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html

# try if jax works on GPU
python
import jax.numpy as jnp
import jax
# should be no error if everything worked
jnp.ones(10)
# should print gpus
jax.devices()
exit()

# other dependencies

# glass
git clone https://github.com/glass-dev/glass.git
cd glass
pip install -e .
cd ..

# glass-jax
git clone https://github.com/LSSTDESC/glass-jax.git
cd glass-jax
pip install -e .
cd ..

# pmwd
git clone https://github.com/eelregit/pmwd.git
cd pmwd
pip install -e .
cd ..

# s2fft
git clone https://github.com/astro-informatics/s2fft.git
cd s2fft
pip install -e .
cd ..

# other stuff
conda install -c conda-forge healpy h5py astropy matplotlib
pip install jupyterlab
pip install jax-cosmo
pip install typing-extensions

# setting up the kernel for jupyterhub
# https://docs.nersc.gov/services/jupyter/how-to-guides/
# conda activate jglass
python -m ipykernel install \
    --user --name jglass --display-name jglass```

Hello,
I've just tried and get
(nersc-python) login18:c/campagne/Work$ conda create -n jglass python=3.9 pip numpy scipy
Collecting package metadata (current_repodata.json): failed

# >>>>>>>>>>>>>>>>>>>>>> ERROR REPORT <<<<<<<<<<<<<<<<<<<<<<

    Traceback (most recent call last):
      File "/global/common/software/nersc/pe/conda/23.9.0/Miniconda3-py311_23.5.2-0/lib/python3.11/site-packages/conda/exception_handler.py", line 17, in __call__
        return func(*args, **kwargs)
               ^^^^^^^^^^^^^^^^^^^^^
....

may I have missed something?

Hello, I've just tried and get
(nersc-python) login18:c/campagne/Work$ conda create -n jglass python=3.9 pip numpy scipy
Collecting package metadata (current_repodata.json): failed

# >>>>>>>>>>>>>>>>>>>>>> ERROR REPORT <<<<<<<<<<<<<<<<<<<<<<

    Traceback (most recent call last):
      File "/global/common/software/nersc/pe/conda/23.9.0/Miniconda3-py311_23.5.2-0/lib/python3.11/site-packages/conda/exception_handler.py", line 17, in __call__
        return func(*args, **kwargs)
               ^^^^^^^^^^^^^^^^^^^^^
....

may I have missed something?

Hi,
Could you try starting fresh and use the following lines:
conda create -n jglass python pip numpy scipy
conda activate jgass
module load gpu
module load evp-patch
conda install -y jaxlib=*=*cuda* jax cuda-nvcc -c conda-forge -c nvidia
conda install -c conda-forge numpyro

and then install the "other dependencies." This should get you ready with a more up-to-date version of jax and numpyro as well.

Hello @AZhou00
Thanks for the tip. In fact I'm pretty sure that the origin of the crash was due to disk quota exceed :(,  as when I tried the above workflow I get the nasty "OSError: [Errno 122] Disk quota exceeded" immersed  among a flow of error reports. After cleaning a little I was able to start the installation process :)
Now, as I am not familiar with NERSC running, I certainly not did an install in the right place. May I ask you where you install such environment, and where to do you run (ie. jupyter notebook @ nersc). I know that these questions are quite basic, so I hope you don't mind too much. Thanks.

I have in a jupyter in Google Colab but I do not manage to import glass-jax after
! git clone https://github.com/LSSTDESC/glass-jax.git

and the pip install -e .
The glass-jax module is not recognized neither glass_jax...
Have you an idea?
I have a short use-case to test.

For future reference, use the following setup commands to install the required glass-jax environment with gpu on NERSC 😀
# get on a GPU node first!
module load gpu
module load evp-patch

# Create a new conda environment
conda create -n glass python pip numpy scipy
conda activate glass
conda install -y jaxlib=*=*cuda* jax cuda-nvcc -c conda-forge -c nvidia
conda install -c conda-forge numpyro

# -------- then follow the code below --------
# try if jax works on GPU
python
import jax.numpy as jnp
import jax
import numpyro
# should be no error if everything worked
jnp.ones(10)
jnp.fft.fft(jnp.array([1.0,2.0,3.0,4.0,5.0]))
# should print gpus
jax.devices()
exit()

# other dependencies
# other stuff
conda install -c conda-forge healpy h5py astropy matplotlib pyccl

pip install jupyterlab
pip install jax-cosmo
pip install typing-extensions

# s2fft
git clone https://github.com/astro-informatics/s2fft.git
cd s2fft
pip install -e .
cd ..

# glass
git clone https://github.com/glass-dev/glass.git
cd glass
pip install -e .
cd ..

# glass-jax
git clone https://github.com/LSSTDESC/glass-jax.git
cd glass-jax
pip install -e .
cd ..

# pmwd
git clone https://github.com/eelregit/pmwd.git
cd pmwd
pip install -e .
cd ..

# setting up the kernel for jupyterhub
# https://docs.nersc.gov/services/jupyter/how-to-guides/
# conda activate jglass
python -m ipykernel install \
    --user --name glass --display-name glass


Make it so the imbued heart timer shows even while in combat

Sometimes when using the imbued heart special while in combat the timer won't show even if you activated it. It would be really nice if the timer displayed when activating the imbued heart and the message displaying if the heart's spec isn't available doesn't show in the chatbox, instead of relying on the spec animation of it.

The animation (which may not appear while in combat) is the only way we're able to definitively know that an imbued heart has been used, so unfortunately there isn't a good way to fix this.

Duplicate of #3516


Missing Runtime Permissions for Android Version 6.0

On Android M devices, permissions need to be asked at runtime.
Moreover, I add a  small cleanup on BaseActivity and LocativeApplication.

@robertbaptiste awesome, thank you! I wonder why Travis is failing to build though, we've got another PR open which also fails so I'm not sure what the exact reason is, would you mind taking a look into this? Apart from that great work and really appreciate to get this merged asap.

Hi @kimar,
Thanks !
The issue is because I updated the gradle version to gradle-2.1.0-beta1. Travis didn't manage to get it, I will try to fix it.

Bingo !
The build was failing for 2 reasons:

I was trying to use an experimental version of gradle which is not published in the repo used by Travis: https://repo1.maven.org/maven2/com/android/tools/build/gradle/
You have 105 lint issues. To avoid a failed build I was forced to add:

lintOptions {
abortOnError false
}
to build.gradle. This is not really a good thing :/ and all these lint issues must be handle in another ticket. Do you want an issue for that ?

Awesome! @robertbaptiste yeah please raise an issue for this! Thanks for contributing, going to merge this now!

@kimar Done: https://github.com/LocativeHQ/android-app/issues/43


⚠ Bofrost.de has degraded performance

In d8552d1, Bofrost.de (https://www.bofrost.de) experienced degraded performance:

HTTP code: 200
Response time: 810 ms

Resolved: Bofrost.de performance has improved in e4b176e after 59 minutes.


feat: value mapping changes for yamls

Object having little confusion for rest values:

disk -> outage- > reason
node -> healthy : no rest field found
diagnosis-subsystem-config-get-iter -> health : no rest call found
diagnosis-status-get -> status: no rest call found

once you are done, can you also update the documentation of the plugin in cmd/poller/plugin#value_mapping?

made the changes in https://github.com/NetApp/harvest/pull/319
@vgratian , yes I have covered the doc part as well in the above PR.


Backported patches for 2.0.1

These are the candidate patches for the release-2.0.z branch to release 2.0.1.
@enoodle @pweil- make sure we're not missing something and we're not introducing regressions. Thanks.

All of my commit that are necessary are here. I am still testing to see that all the bug are not reproducing in any way


feat(workspace): Workspace data source returns workspaces

Pull Request
🤨 Rationale
https://dev.azure.com/ni/DevCentral/_workitems/edit/2527388
👩💻 Implementation
Implement runQuery and related functionality.
🧪 Testing

Manually validated functionality
Added new auto tests

✅ Checklist

[X] This PR has a title that follows the commit message format.

:tada: This PR is included in version 3.4.0 :tada:
The release is available on:

v3.4.0
GitHub release

Your semantic-release bot :package::rocket:


Clarify "Access control by the state-enable CSRs"

Hi~, when reading about the feature in the spec, I am kind of confused. Could you please clarify the specification for the following feature(in chapter 2.5)：
Can bit 59 in stateen for riscv64 control access to states of mip/mie?
thanks.

@wissygh:  No bits in mstateen0 are supposed to affect accesses to M-level CSRs such as mip and mie.  Hence, I don't understand the question:

Can bit 59 in stateen for riscv64 control access to states of mip/mie?

The answer would seem to obviously be "No".

@wissygh: No bits in mstateen0 are supposed to affect accesses to M-level CSRs such as mip and mie. Hence, I don't understand the question:

Can bit 59 in stateen for riscv64 control access to states of mip/mie?

The answer would seem to obviously be "No".

Sorry, I made a typo. It should be "sip/sie". It only mentions "sieh/siph" here.


1.22 - DRIVER_FLAG macros

Haven't tried in Windows but with gendev:
src/xgm.c: In function ‘XGM_getManualSync’:
src/xgm.c:445:26: error: ‘DRIVER_FLAG_MANUALSYNC_XGM’ undeclared (first use in this function)
     return driverFlags & DRIVER_FLAG_MANUALSYNC_XGM;
                          ^
src/xgm.c:445:26: note: each undeclared identifier is reported only once for each function it appears in
src/xgm.c: In function ‘XGM_setManualSync’:
src/xgm.c:456:24: error: ‘DRIVER_FLAG_MANUALSYNC_XGM’ undeclared (first use in this function)
         driverFlags |= DRIVER_FLAG_MANUALSYNC_XGM;
                        ^
src/xgm.c: In function ‘XGM_getForceDelayDMA’:
src/xgm.c:470:26: error: ‘DRIVER_FLAG_DELAYDMA_XGM’ undeclared (first use in this function)
     return driverFlags & DRIVER_FLAG_DELAYDMA_XGM;
                          ^
src/xgm.c: In function ‘XGM_setForceDelayDMA’:
src/xgm.c:480:24: error: ‘DRIVER_FLAG_DELAYDMA_XGM’ undeclared (first use in this function)
         driverFlags |= DRIVER_FLAG_DELAYDMA_XGM;
                        ^

Whole thing: https://ghostbin.com/paste/a4uq5
I would start comparing Makefiles and stuff but I don't see the flags defined.
https://github.com/Stephane-D/SGDK/search?utf8=✓&q=DRIVER_FLAG_MANUALSYNC_XGM
Also unrelated but xgmtool had some lines that were probably meant to be commented. https://github.com/andwn/SGDK/commit/7c4811c9e9f5d41c96efc0d6bb4d5db084b57c8b

Thanks for the report ! In fact i accidentally broken it just before doing the 1.22 release, i just fixed it !
You can redownload it :)


Rewrite facade rendering

Description
This rewrites facade rendering to always use the additional chunk buffering system. Additionally, bugs have been fixed with shaders and mods, and the block breaking overlay now correctly shows when breaking a facade.
Checklist

[X] My code follows the style guidelines of this project (.editorconfig, most IDEs will use this for you).
[X] I have made corresponding changes to the documentation.
[X] My changes are ready for review from a contributor.

This could be improved quite a bit if there was a map of chunks that had facades; but adding that right now seems potentially out of scope.

I've added a chunk map, fixing the above issue. It will check if the chunk has any facades, skipping the expensive lookup step.


add remaining projects in json file

Issue Type:

[ ] Bug Report
[x] Feature Request
[ ] Documentaion

Describe the bug

A clear and concise description of what the bug is.

Possible solution

Describe the solution you thought of.

Screenshots

If applicable, add screenshots to help explain your problem.

can i work @arpit456jain

@Atif0604 go ahead and don't forget to add screenshots in respective folder if its not present name it as preview.png


Option to create recognizers in YAML

Change Description
Added methods to the RecognizerRegistry which allow recognizers to be loaded from a dict and a yaml file. Docs to follow this PR.
Issue reference
This PR fixes issue #XX
Checklist

[X] I have reviewed the contribution guidelines
[X] I have signed the CLA
[X] My code includes unit tests
[X] All unit tests and lint checks pass locally
[ ] My PR contains documentation updates / additions if required

@ontocord and @paulovn added the option of loading recognizers via YAML

@shiranr thanks for your feedback! I agree that having the same example file in 10 different places isn't probably the perfect solution 😊. Let me see if I can create some references and I'll update the PR.

/azp run


CLI unresponsive

The CLI is incredibly unresponsive, what's up with that?
This isn't an urgent issue obviously, but it is a bit unappealing.
It takes nearly 3 seconds for embark to print out it's -h option to stdout.
Are others having this issue?
Is this an issue with commander.js?
λ /usr/bin/time -v embark -h

        Command being timed: "embark -h"
        User time (seconds): 2.69
        System time (seconds): 0.06
        Percent of CPU this job got: 101%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 0:02.71
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 205476
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 0
        Minor (reclaiming a frame) page faults: 50376
        Voluntary context switches: 152
        Involuntary context switches: 4
        Swaps: 0
        File system inputs: 0
        File system outputs: 0
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

Yes, we're aware of this and there is a restructuring ongoing to address this. I'll keep this issue open until this is improved.

Okay, the issue is that the entire project is initialized before ever running the cmd.js. This means every module required by the project has to be synchronously loaded before anything can be done.
Instead of requiring every module at the top of the index.js I'd recommend loading modules ad-hoc for each subcommand.

Is there something/somewhere I read read up on the restructuring effort?

@toadkicker nothing written currently but I'd be happy to chat about it on gitter

@nathanph What version of Embark are you using? I can confirm the 2-3 seconds on 2.3.0, but it's instantaneous in 2.4.0

Hmmm, I may have been using 2.3.0, but I've reinstalled embark since then and it does seem responsive now.
I'll go ahead close this. Thanks! :heart:


Fix add dba ag database seeding mode

Type of Change

[x] Bug fix (non-breaking change, fixes #5702 )
[ ] New feature (non-breaking change, adds functionality)
[ ] Breaking change (effects multiple commands or functionality)
[ ] Ran manual Pester test and has passed (`.\tests\manual.pester.ps1)
[ ] Adding code coverage to existing functionality
[ ] Pester test is included
[ ] If new file reference added for test, has is been added to github.com/sqlcollaborative/appveyor-lab ?
[ ] Nunit test is included
[ ] Documentation
[ ] Build system

Purpose
To prevent an error message when attempting to use -SeedingMode Automatic on SQL 2014
Approach
Added a check to the VersionMajor property - if it's less than or equal to 12 we warn the user that Automatic seeding isn't available.
We then perform a second check: If the user hasn't chosen to use -UseLastBackup and they haven't provided $SharedPath, we break out of the loop for that server. We don't want to completely stop the execution though so I have used break rather than Stop-Function without -Continue
Commands to test
Add-DbaAgDatabase on SQL 2014 using both -SeedingMode Manual and -SeedingMode Automatic, providing -SharedPath and not.

thanks much, george. all tests pass! but i dont think we test this command specifically 😅  do you have a screenshot of it working?

hey george, i found some unrelated bugs when testing this PR, so im gonna piggy back and add fixes 👍

oh wait, we do have a test for it 💯  added some updates

merci!


feat request: add alias on query fields

Add the capability to set an aliases for fields in sql-mapper find method

what's an alias in this case?

Add the capability to set an aliases for fields in sql-mapper find method

I think that would be great!


Refresh generated proto classes

Codecov Report

Merging #115 into master will not change coverage.
The diff coverage is 66.66%.

@@           Coverage Diff           @@
##           master     #115   +/-   ##
=======================================
  Coverage   90.08%   90.08%
=======================================
  Files          32       32
  Lines        2238     2238
=======================================
  Hits         2016     2016
  Misses        222      222

Impacted Files
Coverage Δ

src/LongRunning/Gapic/OperationsGapicClient.php
81.09% <66.66%> (ø)
:arrow_up:

src/OperationResponse.php
100% <0%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 56b9fa9...a17d965. Read the comment docs.


Filter user-provided ciphers using RFC cipher names

Motivation:
Previously filterCipherSuites was being passed the OpenSSL-formatted
cipher names. Commit 43ae974 introduced a regression as it swapped to the
RFC/JDK format, except that user-provided ciphers were not converted and
remained in the OpenSSL format.
This mis-match would cause all user-provided to be thrown away, leading
to failure trying to set zero ciphers:
Exception in thread "main" javax.net.ssl.SSLException: failed to set cipher suite: []
	at io.netty.handler.ssl.ReferenceCountedOpenSslContext.<init>(ReferenceCountedOpenSslContext.java:299)
	at io.netty.handler.ssl.OpenSslContext.<init>(OpenSslContext.java:43)
	at io.netty.handler.ssl.OpenSslServerContext.<init>(OpenSslServerContext.java:347)
	at io.netty.handler.ssl.OpenSslServerContext.<init>(OpenSslServerContext.java:335)
	at io.netty.handler.ssl.SslContext.newServerContextInternal(SslContext.java:421)
	at io.netty.handler.ssl.SslContextBuilder.build(SslContextBuilder.java:441)
Caused by: java.lang.Exception: Unable to configure permitted SSL ciphers (error:100000b1:SSL routines:OPENSSL_internal:NO_CIPHER_MATCH)
	at io.netty.internal.tcnative.SSLContext.setCipherSuite(Native Method)
	at io.netty.handler.ssl.ReferenceCountedOpenSslContext.<init>(ReferenceCountedOpenSslContext.java:295)
	... 7 more

Modifications:
Remove the reformatting of user-provided ciphers, as they are already in
the RFC/JDK format.
Result:
No regression, and the internals stay sane using the RFC/JDK format.

It seems having a test for this would be good. Where would the test probably be best placed?

Doh ... thanks for the cleanup.
SSLEngineTest#testHandshakeCompletesWithNonContiguousProtocolsTLSv1_2CipherOnly is a place where this can be tested (and fails before this PR).
diff --git a/handler/src/test/java/io/netty/handler/ssl/SSLEngineTest.java b/handler/src/test/java/io/netty/handler/ssl/SSLEngineTest.java
index 0983bd3a8..71e632cfd 100644
--- a/handler/src/test/java/io/netty/handler/ssl/SSLEngineTest.java
+++ b/handler/src/test/java/io/netty/handler/ssl/SSLEngineTest.java
@@ -1692,13 +1692,13 @@ public abstract class SSLEngineTest {
         final String sharedCipher = "TLS_RSA_WITH_AES_128_CBC_SHA";
         clientSslCtx = SslContextBuilder.forClient()
                 .trustManager(InsecureTrustManagerFactory.INSTANCE)
-                .ciphers(Arrays.asList(sharedCipher))
+                .ciphers(Arrays.asList(sharedCipher), SupportedCipherSuiteFilter.INSTANCE)
                 .protocols(PROTOCOL_TLS_V1_2, PROTOCOL_TLS_V1)
                 .sslProvider(sslClientProvider())
                 .build();

         serverSslCtx = SslContextBuilder.forServer(ssc.certificate(), ssc.privateKey())
-                .ciphers(Arrays.asList(sharedCipher))
+                .ciphers(Arrays.asList(sharedCipher), SupportedCipherSuiteFilter.INSTANCE)
                 .protocols(PROTOCOL_TLS_V1_2, PROTOCOL_TLS_V1)
                 .sslProvider(sslServerProvider())
                 .build();

@ejona86 thanks a lot! Please add the test as @Scottmitch suggested and we can merge 👍

Now with test, as helpfully defined by @Scottmitch :smile:. I confirmed the test fails before my change. I squashed since the new file addition is so obvious and squashing helps the merge.

@normanmaurer, a lot of the other tests are failing to delete the SelfSignedCertificate. I'm going to have a follow-up PR that cleans them up.

Thx buddy !

Am 21.07.2017 um 20:28 schrieb Eric Anderson<EMAIL_ADDRESS>@normanmaurer, a lot of the other tests are failing to delete the SelfSignedCertificate. I'm going to have a follow-up PR that cleans them up.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

@normanmaurer, since SelfSignedCertificate is calling deleteOnExit() I'm having a bit of a hard time describing the motivation in the commit message. Are we wanting JVM shutdown to be faster, wanting to avoid orphaned files if the JVM aborts, want warm fuzzies, or weren't aware they were being deleted on exit?

It's just a good practice to delete it as otherwise the files that needs to be deleted on JVM exists getting bigger and so produce overhead. That said it's not super important in unit tests but I like to show good practice there as well as people tend to look at the code and adapt it.

Am 21.07.2017 um 20:47 schrieb Eric Anderson<EMAIL_ADDRESS>@normanmaurer, since SelfSignedCertificate is calling deleteOnExit() I'm having a bit of a hard time describing the motivation in the commit message. Are we wanting JVM shutdown to be faster, wanting to avoid orphaned files if the JVM aborts, want warm fuzzies, or weren't aware they were being deleted on exit?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

I created #7007 to add deletes to the other tests. I did it in a separate PR because I was initially going to use an @After. After writing it I re-considered and swapped to explicit.

4.1 (8a25c3593) 4.0 (f30dd0b31)

Thanks @ejona86 !


fix: EventEmitter.listeners() should not throw on unknown listeners

Fixes #103

Oh, you got it for me! Cool!

@jfhbrook thank you! We use it very heavily at Playwright and it works like a charm! 💯