Frame cycles from pyboy inconsistent (w/ patch demo)

The frame cycles from pyboy are inconsistent and reset mid rendering. This is concerning for creating a reliable observation feedback situation.
Here's the situation in picture's:
We start at oak, issue one down cmd, frames 0->19 happen and the 'final' frame is still in the next position (good so far):

Another down cmd, frames 0->16 look good but then jump to 20 (which doesn't match the terminal path output), regardless frames 20-24 jump back to the starting pos (bad/weird idk). The final frame is in the right place. Still this is a problem, what's in video memory shouldn't render this jump:

A few steps more down and we exit Oak's building. Frames 0-1 start to exit from pos map-x-y 40,5,11 then frames 2-34 jump to 0_5_11 (almost ok, we just exited right) but then there are still frames 17-21 at 40-5-11. It seems like x,y positions are jumping back and forth, somehow unsettled, and this matches my observations for more complicated runs, but hopefully this simple example gives some weight to the claim.
As an experienced embedded software dev I'm not a python expert but I do know memory and it really looks like the values being pulled from video/ram are not stable. Maybe I'm missing something but would love anyone to weight in what's going on. I lean to this maybe being a pybot bug, @Baekalfen what do you think?
Thanks
See the comment message to run this very easy demo patch off (f8a7fdfa08b01fa89d0cb76f06d681506ac4115d) to view yourself.
Demo Patch:
From 7776d90cfd3fdec8a7539cb69aa6b4d98ad2bd18 Mon Sep 17 00:00:00 2001
From: Matthew Stanger<EMAIL_ADDRESS>Date: Sat, 28 Oct 2023 13:54:36 -0700
Subject: [PATCH] Demo: Frame cycles from pyboy inconsistent

This is an issue because when training AI the game's video
output per 'turn' or frame completion cycle needs to be very
percise to create a perfect turn feedback observation.

This patch shows an issue where after keying off a frame
animation memory flag (ie. the sprite should be still & it's
animation has been completed) the screen output is stale or
reset or a starting frame.

The main meory key 0xC108: wSpritePlayerStateData1AnimFrameCounter
is used and when comparing this value on mGBA emulator the end
screen frame is whats expected.

Bug Demo Usage:
    python run_pretrained_interactive.py

Result:
The emulation will run 12 dpad down cmds starting from prof oak
and during this will capture every frame for each step. It saves
every frame by 'map_x_y' folder and screenshot by
'self.id_step-count_frame-number'.

You will see that the sprite in the screenshots moves down in
animation and then at the end of some frames jumps back to the
starting pos. This is the issue.
---
 baselines/agent_enabled.txt             |  2 +-
 baselines/red_gym_env.py                | 59 +++++++++++++++++--------
 baselines/run_pretrained_interactive.py | 16 ++++---
 3 files changed, 50 insertions(+), 27 deletions(-)

diff --git a/baselines/agent_enabled.txt b/baselines/agent_enabled.txt
index 7cfab5b..7ecb56e 100644
--- a/baselines/agent_enabled.txt
+++ b/baselines/agent_enabled.txt
@@ -1 +1 @@
-yes
+no
diff --git a/baselines/red_gym_env.py b/baselines/red_gym_env.py
index 5d23527..468abf1 100644
--- a/baselines/red_gym_env.py
+++ b/baselines/red_gym_env.py
@@ -108,7 +108,7 @@ class RedGymEnv(Env):
         self.screen = self.pyboy.botsupport_manager().screen()

         if not config['headless']:
-            self.pyboy.set_emulation_speed(6)
+            self.pyboy.set_emulation_speed(1)

         self.reset()

@@ -190,11 +190,13 @@ class RedGymEnv(Env):

     def step(self, action):

+        cur_map_n, cur_x_pos, cur_y_pos = self.read_m(0xD35E),  self.read_m(0xD362), self.read_m(0xD361)
+
         self.run_action_on_emulator(action)
         self.append_agent_stats(action)

         self.recent_frames = np.roll(self.recent_frames, 1, axis=0)
-        obs_memory = self.render()
+        obs_memory = self.render(reduce_res=False)

         # trim off memory from frame for knn index
         frame_start = 2 * (self.memory_height + self.mem_padding)
@@ -225,25 +227,42 @@ class RedGymEnv(Env):

         self.step_count += 1

+        ss_dir = self.s_path / Path(f'screenshots/{cur_map_n}_{cur_x_pos}_{cur_y_pos}')
+        ss_path = f'{id(self)}_final.jpeg'
+        plt.imsave(
+            Path(f'{ss_dir}/{ss_path}.jpeg'),
+            obs_memory)
+
         return obs_memory, new_reward*0.1, False, step_limit_reached, {}

     def run_action_on_emulator(self, action):
+        user_inputs = self.pyboy.get_input()
+        animation_started = False
+        cur_map_n, cur_x_pos, cur_y_pos = self.read_m(0xD35E),  self.read_m(0xD362), self.read_m(0xD361)
+
+        print(f'\naction: {WindowEvent(action).__str__()}, user_inputs: {str(user_inputs)[1:-1]},'
+              f' x:{cur_x_pos}, y:{cur_y_pos}, map: {cur_map_n}')
+
         # press button then release after some steps
-        self.pyboy.send_input(self.valid_actions[action])
+        self.pyboy.send_input(action)
         # disable rendering when we don't need it
         if not self.save_video and self.headless:
             self.pyboy._rendering(False)
-        for i in range(self.act_freq):
-            # release action, so they are stateless
-            if i == 8:
-                if action < 4:
-                    # release arrow
-                    self.pyboy.send_input(self.release_arrow[action])
-                if action > 3 and action < 6:
-                    # release button
-                    self.pyboy.send_input(self.release_button[action - 4])
-                if self.valid_actions[action] == WindowEvent.PRESS_BUTTON_START:
-                    self.pyboy.send_input(WindowEvent.RELEASE_BUTTON_START)
+        for i in range(self.act_freq): # Frames for animation vary, xy move ~22, wall collision ~13 & zone reload ~66
+            self.save_screenshot(self.read_m(0xD362), self.read_m(0xD361), self.read_m(0xD35E), i)
+
+            # wSpritePlayerStateData1AnimFrameCounter, non-zero when sprite anim frames are playing
+            moving_animation = self.read_m(0xC108)
+            print(f'Moving: {moving_animation}, map: {self.read_m(0xD35E)}, frame: {i}')
+
+            if animation_started and moving_animation == 0:
+                break
+
+            # Release the key once the animation starts so it should only be possible to advance 1 pos.
+            if moving_animation > 0:
+                animation_started = True
+                self.pyboy.send_input(WindowEvent.RELEASE_ARROW_DOWN)
+
             if self.save_video and not self.fast_video:
                 self.add_video_frame()
             if i == self.act_freq-1:
@@ -535,11 +554,13 @@ class RedGymEnv(Env):

         return state_scores

-    def save_screenshot(self, name):
-        ss_dir = self.s_path / Path('screenshots')
-        ss_dir.mkdir(exist_ok=True)
+    def save_screenshot(self, x_pos_cur = 0, y_pos_cur = 0, n_map_cur = 0, i = 0):
+        ss_dir = self.s_path / Path(f'screenshots/{n_map_cur}_{x_pos_cur}_{y_pos_cur}')
+        ss_path = f'{id(self)}_{i}.jpeg'
+        print(f'path: {ss_dir}/{ss_path}')
+        ss_dir.mkdir(parents=True, exist_ok=True)
         plt.imsave(
-            ss_dir / Path(f'frame{self.instance_id}_r{self.total_reward:.4f}_{self.reset_count}_{name}.jpeg'),
+            Path(f'{ss_dir}/{ss_path}.jpeg'),
             self.render(reduce_res=False))

     def update_max_op_level(self):
@@ -618,4 +639,4 @@ class RedGymEnv(Env):
             return map_locations[map_idx]
         else:
             return "Unknown Location"
-
\ No newline at end of file
+
diff --git a/baselines/run_pretrained_interactive.py b/baselines/run_pretrained_interactive.py
index 2c26713..5dc0067 100644
--- a/baselines/run_pretrained_interactive.py
+++ b/baselines/run_pretrained_interactive.py
@@ -30,9 +30,10 @@ if __name__ == '__main__':

     env_config = {
                 'headless': False, 'save_final_state': True, 'early_stop': False,
-                'action_freq': 24, 'init_state': '../has_pokedex_nballs.state', 'max_steps': ep_length,
+                'action_freq': 120, 'init_state': '../has_pokedex_nballs.state', 'max_steps': ep_length,
                 'print_rewards': True, 'save_video': False, 'fast_video': True, 'session_path': sess_path,
-                'gb_path': '../PokemonRed.gb', 'debug': False, 'sim_frame_dist': 2_000_000.0, 'extra_buttons': True
+                'gb_path': '../PokemonRed.gb', 'debug': False, 'sim_frame_dist': 2_000_000.0, 'extra_buttons': True,
+                'use_screen_explore': False
             }

     num_cpu = 1 #64 #46  # Also sets the number of episodes per training iteration
@@ -47,7 +48,7 @@ if __name__ == '__main__':
     #keyboard.on_press_key("M", toggle_agent)
     obs, info = env.reset()
     while True:
-        action = 7 # pass action
+        action = 2 # Down D-Pad action
         try:
             with open("agent_enabled.txt", "r") as f:
                 agent_enabled = f.readlines()[0].startswith("yes")
@@ -55,8 +56,9 @@ if __name__ == '__main__':
             agent_enabled = False
         if agent_enabled:
             action, _states = model.predict(obs, deterministic=False)
-        obs, rewards, terminated, truncated, info = env.step(action)
-        env.render()
-        if truncated:
-            break
+        for i in range(12):
+            obs, rewards, terminated, truncated, info = env.step(action)
+        #env.render()
+        #if truncated:
+        break
     env.close()
--
2.34.1

As I am watching my sessions sometimes I notice battles end then go back to battle then end again so i can confirm something weird is happening.

I've no reason to believe this is a fault in PyBoy. If that was the case, I think I would have caught it in automated testing and manual testing. PyBoy doesn't really have the ability to randomly reset, unless you're issuing save/load state.
I don't have time to study the patch, but if I were you, I'd set a breakpoint() or input() after saving each frame to verify it's getting saved correctly. Maybe you're having some race-condition.

Hi, I'm having a bit of trouble understanding the issue here. Does this only happen when running with GUI? I don't think I've observed anything like what you're describing in my experiments.

Lets just close this for now. I don't think this is actionable at the moment.


Important Notification From SONOFF

As eWeLink will stop provide the support and maintance of current APPID & APP secret on Aug 31th 2020.
That means that this project may work improperly.
eWeLink will offer a special APPID and APP secret for this project.
@lucien2k  Please contact me via the mail
To<EMAIL_ADDRESS>and cc<EMAIL_ADDRESS>Daniel

i wrote you but never received feedback... :(

+1

Did it just stop to work? I can list devices but if I try to switch outlet nothing happens (without error code).

I can confirm that. I'm able to list and get the status of my devices, but switching them has no effect.

This project doesn't work?


Add job list in build output

Changes
This allows the printing of build jobs to the terminal. We can kind of safely assume that a build will always have at least one job, but could implement tests too if eventually.
The output looks like:

I didn't want the time to become the focus, so made it grey in colour.

Ohh nice addition 👍 One thing though, I don't think this will handle non-command type steps as I can see it uses timestamps and falls back to the Command job field which would be nil. We can follow up with those improvements in another PR


Basic LPUART support for STM32Lx

Tested on STM32L073.

Codecov Report

Merging #6861 into master will increase coverage by <.01%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #6861      +/-   ##
==========================================
+ Coverage   54.89%   54.89%   +<.01%
==========================================
  Files         449      449
  Lines       43378    43378
  Branches     8154     8154
==========================================
+ Hits        23812    23813       +1
+ Misses      16263    16262       -1
  Partials     3303     3303

Impacted Files
Coverage Δ

kernel/posix/pthread.c
70% <0%> (+0.5%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5e7a104...0a76b25. Read the comment docs.

@vaussard , I can't add you to the review, but would be nice if you can have a look.

Mmmh why are some of my comments shown as outdated, while the code did not changed? Strange github.

@vaussard, thank you for detailed review!

@erwango, could you look again?


fix: using xpty

using x/xpty, and using term size as pty size

Need to update deps, then good to merge :)


does not work if one of the memcached server is down in case of multiple servers

Hi,
I am facing Issues with this npm, I have added 2 servers and given 3rd server for the case of failure.
var Memcached   = require('memcached');
var memcached   = new Memcached(['<IP_ADDRESS>:11211','2nd server:11211'], {retries:0,retry:0,remove:false,failOverServers:['3rd:11211']});
but the issue is, if I turn off memcache at 2nd server, then the local server which is <IP_ADDRESS>:11211 also does not get any request to add delete or manipulate data.
If any one server is down, atleast other servers should get the request to save or manipulates cache at their end.
I am really stuck with this, is this a issue with npm?
is there any solution to it?

I also got the same issue.


ambiguous statement - unclear what it is trying to say

However, administrators of 'Contoso' can control access to organization 'Test' if they control the user account that created 'Test.'
What does "control the user account" means? Is it sign in as the user?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 4a916018-5100-91af-bc16-6aab0372bd48
Version Independent ID: 2f526d40-8282-090c-430e-b2bf1d3ba7df
Content: Characteristics of multiple tenant interaction - Azure AD
Content Source: articles/active-directory/users-groups-roles/licensing-directory-independence.md
Service: active-directory
Sub-service: users-groups-roles
GitHub Login: @curtand
Microsoft Alias: curtand

@bfg100k  Thanks for reaching out. We will investigate and update the thread accordingly.

@bfg100k  By the statement "control the user account " that means having privilege to manage the user account like any normal GA would have.  It does not mean sign as that user, it just mean you can assign licenses, reset passwords and other administrative stuff to that user account.
Let me know if you have any questions.

Thanks for the reply. I can understand a GA can do administrative task to
the user account but how can the GA control access to the Directory created
by that user account? Can you be more specific please?
On Tue, 18 Aug 2020 at 10:41 pm, VipulSparshMSFT<EMAIL_ADDRESS>wrote:

@bfg100k https://github.com/bfg100k By the statement "control the user
account " that means having privilege to manage the user account like any
normal GA would have. It does not mean sign as that user, it just mean you
can assign licenses, reset passwords and other administrative stuff to that
user account.
Let me know if you have any questions.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/MicrosoftDocs/azure-docs/issues/60845#issuecomment-675454505,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAQWGN54WG34DQ2REU475G3SBJZI7ANCNFSM4P7ADSMQ
.

Hi @bfg100k
It IS sign in as the user, which gives you GA permissions in Test, to use their example. The paragraph is trying to say that you can get GA permissions by having an admin in Test assign it to you or by signing in with the user account that created the tenant. I have made it more specific.. Thanks for your contribution!!
#please-close


Using metadata in Handlebars helper functions

I was writing a question about this, but did some more research and figured it out. It wasn't obvious to me, so I'm assuming someone else might be struggle with it too.
If you want to use metadata (global or imported) in a Handlebars helper function, include options as your last parameter. Then options.data.root will be the global metadata object. If imported a key foo with metalsmith-metadata, you can access it as options.data.root.foo.
Assume foo.json is imported to foo
{
    "bar": "Hello, World!"
}

helper, registered as 'foobar'
module.exports = function (parm, options) {
    var foo = options.data.root.foo;
    return(foo.bar);

Template
{{foobar}}

will produce output
Hello, World!

You can also access any file-level metadata in options.data.root, for example if you have a title key in your document, options.data.root.title
You can get a sense of what's in options.data.root by registering the following helper and calling it in a template.
module.exports = function (filename, options) {
	var md = options.data.root;
	for (i in md) {
		console.log(i + " | " + md[i]);
	}
};

This will log keys and values. Note that some values will be objects, but they should be obvious (partials, knownHelpers, etc.).
Metalsmith team
I'm not sure exactly where this information should go. It's related to using metalsmith-metadata, but also general to metalsmith (global metadata). It's focused on Handlebars helpers, but may apply to other templating engines. Tell me where you want this documented and I'll try to make it happen.

Thanks for the writeup on this, was a big help to me.
So a question I have - how did you discover that you could pass in the second options argument? Is this a function of handlebars itself, or perhaps of the template engine (consolidate / metalsmith-templates)?

Handlebars helper functions are functions developers write to deal with logic that doesn't fit in Handlebars templates. For example, I wrote a helper to determine if a menu item or any of its descendants (if they exist) is active and return ' active' or '' (empty string) so I can inject it into the menu item <li>'s class attribute (I'm using Bootstrap). So, helper functions can take any parameters the developer wishes to pass.
Handlebars allows passing multiple parameters to helper functions and partials. See the discussion for helpers in the Helpers section at http://handlebarsjs.com/expressions.html. Partials work the same way.
The options object from whence comes options.data.root is part of Metalsmith and contains pretty much everything Metalsmith knows about what it's doing. It was either documented somewhere I can't find or was in some code I was looking at when I was trying to get various plugins working. Writing a Handlebars (or other templating engine of your choice) template and partial to recurse and dump options (or any other object passed to it) is a revealing exercise everyone should try at least once. All kinds of goodies hidden in options. You'll probably end up using the template and partial again later when you're trying to figure out what's in some other hash you're looking at.
Finally, unrelated to this, consolidate passes a set of user-defined options to Handlebars, as hinted in the Notes section (first six bullets reference passing options.partials, options.loader, etc., which get passed through to the engine) and the metalsmith-layouts documentation https://github.com/superwolff/metalsmith-layouts#consolidate.
Hope that helps.

@jmjf you can maybe help me on finding a solution in this issue: segmentio/metalsmith-headings#4
I wonder if metalsmith-navigation is similar to metalsmith-headings...

Well, metalsmith-navigation generates menu structures nicely, but uses frontmatter metadata in individual markdown files. From what I'm reading, metalsmith-headings looks at the h1, h2, etc., tags in one or more files. So, while it looks like headings would extract all h1, h2, etc., which might be nice for documentation menus, I believe navigation will only extract one item per file. If that's what you want, navigation is the way to go, but if you're trying to build multilevel menus based on heading in the markdown files, you'll need to work with headings.
I do see a problem with the JSFiddle and will note that on the issue.

Ok, thanks @jmjf for these explanations.
As far as I understand, metalsmith-navigation is appropriate for generating a navigation menu through a whole site.
metalsmith-headings is appropriate for generating a table of content on one page.
These are different usecases. Choose the appropriate plugin for the appropriate usecase.


Encoding quality heuristic

Heuristic for determining the quality of an encoding without a ground truth. Useful for schema optimisation.

I don’t think this would really fit in the threshold-finding example notebook. I’d like to make another, possibly with the Bayesian optimisation of schema as the use case, but this is multiple hours’ worth of effort, so I’ll just put it on my to do list for now.


Docking.clear()

Hello, could you add a function, something like Docking.clear() or Docking.reset() which would clear everything that is registered?
I am trying to implement a soft restart function to my app, and there is no easy way to unregister everything, having a clear function would make things very simple.
Thank you,
Trevor

Sounds good to me. I think it would have to deregister all dockables and undock them from all the roots.
I'll leave the roots alone and not deregister those.

I think while I'm at it I'll add a way to access a list of all registered dockables. That should make it a bit easier to deal with if you need to write any temporary workarounds in the future like you mentioned in issue #74.

Sounds good, a way to unregister all roots would be desirable too. In my case all my windows have been disposed of.

Sounds good, a way to unregister all roots would be desirable too. In my case all my windows have been disposed of.

This makes me realize that I assume the framework is managing all windows that aren't the main window and I'm disposing them in certain cases. I'll clean that up and make sure I only dispose the windows I create.

Made some more improvements to this for the next release. Dockables that can't be closed were being redocked after undocking in the deregister.


Lazy Loading

Ionic version:  (check one with "x")
[ ] 1.x
[x] 2.x
I'm submitting a ...  (check one with "x")
[x ] bug report
[ x] feature request
Current behavior:
I have a 20-30 pages. Loading startup time: 15-20s.
Expected behavior:
only 2-3s ;)
It is possible implement lazy loading? I created many ngModules for my application (specific parts), but Ionic loaded all in start app. Start is very slow.
I saw branch v3.   It is possible implement this for v2 ?

@kwarpechowski Please try the search functions first, this topic is discussed so many times, ionic is one this, asking each day these same new questions realy don't help.
Have a look here
https://github.com/driftyco/ionic/issues/8102
or
https://github.com/driftyco/ionic/issues/6776
If your startup time is 20-30 seconds try to compile with --prod 5-8 seconds should be the normal time.
Thanks
Graphefruit


fix macOS build

this PR:

fixes Makefile to compile the SDK properly under macOS
adds install command

Updated makefile to do install without running make first.


Additive blend without drawcall

Moves the distinction between "Additive" and "Mixture" blend modes into the shader. This is controlled by the sign bit of each vertex's alpha channel, which feels slightly hacky, but is the least-intrusive solution I could think of. (And it's basically free, perf-wise.)
A necessary component of this change is the use of premultiplied alpha in the shader outputs, which means that buffered containers need special treatment: their framebuffers become textures with premultiplied alpha, which needs to be unmultiplied further down the line (for backwards compatibility). In this PR, this is handled by an additional shader uniform that denotes whether the input texture has premultiplied alpha or not.
Another thing of note: in the interest of API compatibility, additive blending on the Drawable side is controlled by an extra boolean within BlendingParameters, which feels hacky. I'd prefer removing the distinction between additive and mixture blend modes as far as the graphics API is concerned... but that'd require changing every single place where additive blending is currently set.
Lastly: some osu-resources-side shaders also need to have their output multiplied by alpha. I can make another PR for those -- it's a minor change. Until then, isolated places like osu!'s intro shader look broken.

I think this looks like a pretty good direction to take things, but will note that TestSceneComplexBlending no longer work at my end:
https://user-images.githubusercontent.com/191335/204737607-d23526b3-6cf6-47f3-ac54-e72ec5556148.mp4

Fixed!
This problem shed light on a few problems osu! has with its blending in general. A few of those, I could fix and should make the game look slightly more correct looking forward. A few others of those are too late to be adjusted (or shouldn't be adjusted for aesthetic reasons, such as the design decision to do most, but not all, blending in sRGB space), so I added workarounds for these, along with verbose comments.


Typo in requireNumericChataters

Should be "Characters"

This has now been resolved and released as v2.0.3, the old method name can still be used for the time being (I've proxied/aliased the old method name too in order to prevent broken code and also marked as deprecated with a docblock). Thanks for reporting 👍

I know this was a typo, but this is a breaking change. imho it should have been a major bump.

Oh! my bad, we kept the original for backwards compatibility 👏

Yep 👍 - Don’t worry, I have your back 😎
Sent from my iPhone

On 12 Jul 2022, at 00:16, Ignacio Catalina @.***> wrote:

Oh! my bad, we kept the original for backwards compatibility 👏
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you modified the open/close state.


User management

In gitlab by @MJochim on Sep 7, 2016, 13:26
emudb-manager.php contains commented-out code to look up users in an SQL database. This must replace the hard-coded user management.

In gitlab by @MJochim on Oct 11, 2016, 15:51
fixed in 4e682519

In gitlab by @MJochim on Sep 7, 2016, 20:16
Milestone removed


[master] Update GitHub Actions

Copied from https://github.com/knative-sandbox/.github/tree/master/workflow-templates.
/assign n3wscott shashwathi tanzeeb
/cc n3wscott shashwathi tanzeeb

/lgtm
/approve


CanMoveFurther() method not working on last slide.

Method canMoveFurther() from MaterialIntroActivity is not working on last slide. When the user is on the last slide and clicks finish button, that method is not running, and a user can pass further.

@radzio https://github.com/TangoAgency/material-intro-screen/pull/20


Migrate contact emails

Closes https://github.com/jhu-idc/iDC-general/issues/296
Adds a naive migration for the "contact email" entity, that is used to configure our collection and repository item contact forms in order to send emails to the expected addresses. These entities were already in our snapshot, but a migration and pre-defined data did not, so that if the entities were lost, or the system were started with a fresh database, they'd have to be recreated manually.
There will be a CSV available in our idc_ui_module/migrate that can be used to recreate these entities
Note that I did attempt to create the migration definition in jhu-idc/idc_ui_module, but I couldn't get the module to add the migration on install, so I just plopped the migration definition here.

Presumably, this one test could be folded into an already existing test suite to cut down on make resets a bit. Would 10-migration-backend-tests be the best place -- and if that's the case, would we need an accompanying verification test in Go, as opposed to simply checking for some known values in the UI, like is done now?

Presumably, this one test could be folded into an already existing test suite to cut down on make resets a bit

I think the end-to-end folder is a good place for one-off tests that don't really require a test "suite", but I'm indifferent as to whether or not it is actually moved.

I'm sorry that you couldn't get the migration to run on module install, but that can be done later.  I know the islandora module performs migrations on install, but maybe there's a little more magic to it besides adding a migration folder + csvs to your module.


Add redirect for old SpectralTrainFig tool URL to GitHub repository

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5976521/pdf/nihms925362.pdf
The paper contains the following URL, which is no longer active: https://www.sleepdata.org/community/tools/nsrrspectraltrainfig
Manually redirect users coming to this URL to the GitHub repository here: https://github.com/nsrr/SpectralTrainFig

https://github.com/nsrr/sleepdata.org/pull/357

Whoops, I made a mistake - the link in the paper actually points to this old URL - https://www.sleepdata.org/community/tools/nsrr-spectraltrainfig
(Add dash between 'nsrr' and 'spectrainfig')
I asked Remo to jump back to NSRR when he next has the chance.


Won't load after update

I just updated the plugin, since I saw you had a new commit (release?) https://github.com/lukeleppan/better-word-count/commit/3434a4f145c52a112a077955bca38aa9ab551232
But now the plugin won't load at all, and get the error Failed to load Plugin and this is in the console:

I'm on Linux Mint, Obsidian v0.13.23 (Installer v0.12.15)
Thanks :)

Are you using the Legacy Editor? It says it on top of the Readme:
IMPORTANT NOTICE: Due to the introduction of the new Live Preview feature, this plugin needed to be almost entirely rewritten. Currently the plugin only displays the only the word and character count with selecting text features. ALL other features have been scrapped and will be ported in future updates. DO NOT UPDATE If you want to use the legacy editor since their is no backwards compatibility yet (I know I'm lazy but I wanted to release the fix, its been too long).

I'm not :) Thanks though!

the newest release 0.8.1 works now! But there's no settings to change the default appearance, but I assume that'll come later. Thanks for the quick fix!!


chown root:root /etc/chef/solo.rb error on os x lion

I just tried to use littlechef to configure my local machine. But when running
fix node:localhost recipe:irssi

I encountered
Fatal error: sudo() encountered an error (return code 1) while executing 'chown root:root /etc/chef/solo.rb'

The command returns 1 because there is no group root, but only the group wheel.

interesting. I never used LittleChef to configure my local machine.
Lots of bad things can happen there. For example, when I try that on Ubuntu, I get Fatal error: Low level socket error connecting to host localhost: Connection refused
Bear in mind that the library commands will try to ssh into your localhost, which is a bit weird. In your case the user you are using for LittleChef and your nodes may not have sudo rights on your local computer? or has a different password?

hm, chef does support OS X and I don't see a reason for not configuring the the user on my machine with the same cookbooks that I use for my servers. In the littlechef readme, it says it was tested with OS X.
My user has sudo rights and the password was correct, too. I am quite sure that the problem is with the chown and that there is no root group but only wheel.
For now I can run chef-solo manually, but I would really appreciate if one (you? ;) ) could check this out (or drop the support for OS X).

I did this before posting this issue. The chown command failed because there is no group root.
I now created the group with:
dscl . -create /Groups/root
dseditgroup -o edit -t user -a root root

⚡ fix node:localhost recipe:vim

== Applying recipe 'vim' on node localhost ==
sudo password:
Saving node configuration to nodes/localhost.json...
Synchronizing node, cookbooks, roles and data bags...
The authenticity of host 'localhost (::1)' can't be established.
RSA key fingerprint is a7:5f:5b:38:a1:74:4d:9d:08:18:3a:c7:94:e3:c2:08.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'localhost' (RSA) to the list of known hosts.

Cooking...
tee: /var/log/chef/solo.log: No such file or directory
[Wed, 18 Jan 2012 13:55:26 +0100] INFO: *** Chef 0.10.8 ***
[Wed, 18 Jan 2012 13:55:27 +0100] INFO: Setting the run_list to ["recipe[vim]"] from JSON
[Wed, 18 Jan 2012 13:55:27 +0100] INFO: Run List is [recipe[vim]]

The recipe failed later, but I am not sure why yet.
fix node:localhost deploy_chef does not work because it uses the chef bootstrap script (right?), which does not provide support for os x.

Regarding the later, deploy_chef per default uses distro packages. Supported are systems listed in the README. deploy_chef:gems=yes does the same but using gems. Neither method supports OSX.

A previous version of LittleChef worked for sure on OSX. A user contributed patches to add support, and that is why it is listed. That it doesn't work with 1.0+ is possibly because of the change to rsync, which caused the explicit root ownership command.
To fix that would be as easy as adding a check for OSX and then using wheel instead of root

OK, so to recap the status of this bug: you temporarily solve your problem by adding a root user to your OSX based system. To properly solve this we need to check whether we are on OSX and then use wheel to chown the kitchen directory instead of root. Is that correct?

Almost correct: I added the groop root to my OSX based system. But yeah, actually, the only required change for this bug is chowning to root:wheel instead of root:root.

Hi,
coming back to this issue, would it be find by you if you had to define in the node/<hostname>.json the attribute
"platform": "mac_os_x"?
The more runtime-expensive but transparent way would be to execute ohai platform at run time. That would be one extra ssh command to send over the wire for every server configuration, which is why I prefer to define it in the node file explicitly.


go: go1.21 version cause gorilla/websocket failed

Go version
go version go1.22.4 darwin/arm64
Output of go env in your module/workspace:
GO111MODULE='on'
GOARCH='arm64'
GOBIN=''
GOCACHE='/Users/xiecui/Library/Caches/go-build'
GOENV='/Users/xiecui/Library/Application Support/go/env'
GOEXE=''
GOEXPERIMENT=''
GOFLAGS=''
GOHOSTARCH='arm64'
GOHOSTOS='darwin'
GOINSECURE='*.futunn.com,*.oa.com'
GOMODCACHE='/Users/xiecui/code/go/gopath/pkg/mod'
GONOPROXY='*.futunn.com,*.oa.com'
GONOSUMDB='on'
GOOS='darwin'
GOPATH='/Users/xiecui/code/go/gopath'
GOPRIVATE='*.futunn.com,*.oa.com'
GOPROXY='https://goproxy.cn,direct'
GOROOT='/Users/xiecui/code/go/go1.22.4/go'
GOSUMDB='off'
GOTMPDIR=''
GOTOOLCHAIN='auto'
GOTOOLDIR='/Users/xiecui/code/go/go1.22.4/go/pkg/tool/darwin_arm64'
GOVCS='*:all'
GOVERSION='go1.22.4'
GCCGO='gccgo'
AR='ar'
CC='clang'
CXX='clang++'
CGO_ENABLED='1'
GOMOD='/Volumes/Elements/code/go/broker/my_test/go.mod'
GOWORK='off'
CGO_CFLAGS='-O2 -g'
CGO_CPPFLAGS=''
CGO_CXXFLAGS='-O2 -g'
CGO_FFLAGS='-O2 -g'
CGO_LDFLAGS='-O2 -g'
PKG_CONFIG='pkg-config'
GOGCCFLAGS='-fPIC -arch arm64 -pthread -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -ffile-prefix-map=/var/folders/d2/82q9pj7x33gc7m0xkpkx3p3w0000gn/T/go-build162556822=/tmp/go-build -gno-record-gcc-switches -fno-common'

What did you do?
go.mod
module github.com/cuiweixie/websocket_test

go 1.21

require github.com/gorilla/websocket v1.5.3 // indirect

wss.go
package main

import (
	"log"
	"net/http"

	"github.com/gorilla/websocket"
)

func main() {
	webURL := "wss://wspap.okx.com:8443/ws/v5/public"

	header := http.Header{}
	var dialer websocket.Dialer
	_, _, err := dialer.Dial(webURL, header)
	if err != nil {
		log.Fatalf("dial failed: %v", err)
	}
	log.Println("connection ok")
}

go run wss.go

What did you see happen?
2024/07/19 19:01:13 dial failed: websocket: bad handshake
exit status 1

What did you expect to see?
if change go mod to:
module github.com/cuiweixie/websocket_test

go 1.22

require github.com/gorilla/websocket v1.5.3 // indirect

will result in:
2024/07/19 19:01:39 connection ok

It's strange that using go1.21 doesn't work, but go1.22 or later does.

Related Issues and Documentation

Go get not working #37389 (closed)
net: broken pipe errors starting from Go 1.12 when using a deadline #35373 (closed)
crypto/tls conn sometimes hangs when calling tls.Handshake() #17708 (closed)
crypto/tls: https request, tls handshake failure in go1.22 #66512 (closed)
deadlock in websocket server (gorilla) on linux/arm (raspberry pi) with crosscompile #19730 (closed)
affected/package: windows X86环境下，tls 库貌似有点问题 #63531 (closed)
net: Dial does not respond to quickly-broken IPv6 connections by falling back to IPv4 #68237
cmd/link: regression on building an app with `GOOS=wasip1 GOARCH=wasm` #65786 (closed)

(Emoji vote if this was helpful or unhelpful; more detailed feedback welcome in this discussion.)

I think this is controlled by the GODEBUG setting tlsrsakex where the default changed from enabled in go1.21 to disabled in go1.22.
I don't think there's anything to do here as the new behavior is more correct and we aren't going to change the default GODEBUG for a previous version.
main » GODEBUG=tlsrsakex=1 go1.22.5 run .
2024/07/19 12:18:46 dial failed: websocket: bad handshake
exit status 1

main » GODEBUG=tlsrsakex=0 go1.22.5 run .
2024/07/19 12:18:56 connection ok

thanks!


Agent config link is broken

honeytrap/honeytrap#414:

the documentation on the honeytrap.io has a 404 on the config-docker.toml file. The docker-compose-honeytrap.yml is ok.

wget https://gist.githubusercontent.com/Coen-Schuijt/0600aca75dc99f6c2ce2c260ad00f0ab/raw/config-docker.toml

On this page:
https://docs.honeytrap.io/docs/setup/server/setup-prerequisites/

I think it should link to agent-server in the honeytrap-configs repo.

good shout, I've just created a PR with a fix
https://github.com/honeytrap/honeytrap-docs/pull/16

We have launced new documentation so this is no longer a issue.


(maint) Download CMake from our S3 bucket

It's much faster than downloading from cmake.org.

CLA signed by all contributors.


chore: impl default function for repository

Codecov Report

Merging #10 (69238eb) into main (196cdd9) will increase coverage by 0.33%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main      #10      +/-   ##
==========================================
+ Coverage   86.08%   86.42%   +0.33%
==========================================
  Files           6        6
  Lines         460      464       +4
==========================================
+ Hits          396      401       +5
+ Misses         64       63       -1

Impacted Files
Coverage Δ

src/evaluate.rs
87.68% <100.00%> (+0.24%)
:arrow_up:

src/sync.rs
88.15% <0.00%> (+1.31%)
:arrow_up:


⚠ Bofrost.de has degraded performance

In f77c2cd, Bofrost.de (https://www.bofrost.de) experienced degraded performance:

HTTP code: 200
Response time: 1282 ms

Resolved: Bofrost.de performance has improved in 0619110 after 6 minutes.


My user model doesn't have 'Name' field...

Pardon my lack of knowledge - this will be my first time creating an app for Shopify.
When doing a first install of the app to a dev store from the partner portal of Shopify, my laravel app throws me an SQL error asking for the name field, but I have this separated into two fields: first_name and last_name - any ideas what to do in this case?
Secondly, is this normal behavior where you create a user account from Shopify side?  What if a user already has an account on my laravel app and just wants to connect their shopify account?  Is there a way to have this as the default behavior?

After playing around with Shopify for a few hours, I'm wondering if there is a way to override the user creation part of the auth process?  I want my users to do the auth part from my laravel app, while logged in.  If not, no biggie as I've already pieced something together using Socialite.

If you have modded your user model to be two fields then you need to modify the package to support this. Creation via Socialite is something people have asked for but it honestly makes no sense to me for normal Shopify app development, unless I'm missing something.
Thanks!


Refactor Email Sending in Web Project

Allready.Services.MessageServices needs to be refactored (away?) and replaced/reuse/integrate with logic and config of the similar sending logic in NotificationsProcessor in the WebJobs Project.
This will close out email related issue #172

On it :)


undoing characters inserted from surround map doesn't work

Enter abc in an editor and select it. Type { and it enters the } after c. Now, undo and instead of getting abc, you get ab}. Also, if you enter { in a new editor, it gives you {}. Now when you undo, you get }.

I've disabled surround map for now.


feat: enhance time range selector for metrics - include presets

Resolves #2278

We are using  https://mui.com/x/react-date-pickers but for presets (last 1 hr, last 30mins etc) https://mui.com/x/react-date-pickers/shortcuts/ requires pro version (date and time shortcuts). Testing out different libraries and their outputs.

Why is the date format so weird?

@whynowy: talking about the attached date format? It's the default format(attached) for date with times. I tried with other formats but didn't work. Will check once more if there's a workaround.

What do you suggest?

Why is the date format so weird?

@whynowy: talking about the attached date format? It's the default format for date with times. I tried with other formats but didn't work. Will check once more if there's a workaround.
https://mui.com/x/react-date-pickers/date-time-range-field/
here, it's like 04/17/2022 03:30 PM – 04/21/2022 06:30 PM

What do you suggest?

Is it according to different client? What i see in the link you posted is like below.

@whynowy: yes it was a different component (for reference i added, but we aren't using that).
I have made the changes and format would be like below. This works?


iOS/master: Can not establish connection to the server

Describe the bug
Can not establish connection to the server.
Error message: "Sorry, an unexpected error occurred."
To Reproduce
Try connecting to any server.
Expected behavior
Successful connection.
Screenshots
n/a
Client System (please complete the following information):

Outline Client Version: built from the master branch
Operating System: iOS 15.5

Submit Feedback
n/a
Additional context
n/a

It is going to be happen when we want to switch between some other Key Servers .


Improve headers and debugging page

I hope this is not too much for one PR. I was initially only planning to fix up the headers in the Debugging page, but then I found more that were not looking so great. I moved the instructions on setting up PSPLINK for Linux and Windows to its own pages to clean up a bit. Hope I made no errors, please do a quick check before merging.

I checked it and it's alright, this was much better, thanks for working on this wouter!


Add PAE presentation in the notebook of 3_pipelines_experiment_metadata.ipynb

Would be great if we could add PAE diagram presentation in the notebook of 3_pipelines_experiment_metadata.ipynb. It’s called the Predicted Aligned Error and is sourced from the pkl files.
The data is hidden in the pkl file output and needed to be programmed to present its graph. This graph is the critical output the biologists need to see how the run has gone but not straightforward for them to access. An example is attached below (the right part of it)

Also quoted the PAE detailed definition from https://alphafold.ebi.ac.uk/faq as below as reference:
_The Predicted Aligned Error (PAE) is displayed as an image for each of the structure predictions. If you need the raw data with PAE for all residue pairs, you can download the PAE in a JSON format using the button at the top of the structure page.
This file is in a custom format and it isn't supported by any existing software – you will have to use Python or any other scripting language to process and plot the information that is contained in it.
For a protein of length num_res, the JSON has the following structure of arrays format:
[
{
"residue1": [ 1, 1, 1, 1, 1, ...], # Length: num_res^2.
"residue2": [ 1, 2, 3, 4, 5, ...], # Length: num_res^2.
"distance": [0.2, 1.2, 3.7, 6.6, 8.7, ...], # Length: num_res^2.
"max_predicted_aligned_error": 31.75
}
]
The fields in the JSON are:
residue1: The residue on which the structure is aligned for the predicted error.
residue2: The residue on which the error is predicted.
distance: The PAE value of the residue pair.
max_predicted_aligned_error: A scalar that denotes the maximum possible value of PAE. The minimum PAE is 0.
Since distance contains values for all residue pairs, it can be used directly by reshaping to a 2D matrix of shape [num_res, num_res]._

@JasperW01 I created a new branch HERE and added the PAE chart to the notebook number 03.
Could you please check out, test and validate if this is the expected result?

I have just tested and verified it's all working fine. Thx a lot for adding this feature, @leiterenato , which is popular with researchers.


Incus cannot create new instances

Describe the bug
~$ incus launch images:ubuntu/24.04 sample
Launching sample
Error: Failed instance creation: Failed to run: /nix/store/i9dkdkh6ndlvdqg94rxdfy7qp8bp09jq-incus-lts-6.0.1/bin/incusd forkstart sample /var/lib/incus/containers /run/incus/sample/lxc.conf: exit status 1
~ [1]$ incus info --show-log sample
Name: sample
Status: STOPPED
Type: container
Architecture: x86_64
Created: 2024/08/08 22:26 CEST
Last Used: 2024/08/08 22:26 CEST

Log:

lxc sample<PHONE_NUMBER>2646.963 ERROR    idmap_utils - ../src/lxc/idmap_utils.c:lxc_map_ids:245 - newuidmap failed to write mapping "newuidmap: write to uid_map failed: Invalid argument": newuidmap 1496505 0 1000000<PHONE_NUMBER> 0 1000000 65536
lxc sample<PHONE_NUMBER>2646.963 ERROR    start - ../src/lxc/start.c:lxc_spawn:1795 - Failed to set up id mapping.
lxc sample<PHONE_NUMBER>2646.963 ERROR    lxccontainer - ../src/lxc/lxccontainer.c:wait_on_daemonized_start:837 - Received container state "ABORTING" instead of "RUNNING"
lxc sample<PHONE_NUMBER>2646.964 ERROR    start - ../src/lxc/start.c:__lxc_start:2114 - Failed to spawn container "sample"
lxc sample<PHONE_NUMBER>2646.964 WARN     start - ../src/lxc/start.c:lxc_abort:1037 - No such process - Failed to send SIGKILL via pidfd 17 for process 1496505
lxc<PHONE_NUMBER>2646.999 ERROR    af_unix - ../src/lxc/af_unix.c:lxc_abstract_unix_recv_fds_iov:218 - Connection reset by peer - Failed to receive response
lxc<PHONE_NUMBER>2646.999 ERROR    commands - ../src/lxc/commands.c:lxc_cmd_rsp_recv_fds:128 - Failed to receive file descriptors for command "get_init_pid"

~$ incus start sample
Error: Failed to run: /nix/store/i9dkdkh6ndlvdqg94rxdfy7qp8bp09jq-incus-lts-6.0.1/bin/incusd forkstart sample /var/lib/incus/containers /run/incus/sample/lxc.conf: exit status 1
Try `incus info --show-log sample` for more info
~ [1]$ incus info --show-log sample
Name: sample
Status: STOPPED
Type: container
Architecture: x86_64
Created: 2024/08/08 22:26 CEST
Last Used: 2024/08/08 22:27 CEST

Log:

lxc sample<PHONE_NUMBER>2700.167 ERROR    idmap_utils - ../src/lxc/idmap_utils.c:lxc_map_ids:245 - newuidmap failed to write mapping "newuidmap: write to uid_map failed: Invalid argument": newuidmap 1496647 0 1000000<PHONE_NUMBER> 0 1000000 65536
lxc sample<PHONE_NUMBER>2700.167 ERROR    start - ../src/lxc/start.c:lxc_spawn:1795 - Failed to set up id mapping.
lxc sample<PHONE_NUMBER>2700.167 ERROR    lxccontainer - ../src/lxc/lxccontainer.c:wait_on_daemonized_start:837 - Received container state "ABORTING" instead of "RUNNING"
lxc sample<PHONE_NUMBER>2700.167 ERROR    start - ../src/lxc/start.c:__lxc_start:2114 - Failed to spawn container "sample"
lxc sample<PHONE_NUMBER>2700.167 WARN     start - ../src/lxc/start.c:lxc_abort:1037 - No such process - Failed to send SIGKILL via pidfd 17 for process 1496647
lxc<PHONE_NUMBER>2700.205 ERROR    af_unix - ../src/lxc/af_unix.c:lxc_abstract_unix_recv_fds_iov:218 - Connection reset by peer - Failed to receive response
lxc<PHONE_NUMBER>2700.205 ERROR    commands - ../src/lxc/commands.c:lxc_cmd_rsp_recv_fds:128 - Failed to receive file descriptors for command "get_init_pid"

~$ incus delete sample
~$

Notify maintainers
@aanderse
@adamcstephens
@jnsgruk
@megheaiulian
@mkg20001

Metadata

system: "x86_64-linux"
host os: Linux 6.10.2, NixOS, 24.11 (Vicuna), 24.11.20240731.9f918d6
multi-user?: yes
sandbox: yes
version: nix-env (Nix) 2.18.5
channels(root): "nixos"
nixpkgs: /nix/store/7v6l2v247fmdgfpbs3w91mf6rinai4yk-source

Add a :+1: reaction to issues you find important.

Please share the relevant configuration, including subuid/subgid configurations.

I’m building from the flake at https://github.com/schuelermine/configuration on commit a7f16e1 with hostname nailbox-on-buggeryyacht.
Incus-specific configuration is in https://github.com/schuelermine/configuration/blob/a7f16e1067bac44aa7e636b894f07d7ef093f939/nixosModules/configuration.nix on lines 44-57 and 133-173.

I set up this Incus install by enabling Incus in the NixOS configuration, then running lxd-to-incus, and then disabling the LXD installation and copying my pressed from LXD to Incus.

Instances that I transferred with lxd-to-incus are running fine. I can run programs in them, SSH into them, and move files to them.

Did you manually configure /etc/subuid or /etc/subgid?

Does the error occur with privileged containers? This error type sounds like something related to your user namespace configuration.

The error does not occur with privileged containers.

I have an idea of what might be causing this: I’m running from a disk that was installed to from a different computer. I wiped /nix and /etc and re-installed with appropriate hardware configuration, but I reset stateVersion thinking it’d be fine since I wiped /etc. Maybe that’s related?

I don’t think the incus or lxd modules have any state version conditions and shouldn’t store anything in /etc.
Clearly some state is on your system or you have an incompatibility with something that has changed in Incus. I know there has been some changes to the user mapping stuff, but am not sure how to tell you to proceed troubleshooting.
You could try starting a support thread in https://discuss.linuxcontainers.org/

I have created a thread: https://discuss.linuxcontainers.org/t/after-migrating-from-lxd-to-incus-i-can-t-create-new-unprivileged-containers/21334?u=anselmschueler

A restart of the service fixed it. I don’t know what the problem was.

I had a similar issue. My issue was resolved by removing virtualisation.lxd.enable = true, since lxd adds it's own subuid space.


Display latest OSM turn restrictions on the map

As we're expanding navigation mapping, we need a tileset that is regularly updated with all the turn restrictions from OSM (atleast daily). We're hitting the limits of Overpass+Shaktiman to do a global query and need alternate mechanisms to visualize existing restrictions on the map.
@geohacker  Since we only need to see the turn restrictions when zoomed in >z14, is it worthwhile to dynamically add it to the map as we browse around, just like http://restrictions.morbz.de/#19/37.78219/-122.41047 ?

cc @ajithranka

@planemad I see. I think we can do z14 dynamic fetch from Overpass somewhat reliably. We can fallback to couple of overpass instances.

@geohacker 👍  this is a highly useful mechanism to reuse for other GL tools, especially for doing QA checks.

Demo: http://billowy-view.surge.sh/#12.5/37.7749/-122.4194
The latency isn't too bad and the map is definitely usable. Should we go ahead and use it in osm-navigation-map?

@ajithranka this is great. I'm testing on 3G tether and works pretty well. Pretty sure overpass will also start caching some of the results. Let's roll this, can we add a spinner? :)
Nice work!

@ajithranka if I zoom in after loading the TRs, it makes more requests to Overpass. Do you think we can avoid this easily? Like store the previous bbox and then check if the new one is inside the previous before we make the request?
Not a big deal, just one way to keep Overpass a little less busy :)

The map should now show current turn restrictions after querying overpass.

A few comments:

The styling doesn't come off very clearly against the satellite base.
We might need to add text labels for clarity.

There's an issue with the way shaktiman's geojson flattening is implemented because of which we are losing a few features. I'll work on fixing this (but not as a priority).

Amazing @ajithranka! This is a really useful feature that we can reuse for different types of navigation features - turn lanes, traffic signals, road speeds, based on requirements.


⚠ Bofrost.be has degraded performance

In 97885c8, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 968 ms

Resolved: Bofrost.be performance has improved in 11400e0 after 6 minutes.


some AUR packages fail to build

I've tried compiling aur packages such as crosstool-ng and arm-linux-gnueabihf and both will fail at some point with the error bison: m4 subprocess failed: Operation not permitted below is a sample of the makepkg output
config.status: creating Makefile
  SED    'ct-ng'
  SED    'scripts/crosstool-NG.sh'
  SED    'scripts/saveSample.sh'
  SED    'scripts/showTuple.sh'
  GEN    'config/configure.in'
  GEN    'paths.mk'
  GEN    'paths.sh'
  DEP    'nconf.gui.dep'
  DEP    'nconf.dep'
  DEP    'lxdialog/yesno.dep'
  DEP    'lxdialog/util.dep'
  DEP    'lxdialog/textbox.dep'
  DEP    'lxdialog/menubox.dep'
  DEP    'lxdialog/inputbox.dep'
  DEP    'lxdialog/checklist.dep'
  DEP    'mconf.dep'
  DEP    'conf.dep'
  BISON  'zconf.tab.c'
bison: m4 subprocess failed: Operation not permitted
  BISON  'zconf.tab.c'
bison: m4 subprocess failed: Operation not permitted
make[2]: *** No rule to make target 'zconf.tab.c', needed by 'zconf.tab.o'.  Stop.
make[1]: *** [Makefile:167: build-lib-kconfig] Error 2
make: *** [Makefile:127: build] Error 2
==> ERROR: A failure occurred in build().
    Aborting...

Cross compiling does not work in WSL. Other architectures don't work, too. Including i686, ARM etc. There will be a workaround for this, though

Odd, I didn't run into this problem when compiling something such as musl-cross-make. Both compiling the tools and the output of the tools worked fine.


Build failures with incorrect procedure names

Results :
Failed tests:   shouldOnlyKeepFeaturesThatAddSomethingUnique(embedding.PruningTest): expected:<[9.0000, (..)
pruneEmbeddingsAndFeatures(embedding.PruningTest): arrays first differed at element [3]; expected:<MEAN_OUT_NEIGHBOURHOOD> but was:<MEAN_BOTH_NEIGHBOURHOOD>
makeModel(regression.LogisticTest): unable to read csv file for test data
Tests in error:
stream(embedding.DeepGLIntegrationTest): There is no procedure with the name algo.deepgl.stream registered for this database instance. Please ensure you've spelled the procedure name correctly and that the procedure is properly deployed.
write(embedding.DeepGLIntegrationTest): There is no procedure with the name algo.deepgl registered for this database instance. Please ensure you've spelled the procedure name correctly and that the procedure is properly deployed.
Tests run: 33, Failures: 3, Errors: 2, Skipped: 0
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 16.798 s
[INFO] Finished at: 2018-10-20T21:40:28-04:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12.4:test (default-test) on project neo4j-ml-models: There are test failures.
[ERROR]
[ERROR] Please refer to /Users/bradnussbaum/git/neo4j-graph-analytics/ml-models/target/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

This is build from latest master branch.

Yeh we changed the name of the procedure and I thought I'd updated the tests, but maybe I didn't push it or something. I'll check that other test too - perhaps an unnecessary ordering.


⚠ ClamAV has degraded performance

In 42bff17, ClamAV (https://spamassassin.apache.org/) experienced degraded performance:

HTTP code: 200
Response time: 67 ms

Resolved: ClamAV performance has improved in 57b0c46.


Scrolling in touch devices -  bug fixed

As mentioned in issues #83 and #69 - touching any smooth-dnd draggable in touch devices disabled the ability to scroll, until user taps outside of draggable. This is a very simple fix to this bug.

Hi, take a look at this lib, if you're having issues vue-dndrop @idanstrul

Hi, take a look at this lib, if you're having issues vue-dndrop @idanstrul

@amendx the same problem also exists in the vue-dndrop lib on touch devices (tested on Chrome on Android).
Perhaps the fix suggested by @idanstrul would also solve it?


OOM Error when app is left idle in network disconnected state

When application is left idle for sometime disconnected from network, it throws the OOM Error.
Throwing OutOfMemoryError "Failed to allocate a 104 byte allocation with 1592 free bytes and 1592B until OOM;

You can see the below logs to analyse how app is allocated incremental memory and trying to perform GC.
05-04 21:12:25.564 9343-9354/com.hapramp I/art: Background sticky concurrent mark sweep GC freed 62642(9MB) AllocSpace objects, 0(0B) LOS objects, 9% free, 85MB/94MB, paused 6.776ms total 47.018ms
05-04 21:12:26.197 9343-9354/com.hapramp I/art: Background partial concurrent mark sweep GC freed 39536(5MB) AllocSpace objects, 3(36KB) LOS objects, 15% free, 89MB/105MB, paused 6.492ms total 96.211ms
05-04 21:12:27.151 9343-9354/com.hapramp I/art: Background sticky concurrent mark sweep GC freed 52682(3MB) AllocSpace objects, 354(5MB) LOS objects, 8% free, 97MB/105MB, paused 6.235ms total 46.133ms
05-04 21:12:27.782 9343-9354/com.hapramp I/art: Background partial concurrent mark sweep GC freed 32907(2MB) AllocSpace objects, 228(3MB) LOS objects, 13% free, 101MB/117MB, paused 7.971ms total 114.249ms
05-04 21:12:28.851 9343-9354/com.hapramp I/art: Background sticky concurrent mark sweep GC freed 51103(3MB) AllocSpace objects, 366(5MB) LOS objects, 7% free, 109MB/117MB, paused 9.633ms total 52.583ms
05-04 21:12:29.564 9343-9354/com.hapramp I/art: Background partial concurrent mark sweep GC freed 33564(2MB) AllocSpace objects, 237(3MB) LOS objects, 12% free, 113MB/129MB, paused 10.325ms total 134.798ms
05-04 21:12:30.766 9343-9354/com.hapramp I/art: Background sticky concurrent mark sweep GC freed 49473(3MB) AllocSpace objects, 357(5MB) LOS objects, 6% free, 121MB/129MB, paused 11.450ms total 58.796ms
05-04 21:12:31.417 9343-9354/com.hapramp I/art: Background partial concurrent mark sweep GC freed 26901(2MB) AllocSpace objects, 189(3MB) LOS objects, 11% free, 125MB/141MB, paused 11.013ms total 154.523ms
05-04 21:12:32.443 9343-9354/com.hapramp I/art: Background sticky concurrent mark sweep GC freed 36985(3MB) AllocSpace objects, 267(5MB) LOS objects, 5% free, 133MB/141MB, paused 12.679ms total 58.709ms
05-04 21:12:33.124 9343-9354/com.hapramp I/art: Background partial concurrent mark sweep GC freed 25378(2MB) AllocSpace objects, 183(3MB) LOS objects, 10% free, 137MB/153MB, paused 9.552ms total 165.029ms
05-04 21:12:34.206 9343-9354/com.hapramp I/art: Background sticky concurrent mark sweep GC freed 37006(3MB) AllocSpace objects, 264(5MB) LOS objects, 5% free, 145MB/153MB, paused 13.009ms total 57.081ms

added check before any network call


BDay typing

I was using pylance to check types and the date + BDay stubs seems to be incorrect
All 3 (__rsub__, __add__, __radd__) should return pd.Timestamp, but instead they are inferred as datetime.date:
datetime.date(2023, 1, 1) + BDay(2)
datetime.date(2023, 1, 1) - BDay(2)
BDay(2) + datetime.date(2023, 1, 1)

https://github.com/microsoft/pylance-release/issues/4631

We need to know the version of the stubs that you have installed and a more complete example that runs.
To find the version of the stubs within VS Code, use this code
from pandas._version import _stub_version

Then in VS Code, put your mouse over _stub_version and it will show the version.

We need to know the version of the stubs that you have installed and a more complete example that runs.

Can reproduce on main:
import datetime
from pandas.tseries.offsets import BDay

datetime.date(2023, 1, 1) + BDay(2)
datetime.date(2023, 1, 1) - BDay(2)
reveal_type(BDay(2) + datetime.date(2023, 1, 1)) # datetime.date but pd.Timestamp at runtime

I was using pylance to check types and the date + BDay stubs seems to be incorrect

Technically it is correct because pd.Timestamp is a sub-class issubclass(pd.Timestamp, datetime.date) but it could be more precise :) Returning the correct sub-class may require many overloads, as there are many combinations (date/Timestamp/Tick/Day/BDay/...).

Thanks for confirming!
Doesn't it always return pd.Timestamp or an offset though? (and offset is not subclass of datetime.date)
Quickly cross-checking the examples I don't see any new cases where it could result in different, python-native types.

Your are welcome to open a PR, the relevant file is https://github.com/pandas-dev/pandas-stubs/blob/main/pandas-stubs/_libs/tslibs/offsets.pyi It is best to make changes and run the CI (poe test) to see whether the runtime and typing behavior agree :)
I think the line def __add__(self, other: _DatetimeT) -> _DatetimeT: ... is definitely wrong, an improvement may be def __add__(self, other: datetime.date) -> pd.Timestamp: ... even if that is not always the case.


User does not get email on multiple email accounts

"Ive already checked spam and just rechecked now nothing there.. ive try with gmail, hotmail and a work email @rona.ca and none of them where able to received the registration email."
Shane: Any insight on a user who is not getting a registration email sent to them (multiple email tries & not in spam) sendgrid? bug? us? them?
<EMAIL_ADDRESS>is the email he used to contact
User based in canada i think

Was it addressed?

unable to reproduce. only happens for the one user. closing for now.


QT error when attempting to open plugin

I have the following error when attempting to open the visualization of an image:
---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
~/.local/lib/python3.8/site-packages/napari_tools_menu/__init__.py in func(whatever=False)
     44         def func(whatever=None):
     45             # ugh
---> 46             napari_viewer = window._qt_window.qt_viewer.viewer
        napari_viewer = undefined
        global window._qt_window.qt_viewer.viewer = undefined
     47             action, type_, args, kwargs = action_type_tuple
     48             if type_ == "action":

AttributeError: '_QtMainWindow' object has no attribute 'qt_viewer'

here is my current napari installation config:
napari: 0.4.13.dev112+ge6ce01d9
Platform: Linux-5.11.0-41-generic-x86_64-with-glibc2.29
System: Ubuntu 20.04.3 LTS
Python: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0]
Qt: 5.15.2
PyQt5: 5.15.4
NumPy: 1.18.5
SciPy: 1.6.1
Dask: 2021.03.0
VisPy: 0.9.4

OpenGL:
- GL version: 4.6.0 NVIDIA 470.86
- MAX_TEXTURE_SIZE: 16384

Screens:
- screen 1: resolution 1920x1080, scale 1.0

Plugins:
- Visualization(B/C): 0.1.4
- console: 0.0.4
- napari-tools-menu: 0.1.6
- scikit-image: 0.4.13.dev112+ge6ce01d9
- svg: 0.1.4

Hi @RaananHadar ,
thanks for reporting this issue! Would you mind trying it on the current napari release 0.4.12?
Thanks!
Best,
Robert

And would you mind trying again on the current napari main branch version? I just tried with napari 0.4.13-dev116 and it also works...

Hi @RaananHadar ,
I just fixed a related issue. Would you mind updating napari-tool-menu and napari-brightness-contrast? You issue should then also be gone.
Let me know if this helps!
Thanks,
Robert

Thanks @haesleinhuepf this solved the issue!


Typo in first sentence

"UWP app that uses th Windows"
Need to change th to the.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 21a59145-2721-5b06-eb10-6b2e6d5af7ac
Version Independent ID: 0f10e286-8759-cc74-dcef-aa7c1334607e
Content: Write a custom plugin for device portal - UWP applications
Content Source: windows-apps-src/debug-test-perf/device-portal-plugin.md
Product: uwp
Technology: deployment
GitHub Login: @Karl-Bridge-Microsoft
Microsoft Alias: kbridge

Thanks. The topic has been updated.
For future reference, you can use our Open Publishing system to submit PRs to fix issues like this. Just click the "Edit" button near the top of the topic to open the GitHub editor.


About code issues

Hello, can the code in Figure 3 in the paper be published? I want to see a section of that code. Thank you

Hi, you can find the code for emotion recognition in https://github.com/anita-hu/MSAF/tree/master/ravdess. Our model code can be found in https://github.com/anita-hu/MSAF/blob/master/ravdess/networks/msaf_ravdess.py

thank you very much


Adds an option to disable auto insert

Roslyn side fix: https://github.com/dotnet/roslyn/pull/74485
To fix: #6349

/azp run dotnet.vscode-csharp


Empty commit in the overlay causes panic

We need to calculate the correct RootHash and Version to return when the overlay is empty.
This is relatively low-priority, because this situation never occurs in our use case.

Closed by #60.


Recent Updates - support error handling

This is a...

[x] Feature request
[ ] Regression (a behavior that used to work and stopped working in a new release)
[ ] Bug report
[ ] Documentation issue or request

Description
See screenshot. RecentUpdatesCard component does not support errors at networking level like some other components do.
See https://github.com/syndesisio/syndesis-react/blob/638933e7c2e5ea912c7b079bfe5bc7aeced64d01/app/ui-react/syndesis/src/modules/dashboard/pages/DashboardPage.tsx#L225

This was fixed by #367


ERR_HTTP_HEADERS_SENT Cannot set headers after they are sent to the client

I'm getting this error, I think it is related to this module,  I used the example from react-i18next, with nextjs.
I'm using this detection config:
    detection: {
      order: ['querystring', 'cookie', 'header'],
      lookupQuerystring: 'lng',
      lookupCookie: 'lng',
      lookupSession: 'lng',
      caches: ['cookie'],
    }

My browser is in pt-BR, and I request the page with ?lng=en, I think it sets up the pt-BR language, then it tries to set to en and the server crashes with this error.
I can  post the entire server.js if it would help.

I had the same issue with v1.0.9 but with v1.0.10 it should be solved try to update your version. If it still doesn't work, it should :), then you can fix it by checking if the res._headerSent is false before calling the cacheUserLanguage.

I did a quickfix by checking if the headers are set before setting the cookies. I thought it was fixed with 1.0.10 but I realized I had the cache set to false :) I will create a PR for the fix as soon as I can.


duplicated drilldowns result in malformed data

Taking as example this query, we get:
{"data":[
  {"Flow ID": 1, "Flow": "Exports", "Total":<PHONE_NUMBER>97},
  {"Flow ID": 2, "Flow": "Exports of goods of Estonian origin", "Total":<PHONE_NUMBER>1},
  {"Flow ID": 3, "Flow": "Imports by country of consignment", "Total":<PHONE_NUMBER>42},
  {"Flow ID": 4, "Flow": "Imports by country of origin", "Total":<PHONE_NUMBER>92}
]}

If we duplicate the drilldown we get a malformed dataset:
{"data":[
  {"Flow ID":<PHONE_NUMBER>97, "Flow": "Exports"},
  {"Flow ID":<PHONE_NUMBER>1, "Flow": "Exports of goods of Estonian origin"},
  {"Flow ID":<PHONE_NUMBER>42, "Flow": "Imports by country of consignment"},
  {"Flow ID":<PHONE_NUMBER>92, "Flow": "Imports by country of origin"}
]}

This looks very similar to the result data I described on issue #26.
I just pushed a fix on tesseract-client to prevent duplicated parameters, but the bad url could still be crafted on another environment and led to errors.

Thanks for the heads up. This will be handled as part of an overhaul of query verification, soon!

#151


Feature/#4

Added heuristic filters similar to MassiveText's Quality Filtering which can be helpful for web crawled datasets

Add MassiveText quality filters
Add test code for massiveteqxt quality filters (still working on test code though)

Ref: #4

I modified the test code to verify example cases.


Status on resources in Alpha and when they are going into Beta. How stable are Beta resources in general?

What: We need as many AWS resources in Beta as possible, because this is our minimum version requirement to push a given resource into GA in our Hellman cluster
Why: Because we want as many AWS resources exposed as possible, so we avoid having to mix-and-match between Terraform and Crossplane

[ ] Verify fix of https://github.com/aws-controllers-k8s/community/issues/1089 (not very relevant)
[ ] Review list of beta features vs existing issues (see comments) to ensure all GA resources are covered
[ ] Test new resources and wrap them in RBAC components
[ ] Demo for team
[ ] Sign-off with Upbound

https://github.com/dfds/backstage/issues/419

Compiled a list to get an overview of which resource and XR is missing for GA:

Priority
Resource
group
Available in Beta ?
API Doc
XR Done ?
Github Issue for XR

1
Repository
ecr.aws.crossplane.io
yes
<EMAIL_ADDRESS>no
https://github.com/dfds/backstage/issues/467

1
RepositoryPolicy
ecr.aws.crossplane.io
yes
<EMAIL_ADDRESS>no
https://github.com/dfds/backstage/issues/467

1
SNSTopic
notification.aws.crossplane.io
no
<EMAIL_ADDRESS>no

1
SNSSubscription
notification.aws.crossplane.io
no
<EMAIL_ADDRESS>no

1
Function
lambda.aws.crossplane.io
no
<EMAIL_ADDRESS>no

2
Certificate
acmpca.aws.crossplane.io
yes
<EMAIL_ADDRESS>no
https://github.com/dfds/backstage/issues/432

2
CertificateAuthority
acmpca.aws.crossplane.io
yes
<EMAIL_ADDRESS>no
https://github.com/dfds/backstage/issues/433

2
CertificateAuthorityPermission
acmpca.aws.crossplane.io
yes
<EMAIL_ADDRESS>no
https://github.com/dfds/backstage/issues/435

2
VPC
ec2.aws.crossplane.io
yes
<EMAIL_ADDRESS>no

2
VPCCIDRBlock
ec2.aws.crossplane.io
yes
<EMAIL_ADDRESS>no

2
VPCLink
apigatewayv2.aws.crossplane.io
no
<EMAIL_ADDRESS>no

2
DBCluster
docdb.aws.crossplane.io
no
<EMAIL_ADDRESS>no

2
DBClusterParameterGroup
docdb.aws.crossplane.io
no
<EMAIL_ADDRESS>no

2
DBInstance
docdb.aws.crossplane.io
no
<EMAIL_ADDRESS>no

2
DBSubnetGroup
docdb.aws.crossplane.io
no
<EMAIL_ADDRESS>no

2
Table
dynamodb.aws.crossplane.io
no
<EMAIL_ADDRESS>no

1
Bucket
s3.aws.crossplane.io
yes
<EMAIL_ADDRESS>yes

one interesting to notice that IAM resources changed in despite of being in Beta1. They changed both Name and API groups.
Example
<EMAIL_ADDRESS>vs
<EMAIL_ADDRESS>Wasn't Beta resources meant to be stable?

it's more important to have guarantee on the stability of beta resources than the availability of resources

Hey Sami. We are following https://kubernetes.io/docs/reference/using-api/#api-versioning
Which notes under beta:

The schema and/or semantics of objects may change in incompatible ways in a subsequent beta or stable release. When this happens, migration instructions are provided. Schema changes may require deleting, editing, and re-creating API objects. The editing process may not be straightforward. The migration may require downtime for applications that rely on the feature.

In the release notes, we clearly called out the Breaking Changes and how to migrate: https://github.com/crossplane/provider-aws/releases/tag/v0.22.0
I would love to understand what you need the guarantees for and if there possible other ways to support you.

@luebken the link above, says this "The software is not recommended for production uses" about software in Beta versions and it is what we don't want, we want production use and we want something stable

will be dealt with the alignment meeting


add warning about potential exposure to XSS attacks?

hey there -
very helpful library - thanks for putting it together. i realize this could be seen as out of scope (ref) but figured i'd suggest it anyway.
if you naively embed the raw JSON provided via transit.toJSON into your html page, you expose yourself to XSS attacks.
simple example:
// somewhere on your server
var data = transit.toJSON({ xss: '</script><script>alert(\'evil\');</script><script>' });

// somewhere in your html / view rendering
<script id="my-data" type="application/json">${data}</script>

might want to just throw a little disclaimer into the docs - i can take a crack at it if you agree :)
-matt

Does the same thing happen when using JSON.stringify?
A note in the docs sounds good, PR welcome.

Does the same thing happen when using JSON.stringify?

yep, it's a fairly well-known gotcha :-/

A note in the docs sounds good, PR welcome.

done --> https://github.com/glenjamin/transit-immutable-js/pull/24
thanks again for the lib!

Nice one, thanks!


Which Alphabet?

It appears there can be different Base64 "alphabets" depending upon the transport protocol to be used. As such, it would be advisable to document which alphabet is in use and which standard (if any) it matches.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 9d685c7f-67a9-6293-d1c8-d01080d72762
Version Independent ID: 77fc3c98-d0a6-f508-215e-f16ae834ff19
Content: CryptographicBuffer.DecodeFromBase64String(String) Method (Windows.Security.Cryptography) - Windows UWP applications
Content Source: https://cpubwin.visualstudio.com/DefaultCollection/windows-uwp/_git/winrt-api-build?path=%2fwinrt-api-build%2fwindows.security.cryptography.cryptographicbuffer.yml&version=GBlive&_a=contents
Product: uwp
Technology: winrt-reference
Git Login: lastnameholiu
Microsoft Alias: alholiu

Closing this thread as there is a duplicate one opened.


BUG: Spatial interpolation can produce negative values in positive fields

Interpolating across a large gradient (e.g. 25->0) can produce small negative values at what should be the 0 edge. This may be a nearly unavoidable rounding/truncation error, but needs to be investigated as it can create issues for precipitation.
This is probably identical to NCAR/GARD#63 as they use the same regridding code.

Note this is fixed in the develop branch so closing for now.


support of TFlite of Snapdragon888 dsp

Hi @shuki-k
Sadly this is not possible.
These new chips uses a newer version of HVX that is different than what Hexagon delegate supports.
Originally posted by @karimnosseir in https://github.com/tensorflow/tensorflow/issues/47246#issuecomment-783807697

when will Snapdragon 888 DSP be supported with TFlite? is it in the roadmap ?


Full text search not working if the start is not correct (even with *)

From nexus-kg created by antonelepfl : BlueBrain/nexus-kg#281
I'm trying to full search by part of the entity name.
BASE = https://nexus-int.humanbrainproject.org/v0/data/brainsimulation/simulation/memodel/v0.1.1
We have an entity
BASE/a27fdf49-1798-4b76-99d5-4cf8afe3c31b
This entity has the name attribute CA1_int_cAC_031031AM1_20180201104443
If I query:
BASE?q=CA1_int_cAC_031031AM1_20180201104443 -> Works
BASE?q=*CA1_int_cAC_031031AM1_20180201104443* -> Works
BASE?q=*CA1_int_cAC_031031AM1* -> Works
BASE?q=*031031AM1_20180201104443* -> NOT Working (I removed some part from the beginning)

Unless critical, we don't plan on fixing v0 issues. With v1 I would argue that this is no longer an issue as a client can target specifically the elastic search index. The issue was caused by the limited full text search support in BlazeGraph.
@pgetta does that seem reasonable to you?

Great, that works for me, thank you @bogdanromanx!

We are switching to ElasticSearch to perform full text search. Not relevant


Reduce package size

The character ranges  in neutral category is not needed, since lookup returns neutral by default.

Reduce lookup.js from 34KB to 9KB.


Add event recorder

Signed-off-by: Sambhav Kothari<EMAIL_ADDRESS>

Closing as this has gone stale. Can we re-open or create an issue to discuss?


New release

Do you think it would be possible to get a new release of milkdown for vscode? I saw that the editor itself has had quite a few updates that would be nice to have in vscode as well.

I'm working on it, I hope I can release a new version in Oct.


[Python][Parquet] Parquet Support write and validate CRC

Describe the enhancement requested
Now, C++ Parquet API already supports CRC in reading and write.
Though system like S3 will ensure the storage data works well. But some data storage like HDD or SSD might corrupt. And network might provide bad result. So having CRC would helps.
Now it's better to has crc in Python code.
Component(s)
Parquet, Python

I'll take this!


Support nats streaming server

Does this library support nats streaming server?

Not currently, but planning to support eventually with another library which uses this as a dependency

That's too bad! I was really looking at nats for the streaming server pieces. Do you have a timeline?

See http://github.com/mackeyja92/asyncio-nats-streaming


Docs: Document and publish Colors design guidelines

Document color variables, usage and design guidelines
Steps

Create a markdown file in the styleguide/src/sections/ folder by clicking Create a new file
Add guidelines into this markdown file
Scroll down and Click Commit with the 🔘 Create a new branch for this commit and start a pull request.  turned on.
Keep editing that file.
Add the name of that file to the table of contents, here: https://github.com/reactioncommerce/reaction-component-library/blob/master/styleguide.config.js#L251

Color - zpl://screen?sid=5ab40ad441ffd6ee46ec97a0&pid=59305ed4ac6e641b8ea32f76

:tada: This issue has been resolved in version 0.14.4 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


[BUG]  [cardano-api] - Utxo Redeemer Pointer mismatch in TxBody

External : Plutus Partners
I have very grim about anybody here, reading this issue, but here it goes..
Context :
When trying to redeem from script in a complex transaction I got following error.
ShelleyTxValidationError ShelleyBasedEraAlonzo (
    ApplyTxError [
     UtxowFailure (ExtraRedeemers [RdmrPtr Spend 2]),
     UtxowFailure (MissingRedeemers [(Spending (TxInCompact (TxId {_unTxId = SafeHash "f1faf6f98e39c5b4b1a2fd544df64117213fa0b09740afe33b3de45f170da68a"}) 0),ScriptHash "a75abe73708b263d086f9b0d298dcaddff37c0892e9425675a6d26e9")
])

Reason :
in makeTransactionBody function, the txins are mapped  to Shelley with the following function
Set.fromList (map (toShelleyTxIn . fst) txIns

It should be noted that the newly constructed set may not have the txIns in same order because the data are different.
But to calculate RedeemerPtr in the redeemers, the txIns are directly used in previous order
Workaround For Now :
Before calling makeTransactionBody , reorder the txIns in TxBodyContent
reorderInputs :: [(TxIn, a)] -> [(TxIn,a)]
reorderInputs txIns = map ((\key-> (key,forceJust $ Map.lookup key  mapped)) . fromShelleyTxIn) ordered
  where
    ordered =  Set.toList $  Set.fromList (map (toShelleyTxIn . fst) txIns)
    mapped = Map.fromList txIns
    forceJust (Just a) = a

same

I think the problem is that there's no way for nodes to recognize which redeemer is for which script-input. For example, if there are two script-inputs and two redeemers in the witnesses - nodes have no way to somehow match a redeemer to a script, except matching them by order.
Although it's definitely feels like a problem that nodes don't skip non-script inputs, so even if there's a single script input at all - it always MUST be on the very first position, or it will never get matched with the redeemer.

Feels like a logical convention would be to require for there to be same number of redeemers as there are script inputs and for the redeemers to be in the same order as script inputs in the input list, but not necessarily match inputs and redeemers index-to-index - i.e. redeemer on index 0 is assumed to be for the input on index 0 - this is how it works atm.

think the problem is that there's no way for nodes to recognize which redeemer is for which script-input. For example, if there are two script-inputs and two redeemers in the witnesses - nodes have no way to somehow match a redeemer to a script

This is incorrect. Redeemers are stored in a transaction as map of pointers to redeemers data. Those pointers explicitly refers to transaction inputs (or minting policies, or withdrawals, or certificates depending on the redeemer's type) and are unambiguous.

But to calculate RedeemerPtr in the redeemers, the txIns are directly used in previous order

I don't think this is the case. Inside makeTransactionBody, redeemer pointers are ultimately figured out from https://github.com/input-output-hk/cardano-node/blob/333c701ca9be38e5d955c9d3ee0fab391e85e4f4/cardano-api/src/Cardano/Api/TxBody.hs#L2819 which correctly takes care of ordering transaction inputs lexicographically as they also are in the input set: https://github.com/input-output-hk/cardano-node/blob/333c701ca9be38e5d955c9d3ee0fab391e85e4f4/cardano-api/src/Cardano/Api/TxBody.hs#L2839-L2843

@mesudip are you by any chance "fiddling" with the transaction after makeTransactionBody , like, adding change input/output to it before passing it to the node?

Note that even if you want to impose an order on the input by making your own makeTransactionBody function (e.g., use of Set.fromAscList instead of Set.fromListto preserve txins order from TxBodyContent) and properly patch the collectTxBodyScriptWitnesses, you will still be faced with an ordering issue when submitting the transaction to cardano-node (either via cli or directly using cardano-api). In fact, when cardano-node will decode the transaction, it will implicitly reapply Set.fromList, which can alter the input order. So no ordering other that txId order can be imposed on transaction input.

@KtorZ , I am api as follows

create dummy transaction with minFee, exUnits and change and  call makeTransactionBody
use evaluateTransactionExecutionUnits and update it, and recall makeTransactionBody
reCalculate Fee and call makeTransactionBody. Now we are ready to sign the tx :)

and update it

That's the part I am the most interested about. What kind of update :) ?

Closing this. If this is still relevant please reopen.


Show tracebacks in results

YES YES YES YES. +1

Nice :+1:

Very nice! I hate having to log-dig for those.


comment

// Create a delicious data source.

Thanks for this hilarious comment.
And by the way, how dare you put "apple" in your 'fruits' array?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

Closing as kudos.


Feat: Add strict analyser rules

Close #210

Codecov Report
Attention: Patch coverage is 49.70588% with 171 lines in your changes are missing coverage. Please review.

Project coverage is 54.45%. Comparing base (cc11563) to head (4807a99).

Files
Patch %
Lines

lib/tools/repository/repository.dart
0.00%
115 Missing :warning:

lib/login/repositories/sign_up_repository.dart
0.00%
6 Missing :warning:

lib/recommendation/class/recommendation.dart
14.28%
6 Missing :warning:

lib/vote/repositories/status_repository.dart
0.00%
6 Missing :warning:

lib/auth/providers/openid_provider.dart
0.00%
5 Missing :warning:

lib/tools/repository/logo_repository.dart
0.00%
5 Missing :warning:

...ib/amap/repositories/delivery_list_repository.dart
0.00%
4 Missing :warning:

lib/tools/functions.dart
0.00%
4 Missing :warning:

lib/tools/token_expire_wrapper.dart
0.00%
3 Missing :warning:

lib/user/repositories/user_repository.dart
0.00%
3 Missing :warning:

... and 12 more

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #320      +/-   ##
==========================================
- Coverage   55.79%   54.45%   -1.35%
==========================================
  Files         164      164
  Lines        3579     3684     +105
==========================================
+ Hits         1997     2006       +9
- Misses       1582     1678      +96

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Merge develop to CGD2D branch

@DHowett-MSFT is added to the review. #Closed

@MSFTFox is added to the review. #Closed

@msft-Jeyaram is added to the review. #Closed

:shipit:

:shipit:

technically i am merging CT-DW onto CGD2D.

:shipit:


core.engine: Enable selftest() method

The selftest method has been suppressed in a previous change. It seems better to run it and for all available features (including both features that are always enabled and ones that are only optionally enabled).
Currently fails in the app restart-on-error part of the tests. This feature is not currently enabled by default but it should still be working and tested.

Superseded by #697.


Ui redesign

This branch has been around for a while but I think the new interface is pretty clean now. There are probably still a few changes to be made but I think we've got a pretty solid base.
We've still got the reorderable lists on the feature/reorderable-list branch, but they need more complex changes to the code, and that's not urgent.
As for the title bar, we'll have to wait for the feature to arrive on the Godot side (it's pretty buggy at the moment) but we'll do that later.

Thanks a lot for all these fixes! I'm glad you like these changes!


Nehal gupta

Assigned Issue Number ?
#1408
Language Opted ?
C++
Number of files added or updated ?
1
Name of these files ?
Data_Structures=>Linked_List=>Singly_Linked_List
Checklist

[x] I've read the contribution guidelines.
[x] I've referred the correct issue number.
[x] I've fill up this entire template correctly.

C++ implementation has already been assigned to someone else. :warning:


refactor: add Dart linting rules and change code to follow rules

This PR adds the following:

It adds .gitignore file
It adds the package lints to dev_dependencies
It adds the file analysis_options.yaml which contains the linting rules from the lints package
It changes the code to follow the rules.

This repo is generated together with all the Appwrite SDKs by the https://github.com/appwrite/sdk-generator. This repo is read-only.


[TextInput-1087] Add TextEditor for SwiftUI & UIKit

This PR contains :

The viewModel for the TextEditor
The TextEditor in UIKit (from UITextView)
The TextEditor in SwiftUI (from multliline TextField)

Header targets are often different, could be nice to uniformize them

Can you explain more please ?


Python 3.10 support

More specifically the match..case syntax, it seems to be break the parser
Here's an example on Replit

def http_status(status):
  match status:
    case 400:
      return "Bad request"
    case 401 | 403:
      return "Authentication error"
    case 404:
      return "Not found"
    case _:
      return "Unknown error"

@lezer/python 1.1.0 should add this.


Automatic logout session

Description
I successfully reinstalled Wppconnect-server. After scanning the QR code with WhatsApp, I logged in successfully. However, after a few seconds, it automatically logs out. When I check the connection session, it returns: {"status": false, "message": "Disconnected"}. I confirm that I logged in successfully.
Environment

Wppconnect-server version(s): [2.4.6]
Browser: [Chrome 125.0.6422.141]
OS: [Ubuntu 24]
Node version: [Node 20.14.0]
WhatsApp version: [2.3000.1013232587-alpha]
MultiDevice (BETA): no
config.json: config.txt

Steps to Reproduce

generate-token
start-session
qrcode-session
check-connection-session

Parameters
Log Output
[Log.txt](https://github.com/user-attachments/files/15809719/Log.txt)

git clone https://github.com/wppconnect-team/wppconnect-server.git && cd wppconnect-server


Doc IOptionsBuilder  for 2.1

Doc new IOptionsBuilder and related overloads, see https://github.com/aspnet/Security/issues/1718#issuecomment-380204790 its related to this general idea of being able to more easily configure options with things from DI
See #5922

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: ed39cb0e-aa85-8bba-ffb4-859b56a60723
Version Independent ID: dc7e3449-650b-d117-5eac-69e5ccb250cb
Content: Options pattern in ASP.NET Core
Content Source: aspnetcore/fundamentals/configuration/options.md
Product: aspnet-core
GitHub Login: @guardrex
Microsoft Alias: riande

Dup of https://github.com/aspnet/Docs/issues/5924.


some changes of settings.(django/conf/global_settings.py)

this to keep to as most of settings error is due to Formation of import os so let's fix it.

There is no need to import os in the settings.py template, it doesn't use os.


[Bug] Inconsistency between --remux and --exec

Checklist

[x] I'm reporting a bug unrelated to a specific site
[x] I've verified that I'm running yt-dlp version 2021.10.10
[x] I've checked that all provided URLs are alive and playable in a browser
[x] The provided URLs do not contain any DRM to the best of my knowledge
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar bug reports including closed ones
[x] I've read the opening an issue section in CONTRIBUTING.md
[x] I have given an appropriate title to the issue

Verbose log
$ ytdl -F kjyKUIx3Ou8
[youtube] kjyKUIx3Ou8: Downloading webpage
[youtube] kjyKUIx3Ou8: Downloading android player API JSON
[info] Available formats for kjyKUIx3Ou8:
ID  EXT  RESOLUTION FPS |  FILESIZE    TBR PROTO | VCODEC                           VBR ACODEC     ABR  ASR    MORE INFO
--- ---- ---------- --- - ---------- ----- ----- - ------------------------------ ----- --------- ---- ------- -----------------------
139 m4a  audio only     |  388.89KiB   48k https |                                      mp4a.40.5  48k 22050Hz low (AND), m4a_dash
249 webm audio only     |  385.48KiB   48k https |                                      opus       48k 48000Hz low (AND), webm_dash
250 webm audio only     |  503.96KiB   63k https |                                      opus       63k 48000Hz low (AND), webm_dash
140 m4a  audio only     |  1.00MiB    129k https |                                      mp4a.40.2 129k 44100Hz medium (AND), m4a_dash
251 webm audio only     |  995.65KiB  125k https |                                      opus      125k 48000Hz medium (AND), webm_dash
17  3gp  176x144    7   |  629.82KiB   79k https | mp4v.20.3                        79k mp4a.40.2   0k 22050Hz 144p (AND)
394 mp4  176x144    30  |  371.46KiB   46k https | av01.0.00M.<IP_ADDRESS>.01.06.0   46k                        144p (AND), mp4_dash
160 mp4  176x144    30  |  204.23KiB   25k https | avc1.4d400b                      25k                        144p (AND), mp4_dash
278 webm 176x144    30  |  492.40KiB   62k https | vp9                              62k                        144p (AND), webm_dash
395 mp4  294x240    30  |  476.46KiB   60k https | av01.0.00M.<IP_ADDRESS>.01.06.0   60k                        240p (AND), mp4_dash
133 mp4  294x240    30  |  359.10KiB   45k https | avc1.4d400d                      45k                        240p (AND), mp4_dash
242 webm 294x240    30  |  578.54KiB   72k https | vp9                              72k                        240p (AND), webm_dash
18  mp4  352x288    30  |  2.63MiB    338k https | avc1.42001E                     338k mp4a.40.2   0k 44100Hz 240p (AND)

$ ytdl -f b --remux mkv --exec 'echo _filename: %(_filename)s' --exec 'echo old style: {}' kjyKUIx3Ou8
[youtube] kjyKUIx3Ou8: Downloading webpage
[youtube] kjyKUIx3Ou8: Downloading android player API JSON
[info] kjyKUIx3Ou8: Downloading 1 format(s): 18
[download] Destination: HIKAKIN Beatbox-kjyKUIx3Ou8.mp4
[download] 100% of 2.63MiB in 00:00
[VideoRemuxer] Remuxing video from mp4 to mkv; Destination: HIKAKIN Beatbox-kjyKUIx3Ou8.mkv
Deleting original file HIKAKIN Beatbox-kjyKUIx3Ou8.mp4 (pass -k to keep)
[Exec] Executing command: echo _filename: HIKAKIN Beatbox-kjyKUIx3Ou8.mp4
_filename: HIKAKIN Beatbox-kjyKUIx3Ou8.mp4
[Exec] Executing command: echo old style: '/home/lesmi/tmp/HIKAKIN Beatbox-kjyKUIx3Ou8.mkv'
old style: /home/lesmi/tmp/HIKAKIN Beatbox-kjyKUIx3Ou8.mkv

Description

When --remux-video is used, the _filename field passed to --exec is different from the final filename.
This happens when filename has been changed by --remux-video, so theoretically it shouldn't happen when -f bv+ba, or the original format is MKV, in this case.

Use filepath, not _filename. The _filename field is only meant for internal housekeeping and is the filename assigned before any PPs run. Actually, it is not even used in yt-dlp any longer. I only keep populated it because I know there are thrid-party scripts that depend on it


Fix soc7 repo path

rebased + fix cloud_repo_path in setup_zypper_repos to handle SOCC7 as well

Please reuse #3566 instead of creating a new PR.


Files don't stop doing things when deleted?

Describe your bug here.
There is a bug where scripts will keep running, even when deleted. I tried removing them from the recycle bin and not even that fixed it.
Command Prompt/Terminal logs (if existing)
No response
Are you modding a build from source or with Lua?
Source
What is your build target?
Windows
Did you edit anything in this build? If so, mention or summarize your changes.
Added two new pause menu tracks

Delete it from the export

It's not a bug, it keeps files cached until you close the game or enter a song from another mod/vanilla to reduce loading times.


Create visualisations having the same temporal span

It would be good if the users can view data with different temporal frequency in a common temporal extent. This would require resampling of one versus the other
eg. variable x temporal frequency is in minutes
variable y temporal frequency is in days

@thanosbnt does this get addressed through front filling in the DB? Or at the moment does the API just pass the data with it's existing timestamps to the front end?


Support bulk delete

As a content user I want to be able to bulk delete documents that meet a certain criteria, so that I can reduce time spent on repetitive actions.

I'd like to clarify that this is not a burning issue for me. Clearly single delete works. Bulk deletions can be done today via API. There was a couple of times I wanted this so I posted this.


Fix: update a specific package.

fixes #455
@nvie check please.

No, this breaks updates if *.in file changed.


minor: Rename some assists

Trying to make our assist names a bit more uniform
fill_match_arms -> add_missing_match_arms
infer_function_return_type -> add_return_type
replace_impl_trait_with_generic -> introduce_named_generic
bors r+

bors retry

bors retry


Simplify m4 and bison rules with "org_gnu_gnulib" and fixup "tk_tcl" build

Can be used by GNU tools like m4 and bison.
This change consolidates the portability and Bazel works of GNU tools
into a unified place, in effect offloads the HARD parts from them.
Hopefully, this will make it easier for us to maintain rules of those
tools.
Plus, this version of gnulib is fairly recent, which provides much
better compatibility.
Most of the rule comes from https://github.com/jmillikin/rules_m4,
which is licensed under Apache 2.0.

error running 'git fetch origin refs/heads/*:refs/remotes/origin/* refs/tags/*:refs/tags/*' while working with @org_tuxfamily_eigen:
error: RPC failed; curl 56 GnuTLS recv error (-54): Error in the pull function.
fatal: The remote end hung up unexpectedly
fatal: early EOF
fatal: index-pack failed

Well. Not my fault. Is there a way to rerun?
/gcbrun
?

Did you verify that bison can be built under MacOS ? In verible, we once switched to the jmillikin rules to get a working compilation across platforms (as there were otherwise all kinds of troubles with gnulib and m4); just want to make sure that these jmillikin-derived rules preserve that property.

Did you verify that bison can be built under MacOS ? In verible, we once switched to the jmillikin rules to get a working compilation across platforms (as there were otherwise all kinds of troubles with gnulib and m4); just want to make sure that these jmillikin-derived rules preserve that property.

At the moment, I can't say for sure about macOS support with this PR.
However, I am fairly sure that the rules (w/o this PR) do not work for macOS right now. This PR brings substantial portability improvement, and we can certainly try to further improve to support macOS in the future.

I manage to test on a macOS machine. With this PR, it is indeed possible to compile working bison and m4 executable on macOS.

Bump!
Can someone 🚢 this?

Should this be merged? @QuantamHD

Sorry for the late reply @jesec merging now.


Guests should be able to call /context/... and /room/.../event/...

Since this operation is about retrieving an event which is very handy for projects who use guests as readonly viewers of events.
It's also worth pointing out that synapse supports guest access to context, but not event.

I seem to recall some discussion in a room somewhere about this - is there a public link we can append to this? Preferably something that says it should be a spec issue :)

I mean I asked about it once in #matrix-core and there was no response. I don't remember a discussion

Discussion at: https://matrix.to/#/!HCXfdvrfksxuYnIFiJ:matrix.org/$1534757519427CTGeg:half-shot.uk
Conclusion: It's a bug that the spec doesn't say it's guest accessible. As for /event: this should be guest accessible, and is a synapse bug that it isn't (as some guests may want to peek without getting the entirety of /context).


:bug: fix the stc type inference

Description: This pull request  Closes #720 , I changed the type from [number] to [number, (string | undefined)]

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Hello @kdy1 , sorry for the disturbance, although I tried fixing the issue, am not really sure if it's correct, mainly because I am somehow new to building type checkers, can you please on your own time suggest resources that I can learn from to continue contributing to your amazing stc project.