Safetensors stop working at 97%

I try to fine-tuning LLma 3.2 vision model. The python code stop running at safetensors 97%. I think, this is downloading the pretained model (model_name = "unsloth/Llama-3.2-11B-Vision-Instruct"). No other error messages is seen. I run the python code in Nvidia-docker "PyTorch:24:10-py3" on DGX A100 40 GB using 1 GPU.
unsloth==2024.11.11 torchvision==0.20.1
I try to change location of cache directory but it doesn't work.  How to fix it.

It might be the fast downloading breaking up - you'll have to restart it sadly

Facing same issue, Tried multiple times, with 7b and 34b, same result. How many retry should I attempt to make it a success? Can anyone suggest a fix? Thanks in advance.

@Muhammadkamrul Try before importing Unsloth:
import os
os.environ["HF_HUB_ENABLE_HF_TRANSFER"] = "0"
...

Tried after adding those line, no the progress bar is not showing and it stuck forever.

Oh wait if it stops, that's a weird sign - do you know if normal transformers functions normally?

I did not understand what you mean by "normal transformers functions normally". Can you elaborate? Thanks.


Testing error case fails

Issue
Trying to test that an endpoint returns an error status code (like 400) fails.
Details
https://github.com/twhitbeck/superoak-testcase

run the server
curl localhost:8080/create -H "Content-Type: application/json" -d "{\"url\":\"foo\"}" -v
note response status code is 400

I'm trying to create a test case that this endpoint will respond with 400.

deno test --allow-net

[uncaught oak error]: BadRequestError - Invalid url

request: { url: "http://<IP_ADDRESS>:19542/create", method: "POST", hasBody: true }
response: { status: 404, type: undefined, hasBody: false, writable: true }

    at createHttpError (https://deno.land/x/oak@v9.0.0/httpError.ts:128:10)
    at Context.throw (https://deno.land/x/oak@v9.0.0/context.ts:177:17)
    at file:///home/twhitbeck/src/local/superoak-testcase/server.ts:18:18
    at async dispatch (https://deno.land/x/oak@v9.0.0/middleware.ts:41:7)
    at async dispatch (https://deno.land/x/oak@v9.0.0/middleware.ts:41:7)
    at async dispatch (https://deno.land/x/oak@v9.0.0/middleware.ts:41:7)
    at async Application.#handleRequest (https://deno.land/x/oak@v9.0.0/application.ts:378:9)
test it should respond with 400 when the url is marlformed ... FAILED (18ms)

failures:

it should respond with 400 when the url is marlformed
AssertionError: Test case is leaking async ops.
Before:
  - dispatched: 2
  - completed: 2
After:
  - dispatched: 13
  - completed: 12

Make sure to await all promises returned from Deno APIs before
finishing test case.
    at assert (deno:runtime/js/06_util.js:42:13)
    at asyncOpSanitizer (deno:runtime/js/40_testing.js:48:7)
    at async resourceSanitizer (deno:runtime/js/40_testing.js:72:7)
    at async exitSanitizer (deno:runtime/js/40_testing.js:99:9)
    at async runTest (deno:runtime/js/40_testing.js:215:7)
    at async Object.runTests (deno:runtime/js/40_testing.js:283:22)
    at async file:///home/twhitbeck/src/local/superoak-testcase/c7629de1-c472-4780-a46d-d82b87eba195$deno$test.js:4:1

failures:

        it should respond with 400 when the url is marlformed

test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out (90208ms)

error: Test failed

@asos-craigmorten thanks for taking a look!

Hey @twhitbeck :wave:
So the issue here is https://github.com/asos-craigmorten/superoak/issues/22 😅
Oak, since adopting the native Deno server, hasn't correctly been closing the server. I put in a fix https://github.com/oakserver/oak/pull/389 but a new release hasn't been created yet. 🤞 it will be released soon! Perhaps we can hint at Kitson on Discord 😉
For now you can work around the issue by using the std lib server implementation for Oak with the serverConstructor parameter. E.g.
import {
  Application,
  Router,
  Status,
  HttpServerStd,
} from<EMAIL_ADDRESS>
// Define the routes
const router = new Router();

router.post("/create", async (context) => {
  const body = context.request.body({ type: "json" });

  const { url } = (await body.value) as { url: string };

  try {
    new URL(url);
  } catch {
    context.throw(Status.BadRequest, "Invalid url");
  }

  context.response.body = url;
});

const app = new Application({ serverConstructor: HttpServerStd }); // here

app.use(router.routes());
app.use(router.allowedMethods());

if (import.meta.main) {
  await app.listen({ port: 8080 });
}

export { app };

Not ideal but all we can do for now until the fix in Oak is released!

thanks @cmorten it's all good now! boy that bit me hard!

I think they include the fix in release v9.0.1, I'm using it all fine.

Fixed upstream in latest version<EMAIL_ADDRESS>


Query feature

[ ] What does this PR do?

Input Field to make a query
Add table-view for query result

TODO:

[x] Add breadcrumbs
[x] Exploration of children workItems

[ ] What issue/task does this PR references?

[ ] Story: https://openshift.io/openshiftio/Openshift_io/plan/detail/171

[x] Task: https://openshift.io/openshiftio/Openshift_io/plan/detail/367
[x] Task: https://openshift.io/openshiftio/Openshift_io/plan/detail/366
[x] Task: https://openshift.io/openshiftio/Openshift_io/plan/detail/364
[x] Task: https://openshift.io/openshiftio/Openshift_io/plan/detail/365
[x] Task: https://openshift.io/openshiftio/Openshift_io/plan/detail/368

[ ] Are the tests Included?

Optional

[ ] Is the documentation Included?

[ ] Are the Release Notes included?

[ ] @mention(s) to expected reviewer(s) included

@sahil143 Your image is available in the registry. Run docker pull quay.io/openshiftio/rhel-fabric8-ui-fabric8-planner:SNAPSHOT-PR-2754 && docker run -it -p 5000:8080 quay.io/openshiftio/rhel-fabric8-ui-fabric8-planner:SNAPSHOT-PR-2754 and visit http://localhost:5000 to access it.

@sahil143 Your image is available in the registry. Run docker pull quay.io/openshiftio/rhel-fabric8-ui-fabric8-planner:SNAPSHOT-PR-2754 && docker run -it -p 5000:8080 quay.io/openshiftio/rhel-fabric8-ui-fabric8-planner:SNAPSHOT-PR-2754 and visit http://localhost:5000 to access it.

@sahil143 Your image is available in the registry. Run docker pull quay.io/openshiftio/rhel-fabric8-ui-fabric8-planner:SNAPSHOT-PR-2754 && docker run -it -p 5000:8080 quay.io/openshiftio/rhel-fabric8-ui-fabric8-planner:SNAPSHOT-PR-2754 and visit http://localhost:5000 to access it.

@sahil143 Your image is available in the registry. Run docker pull quay.io/openshiftio/rhel-fabric8-ui-fabric8-planner:SNAPSHOT-PR-2754 && docker run -it -p 5000:8080 quay.io/openshiftio/rhel-fabric8-ui-fabric8-planner:SNAPSHOT-PR-2754 and visit http://localhost:5000 to access it.

[test]

@Raunak1203

clicking on show child highlights the backlog view

This is temporary until we have the support for parent id/number then we will have the parentId also inside the query and this will resolve itself. If we want to make the fix now then we will have to do it in fabric8-ui and later undo the changes once we have ParentId inside query.

@sahil143 clicking in quickpreview throws 404error

@sahil143 Your image is available in the registry. Run docker pull quay.io/openshiftio/rhel-fabric8-ui-fabric8-planner:SNAPSHOT-PR-2754 && docker run -it -p 5000:8080 quay.io/openshiftio/rhel-fabric8-ui-fabric8-planner:SNAPSHOT-PR-2754 and visit http://localhost:5000 to access it.

@sahil143 Your image is available in the registry. Run docker pull quay.io/openshiftio/rhel-fabric8-ui-fabric8-planner:SNAPSHOT-PR-2754 && docker run -it -p 5000:8080 quay.io/openshiftio/rhel-fabric8-ui-fabric8-planner:SNAPSHOT-PR-2754 and visit http://localhost:5000 to access it.

@sahil143 Your image is available in the registry. Run docker pull quay.io/openshiftio/rhel-fabric8-ui-fabric8-planner:SNAPSHOT-PR-2754 && docker run -it -p 5000:8080 quay.io/openshiftio/rhel-fabric8-ui-fabric8-planner:SNAPSHOT-PR-2754 and visit http://localhost:5000 to access it.

@sahil143 Your image is available in the registry. Run docker pull quay.io/openshiftio/rhel-fabric8-ui-fabric8-planner:SNAPSHOT-PR-2754 && docker run -it -p 5000:8080 quay.io/openshiftio/rhel-fabric8-ui-fabric8-planner:SNAPSHOT-PR-2754 and visit http://localhost:5000 to access it.

@sahil143 Your image is available in the registry. Run docker pull quay.io/openshiftio/rhel-fabric8-ui-fabric8-planner:SNAPSHOT-PR-2754 && docker run -it -p 5000:8080 quay.io/openshiftio/rhel-fabric8-ui-fabric8-planner:SNAPSHOT-PR-2754 and visit http://localhost:5000 to access it.


[Template Submission]: Vue 3

Contact Details
https://discord.gg/railway
Template URL
https://railway.app/template/Qh0OAU
What does this template deploy?
A static Vue 3 demo app, served with Caddy used to show off a best practices deployment. As requested in the Notion doc
Demo project
https://railway.app/project/9c3f6dc2-6129-4ace-9005-6eede16b7c6e

So good @brody192 !  Thanks for another excellent submission.  We'll get you paid on this too, but I just have one weird thing to raise, that has nothing to do with your code, but how the repo is being cloned into my account.. it's cloning it as -Vue-3 which is annoying because when I try to open it in VSCode from my terminal running code -Vue-3, it errors with Warning: 'V' is not in the list of known options because it thinks i'm trying to use a switch.

any idea why it's being created with that funky repo name?  does the same thing happen to you?

Github is escaping the whitespace, good catch! all fixed

OOooO good to know that's where it was coming from, thank you for fixing it!
Here is your repo, if you don't mind pushing your code over: https://github.com/railwayapp-templates/vue-starter

pushed and updated!


fix: sentence casing fixes

This PR makes numerous casing fixes and resolved misc typos in our install plans.

I've asked DevEx to confirm that these changes won't impact the functionality of install plans, just to double check.


IAmazonS3.GetObjectAsync tries to log and fails because of missing deps log4net.

Expected Behavior
It should not throw current exception.
Current Behavior
It throws MethodAccessException:

MethodAccessException: Attempt by method log4net.Core.LoggerManager.RegisterAppDomainEvents()' to access method 'System.AppDomain.add_ProcessExit(System.EventHandler)' failed.

Steps to Reproduce (for bugs)
I have 3 reproduces.
First Repro
new AmazonS3Client();

After a small fix
I tried to set DisableLogging property to true. By doing this, I was able to create a AmazonS3Client instance. But this time I got this Exception when calling AmazonS3Client.GetObjectAsync method:
var config = new AmazonS3Config() { DisableLogging = true };
var amazonS3 = new AmazonS3Client(config);
amazonS3.GetObjectAsync("bucketName", "key").Wait();

Tried also this one
AWSConfigs.LoggingConfig.LogTo = LoggingOptions.None;
new AmazonS3Client();

Version Info
Using:

.NET Standard 1.3
xunit 2.2.0
AWSSDK.S3 <IP_ADDRESS>

Duplicate of #620, closing.


JSON-RPC parsing fixes

Trim the extracted non-quoted JSON string elements, so then the FromString() deserialization does not fail on invalid characters. This fixes execution of JSON-RPC number/float/boolean property setters (and non-extended single parameter methods) when there is white space after the value. E.g. the below examples would earlier fail to parse:
"params": 10 ,

or
"params": false
}

Fix return value on void and successful methods and properties i.e. have "result":null} instead of a broken "result":}

Blackduck scan failure details
Summary: 0 violations, 0 files pending approval, 1 file pending identification.

Protex Server Path: /home/blackduck/github/Thunder/848/rdkcentral/Thunder

Commit: b3afaf932377edfd478da9baae37c096c9f011d7

Report detail: gist

Blackduck scan failure details
Summary: 0 violations, 0 files pending approval, 1 file pending identification.

Protex Server Path: /home/blackduck/github/Thunder/848/rdkcentral/Thunder

Commit: a5a3d79f0db4845c04b35f24664ce6cfb1e3b689

Report detail: gist

Blackduck scan failure details
Summary: 0 violations, 0 files pending approval, 1 file pending identification.

Protex Server Path: /home/blackduck/github/Thunder/848/rdkcentral/Thunder

Commit:<PHONE_NUMBER>debc48556f16e6c8fab3adaeabf642

Report detail: gist

WARNING: A Blackduck scan failure has been waived
A prior failure has been upvoted

Upvote reason: spurious copyright match

Commit:<PHONE_NUMBER>debc48556f16e6c8fab3adaeabf642


fix: mermaid simple graph

Mermaid rendering is broken for just graph
graph
  A --> B

is broken, where
flowchart
  A --> B

is working

@toppair Could you have a look?


Typo: HEML -> HTML

HEML Encoder / Decoder -> HTML Encoder / Decoder

Thank you. I'll fix that.

fixed!

Depending on how picky you are, you might also want to update the screenshot showcasing this Encoder/Decoder in README.md.


Update build number for pyorc

Checklist

[ ] Used a personal fork of the feedstock to propose changes
[ ] Bumped the build number (if the version is unchanged)
[ ] Reset the build number to 0 (if the version changed)
[ ] Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
[ ] Ensured the license file is being packaged.

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

Going to go ahead and merge this since we are merely bumping the build number for the change already merged in PR ( https://github.com/conda-forge/pyorc-feedstock/pull/18 ). Hope that is ok 🙂


since this os engine can i work on html5?

What is your question?
since this os engine can i work on html5? :D

Hopefully

I made an os engine port before on html5


Add save to html

Overview
This adds the ability to save the preview to an HTML document.
It adds a couple of methods to achieve this:

Adds a way for the rendered HTML to be automatically saved to a file every time it's rendered.
Adds a toolbar with a save button to the preview panel.

I have added settings to the setting window to allow selecting the automatically saved file, and for enabling/disabling the toolbar in the preview panel.
Other Notes:

By default, the new toolbar is disabled.
I moved the Print Preview button that was hidden and not doing anything to the toolbar as well (and added an icon). It's still hidden since it currently has no functionality.
If you let this pull in, I plan to submit another that cleans up some of the UI (Mostly for the settings panel), and maybe adds error checking for the selected CSS file.

Screenshots:
Preview Panel with Toolbar enabled:

Settings Window with new options:

I've made some changes for test pre-RegExp: https://github.com/andrzejQ/NppMarkdownPanel/tree/RegExp, and faster Css config...


Add factory model creation on different connections

This PR allows for the creation of 'factory models' on other connections than the default.
Example usage:
factory(User::class)->connection('ext-02')->create();

Currently, for the same behavior, you would have to make() the model, then use setConnection() and manually save() it.

Isn't that what the $connection property on the models is for? What's the use case for this?

@ntzm so you can create a factory model on a different connection.

@casperboone it seems there could be some unexpected behavior if you do:
factory()->connection()->make()...
The model will not have the connection you specified set. That might be unexpected since it works for create.

@taylorotwell Good catch! Will look into it :)

Done 😃 .
The changes involved moving
$instance->setConnection($instance->newQueryWithoutScopes()->getConnection()->getName());

to the makeInstance() method. I believe this will not change any behavior (and tested this quickly), but please correct me if I'm wrong.

@casperboone  the side effect to your change is that now factory()->make() will generate models that have the connection property set, before your change the resulted model will have the connection property = null, since it's not persisted yet I believe the connection should remain null.

Yeah I think you can keep current behavior if connection is not explicitly set.

@themsaid Good point! Changed the code. Didn't like having to add two conditionals for this, but seems like the simplest way to keep the current behavior (and support the new 😄).


Executing RenderSceneBuffersRD.new function crashes Godot in its destructor, using OpenGL

Tested versions
4.3.dev.custom_build https://github.com/godotengine/godot/commit/6c579280630715ff7da8310d405ef34194847294  (I found that now godot --version not prints git version of app - it is possible to restore this?)
System information
Ubuntu 22.04 CI
Issue description
When executing (this code was automatically minimized, so it is possible, that an even more "minimal" project can be created)
extends Node
func _process(delta):
	var temp_variable66 = AStar3D.new()
	temp_variable66.get_meta(StringName("5555"), Array([Array([]), Array([]), 0, 69, Array([]), Array([]), Array([]), Array([]), Array([]), Array([]), Array([]), Array([]), 95, Array([]), Array([]), Array([]), Array([]), Array([]), Array([]), Array([]), Array([]), Array([]), Array([]), Array([]), Array([])]))
	temp_variable66.is_queued_for_deletion()
	temp_variable66.get_available_point_id()
	var temp_variable71 = AStar3D.new()
	temp_variable71.has_user_signal(StringName("<IP_ADDRESS>"))
	temp_variable71.set_indexed(NodePath("<IP_ADDRESS>"), RenderSceneBuffersRD.new())

Godot crashes:
Godot Engine v4.3.dev.custom_build - https://godotengine.org
MESA: error: ZINK: failed to choose pdev
glx: failed to create drisw screen
failed to load driver: zink
WARNING: Could not set V-Sync mode. V-Sync is not supported.
     at: set_use_vsync (platform/linuxbsd/x11/gl_manager_x11.cpp:374)
OpenGL API 4.5 (Core Profile) Mesa 23.3.6 - kisak-mesa PPA - Compatibility - Using Device: Mesa - llvmpipe (LLVM 15.0.7, 256 bits)
######################## Ending test ########################
servers/rendering/renderer_rd/storage_rd/render_scene_buffers_rd.cpp:46:64: runtime error: member call on null pointer of type 'struct MaterialStorage'
servers/rendering/renderer_rd/storage_rd/render_scene_buffers_rd.cpp:46:64: runtime error: member access within null pointer of type 'struct MaterialStorage'
================================================================
handle_crash: Program crashed with signal 11
Engine version: Godot Engine v4.3.dev.custom_build
Dumping the backtrace. Please include this when reporting the bug to the project developer.
[1] ./godot.linuxbsd.editor.dev.x86_64.san(+0x3fda69d3) [0x55e1401f89d3] (/home/runner/work/Qarminer/Qarminer/godot/platform/linuxbsd/crash_handler_linuxbsd.cpp:61)
[2] /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7feef8042520] (??:0)
[3] RenderSceneBuffersRD::~RenderSceneBuffersRD() (/home/runner/work/Qarminer/Qarminer/godot/servers/rendering/renderer_rd/storage_rd/render_scene_buffers_rd.cpp:46)
[4] void memdelete<RefCounted>(RefCounted*) (/home/runner/work/Qarminer/Qarminer/godot/./core/os/memory.h:119)
[5] Variant::_clear_internal() (/home/runner/work/Qarminer/Qarminer/godot/core/variant/variant.cpp:1363)
[6] Variant::clear() (/home/runner/work/Qarminer/Qarminer/godot/./core/variant/variant.h:305)
[7] Variant::reference(Variant const&) (/home/runner/work/Qarminer/Qarminer/godot/core/variant/variant.cpp:1067)
[8] Variant::operator=(Variant const&) (/home/runner/work/Qarminer/Qarminer/godot/core/variant/variant.cpp:2714)
[9] GDScriptFunction::call(GDScriptInstance*, Variant const**, int, Callable::CallError&, GDScriptFunction::CallState*) (/home/runner/work/Qarminer/Qarminer/godot/modules/gdscript/gdscript_vm.cpp:1273)
[10] GDScriptInstance::callp(StringName const&, Variant const**, int, Callable::CallError&) (/home/runner/work/Qarminer/Qarminer/godot/modules/gdscript/gdscript.cpp:1970)
[11] bool Node::_gdvirtual__process_call<false>(double) (/home/runner/work/Qarminer/Qarminer/godot/scene/main/node.h:355 (discriminator 1))
[12] Node::_notification(int) (/home/runner/work/Qarminer/Qarminer/godot/scene/main/node.cpp:59)
[13] Node::_notificationv(int, bool) (/home/runner/work/Qarminer/Qarminer/godot/./scene/main/node.h:49 (discriminator 14))
[14] Object::notification(int, bool) (/home/runner/work/Qarminer/Qarminer/godot/core/object/object.cpp:902)
[15] SceneTree::_process_group(SceneTree::ProcessGroup*, bool) (/home/runner/work/Qarminer/Qarminer/godot/scene/main/scene_tree.cpp:979)
[16] SceneTree::_process(bool) (/home/runner/work/Qarminer/Qarminer/godot/scene/main/scene_tree.cpp:1051 (discriminator 2))
[17] SceneTree::process(double) (/home/runner/work/Qarminer/Qarminer/godot/scene/main/scene_tree.cpp:536)
[18] Main::iteration() (/home/runner/work/Qarminer/Qarminer/godot/main/main.cpp:4016)
[19] OS_LinuxBSD::run() (/home/runner/work/Qarminer/Qarminer/godot/platform/linuxbsd/os_linuxbsd.cpp:962)
[20] ./godot.linuxbsd.editor.dev.x86_64.san(main+0x4bb) [0x55e1401f8374] (/home/runner/work/Qarminer/Qarminer/godot/platform/linuxbsd/godot_linuxbsd.cpp:85)
[21] /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7feef8029d90] (??:0)
[22] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0x80) [0x7feef8029e40] (??:0)
[23] ./godot.linuxbsd.editor.dev.x86_64.san(_start+0x25) [0x55e1401f7df5] (??:?)
-- END OF BACKTRACE --
================================================================
Aborted (core dumped)

This example was found by Godot fuzzer - Qarminer, so it is quite unlikelly that this code could be used in real project, but still this should be handled gracefully.
Memory leaks or asan backtraces are visible when using Godot build with sanitizers support - https://github.com/qarmin/GodotBuilds/actions (linux -> linux-editor-sanitizers)
Steps to reproduce
Above
Minimal reproduction project (MRP)
Above

RenderSceneBuffersRD probably can't be used with a non-RD renderer like GL Compatibility.
It should probably be disabled when using the GL renderer, but the destructor can also be fixed so it doesn't index         RendererRD::MaterialStorage::get_singleton()->samplers_rd_free(samplers); without checking that RendererRD::MaterialStorage exists.
CC @clayjohn @BastiaanOlij

4.3.dev.custom_build 6c57928 (I found that now godot --version not prints git version of app - it is possible to restore this?)

It still does for me:
$ godot-git --version
4.3.dev.custom_build.6c5792806

Maybe you're not compiling from an actual Git checkout, but only an extracted tarball? If so there's no Git commit info.

CI has been failing lately due to too much disk space usage, so to reduce the size I started downloading zip files in CI instead of doing a git clone and I didn't think I would lose access to the easy way to get Godot version.


Merge pipeline failed when index has too many splits

Describe the bug
quickwit-indexer got this error
2023-06-26T07:47:49.057Z  WARN spawn_merge_pipeline{index=xxx-index gen=0}: quickwit_metastore::metastore::retrying_metastore::retry: Request failed attempt_count=5
2023-06-26T07:47:49.057Z ERROR quickwit_indexing::actors::merge_pipeline: Error while spawning indexing pipeline, retrying after some time. error=Internal error: `Error, message length too large: found 50114113 bytes, the limit is: 4194304 bytes` Cause: ``. retry_count=0 retry_delay=2s

Expected behavior
no error
Configuration:
quickwit version: v0.6.1
deploy with helm, default settings (with cpu/memory request/limit increased)

I found the same error(message length too large) when request /api/v1/indexes/<index-id>/splits on searcher, but successed on metastore. I found this error template in tonic's source, so I guess that error occurs on large grpc response of splits.

MergePipeline query all published splits merge_pipeline.rs
let query = ListSplitsQuery::for_index(self.params.pipeline_id.index_uid.clone())
    .with_split_state(SplitState::Published);

It seems that the mergepipline must be failed in the future because of lots of splits.
Do we need a streaming splits api or just filter splits with start_timestamp (via maturation_period)?

Ah interesting. Out of curiosity, how many splits do you have?

We could fetch only immature splits, we would need to filter on split.create_timestamp.
In the merge pipeline, one of the condition that filters out splits that won't undergo merges is like this:
if OffsetDateTime::now_utc().unix_timestamp()
            >= split.create_timestamp + self.config.maturation_period.as_secs() as i64
{
    return true;
}

Ah interesting. Out of curiosity, how many splits do you have, and how did you end up in that state?

8w+ splits, this cluster is crashed last night (k8s OOMKilled), 6w+ splits is created last night (oom then restart...then oom)

just to be sure, 8w is for 80 000 right?

just to be sure, 8w is for 80 000 right?

right

I have also encountered this situation. The current temporary solution is to increase the limit condition of the query to control the number of pulls at one time. The splits that is out of the limits will never be merged at all...

@fulmicoton we first fetch all splits and then filter out the mature ones.

@geek-frio @dojiong we will fix this as soon as possible.
Another question: to have that many splits, you are probably using partitioning? Do you have long retention too?

@dojiong the fix is released in 0.6.2. It does not solve all the cases, you can still get the same error messages if you search on 10k splits for example. We will push a fix to use gRPC stream and avoid sending big messages.

@geek-frio, it should work for you as well.
And sorry again for the bad experience, don't hesitate to report other bugs, it's really helping us.

@geek-frio, it should work for you as well.
And sorry again for the bad experience, don't hesitate to report other bugs, it's really helping us.

One more thing @dojiong @geek-frio : the upgrade will trigger a postgresql migration. It’s better to make a dump of the db before.
Also I should have done a proper upgrade test, I will check today the upgrade process, it should work but I want to double check that.

Ok, PostgreSQL migration worked fine on our cluster.
It will add the column maturity_timestamp to the splits table. By default, the maturity_timestamp is set to 1970-01-01 00:00:00. This means that all your splits will be considered mature and won't undergo merge operations. This is mostly true for your splits but... it may be not for splits created recently. You may want to do an additional operation, like set the maturity_timestamp of recent splits that has a low number of documents to a timestamp in the future, like now + 48h.

@fmassot I tested on my cluster, it works as expected!


Close PinotFS after Data Manager Shutdowns

When a pinot server is shutting down gracefully, at present it first closes the PinotFS instances and then it waits for all data managers to be destroyed. This could mean that the segments that are getting committed in parallel will not be uploaded to the deep-store.
In this PR I am simply changing the order of these events: making PinotFS close after all segment data managers are destroyed.
This and some other issues are also documented in #10876

Codecov Report

Merging #10888 (3f9af4e) into master (b76f24c) will decrease coverage by 34.36%.
The diff coverage is n/a.

@@              Coverage Diff              @@
##             master   #10888       +/-   ##
=============================================
- Coverage     34.47%    0.11%   -34.36%
=============================================
  Files          2159     2132       -27
  Lines        116007   114988     -1019
  Branches      17558    17460       -98
=============================================
- Hits          39989      137    -39852
- Misses        72545   114831    +42286
+ Partials       3473       20     -3453

Flag
Coverage Δ

integration1
?

integration2
?

unittests2
?

unittests2temurin20
0.11% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.
see 1130 files with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Run user test submodule update in the correct directory

So they actually update regularly~

@typescript-bot user test this


My code seems to hang when skip_remainder_batch=False.

Describe the bug
Hi, Authors. My code seems to hang when skip_remainder_batch=False.
To Reproduce
Steps to reproduce the behavior:
git clone https://github.com/microsoft/tutel --branch main
python3 -m pip uninstall tutel -y
python3 ./tutel/setup.py

cd ./tutel/tutel/examples/fairseq_moe
git clone https://github.com/facebookresearch/fairseq --branch main
cd fairseq/ && git checkout b5e7b250913120409b872a940fbafec4d43c7b13
# This patch is an example to train Fairseq MoE transformers.
# Note that the current patch only works for `legacy_ddp` backend, and `--checkpoint-activations` must be disabled.
git apply ../fairseq_patch.diff
python3 -m pip install omegaconf==2.0.5 hydra-core==1.0.7
python3 -m pip install --no-deps --editable .

#fix bug in https://github.com/facebookresearch/fairseq/blob/main/fairseq/tasks/translation.py#L441-L442
#get dataset followed by https://github.com/facebookresearch/fairseq/tree/main/examples/translation

 CUDA_VISIBLE_DEVICES=0,1  MOE=3 L_AUX_WT=0.01 SKIP_EXPERT=1 fairseq-train  fairseq/data-bin/iwslt14.tokenized.de-en     --arch transformer_iwslt_de_en --share-decoder-input-output-embed     --optimizer adam --adam-betas '(0.9, 0.98)' --clip-norm 0.0     --lr 10e-4 --lr-scheduler inverse_sqrt --warmup-updates 4000     --dropout 0.3 --weight-decay 0.0001     --criterion label_smoothed_cross_entropy --label-smoothing 0.1     --max-tokens 4096 --eval-bleu     --eval-bleu-args '{"beam": 5, "max_len_a": 1.2, "max_len_b": 10}'     --eval-bleu-detok moses     --eval-bleu-remove-bpe  --eval-bleu-print-samples     --best-checkpoint-metric bleu --maximize-best-checkpoint-metric  --ddp-backend legacy_ddp --max-update 100000

Logs
2022-08-09 10:51:01 | INFO | fairseq.utils | rank   0: capabilities =  7.5  ; total memory = 10.761 GB ;[0/1773]
NVIDIA GeForce RTX 2080 Ti
2022-08-09 10:51:01 | INFO | fairseq.utils | rank   1: capabilities =  7.5  ; total memory = 10.761 GB ; name =
NVIDIA GeForce RTX 2080 Ti
2022-08-09 10:51:01 | INFO | fairseq.utils | ***********************CUDA enviroments for all 2 workers**********
*************
2022-08-09 10:51:01 | INFO | fairseq_cli.train | training on 2 devices (GPUs/TPUs)
2022-08-09 10:51:01 | INFO | fairseq_cli.train | max tokens per device = 4096 and max sentences per device = Non
e
2022-08-09 10:51:01 | INFO | fairseq.trainer | Preparing to load checkpoint checkpoints/checkpoint_last.pt
2022-08-09 10:51:01 | INFO | fairseq.trainer | No existing checkpoint found checkpoints/checkpoint_last.pt
2022-08-09 10:51:01 | INFO | fairseq.trainer | loading train data for epoch 1
2022-08-09 10:51:01 | INFO | fairseq.data.data_utils | loaded 160,239 examples from: fairseq/data-bin/iwslt14.to
kenized.de-en/train.de-en.de
2022-08-09 10:51:01 | INFO | fairseq.data.data_utils | loaded 160,239 examples from: fairseq/data-bin/iwslt14.to
kenized.de-en/train.de-en.en
2022-08-09 10:51:01 | INFO | fairseq.tasks.translation | fairseq/data-bin/iwslt14.tokenized.de-en train de-en 16
0239 examples
2022-08-09 10:51:01 | INFO | fairseq.trainer | NOTE: your device may support faster training with --fp16 or --am
p
2022-08-09 10:51:01 | INFO | fairseq.data.iterators | grouped total_num_itrs = 551
epoch 001:   0%|                                                          | 0/551 [00:00<?, ?it/s]2022-08-09 10:
51:01 | INFO | fairseq.trainer | begin training epoch 1
2022-08-09 10:51:01 | INFO | fairseq_cli.train | Start iterating over samples
/home/xinglinpan/tutel/tutel/examples/fairseq_moe/fairseq/fairseq/utils.py:374: UserWarning: amp_C fused kernels
 unavailable, disabling multi_tensor_l2norm; you may get better performance by installing NVIDIA's apex library
  warnings.warn(
/home/xinglinpan/tutel/tutel/examples/fairseq_moe/fairseq/fairseq/utils.py:374: UserWarning: amp_C fused kernels
 unavailable, disabling multi_tensor_l2norm; you may get better performance by installing NVIDIA's apex library
  warnings.warn(
epoch 001: 100%|▉| 550/551 [02:12<00:00,  4.54it/s, loss=9.244, nll_loss=8.59, ppl=385.3, wps=31462022-08-09 10:
53:14 | INFO | fairseq_cli.train | begin validation on "valid" subset
                                                                                2022-08-09 10:5
3:19 | INFO | fairseq.tasks.translation | example hypothesis: they don't don't don't don't don't don't don't't't
't
2022-08-09 10:53:19 | INFO | fairseq.tasks.translation | example reference: they're just not moving.

The possible problem is that not all devices are provided with data in the last iteration on the valid, so alltoall is always pending other processes. If SKIP_MOE=1, there is no this phenomenon.

{"max_len_a": 1.2, "max_len_b": 10} means that max_len will differ in different GPUs(please see https://github.com/facebookresearch/fairseq/blob/main/fairseq/sequence_generator.py#L335-L576).
so the alltoall of the largest length is always pending other processes.
One solution is that using {"max_len": 20} instead.
But I don't really understand the effect of this change on the BLEU score.

Thanks for your information. This is a dup of #173.
The positive capacity factor requires token workloads in different GPUs to keep pace with each other at every training/inference step. If the application data feeding is special which cannot guarantee that, you need to set the negative value of original capacity factor to avoid the hang. You can either change the value of capacity_factor at the creation of moe_layer in source code, or using export CAP_FACTOR=-1.2 to overwrite the setting in system wide.

Thanks for your information. This is a dup of #173.
We'll update the fairseq patch to add inequivalent_tokens=True which is recently in tutel but not in fairseq patch. You may apply it by yourself temperarily.

If I understand correctly, I respectfully disagree with this view.  In #173, there are inequivalent tokens in different devices. However, in this case, there is no forward in some devices due to the difference in max_len. (https://github.com/facebookresearch/fairseq/blob/main/fairseq/sequence_generator.py#L335)

That's interesting. If it's true that one GPU performs 5 forwards and another GPU performs 6 forwards, does traditional data parallel even work? I think the application itself has to do something special to avoid that, right?

The number of forwarding may be different in different GPUs during the validation process. In some codes, forwards are even only found on GPU0 during the validation process.
In this code, two sentences with different lengths(e.g, "How are you" and "Thank you") are distributed into two GPUs. BLEU score seems to be calculated word by word. As a result, "How" and "Thank" is viewed as data parallelism, and "are" and "you" is viewed as data parallelism too. However, there is no word that can be viewed as data parallelism with "you" in "How are you".

OK, this root cause makes sense. MoE layer within one process does not know application's purpose on whether other processes are going to forward MoE together with it or not. Even though it knows some of the processes are suspended and not to join in the validation procedure, part of expert parameters stored in those processes would be inaccessible by the validation process.
So, seems like there are no more solutions expect to do changes on application side, which is to open evaluation in every processes. Can you provide the code lines that performs related validation procedure?

Yes, I pretty much agree that opening evaluation in every process can fix this hang. In this code, we delete some BLEU args (i.e. max_len_a, max_len_b) to fix it. So we retrain our transformer by CUDA_VISIBLE_DEVICES=0,1  MOE=3 L_AUX_WT=0.01 SKIP_EXPERT=1 fairseq-train  fairseq/data-bin/iwslt14.tokenized.de-en     --arch transformer_iwslt_de_en --share-decoder-input-output-embed     --optimizer adam --adam-betas '(0.9, 0.98)' --clip-norm 0.0     --lr 10e-4 --lr-scheduler inverse_sqrt --warmup-updates 4000     --dropout 0.3 --weight-decay 0.0001     --criterion label_smoothed_cross_entropy --label-smoothing 0.1     --max-tokens 4096 --eval-bleu     --eval-bleu-args '{"beam": 5}'     --eval-bleu-detok moses     --eval-bleu-remove-bpe  --eval-bleu-print-samples     --best-checkpoint-metric bleu --maximize-best-checkpoint-metric  --ddp-backend legacy_ddp --max-update 100000. It seems that the code works well and few BLEU scores will be influenced by deleting these arguments. But I don't sure about it completely.


Wrong file type .dib for notebook 0209?

I'm viewing the session on Async code with notebook 0209-AsyncAwaitAndMultithreading but it seems like it has the wrong file type .dib, instead of ipynb.
Here's the output when you try to open the notebook either locally or binder:

Ah rats... you're right....  I'll get it converted.
.dib is the format available for .NET Interactive notebooks in Visual
Studio Code.
On Mon, Nov 1, 2021 at 11:04 AM Jeremy @.***> wrote:

I'm viewing the session on Async code with notebook
0209-AsyncAwaitAndMultithreading but it seems like it has the wrong file
type .dib, instead of ipynb.
Here's the output when you try to open the notebook either locally or
binder:
[image: image]
https://user-images.githubusercontent.com/34408108/139693275-d8389283-ccf2-4d22-9bdf-1e77f26cf848.png
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/csharpfritz/csharp_with_csharpfritz/issues/94, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAATF4PHD2G27BWNHZPPCX3UJ2UAPANCNFSM5HEHSXDA
.


Instrumented some new RDD operations from Spark 1.2

Added instrumentation for some new RDD operations from Spark 1.2: fullOuterJoin and repartitionAndSortWithinPartitions

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/bdg-utils-prb/28/
Test PASSed.

Excellent! Thanks @nfergu!


Task/add warning for external storage

 add warning msg for system calac & pool calc in case external storage is in-use


docs: update readme with xs-dev info

Creating a PR for discussion around workshop details, include pre-work and post-work ideas.
I'd like to advocate for folks familiar with JS / Node to get as far as they can with the setup using xs-dev. That will save a bunch of time and bandwidth at the workshop, which can be used to cover more of the programming basics. Hopefully, the Windows support will be solid enough by August to provide a streamlined experience for those machines as well.
Open questions:

Are we planning to use j5e? If yes, do we want to include that in the setup instructions?
How "self-hostable" should the instructions for this workshop be?
Do we want to mention npm if we can't take advantage of it for Moddable projects yet?
Should we mention ECMA-419 in the "Goal" or "Why is JS ideal for hardware?" sections?

Are we planning to use j5e?

I would like to, yes. Much like xs-dev it simplifies some things and gets people up and running faster.

How "self-hostable" should the instructions for this workshop be?

That's a good question. I think participants should be able to go at their own pace since there will be a wide spectrum of skill levels, so totally "self-hostable" I would think.

Do we want to mention npm if we can't take advantage of it for Moddable projects yet?

I don't want to miss the point that non-platform specific JS will work and there's a huge universe of libraries out there. We'll just have to make it clear that they will need to wire it up.


Flux: cannot read from csv file in OSS

import "csv"

csv.from(file: "/path/to/data-file.csv")

failed to initialize execute state: filesystem service uninitialized in dependencies

@adriandt thinks this is because you are still running on a server, and the server does not have access to the local file system. This would work on the REPL.
We have just added experimental support for csv.from(url: " "), perhaps that would be a better solution?

So, I think this is by design. from() on a local file system should only work in the REPL, using Flux outside the context of InfluxDB. Within InfluxDB, we should block, access to local file system.

Thanks for the information. We will update the documentation to reflect these changes.


Redirected request returns 400 Bad Request status

I would like data from booking form on my website to be send to car parks providers website and then I would like to scrap data about availablity and costs of car parks from a car parks booking site to display it on mine.
I am using following request:
       var form = {
            'TextBox_DateFrom': '16/10/15',
            'Arrive_Time': '32400',
            'TextBox_DateTo': '22/10/15',
            'Return_Time': '64800',
            'TextBox_PromoCode': '',
            'Button1': 'Get My Quote'
        };

        var formData = querystring.stringify(form);
        var contentLength = formData.length;

        var options = {
            followAllRedirects: true,
            maxRedirects: 20,
            hostname: 'directparking.co.uk',//'<IP_ADDRESS>:443',
            host: '<IP_ADDRESS>',
            path: '/index.php',
            port: '443',
            method: 'POST',
            headers: {
                'Content-Length': contentLength,
                'Content-Type':'application/x-www-form-urlencoded',
                'User-Agent': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.2454.85 Safari/537.36'
              }
        };

        var r = https.request(options, function(response){
            console.log('STATUS: ' + response.statusCode);
            console.log('HEADERS: ' + JSON.stringify(response.headers));
        });
        r.on('error', function(e) {
            console.log('error: ' + e);
            console.log('problem with request: ' + e.message);
        });
        r.write(formData);
        r.end();

That's what I get in return. I have no idea why there is 400 Bad request error within the Get method. You can have a look at the results from Node Inspector below:

While I am sending filled in HTML form the requests have correct satus.

You are using Node's HTTP core request method with some mix of options from this module. Ask in StackOverflow instead. Hope that helps.


c# scripts are missing but my only scene doesn't has no script attached to

**Godot version: 3.0.5 mono and 3.0.6 mono
https://www.dropbox.com/s/hhzbxqdw7hzl7bb/Bildschirmfoto%202018-07-30%20um%2013.58.18.png?dl=0
**OS/device including version: macos highsierra
Issue description:
I first tried to play with adding a .cs script to my main node where it popped up some kind of error but only at the end. the assembler code still appeared and the first time the build worked, but after detaching every c# script, I get this very error on my screenshot.
Can anyone help me?
Thank you in advance:)

strangest thing: the problem somehow was resolved by changing the project

Here are similar/related issues: #12415 #12917 #17281 #15624

thank you for the links. i just was in panic and didn‘t take enough time to search for a solution^^


@click event doesnot work

vue 3 (nuxt)
....
methods: {
myFunction(){
....
}
}
i try to catch click event like this on div

@click="myFunction"
@click="myFunction()"
@click="()=> myFunction()"
@click="()=> ..."

none of the above works :( cant figure out what happens

Just do one thing, run below command will fix issue at my end
npm run build, when build successfully run below command again
npm run dev

Just do one thing, below commands fixed issues at my end npm run build, when build successfully run below command again npm run dev

weirdly is also fix for me with this approach

Hey everyone, seems like this is still an issue. I made a simple reproduction here:
https://stackblitz.com/edit/github-jsuxnz-rst5gg?file=README.md,nuxt.config.ts,app.vue
When runtimeConfig is used, @click event doesn't work anymore. If you remove runtimeConfig variables, everything starts to work again. Has anyone figured this out?

Unfortunately still seems to be an issue

i still have the same

Same problem.
In my case, i set ssr: true in nuxt.config.ts,and every click event is not working.
If i set ssr: false, everything just works fine.
Why?????

@60late It sounds like you have a hydration error. You can install @nuxtjs/html-validator which can help resolve if the issue is invalid HTML. Check out your console in development to see the logs.

@60late It sounds like you have a hydration error. You can install @nuxtjs/html-validator which can help resolve if the issue is invalid HTML. Check out your console in development to see the logs.
Thanks.
I checked my code, finally find out there's something wrong with my data fetching process.
I fixed it, now it's working just fine.

For anyone looking for help. What helped me was this stackoverflow answer.
TL;DR - Run build command (eg. npm run build) to find any issues that are not visible right away in the console.
Not necessarily solving the @click issue per se, but helps a bit with debugging issues outside of it.


Fresh MicroK8s Cluster Not Starting

Just created a fresh microk8s cluster follow microk8s.io.
The microk8s kubectl get all --all-namespaces command was taking a while to return results to I cancelled it, ran microk8s stop then start and now get the below.
microk8s status
microk8s is not running. Use microk8s inspect for a deeper inspection.
microk8s inspect
Inspecting Certificates
Inspecting services
  Service snap.microk8s.daemon-cluster-agent is running
  Service snap.microk8s.daemon-containerd is running
  Service snap.microk8s.daemon-apiserver is running
  Service snap.microk8s.daemon-apiserver-kicker is running
  Service snap.microk8s.daemon-control-plane-kicker is running
  Service snap.microk8s.daemon-proxy is running
  Service snap.microk8s.daemon-kubelet is running
  Service snap.microk8s.daemon-scheduler is running
  Service snap.microk8s.daemon-controller-manager is running
  Copy service arguments to the final report tarball
Inspecting AppArmor configuration
Gathering system information
  Copy processes list to the final report tarball
  Copy snap list to the final report tarball
  Copy VM name (or none) to the final report tarball
  Copy disk usage information to the final report tarball
  Copy memory usage information to the final report tarball
  Copy server uptime to the final report tarball
  Copy current linux distribution to the final report tarball
  Copy openSSL information to the final report tarball
  Copy network configuration to the final report tarball
Inspecting kubernetes cluster
  Inspect kubernetes cluster
Inspecting juju
  Inspect Juju
Inspecting kubeflow
  Inspect Kubeflow

Building the report tarball
  Report tarball is at /var/snap/microk8s/1910/inspection-report-20210126_053926.tar.gz

Here is the tar ball, I just starting using MicroK8S and I'm not sure what file I should be looking at first to help point in the right direction of where the issue should be.
inspection-report-20210126_053926.tar.gz

I can see that the calico-kube-controller isn't healthy.  And the load of the system is very high.
You may want to increase the memory of the system or start with reducing the pods.  IMHO 4GB is a good start though.
Prometheus and istio are heavy weights.

I can see that the calico-kube-controller isn't healthy.  And the load of the system is very high.
You may want to increase the memory of the system or start with reducing the pods.  IMHO 4GB is a good start though.
Prometheus and istio are heavy weights.

@balchua Thanks for the response. Updated the RAM to 4GB and rebooted. Things are running smoothly it seems.
I am having trouble accessing the dashboard however.
microk8s.kubectl get all --all-namespaces | grep service/kubernetes-dashboard
kube-system          service/kubernetes-dashboard        ClusterIP      <IP_ADDRESS>   <none>        443/TCP
Then on another PC, navigated to https://<IP_ADDRESS> but not getting a response. The node IP itself is <IP_ADDRESS>. Is this expected to be accessed from the same node running the containers by chance or is it exposed publicly so other devices can access it. Typing this I realize there is no route to <IP_ADDRESS>/24 from the <IP_ADDRESS>/24 network so not sure how other devices can access the dashboard.

@balchua Thanks for the response. Updated the RAM to 4GB and rebooted. Things are running smoothly it seems.
I am having trouble accessing the dashboard however.
microk8s.kubectl get all --all-namespaces | grep service/kubernetes-dashboard
kube-system          service/kubernetes-dashboard        ClusterIP      <IP_ADDRESS>   <none>        443/TCP
Then on another PC, navigated to https://<IP_ADDRESS> but not getting a response. The node IP itself is <IP_ADDRESS>. Is this expected to be accessed from the same node running the containers by chance or is it exposed publicly so other devices can access it. Typing this I realize there is no route to <IP_ADDRESS>/24 from the <IP_ADDRESS>/24 network so not sure how other devices can access the dashboard.

Are you running MicroK8s on bare metal or on a virtualized environment like mac or windows.
There is a section in (this)[https://microk8s.io/docs/addon-dashboard] link  explaining how to do so.
Thanks!

Are you running MicroK8s on bare metal or on a virtualized environment like mac or windows.
There is a section in (this)[https://microk8s.io/docs/addon-dashboard] link  explaining how to do so.
Thanks!

@ThePieMonster the <IP_ADDRESS>/24 may be causing issues. The pods are placed in <IP_ADDRESS>/16 network. Would you be able to select a different network for the host?

@ThePieMonster the <IP_ADDRESS>/24 may be causing issues. The pods are placed in <IP_ADDRESS>/16 network. Would you be able to select a different network for the host?

@balasu
MicroK8S is running in a Ubuntu VM. The VM is on the <IP_ADDRESS>/24 network as that is a available network that is set aside for the K8S VM's.
@ktsakalozos
What do you mean by selecting a different network? Is there a config change that should be made when setting up the MicroK8S node. I imagine that all sorts of different base networks are used to host the nodes by different people. Is there some routing that needs to be setup to be able to access the nodes that is expected as part of the setup?

@balasu
MicroK8S is running in a Ubuntu VM. The VM is on the <IP_ADDRESS>/24 network as that is a available network that is set aside for the K8S VM's.
@ktsakalozos
What do you mean by selecting a different network? Is there a config change that should be made when setting up the MicroK8S node. I imagine that all sorts of different base networks are used to host the nodes by different people. Is there some routing that needs to be setup to be able to access the nodes that is expected as part of the setup?

Hi @ThePieMonster  , instead of dashboard , portainer can be an option. if its microk8s version 1.20, microk8s enable portainer addon is available and on port 30777 its accessible. dashboard-proxy is not required for this

Hi @ThePieMonster  , instead of dashboard , portainer can be an option. if its microk8s version 1.20, microk8s enable portainer addon is available and on port 30777 its accessible. dashboard-proxy is not required for this

Hi @ThePieMonster the dashboard-proxy is doing port-forwarding[1].  That's why it has to stay up.  Stopping the command doesn't really stop the kubernetes dashboard, but only the port forwarding.
If i need to expose the dashboard to anywhere, which i dont really do for security sake, i use ingress to expose it.
Some details you can get from this stackoverflow[2].  Hope this helps.
[1] https://github.com/ubuntu/microk8s/blob/8d0b9e5d6cfdb61b855b0d1ad657b43c4db73583/scripts/wrappers/dashboard-proxy.py#L62-L70
[2] https://stackoverflow.com/questions/48324760/ingress-configuration-for-dashboard

Hi @ThePieMonster the dashboard-proxy is doing port-forwarding[1].  That's why it has to stay up.  Stopping the command doesn't really stop the kubernetes dashboard, but only the port forwarding.
If i need to expose the dashboard to anywhere, which i dont really do for security sake, i use ingress to expose it.
Some details you can get from this stackoverflow[2].  Hope this helps.
[1] https://github.com/ubuntu/microk8s/blob/8d0b9e5d6cfdb61b855b0d1ad657b43c4db73583/scripts/wrappers/dashboard-proxy.py#L62-L70
[2] https://stackoverflow.com/questions/48324760/ingress-configuration-for-dashboard

@balchua @balasu I would like to be able to have access to the dashboard via port forward. I'm guessing I will have to do port forwarding for accessing prometheus as well. Currently I have the below deployments. Do you know what would specifically have to be updated in order to get port forwarding working. Since it seems I don't have nginx I would be modifying istio-ingressgateway?
 I'm guessing I will have to do port forwarding for accessing prometheus as well. Currently I have the below deployments. Do you know what would specifically have to be updated in order to get port forwarding working. Since it seems I don't have nginx I would be modifying istio-ingressgateway?

While for the others, its going to be similar to what you are doing.  But you need to know the port used by the containers.

If you want to port forward with the dashboard i will simply use the dashboard-proxy.
While for the others, its going to be similar to what you are doing.  But you need to know the port used by the containers.

If you want to port forward with the dashboard i will simply use the dashboard-proxy.
While for the others, its going to be similar to what you are doing. But you need to know the port used by the containers.
Yes but I am trying to set something up that is permanent and not relying on running that command.

If you want to port forward with the dashboard i will simply use the dashboard-proxy.
While for the others, its going to be similar to what you are doing. But you need to know the port used by the containers.
Yes but I am trying to set something up that is permanent and not relying on running that command.

Ingress maybe a better option imho.

Ingress maybe a better option imho.

Solution was to run microk8s kubectl edit service -n kube-system kubernetes-dashboard
Change type to type: NodePort
Run the first command again to see the nodePort that was automatically set and use that as the node-ip:port to connect too.

Solution was to run microk8s kubectl edit service -n kube-system kubernetes-dashboard
Change type to type: NodePort
Run the first command again to see the nodePort that was automatically set and use that as the node-ip:port to connect too.


Profile Cloud SQL Server sizes for large GCP orgs

[ ] Perform profile testing with larger Cloud SQL instances for orgs that are very large numbers of GCP resources
[ ] Propose optimal default Cloud SQL Size for large orgs.

Updated default Cloud SQL and VM to handle large dataset based on internal profiling.


Upgrade to 0.42, fix wpt checkout, add channelCount to MediaTrackConstraints

@trevorparscal could you have a look if this works for you? I don't have a multichannel mic at hand here and the underlying cpal library is surprisingly relaxed in allowing exotic channel counts - so I can't really test properly myself.
Fixes #74

Ready for merging!

Cool thanks!
Will try to set up some example with Pure Data or Max patch
And will create an issue regarding 1fd1e22, if I make it AudioBuffer::getChannelData safe and return a non mutable Float32Array this breaks lots (~500...) of wpt test


SMHE-729: Add TEST_ALARM_SCHEDULER message

Signed-off-by: Andre Bolder<EMAIL_ADDRESS>Added schedule test alarms operation for the alarms: PHASE_OUTAGE_TEST (fom smr5) and LAST_GASP_TEST (for smr55).
Added to:

osgp-adapter-ws-smartmetering
osgp-core
osgp-protocol-adapter

You should trigger the nightly build in this PR and post a link in a comment to the succeeded build in this PR, because you added @NightlyBuildOnly tests

New Jenkins server GXF Nightly : https://jenkins.fdp.osgp.cloud/view/Nightly Build/job/gxf-nightly-build/462/

New GXF Nightly build after https://github.com/SmartSocietyServices/release/pull/289 merge.

https://jenkins.fdp.osgp.cloud/view/Nightly Build/job/gxf-nightly-build/467/

https://jenkins.fdp.osgp.cloud/view/Nightly Build/job/gxf-nightly-build/468/

https://jenkins.fdp.osgp.cloud/view/Nightly Build/job/gxf-nightly-build/469/

https://jenkins.fdp.osgp.cloud/view/Nightly Build/job/gxf-nightly-build/469/

https://jenkins.fdp.osgp.cloud/view/gxf/job/gxf-nightly-build/474/

Merged development branch into this one to fix the ExchangeUserKeyOnMbusDevice cucumber test.
https://jenkins.fdp.osgp.cloud/view/gxf/job/gxf-nightly-build/476/

Nightlies are succesfull and added to the checklist


Remove deprecated richtext_filter tag.

I don't see how the fallback could even work without the user defining
RICHTEXT_FILTERS as empty in their own settings, because it defaults to
("mezzanine.utils.html.thumbnails",) so the if not filternames path
would never be taken. Give that the fallback does nothing, I think
printing a warning is deceptive so better just to remove it entirely.

Your analysis seems right to me, and this is a three-year-old deprecation. I think it's fine to get rid of. Thanks!


Obvious "close" button on popups

Often, when I have any popup or menu open, I am looking for an easy, visually obvious way out. I think it would make most sense to just have an X on every popup, like this:

:+1: Maybe we should also close it if you click anywhere outside the popup?

I second that!

Leaving decisions on this one up to @stuartnelson3 (including yay or nay or how). Just FWIW, Escape already closes any popups.
Just a thought about closing popups when clicking somehwere else: sometimes you don't want that, such as when you're copying expressions from one graph to another and you want panes in both graphs to stay open for that.

Just a thought about closing popups when clicking somehwere else: sometimes you don't want that, such as when you're copying expressions from one graph to another and you want panes in both graphs to stay open for that.

Fair enough, but you never want to click on graphs or the background without the popup closing, right? So I would close it unless you click on any other popup or menu.
@juliusv

:+1: to icon and "close on click on background".
At least for data sources and dashboard settings it should be easy. Time settings might be harder, as it's a) a plugin afaik and b) visually there is no space available right now. Maybe not strictly necessary?

regarding time settings:

it is a plugin
we don't have much control over the visuals as a result (and there is no space)
but, it already closes when you click outside it

Another cue that came to mind, and might help for the time menu (which I wouldn't mind changing …) – highlight the button that opened (and will close) it, so that it is visibly anchored to it. That would make it feel more like a menu than a button, and show where it came from. This applies to the other menu/popups as well.

closed by #347


[master] Ignore the fdasd error for rereading partition table

The error code of rereading partition table for fdasd command has been changes
it will be 255 in package s390utils-base-2.4.0-1.el7.s390x for rhel7
and 1 in package s390utils-base-2.6.0-28.el8.s390x for rhel8
will ignore the error based on os version

And please sign your commit

it's very weird that they make such changes... anyway, +1 to @bjhuangr 's point above

The get os version function also appeared in refreshbootmap and potentially other place. As discussed with Yalian, let's merge this at first, then I will refine this in following PR.


Error: Cant find mono!

Hello,
Thanks for this project, it looks like this is what I was looking for.
I'm running into an issue when trying to run a script:
node fridax.js inject --scripts read_class_static_string_variable
[*] Awaiting storage initialization.
[*] Awaiting USB device.
[*] Up and running on Phone.
? Which application do you want to inject? Gadget
[*] Attached to application (session: 23972).
[*] Injected a test script (this runs from within the injected application)!
Error: Cant find mono!
    at node_modules/frida-mono-api/src/mono-module.js:7
    at o (node_modules/browser-pack/_prelude.js:1)
    at node_modules/frida-mono-api/src/mono-api.js:2
    at o (node_modules/browser-pack/_prelude.js:1)
    at /script2.js:119
    at o (node_modules/browser-pack/_prelude.js:1)
    at scripts/read_class_static_string_variable.js:1
    at o (node_modules/browser-pack/_prelude.js:1)
    at r (node_modules/browser-pack/_prelude.js:1)
[*] Happy hacking.

What I did was:

Patch the APK using Objection
Install the APK on the phone (real device)
Start the APK
Start Objection so that the app is running
Run node fridax.js inject

Any idea of what could be wrong ?

Would it be possible to share the APK file, or is it confidential?
I must say that I haven't tested this script on Android (only on iOS), but nevertheless it should work on Android too. Are you sure it is a Xamarin application?
Also, make sure to run your application before running Fridax, as described in the known issues.

I can't share the APK but I have sent some info about it as a DM on Twitter.
I'm sure this is a Xamarin app.
I'm doing objection explore before doing the injection using Fridax so the app is running.
Note that I'm doing this on a Mac but I have Mono installed (using brew).
Frida version: 12.8.19
Mono version: <IP_ADDRESS>
Objection version: 1.9.0
Gadget version: 12.8.19

Commit 192c6fe8a9cb743846f80b7a3090d8a52e74babb fixes this issue, as discussed on Twitter.

@tijme Not sure if you saw that but the solution to our problem was right under our nose: https://github.com/freehuntx/frida-mono-api/pull/6/commits/615a6d45f3357df8dd845af784e8402c857d7a4f


Looks interesting. Can you please add more context what this project intends to do?

Hi, don't know what else I can say other than what's written in the readme. It basically makes Win32 API somewhat easier to use. It was previously a part of a desktop application I made. Unless you're already familiar with the API, I wouldn't recommend adopting it for a brand new application.

Hi, don't know what else I can say other than what's written in the readme. It basically makes Win32 API somewhat easier to use. It was previously a part of a desktop application I made. Unless you're already familiar with the API, I wouldn't recommend adopting it for a brand new application.


Missing default value information for those not using typescript in the example of unform integration with react-input-mask

Today I faced a bug using unform with react-input-mask.
In my case using the <Scope path="module[0]" /> and <Scope path="module[1]" /> with setData, and in my input component using react-input-mask I defined the structure:
useEffect() => {
   registerField({
     name: fieldName,
     ref: inputRef.current,
     path: 'value',
     setValue(ref, value) {
       ref.setInputValue(value);
     },
     clearValue(ref: any) {
       ref.setInputValue('');
     },
   });
}, [fieldName, registerField]);

Following exactly as the documentation says, however, if I had value to fill only the fields of the first <Scope /> the second would give Uncaught TypeError error: Cannot read property 'split' of undefined in the react-input-mask components.

What I followed to solve the problem was to set a default value for the setValue function in registerField.

 As in the documentation you used typescript to exemplify, I think it would be convenient to comment out this default value for those who are using javascript too!

Hello @jrmarqueshd, i don't think i got it.
Where are you using the .split method? Can you point exactly where the problem is inside the docs?

Hi @diego3g!
I'm having the same problem, when i use either formRef.current.setData() or formRef.current.setFieldValue i get the error Unhandled Rejection (TypeError): insertStr.split is not a function
Here is my InputMask and Form component https://gist.github.com/paulohenriquepm/1f3c88c137c7341c0e4e6ea12102b0c2
You can find the InputMask on line 677 of Form component

Hi guys, I'm having the same problem, data loads normally on the screen, but when I submit form the input with the defaultValue comes empty.
Is it possible to set the form data manually?, I'm trying but its not working

I solved it that way:
 registerField({
      name: fieldName,
      ref: inputRef.current,
      path: "value",
      setValue(ref, value) {
        ref.setInputValue(value ? value : "");
      },
      clearValue(ref) {
        ref.setInputValue("");
      },
    });

The getValue function needs to be prevented when the value parameter does not exist

Hello!
I have the same problem.
I tried the solution cited by @jrmarqueshd , but it didn't work for me

Hello!
I have the same problem.
I tried the solution cited by @jrmarqueshd , but it didn't work for me

Hello @lucasrisatto, are you using TypeScript? Can you share the code snnipet?

Hello @jrmarqueshd, thank you for reply.
Yes, I'm using typescript...
My input mask is being registered as follows:
useEffect(() => {
    registerField({
      name: fieldName,
      ref: inputRef.current,
      path: 'value',
      setValue(ref: any, value: string) {
        ref.setInputValue(value);
      },
      clearValue(ref: any) {
        ref.setInputValue('');
      },
    });
  }, [fieldName, registerField]);

On my form:
 <InputMask
     name="cpfcnpj"
     type="input"
     className="form-control"
     mask="999.999.999-99"
  />

I'm also using the hook setFieldValue to get the initialData:
formRef.current?.setFieldValue('cpfcnpj', {
   value: response.data.data[0].cpfcnpj,
   label: response.data.data[0].cpfcnpj,
});

Hello!
I have the same problem.
I tried the solution cited by @jrmarqueshd , but it didn't work for me

Hello @lucasrisatto, are you using TypeScript? Can you share the code snnipet?

Hello @jrmarqueshd, thank you for reply.
Yes, I'm using typescript...
My input mask is being registered as follows:
useEffect(() => {
    registerField({
      name: fieldName,
      ref: inputRef.current,
      path: 'value',
      setValue(ref: any, value: string) {
        ref.setInputValue(value);
      },
      clearValue(ref: any) {
        ref.setInputValue('');
      },
    });
  }, [fieldName, registerField]);

On my form:
 <InputMask
     name="cpfcnpj"
     type="input"
     className="form-control"
     mask="999.999.999-99"
  />

I'm also using the hook setFieldValue to get the initialData:
formRef.current?.setFieldValue('cpfcnpj', {
   value: response.data.data[0].cpfcnpj,
   label: response.data.data[0].cpfcnpj,
});

Hello!
I have the same problem.
I tried the solution cited by @jrmarqueshd , but it didn't work for me

Hello @lucasrisatto, are you using TypeScript? Can you share the code snnipet?

Hello @jrmarqueshd.
Yes, i'm using TypeScript.
this is my error.

I tried to use your code snippet, but the error above was displayed.
Besides, I'm trying to get the initial data for my CPFCNPJ field
useEffect(() => {
    api.get(`/people?&order=id&id=${id}`).then(cpfcnpj => {
      formRef.current?.setData({cpfcnpj: cpfcnpj})
      console.log(formRef.current?.setData)
    })
  }, []);

Hello!
I have the same problem.
I tried the solution cited by @jrmarqueshd , but it didn't work for me

Hello @lucasrisatto, are you using TypeScript? Can you share the code snnipet?

Hello @jrmarqueshd.
Yes, i'm using TypeScript.
this is my error.

I tried to use your code snippet, but the error above was displayed.
Besides, I'm trying to get the initial data for my CPFCNPJ field
useEffect(() => {
    api.get(`/people?&order=id&id=${id}`).then(cpfcnpj => {
      formRef.current?.setData({cpfcnpj: cpfcnpj})
      console.log(formRef.current?.setData)
    })
  }, []);

Hi @lucasrisatto.
My example is for those who are not using TypeScript.
In your case, I believe that it should be done like this:
setValue(ref: any, value: string) {
  ref.setInputValue(value);
},

If that doesn't work (as it should), you can try this code below, but, I'm not sure if it would be the best way.
setValue(ref: any, value: string) {
  if(ref) return ref.setInputValue(value);
},

If it works, it will serve more as a hacking code than a real solution!
Hope this helps.

Hello!
I have the same problem.
I tried the solution cited by @jrmarqueshd , but it didn't work for me

Hello @lucasrisatto, are you using TypeScript? Can you share the code snnipet?

Hello @jrmarqueshd.
Yes, i'm using TypeScript.
this is my error.

I tried to use your code snippet, but the error above was displayed.
Besides, I'm trying to get the initial data for my CPFCNPJ field
useEffect(() => {
    api.get(`/people?&order=id&id=${id}`).then(cpfcnpj => {
      formRef.current?.setData({cpfcnpj: cpfcnpj})
      console.log(formRef.current?.setData)
    })
  }, []);

Hi @lucasrisatto.
My example is for those who are not using TypeScript.
In your case, I believe that it should be done like this:
setValue(ref: any, value: string) {
  ref.setInputValue(value);
},

If that doesn't work (as it should), you can try this code below, but, I'm not sure if it would be the best way.
setValue(ref: any, value: string) {
  if(ref) return ref.setInputValue(value);
},

If it works, it will serve more as a hacking code than a real solution!
Hope this helps.

Hi @jrmarqueshd, thanks for the reply.
I did the test with both suggestions, but it doesn't work for me :/
the error is returned

I'm trying to pass the values with setData
formRef.current?.setData({
   cpfcnpj: response.data.data[0].cpfcnpj,
   phone: response.data.data[0].phone[0].phone
 })

Hello!
I have the same problem.
I tried the solution cited by @jrmarqueshd , but it didn't work for me

Hello @lucasrisatto, are you using TypeScript? Can you share the code snnipet?

Hello @jrmarqueshd.
Yes, i'm using TypeScript.
this is my error.

I tried to use your code snippet, but the error above was displayed.
Besides, I'm trying to get the initial data for my CPFCNPJ field
useEffect(() => {
    api.get(`/people?&order=id&id=${id}`).then(cpfcnpj => {
      formRef.current?.setData({cpfcnpj: cpfcnpj})
      console.log(formRef.current?.setData)
    })
  }, []);

Hi @lucasrisatto.
My example is for those who are not using TypeScript.
In your case, I believe that it should be done like this:
setValue(ref: any, value: string) {
  ref.setInputValue(value);
},

If that doesn't work (as it should), you can try this code below, but, I'm not sure if it would be the best way.
setValue(ref: any, value: string) {
  if(ref) return ref.setInputValue(value);
},

If it works, it will serve more as a hacking code than a real solution!
Hope this helps.

Hi @jrmarqueshd, thanks for the reply.
I did the test with both suggestions, but it doesn't work for me :/
the error is returned

I'm trying to pass the values with setData
formRef.current?.setData({
   cpfcnpj: response.data.data[0].cpfcnpj,
   phone: response.data.data[0].phone[0].phone
 })

What is the return in console.log(ref)?

Hello!
I have the same problem.
I tried the solution cited by @jrmarqueshd , but it didn't work for me

Hello @lucasrisatto, are you using TypeScript? Can you share the code snnipet?

Hello @jrmarqueshd.
Yes, i'm using TypeScript.
this is my error.

I tried to use your code snippet, but the error above was displayed.
Besides, I'm trying to get the initial data for my CPFCNPJ field
useEffect(() => {
    api.get(`/people?&order=id&id=${id}`).then(cpfcnpj => {
      formRef.current?.setData({cpfcnpj: cpfcnpj})
      console.log(formRef.current?.setData)
    })
  }, []);

Hi @lucasrisatto.
My example is for those who are not using TypeScript.
In your case, I believe that it should be done like this:
setValue(ref: any, value: string) {
  ref.setInputValue(value);
},

If that doesn't work (as it should), you can try this code below, but, I'm not sure if it would be the best way.
setValue(ref: any, value: string) {
  if(ref) return ref.setInputValue(value);
},

If it works, it will serve more as a hacking code than a real solution!
Hope this helps.

Hi @jrmarqueshd, thanks for the reply.
I did the test with both suggestions, but it doesn't work for me :/
the error is returned

I'm trying to pass the values with setData
formRef.current?.setData({
   cpfcnpj: response.data.data[0].cpfcnpj,
   phone: response.data.data[0].phone[0].phone
 })

What is the return in console.log(ref)?

I did not receive any response from console.log (ref)

I have the same problem of @lucasrisatto. I'm using TypeScript, unform and react-input-mask. I fetch a Zip data and then:
          if (zip?.city) {
            addressFormRef.current?.setData({
              user_address: zip.street,
              user_city: zip.city,
              user_state: zip.state,
            });
          } else
            addressFormRef.current?.setErrors({
              user_zip_code: 'CEP not found',
            });

And then, the error: ref.setInputValue is not a function

Any solutions? I need to change the default value dynamically! There's any ohters options?

I'm having the exact same error.

I'm having the exact same error.

@FeMaffezzolli try use it:
  useEffect(() => {
    registerField({
      name: fieldName,
      ref: inputRef.current,
      path: 'value',
      setValue(ref: any, value: string) {
        if (!value) return ref.setInputValue("");
        ref.setInputValue(value);
      },
      clearValue(ref: any) {
        ref.setInputValue('');
      },
    });
  }, [fieldName, registerField]);

Can be a alternative to solve your problem.

@FeMaffezzolli try use it:
  useEffect(() => {
    registerField({
      name: fieldName,
      ref: inputRef.current,
      path: 'value',
      setValue(ref: any, value: string) {
        if (!value) return ref.setInputValue("");
        ref.setInputValue(value);
      },
      clearValue(ref: any) {
        ref.setInputValue('');
      },
    });
  }, [fieldName, registerField]);

Can be a alternative to solve your problem.

@jrmarqueshd , thanks for your reply.
Unfortunately I keep having the same error even after trying your snippet:

Would you have any other suggestion?

@jrmarqueshd , thanks for your reply.
Unfortunately I keep having the same error even after trying your snippet:

Would you have any other suggestion?

I had the same problem and managed to resolve the error as follows:
useEffect(() => {
    registerField({
      name: fieldName,
      ref: inputRef.current,
      path: 'value',
      setValue(ref: any, value: string) {
        ref.value = value;
      },
      clearValue(ref: any) {
        ref.value = '';
      },
    });
  }, [fieldName, registerField]);

I had the same problem, none of the above solutions worked, so to solve the "problem" I just took the data from the modified input and compared it with the data I filled in by default on the form. So I was able to validate the data and send it to the destination.


Validate Signature

User Story

As a user
I want to be able to validate a signature
So that I can confirm its validity

Acceptance Criteria

The public key can be provided from the hard drive or by the identity providers
Extract the algorithm used to sign the token
If no public key is provided by the user, the public key to confirm the signature is attained by the program
Given a signature function and a token, the validity of a token is confirmed

The public keys of an identity provider are accessible over their jwks_uri

https://www.npmjs.com/package/jsonwebtoken (used by the customer)

I have created our development branch for this task and have added the jsonwebtoken library.

I look, that I can use jwt.verify for the verification: https://github.com/auth0/node-jsonwebtoken#jwtverifytoken-secretorpublickey-options-callback

Philip has implemented and added the validation of the token (incl. the signature) last week with https://github.com/amosproj/amos2022ss08-openid-connect-doctor/commit/e32b4656524d70f03e01a5330625813a535b5413
@RumiAust Should we add an output of the validation into the frontend to complete this task? That would complete the acceptance criteria "the validity of a token is confirmed".

@skriesch  I think in the front end we just need to show a confirmation message of signature validity.


Fix dynamic header heights

Previously header cell heights were calculated based on a "max height is
king" algorithm where cells could grow to match the largest height, but
could never shrink, e.g. this let cells with no filter box be the same
height as those with no filter box.
This presented a problem with toggling features like filtering. If
suddenly no columns were filterable this would leave a big empty space at
the bottom of each header cell.
This change makes header cells display-type "table-cell", which lets them
render like a TD with full height, and places them in table-row and
table divs. Replacing "width" with "min-width" and "max-width" forces the
header cells to be the correct width.
Also the columnStyle method has been replaced with a
columnWrapperStyle method.

Hi, I'm set enableRowHeaderSelection:true and makin filter dynamic with ng-select. (ui grid last version)
For make that, the only way i found is remove the column without the filter and add the column again now with the filter.
If the option enableRowHeaderSelection is true, the header heights not working good,
show the filter when add and hide the input filter when remove but not change height any more.
I change this point to get the lowest and work's good.
I have another way to show and hide the filter, please tell me.
Thanks
             if (container.headerHeight < maxHeaderHeight) {
                container.explicitHeaderHeight = container.headerHeight;
           }
            if (container.headerCanvasHeight < maxHeaderCanvasHeight) {
                  container.explicitHeaderCanvasHeight = container.headerCanvasHeight;
            }

I believe this may have caused a bug.
I have just started to work with this control and I am at 101 in the tutorial and I get a header row that is the entire size of the viewport with a row the size of the horizontal scroll bar.
This code renderContainer.explicitHeaderCanvasHeight is undefined and the inherited height is that of the parent container element.
if (renderContainer.explicitHeaderCanvasHeight) {
ret += '\n .grid' + uiGridCtrl.grid.id + ' .ui-grid-render-container-' + $scope.containerId + ' .ui-grid-header-canvas { height: ' + renderContainer.explicitHeaderCanvasHeight + 'px; }';
}
else {
ret += '\n .grid' + uiGridCtrl.grid.id + ' .ui-grid-render-container-' + $scope.containerId + ' .ui-grid-header-canvas { height: inherit; }';
}


Data is backed up, but backup enters failed phase due to "can't extract backup id"

As the title suggests, I am able to backup my data using a Backup or ScheduledBackup.   However, the backup is unable to extract a backup id which puts the backup in the failed phase.
Here's the backup schedule:
apiVersion: postgresql.cnpg.io/v1
kind: ScheduledBackup
metadata:
  name: cnpg-backup
spec:
  schedule: "50 * * * *"
  backupOwnerReference: self
  cluster:
    name: my-cluster

The logs:
my-cluster-2 postgres {
  "level": "info",
  "ts": "2023-07-26T09:12:07Z",
  "msg": "WAL archiving is working",
  "logging_pod": "my-cluster-2"
}
my-cluster-2 postgres {
  "level": "info",
  "ts": "2023-07-26T09:12:07Z",
  "msg": "Backup started",
  "backupName": "cnpg-backup",
  "backupNamespace": "cnpg-backup",
  "logging_pod": "my-cluster-2",
  "options": [
    "--user",
    "postgres",
    "--name",
    "backup-1690362727",
    "--endpoint-url",
    "<my s3 compatible storage>",
    "--cloud-provider",
    "aws-s3",
    "<my s3 destination>",
    "my-cluster"
  ]
}
my-cluster-2 postgres {
  "level": "info",
  "ts": "2023-07-26T09:12:29Z",
  "msg": "Backup completed",
  "backupName": "cnpg-backup",
  "backupNamespace": "cnpg-backup",
  "logging_pod": "my-cluster-2"
}
my-cluster-2 postgres {
  "level": "error",
  "ts": "2023-07-26T09:12:30Z",
  "logger": "barman",
  "msg": "Can't extract backup id",
  "logging_pod": "my-cluster-2",
  "command": "barman-cloud-backup-show",
  "options": [
    "--format",
    "json",
    "--endpoint-url",
    "<my s3 compatible storage>",
    "--cloud-provider",
    "aws-s3",
    "<my s3 destination>",
    "my-cluster",
    "backup-1690362727"
  ],
  "stdout": "",
  "stderr": "2023-07-26 09:12:30,354 [273] ERROR: Barman cloud backup show exception: Unknown backup 'backup-1690362727' for server 'my-cluster'\n",
  "error": "exit status 4",
  "stacktrace": "github.com/cloudnative-pg/cloudnative-pg/pkg/management/log.(*logger).Error\n\tpkg/management/log/log.go:128\ngithub.com/cloudnative-pg/cloudnative-pg/pkg/management/barman.executeQueryCommand\n\tpkg/management/barman/backuplist.go:87\ngithub.com/cloudnative-pg/cloudnative-pg/pkg/management/barman.GetBackupByName\n\tpkg/management/barman/backuplist.go:140\ngithub.com/cloudnative-pg/cloudnative-pg/pkg/management/postgres.(*BackupCommand).getExecutedBackupInfo\n\tpkg/management/postgres/backup.go:383\ngithub.com/cloudnative-pg/cloudnative-pg/pkg/management/postgres.(*BackupCommand).takeBackup\n\tpkg/management/postgres/backup.go:352\ngithub.com/cloudnative-pg/cloudnative-pg/pkg/management/postgres.(*BackupCommand).run\n\tpkg/management/postgres/backup.go:267"
}
my-cluster-2 postgres {
  "level": "error",
  "ts": "2023-07-26T09:12:30Z",
  "msg": "Backup failed",
  "backupName": "cnpg-backup",
  "backupNamespace": "cnpg-backup",
  "logging_pod": "my-cluster-2",
  "error": "exit status 4",
  "stacktrace": "github.com/cloudnative-pg/cloudnative-pg/pkg/management/log.(*logger).Error\n\tpkg/management/log/log.go:128\ngithub.com/cloudnative-pg/cloudnative-pg/pkg/management/postgres.(*BackupCommand).run\n\tpkg/management/postgres/backup.go:271"
}

Happy to provide more config if it is helpful.
As an aside, when this problem is encountered using ScheduledBackup, it seems to cause the ScheduledBackup to run repeatedly rather than adhering to its schedule.

I'm running into this issue as well, I'm on linode s3 storage, perhaps that might cause the issue somehow

Fixed it with help from https://github.com/EnterpriseDB/barman/issues/835. Moving the bucket name from the endpoint url into the destinationpath fixes it (see https://github.com/cloudnative-pg/cloudnative-pg/pull/2630/files)

Thank you so much. I spent several hours on the problem. In my case it was the following combination:
Failing chart config:
backups:
  data:
    encryption: "" # Contabo does not support encryption
  wal:
    encryption: "" # Contabo does not support encryption
  endpointURL: "https://eu2.contabostorage.com/cnpg-cluster-backups-prod"
  s3:
    bucket: "cnpg-cluster-backups-prod"

Successful config:
backups:
  enabled: true
  data:
    encryption: "" # Contabo does not support encryption
  wal:
    encryption: "" # Contabo does not support encryption
  endpointURL: "https://eu2.contabostorage.com"
  destinationPath: "s3://cnpg-cluster-backups-prod/"
  s3:
    bucket: "cnpg-cluster-backups-prod"


Adjust load_nodes_from JSON that it also handles lists correctly

Description
Use more json help to encode lists correctly for the decoding of lists, and dicsts of nodes.
Changes
Refactor nodes.util.init.py to separate the json related functions.
Known Issues
Notes
Checklist

[x] My name is on the list of contributors (CONTRIBUTORS.md) in the pull request source branch.
[x] I have updated the documentation to reflect my changes.
[x] My code changes have been verified by automated tests and pass all relevant test scenarios.

great - I can incorporate this


Not able to create multiple task based on different tags

I have 3 different tags in my PBI. I want to create 3 different task based on the tags available in the PBI.
Problem is sometimes its working. But, after few  minutes It stopped working  and getting below error.
When I click 1-click-links, am getting an error as

"No Task,Test Case templates found. Please add Task,Test Case templates for the project team."

Some other time, I am getting below error also,

Cannot insert duplicate key row in object 'dbo.LinksAre' with unique index 'PK_LinksAre'. The duplicate key value is (41824, 91, 2, 117, 7332867, 7332867, ). azure devops

I sometimes get the same error message:

Cannot insert duplicate key row in object 'dbo.LinksAre' with unique index 'PK_LinksAre'. The duplicate key value is (1, 70234, 2 70235, 166, 166, <NULL>).
In my case, I'm adding multiple work items to one parent workitem, not based on any tags.


Order / Position not remembered?

I've created a freeboard, moved the panes around, then saved the board.
When I load the board, the panes are in a completely different order.
Is there a way to maintain the position of the panes on Serialize?
Possible dupe of #67?

I'm in the same boat here.  It appears that in FreeboardUI.js, in the addPane() function you are indeed tracking changes to the data-row and data-col and calling the updatePositionForScreenSize() function where you are updating both paneModel.row and paneModel.col objects.  I'm not quite sure where to go from here.  Additionally, has there been any luck updating to the latest version of gridster?  I tried to reference the latest version but it caused all sorts of issues.

Any news regarding this???

I think this project has been abandoned, sorry.

Was it or not???

Is there any update regarding this subject?

This has been fixed.