GH-39702: [GLib] Add support for time zone in GArrowTimestampDataType

Rationale for this change
Timestamp data type in Apache Arrow supports time zone but Apache Arrow C GLib didn't support it. Timestamp data type has "timezone-aware" mode and "timezone-naive" mode. If a timestamp data type has a valid time zone information, it uses "timezone-aware" mode. If a timestamp data type doesn't have a valid time zone information, it uses "timezone-naive" mode. Apache Arrow C GLib should support both of them.
What changes are included in this PR?
This change adds a new GTimeZone *time_zone argument to garrow_timestamp_data_type_new() instead of adding a new garrow_timestamp_data_type_new_time_zone() function. This breaks backward compatibility for Apache Arrow C GLib users. But this still keeps backward compatibility for users of bindings such as Ruby and Vala. Because the new GTimeZone *time_zone is nullable.
I tried to use the "adding a new
garrow_timestamp_data_type_new_time_zone() function" approach but Vala didn't like it. Both of
garrow_timestamp_data_type_new_time_zone() (constructor) and garrow_timestamp_data_type_get_time_zone() (instance method or property reader) were mapped to
GArrow.TimestampDataType.time_zone().
So I chose the "adding a new argument to
garrow_timestamp_data_type_new()" approach.
Are these changes tested?
Yes.
Are there any user-facing changes?
Yes.
This PR includes breaking changes to public APIs.

Closes: #39702

+1


SecurityPolicyDsc: OptIn to DSC Resource Meta Tests

Pull Request (PR) description
This PR opts in to the following DSC Resource meta tests:

Common Tests - Validate Module Files
Common Tests - Validate Script Files
Common Tests - Validate Markdown Files
Common Tests - Required Script Analyzer Rules
Common Tests - Flagged Script Analyzer Rules
Common Tests - New Error-Level Script Analyzer Rules
Common Tests - Custom Script Analyzer Rules
Common Tests - Validate Markdown Links
Common Tests - Relative Path Length

To pass the Common Tests - Validate Script Files test, the following files have had their BOM removed:

Examples/AccountPolicy_Example.ps1
Tests/Integration/MSFT_SecurityTemplate.Integration.tests.ps1
Tests/Integration/MSFT_SecurityTemplate.config.ps1

To pass the Common Tests - Validate Script Files, a Write-Verbose command was added to the Get-TargetResource function of the SecurityTemplate resource.
To pass the Common Tests - Validate Markdown Files test, markdown issues were fixed in the README.md file.
This Pull Request (PR) fixes the following issues
None
Task list

[x] Added an entry under the Unreleased section of the change log in the README.md.
Entry should say what was changed, and how that affects users (if applicable).
[ ] Resource documentation added/updated in README.md.
[ ] Resource parameter descriptions added/updated in README.md, schema.mof
and comment-based help.
[ ] Comment-based help added/updated.
[ ] Localization strings added/updated in all localization files as appropriate.
[ ] Examples appropriately added/updated.
[ ] Unit tests added/updated. See DSC Resource Testing Guidelines.
[ ] Integration tests added/updated (where possible). See DSC Resource Testing Guidelines.
[ ] New/changed code adheres to DSC Resource Style Guidelines and Best Practices.

This change is

Codecov Report

Merging #130 into dev will not change coverage.
The diff coverage is n/a.

@@        Coverage Diff         @@
##           dev   #130   +/-   ##
==================================
  Coverage   89%    89%
==================================
  Files        5      5
  Lines      497    497
==================================
  Hits       446    446
  Misses      51     51

Would someone please review this PR? Thanks.

@jcwalker Do you have time to review this?

I've resolved the conflicts on this PR so it is now ready for review.


new error in sveltekit integration (similar to #69)

I now just get a new error:
Cannot destructure property 'building' of '(intermediate value)' as it is undefined.
    at Module.svelteKitHandler

Originally posted by @nevthereal in https://github.com/better-auth/better-auth/issues/69#issuecomment-2393235055

Could you please confirm if this issue still occurs in the latest release (0.2.9-beta.9)?

it is now gone, thanks!
I will soon do a video about your work btw


Issues after updating to latest iOS SDK with WatsonAuthenticator

After updating to the following :
pod 'IBMWatsonAssistantV1', '~> 3.0.0'
pod 'IBMWatsonConversationV1', '~> 0.38.1'
pod 'IBMWatsonTextToSpeechV1', '~> 3.0.0'

I know am seeing an issue with the new WatsonAuthenticator. I'm getting a "does not conform to protocol 'Authenticator'" in the class in which I am trying to init a TextToSpeech object like so :
var textToSpeech = TextToSpeech.init(authenticator: self)

I am clearly conforming to the protocol :
func authenticate(request: RestRequest, completionHandler: @escaping (RestRequest?, RestError?) -> Void) {}

func authenticate(request: URLRequest, completionHandler: @escaping (URLRequest?, RestError?) -> Void) {}

Yet I cant get past this error and build.  Please any help would be appreciated.  I am using Swift 5.

@shokaveli thanks for bringing this up, and apologies for the initial delay in getting to this. Let me see if I can replicate this and I'll write back and see if I can help here.

Great thanks!
On Nov 12, 2019, 2:20 PM -0600, Jeff Arn<EMAIL_ADDRESS>wrote:

@shokaveli thanks for bringing this up, and apologies for the initial delay in getting to this. Let me see if I can replicate this and I'll write back and see if I can help here.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or unsubscribe.

@shokaveli I believe I've found a possible cause the issue here. By implementing the protocol Authenticator, you need to provide two methods that use RestRequest and RestError. This requires you to explicitly import the IBMSwiftSDKCore, which is a sub-dependency of the SDK pods.
We typealias RestError into WatsonError, but we do not have a typealias for RestRequest, so that import is needed for it to compile.
import TextToSpeech
import IBMSwiftSDKCore

class Something: NSObject, WatsonAuthenticator {
    func authenticate(request: RestRequest, completionHandler: @escaping (RestRequest?, RestError?) -> Void) {

    }

    func authenticate(request: URLRequest, completionHandler: @escaping (URLRequest?, RestError?) -> Void) {

    }

}

That fixed it! Thanks!

@shokaveli great! Glad that was it. Closing this as resolved


add uri support

Matt, we use sqlite vfs to allow compression.  This patch allows passing a file uri like file:/tmp/foo/bar.zindex?zv=zlib and the vfs will know how to handle the uri params.  It required SQLITE_OPEN_URI.  Regular files are still supported. I also added a method to convert the uri to a file in order to unlink (kind of a hack)

Hi mate!
Oh neat!! I was only thinking about this the other week (I did a presentation at work - some cute slides at https://mattgodbolt.github.io/zindex-pres/ esp https://mattgodbolt.github.io/zindex-pres/huffman.html ) - sounds great!


Removing old demo of WLS on K8S, the prometheus and Grafana samples h…

…ave been moved under the WebLogic Monitoring Exporter project

Can you please update a README to point to the WebLogic Monitoring Exporter project?

Which README?

Whichever one you think is the most appropriate to guide users to where the content is. :)


Support for Sunmi V2s devices

This package works on V2 modal but it is not able to print on Snumi V2s devices.

It supports V2s. I have already tested it. But you need to add  #4


Question/Suggestion - Connecting to Countries

This is an observation/question. Maybe I'm missing something. I love the ease of use of this on importing everything related to time zones. Has there been any thought on connecting these in some way with a mapping table or so forth to the actual countries via ISO country codes?

What sort of link would you be wanting?
An ISO country code might refer to a country with multiple time zones.

It looks like this has been covered in moment.  I wonder if the logic could be re-used for this application:
https://github.com/moment/moment-timezone/issues/289

The question is not silly at all, I also need a solution.

In such cases, the expected operation is that if there are multiple matches, an array is returned with all matching values.
The developer then decides which element of the array to use. In most cases, probably the first element, but one has to think of more complex uses, so it would be perfect if all time zones could be obtained in one array.
In addition, the array should somehow return in a form that allows further operations to be performed.

Thank you.


Inconsistent host_name data in genome core

There are several variations on human, homo sapiens in the genome core, which makes the faceting wierd.  Can they be cleaned up?

fixed on production solr.


Reuse Models on subsequent requests

Maybe I'm reading code wrong, but it looks like it loads the Whisper model at least on every request.  Seems like we should have some option of retaining models. I understand massive memory requirements so you may not want them all loaded forever.

that's a fair point actually, we should treat whisper like the other models and keep that in memory

fixed in #233


Is this only for Windows ?

I though the above documentation can be used for Linux too, The JSON format presented here, does it support only windows and is there any other page which shows how to install the extension on Linux VMs and VMss with ARM template ?
How does it work with the VMs and VMss which has docker.I had trouble installing both because the dpkg gets locked by one of them and if extension goes first , I miss the dependencies needed to be installed for the docker through OMS for log collection .

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: be778ff9-80c7-0d7b-5c5b-7e3c74ce92c5
Version Independent ID: 5333482c-b7dc-3092-1a73-8fb412be623b
Content: OMS Azure virtual machine extension for Windows
Content Source: articles/virtual-machines/windows/extensions-oms.md
Service: virtual-machines-windows
GitHub Login: @danielsollondon
Microsoft Alias: danis

@akramwaseem Thanks for the question! We are investigating and will update you shortly.

Looks to be the same issue you have already opened on this doc #7460
But the template for Linux should be simliar. Check the following: https://docs.microsoft.com/en-us/azure/virtual-machines/linux/extensions-oms

@akramwaseem as per the question with docker do you mean installing docker via the extension and the OMS extension? You should be able to specify multiple extensions in an Arm template just as you would in PowerShell

@MicahMcKittrick-MSFT -- I think docker extension is discontinued, you can check around and let me know.As per my knowledge Microsoft is not encouraging to use the docker extension anymore.
I am installing the docker through cloud-init and upstart script for ubuntu and OSM with OMS extension.
The problem we have here is OMS gets installed first every time we try and because of that we are missing the docker dependencies need for OMS to collect the logs.
And regarding the template, it says it is for windows and doesn't  specify anything about Linux . If we go by the header people might get confused .

@akramwaseem Have you attempted the same solution using a version of Ubuntu that already has docker installed? Such as the following:

@MicahMcKittrick-MSFT -- I dont think we can use the ubuntu which comes with docker pre installed. Because we are using our own docker register and we have a script we get the images from the our own docker register and setup the docker host during the runtime of cloud init .

@MicahMcKittrick-MSFT -- that might not be possible . We have around 500 VMs in all the subscriptions and we test the new ones all the time and In don't think that is a valid structure when you are trying to implement as Saas or Iaas.
Also I tried the option you mentioned and seems like it is same as docker extension and docker extension is discontinued .so seems like I cannot use the docker with ubuntu and it is only classic not ARM based.
can you check with the team , who are working with this and what are there plans to implement it when docker is running.

@MicahMcKittrick-MSFT -- I found a interesting document in github from OMSagentforLinux repo, which is as follows
My question we cannot follow the same format for the VMss, I tried and VMss doesn't work that way .
Below format works only with the VMs and not VMss.
2.3. Using ARM Template
{
"type": "Microsoft.Compute/virtualMachines/extensions",
"name": "",
"apiVersion": "",
"location": "",
"dependsOn": [
"[concat('Microsoft.Compute/virtualMachines/', )]"
],
"properties": {
"publisher": "Microsoft.EnterpriseCloud.Monitoring",
"type": "OmsAgentForLinux",
"typeHandlerVersion": "1.4",
"settings": {
"workspaceId": "",
"stopOnMultipleConnections": true/false
},
"protectedSettings": {
"workspaceKey": "",
"proxy": "",
"vmResourceId": ""
}
}
}

@akramwaseem I am trying to figure it out for you. I can simply do this via a PowerShell script but it is slightly more difficult via arm.
https://blogs.msdn.microsoft.com/timomta/2018/04/09/how-to-add-the-oms-client-to-a-vm-scale-set/
The issue with your above might be due to the depends on property. I believe it needs to be like:
dependsOn": [
"[concat('Microsoft.Compute/virtualMachineScaleSets/', variables

@gatneil do you have any examples handy on doing this? I am not finding any documentation anywhere for this specific scenario.

You can do the same thing for scale sets, but everywhere it says "virtualMachines/extensions", you instead need "virtualMachineScaleSets/extensions"

Ah okay! Thanks @gatneil! So I was on the right track with my above comment then :)

@MicahMcKittrick-MSFT -- nope, that doesn't work with VMss.I tried.
I figured it out , I found an article from the github on how it can be added.

@akramwaseem can you share the article from GitHub you found?

@MicahMcKittrick-MSFT -- below is the method, I am trying to use.
"virtualMachineProfile": {
"extensionProfile": {
"extensions": [
{
"name": "[concat(variables('vmNodeType0Name'),'OMS')]",
"properties": {
"publisher": "Microsoft.EnterpriseCloud.Monitoring",
"type": "OmsAgentForLinux",
"typeHandlerVersion": "1.4",
"autoUpgradeMinorVersion": true,
"settings": {
"workspaceId": "[reference(resourceId('Microsoft.OperationalInsights/workspaces/', parameters('omsWorkspacename')), '2015-11-01-preview').customerId]"
},
"protectedSettings": {
"workspaceKey": "[listKeys(resourceId('Microsoft.OperationalInsights/workspaces/', parameters('omsWorkspacename')),'2015-11-01-preview').primarySharedKey]"
}
}
},

@akramwaseem have you attempted to do this via PowerShell as well? I have personally done that and it has worked without issue. Maybe something to consider as well.

@MicahMcKittrick-MSFT -- we used linux machines and we do not intend to use powershell at any case.We do you azure cli but, we have around 100 machines per subscription.
How do you suggest to do that ? manually ? That is not a proper way and it doesn't not convey the standards we have.

@akramwaseem I believe at this point you might benefit from 1:1 support from a Support Engineer. That way you both can share full templates and they can see what is happening on the back end. Do you have the ability to open a technical support ticket? If not I can enable one for you.

Did a bit of digging, and we do actually have an example of this lying around: https://github.com/gatneil/mvss/blob/child-extension/azuredeploy.json
Hope this helps!

@MicahMcKittrick-MSFT -- Havent tried yet. Give me couple of days and will let you know.

@akramwaseem I am going to close this out for now. Please come back after you have tested and let us know the results. We can reopen to continue if needed.


Demos: only listen for width resize (#206)

Description

Avoid triggering a resize when viewport height changes on the demos.
Motivation and Context

Undesired rerender on mobile browsers when scrolling, see #206
How Has This Been Tested?

Tested on Android, Samsung S7 + Chrome
Screenshots (if appropriate):
Types of changes

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[x] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[x] I have read the CONTRIBUTING document.
[ ] I have added tests to cover my changes.
[x] All new and existing tests passed.

Thanks @nobitagit ! That was neat!


Java: Unable to use SecretValue

Describe the bug
I have the issue described in https://github.com/awslabs/aws-cdk/issues/2304
Will the fix only be available in 0.29 release?

resolved by upgrading


Better advertising for the R package

We need better advertising for the R api.  Luke has good documentation for that which we could directly link to.  Not sure if should get top-level tab, but maybe we could change "blog" to "more" and have the read.md for the R api as one option and the blog as the other?

The documentation needs to be updated, and @aaronrudkin and I need to work on the query parser a little bit more.


Bug : "Invalid call. Nonexistent function slerp in base Vector3"

**Godot version: **

v3.0.6.stable.official
OS/device including version:

Windows 10
Issue description:

Documentation for Vector3 includes a slerp function. Calls to this function result in the engine returning an error stating that the function doesn't exist.
Steps to reproduce:
var newVect = Vector3(0,1,1)
var oldVect = Vector3(1,0,0)
newVect.slerp(oldVect, 0.1)

Vector3 doesn't have slerp. The docs doesn't include it either. Where did you find it?


Having the possibilty to manage multiple simulation at once

Problem
I want to run at least 2 simulation at the same time, so to register for on SymuFlow dll multiple simulation. Currently SymuPy only use the defualt network id when calling the C interface.

[ ] Check in SymuFlow how are increments of NetworkID managed.

Use case:
x = cdll.LoadLibrary('libSymuFlow.dylib')
id_sim1 = x.LoadNetwork('my_file.xml')

id_sim2 = x.LoadNetwork('my_file.xml')
x.SymurunNextStepEx(id_sim1)

simulator = Simulator() #id1
simulator2 = Simulator() #id2

with simulator1, simulator2:
   simulator1.run_step()
   simulator2.run_step()

[ ] Add return of simulation id in LoadNetworkEx
[ ] Modify Simulator instances for matching the corresponding runtime action. run_step(simulation_id)

No updates


Update OpenResolver

Deployed OpenResolver has issues...
New fixed OpenResolver deployed on Matic
To deploy on other networks

working : https://app.kredeum.com/#/bsc/0x432d2604dAa118e3B6C390E1E599F64768ff4B19/12
not working : https://app.kredeum.com/#/bsc/0x432d2604dAa118e3B6C390E1E599F64768ff4B19


QueryDSL not converting Time correctly when value is 00:00:00

Hi,
I have in my database (mariadb) a Time field whose value is 00:00:00. My entity defines a java.util.Date field to store that value. The problem is that when I retreive that entry from the database the date field in my entity instance is Null instead of having a Date Object representing midnight.
Regards,
Bruno Delor-Sullivan

Do you use Querydsl SQL or JPA?

I Use Querydsl JPA with Hibernate

Then the mapping is handled by Hibernate and not Querydsl. You might want to look into the Hibernate type that handles the result set / statement mapping and see if something might go wrong there.


increase port identifier limit to 128 characters

Description

closes: #339

Before we can merge this PR, please make sure that all the following items have been
checked off. If any of the checklist items are not applicable, please leave them but
write a little note why.

[x] Targeted PR against correct branch (see CONTRIBUTING.md)
[x] Linked to Github issue with discussion and accepted design OR link to spec that describes this work.
[x] Code follows the module structure standards.
[x] Wrote unit and integration tests
[x] Updated relevant documentation (docs/) or specification (x/<module>/spec/)
[x] Added relevant godoc comments.
[x] Added a relevant changelog entry to the Unreleased section in CHANGELOG.md
[x] Re-reviewed Files changed in the Github PR explorer
[x] Review Codecov Report in the comment section below once CI passes

Codecov Report

Merging #344 (90b1a6c) into main (e86cdbe) will not change coverage.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##             main     #344   +/-   ##
=======================================
  Coverage   78.86%   78.86%
=======================================
  Files         117      117
  Lines        9598     9598
=======================================
  Hits         7569     7569
  Misses       1647     1647
  Partials      382      382

Impacted Files
Coverage Δ

modules/core/24-host/validate.go
100.00% <100.00%> (ø)


Proxying redis-stat (with nginx) fails

Ubuntu 16.04
Having other services proxied wih nginx successfully, it fails with redis-stat.
sudo redis-stat --server --daemon
Accessing via http(s)://domain/redis shows the following screen (proxied setup), but no content:

Doing the same but accessing direct (http://server:63790), without nginx and proxying, works.
Example logs entries:
access log:
"GET /js/site.js HTTP/2.0" 404 210 "https://xxxx/redis/"
error log:
open() "/var/www/xxxx/js/site.js" failed (2: No such file or directory),  request: "GET /js/site.js HTTP/2.0"
It tries to access files locally instead of proxying them
Here is the corresponding config. As said, other apps proxied work like a charm
        location /redis/ {
                # proxy to redis-stat
                proxy_buffering    off;
                proxy_set_header   Host $http_host;
                proxy_set_header   X-Real-IP $remote_addr;
                proxy_http_version 1.1;
                proxy_pass         http://<IP_ADDRESS>:63790/;
        }

Tried to play with the nginx settings around, but it always ends up with the error messages described above.

Thanks for the heads up. Sorry that I don't have enough time to maintain this repository at the moment. redis-stat web server is just a sinatra app, I don't think there's anything special about it. So you might want to test if it works well with a simple sinatra app running on thin.

@junegunn
I found the root cause and after changing it, it worked for both, direct web access and for proxying (valid for any webserver)!
In file: redis-stat/lib/redis-stat/server/views/index.erb
old: path is absolute
...
    <title>redis-stat</title>
    <link href="/bootstrap/css/bootstrap.min.css" rel="stylesheet"/>
    <link href="/jqplot/jquery.jqplot.min.css" rel="stylesheet"/>
    <link href="/select2/select2.css" rel="stylesheet"/>
    <link href="/select2/select2-bootstrap.css" rel="stylesheet"/>
    <link href="/css/site.css" rel="stylesheet"/>

...
        // TODO Check (typeof(EventSource) !== "undefined")

        var source = new EventSource("/pull")

new: pls see the dot before the slash making the path relative
...
    <title>redis-stat</title>
    <link href="./bootstrap/css/bootstrap.min.css" rel="stylesheet"/>
    <link href="./jqplot/jquery.jqplot.min.css" rel="stylesheet"/>
    <link href="./select2/select2.css" rel="stylesheet"/>
    <link href="./select2/select2-bootstrap.css" rel="stylesheet"/>
    <link href="./css/site.css" rel="stylesheet"/>

...
        // TODO Check (typeof(EventSource) !== "undefined")

        var source = new EventSource("./pull")

Would be great if you could incooperate and merge it.
BTW:
I have a sample config for nginx to proxy it,
and a script example for Ubuntu to create a standard start/stop environment inclunding upstart.
If interested - where to put it to? (I could add these to this issue and you could take it and merge it in your readme)

Thanks for looking into it. Yeah, a script for setting up a testing environment would be nice.
A couple questions:

We can simply remove the leading /, right? (instead of prepending .)

e.g. <link href="bootstrap/css/bootstrap.min.css" rel="stylesheet"/>

If so, what should we do with line 23?

redis-stat

Thanks for looking into it. Yeah, a script for setting up a testing environment would be nice.

#58

ad 1
yes, you are right, just remove /
http://webmasters.stackexchange.com/questions/56573/relative-link-to-a-subfolder
The part ./ is removed from the start of a URL as part of URL resolution as defined in STD 66.
This has nothing to do with folders or files; it is just string manipulation dictated by generic
URL specifications. Thus, for example, the URLs picture1.jpg and ./picture1.jpg have identical
meaning: they resolve to the same absolute URL.

ad 2
http://stackoverflow.com/questions/9221872/link-practice-without-in-the-beginning-of-href
redis-stat -> redis-stat
It is not good practise to use subpage-1 urls exactly because of redirections you might
implement later on. If you insist on working in a folder, you can use ./subpage-1 and
./ for the home link.

I have tested it and it works. When you proxy to access redis-stat from a subfolder, the href link resolved must be the complete url like domain/redis-status.
Without ./ you end up in domain (without redis-status subfolder in the URI) which is a different location.

Thanks for digging those up. Would you be interested in sending me a PR?


a more elegant way

What is the purpose of the change
a more elegant way，higher efficiency。
Brief changelog
no
Verifying this change
yes
Follow this checklist to help us incorporate your contribution quickly and easily:
run the test case

Can u give some benchmark to verify that your way is better performance?

Can u give some benchmark to verify that your way is better performance?

我做过一些测试，从一到百万，用该种方式的效率是原来方式的几十倍

From hashmap

Attach your code will be better.
Maybe a little ut in org.apache.dubbo.common.timer.HashedWheelTimerTest is enough.

Codecov Report

Merging #3567 into master will increase coverage by 0.06%.
The diff coverage is 100%.

@@             Coverage Diff              @@
##             master    #3567      +/-   ##
============================================
+ Coverage     63.98%   64.05%   +0.06%
  Complexity       71       71
============================================
  Files           664      664
  Lines         28629    28632       +3
  Branches       4753     4767      +14
============================================
+ Hits          18319    18339      +20
+ Misses         8079     8069      -10
+ Partials       2231     2224       -7

Impacted Files
Coverage Δ
Complexity Δ

...rg/apache/dubbo/common/timer/HashedWheelTimer.java
58.62% <100%> (+0.78%)
0 <0> (ø)
:arrow_down:

...e/dubbo/remoting/transport/netty/NettyChannel.java
57.64% <0%> (-3.53%)
0% <0%> (ø)

...bo/rpc/cluster/support/FailbackClusterInvoker.java
67.21% <0%> (-3.28%)
0% <0%> (ø)

.../exchange/support/header/HeaderExchangeServer.java
65.09% <0%> (-1.89%)
0% <0%> (ø)

...che/dubbo/common/compiler/support/JdkCompiler.java
64.54% <0%> (ø)
0% <0%> (ø)
:arrow_down:

.../apache/dubbo/remoting/transport/AbstractPeer.java
63.04% <0%> (ø)
0% <0%> (ø)
:arrow_down:

...ache/dubbo/remoting/transport/AbstractChannel.java
75% <0%> (ø)
0% <0%> (ø)
:arrow_down:

...org/apache/dubbo/registry/redis/RedisRegistry.java
39.03% <0%> (+0.28%)
0% <0%> (ø)
:arrow_down:

...org/apache/dubbo/config/context/ConfigManager.java
65.07% <0%> (+0.79%)
0% <0%> (ø)
:arrow_down:

... and 10 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ade0cd7...ebeab5d. Read the comment docs.

static final int newNormalizeTicksPerWheel(int ticksPerWheel) {
int n = ticksPerWheel;
n |= n >>> 1;
n |= n >>> 2;
n |= n >>> 4;
n |= n >>> 8;
n |= n >>> 16;
return n + 1;
}
public static void main(String[] args) {
    Long startTime = System.currentTimeMillis();
    for (int n = 1; n < 10000000; n++) {
        oldNormalizeTicksPerWheel(n);
    }
    Long endTimeOne = System.currentTimeMillis();
    for (int n = 1; n < 10000000; n++) {
        newNormalizeTicksPerWheel(n);
    }
    System.out.println(endTimeOne - startTime);
    System.out.println(System.currentTimeMillis() - endTimeOne);
}

private static int oldNormalizeTicksPerWheel(int ticksPerWheel) {
    int normalizedTicksPerWheel = 1;
    while (normalizedTicksPerWheel < ticksPerWheel) {
        normalizedTicksPerWheel <<= 1;
    }
    return normalizedTicksPerWheel;
}


[WIP] feat: set diagnostic aggregator param for beta/v2.1.0

Description

[統合]System_Hazard_and_Fail_Safeに従い、diagnostic aggregator に登録するパラメータの変更を行った。
aip_launcher、https://github.com/tier4/autoware_launch.x2/pull/243においてもdiagnostic関連の変更を行った。この変更とhttps://github.com/tier4/autoware_launch.x2/pull/220 にあるsystem_error_monitor, dummy_diag_publisher, fault_injectionのparameterの変更をすべて反映することにより、[統合]System_Hazard_and_Fail_Safeと実際のparamterの設定を合致させる。
Related links
https://github.com/tier4/autoware_launch.x2/pull/220
https://github.com/tier4/autoware_launch.x2/pull/243
https://github.com/tier4/aip_launcher/tree/feature/set-diag-param-for-beta-v2.1.0
[統合]System_Hazard_and_Fail_Safe

Tests performed

Notes for reviewers

Pre-review checklist for the PR author
The PR author must check the checkboxes below when creating the PR.

[ ] I've confirmed the contribution guidelines.
[ ] The PR follows the pull request guidelines.

In-review checklist for the PR reviewers
The PR reviewers must check the checkboxes below before approval.

[ ] The PR follows the pull request guidelines.
[ ] The PR has been properly tested.
[ ] The PR has been reviewed by the code owners.

Post-review checklist for the PR author
The PR author must check the checkboxes below before merging.

[ ] There are no open discussions or they are tracked via tickets.
[ ] The PR is ready for merge.

After all checkboxes are checked, anyone who has write access can merge the PR.

Codecov Report

:exclamation: No coverage uploaded for pull request base (beta/v0.6.1@c4b243b). Click here to learn what that means.
Patch has no changes to coverable lines.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
Additional details and impacted files
@@              Coverage Diff               @@
##             beta/v0.6.1     #285   +/-   ##
==============================================
  Coverage               ?   10.48%
==============================================
  Files                  ?     1248
  Lines                  ?    91215
  Branches               ?    21011
==============================================
  Hits                   ?     9566
  Misses                 ?    71477
  Partials               ?    10172

Flag
Coverage Δ

*Carryforward flag

differential
0.00% <0.00%> (?)

total
10.46% <0.00%> (?)

Carriedforward from 56f9be9

*This pull request uses carry forward flags. Click here to find out more.
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

cherry-pickしてPRを作り直しました。https://github.com/tier4/autoware.universe/pull/340


Ruby Rack/Rails

Hi, I maintain the Rack Lambda project. Is there an opportunity to mention how the Lamby project (https://github.com/customink/lamby) does this for Ruby and all Rack applications in Ruby like Rails, Sinatra, etc? That project is even listed as an AWS Lambda web server on Rack's page. https://github.com/rack/rack#supported-web-servers
Maybe this project can link to ours in the Acknowledgement section?

This is wonderful suggestions. I will add a section in the README for the related projects.

Thanks, I added a link to this project from mine too. Cheers.


[ci:component:github.com/gardener/vpn2:0.22.0->0.23.1]

Release Notes:
Security improvements to the `openvpn` configuration. Due to backwards incompatible change between the vpn server and client a short downtime is to be expected during the initial upgrade.

/test pull-gardener-e2e-kind-ha-multi-zone-upgrade

/lgtm


camel-cased column name causes sorting to fail

We have a model with a unconventional camel-cased name "likeThis" instead of "like_this", when viewing a list of these models, and attempting to sort by that field, we get an exception from the database that that column doesn't exist because it appears to be looking for "likethis" (it looks downcased).
ActionView::Template::Error (PG::Error: ERROR:  column our_table.likethis does not exist
2012-08-13T18:44:13+00:00 app[web.1]: LINE 1: SELECT  "our_table".* FROM "our_table"  ORDER BY our_table.likethi...
2012-08-13T18:44:13+00:00 app[web.1]:                                                        ^
2012-08-13T18:44:13+00:00 app[web.1]: : SELECT  "our_table".* FROM "our_table"  ORDER BY our_table.likeThis asc LIMIT 20 OFFSET 0):
2012-08-13T18:44:13+00:00 app[web.1]:     120:       %tbody
...
2012-08-13T18:44:13+00:00 app[web.1]:     122:           %tr
2012-08-13T18:44:13+00:00 app[web.1]:     123:             %td
2012-08-13T18:44:13+00:00 app[web.1]:     124:               = check_box_tag "bulk_ids[]", object.id, false
2012-08-13T18:44:13+00:00 app[web.1]:     125:             - if @other_left_link ||= other_left && index_path(params.except('set').merge(params[:set].to_i != 1 ? {:set => (params[:set].to_i - 1)} : {}))
2012-08-13T18:44:13+00:00 app[web.1]:     126:               %td.other.left= link_to "...", @other_left_link, :class => 'pjax'

@mshibuya: We (@jayasi and I) want to start working on this. Let us know if you haven't taken it up already so that we can proceed with it!

@meghaarora42 Go ahead and try, please!

@mshibuya: Thanks! :)

It's not a great solution - and I'm not clear from looking at the internals of RailsAdmin what the best way forward here is, but adding the following to my rails_admin initializer appears sufficient to work around this issue for now.
module RailsAdminColumnQuotePatch
  def build_statement_for_string_or_text
    original_column = @column
    @column = PG::Connection.quote_ident(original_column)
    begin
      super
    ensure
      @column = original_column
    end
  end

  def all(options = {}, scope = nil)
    if options[:sort].is_a?(String) && options[:sort] =~ /^[A-Za-z0-9_]+\.[A-Za-z0-9_]+$/
      table, column = options[:sort].split(/[.]/, 2)
      options[:sort] = [table, column].map { |name| PG::Connection.quote_ident(name) }.join('.')
    end
    super
  end
end

module RailsAdmin
  module Adapters
    module ActiveRecord
      prepend RailsAdminColumnQuotePatch
    end
  end
end


Enable branch protection on master

Rules to enforce:

At least 1 reviewer approve of PR before merging.
Pass all tests before merging PR.
Pass all linting requirements before merging PR.

Branch protection is now enabled on master.


add minimum version of CMake for mac build

sets correctly the minimum required version for Mac in CMakeLists.txt and in the meta.yaml
Tested on a system with AppleClang <IP_ADDRESS>10046

closes #964


Make the valid emails check more permissive of whitespace

Use a regular expression to split the field value so that if the user
puts a space before or after the comma then the validation doesn’t fail.
Fixes #129

Can you rebase this into one commit please.

No problems, that's done.

Thanks!


Add manual coordinate frame rotation in viewer.

If the auto-orientation methods in the dataparser fails, the scene make look rotated in the viewer. We should add controls in the UI to manually correct for these offsets.

Added


Trailing slash eats next character line (fringe parse error?)

The problem
Describe the bug
Found while editing and swapping between editor views and swapping between multiline dialogs.
Trailing "" backslash will display in visual editor but the following line is hidden. When testing PlayTimeline, the backslash is not shown, and the following line is not shown.
To Reproduce
Steps to reproduce the behavior:

per screenshot - add a trailing backslash on a line that isn't intended to be multiline.

Expected behavior
Likely - to ignore the multiline meaning, and display the slash and the following dialog.
Screenshots

System (please complete the following information):

OS: Win10
Godot Version: 4 beta 10
Dialogic Version: 2-alpha-5

Solutions
Workaround
Obviously, don't do it 😅 but accidents happen. Remove the character is the obvious fix, but it isn't displayed while previewing so its harder to find.
Possible fixes
It has the feels of a fringe regex parse issue? just checking for {Multiline}{EOL}{ ** } rather than  {Multiline}{EOL}{! Command}{ ** }?

When I realized I was having this bug, I ended up needing to control-Z my project a lot as the actual lines of dialog were being removed, but I've been unable to replicate this.

Yup - confirmed a situation.

Leave a trailing slash on the first row in text editing.
Return to visual editor.
Make any change (such as adding and removing a space), and test the scene.
Tap to look at text editing and immediate return to visual editor.
Make any change (such as adding and removing a space), and test the scene.
etc

Obviously the visual editor throws away any invalid lines and character names along the way even it fails forward. Potentially the visual editor could check to see the delta of changes its making and advise the user (as well as if the regex parse was fixed), otherwise Im not sure what else to suggest

Do I understand it correctly that you are trying to create multiline events but the editor breaks them? Or do you just want to add a \ at the end?

Sort of. I had a multiline that I edited into separate prompts, but didn't see the trailing character at the time. The editor and the game parser then handles it badly but both are interpreting differently I think? And then the editor eats the line on save.
Sorry if not making sense. I could voice chat or screenshare via discord if that helps

So here is the thing:
There was a regex issue that meant text events that got processed would loose all except the first line (processing only happens in visual mode or when playing).
Fixing this makes this thing less of an issue. However a text event ending with \ will ALWAYS make the next line part of itself. That means in your case the next event would still not function correctly, but also not get removed (instead turned into a text event). Just removing the \ at any point in time with the text editor should then make the event behave correctly again.
Will merge this small fix asap.

Alright I've merged my fix for the regex (which autoclosed this issue, sorry). Maybe you could try again with the latest main branch? As always, keep a backup or use version control when handling WIP software.
Would appreciate if you could test.

Alright I've merged my fix for the regex (which autoclosed this issue, sorry). Maybe you could try again with the latest main branch? As always, keep a backup or use version control when handling WIP software.
Would appreciate if you could test.

Awesomesause - just downloaded and tested HEAD against Godot b10 and it is acting a lot more sane and consistant to the slash spec. [chef kiss]
Thanks!


Crystal shard rates buffs

Description:
Crystal shard rates were recently buffed in OSRS.
Changes:
-Regular Gauntlet: 5-9 shards, up from 3-7.
-Corrupted Gauntlet: 7-12 shards, up from 5-9.
-Crystal Chest: Buffed the quantity of Acorns to 4-6 and quantity of Shards by ~50%.
-Crystal Impling: 30-40 Shards, up from 5-10.

[] I have tested all my changes thoroughly.

All this looks good and can be confirmed here: https://oldschool.runescape.wiki/w/Update:Araxxor_CAs,Poll_82_Updates%26_More!#Crystal_Shard_Rates_Buff


gnused: Remove crossAttrs

Motivation for this change
Use a cleaner help2man trick from coreutils.
Progress towards #33302.
Things done
Tested on aarch64-linux.

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option build-use-sandbox in nix.conf on non-NixOS)
Built on platform(s)

[ ] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Fits CONTRIBUTING.md.

Success on x86_64-darwin (full log)
Attempted: gnused
Partial log (click to expand)
/nix/store/llk6iyb3ppvyaflbkg5rbv960wlsxpkc-gnused-4.4

Success on x86_64-linux (full log)
Attempted: gnused
Partial log (click to expand)
/nix/store/p844gl2lb267aii2jdv5bqx4ph68l25m-gnused-4.4


Add chart which shows final demand and/or primary demand per energy carrier

@DorinevanderVlies added this to-do to BC two months ago:
Input from client: it is currently difficult to get a quick overview of total final/primary demand per carrier.
Users (including me) often manually sum numbers from the final demand mekko or move their cursor over the Sankey diagram (which only shows primary demand).

Can you pick this up @marliekeverweij ? I think this is very useful!


README.md refs va-v4

PR summary
docs: docs: update README.md with links to va-v4 apidoc
PR Checklist
Please make sure that your PR fulfills the following requirements:

[x] The commit message follows the Angular Commit Message Guidelines.
[ ] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features)

PR Type

[ ] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] New tests
[ ] Build/CI related changes
[x] Documentation content changes
[ ] Other (please describe)

What is the current behavior?
README links to deprecated apidoc
What is the new behavior?
README links to current apidoc
Does this PR introduce a breaking change?

[ ] Yes
[x] No

Other information
no release required

:tada: This PR is included in version 1.1.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


[proxima-beam] #180 first passing test

I would definitely move getting rid of SerializableCoder out of the scope of this PR. Restriction should be kept mutable IMO. Explanation above. The key point is that we have to make sure, that a checkpoint can be taken even when there is no more work, that's a nasty bug, thanks for this catch!

Can you please create an issue for the SerializableCoder replacement then?

Can you please create an issue for the SerializableCoder replacement then?
https://github.com/O2-Czech-Republic/proxima-platform/issues/181

@dmvk another review round please. The review commit is as separate, should be squashed after review.


Madie - Bonnie: Discrepancy between code highlighting and coverage

Summary
The included measure is displaying 100% code coverage, however the highlighting is not covering all union clauses.
External Tracking Ticket
https://oncprojectracking.healthit.gov/support/browse/BONNIEMAT-1511
Expected Behavior
Highlighting in both Madie and Bonnie would be handled the same.
Version or Commit
Inputs (e.g. Measure Bundle, Patient Bundle, CQL Library)
CMS133FHIR-v0.0.007-FHIR4.zip

Relevant Calculation Options (e.g. Measurement Period, meta.profile Validation)
cql-to-elm Version Used for Measure Logic Translation (if known)
Any Additional Info

@mcmcphillips Could you please provide patient bundles for this issue? Our team has no ability of replicating this without the patients being used.

@mcmcphillips just wanted to follow. up on this and see if the patient bundles were available yet?

@laclark22 Apologizes for the delay! test case bundle is attached.
CMS133TestCaseBundles.txt

Sorry for the lateness of my reply:
Attached are valuesets, testcase bundles, and measure bundles.
CMS133ValueSets.txt
CMS133TestCaseBundles.txt
CMS133MeasureBundle.txt

@mcmcphillips Thank you for the sending over the bundles, they helped us debug this issue. This issue was indeed a bug in the clause coverage percentage calculation. The percentage was not including all relevant clauses in the measure while calculating, it was only using the top level clause in each define statement. We have resolved this issue in PR #266 and accelerated our release of v1.2.2 to get this fix in your hands ASAP. This has been published to NPM.
There were no changes made to the visual coverage highlighting. Only the coverage percentage calculation was fixed to properly calculate based on all relevant clauses in the measure. The percentage will now correlate with what the user sees in the highlighting.
This is the highlighting that should now be expected for this measure and test case set. The percentage of clauses covered is 65.6% which is accurate due to the incomplete coverage of many of those Condition retrieves.

Reminder: Some of the union statements in the logic may not show visually as covered. This is due to the unions not always having a corresponding ELM expression clause to provide a result for them in massive multi union blocks. This is a quirk of the cql-to-elm translator and does not count against the coverage percentage calculation.
As noted in the release notes for v1.2.2 users will very likely see a change in coverage percentage. Most likely percentages will go down as all relevant clauses are now being included in the calculation


Documentation/actions examples to text

Should fix devel docu build errors.
http://jenkins01.arangodb.biz:8080/view/Documentation/job/arangodb-documentation/127/
For reviewers: is the content of the warning box alright? If so, then it should be fine to merge.
http://web01.arangodb.biz/documentation/actions-examples-to-text/Manual/Appendix/Deprecated/Actions/

I'm strictly against this change, since these were one of the areas where only the documentation proved that things were broken or not.

Please rather add the .js code creating the missing collections in the setup of the test-server here: https://github.com/arangodb/arangodb/blob/devel/utils/generateExamples.py#L102

@dothebart Can we create system collections from user land (_routing and _modules)?
db._create("_underscoreAnything") throws ArangoError: illegal name for me.
The chapter is about Actions, deprecated since v3.0.0. Do we really care if it's broken or not? The reason why I put the example outputs in is because the feature is not removed yet, but we don't have the required collections anymore on new installations.
Alternatively, we could remove the entire chapter and if anyone needs it again, we can point him/her to the 3.3 docs.

either remove or fix. but not hard code.

Removed most of it, except this:
http://web01.arangodb.biz/documentation/actions-examples-to-text/Manual/Appendix/Deprecated/
Test build passed:
http://jenkins01.arangodb.biz:8080/view/Documentation/job/arangodb-documentation/128/
FYI: Only devel (so upcoming 3.5.0) does not create the two system collections anymore, 3.4 still does.
@sleto-it Are you okay with this?


Sg/calc angles

Calculate angles of given geometries.
The only thing I am concerned about here again is type stability. Right now, points, lines, line strings, and linear rings all return Vectors of Floats, while Polygons return Vectors of Vectors of Floats.
And then a multi-geometry returns a vector of its element's angle return types. I don't really see a way to get around it.

What do you think about polygons just returning a vector, rather than a nested vector? And then the angles after the first n are angles of holes... or do you think it needs to be nested?

Maybe inconsistent? But I have no idea what the use case is 😂

Yeah, it matches up more with the conventions. It is just irritating for me because none of the polygons in my simulations have holes and I don't need the extra allocations 😆
I have a decent amount of geometry code that I have written in the last year and a half floating around my model and I am going to try to move as much of it as I can into GeometryOps, both for the cleanliness of my model and also in case other people find it useful. So if there is slightly "off-topic" code coming in, that is why.

Given that we want Polygons to return Vector{Vector{T}}, I am not sure that applyreduce is the correct strategy. So then a "multi-geom" will be type Vector{Union{Vector, Vector{Vector{T}}}}.
If we want that to happen, I think we need to use push! as the applyreduce operation given that something like vcat would get rid of the nesting. Honestly, though, I kind of want to get rid of the nesting. I feel like it could be equally valid to just return a Vector of angles, there they are in the order provided by GI.getgeom, and then GI.getring. If someone wants the angles of a specific sub-geometry or sub-ring, they can calculate that... or figure it out by the number of points in each sub-geom/ring.
This also gets rid of the issue of empty Vectors (no angles, no elements). Versus if we filter out empty ones and we are nesting, I feel like that is strange as it leaves a missing slot for an existing geometry.
What do you think? Because I think it is going to be type-unstable if we keep the nesting for multi-geoms due to the depth of nesting depending on the type of sub-geometry.

Flattenimg is fine too! Just somethimg consistent thst will also work on features without manually writingvit all.
You can eapsily flattten with applyreduce, or use GO.flatten ;)

Also not suer what you mean by multi-geom - where does the union come from?
You should only be able to get a union if you start with a union.

By multi-geom I am referring to multipolygons, multipoints, multicurves, and geometry collections.
I think flattening is fine. We are just giving back a list of the angles of the shape.

What do you use these angles for in the end? Just so I get the purpose a little more.

So for me, the polygons are all pieces of ice on the ocean.  So I check the angle, and if it is smaller than a threshold, break off the corner, adding a new edge to the polygon and making the corner its own piece.
I also have code that breaks polygons through a given line segment to implement this (and more general fracturing), but that feels maybe a bit too niche to put in this library. Thoughts?

Ahh cool.
We do need polygon clipping!
But maybe people can hook up the angles/clipping part themselves?

Polygon clipping is entering a PR this week (I hope)! My intern is just cleaning up a few things, although there will probably be some more things to clean up afterward.
Ah, you're right! That is just clipping a polygon by a line. I hadn't thought of it like that. Perfect! I will move that code into the library sometime soon-ish then.

For now, I will try to finish this up today and get it merged.

Amazing. What clipping algorithm is it?

Greiner and Hormann

Okay, I think this is good to go! I switched the polygon hole angles to the interior, which means they do need their own function but I use apply reduce for everything else.

I can't figure out why the documentation is failing. I removed the angle documentation just to see if that was causing it. But I don't think I changed anything that would cause the docs to fail... The error messages also aren't that helpful. Have you every seen anything like this?

Is there a way to run the documentation locally? This takes way too long to test...

Okay, so what I think happened is that with the updates to Documentor, it started running examples within comments, rather than just in DocStrings. I assumed it was the whole time, but I guess not given the number of issues. I fixed the errors, and many of the warnings, but there are still warnings left. Fixing those should be a separate PR.


"cargo sqlx prepare" unexpectedly cleans all build artifacts

Bug Description
When I run cargo sqlx prepare from a workspace root, I get the following output:

Failed minimal recompile setup. Cleaning entire project. Err: Failed to get package in current working directory, pass --merged if running from a workspace root
Compiling libc v0.2.140
...
error: Resolving the crate package for the current working directory failed

And it cleans the build dir when it starts, resulting in recompilation of all dependencies. This causes me to lose time waiting for them to recompile.
I'm not interested in --merged feature, as only one of the crates in my workspace uses sqlx. I just forget about this behavior every time and get surprised.
I would prefer that it gave me an error immediately. It should never clean the build (at least not without some flag like --clean).
Minimal Reproduction
Run cargo sqlx prepare --database-url ... in a workspace root.
Info

SQLx version: cargo-sqlx 0.6.3
SQLx features enabled: n/a
Database server and version: n/a
Operating system: Linux
rustc --version: rustc 1.68.0 (2c8cc3432 2023-03-06)

You may be hitting issues if your sqlx can sqlx-cli versions are mismatched

My sqlx version is the same (0.6.3).

I'll take a look in a couple of days


file-size: The Plugin is unable to detect files or read files on WINDOWS servers

This issue respects the following points:

[X] This is a bug, not a question or a setup/configuration issue.
[X] This issue is not already reported on Github (I've searched it).
[X] I use the latest release of the Monitoring Plugins (https://github.com/Linuxfabrik/monitoring-plugins/releases).
[X] I agree to follow Monitoring Plugins's Code of Conduct.

Which variant of the Monitoring Plugins do you use?

[ ] .rpm/.deb package from repo.linuxfabrik.ch
[ ] Compiled for Linux (.tar/.zip from download.linuxfabrik.ch)
[X] Compiled for Windows (from download.linuxfabrik.ch)
[ ] Source Code from GitHub

Bug description

When I execute the windows EXE it does not detect or read files. Always returns "No files found"
Steps to reproduce - Plugin call
C:\Linuxfabrik\file-size --filename 'C:\Linuxfabrik\feed.exe'
Steps to reproduce - Data
No response
Environment
Windows Server 2019
Plugin Version
file-size: v2023112901 by Linuxfabrik GmbH, Zurich/Switzerland
Python version
No response
List of Python modules
No response
Additional Information
No response

Please try / or \\ instead of \.


Transient build failure: unable to find installation candidates

Problem
Poetry builds randomly fail with a RuntimeError and say Unable to find installation candidates for some package. When we run them again, they find the package and it's fine.
We already do poetry install --no-ansi || poetry install --no-ansi with one retry to make these transient build errors less common.
Could we be doing something else?

Reported upstream with Poetry: https://github.com/python-poetry/poetry/issues/8139


Obtaining stack trace from the error as []uintptr

I made a spiritual successor of github.com/pkg/errors some time ago and in it I want to know if an error already contains a stack trace. The goal is that if a large codebase uses different packages for errors, they should work together and not hide existing recorded information, like a stack trace.
It seems this package does not expose the stack trace as []uintptr but only as a formatted string?
I would suggest that the following interface is implemented:
type stackTracer interface {
        StackTrace() []uintptr
}

Then, it is easy to obtain a stack trace, use it, format it.

LGTM, thanks! Help wanted (:


Only using 65% of GPU memory

While running some benchmarks I noticed min-dalle was only using 65% of my 3070 Ti GPU's memory:

Here's the function I'm calling:
def run_dalle():
    generate_image(
        is_mega=True,
        text='rich ducks playing poker',
        seed=0,
        grid_size=3,
        top_k=256,
        image_path='generated',
        models_root='pretrained',
        fp16=True,
    )

After running it 50 times, each image takes 54.5 seconds on average to generate. It's running baremetal on 32x E5-2630 v3 threads and 64 GB RAM.
Is there a way to make it use more of the GPU? or am I reading this wrong? Thanks!

Also the GPU-Util field fluctuates between 0% and ~40%.

 I use the bfloat16 and get a usage of 41% with 7.7 GB/ 8 GB VRAM

@78Alpha are you using the Mega model?

@78Alpha are you using the Mega model?

The default for the pip package

I'm surprised there's only two seconds difference. Note that mega defaults as off, so you have to pass --mega into the command line.


UAVCAN environement broken

Due to the renaming of the repository, all previous works with UAVCAN are now broken as https://github.com/UAVCAN/dsdl doesn't exist anymore.
That wasn't a nice move considering that most of UAVCAN system are on v0 ...

The old name is still valid and can be cloned from. If you have any specific suggestion aside from renaming the repository back, please introduce it.

The old name is still valid and can be cloned from. If you have any specific suggestion aside from renaming the repository back, please introduce it.

That what we got on ArduPilot CI :
 Cloning into '/__w/ardupilot/ardupilot/modules/libcanard/dsdl_compiler/pyuavcan/uavcan/dsdl_files'...
  remote: Not Found
  Error: fatal: repository 'https://github.com/UAVCAN/dsdl.git/' not found
  Fetched in submodule path 'modules/libcanard/dsdl_compiler/pyuavcan/uavcan/dsdl_files', but it did not contain 103745afb42f15f83d49fc23530f7fe2c11358b8. Direct fetching of that commit failed.
  Failed to recurse into submodule path 'modules/libcanard/dsdl_compiler/pyuavcan'
  From git://github.com/ArduPilot/mavlink
   * branch            d8cad47bb3e4ecf21ae631e492e9643cd063cb8c -> FETCH_HEAD
  Submodule path 'modules/mavlink': checked out 'd8cad47bb3e4ecf21ae631e492e9643cd063cb8c'
  Submodule 'pymavlink' (git://github.com/ArduPilot/pymavlink.git) registered for path 'modules/mavlink/pymavlink'
  Cloning into '/__w/ardupilot/ardupilot/modules/mavlink/pymavlink'...
  From git://github.com/ArduPilot/pymavlink
   * branch            1a6faa8b97950158682b932c1444d4488df4adcd -> FETCH_HEAD
  Submodule path 'modules/mavlink/pymavlink': checked out '1a6faa8b97950158682b932c1444d4488df4adcd'
  Submodule path 'modules/uavcan': checked out '3ef4b88d96466bbcf886f74d0ae169a4c8c1bdb0'
  Submodule 'dsdl' (https://github.com/UAVCAN/dsdl) registered for path 'modules/uavcan/dsdl'
  Submodule 'libuavcan/dsdl_compiler/pyuavcan' (https://github.com/UAVCAN/pyuavcan) registered for path 'modules/uavcan/libuavcan/dsdl_compiler/pyuavcan'
  Cloning into '/__w/ardupilot/ardupilot/modules/uavcan/dsdl'...
  Cloning into '/__w/ardupilot/ardupilot/modules/uavcan/libuavcan/dsdl_compiler/pyuavcan'...
  From https://github.com/UAVCAN/dsdl
   * branch            192295c4f9b67f4a20b0eabf74757b6597415f2b -> FETCH_HEAD
  Submodule path 'modules/uavcan/dsdl': checked out '192295c4f9b67f4a20b0eabf74757b6597415f2b'
  From https://github.com/UAVCAN/pyuavcan
   * branch            c58477a644d20ccf95a20c151f3a0402f271c3b8 -> FETCH_HEAD
  Submodule path 'modules/uavcan/libuavcan/dsdl_compiler/pyuavcan': checked out 'c58477a644d20ccf95a20c151f3a0402f271c3b8'
  Submodule 'dsdl' (https://github.com/UAVCAN/dsdl) registered for path 'modules/uavcan/libuavcan/dsdl_compiler/pyuavcan/dsdl'
  Cloning into '/__w/ardupilot/ardupilot/modules/uavcan/libuavcan/dsdl_compiler/pyuavcan/dsdl'...
  From https://github.com/UAVCAN/dsdl
   * branch            fd12483ddd4e58242d61d74a163e7aeaa1e0f466 -> FETCH_HEAD
  Submodule path 'modules/uavcan/libuavcan/dsdl_compiler/pyuavcan/dsdl': checked out 'fd12483ddd4e58242d61d74a163e7aeaa1e0f466'
  Submodule path 'modules/waf': checked out '67b3eac550520cd8a7cd1dce0f77820e91fb8ad0'
  Failed to recurse into submodule path 'modules/libcanard'
  Error: The process '/usr/bin/git' failed with exit code 1

So the ability to clone with the old name may just be some DNS cache or something similar ...

That what we got on ArduPilot CI :
 Cloning into '/__w/ardupilot/ardupilot/modules/libcanard/dsdl_compiler/pyuavcan/uavcan/dsdl_files'...
  remote: Not Found
  Error: fatal: repository 'https://github.com/UAVCAN/dsdl.git/' not found
  Fetched in submodule path 'modules/libcanard/dsdl_compiler/pyuavcan/uavcan/dsdl_files', but it did not contain 103745afb42f15f83d49fc23530f7fe2c11358b8. Direct fetching of that commit failed.
  Failed to recurse into submodule path 'modules/libcanard/dsdl_compiler/pyuavcan'
  From git://github.com/ArduPilot/mavlink
   * branch            d8cad47bb3e4ecf21ae631e492e9643cd063cb8c -> FETCH_HEAD
  Submodule path 'modules/mavlink': checked out 'd8cad47bb3e4ecf21ae631e492e9643cd063cb8c'
  Submodule 'pymavlink' (git://github.com/ArduPilot/pymavlink.git) registered for path 'modules/mavlink/pymavlink'
  Cloning into '/__w/ardupilot/ardupilot/modules/mavlink/pymavlink'...
  From git://github.com/ArduPilot/pymavlink
   * branch            1a6faa8b97950158682b932c1444d4488df4adcd -> FETCH_HEAD
  Submodule path 'modules/mavlink/pymavlink': checked out '1a6faa8b97950158682b932c1444d4488df4adcd'
  Submodule path 'modules/uavcan': checked out '3ef4b88d96466bbcf886f74d0ae169a4c8c1bdb0'
  Submodule 'dsdl' (https://github.com/UAVCAN/dsdl) registered for path 'modules/uavcan/dsdl'
  Submodule 'libuavcan/dsdl_compiler/pyuavcan' (https://github.com/UAVCAN/pyuavcan) registered for path 'modules/uavcan/libuavcan/dsdl_compiler/pyuavcan'
  Cloning into '/__w/ardupilot/ardupilot/modules/uavcan/dsdl'...
  Cloning into '/__w/ardupilot/ardupilot/modules/uavcan/libuavcan/dsdl_compiler/pyuavcan'...
  From https://github.com/UAVCAN/dsdl
   * branch            192295c4f9b67f4a20b0eabf74757b6597415f2b -> FETCH_HEAD
  Submodule path 'modules/uavcan/dsdl': checked out '192295c4f9b67f4a20b0eabf74757b6597415f2b'
  From https://github.com/UAVCAN/pyuavcan
   * branch            c58477a644d20ccf95a20c151f3a0402f271c3b8 -> FETCH_HEAD
  Submodule path 'modules/uavcan/libuavcan/dsdl_compiler/pyuavcan': checked out 'c58477a644d20ccf95a20c151f3a0402f271c3b8'
  Submodule 'dsdl' (https://github.com/UAVCAN/dsdl) registered for path 'modules/uavcan/libuavcan/dsdl_compiler/pyuavcan/dsdl'
  Cloning into '/__w/ardupilot/ardupilot/modules/uavcan/libuavcan/dsdl_compiler/pyuavcan/dsdl'...
  From https://github.com/UAVCAN/dsdl
   * branch            fd12483ddd4e58242d61d74a163e7aeaa1e0f466 -> FETCH_HEAD
  Submodule path 'modules/uavcan/libuavcan/dsdl_compiler/pyuavcan/dsdl': checked out 'fd12483ddd4e58242d61d74a163e7aeaa1e0f466'
  Submodule path 'modules/waf': checked out '67b3eac550520cd8a7cd1dce0f77820e91fb8ad0'
  Failed to recurse into submodule path 'modules/libcanard'
  Error: The process '/usr/bin/git' failed with exit code 1

So the ability to clone with the old name may just be some DNS cache or something similar ...

Consider updating submodule references to use the new URI. A pull request with that change would be accepted.

Consider updating submodule references to use the new URI. A pull request with that change would be accepted.

Fixing it for the master branch isn't an issue. The issue is that all previous release are now broken... And we cannot do anything else that saying to everyone to change to the new url....
Instead of broking compatibility of all previous environment, archiving this repo and create a new one with the new name would have been a better move. And that what Github recommend too

Fixing it for the master branch isn't an issue. The issue is that all previous release are now broken... And we cannot do anything else that saying to everyone to change to the new url....
Instead of broking compatibility of all previous environment, archiving this repo and create a new one with the new name would have been a better move. And that what Github recommend too


Bugs: Fail to calulate BLEU when reference corpus is large

This is the code to cause problems:
from fast_bleu import BLEU

bleu = BLEU(reference_corpus, weights)

when reference_corpus is a list containing 70000 sentences with a length of 200.
And the error message is shown as follows:
Fatal Python error: Segmentation fault

Thread 0x00007fa775d6a700 (most recent call first):
  File "/home/tangtianyi/anaconda3/lib/python3.7/threading.py", line 300 in wait
  File "/home/tangtianyi/anaconda3/lib/python3.7/threading.py", line 552 in wait
  File "/home/tangtianyi/anaconda3/lib/python3.7/site-packages/tqdm/_monitor.py", line 59 in run
  File "/home/tangtianyi/anaconda3/lib/python3.7/threading.py", line 926 in _bootstrap_inner
  File "/home/tangtianyi/anaconda3/lib/python3.7/threading.py", line 890 in _bootstrap

Current thread 0x00007fa809c26700 (most recent call first):
  File "/home/tangtianyi/anaconda3/lib/python3.7/site-packages/fast_bleu/__python_wrapper.py", line 86 in __init__

Thank you for taking the time to solve the issues.

can you give more information about the dataset you are using and put some sample of it here?
I duplicated my dataset to have 1.5 million samples, each of them having 10 words  on average and didn't have problem.

For example, reference_corpus = [[str(i) + str(j) for i in range(100)] for j in range(70000)].

I guess maybe it is caused by vocabulary size.
If using reference_corpus = [['a' for i in range(100)] for j in range(70000)], it works.

Yes, I am running this code on a server with 256GB memory. And the above code occupied about 3GB memory when failing. I guess  maybe this issue due to the limit memory of local variables in functions.

Excuse me, waht is your OS , fast_bleu and python version?
Is the code you are running exactly like this?

from fast_bleu import BLEU

bleu = BLEU(reference_corpus, weights)

As I see in you stack trace, there is something about threading.
If you you are using it in mult-ithreaded mode, could you please test it in standard and single-thread mode?

I have tested in three severs, and met the same error.
OS: Ubuntu 16.04.1 LTS (GNU/Linux 4.4.0-193-generic x86_64), Ubuntu 16.04.5 LTS (GNU/Linux 4.15.0-120-generic x86_64), Ubuntu 18.04.2 LTS (GNU/Linux 4.15.0-121-generic x86_64)
Memory: 256GB, 128GB, 64GB
Python: 3.7.4, 3.7.4, 3.7.7
fast_bleu: 0.0.86, 0.0.86, 0.0.86
The entire code is shown as follows, without using multi-threading:
from fast_bleu import BLEU

reference_corpus = [[str(i) + str(j) for i in range(100)] for j in range(70000)]
weight = {'4': (.25, .25, .25, .25)}
BLEU(reference_corpus, weight)

Thanks for your help. Now it can run successfully on my server with GCC version 7.5.0.
However, when I installed it on the server with GCC version 5.4.0, it failed to install. Could you lower the barrier to version for more widely usage.

I created a new branch gcc-downgrade and lowered compilation flag to c++11.
I tested it and it seems there is no issue.
Could you please clone the repo and and test whether the gcc-downgrade branch works well or not?
Please uninstall the currently installed version and install the new version with python setup.py install command .

I can run it successfully with GCC version 5.4.0. Thank you very much for your help.
Best wishes!


Fix links for filenames with special characters

I happened to have a file with a '#' in the filename, and when using @indexzero's http-server (which uses ecstatic for autoIndex) the filename wasn't being properly encoded. This should fix that (as well as any files which use "; , / ? : @ & = + $" in the filename as well).

Oops, I meant showDir, not autoIndex. And it looks like there's a test that fails, but because it expects the old behavior (which I think is broken).


Dark Mode

The project should also be in dark mode .
I want to put a toggle of day or night mode in the corner .
Can i work on this issue under GSSoC'21.

Sure Go Ahead @kumarishalini6

I have send the PR  please check it.

please assign me this


decoupling prog bar from the terminal interface

Pull Request Test Coverage Report for Build 886533715

75 of 75 (100.0%)  changed or added relevant lines in 2 files are covered.
2 unchanged lines in 1 file lost coverage.
Overall coverage increased (+0.2%) to 87.189%

Files with Coverage Reduction
New Missed Lines
%

progress_bar.go
2
97.65%

Totals

Change from base Build 886531595:
0.2%

Covered Lines:
456

Relevant Lines:
523

💛  - Coveralls


404 at /install/linux/linux-postinstall/%20sudo%20groupadd%20docker%20sudo%20usermod%20-aG%20docker%20$USER

I found a broken link : https://docs.docker.com/install/linux/linux-postinstall/ sudo groupadd docker sudo usermod -aG docker $USER

The correct url should be:
https://docs.docker.com/install/linux/linux-postinstall/
I suspect you copied this URL from somewhere and accidentally copied some output together with it, because the parts after that (in the URL you posted) is;
sudo groupadd docker sudo
usermod -aG docker $USER

Based on the above, I think this was a copy/paste mistake, so I'll close, but let me know if you did arrive at that URL through a link somewhere in our docs.


Remove private jdk api

Thanks and sorry @bgrozev, but this isn't actually ready yet. One of the tests hangs reproducible when run on JDK17.

Maybe you've got an idea: when org.ice4j.pseudotcp.PseudoTcpSocketImpl#close is called in the client thread in org.ice4j.pseudotcp.PseudoTcpStreamTest#testConnectTransferClose, there's data left to be sent:
ON CLOSE: in flight 1334
ON CLOSE: buff not sent 555

That never happens on JDK8 or 11.

oO. So, org.ice4j.pseudotcp.PseudoTcpSocketImpl.PseudoTcpOutputStream#flush doesn't get called anymore because Java 17's new SocketOutputStream wraps socketImpl.getOutputStream(), but doesn't forward/delegate flush().

Hm, is the hanging test introduced in this PR or just exposed due to tests running on 17? If it's not a regression we can just add some comments and disable the test on 17

I think it is actually a regression since it's not possible anymore to flush the PseudoTcpOutputStream. However, I'm unsure if that flush is actually needed outside of tests.

So I think I've stabilized this enough to merge. Runs might still fail from time to time due to the randomness in the tests (which should be removed...).

@ibauersachs is it possible that this PR causes problem with IPv4 vs IPv6 gathering. On my fresh test server ice4j appears to gather IPv6 only?!


Mova E30 Ultra Support

Are there any Plans to support the new released Mova E30 Ultra? (which seems to be a rebranded Dreame L10s Pro Ultra Heat)
Or is it maybe possible to use it with the existing Integration?

Thanks works like a charme, maybe interesting: you need to add the robot with the Dreameapp instead of the Movaapp, to make this work.


question on KL computation and lastgaelam

Hi! I have 2 questions on PPOTrainer.loss.
(1) What is purpose of lastgaelam when delta is actually an advantage estimate? line link
It seems lastgaelam is collecting future trajactory advantages at a timestep with decaying factor self.config.lam.
Why is this value used instead of textbook advantage delta?
(2) Why is KL not computed with expectation over $\pi_\text{old}$ but just with $1/T$? line link
when logprob and oldlogprob is logprobs with (batch_size, T) shape, I think $KL(\pi_\text{old} | \pi)$ should be torch.dot(oldlogprob-logprob, F.softmax(oldlogprob, dim=1)). Why is it computed just as a mean over sequence length? Also I don't know why there are two different KLs(approxkl, policykl).
I'd really appreciate if you answer these questions. Thanks!

I would guess most of these questions are answered by the fact that the repo was built to closely mirror the "learning to summarize" work.  Which of these do you think is more impactful in investigating?

Thank you for answering! I'll check out the original implementation.
this post contains answers many of my question on their implementations!

Closing this for now - feel free to re-open if you have any follow-up :)


Changed jsonValue return type to be Js.Json.t

Puppeteer docs describe jsonValue()  as returning a JSON representation
of the object. In some cases the object is simply a string (such as
getting a property as the test case does), for these cases, using
a Js.Json.t return type is more robust.

Good call. Js.Json.t is definitely an improvement here. Thank you so much for contributing!


Update README.md

Add a blurb mentioning needing Editor permissions in GCP

Since I ran into this, it wasn't clear what the cause was until pointed out to my by SpotInst Support.


Bike rented examples doesn't work

I have created a LOI and Hypotheses.
When I trigger the execution, the query doesn't work.
The problem seems to be that the code is adding the workflow variables. However, the workflow variables are not included in the query
https://github.com/KnowledgeCaptureAndDiscovery/DISK-WEB/blob/7039e9089b2f0f5062217d161b43367466c9c4c2/server/src/main/java/org/diskproject/server/repository/DiskRepository.java#L1205
You can check the error using dev tools
Error querying endpoint:

PREFIX xsd:  <http://www.w3.org/2001/XMLSchema#>
PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>
PREFIX rdf:  <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
PREFIX disk: <http://disk-project.org/ontology/disk#>
PREFIX hyp: <http://disk-project.org/ontology/hypothesis#>
SELECT DISTINCT ?ClimateVariable1 ?ClimateVariable2 ?url ?ClimateVariable3 {
?resource <http://disk-project.org/ontology/disk#hasVariableName> "Temperature", "Temperature", "Temperature" ;?resource <http://www.w3.org/ns/dcat#downloadURL> ?URL
}

Encountered " <VAR1> "?url "" at line 8, column 51.Was expecting one of:    "values" ...    "graph" ...    "optional" ...    "minus" ...    "bind" ...    "service" ...    "filter" ...    "{" ...    "}" ...    ";" ...    "," ...    "." ...

@hvarg help!

Thats non valid sparql,
The query should be:
SELECT DISTINCT ?ClimateVariable1 ?ClimateVariable2 ?url ?ClimateVariable3 {
  ?resource <http://disk-project.org/ontology/disk#hasVariableName> "Temperature",
                                                                    "Temperature",
                                                                    "Temperature" ;
            <http://www.w3.org/ns/dcat#downloadURL> ?URL .
}

after a ; you must follow with two resources

Thanks.
The server sends a 400 bad request when the query doesn't parse


Updates to minikube.md (broken links)

updated the links to documents that do not exists locally but remotely in github. These links are broken online.

This change is

Review status: 0 of 1 files reviewed at latest revision, all discussions resolved.

Comments from Reviewable

@dlorenc im not sure what check/review is required here?

Reviewed 1 of 1 files at r1.
Review status: all files reviewed at latest revision, all discussions resolved, some commit checks failed.

Comments from Reviewable

Review status: all files reviewed at latest revision, all discussions resolved, some commit checks failed.

Comments from Reviewable

@dlorenc I am new to this repo, do you then merge or are lgtm supposed to do that for you?

I'm not sure either, @jeffmendoza who usually does the merges?

No bots, Assignee usually merges.

It looks like this is conflicting with a change in master now. Could you rebase and then I'll merge?

@dlorenc thanks for finding out, yeah i have rebased it, if when you look at it and it needs to be rebased again ping me and ill try to do so quickly. Thanks!

LGTM, looks like I don't actually have merge rights. @jeffmendoza would you mind merging?


Delay Pod creation

Is this a BUG REPORT or FEATURE REQUEST?:
/kind feature
Description:
For batch workload, there're always several pending jobs in the system because of limited resource. If pods were created for each job, there'll be so many pending pods :(
It's better to let kube-batch notify controller whether the pod should be created according to quota and resources.

xref https://github.com/kubernetes-sigs/kube-batch/issues/401

@k82cn Could we implement it using admission webhook?

implement it using admission webhook

admission webhook did not others except current pod, which lose the context; IMO, it's better to let scheduler to decide which PodGroup can create more pods.

As I understand, admission webhook could list/get/.. all resources.

it's better to let scheduler to decide which PodGroup can create more pods.

Then we need modify controllers?

Then we need modify controllers?

It's up to the contoller whehter leverage this feature.

/sig apps


Cancellation still doesn't work

At least for pnpm.
Cancellation is based on fkill, which should force-kill pnpm on cancel, however I can confirm that it doesn't work on Windows.

seems to be issue only with pnpm i in some scenarios, other cases where resolved with new shell integration


Node crashes sometimes on rollback: ERROR: UndoReadFromDisk: Deserialize or I/O error 2 (23)

Describe the bug
There appears to be what I assume is a bug with the block rollback part of the pocketcoind process. Every so often, all nodes I manage crash simultaneously after an "RIDB rollback" event. The nodes are located in geographically separated areas on different servers, so the issue is not hardware related, it seems to be network/protocol related or a bug in pocketcoind.
The actual exception seems to be:  ERROR: UndoReadFromDisk: Deserialize or I/O error 2 (23) - CAutoFile::read: end of file: iostream error
To Reproduce
Steps to reproduce the behavior:
Run a staking node for a period of 3-5 days, the error usually occurs with that frequency.
Expected behavior
The Node should stay up and not auto-shutdown to due a crash.
Screenshots
Logs from Node 01:
2021-10-19T16:23:57Z ERROR: Failed find reindexer transaction part (cc6da0f88ad233091dc2c2589ee1005625648cb12d3236f8891b4dc6f142a8c7)
2021-10-19T16:23:57Z ERROR: ConnectTip: ConnectBlock 91f3a37e5c1f2d650ecaf8c7349f24432efee80461c73ab28fc401ee00e4c56f failed, failed-find-rtransaction (code 96)
2021-10-19T16:23:57Z Available coins count 3 BestHeader: 1402233 dd3a47ab57af27324a54d975b6850967dfffe9d0c0f56dc769465958c6494ae3
2021-10-19T16:24:04Z RIDB rollback to block height 1402232 success!
2021-10-19T16:24:14Z 700004: Transaction RI data Not Found (c211abea871010c61a2e851464ccc396b0a280d3181bd570aa68ad9f1722a994)
2021-10-19T16:24:14Z ERROR: Failed find reindexer transaction part (c211abea871010c61a2e851464ccc396b0a280d3181bd570aa68ad9f1722a994)
2021-10-19T16:24:14Z ERROR: ConnectTip: ConnectBlock 06a410b6460c589e18f1ecfd46c07eac96fa494e9153630c4be69cc1d7e228fb failed, failed-find-rtransaction (code 96)
2021-10-19T16:24:15Z Available coins count 3 BestHeader: 1402233 b1f2a67cb8395aaddfbdc7fa9d96c0d690d78bd502b79e5c50bb256709f8d03d
2021-10-19T16:24:16Z socket recv error Connection reset by peer (104)
2021-10-19T16:24:20Z BlockUntilSyncedToCurrentChain: txindex is catching up on block notifications
2021-10-19T16:24:22Z RIDB rollback to block height 1402234 success!
2021-10-19T16:24:23Z ERROR: UndoReadFromDisk: Deserialize or I/O error 2 (23) - CAutoFile::read: end of file: iostream error
2021-10-19T16:24:23Z ERROR: DisconnectBlock(): failure reading undo data
2021-10-19T16:24:23Z ERROR: DisconnectTip(): DisconnectBlock 06a410b6460c589e18f1ecfd46c07eac96fa494e9153630c4be69cc1d7e228fb failed
2021-10-19T16:24:23Z *** Failed to disconnect block; see debug.log for details
2021-10-19T16:24:23Z Error: Error: A fatal internal error occurred, see debug.log for details
2021-10-19T16:24:23Z ERROR: ProcessNewBlock: ActivateBestChain failed (Failed to disconnect block; see debug.log for details (code 0))
2021-10-19T16:24:23Z tor: Thread interrupt
2021-10-19T16:24:23Z Shutdown: In progress...
2021-10-19T16:24:23Z torcontrol thread exit
2021-10-19T16:24:23Z addcon thread exit
2021-10-19T16:24:23Z opencon thread exit
2021-10-19T16:24:23Z net thread exit
2021-10-19T16:24:23Z msghand thread exit
2021-10-19T16:24:23Z Available coins count 3 BestHeader: 1402234 06a410b6460c589e18f1ecfd46c07eac96fa494e9153630c4be69cc1d7e228fb
2021-10-19T16:24:23Z ~HTTPRequest: Unhandled request
2021-10-19T16:24:23Z ~HTTPRequest: Unhandled request
2021-10-19T16:24:23Z ~HTTPRequest: Unhandled request
2021-10-19T16:24:23Z ~HTTPRequest: Unhandled request
2021-10-19T16:24:23Z ~HTTPRequest: Unhandled request
2021-10-19T16:24:23Z Pocketcoin Staker terminated
2021-10-19T16:24:23Z scheduler thread interrupt
2021-10-19T16:24:23Z [Staking Wallet] keypool return 1
2021-10-19T16:24:23Z Dumped mempool: 0.000159s to copy, 0.009723s to dump
2021-10-19T16:24:52Z Close reindexer DB
2021-10-19T16:24:52Z [Staking Wallet] Releasing wallet
2021-10-19T16:24:52Z Shutdown: done

Logs from Node 02:
2021-10-19T16:23:40Z BlockUntilSyncedToCurrentChain: txindex is catching up on block notifications
2021-10-19T16:23:40Z socket recv error Connection reset by peer (104)
2021-10-19T16:23:44Z Available coins count 0 BestHeader: 1402234 23dce4a1eebab67a38464bf846325e428075f4d1ca42f6639f27408b4e5aeaff
2021-10-19T16:23:48Z RIDB rollback to block height 1402233 success!
2021-10-19T16:23:48Z ERROR: UndoReadFromDisk: Deserialize or I/O error 2 (23) - CAutoFile::read: end of file: iostream error
2021-10-19T16:23:48Z ERROR: DisconnectBlock(): failure reading undo data
2021-10-19T16:23:48Z ERROR: DisconnectTip(): DisconnectBlock dd3a47ab57af27324a54d975b6850967dfffe9d0c0f56dc769465958c6494ae3 failed
2021-10-19T16:23:48Z *** Failed to disconnect block; see debug.log for details
2021-10-19T16:23:48Z Error: Error: A fatal internal error occurred, see debug.log for details
2021-10-19T16:23:48Z ERROR: ProcessNewBlock: ActivateBestChain failed (Failed to disconnect block; see debug.log for details (code 0))
2021-10-19T16:23:48Z ERROR: UndoReadFromDisk: Deserialize or I/O error 2 (23) - CAutoFile::read: end of file: iostream error
2021-10-19T16:23:48Z ERROR: DisconnectBlock(): failure reading undo data
2021-10-19T16:23:48Z ERROR: DisconnectTip(): DisconnectBlock dd3a47ab57af27324a54d975b6850967dfffe9d0c0f56dc769465958c6494ae3 failed
2021-10-19T16:23:48Z *** Failed to disconnect block; see debug.log for details
2021-10-19T16:23:48Z Error: Error: A fatal internal error occurred, see debug.log for details
2021-10-19T16:23:48Z ERROR: ProcessNewBlock: ActivateBestChain failed (Failed to disconnect block; see debug.log for details (code 0))
2021-10-19T16:23:48Z tor: Thread interrupt
2021-10-19T16:23:48Z Shutdown: In progress...
2021-10-19T16:23:48Z torcontrol thread exit
2021-10-19T16:23:48Z opencon thread exit
2021-10-19T16:23:48Z addcon thread exit
2021-10-19T16:23:48Z net thread exit
2021-10-19T16:23:49Z msghand thread exit
2021-10-19T16:23:49Z Pocketcoin Staker terminated
2021-10-19T16:23:49Z [default wallet] keypool return 1
2021-10-19T16:23:49Z scheduler thread interrupt
2021-10-19T16:23:49Z Dumped mempool: 8.7e-05s to copy, 0.004335s to dump
2021-10-19T16:24:14Z Close reindexer DB
2021-10-19T16:24:14Z [default wallet] Releasing wallet
2021-10-19T16:24:14Z Shutdown: done

Node 01:

OS: Linux
uname -a: Linux pocket-01-node-vm 4.19.0-18-cloud-amd64 #1 SMP Debian 4.19.208-1 (2021-09-29) x86_64 GNU/Linux
vCPU's: 8
RAM: 32 GB

Node 02:

OS: Linux
uname -a: Linux debian 5.10.0-8-amd64 #1 SMP Debian 5.10.46-5 (2021-09-23) x86_64 GNU/Linux
vCPU's: 16
RAM: 32 GB

Additional context
Recovering from these events are very painful, it seems that many nodes in the network are all affected by this error simultaneously. My objective with this bug report is to bring awareness to the issue, and gather as much information regarding the problem as possible so it can be addressed.

I had one of these a few days ago but didn't realise until Github notified me of this issue,
2021-10-15T18:24:43Z RIDB rollback to block height 1396634 success!
2021-10-15T18:24:43Z RIDB rollback to block height 1396633 success!
2021-10-15T18:24:43Z 700004: Transaction RI data Not Found (0635c3962e95e660854163837a26afc3e7e5677f47b3b4ddc7f4daca1a5417f8)
2021-10-15T18:24:43Z ERROR: Failed find reindexer transaction part (0635c3962e95e660854163837a26afc3e7e5677f47b3b4ddc7f4daca1a5417f8)
2021-10-15T18:24:43Z ERROR: ConnectTip: ConnectBlock efa10d2c114a072f9e8f2ccba3fe9a8dbd436619430cf275fe99ce0ba0eedd33 failed, failed-find-rtransaction (code 96)
2021-10-15T18:24:44Z 700004: Transaction RI data Not Found (0635c3962e95e660854163837a26afc3e7e5677f47b3b4ddc7f4daca1a5417f8)
2021-10-15T18:24:44Z ERROR: Failed find reindexer transaction part (0635c3962e95e660854163837a26afc3e7e5677f47b3b4ddc7f4daca1a5417f8)
2021-10-15T18:24:44Z ERROR: ConnectTip: ConnectBlock b15d65f324bf35d8c05c76a26a481a7d79a57d5350c1167fb37ed8c735f900f3 failed, failed-find-rtransaction (code 96)
2021-10-15T18:24:44Z Warning! Block generate (CheckInputs): 2fe7af072e6841e61ac2e28aff7b7aee304c00e3c68bca30cc991a73dcbe5820
2021-10-15T18:24:44Z Warning! Block generate (CheckInputs): 1aeb9543793410272cfe73a0da3f9e8627d5732d663892e3a598da9acef8e4a5
2021-10-15T18:24:44Z Warning! Block generate (CheckInputs): 58785d9a0f2466c7a1ab9451326b6186d89d993e8500a15dce34267979a9017e
2021-10-15T18:24:50Z 700004: Transaction RI data Not Found (106fe028500783535b9ad66d2beea61c93c83395e9ff9164860c57e6d811f832)
2021-10-15T18:24:50Z ERROR: Failed find reindexer transaction part (106fe028500783535b9ad66d2beea61c93c83395e9ff9164860c57e6d811f832)
2021-10-15T18:24:50Z ERROR: ConnectTip: ConnectBlock 5a1d4a7b8f21b27b9ea8f9a0cbfeb05c7ae4c1ef5d6d0899017c1b260c7b1c24 failed, failed-find-rtransaction (code 96)
2021-10-15T18:24:50Z Warning! Block generate (CheckInputs): 2fe7af072e6841e61ac2e28aff7b7aee304c00e3c68bca30cc991a73dcbe5820
2021-10-15T18:24:50Z Warning! Block generate (CheckInputs): 1aeb9543793410272cfe73a0da3f9e8627d5732d663892e3a598da9acef8e4a5
2021-10-15T18:24:50Z Warning! Block generate (CheckInputs): 58785d9a0f2466c7a1ab9451326b6186d89d993e8500a15dce34267979a9017e
2021-10-15T18:24:50Z Available coins count 2 BestHeader: 1396634 b15d65f324bf35d8c05c76a26a481a7d79a57d5350c1167fb37ed8c735f900f3
2021-10-15T18:24:50Z ERROR: UndoReadFromDisk: Deserialize or I/O error 2 (23) - ReadVarInt(): size too large: iostream error
2021-10-15T18:24:50Z ERROR: DisconnectBlock(): failure reading undo data
2021-10-15T18:24:50Z ERROR: DisconnectTip(): DisconnectBlock b15d65f324bf35d8c05c76a26a481a7d79a57d5350c1167fb37ed8c735f900f3 failed
2021-10-15T18:24:50Z *** Failed to disconnect block; see debug.log for details
2021-10-15T18:24:50Z Error: Error: A fatal internal error occurred, see debug.log for details
2021-10-15T18:24:50Z ERROR: ProcessNewBlock: ActivateBestChain failed (Failed to disconnect block; see debug.log for details (code 0))
2021-10-15T18:24:50Z tor: Thread interrupt
2021-10-15T18:24:50Z RemoveLocal(lu4l4cocmwelhble.onion:37070)
2021-10-15T18:24:50Z addcon thread exit
2021-10-15T18:24:50Z msghand thread exit
2021-10-15T18:24:50Z torcontrol thread exit
2021-10-15T18:24:50Z opencon thread exit
2021-10-15T18:24:50Z Shutdown: In progress...
2021-10-15T18:24:50Z net thread exit
2021-10-15T18:24:50Z Pocketcoin Staker terminated
2021-10-15T18:24:50Z scheduler thread interrupt
2021-10-15T18:24:50Z [default wallet] keypool return 1
2021-10-15T18:24:50Z Dumped mempool: 0.00051s to copy, 0.003707s to dump
2021-10-15T18:26:32Z Close reindexer DB
2021-10-15T18:26:32Z [default wallet] Releasing wallet
2021-10-15T18:26:32Z Shutdown: done

There's a VERY small chance it was associated with an attempted staking event (node collateral is too low). Recovery was indeed painful since upon restart
...
2021-10-19T22:31:01Z Cache configuration:
2021-10-19T22:31:01Z * Using 2.0MiB for block index database
2021-10-19T22:31:01Z * Using 56.0MiB for transaction index database
2021-10-19T22:31:01Z * Using 8.0MiB for chain state database
2021-10-19T22:31:01Z * Using 139.0MiB for in-memory UTXO set (plus up to 286.1MiB of unused mempool space)
2021-10-19T22:31:01Z init message: Loading block index...
2021-10-19T22:31:01Z Opening LevelDB in /home/masternode/.pocketcoin/blocks/index
2021-10-19T22:31:01Z Opened LevelDB successfully
2021-10-19T22:31:01Z Using obfuscation key for /home/masternode/.pocketcoin/blocks/index:<PHONE_NUMBER>000000
2021-10-19T22:31:33Z LoadBlockIndexDB: last block file = 23
2021-10-19T22:31:33Z LoadBlockIndexDB: last block file info: CBlockFileInfo(blocks=1520, size=17594613, heights=1395259...1396636, time=2021-10-14...2021-10-15)
2021-10-19T22:31:33Z Checking all blk files are present...
2021-10-19T22:31:34Z Opening LevelDB in /home/masternode/.pocketcoin/chainstate
2021-10-19T22:31:34Z Opened LevelDB successfully
2021-10-19T22:31:34Z Using obfuscation key for /home/masternode/.pocketcoin/chainstate: b0b61894e8e44e42
2021-10-19T22:31:35Z Loaded best chain: hashBestChain=b15d65f324bf35d8c05c76a26a481a7d79a57d5350c1167fb37ed8c735f900f3 height=1396634 date=2021-10-15T18:20:32Z progress=0.989512
2021-10-19T22:31:35Z init message: Rewinding blocks...
2021-10-19T22:31:49Z init message: Verifying blocks...
2021-10-19T22:31:49Z Check Reindexer DB... success.
2021-10-19T22:32:42Z Verifying last 6 blocks at level 3
2021-10-19T22:32:42Z [0%]...ERROR: UndoReadFromDisk: Deserialize or I/O error 2 (23) - ReadVarInt(): size too large: iostream error
2021-10-19T22:32:42Z ERROR: VerifyDB(): *** found bad undo data at 1396634, hash=b15d65f324bf35d8c05c76a26a481a7d79a57d5350c1167fb37ed8c735f900f3

2021-10-19T22:32:42Z : Corrupted block database detected.
Please restart with -reindex or -reindex-chainstate to recover.
2021-10-19T22:32:42Z Aborted block database rebuild. Exiting.
2021-10-19T22:32:42Z Shutdown: In progress...
2021-10-19T22:32:42Z scheduler thread interrupt
2021-10-19T22:34:10Z Close reindexer DB
2021-10-19T22:34:10Z Shutdown: done

OS: Ubuntu 18.04
uname -a: 4.15.0-135-generic #139-Ubuntu SMP Mon Jan 18 17:38:24 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
vCPUs: 8
RAM: 32GB

I am investigating this issue and hope to have a fix ready soon.  The bug appears to happen during serialization of transaction data to disk, and the crash will not be hit until the node attempts to switch to a longer chain and load the block transaction undo data from disk.
We are currently testing this branch on testnet which ports over the transaction serialization code from bitcoin: https://github.com/pocketnetteam/pocketnet.core/commits/fix/serialization
This may fix the issue however we will need to test on mainnet for ~2 weeks to be able to confirm.

I am investigating this issue and hope to have a fix ready soon. The bug appears to happen during serialization of transaction data to disk, and the crash will not be hit until the node attempts to switch to a longer chain and load the block transaction undo data from disk. We are currently testing this branch on testnet which ports over the transaction serialization code from bitcoin: https://github.com/pocketnetteam/pocketnet.core/commits/fix/serialization This may fix the issue however we will need to test on mainnet for ~2 weeks to be able to confirm.

This is great to hear, thank you.

I haven't managed to resync my node yet. reindex-chainstate got about 12/14 done and lost connection with/banned all of it's peers. I'm trying again with a reindex but in light of today's announcement I'm wondering if it's better to simply wait for the new release on Sunday and try a clean sync from genesis?


Fix/mapping rules load time

I like this in general. Do you have any feel for how this performs in comparison?

When I tested it locally it didn't seem to make a massive difference. I jotted the numbers down at it went from 17 seconds to 15 seconds to load (that was using Chrome dev tools and could well have been consistent with each other)
Testing has the same problem we discussed before, no idea if any speed ups are significant or not, because on dev-db we don't have many examples of ScanReports that have been mapped with lots of concepts and are taking >30 seconds to load.
I'm "hacking" the get_context_data function, so it could be that the super().get_context_data that builds the original context['object_list'] is slow and making many queries.  This is what I was guessing, got no proof of this yet and depends what @simon-tarr has found from his tests/profiling.
I don't still quite understand the order that Django executes these various methods when preparing data for the templating. Nor have I timed this new loop I implemented - to see if it really is the GenericRelation via content_object that is the thing that is super slow for the mapping-rules page.

Closing this as is superseded by #235


How to display confidence key in json?

Hi, Sir Thank you for this solution it helped me a lot I want to add confidence against every bounding box. Also when I import confidence in txt files from yolov5 like "0 0.1 0.3 0.5 0.6 0.83" the last figure is confidence the script gives an error of packing extra parameters.

Hi thank you for the feedback. I have a few questions for you:

What is your desired goal of what will happen with the confidence number? Even if I could resolve the error, I am not sure what would happen to that value once your export it to other formats.
Is that extra confidence column an official part of the Yolo data format?


Reference in the Project

I saw your answer now, as I was stuck with some other matters and couldn't view it before.
Analyzing your answer, I still saw some projects (Extract Wifi, Obfuscation, Process Hypnosis and AMSI) that you are referencing as MALDEV, but I see that there are some parts of the project that you copy from the RustRedOps repository and I see that you are not referencing it .
I am sending you this message in the sense that both the person responsible for the RustRedOps repository, and others that you may have used to create your projects, may not view this in an ethical way.
Originally posted by @Whitecat18 in https://github.com/Whitecat18/Rust-for-Malware-Development/issues/2#issuecomment-2078763467

Bro, Actually using others function names and variable names does not means that i'm copying, as you can see He uses different API's, different functions different methods to implement the logic ie POC, but the methods were same as per the original authors, Actually i'm just showcasing my POC and my learning phases of malware development, i'm not intent to copy from others and make use of it, and im not intent to that. All i do is learning from the resources that was written from C,C++ Asm and understanding the logic ie POC behind it and started coding . If i really use some malware developer's content. im sure that i will give proper credits to them. Thank you for Informing.

In fact, I see that there are some things that are similar, but I understand your position.

Thanks


Exporting the distribution failed. Error code: Wsl/Service/WSL_E_EXPORT_FAILED

Windows Version
Microsoft Windows [Version 10.0.19045.3086]
WSL Version
<IP_ADDRESS>
Are you using WSL 1 or WSL 2?

[ ] WSL 2
[X] WSL 1

Kernel Version
<IP_ADDRESS>
Distro Version
Ubuntu 20.04
Other Software
No response
Repro Steps

Open PowerShell as Admin
Run wsl --set-version Ubuntu 2 or wsl --export Ubuntu C:\Users\user\Desktop\export.tar

Expected Behavior
Upgrade from WSL 1 to WSL 2 for distribution Ubuntu
Actual Behavior
Received the following output:
PS C:\WINDOWS\system32> wsl --set-version Ubuntu 2
For information on key differences with WSL 2 please visit https://aka.ms/wsl2
Conversion in progress, this may take a few minutes.
Exporting the distribution failed.
Error code: Wsl/Service/WSL_E_EXPORT_FAILED

Diagnostic Logs
Below are log files for running wsl --set-version Ubuntu 2 and wsl --export Ubuntu C:\Users\user\Desktop\export.tar (in that order)
WslLogs-2023-07-04_15-41-46_Set_Version_2.zip
WslLogs-2023-07-04_15-38-56_Export.zip

The closest information I could find on this error message was from a previous issue #9382. The final solution for this specific person looks like it was a modification to their .wslconfig to remove memory limits that were previously set. Unfortunately this doesn't seem to be my problem as I don't have a .wslconfig or wsl.conf (at least that I'm aware of).
I attempted to read the log files and solve the issue myself, but I'm a complete novice when it comes to the Windows Performance Analyzer and I wasn't able to make any progress on that end.

I had the same issue as above:

I ran wsl --set-version Ubuntu-20.04 2 which produced this error Error code: Wsl/Service/WSL_E_EXPORT_FAILED.

I then tried created C:/users/<user-name>/.wslconfig, and repeated step 1.

[wsl2]
memory=4GB # Limits VM memory in WSL 2 to 4 GB
processors=2 # Makes the WSL 2 VM use two virtual processors

Still no luck.

I then tried wsl --export Ubuntu-20.04 ubuntu.tar with the intention of exporting it and then re-importing with the version set to 2, but it once again produced the same error Error code: Wsl/Service/WSL_E_EXPORT_FAILED.

I then restarted my PC, and repeated step 1 once again. Then it worked.

wsl --set-version Ubuntu-20.04 2
For information on key differences with WSL 2 please visit https://aka.ms/wsl2
Conversion in progress, this may take a few minutes.
The operation completed successfully.

I leave this here in the hope that time I lost, is time gained for another.
https://xkcd.com/979/

I had the same issue as above:

I ran wsl --set-version Ubuntu-20.04 2 which produced this error Error code: Wsl/Service/WSL_E_EXPORT_FAILED.
I then tried created C:/users/<user-name>/.wslconfig, and repeated step 1.

[wsl2]
memory=4GB # Limits VM memory in WSL 2 to 4 GB
processors=2 # Makes the WSL 2 VM use two virtual processors

Still no luck.

I then tried wsl --export Ubuntu-20.04 ubuntu.tar with the intention of exporting it and then re-importing with the version set to 2, but it once again produced the same error Error code: Wsl/Service/WSL_E_EXPORT_FAILED.
I then restarted my PC, and repeated step 1 once again. Then it worked.

wsl --set-version Ubuntu-20.04 2
For information on key differences with WSL 2 please visit https://aka.ms/wsl2
Conversion in progress, this may take a few minutes.
The operation completed successfully.

I leave this here in the hope that time I lost, is time gained for another. https://xkcd.com/979/

I restarted my PC, but it doesn't solve problem