Consider marking duplicates in bowtie2 HV output with samtools markdup

We can use samtools to use the HV alignments to check for duplicates and add a flag (1024). This page https://www.htslib.org/algorithms/duplicate.html gives information and usage. This would give us an additional alignment-based measure of duplication. Since we can always ignore the 1024 flag, the only cost is the time to add this extra step. However, since it would only be running on the HV alignments, it should be very quick.
@willbradshaw if you think this is a good idea I can suggest a samtools pipechain to do it. (I'm currenting testing using samtools markdup to look at duplication in PMMoV reads)

Sure sounds like a good idea to me, thanks!
On Tue, 13 Aug 2024 at 10:53, Michael McLaren @.***>
wrote:

We can use samtools to use the HV alignments to check for duplicates and
add a flag (1024). This page
https://www.htslib.org/algorithms/duplicate.html gives information and
usage. This would give us an additional alignment-based measure of
duplication. Since we can always ignore the 1024 flag, the only cost is the
time to add this extra step. However, since it would only be running on the
HV alignments, it should be very quick.
@willbradshaw https://github.com/willbradshaw if you think this is a
good idea I can suggest a samtools pipechain to do it. (I'm currenting
testing using samtools markdup to look at duplication in PMMoV reads)
—
Reply to this email directly, view it on GitHub
https://github.com/naobservatory/mgs-workflow/issues/48, or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADWVV6VALRQE3NCFLEHLY3LZRIMX5AVCNFSM6AAAAABMOOQ6CKVHI2DSMVQWIX3LMV43ASLTON2WKOZSGQ3DGNJVHA3TANQ
.
You are receiving this because you were mentioned.Message ID:
@.***>

In testing this out, I realized that it won't plug into the HV workflow as easily as I hoped, because the first step in the pipechain (a call to samtools collate requires having the SQ lines (which identifies and give the lengths of the reference sequences). The HV sam files don't have the SQ header lines due to the --no-seq flag in
https://github.com/naobservatory/mgs-workflow/blob/f534a8625864cfcc54525b1d2b481c08056fffd5/subworkflows/local/hv/main.nf#L55
I'm guessing @willbradshaw added this to reduce the file size of the SAM output. I briefly tried to find a workaround that wouldn't require removing the --no-seq flag, e.g. by specifying the reference file later in samtools collate (didn't seem to work) or adding a samtools view step to try to add them back in, but haven't had success yet and need to move on for now.
But below I give the nextflow process code for doing this on a bowtie2 output that does have the SQ header lines.

Here's the shell code that you could wrap in the shell block of a process: (the comments are just to help follow along)
# input:
#     val(sample)
#     path(bowtie2_sam)
# Put the below in a shell block delimited by three single quotes
samtools collate -@ !{task.cpus} -O -u !{bowtie2_sam} \
  | samtools fixmate -@ !{task.cpus} -m -u - - \
  | samtools sort -@ !{task.cpus} -u - \
  | samtools markdup -@ !{task.cpus} -t --duplicate-count \
    -f !{sample}_markdup_stats.txt - !{sample}_markdup.sam

Some notes about the output: Optional SAM fields added by samtools that get added to the end of the optional SAM fields from bowtie2 include

"MC:Z:151M	ms:i:5118" --- The "MC" and "ms" tags are added by samtools fixmate; these are the CIGAR string and quality statistic of the mate, which are needed by samtools markdup
"do:Z:VH01619:67:AAFY5LGM5:1:1104:57485:24797" -- The "do" tag is added to duplicates and points to the "original" read pair (the read pair with the best overall quality)
dc:i:2 --- added to the original read pairs, records the copy number. Analogous to "copies=2" in clumpify output

Besides these optional fields, some header comment lines (starting with "@") get added by samtools to track the samtools commands that were run
Additional notes about the call to samtools markdup

the -t and --duplicate-count options are needed to add the "do" and "dc" flags below
-r option would remove duplicates (in which case the -t field becomes useless)
-d ??? sets the distance for optical duplicate marking; currently it's not set, which means there is no attempt to distinguish optical duplicates from PCR duplicates.
-l ??? sets the max read length. The default is 300, which seems generally fine for us. I don't know if there's a significant speed advantage to lowering it to the min possible (e.g. 151 for the 2x150 sequencing we usually have), but already this is quite fast

Misc notes

I don't really understand the difference between --mode t (default) and --mode s, described in the above docs page. It sounds like it shouldn't make a big difference, and it seems to make no difference in my PMMoV testing.
this should be quite fast when run on just HV reads; using !{task.cpus} may be overkill  --- in my testing on ~30K PMMoV aligned read pairs, using 1 versus 6 cpus has a negligible difference --- but I guess it shouldn't hurt


[Issue #471] Host new Angular GUI from textdb-web

This PR hosts the new Angular GUI files from textdb-web.
The index.html file is mapped to the root URL. Users can directly visit the angular GUI by typing the website URL, for example localhost:8080/
The old API endpoints are re-mapped to base URL /api, for example:
old /queryplan/execute becomes /api/queryplan/execute

Please add a screenshot.  LGTM.

LGTM.


LoraTap Curtain Switch

Dears,
I used LoraTap curtain switch in SmartLife and I would like to import the devices to Local Tuya.
I still has got the problem with the functionality because the entities are not visible. Sometimes I saw in logs this kind of errors:
Logger: homeassistant.config_entries
Source: config_entries.py:402
First occurred: 13 listopada 2023 21:42:44 (1 occurrences)
Last logged: 13 listopada 2023 21:42:44
Error setting up entry Roleta sypialnia 2 for cover
Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/config_entries.py", line 402, in async_setup
result = await component.async_setup_entry(hass, self)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/components/cover/init.py", line 206, in async_setup_entry
return await component.async_setup_entry(entry)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/helpers/entity_component.py", line 187, in async_setup_entry
raise ValueError("Config entry has already been setup!")
ValueError: Config entry has already been setup!
This is standard instruction for the lora tap:

The connection looks fine. Could you support me and tell me what am I doing wrong?

Let me know if I should check something or provide more data. Thank you in advanced.

These errors are not from this integration.
It looks like you have somehow gotten duplicate entities in your registry.  Remove them (including any hidden or disabled ones) and try adding the device again.

Hello,
I tried to reload it but there is still the same. Could you tell me how to take a look to app register to check and modify that?

Settings / Devices & Services / Entities / Clear (where it says "... entities not shown").  Find your entities related to this curtain and check the box, then "Remove Selected".
Go to the Devices tab, and do the same for the devices related to this curtain.
Restart, then add the device again.

Dear make-all,
after steps which you suggest me I saw the same problem. Do you have any idea what is the matter?

Do you mean you are still getting this in the log?
File "/usr/src/homeassistant/homeassistant/helpers/entity_component.py", line 187, in async_setup_entry
raise ValueError("Config entry has already been setup!")
ValueError: Config entry has already been setup!

Or your issue is that the state is Unknown (which may be because the device is not returning any info about its current state).

Dear make-alll,
I checked the logs and I did not see this kind of problems. I did not know what is the issue but in general on cloud everything works fine.
I did not see the line which you send to me in logs.
What should I do in this situation?

Hi, I create new HAOS but it is still the same.

Hi I solve the isse used other HACS. But from my observation the LoraTap use the control based on number 1,2,3 - I suppose your hacs use the start pause stop. Please if it is possible add it to your plugin becasuse it is quite good but for me is unusefull becasue of the problem with blinds. Thanks in advance.

same problem
it's Ok with 1,2,3 option in local tuya

Any Updates ?

If you are getting the error reported, then you have somehow managed to get duplicated config entries. The problem is not related to this integration, and the steps to remove the entities and re-add the device are listed above.
According to this comment, the steps worked to solve the original issue:
https://github.com/make-all/tuya-local/issues/1300#issuecomment-1812030043


[ForwardPort: v2.9] [BUG] Scan not running on worker nodes for k3s scan profiles and other test failures

forwardPort for: https://github.com/rancher/cis-operator/issues/254
Rancher Server Setup

Rancher version: v2.8-head (66007093a)
Installation option (Docker install/Helm Chart): Docker

If Helm Chart, Kubernetes Cluster and version (RKE1, RKE2, k3s, EKS, etc):

Proxy/Cert Details:

Information about the Cluster

Kubernetes version: v1.26.11+k3s1
Cluster Type (Local/Downstream): Downstream

If downstream, what type of cluster? (Custom/Imported or specify provider for Hosted/Infrastructure Provider): Infrastructure Provider, Amazon EC2

User Information

What is the role of the user logged in? (Admin/Cluster Owner/Cluster Member/Project Owner/Project Member/Custom): Admin

If custom, define the set of permissions:

Describe the bug

installed cis-benchmark chart 5.1.0-rc4 and ran scan on a k3s v1.26.11+k3s1 cluster with k3s-cis-1.8-permissive.
It was observed that the scans 4.x.x are only running on control plane and etcd nodes whereas those should be running on all the nodes. Which is the same case with rke1 and rke2 profiles.
To Reproduce

provision a k3s v1.26.11+k3s1 cluster on amazon ec2.
install cis-benchmark-chart 5.1.0-rc4 on the cluster.
run scan with k3s-cis-1.8-permissive profile.

Result
Observe that the tests 4.x.x are only running on control plane and etcd nodes.
Expected Result

4.x.x tests should run on all the nodes.
Screenshots

Additional context

there are some other failures as well with the chart on k3s clusters.
On K3S hardened cluster
k3s-cis-1.8-permissive is failing:
Fail
4.1.9	Ensure that the kubelet --config configuration file has permissions set to 600 or more restrictive (Automated)
Fail
4.1.10	Ensure that the kubelet --config configuration file ownership is set to root:root (Automated)

where as same checks passed on 1.8-hardened profile:
Pass
4.1.9	Ensure that the kubelet --config configuration file has permissions set to 600 or more restrictive (Automated)
Pass
4.1.10	Ensure that the kubelet --config configuration file ownership is set to root:root (Automated)

Tested the CIS scan with k3s-cis-1.8-permissive profile on k3s cluster with chart v6.0.0-rc2. 4.1.9 and 4.1.10 scans are passing on cluster. Hence closing the issue.


Add Scaffolder Gitlab Plugin

Hey, I just made a Pull Request!
#15544 Adding Scaffolder Gitlab Plugin.
This needs way more functions integrated, I only had time and need for these three.
Available APIs through @gitbeaker/node: https://github.com/jdalrymple/gitbeaker
Not all are available, they are working on a new version with all APIs. All Gitlab APIs: https://docs.gitlab.com/ee/api/api_resources.html
:heavy_check_mark: Checklist

[x] A changeset describing the change and affected packages. (more info)
[x] Added or updated documentation
[x] Tests for new functionality and regression tests for bug fixes
[x] Screenshots attached (for UI changes)
[x] All your commits have a Signed-off-by line in the message. (more info)

I tried, but I have no idea why the tests fail. Maybe someone can help me?

@djamaile. In https://github.com/backstage/backstage/issues/15544, @jhaals suggested it this way.

@dpfaffenbauer is there a reason, why this PR is still in draft mode? I would like to add additional Gitlab actions based on your PR. Do you need any support?

@Andy2003 Well, I never got a review from anyone and the tests fail and I don't know why...

@dpfaffenbauer please use yarn install to update the yarn.lock correctly

@Andy2003 done

You need to add @backstage/config as dev dependency. Sorry but I missed this one...

@Rugvip May I kindly ask if there is a reason why this pull request hasn't been reviewed or merged yet? If you happen to be busy and unable to review it at the moment, would it be possible for you to kindly assign this PR to another codeowner? Thank you for your time and assistance.

@benjdlambert resolved both requests.

@benjdlambert all done

@dpfaffenbauer let's go with projectVariable then instead. I started to put up some standards for these naming conventions over in this PR: https://github.com/backstage/backstage/pull/16938/

Hello,
I am trying to use gitlab:projectAccessToken:create, but it seems not working.
When I try to use the step the result is empty string, but I have tested also the gitlab api using the body in your code and I receive an error:
{
"error": "expires_at is missing"
}
So, am I wronging something?
Thanks a lot,
Matteo.


The animation of Switch widget can't stop when I drag it to on/off.

Steps to Reproduce
I was using flutter_gallery sample project. Nothing was changed.

Run flutter run and navigate to Selection controls | SWITCH.
Drag the first switch widget to turn it on/off. (Tap couldn't make the issue happen.)

You might need to do step 2 for several times.
Here is the screen-record.
Logs
flutter run -v.log
$ flutter analyze
Analyzing C:\Users\zongj\Documents\MyProject\flutter\flutter_gallery...
No issues found!
Ran in 9.5s

Flutter Doctor
$ flutter doctor -v
[√] Flutter (Channel master, v0.2.2-pre.54, on Microsoft Windows [Version 10.0.16299.309], locale zh-CN)
    • Flutter version 0.2.2-pre.54 at C:\Android\flutter
    • Framework revision d693d427d8 (16 hours ago), 2018-03-15 11:11:13 +0100
    • Engine revision f192c59d76
    • Dart version 2.0.0-dev.37.0.flutter-0175f24b25

[√] Android toolchain - develop for Android devices (Android SDK 27.0.3)
    • Android SDK at C:\Android\sdk
    • Android NDK location not configured (optional; useful for native profiling support)
    • Platform android-27, build-tools 27.0.3
    • ANDROID_HOME = C:\Android\sdk
    • Java binary at: C:\Program Files\Android\Android Studio\jre\bin\java
    • Java version OpenJDK Runtime Environment (build 1.8.0_152-release-915-b01)
    • All Android licenses accepted.

[√] Android Studio (version 3.0)
    • Android Studio at C:\Program Files\Android\Android Studio
    • Java version OpenJDK Runtime Environment (build 1.8.0_152-release-915-b01)

[√] VS Code, 64-bit edition (version 1.21.1)
    • VS Code at C:\Program Files\Microsoft VS Code
    • Dart Code extension version 2.10.0

[√] Connected devices (1 available)
    • Redmi Note 4 • QKKRH6YHPJDIOFLV • android-arm64 • Android 6.0 (API 23)

• No issues found!

cc @HansMuller did this get resolved?

Yes, this was fixed in https://github.com/flutter/flutter/pull/17821


samplebuilder.Pop(), only nil comes out.

Your environment.

Version: Release
Browser: ION-SFU
Other Information - elementary OS 5.1.7 Hera, ~18.04.1-Ubuntu

What did you do?
Builder := samplebuilder.New(10, &codecs.H264Packet{}, 90000)
for {
inboundVideoPacket := make([]byte, 1500)
v, _, err := Listener.ReadFromUDP(inboundVideoPacket)
if err != nil {
log.Fatalf("Listener.ReadFromUDP Error %s", err.Error())
}
        Packet = &rtp.Packet{}
        err = Packet.Unmarshal(inboundVideoPacket[:v])
        if err != nil {
            log.Fatalf("Pakcet.Unmarshal Error %s", err.Error())
        }
        log.Println("Packet : ", Packet.SequenceNumber)
        Builder.Push(Packet)
        log.Println(Builder.Pop())
        // writesample(Builder, Track)

}
the output is
2021/01/21 15:17:03 Packet :  24795
2021/01/21 15:17:03 nil
2021/01/21 15:17:03 Packet :  24796
2021/01/21 15:17:03 nil
2021/01/21 15:17:03 Packet :  24797
2021/01/21 15:17:03 nil
2021/01/21 15:17:03 Packet :  24798
2021/01/21 15:17:03 <il
2021/01/21 15:17:03 Packet :  24799
2021/01/21 15:17:03 nil
2021/01/21 15:17:03 Packet :  24800
2021/01/21 15:17:03 nil
2021/01/21 15:17:03 Packet :  24801
2021/01/21 15:17:03 nil
2021/01/21 15:17:03 Packet :  24802
2021/01/21 15:17:03 nil
2021/01/21 15:17:03 Packet :  24803
2021/01/21 15:17:03 nil
What did you expect?
The packet should have come out.
What happened?
i don't know :(

Hey @thsdmfwns
If you are sending very large frames and/or have packet loss that should be expected! Can you share the command you are using to generate the input?
You can also skip the SampleBuilder and send packets directly. This was changed in 9439d820c594cc3bf0de3c63a22be98c22eef081 because some programs (ffmpeg) were generating invalid RTP packets.
I am going to make the SampleBuilder a CLI flag. Then in the README give people an option to forward RTP, or use the SampleBuilder. If you are interested in contributing that would be a really great PR! Otherwise I will get to it in about two weeks.
thanks

Hey @thsdmfwns
If you are sending very large frames and/or have packet loss that should be expected! Can you share the command you are using to generate the input?
You can also skip the SampleBuilder and send packets directly. This was changed in 9439d820c594cc3bf0de3c63a22be98c22eef081 because some programs (ffmpeg) were generating invalid RTP packets.
I am going to make the SampleBuilder a CLI flag. Then in the README give people an option to forward RTP, or use the SampleBuilder. If you are interested in contributing that would be a really great PR! Otherwise I will get to it in about two weeks.
thanks

the input command is
/usr/bin/ffmpeg -re -i rtmp://localhost:1935/$app/$name -vn -acodec libopus -f rtp rtp://localhost:6000 -vcodec copy -an -f rtp rtp:localhost:5000 -sdp_file video.sdp;
i'm using the nginx-rtmp-module
I can't use Go very well because this is my first Go project.
so please give me the example about Pop in a for loop.
sorry about my english skill

the input command is
/usr/bin/ffmpeg -re -i rtmp://localhost:1935/$app/$name -vn -acodec libopus -f rtp rtp://localhost:6000 -vcodec copy -an -f rtp rtp:localhost:5000 -sdp_file video.sdp;
i'm using the nginx-rtmp-module
I can't use Go very well because this is my first Go project.
so please give me the example about Pop in a for loop.
sorry about my english skill

I will test out your solution tomorrow! That does look ok to me.
If you re-encode to VP8 does it work with the SampleBuilder?
Can you try the non-samplebuilder example also? https://github.com/pion/webrtc/blob/52249252fb14005473242599074abbdfd8fc8077/examples/rtp-forwarder/main.go#L120

I will test out your solution tomorrow! That does look ok to me.
If you re-encode to VP8 does it work with the SampleBuilder?
Can you try the non-samplebuilder example also? https://github.com/pion/webrtc/blob/52249252fb14005473242599074abbdfd8fc8077/examples/rtp-forwarder/main.go#L120

i changed my input command like
exec_push /usr/bin/ffmpeg -re -i rtmp://localhost:1935/tc/stream -vn -c:a libopus -b:a 48000 -ssrc 1 -payload_type 111 -f rtp rtp://localhost:6000 -an -vcodec libvpx -qmin 0 -qmax 10 -deadline 1 -g 10 -error-resilient 1 -auto-alt-ref 1 -f rtp rtp:localhost:5000;
but output is same :(

i changed my input command like
exec_push /usr/bin/ffmpeg -re -i rtmp://localhost:1935/tc/stream -vn -c:a libopus -b:a 48000 -ssrc 1 -payload_type 111 -f rtp rtp://localhost:6000 -an -vcodec libvpx -qmin 0 -qmax 10 -deadline 1 -g 10 -error-resilient 1 -auto-alt-ref 1 -f rtp rtp:localhost:5000;
but output is same :(

Did you try not using the SampleBuilder like in the commit I linked? I am curious if the video is viewable without it.
Would you be able to share a pcap of the RTP traffic. I can debug/fix locally then!
Thanks

Did you try not using the SampleBuilder like in the commit I linked? I am curious if the video is viewable without it.
Would you be able to share a pcap of the RTP traffic. I can debug/fix locally then!
Thanks

Hey @thsdmfwns glad you got it working! What did you end up doing?
thanks

Hey @thsdmfwns glad you got it working! What did you end up doing?
thanks

Actually, I changed the server to Janus. I thought this would be easier.

Actually, I changed the server to Janus. I thought this would be easier.

No worries! Sorry about the frustration.
I added an example so shows rtmp-to-webrtc so future users don't hit this frustration :( https://github.com/pion/example-webrtc-applications/tree/master/rtmp-to-webrtc

No worries! Sorry about the frustration.
I added an example so shows rtmp-to-webrtc so future users don't hit this frustration :( https://github.com/pion/example-webrtc-applications/tree/master/rtmp-to-webrtc


Is the server alive?

I just tried but I kept getting:
tunnel server offline: socket hang up, retry 1s
I also tried --host https://localhost.run as suggested in #203 , but this time I got:
your url is: undefined
Is the server working?

Today I tried it again and it changed. It returned me url, but gave connection refused: localtunnel.me:43766 (check your firewall settings) just as #258 . Maybe it's stability issue?

I encountered this problem too...
Probably because i was writing it wrong:
lt -p 8080  (this gave me the same error)
But I solved it by doing this:
lt --port 8080
or
lt --subdomain mydomain --port 8080

Here's the response:
your url is: https://mydomain.localtunnel.me

I hope it works for you too

I believe it's nothing to do with -p vs. --port because they are equivalent as the help message says. I think it's just because the server was back normal the 2nd time you try. :)

Well, if i write the comand woth -p it doesn't work, but if i re-write the comand with --port it works well in my pc...
(i tried multiple times to verify it)

I deployed my own instance on my server. Now it works normally. So I think it's stability issue for the public one the author hosts.


docs(README): remove old testing prerequisites

This should have been included with #1271.

Codecov Report

Merging #1282 into master will decrease coverage by 0.05%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #1282      +/-   ##
==========================================
- Coverage   86.71%   86.66%   -0.06%
==========================================
  Files          45       45
  Lines        3929     3929
  Branches      681      681
==========================================
- Hits         3407     3405       -2
- Misses        354      355       +1
- Partials      168      169       +1

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c026b64...7d2c0ba. Read the comment docs.


infinite loop when error 301 on info/objects/pack

Hi,
Ii seems that git-dumper is stucked on an infinite loop when the server return a redirect (response 301) on info/objects/pack when it redirects to something different that a git directory (home page for instance)

Could you try again with master and send me the output?


quickplot (x,y) orientation

quickplot does not choose a sensible orientation when plotting ("x","y") cubes.
It plots y along the bottom. We have to specify the coords manually.
I believe it should automatically choose the obvious orientation.
I have found this to be an issue when plotting fields from several different NIMROD sources.
Update:
If neither of the dimension coordinates have a recognisable axis (e.g. via standard_name) then  the trailing dimension would be horizontal for 2D cubes.

#2899 claimed to have closed this.


Transition when entering is wrong if the component is aligned in center

If the  is aligned in the center i.e. text-align: center; the transition acts abnormally.

@jonahbgoode I wrapped text with a fixed-width div element for center.
import React from 'react';
import styled from 'styled-components';
import TextLoop from 'react-text-loop';

const Text = styled.div`
  width: 500px;
  text-align: center;
`;

const App = props => (
  <TextLoop>
    <Text>Hello</Text>
    <Text>World</Text>
  </TextLoop>
)

Hi @jonahbgoode! I'm really really sorry I didn't see this before, I missed it completely on my notifications 😞
Thanks @jinhyuk for taking the time to help out. To give you a more detailed answer, the way TextLoop component is currently implemented is optimised for the cases where it's used within a sentence so it tries to be left aligned with the current text.
I've created a sandbox so you can play a bit with the proposed solution (used glamorous instead of styled-components but it's the same principle): https://codesandbox.io/s/2z7v4ovrn0
I'm planning some improvements to the library in the next few weeks so I'll keep this open to have a better look at it and see if there's a way to make it easier to use in these situations. Thanks again for opening the issue!

Closing this now as the solution has been given.


Only define DNS_ReadNameField when cache is used

Description
This PR adds #if checks to only build/compile the function DNS_ReadNameField when ipconfigUSE_DNS_CACHE or ipconfigDNS_USE_CALLBACKS is defined.
Test Steps

Checklist:

[ ] I have tested my changes. No regression in existing tests.
[ ] I have modified and/or added unit-tests to cover the code changes in this Pull Request.

Related Issue
https://github.com/FreeRTOS/FreeRTOS-Plus-TCP/issues/1199
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

/bot run uncrustify


Fmovies not working

Source information
Fmovies 14.24
Source language
English
Steps to reproduce
net::ERR_NAME_NOT_RESOLVED
Expected behavior
We should be able to access the fmovies website
Actual behavior
net::ERR_NAME_NOT_RESOLVED
Aniyomi version
<IP_ADDRESS>
Android version
Android 11
Other details
Pls fix this bro
Acknowledgements

[X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open or closed issue.
[X] I have written a short but informative title.
[X] I have updated the app to version <IP_ADDRESS>.
[X] I have updated all installed extensions.
[X] I have tried the troubleshooting guide.
[X] If this is an issue with the app itself, I should be opening an issue in the app repository.
[X] I will fill out all of the requested information in this form.

We don't manage that extension anymore.


[DRAFT] [branch-0.6]Support the fallback logic of Trigger.AvailableNow

The existing fallback logic of Trigger.AvailableNow will call latestOffset first and then getBatch on a restarted query, thus for a streaming query that doesn't have "startingVersion", it will fetch the latest snapshot and store it in the local array -- sortedFetchedFiles, which will contains all the consumed data, cause data duplication issue.
This change fix this behavior by re-fetching files needed exactly by getBatch if the case above happens.

moved to https://github.com/delta-io/delta-sharing/pull/342.


Unable to run AppImage on Arch Linux

When running the AppImage on Arch Linux, after making it executable, I get the following error:
/tmp/.mount_NUsefC/AppRun: line 77: 21426 Aborted                 (core dumped) LD_LIBRARY_PATH="" zenity --question --title="$TITLE" --text="$TEXT" 2> /dev/null
This is using the latest release, 0.2.3.

Not saying that this shouldn't be investigated, but FYI, I'm running v0.2.3 just fine on my Arch.
All I did was to download the AppImage file and make it executable, like you did.

I've created AUR packages cerebro and cerebro-git, that allow making a native build instead of using AppImage.
@mckennajones, @julianorafael try them out of you are interested.

hey @maximbaz! I'm not good in linux apps distribution, so can you please explain a bit what is AUR package? Does it make sense to automate this process for each release?

AUR is a community-driven repository for people using Arch-based distros.
The first script I created downloads *.tar.gz file from the Github releases page (the other one just clones master branch), then they install all necessary dependencies like npm, run all build commands like npm install, create binaries specific to the user's CPU architecture, place them in correct locations, create symlinks, put icons and license files in corresponding locations.
Basically every other user of Arch-based distro can now get the latest cerebro built specifically for their CPU architecture with one command. Same goes for updates, they will receive cerebro updates with the same approach as they receive system updates.
However the maintenance is required, not for the cerebro-git (that one just always takes master branch in whatever state it is), but for the cerebro, because there I hardcoded the latest release number.
It would be super-cool if we could somehow automate that. The package is a git repo, where with each release we need to update the version and sha256 sum of the *.tar.gz, run a command that generates some metadata, and do a git push. Can you think of a place where we could automatically execute this sequence of commands with every release?

@maximbaz Thanks so much. It works like a charm. I even learned a little bit about AUR packages from your previous post. Cheers!

I've scripted the upgrade procedure for the AUR package, it now requires running one command ./upgrade.sh 0.2.4 to push the update.
@KELiON if you ever have an environment where you automatically build and deploy new releases, just ping me, I'll give you access and everything so that you can run this command there as well.
For now, anyone can use this link to send me a notification that a new version is released, and I will run the upgrade command manually.
Perhaps it's worth mentioning in the README.md file about the existence of all community packages, so that people can find them easier.
As for this particular github issue, I think it is ready to be closed :)

@KELiON Archlinux does have a docker image that can be used in order to automatically create an upgrade.
This can be done using travis pretty easily i guess.

The version used is too old, maybe try using the new version


bootstrap 3.3.4

Hi Dear
When bootstrap 3.3.4 RTL version released?
Thanks

Hi,
I guess that i'll update it when Bootstrap 3.3.5 is released.


Wrong documentation

In the documentation, you say that the props containerStyle and inputStyle are options, but after trying to use them (and checking the code) I noticed that those doesn't work.

Thanks for the heads-up @felipevargas-gaivota. I neglected to remove that part of the documentation when I forked this. Should be good now! :)

Sweet @alexplumb, ty for the quick update! Have a nice day :)


every file is previewed as text now

Also having this issue. I'm on wayland and using foot as my terminfl, so all images preview works through sixel. For some time (didn't actually notice when this happened) all image previews are just text.
Also, found this issue in lf github. Seems like it's relevant and the problem is in chafa
https://github.com/gokcehan/lf/issues/1582

This has already been addressed in #90 but the pull request hasn't been merged yet.

ctpv needs to pass --polite on to chafa


v4: nav-link.active styles are missing

I understand its still in alpha but this is something trivial, so thought of putting it up on the radar:
http://v4-alpha.getbootstrap.com/components/navs/

I'm using hosted files: https://maxcdn.bootstrapcdn.com/bootstrap/4.0.0-alpha.2/css/bootstrap.min.css

Or maybe one has to use additional qualifiers like .nav-pills or .nav-tabs


cmd/build: debug and test fail to run on mac OS 10.15.4

What version of Go are you using (go version)?

$ go version go1.14.2 darwin/amd64

Does this issue reproduce with the latest release?
Tested with Go 1.14.2
What operating system and processor architecture are you using (go env)?
go env Output
$ go env
GO111MODULE=""
GOARCH="amd64"
GOBIN=""
GOCACHE="/Users/Weihe/Library/Caches/go-build"
GOENV="/Users/Weihe/Library/Application Support/go/env"
GOEXE=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="darwin"
GOINSECURE=""
GONOPROXY=""
GONOSUMDB=""
GOOS="darwin"
GOPATH="/Users/Weihe/go"
GOPRIVATE=""
GOPROXY="https://proxy.golang.org,direct"
GOROOT="/usr/local/Cellar/go/1.14.2_1/libexec"
GOSUMDB="sum.golang.org"
GOTMPDIR=""
GOTOOLDIR="/usr/local/Cellar/go/1.14.2_1/libexec/pkg/tool/darwin_amd64"
GCCGO="gccgo"
AR="ar"
CC="clang"
CXX="clang++"
CGO_ENABLED="1"
GOMOD="/Users/Weihe/code/Mew/go.mod"
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -fdebug-prefix-map=/var/folders/h6/znnjnf1n2t970n6rdht824t40000gn/T/go-build615583220=/tmp/go-build -gno-record-gcc-switches -fno-common"

What did you do?
tried to run test suite on a golang code repo with command go test ./....
debug mode for main application also fails.

What did you expect to see?
Expect test case to run.
What did you see instead?
GOROOT=/usr/local/Cellar/go/1.14.2_1/libexec #gosetup
GOPATH=/Users/Weihe/go #gosetup
/usr/local/Cellar/go/1.14.2_1/libexec/bin/go build -o /private/var/folders/h6/znnjnf1n2t970n6rdht824t40000gn/T/___go_build_mew_go -gcflags "all=-N -l" /Users/Weihe/code/Mew/mew.go #gosetup
`# runtime/cgo`
In file included from gcc_darwin_amd64.c:6:
/usr/local/include/pthread.h:331:6: error: macro expansion producing 'defined' has undefined behavior [-Werror,-Wexpansion-to-defined]
/usr/local/include/pthread.h:200:2: note: expanded from macro '_PTHREAD_SWIFT_IMPORTER_NULLABILITY_COMPAT'
/usr/local/include/pthread.h:331:6: error: macro expansion producing 'defined' has undefined behavior [-Werror,-Wexpansion-to-defined]
/usr/local/include/pthread.h:200:34: note: expanded from macro '_PTHREAD_SWIFT_IMPORTER_NULLABILITY_COMPAT'
/usr/local/include/pthread.h:540:6: error: macro expansion producing 'defined' has undefined behavior [-Werror,-Wexpansion-to-defined]
/usr/local/include/pthread.h:200:2: note: expanded from macro '_PTHREAD_SWIFT_IMPORTER_NULLABILITY_COMPAT'
/usr/local/include/pthread.h:540:6: error: macro expansion producing 'defined' has undefined behavior [-Werror,-Wexpansion-to-defined]
/usr/local/include/pthread.h:200:34: note: expanded from macro '_PTHREAD_SWIFT_IMPORTER_NULLABILITY_COMPAT'

Can you provide a minimal code example that shows this error?
Thanks

The OP in #38876 reported this error and provided a reproducer. Closing here in favour of the other thread.


Add isHidden to secureConnect

This allows connecting to APs that don't broadcast their SSID

it's good idea, just tell me one thing, do you use this package for android or iOS? and how to you use it?

it's good idea, just tell me one thing, do you use this package for android or iOS? and how to you use it?

Both. I eventually ended up using wifi_iot because I also needed the forceWifiUsage functionality

nice, we have to check, because for the project that we use, we need to know SSID, if not, the connection do not work.

Hi, Do you have any plans to review or accept this PR soon? I think it would be very useful.

I'm glad to hear that we're having contributions to this library, I don't have time to check everything because of my personal life and work, I'll check the pr and create a new version for it if it's within the library's needs.


Not working on iOS

I'm trying to integrate this into my iOS app. However it does not seem to be working at all. There is no change on touch, and the completion function is not called.
I basically copied over the example code but it's still not working for me.
<?xml version="1.0" encoding="utf-8" ?>
<ContentPage xmlns="http://xamarin.com/schemas/2014/forms"
             xmlns:x="http://schemas.microsoft.com/winfx/2009/xaml"
             xmlns:controls="clr-namespace:TouchEffect.Controls;assembly=TouchEffect"
             x:Class="Views.TouchFadeViewPage">
    <StackLayout>
        <controls:TouchFadeView
            Padding="10, 5"
            BackgroundColor="Black"
            VerticalOptions="CenterAndExpand"
            HorizontalOptions="CenterAndExpand"
            Completed="Handle_TouchCompleted">

            <Label Text="CLICK ME"
                   TextColor="White"
                   FontSize="60"/>
        </controls:TouchFadeView>
    </StackLayout>
</ContentPage>

using Xamarin.Forms;

namespace Views
{
	public partial class TouchFadeViewPage : ContentPage
	{
		public TouchFadeViewPage ()
		{
			InitializeComponent ();
		}

        private void Handle_TouchCompleted(TouchEffect.TouchView sender, TouchEffect.EventArgs.TouchCompletedEventArgs args)
        {
            DisplayAlert("Thank you", ":)", "OK");
        }
    }
}

I cloned this solution and the example app did work.
Any ideas what might screw this up?

Hi, thank you for feedback
I need to extend readme...
This is linker issue.
Try to write next code in AppDelegate Finish Loading method.
TouchViewRenderer.Initialize();

@NaturalFigurehead I have updated the Readme file :)

@AndreiMisiukevich it's working now. Thanks!

@NaturalFigurehead super)
if you like this plugin, you may STAR it)


Unable to Setup with Bitbucket Server

Hey,
we are currently trying to integrate danger into our internal infrastructure. Sadly we are unable to do so, as the docs seem to be incomplete.
version:
computer:App user$ gem list | grep danger
danger (4.2.1)
executing danger:
computer:App user$ bundle exec danger local --verbose
bundler: failed to load command: danger (/usr/local/bin/danger)
RuntimeError: danger cannot find your git remote, please set a remote. And the repository must host on GitHub.com or GitHub Enterprise.
 /Library/Ruby/Gems/2.0.0/gems/danger-4.2.1/lib/danger/ci_source/local_git_repo.rb:61:in `raise_error_for_missing_remote'
 /Library/Ruby/Gems/2.0.0/gems/danger-4.2.1/lib/danger/ci_source/local_git_repo.rb:43:in `initialize'
 /Library/Ruby/Gems/2.0.0/gems/danger-4.2.1/lib/danger/danger_core/environment_manager.rb:30:in `new'
 /Library/Ruby/Gems/2.0.0/gems/danger-4.2.1/lib/danger/danger_core/environment_manager.rb:30:in `initialize'
 /Library/Ruby/Gems/2.0.0/gems/danger-4.2.1/lib/danger/commands/local.rb:70:in `new'
 /Library/Ruby/Gems/2.0.0/gems/danger-4.2.1/lib/danger/commands/local.rb:70:in `run'
 /Library/Ruby/Gems/2.0.0/gems/claide-1.0.1/lib/claide/command.rb:334:in `run'
 /Library/Ruby/Gems/2.0.0/gems/danger-4.2.1/bin/danger:5:in `<top (required)>'
 /usr/local/bin/danger:23:in `load'
 /usr/local/bin/danger:23:in `<top (required)>'

environment vars:
export DANGER_BITBUCKETSERVER_USERNAME=username
export DANGER_BITBUCKETSERVER_PASSWORD=password
export DANGER_BITBUCKETSERVER_HOST=address-to-bitbucket-server (e.g. bitbucket.local.com)
export GIT_URL=ssh://git@bitbucket.local.com:7999/PROJECTNAME/REPONAME.git
Are there any major missteps on our side?

I wonder if danger local is working with bit bucket?

Yeah - it does look like the command danger local only supports GitHub - local.rb
I'd definitely accept PRs making it run against any of the other sources (same as with danger pr)

@olbrichj Are you still facing this issue?

We actually stopped looking into it.

So we can close this? @orta?

~Ish - if this represents "I want to run danger local or danger pr against bitbucket` then not really. It's an action item for someone to be able to do it :)

I started looking into implementing danger pr for bitbucket today. Not able to figure out how to go about it.

Hi, I am just facing this issue. Was this feature implemented? Is it possible to use danger pr with a bitbucket repo?

Nope, don't think so

Please correct me if I am wrong.
"If our repo is hosted on Bitbucket, we can't use danger"

danger pr or danger local yes, but not the command you run on CI danger

@orta
Could you please elaborate your answer. Also check my comment in https://github.com/danger/danger/issues/744
Do you mean danger should only be run from CI(Jenkins in my case)?

danger pr the command only supports working GitHub - you'll have to skip that set

I am referring http://danger.systems/guides/getting_started.html#setting-up-danger-to-run-on-your-ci documentation but not sure what should I do next to run Dangerfile

Nothing, looks ready, it should be fine to run via danger on your CI as a part of the CI process - danger pr is a command for testing the Dangerfile on your computer instead

danger pr the command only supports working with GitHub - you'll have to skip that step
You mean skip running danger pr in terminal? instead run in CI(Jenkins) process? How does it make difference if I run in terminal or in CI if Buitbucket itself is not supported?

I feel like I've repeated this point, danger is the command which runs on your CI - it supports bitbucket, using the ENV vars you set up.
danger pr is a separate command, which you use on your computer to test a dangerfile, it does not support bitbucket.

Thank you 👍

Hi @orta
My progress with Danger so far is as below. Please let me know if I am doing any mistake.
On my mac machine
ruby -v
ruby 2.5.0p0 (2017-12-25 revision 61468) [x86_64-darwin16]
danger --version
/usr/local/lib/ruby/gems/2.5.0/gems/git-1.3.0/lib/git/lib.rb:999
5.5.9
Created a directory /Users/walvekar.anand/Danger which has Dangerfile
Included below code build shell script
cd "/Users/walvekar.anand/Danger"
PATH="/usr/local/bin/:$PATH"
danger
Error in Jenkins console
Started by user admin
Building in workspace /Users/Shared/Jenkins/Home/workspace/Danger
[Danger] $ /bin/sh -xe /Users/Shared/Jenkins/tmp/jenkins681444157121482829.sh
cd /Users/walvekar.anand/Danger
PATH=/usr/local/bin/:/usr/bin:/bin:/usr/sbin:/sbin
danger
Could not find the type of CI for Danger to run on.
Build step 'Execute shell' marked build as failure
Finished: FAILURE
Even though danger is being run from CI, it says Could not find the type of CI for Danger to run on

Hi @AnandWalvekar, I think something is wrong with the way you're setting the environment variables. Could you try adding this:
export JENKINS_URL="..."
# ...
bundle exec danger --verbose

Afaik, the only way for that error to appear is when that ENV var isn't available.

Hi @jeroenvisser101
Thanks you very much. It helped indeed but onto on more error
What I tried
JENKINS_URL="http://localhost:8080/job/Danger/" DANGER_BITBUCKETSERVER_PASSWORD=“XXX” DANGER_BITBUCKETSERVER_HOST="https://YYY.git" bundle exec danger --verbose
What I get
[33mNot a Pull Request - skipping danger run

Check out this method: https://github.com/danger/danger/blob/master/lib/danger/ci_source/jenkins.rb#L91-L101, it checks the PR number.

Adding 2 more env vars
CHANGE_URL="https://bitbucket.xxx.com/projects/UUU/repos/react-native/pull-requests" CHANGE_ID="1"
I get error
Could not set up API to Code Review site for Danger

For Danger to run on this project, you need to expose a set of following the ENV vars:

GitHub: DANGER_GITHUB_API_TOKEN
GitLab: DANGER_GITLAB_API_TOKEN
BitbucketServer: DANGER_BITBUCKETSERVER_USERNAME, DANGER_BITBUCKETSERVER_PASSWORD, DANGER_BITBUCKETSERVER_HOST
BitbucketCloud: DANGER_BITBUCKETCLOUD_USERNAME, DANGER_BITBUCKETCLOUD_PASSWORD
VSTS: DANGER_VSTS_API_TOKEN, DANGER_VSTS_HOST

Found these keys in your ENV: CHANGE_ID, JENKINS_URL, CHANGE_URL, DANGER_BITBUCKETSERVER_PASSWORD, DANGER_BITBUCKETSERVER_HOST, HUDSON_SERVER_COOKIE, SHELL, TMPDIR, BUILD_TAG, OLDPWD, WORKSPACE, RUN_CHANGES_DISPLAY_URL, com.apple.java.jvmTask, USER, __CF_USER_TEXT_ENCODING, JAVA_MAIN_CLASS_76, JENKINS_HOME, PATH, RUN_DISPLAY_URL, PWD, JOB_NAME, BUILD_DISPLAY_NAME, XPC_FLAGS, BUILD_ID, JOB_BASE_NAME, XPC_SERVICE_NAME, SHLVL, HOME, EXECUTOR_NUMBER, JENKINS_SERVER_COOKIE, NODE_LABELS, LOGNAME, HUDSON_HOME, NODE_NAME, JOB_DISPLAY_URL, BUILD_NUMBER, HUDSON_COOKIE, JAVA_ARCH, _, BUNDLER_ORIG_BUNDLE_BIN_PATH, BUNDLER_ORIG_BUNDLE_GEMFILE, BUNDLER_ORIG_BUNDLER_ORIG_MANPATH, BUNDLER_ORIG_BUNDLER_VERSION, BUNDLER_ORIG_GEM_HOME, BUNDLER_ORIG_GEM_PATH, BUNDLER_ORIG_MANPATH, BUNDLER_ORIG_PATH, BUNDLER_ORIG_RB_USER_INSTALL, BUNDLER_ORIG_RUBYLIB, BUNDLER_ORIG_RUBYOPT, BUNDLE_BIN_PATH, BUNDLE_GEMFILE, BUNDLER_VERSION, RUBYOPT, RUBYLIB, GEM_PATH, GEM_HOME, MANPATH.
Failing the build, Danger cannot run without API access.
You can see more information at http://danger.systems/guides/getting_started.html
Build step 'Execute shell' marked build as failure
Finished: FAILURE

Parse error

JSON::ParserError: 765: unexpected token at 'Invalid request from host <IP_ADDRESS>: Note that Bitbucket does not support Git's legacy HTTP transport protocol.'
/usr/local/Cellar/ruby/2.5.0/lib/ruby/2.5.0/json/common.rb:156:in parse'   /usr/local/Cellar/ruby/2.5.0/lib/ruby/2.5.0/json/common.rb:156:in parse'
/usr/local/lib/ruby/gems/2.5.0/gems/danger-5.5.9/lib/danger/request_sources/bitbucket_server_api.rb:67:in fetch_json'   /usr/local/lib/ruby/gems/2.5.0/gems/danger-5.5.9/lib/danger/request_sources/bitbucket_server_api.rb:36:in fetch_pr_json'
/usr/local/lib/ruby/gems/2.5.0/gems/danger-5.5.9/lib/danger/request_sources/bitbucket_server.rb:46:in fetch_details'   /usr/local/lib/ruby/gems/2.5.0/gems/danger-5.5.9/lib/danger/danger_core/environment_manager.rb:51:in fill_environment_vars'
/usr/local/lib/ruby/gems/2.5.0/gems/danger-5.5.9/lib/danger/danger_core/dangerfile.rb:267:in run'   /usr/local/lib/ruby/gems/2.5.0/gems/danger-5.5.9/lib/danger/danger_core/executor.rb:28:in run'
/usr/local/lib/ruby/gems/2.5.0/gems/danger-5.5.9/lib/danger/commands/runner.rb:68:in run'   /usr/local/lib/ruby/gems/2.5.0/gems/claide-1.0.2/lib/claide/command.rb:334:in run'
/usr/local/lib/ruby/gems/2.5.0/gems/danger-5.5.9/bin/danger:5:in <top (required)>'   /usr/local/bin/danger:23:in load'
/usr/local/bin/danger:23:in `<top (required)>'
Build step 'Execute shell' marked build as failure
Finished: FAILURE

See the first line of the error:

JSON::ParserError: 765: unexpected token at 'Invalid request from host <IP_ADDRESS>5: Note that Bitbucket does not support Git's legacy HTTP transport protocol.'

You mean danger is still using legacy API to talk to bitbucket server & support for new API will be provided in future versions of danger. At present I won't be able to use danger to talk to bitbucket
Correct if my understanding is wrong...

ISSUE RESOLVED
I just changed<EMAIL_ADDRESS>to DANGER_BITBUCKETSERVER_HOST="https://git.TTT.com" in above command & it worked.
Thank you very much @orta @jeroenvisser101 for you help.

Maybe you could send a PR making a warning for people with ENV Vars like that, so others don't get confused in the future?

Hi @orta
I am not sure what went wrong again. With same command which worked before now its giving error

Hi @orta @jeroenvisser101
Resolved.... The issue was with back tick.
DANGER_BITBUCKETSERVER_USERNAME=“ XXX ”
DANGER_BITBUCKETSERVER_USERNAME= " XXX "

For anyone interested, I got danger (5.8.2) working locally (for testing purposes) with Bitbucket Server as follows:
DANGER_BITBUCKETSERVER_HOST="https://your-bitbucket-server.com" \
DANGER_BITBUCKETSERVER_USERNAME="USERNAME" \
DANGER_BITBUCKETSERVER_PASSWORD="PASSWORD" \
JENKINS_URL="https://your-jenkins.com" \
<EMAIL_ADDRESS>\
CHANGE_ID=1 \
bundle exec danger

Couple of notes:

JENKINS_URL - It can technically be anything. It is just to force Jenkins behavior of Danger
GIT_URL - Address of your GIT repo (set by Jenkins by default)
CHANGE_ID - ID of the PR

Make sure your locale is UTF8 to avoid crashes
printenv LC_ALL
en_US.UTF-8

I can confirm that this also works fine testing on a for Self-Hosted GitLab environment if you use the GITLAB_ environment variables for host, base url and access token.

For anyone interested, I got danger (5.8.2) working locally (for testing purposes) with Bitbucket Server as follows:
DANGER_BITBUCKETSERVER_HOST="https://your-bitbucket-server.com" \
DANGER_BITBUCKETSERVER_USERNAME="USERNAME" \
DANGER_BITBUCKETSERVER_PASSWORD="PASSWORD" \
JENKINS_URL="https://your-jenkins.com" \
<EMAIL_ADDRESS>\
CHANGE_ID=1 \
bundle exec danger

Couple of notes:

JENKINS_URL - It can technically be anything. It is just to force Jenkins behavior of Danger
GIT_URL - Address of your GIT repo (set by Jenkins by default)
CHANGE_ID - ID of the PR

Make sure your locale is UTF-8 to avoid crashes
printenv LC_ALL
en_US.UTF-8


Cobbleworks

A machine that implements an advanced cobble gen.
Input: 2 Tanks, Lava and Water; Energy
Output: One slot each for Cobblestone, Stone, Gravel, Sand, Glass, Quite Clear Glass, Flint(?)
The output slots will always show a full stack. When the user removes items, appropriate amounts of energy are removed and the stacks re-fill instantly (or next tick?). With upgrades, additional internal (i.e. not visible in the GUI) slots are filled, so more than one stack per tick can be pulled out.
Appropriate amount is the amount generating the items from cobble using sag mill/alloy smelter would take plus a small amount for generating the cobble.
Optional: It will also use a small amount of water and lava. (1mB per Cobble or Stack of Cobble?).

[16:13]  HenryLoenwind: why not have machine slots - eg place an alloy smelter in if you want stone
[16:13]  place a sag mill in if you want sand

GUI idea: http://imgur.com/a/8yxym
it now also works as autopackager for cobbleproducts. I dropped the tanks for GUI size reasons. Water and Lava buckets should go into the recipe instead. (Or, evil(!), a tank with water and one with lava...)


Header not available in gateway after addZuulRequestHeader

I am trying to add a header in my zuulfilter class using addZuulRequestHeader("test","123") and with in the gateway (in another class) trying to retrieve the header i added previously using
@autowire HttpServeltRequest request;
request.getHeader("test")
// this gives me null but the same piece of code works fine in the microservice after the routing but not in the gateway. Autowiring HttpServletRequest gives me a current http request. So the header added using addZuulRequestHeader() is not available instantly or am i missing something? Or is it meant to be only available for downstream services?
Any help appreciated.

Can you show more? I don't know if you're missing something because I can't see anything besides a short explanation. What versions are you using? Configuration? How are you getting to the piece of code where you don't see the header? If you'd like us to spend time looking into this, please spend some time gathering details.

Thank you @spencergibb for looking into it.
Here is the filter class.
import com.netflix.zuul.ZuulFilter;
import com.netflix.zuul.context.RequestContext;
import org.apache.commons.lang3.RandomStringUtils;
import org.springframework.beans.factory.annotation.Autowired;
import org.springframework.http.HttpHeaders;
import org.springframework.security.core.context.SecurityContextHolder;
import com.sample.AppUser;
import com.sample.TokenGenerator;
import com.sample.Claims;
public class ZuulJwtPreFilter extends ZuulFilter {
@Autowired
private TokenGenerator tokenGenerator;
@Override
public String filterType() { return "pre"; }
@Override
public int filterOrder() { return 1; }

@Override
public boolean shouldFilter() {  return true; }

@Override
public Object run() {
    AppUser user = (AppUser)SecurityContextHolder.getContext().getAuthentication().getPrincipal();

    Claims claims   = new Claims(user);
    try {
        RequestContext.getCurrentContext().addZuulRequestHeader("Key","test");
        String token = tokenGenerator.getToken(claims);
        RequestContext.getCurrentContext().addZuulRequestHeader(HttpHeaders.AUTHORIZATION, token);
    } catch (Exception e) {
        //
    }
    return null;
}

Here is the class where i am having trouble retrieving the header.
import javax.servlet.http.HttpServletRequest;
@Component
public class TokenGenerator {
@Autowire
private HttpServletRequest request;
public String getToken(Claims claims) {
  String key = request.getHeader("Key");
  return claims+key; // using hashing to generate token

}
Note: TokenGenerator is in a jar and is added to my gateway as dependency (assuming that shouldn't effect me getting the request in the generator class)
Here are the dependencies
compile group: 'org.springframework.cloud', name : 'spring-cloud-starter-zuul', version: '1.3.0.RELEASE'
compile 'org.springframework.cloud:spring-cloud-starter-eureka:1.2.3.RELEASE'
compile 'javax.servlet:servlet-api:2.5'
My guess is using RequestContext.getCurrentContext().getRequest().getHeader("Key") in the TokenGenerator class might give me the value but my question is why doesn't HttpServletRequest doesn't give me the header info in gateway and gives me the header info in the micorservice after routing?
Please let me know if you need any other info.

Please learn how to properly format code and logs.
RequestContext.addZuulRequestHeader() doesn't actually change the request, it just keeps things in a local map to be used later.
You need to use RequestContext.getRequest().

This is the problem of sensitive header. zull will not send sensitive information in the header. so to overcome on that you have to add below code in your .yml file
sensitiveHeaders: Cookie,Set-Cookie
so it will not treat authorization as sensitive information
for more details please go through below link
https://www.appsdeveloperblog.com/pass-authorization-header-to-downstream-microservice/#:~:text=Configure Zuul API Gateway to Forward an Authorization Header&text=To make Zuul API Gateway allow Authorization Header to be,from the comma-delimited list.&text=or explicitly set it to the empty list.


[MoveOS] Bug when remove and add value for same table key

When publish_modules in Move, if the module exists in table, we remove old module first and then add new one which will create Op::New and Op::Delete respectively when converting table data into StateChangeSet.
But the StateChangeSet can only store only one Op for a key of a table, so one of Op above will be covered when finish the transaction. The upgrading will fail without any transaction error.

Remove + Add = Update. We need a test case to figure it out.


atuin: 18.1.0 -> 18.2.0

Description of changes

Changelog: https://github.com/atuinsh/atuin/releases/tag/v18.2.0
I did not get to my MacOS machine to test this yet, but looking at the upstream Cargo files, I do not see a reason for why the hash would be different on Darwin. I will test and verify this and then set this to ready for review.
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[x] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

The hash is probably different because of some special casing of a file.

@ofborg build atuin

Since this release fixes some annoying breaking change with nu shell I put this overlay in my flake setup until this is is live and it works great.
Just in case anybody else wants to use this, here you go:
    atuin = prev.atuin.overrideAttrs (oldAttrs: rec {
      version = "18.2.0";

      src = prev.fetchFromGitHub {
        owner = "atuinsh";
        repo = "atuin";
        rev = "v${version}";
        hash = "sha256-TTQ2XLqng7TMLnRsLDb/50yyHYuMSPZJ4H+7CEFWQQ0=";
      };

      cargoDeps = oldAttrs.cargoDeps.overrideAttrs (prev.lib.const {
        name = "atuin-${version}-vendor.tar.gz";
        inherit src;
        outputHash = "sha256-KMH19Op7uyb3Z/cjT6bdmO+JEp1o2n6rWRNYmn1+0hE=";
      });

      checkFlags = [
        # tries to make a network access
        "--skip=registration"
        # No such file or directory (os error 2)
        "--skip=sync"
        # PermissionDenied (Operation not permitted)
        "--skip=change_password"
        "--skip=multi_user_test"
        # Tries to touch files
        "--skip=build_aliases"
      ];
    });


Add UniquelyIdentified interface

This PR adds a simple interface to get a UUID from a given object which is uniquely identified by the said UUID.

Why not #getUuid? Feels a bit like method duplication

I would also say getUuid or getUniqueId would be better.


OpenDataCam on Mobile (iOS / Android)

cc @b-g @mmmmmmmmmmmmmmmm
Since we were talking about one of the potential future milestone would be running opendatacam directly on mobile devices, I though I would share this app (someone retweeted it in my feed):  https://itunes.apple.com/us/app/idetection/id1452689527
It is running the full YOLOv3 SPP weights and claims 13 FPS on latest iPhones (XS I think) .
On my iPhone SE it just runs at 2 FPS but I guess Tiny YOLO would already run at a good enough... So I think the performances are already there to do it
Their work is opensource: https://github.com/ultralytics/yolov3   , the "challenge" is to port YOLO on CoreML, the APIs for machine learning in iOS.
They have also a nice transfer style app: https://itunes.apple.com/app/id1445737240

Just a quick update on this one, seems that it would be now possible to run YOLO easily from recent iOS devices, the app I mentionned a year ago is still getting updated to get an idea of the performance you can get: https://apps.apple.com/us/app/idetection/id1452689527   .. Seems you can run full yolo (not tiny) at 30 fps + on latest iPhone 11+ .. I have an old iPhone SE still so I can't really test hehe
And how to use YOLO from iOS is even documented in the official apple developer docs: https://developer.apple.com/machine-learning/models/ , sure there is plenty of example in github on how to use this.
Maybe and idea for OpenDataCam could be to release an "OpenDataCam" app which would work on latest iPhone devices 😁..  cc @b-g @mmmmmmmmmmmmmmmm

Their YOLO tiny (https://apps.apple.com/us/app/idetection/id1452689527) runs at 9-10 fps even on my iPhone SE.. impressive

Hi, awesome project !
I was wondering if you've explored the possibility of running opendatacam on a relatively modern Android phone.
I was worried about performance, but I tried this app, which looks like a simple tenser flow mobile template app (there are similar apps with a different name on the store) and it looks like it could run fast enough to monitor trafic on my S10e Exynos 9820 (released in 2019). Sorry, I'm confined, and no window directed to a road 😄 ). It runs the above app's inference on my hand moving at ~10FPS
Why Android phones ? The idea came from the fact that I have a S8 at the bottom of a drawer, with a half-broken screen, rough to the fingers but fully working. ~8FPS.
Android phones are probably the most common integrated processing units (chip + wifi + screen + good camera) one can find at home and in enterprise fleets.

Hi @laem !
Many thanks for the input, just renamed this issue to "on Mobile", so people know we don't have any preference regarding iOS / Android..  Historically iOS was a bit ahead of the game regarding Deep Learning stuff on mobile.
Indeed https://play.google.com/store/apps/details?id=hash.tf.objectdetection&hl=ln seems to be running at 13-15 FPS on my Xiaomi mi 8... So it is also promising, I guess it is running YOLO under the hood also, but don't know which weights. Also couldn't find if the implementation if published somewhere.
Building a proof of concept of OpenDataCam on Mobile is becoming very tempting ;-) , I would definitely be a big step towards accessibility and ease of use of the project.
Please share any further findings !

This 1 year old blog poste could be interesting https://blog.francium.tech/real-time-object-detection-on-mobile-with-flutter-tensorflow-lite-and-yolo-android-part-a0042c9b62c6
This could be the source of those Play Store apps : https://github.com/szaza/android-yolo-v2

Hi @laem , OpenDataCam on mobile is happening 🙌 , please see: https://github.com/opendatacam/opendatacam/issues/365

Hi @laem , OpenDataCam on mobile is happening 🙌 , please see: https://github.com/opendatacam/opendatacam/issues/365


Issues with Google Drive through Google Drive FS

Explain the bug
App crashes. First, I had it crash when chaning the layout mode on a Google Drive folder. Later, navigation to a Google Drive folder would leave the content pane empty and crash after a few seconds.
To reproduce

Go to Google Drive Folder
App Crash

Logfile
debug.txt <-- contains relevant inforation
debug_fulltrust.txt
Screenshots

System Information

Files v1.5, Windows 20H2

Additional comment
Does happen after restarting. I use GoogleDriveFS which is technically an enterprise software that also runs on regular accounts. It creates a virtual Drive G: that contains the Files. It uses FileStream so only used or selected files are permanently saved, the others are streamed if required.

Resetting the app solved the app crashes, wouldn't expect to need to do this on every major update.

Same behaviour again, a day later. Guess reinstalling the app was only a very temporary fix.

This is fixed on main.


Cannot read property 'index' of undefined.

Getting this error when list item height dynamically changes and scroll down is performed.
Error:

Reproduced issue:
https://codesandbox.io/s/j30zmly425
Line that causes failure (anchor is undefined):
https://github.com/huangbinjie/react-scroll/blob/master/src/projector.ts#L105
Could you take a look?

When planned to release next package version?

I released the dynamic height version 2.0.0-alpha right now.
This is the online demo: https://codesandbox.io/s/k5jz9yl5lr

I tried to use 2.0.0-alpha. I ran into another error:

Reproduced issue:
https://codesandbox.io/s/kkr1k1w7lv
Steps to reproduce:

Click on dropdown header with text CLICK ME TO COLLAPSE!;
Scroll to the bottom of the list.

@DeividasBakanas bug fixed in 2.0.2-alpha. Please note that measure will trigger automatically in 2.x version and i had dropped the measure method in onRenderCell.


Enhancement  Request

Hi
first I'd like to thank you for this awesome plugin, it's about exactly what I was looking for. But I have one issue. I'm using vue with webpack and I want to use this as a global plugin to all the components, so that each component has it's own local data and info and if there is something which is used globally I put it in the main.js or the plugin folder itself. but I'm struggling with it. I don't know how to achieve it.
this is what I'm trying to do:
import { createApp } from 'vue'
import App from './App.vue'
import router from './router'
import store from './store'
import vI18n from 'vue-simple-i18n'

createApp(App)
    .use(store)
    .use(router)
    .use(vI18n)
    .mount('#app')

but it seems that the library doesn't support it.
I can import it in each component and define the content like this
const i18n = new vI18n({
  base: 'en-us', // The base fallback when specified language not exists, defaults to 'en-us'
  locale: 'zh-cn', // Global language, defaults to browser language
  locales: {
    'en-us': {
      __name__: 'English', // Specify a display name for each language is highly recommended
      welcome: 'Welcome {{name}} to the Wonderland!' // Translation, default template supported is vue-like without expressions
    },
    'zh-cn': {
      __name__: '简体中文',
      welcome: '{{name}}，欢迎来到幻境！'
    }
  } // Where you put all your translations
})

computed: {
    ...i18n.map(['welcome']) // Map the translation!
  }

But there must be some other ways. moving the base and locale to the main.js and in the data define the locals
so that the component becomes like this:

export default{
  data(){
     return(){
         locales:{
            'en-us':{welcome: 'Welcome {{name}} to the Wonderland!'},
            'zh-cn':{welcome: '{{name}}，欢迎来到幻境！'}
        }
    }
  }
}

that would be awesome  :)

First of all thank you for paying attention to this plugin, but I'm sorry
that this plugin is not supposed to work the way you intended it to be.
For some reason I'm no longer a fan of Vue.js and will no longer contribute
to Vue.js development. You could scratch your own itch by writing a wrapper
for it. You may refer to this document for creating your own plugin:
https://vuejs.org/v2/guide/plugins.html#Writing-a-Plugin
I've created a totally different flavoured front-end framework
https://github.com/TheNeuronProject/ef.js , which you could take a look if
you're interested in something simple and timeless.
On Sun, Apr 11, 2021, 03:11 v-dale @.***> wrote:

Hi
first I'd like to thank you for this awesome plugin, it's about exactly
what I was looking for. But I have one issue. I'm using vue with webpack
and I want to use this as a global plugin to all the components, so that
each component has it's own local data and info and if there is something
which is used globally I put it in the main.js or the plugin folder itself.
but I'm struggling with it. I don't know how to achieve it.
this is what I'm trying to do:
import { createApp } from 'vue'
import App from './App.vue'
import router from './router'
import store from './store'
import vI18n from 'vue-simple-i18n'
createApp(App)
.use(store)

.use(router)

.use(vI18n)

.mount('#app')

but it seems that the library doesn't support it.
I can import it in each component and define the content like this
const i18n = new vI18n({
base: 'en-us', // The base fallback when specified language not exists, defaults to 'en-us'
locale: 'zh-cn', // Global language, defaults to browser language
locales: {
'en-us': {

  __name__: 'English', // Specify a display name for each language is highly recommended

  welcome: 'Welcome {{name}} to the Wonderland!' // Translation, default template supported is vue-like without expressions

},

'zh-cn': {

  __name__: '简体中文',

  welcome: '{{name}}，欢迎来到幻境！'

}

} // Where you put all your translations
})
computed: {
...i18n.map(['welcome']) // Map the translation!

}
But there must be some other ways. moving the base and locale to the
main.js and in the data define the locals
so that the component becomes like this:
export default{
data(){
 return(){

     locales:{

        'en-us':{welcome: 'Welcome {{name}} to the Wonderland!'},

        'zh-cn':{welcome: '{{name}}，欢迎来到幻境！'}

    }

}

}
}
that would be awesome :)
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/ClassicOldSong/vue-simple-i18n/issues/2, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/ACQGQJXX22NPTXSEUCKQJSTTICPGTANCNFSM42WZWJCA
.

Thanks for your reply
It's amazing, you have created your own framework. wish you all the best 🙏🏼


portal-nether error

If the player builds and walks in, he will not be able to move at all
[worlds.sky-overworld.portal-nether]
enabled = false

Why can try this version : https://github.com/Euphillya/Skyllia/actions/runs/9205212246

Wait for the compatible menu plug-in, and then I will test

qwq

I'm fixed on last releases


(maint) Return 24 when revoking or cleaning unsigned CSRs

I don't know, seems like a weird behavior to keep.

ping @Magisus


documentation about installation and usage of pyjulia issue#18

why The Travis CI build failed?

Not sure why, but I also had a [trivial, non-code] fix stalled because of CI. I think for my own and your commit, adding "[skip ci]" to the title should have worked. Not sure, if "[ci skip]" was my problem (or that title must start with):
https://github.com/travis-ci/travis-ci/issues/911
or that you can't add it after the initial pull.

Needs rebase.


Yextend error.

I am preparing my machine for malware analysis and I am getting this error at make:
make  all-am
make[1]: Entering directory /home/cuckoo/yextend-1.2' g++ -DHAVE_CONFIG_H -I.   -I.  -g -O2 -MT bayshore_content_scan.o -MD -MP -MF .deps/bayshore_content_scan.Tpo -c -o bayshore_content_scan.o bayshore_content_scan.cpp bayshore_content_scan.cpp: In function ‘void scan_office_open_xml_api(void*, std::list<security_scan_results_t>*, const char*, const char*, bool, void (*)(void*, std::list<security_scan_results_t>*, const char*), int)’: bayshore_content_scan.cpp:303:61: error: cannot convert ‘off_t* {aka long int*}’ to ‘int64_t* {aka long long int*}’ for argument ‘4’ to ‘int archive_read_data_block(archive*, const void**, size_t*, int64_t*)’         x = archive_read_data_block(a, &buff, &lsize, &offset);                                                              ^ bayshore_content_scan.cpp: In function ‘void scan_content2(const uint8_t*, size_t, YR_RULES*, std::list<security_scan_results_t>*, const char*, void (*)(void*, std::list<security_scan_results_t>*, const char*), int)’: bayshore_content_scan.cpp:749:62: error: cannot convert ‘off_t* {aka long int*}’ to ‘int64_t* {aka long long int*}’ for argument ‘4’ to ‘int archive_read_data_block(archive*, const void**, size_t*, int64_t*)’          x = archive_read_data_block(a, &buff, &lsize, &offset);                                                               ^ make[1]: *** [bayshore_content_scan.o] Error 1 make[1]: Leaving directory /home/cuckoo/yextend-1.2'
make: *** [all] Error 2
any help?
thank you

What OS (and bitness) are you running on?

My OS is debian Mint 17.1 and the bitness is 64. Thank you.

Hi! Any help regarding this yet?

I have set up a VM matching your environment. I went through the process of setting up Yara and yextend and I was unable to replicate your error.


Update sources

:robot_face: Updating sources to the latest version.
New commits on tezos/tezos Trunk

SCORU/Node: Don't overwrite configuration file
Test: ensure configuration only overwritten with --force
SCORU/Node: Backport !8154 to mumbai rollup node
Merge tezos/tezos!8154: SCORU/Node: Don't overwrite configuration file
Gossipsub: expose Internal_for_tests in Message_cache
Gossipsub/test: allow to set time in helpers
Gossipsub/test: refactor fragment generator
Gossipsub/test: strengthen remove_peer pbt
Gossipsub/test: cleanup pbt test
Gossipsub/test: check iwant/ihave_per_heartbeat emptyness
Gossipsub/test: deactivate scenario shrinking by default
Gossipsub: fix bug in hearbeat cleanup
Gossipsub/test: reduce number of pbt samples
Merge tezos/tezos!8246: Gossipsub: strengthen PBT, fix bug in hearbeat
Test/p2p: avoid port reuse in [gen_points]
Merge tezos/tezos!8317: Test/p2p: avoid port reuse in [gen_points]
proto: remove toru service
plugin: remove tx_rollup rpc
changes: add line for removing toru rpc
Merge tezos/tezos!8167: proto: remove toru service
proto/soru: mig message at first block of protocol
proto/soru: restore ordering of internal msg
soru/test: fix inbox test with new migration logic
Merge tezos/tezos!8300: proto/soru: Add protocol migration to first block of protocol
p2p: Fix swap mechanism
P2p: Fix the maintainance triggering on new connections
tezt/p2p: Add a test of swap mechanism
p2p: Refactor using result monadic chain
P2p: Add comments and TODOs
p2p: Clarify error handling semantics in swap request processing
P2p: Add TODO
P2p: Use Result.fold
P2p: Add notes
P2p: Use Fun.id
Merge tezos/tezos!7787: p2p: Fix swap mechanism
Snoop: add generated_code_destination in shell_benchmarks
Snoop: add generated_code_destination in lib_benchmark_proto
Snoop: add generated_code_destination to Benchmark.S in lib_benchmark
Snoop: display generated_code_destination on the cli
Snoop: add generated_code_destination for proto/Mumbai benches
Snoop: add generated_code_destination for proto/Lima benches
Merge tezos/tezos!8212: Snoop: add generated code destination to Benchmark.S
Snoop: move lib_benchmark_proto/cache to new registration
Merge tezos/tezos!8265: Snoop: move lib_benchmark_proto/cache to new registration
Protocol: Nairobi
Build: Link Nairobi
Update .ocamlformat files
Fix OCaml formatting
Backport !7751 - SCORU/Node: use local information to compute reorganizations
Test: Add Nairobi to Tezt tests
Test: Add encoding samples for Nairobi
Test: Reset regression tests for Nairobi
Docs: Configure doc generator
Docs: RPC for Nairobi
Docs: Add Nairobi to TOC entries
Docs: Incorporate Nairobi
WASM: Introduce new internal message for Nairobi activation
Partially Revert "Merge tezos/tezos!8143: Proto: remove fold_right from environment"
ProtoEnv: Replace fold_right_es implemention in V9
Docs: Make sure Nairobi procotols are named as such
Backport !8138 - Scoru: preparatory steps for in-memory durable replacement
Backport !7854 - SCORU/Node: unit tests infrastructure/helpers for the rollup node
Backport !8237 - Tezt is faster to initialize
Backport !7932 - Move cryptography packages
Backport !8067 - Snoop: add benchmark filenames when displaying info about benchmark in the CLI
Backport !8164 - Improve quality of Pages_encoding module
Backport !8212 - Snoop: add generated code destination to Benchmark.S
Merge tezos/tezos!8214: Nairobi Initial Snapshot
Snoop: move lib_benchmark_proto/apply to new registration
Merge tezos/tezos!8264: Snoop: move lib_benchmark_proto/apply to new registration
EVM/Kernel: don't ignore [read_input] error
EVM/Kernel: move transactions' collect in [inbox]
Merge tezos/tezos!8298: EVM/Kernel: don't ignore [read_input] error
WASM/Debugger: support U16
Merge tezos/tezos!8303: WASM/Debugger: support U16
Scoru,Proto: forbid double publish
Merge tezos/tezos!8269: Scoru,Proto: forbid double publish
DAL/GS: refactoring. introduce a full_message type in the worker
DAL/GS: make p2p_input and app_input explicit, with dedicated types
DAL/GS: app_input, rework the interface with the application layer
DAL/GS: p2p_input, rework the interface with the p2p layer
DAL/GS: introduce the app_output type
DAL/GS: introduce the p2p_output type
DAL/GS: more explicit fields names for peer in In and Out P2P messages
Merge tezos/tezos!8312: DAL/GS: define p2p and app input and output types
DAL/GS: add two output streams for p2p and application layers
DAL/GS: add function 'has_joined' in the automata's introspection
DAL/GS: handle the automata's output for app messages
DAL/GS: handle the automata's output for p2p full messages
 DAL/GS: improvemements for readability
DAL/GS: introduce function 'message_is_from_network'
DAL/GS: use better names for functions given as arguments
Merge tezos/tezos!8321: DAL/GS: handle the automaton's output for full messages
Test/SCORU/Node: clean node directories after run
Test/SCORU/Node: add protocol name in test files
Merge tezos/tezos!8338: Tests/SCORU: fix a flaky rollup node unit test
Proto/Frozen_deposits_storage: convert to Lwt_result_syntax
Proto/Frozen_deposits_storage: zero
Proto/Frozen_deposits_storage: get defaults to zero
Proto/Frozen_deposits_storage: use add rather than update
Proto/Frozen_deposits_storage: remove allocated
Proto/Token: no need to check whether frozen deposits are allocated
Proto/Frozen_deposits_storage: remove find (use get instead)
Proto/Frozen_deposits_storage: remove init (now useless)
Proto: move Frozen_deposits_storage after Stake_storage
Proto/Token: remove Delegate_balance container
Proto/Contract_storage: remove now dead functions
Merge tezos/tezos!7781: Proto/Token: remove Delegate_balance container
Templates: fix input file path
Merge tezos/tezos!8345: Templates: fix input file path
Kernel SDK: fix debug_msg to work when re-exported
Kernel SDK: fix kernel_entry to work when re-exported
Kernel SDK: impl Error for RuntimeError
Kernel SDK: remove unused paths & cleanup metadata errors
kernel SDK: add top-level crate
Merge tezos/tezos!8293: kernel SDK: add top-level crate
DAL/GS: refactor pattern position in apply_event
DAL/GS: refactor apply_event: add apply_app_event
DAL/GS: refactor apply_event: add apply_p2p_event
DAL/GS: refactor apply_p2p_event: add apply_p2p_message
Merge tezos/tezos!8323: DAL/GS: refactor the worker's apply_event function
Tx_kernel/Tezt: fix flakiness
Merge tezos/tezos!8327: Tx_kernel/Tezt: fix flakiness
Snoop: Add memory allocation benchmark
Snoop: Implement memory allocation benchmarks for interpreter
Merge tezos/tezos!7713: Add memory allocation benchmark
SCORU/Node: use minimal indexing strategy for irmin context
Merge tezos/tezos!8252: SCORU/Node: use minimal indexing strategy for irmin context

Diff URL: https://gitlab.com/tezos/tezos/-/compare/b3551d0a978077f50190990b6c79181841103e46...7695d76be253da9d81de6555f998c7981083d3d3

Fixes #74


STATUS column is not mentioned in the documentation;

From https://github.com/moby/moby/issues/35740
I request docker swarm need start node command .  But it seems I misunderstand STATUS column which is not mentioned in the documentation;
Please provide a method to indicate how to get Down node back (The Down nodes are actually running, just status is Down )
File: engine/swarm/manage-nodes.md, CC @mistyhacks

Closing this ticket due to its age, and the impending refactor. If you think this is in error, feel free to reopen. Thanks!


JIT behaves surprisingly with PyTrees as static arguments

If you create a custom pytree and pass it as a static argument to a JIT-compiled function, it will be treated as static based on the hash of the wrapper class, meaning that changes to underlying data do not lead to recompilation. For example:
import jax.numpy as jnp
from jax import jit
from jax.tree_util import register_pytree_node

class MyClass:
  def __init__(self, data):
    self.data = data

register_pytree_node(MyClass,
  lambda v: ((v.data,), None),
  lambda _, data: MyClass(*data))

m = MyClass(jnp.arange(4))

get_data = lambda x: x.data
jit_get_data = jit(get_data, static_argnums=0)

print(get_data(m))
# [0 1 2 3]
print(jit_get_data(m))
# [0 1 2 3]

m.data += 1
print(get_data(m))
# [1 2 3 4]
print(jit_get_data(m))  # <-- does not trigger a cache miss in the JIT, despite different data!
# [0 1 2 3]

This seems like a potential foot-gun for the use of PyTrees which we should protect against. A better behavior in this case would probably be to raise an error if a PyTree is passed as a static argument, as it's likely a sign of a user mistake.
Alternatively, for a less heavy solution we could recommend in https://jax.readthedocs.io/en/latest/pytrees.html#extending-pytrees that users explicitly set __hash__ = None for pytrees.

Just commenting to say that I use (custom) PyTrees as static arguments very extensively, so FWIW -1 from me on making that an error.
Personally I just add the following as a method to all such custom PyTrees:
def __hash__(self):
    return hash(tuple(jax.tree_leaves(self)))

After discussing with teammates offline, it's not clear there's anything we can do here that would be less surprising than the current behavior; for what it's worth this is documented under jit's static_argnums parameter:

Static arguments should be hashable, meaning both hash and eq are implemented, and immutable.

I think the main action item would be to add some discussion of this (and perhaps @patrick-kidger's solution) at https://jax.readthedocs.io/en/latest/pytrees.html#extending-pytrees

I think the dangerous thing in the example in the OP is mutating an object via m.data += 1. That's not specific to custom pytrees, or even static arguments; here's an example mutating a closed-over list:
import jax

lst = [1]
f = jax.jit(lambda: lst[0])

print(f())  # prints 1
lst[0] = 9999
print(f())  # still prints 1


Iron release ?

Any blocking point ?

For those who might look into this in the future, I pushed a Python package that can be used in iron but installed through the pip package manager: pip install ament-black And then, the rest is story.
Code is in my fork with improved dependency managment


Max Volume Limits

WHen trying to set the MAX DAY VOLUME or MAX NIGHT VOLUME limits, it only works for whole numbers from 1-16. It does not allow you to set as 0, though the player allows this to essentially mute the player. Can you please add the ability set the two MAX VOLUME settings to 0?

Good find!  I have a good idea of how to fix this.  I'll post back once solved.

1.20.2 should fix this.  I will rest when my kid isn't using it.

Tests out for me.  Let me know if works for you!

Works for me, too! Thanks!


iOS app showing duplicate sent messages

Saw this earlier today and had a screenshot, although doesn't seem to be doing it tonight. When sending messages, I would see two of my message going into the chat stream, with one being lighter gray.
When I would leave convos and re-enter, they would still appear, though would usually aggregate toward the bottom of the chat after re-loading the convo. They would stay in their original place in the chat stream.

Android is also doing this, on a Google Pixel running Android 7.1.

Cc: @chrisnojima

Thanks we're looking into this. The grey text is in a 'pending' state so the system thinks its not yet sent


[SUPPORT] What is Hudi?

Describe the problem you faced
Sharvil posted: What is hudi?
Additional context

Creator: Sharvil
Source Channel: triage-test-2
Status: Unresolved
Assignee: Unassigned
Created: 6/11/2024 8:15 PM
Last Updated: 6/11/2024 8:15 PM :torvalds: Ask torvalds button Create Ticket :ticket: button

okay check bfiosfb.com

ok


PR: Fix Classification Issues

This PR fixes various classification issues introduced by the latest aces-dev code.

Also merging this one, the tests are likely broken for the same reasons than #116.


Create 4README.md

To personalised

Need to link with-https://www.dropbox.com/download?dl=packages/dropbox.py

Saved it to folder file:///mnt/sdcard0 [https://www.dropbox.com/download?dl=packages/dropbox.py] Settings/Settings


Hook Scorecard as a CI/CD solution, prevent bad deps from being added in code

Great idea!
I think we'd have to create a separate hook per language-package-manager that can parse out the dependency files and then call the scorecard tool.
It's probably going to be easier to do those hooks in whatever language we're handling.
Do we need a separate repo for each of those, or just one to hold them all?

Great idea!
I think we'd have to create a separate hook per language-package-manager that can parse out the dependency files and then call the scorecard tool.
It's probably going to be easier to do those hooks in whatever language we're handling.
Do we need a separate repo for each of those, or just one to hold them all?

Probably one to hold them all.
By default, we run all the hooks in the CI run. If it does not find package lock file for a particular pkg manager, it bails out. Different hooks can be different jobs in the CI run.

we need to make atleast one check run in cicd pipeline.

I think I'd like to start work on this issue. Here are some of my thoughts:

Snyk has multiple open source projects that parse dependency files. They are all written for node.js, so if we are willing to have a dependency on Node, we could support many languages without a great deal of work. Here's a partial list of dependency parsers:

node.js
.NET
Go
Maven

I would think most users would want to specify a minimum score necessary for dependencies. If so, this issue would be dependent on !346.
I think users would also want a way to specify certain dependencies that can be allowed to be below the minimum score. This would be useful in an existing project where the goal would be to not add new dependencies below the minimum score.
Users might also want to specify certain checks that must pass, e.g. enforcing that "Active" has a score of 10.
Users can include a yaml file to specify options mentioned in previous bullets.

Thoughts on these points?

I do like the idea of a pluggable architecture. I think it would be good for our project to compile in parsers for at least the popular dependency files. That way the user can download a single binary, and it will work out of the box. We can then have an option for the user to configure their own parser.
I cloned one of the Snyk repos I mentioned, and I don't think that will be useful here. They are interested in constructing a graph of all dependencies which is not exactly useful to us.
I did find another project that looks more promising: https://github.com/aquasecurity/go-dep-parser. This can parse dependencies for go.mod, npm, pipenv, composer, and more. Since it's written in Go, we could could easily incorporate it. There are some dependency files that include include the git repo such as composer.lock. For these ones, we might want to write our own parser so it can read the repo directly and not have to look it up with a web call.

Let's discuss this in our upcoming bi-weekly.

did we forget to discuss this in the last meeting?
btw, there's also deps.dev which offers a REST API and would do all the heavy lifting for us.

did we forget to discuss this in the last meeting?

I saw it wasn't on the agenda, but I didn't bring it up because I'll be working on another issue first. Plus I'll be pretty busy the next few weeks getting our house ready to list.

btw, there's also Google's deps.dev which offers a REST API and would do all the heavy lifting for us.

I'll definitely give that look!

Is this something that still needs to be discussed or can it be closed until it comes up again?

Going to point to https://github.com/ossf/scorecard-action/issues/1070, as that seems to be relevant discussion. This can be re-opened here as needed.


Add support for resursive searching of sub-fields

This allows sub-fields to be converted recursively. Given the potential for this to be really slow, it's recommended to only use it when specifying specific fields to search.
Fixes #7
This fixes the merge conflicts of the original pull request https://github.com/logstash-plugins/logstash-filter-de_dot/pull/13

If someone has a proper Logstash development environment, could they please confirm this passes the unit tests. I have only attempted to resolve all the merge conflicts and this work is untested.

This is now failing on the Logstash master branch. This is unrelated to the change, so any advice would be appreciated.
/cc @ph @untergeek @robbavey


Spevacus: Watch indianacademics.com

Spevacus requests the watch of the watch_keyword indianacademics\.com. See the MS search here and the Stack Exchange search in text, in URLs, and in code.

indianacademics\.com has been seen in 1 true positive, 0 false positives, and 0 NAAs.

Approved by NobodyNada in Charcoal HQ


type: "commonjs" and browser ESM exports with ".js"

Bug report

What is the current behavior?
Hi,
Per https://github.com/webpack/webpack/issues/11597#issuecomment-705114717 and https://github.com/JSONPath-Plus/JSONPath/issues/145 , a couple of projects have run into issues where type: 'commonjs' is used and webpack is using this fact to insist that all .js exports must therefore be CommonJS and complaining when an ES module is encountered.
If the current behavior is a bug, please provide the steps to reproduce.

Add a package.json with "type": "commonjs".
Add exports with a browser pointing to .js, e.g.:

    ".": {
      "browser": "./dist/index-browser-esm.js",
      "umd": "./dist/index-browser-umd.js",
      "import": "./dist/index-node-esm.mjs",
      "require": "./dist/index-node-cjs.js",
      "default": "./dist/index-browser-esm.js"
    }

....where ./dist/index-browser-esm.js uses an ESM import and/or export.

See the message:

ERROR in ./node_modules/jsonpath-plus/dist/index-browser-esm.js 1061:0
Module parse failed: 'import' and 'export' may appear only with 'sourceType: module' (1061:0)

What is the expected behavior?
In my understanding of the type property per the Node docs, that property is specified for the sake of Node. A browser or other build should not need to be similarly constrained, and indeed:

I would expect more browser builds using package.json (esp. within exports since it has been around) are exposing standard ESM.
I understand some browser versions which support modules nevertheless do not automatically treat ".mjs" as JavaScript when a content-type header is absent, causing problems for downstream users. Besides the possible inconvenience of a project being forced to switch to "type: 'module'" to work around this, it seems some testing frameworks like mocha do not support native ESM testing, so this would force such projects to write their tests without using ESM.

In my humble opinion (and as someone who is not a regular user but is impacted by such users), Webpack should either allow its users configuration to choose the exports one desires, expect a specific umd type if wishing to allow users to specify other non-ESM browser builds, or just assume ESM for the browser by default.
Thank you.

Other relevant information:
webpack version:
Node.js version:
Operating System:
Additional tools:

"type": "commonjs" and exports are completely unrelated properties, you can use and commonjs and esm and node and deno and etc exports

In my humble opinion (and as someone who is not a regular user but is impacted by such users), Webpack should either allow its users configuration to choose the exports one desires, expect a specific umd type if wishing to allow users to specify other non-ESM browser builds, or just assume ESM for the browser by default.

You can use conditionNames for setup it https://github.com/webpack/webpack/blob/master/lib/config/defaults.js#L978

And adding exports (i.e. https://github.com/JSONPath-Plus/JSONPath/pull/146) is breaking change and should use major release

Yes, thank you for the reference to conditionNames, and I would think that should allow proper selection (if it is not the default behavior and webpack is somehow otherwise informed it is a browser app). (We've already released with exports, so I don't think it is a breaking change, even if we change the file names to which we point since to Node, I believe exports causes the resolution to be opaque. It was breaking when we added exports because that prevents access to other files, but this shouldn't do that since we are not restricting file access.
However, the issue seems to be that although webpack is finding the right browser-based file through exports, the user is being informed (when adding the type: commonjs), that the use of ESM within the pointed-to browser file was problematic. Why would the user be getting such an error if not for type: commonjs?

I think this is working as expected. If you are using type: "commonjs" you are basically opting in into .js and .cjs being CommonJS and .mjs being ESM. This is unrelated from the conditions used for exports and I don't think there should be explict exceptions here.
Note that you don't have to opt-in into type: "commonjs". You can just omit the property and webpack will auto-detect which file-format it should use for .js.
Note that you can also choose the type per directory by placing e. g. a package.json with { type: "module" } in dist/browser.

But this was all meant for Node. Node is just making space for exports to be leveraged for other purposes, none of which are obliged to abide by conventions meant for it (browsers of course don't even understand CommonJS in a native way).
I can work around by avoiding opting in with type: commonjs for the sake of our users, but if you are going by Node conventions, having it present is supposed to have the same meaning as not having it at all. And it is called for not only as a best practice to be more explicit, but Node even raises the possibility that the default behavior could be switched in the future, meaning you are possibly encouraging projects to do something which causes future Node breakage.
I think others are going to keep discovering and being dismayed by this problem as module use increases, especially since it is tool-specific rather than something Node spelled out. You all admittedly are the ones making the tools, so I guess it is also whatever you want it to mean too. :-) However, I'm not so sure that is very good for the ecosystem. (The nested browser folder is at least a standard workaround, albeit a bit clumsy and perhaps prone to some confusion.)
Anyways, you guys are doing the hard work of maintaining this, so I'll leave it at that. Appreciate the investigation of the issue, and suggestions. Take care!

I can work around by avoiding opting in with type: commonjs for the sake of our users, but if you are going by Node conventions, having it present is supposed to have the same meaning as not having it at all. And it is called for not only as a best practice to be more explicit, but Node even raises the possibility that the default behavior could be switched in the future, meaning you are possibly encouraging projects to do something which causes future Node breakage.

I don't think it will ever change, it's huge breaking change and breaks many things, but anything can happen someday...

Ok, will close then if that's the plan. Thanks!