MPEG, MPEG-TS, MPEG-PS Support

I am trying to be able to pick out frames (video and metadata) from MPEG, MPEG-TS and MPEG-PS files and streams (network / UDP / RTP streams). I was looking into using JCODEC to do this and I started off by trying to use the FrameGrab / FrameGrab8Bit classes, and ran into an error that those files are "temporarily unsupported". I looked into going back some commits to see if I could just use older code, but it looks like both of those files have had those formats "temporarily unsupported" since 2103 / 2015, respectively.
Are any of those formats supported somewhere in the library and I am just using the wrong interface? Or do I have to go and hook things together to be able to get video and metadata out of the files & streams?
I saw issue #27 and I was not sure if that is related. If it is, is there any update on the progress? For example files, I am testing with sample files available from FFMPEG (http://samples.ffmpeg.org/MPEG2/mpegts-klv/).
I have started trying to plug things back in, in the FrameGrab8Bit class by putting in the following code, but I run into a packet header assertion failure in the MTSDemuxer.java file (information below code)
---FrameGrab8Bit additional code---
public static FrameGrab8Bit createFrameGrab8Bit(SeekableByteChannel _in) throws IOException, JCodecException {
...
case MPEG_PS:
MPSDemuxer psd = new MPSDemuxer(in);
List tracks = psd.getVideoTracks();
videoTrack = (SeekableDemuxerTrack)tracks.get(0);
//            throw new UnsupportedFormatException("MPEG PS is temporarily unsupported.");
break;
case MPEG_TS:
MTSDemuxer tsd = new MTSDemuxer(in);
MPSDemuxer ptsd = new MPSDemuxer(tsd.getProgram(0));
List tstracks = ptsd.getVideoTracks();
videoTrack = (SeekableDemuxerTrack)tstracks.get(0);
//            throw new UnsupportedFormatException("MPEG TS is temporarily unsupported.");
break;
...
---End FrameGrab8Bit additional code---
---MTSDemuxer.java Assertion failure---
public static MTSPacket parsePacket(ByteBuffer buffer) {
int marker = buffer.get() & 0xff;
int marker = by & 0xff;
Assert.assertEquals(0x47, marker);
...
---End MTSDemuxer.java Assertion failure---

Also, where would one go to get the metadata out of those files? Is there something that would be able to get me both the metadata AND the image frame all in one? Or do I have to use two separate classes?

Has anyone taken a look at this? @svitvitskiy, is this the same problem discussed in #27?

you are very welcome to submit a pull request for the feature

@zhuker When you say to submit a pull request, do you mean just a blank request for the feature? Or to implement the feature and then submit the request?
If you mean the former, do you know when about when that feature would be implemented? And if you mean the later, would you know a rough outline of what all would need to be done? I have been going through the code, and it seems like (at a minimum) the MTSDemuxer class would need to be recoded to be built off of the SeekableDemuxerTrack class. Is this correct?
And just to confirm, in either case, this does mean that the MPEG-TS demuxing is NOT currently fully implemented in the code?
Thanks,
Aero

Yeah, MPEG TS is not supported to the extent MP4 is.
You can't really seek in TS streams (unless you index the entire stream
before hand). So it doesn't look like there's much sense to implement TS
demuxer on top of SeekableDemuxerTrack.
We haven't given much attention to TS demuxer actually, so any input is
very welcome.
Re PR - jcodec is a non profit project done on spare time of mostly
@svitvitskiy and less so myself, so please submit a PR with code :)
Cheers
On Tue, Apr 18, 2017, 21:17 AeroBuffalo<EMAIL_ADDRESS>wrote:

@zhuker https://github.com/zhuker When you say to submit a pull
request, do you mean just a blank request for the feature? Or to implement
the feature and then submit the request?
If you mean the former, do you know when about when that feature would be
implemented? And if you mean the later, would you know a rough outline of
what all would need to be done? I have been going through the code, and it
seems like (at a minimum) the MTSDemuxer class would need to be recoded to
be built off of the SeekableDemuxerTrack class. Is this correct?
And just to confirm, in either case, this does mean that the MPEG-TS
demuxing is NOT currently fully implemented in the code?
Thanks,
Aero
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/jcodec/jcodec/issues/181#issuecomment-295077299, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AEKlQrR16aAYpecgegCtN76r4Ygjk-qeks5rxYrigaJpZM4M82WX
.

@AeroBuffalo, yes MPEG TS is supported but not in the FrameGrab line of interfaces. You can use MPEGTS with Transcoder and TranscoderMain. These classes implement a generic transcoder between the input and output formats. Ideally I would like to then implement the FrameGrab and SequenceEncoder family of interfaces through Transcoder internally. This can be done by using a specialized source or sink in the transcoder (I am not even sure if source and sink abstractions have made it into Transcoder yet :) ).
 Yes, in real life you usually get MPEG TS with what you might think is one stream (through it might not be the case when you dive into details) however in broadcast one TS stream can carry up to 27 Mbit/s worth of data (which can be multiple independent TV channels depending on the actual compression and video resolution). So while I agree that for the average user the MTS interface has to be simplified I can't quite imagine how because the complexity of the interface is caused by the complexity of the format itself. One idea I have is to just create a facade demuxer called MTSSimpleDemuxer that will just assume a file with one program and will try to figure out it's streams as best as it can. Let me know if you think this is a good idea.

@svitvitskiy I have been able to use MPEGTS-Streamer to parse out the TS bits. Once I strip that away, I get down to the PES packet (within the TS payload). Can I then plug this into JCODEC directly and have it parse out the contents of the PES packet? If so, how can I go about doing this? Do I need to combine everything into a single frame and then use JCODEC to decode?

@AeroBuffalo did you manage to solve this in any way?

@B-R-Bender Sorry, it has been so long I do not remember what I was able to do / get done.


Benchmark for GCP

[Enter feedback here]
What's the CIS version and hardening level for GCPBenchmark? Can we choose a template based on the hardening level?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 808eab20-96ce-d5c4-41be-ea5475a0c6bf
Version Independent ID: 1eef009c-a54e-2038-59b6-30c21eb5797a
Content: How Defender for Cloud Apps helps protect your Google Cloud Platform environment
Content Source: CloudAppSecurityDocs/protect-gcp.md
Service: defender-for-cloud-apps
GitHub Login: @dcurwin
Microsoft Alias: dacurwin

Thanks for your question. We'll investigate and get back to you.


422 | "[QuickBlox] base Forbidden. Need user."

Hi I am new to the QuickBlox
I just followed the video that was added in docs
But I couldn't continue due to getting this error when I tried to start the chat
Response:
{
    "statusCode": 422,
    "error": "Unprocessable Entity",
    "message": "[QuickBlox] base Forbidden. Need user."
}

Payload
{
    "client_id": 140521582,
    "provider_id": 140518423,
    "description": "HI LET's do it!"
}

Also Already add user in the dashboard!

Hi @andrii-khomutovskyi-qb followed the page but get that erro
when i run
yarn init:schema
(node:25816) [DEP0040] DeprecationWarning: The `punycode` module is deprecated. Please use a userland alternative instead.
(Use `node --trace-deprecation ...` to show where the warning was created)
lerna notice cli v7.2.0
lerna notice filter including "@qc/bin"
lerna info filter [ '@qc/bin' ]

> @qc/bin:"init:schema"

(node:25816) [DEP0060] DeprecationWarning: The `util._extend` API is deprecated. Please use Object.assign() instead.
QuickBlox account owner credentials found in config file: /Users/lara/WebstormProjects/q-consultation/.env
Error:
undefined

I am using
node 22.11.0
yarn  3.6.3

Also, I used my own email, not with Google or another SSO
This my env file
QB_SDK_CONFIG_APP_ID=*****
QB_SDK_CONFIG_AUTH_KEY="ak_*******"
QB_SDK_CONFIG_AUTH_SECRET="*****"
QB_SDK_CONFIG_ACCOUNT_KEY="******"
QB_SDK_CONFIG_DEBUG=false
QB_SDK_CONFIG_ENDPOINT_API="api.quickblox.com"
QB_SDK_CONFIG_ENDPOINT_CHAT="chat.quickblox.com"
QB_SDK_CONFIG_ICE_SERVERS=
QB_ADMIN_EMAIL="*********"
QB_ADMIN_PASSWORD="*******"
BEARER_TOKEN=""
OPENAI_API_KEY=""
AI_QUICK_ANSWER=false
AI_SUGGEST_PROVIDER=false
AI_RECORD_ANALYTICS=false
AI_REPHRASE=false
AI_TRANSLATE=false
PROVIDER_ASSISTANT_ID=-1
APP_NAME="Q-Consultation"
APP_DESCRIPTION="Q-Consultation"
ENABLE_REDUX_LOGGER=false
DISPLAY_VERSION=false
CLIENT_APP_URL="https://<IP_ADDRESS>:3001"
SERVER_APP_URL="http://<IP_ADDRESS>:4000"
ENABLE_GUEST_CLIENT=false
HAS_HISTORY=false
HAS_PROVIDER_LIST=false
HAS_CHANGE_LANGUAGE=false
DEFAULT_LANGUAGE="en"
FILE_SIZE_LIMIT=10485760
FILE_EXTENSIONS_WHITELIST="gif jpeg jpg mov mp4 png csv docx pdf pptx txt xls xlsx zip webm heic heif"

Hi @Ge6ben
I think your app already has the required custom object schemas, that's why you get the error.
If you are not sure about the correctness of the existing schemas in QuickBlox, I advise you to delete them and retry the command.
If you have problems with this command, you can use other methods of uploading schemas described in https://quickblox.github.io/q-consultation/dev/setup-and-deployment/configurations/#upload-schema


rxSwift rxCocoa 5.0.1 support instead of 5.0.

Hello, is where a way to use rxSwift rxCocoa 5.0.1 support instead of 5.0.
5.0.1 removed deprecated UIWebView

Hey @yaroyk, yes there should be a way! It should be as simple as updating your dependency:
SPM:
swift package update

CocoaPods:
pod update Moya

Carthage:
carthage update Moya // --platform iOS --cache-builds or any other option you would like

👍🏻
thank you

@sunshinejr This does not seem to be working. I am using CocoaPods and my podfile says pod 'Moya/RxSwift'. It installs RxSwift ~> 4. Is there something I am doing wrong?

@therohansanap this means you have installed Moya 13.* (or lower) - we are using RxSwift 5 for Moya 14, which is not yet out of beta phase as Alamofire is not out yet. You can specify version 14.0.0-beta.5 in your Podfile, but be careful as there are breaking changes in this release.

@sunshinejr noted! Thank you for prompt response.


Replacing includes with indexOf for compatibility

Minor compatibility fix.

It seems includes is just to big of an issue, so I pulled in these changes, thnx @cdibbs


Supporting variable length

@mfdeveloper508 We need to be very careful about making large changes here. For anyone using Wire as a library in their own applications, this PR represents a sizable change they'd need to make to continue using it.
I'm concerned about how much is being changed in this single PR. If at all possible, we should attempt to centralize the changes to the reader and writer, and avoid modifying every record type.


Build the native binary inside docker

Right now, the native binaries in both the linux/amd64 and linux/arm64 images are built in a CircleCI step which uses the linux/amd64 version of the java-to-native as the docker executor. The linux/arm64 image does work as of now, when tested using qemu-user-static on a x86 Ubuntu machine. But it might stop working or run into issues. The ideal way to ensure that both images keep working would be to build them in a multi-stage docker build, the first stage of which would perform the native binary build. The java-to-native image can be used as the base image of the first stage(once it has both linux/amd64 and linux/arm64 variants). Requires https://github.com/devatherock/java-to-native/issues/4. Also build 2 separate images, instead of a multiarch image, as building a native binary with emulation is too slow as seen in this artifactory-badge build

Required, to fix this build failure


'iconAddSolid' was not found in 'carbon-icons'

1. Icon name
'iconAddSolid' was not found in 'carbon-icons'
'iconCheckmarkSolid' was not found in 'carbon-icons'
3. Please briefly describe what the icon is supposed to represent and the use case(s) its being used for.
Creating new React Application include carbon-icons library  but below error its comes.
4. Screen Shot
Please add the following screen shots to this issue:

Close-up screen shot of the icon with the pixel grid turned on
Screen shot of the icon in context with your use case. ##

Hi @anupamsomani1! 👋 Could you share the package version for carbon-icons that you are using? These should show up in v7 of the icons 😄

"carbon-addons-cloud": "^2.1.0",
"carbon-addons-cloud-react": "1.3.0",
"carbon-components": "9.7.1",
"carbon-components-react": "6.20.0",
"carbon-icons": "^6.3.2",

Thanks @anupamsomani1! You are using v6.3.2, but those icons are available in 7.0.7. Updating should help!

Yeah I tried that but still when I am using below code that Image was not rendering

Hi 👋 do you want to create a reduced case, based on https://codesandbox.io/s/x2mjypo6pp? Thanks!

Hi @asudoh  That was strange in codesandbox It's working but I am trying to integrate in our solution that the will comes up.
So here my question is there is any need to  import carbon-icons. I think 'carbon-components-react' has duty to import carbon-icons is my understanding correct ?

@anupamsomani1 carbon-icons is listed as a peerDependency on the project 👍
https://github.com/IBM/carbon-components-react/blob/052822271c4663c153e25bd92f00ccb49e278153/package.json#L122

Hi again 👋 npm i -S carbon-icons would be something you’d want - Hope it helps!

In case this is what you are asking; <Icon> as of today has two ways to use - One is <Icon icon={iconSomething}> where iconSomething is a named import of carbon-icons (as you brought up). Another is <Icon name="add—solid”> but it’s deprecated.
You can see the demo of all options in http://react.carbondesignsystem.com/?selectedKind=Icon&selectedStory=Default by going to Knobs tab at the bottom and changing some props there. The source code of that demo can be found at https://github.com/IBM/carbon-components-react/blob/eb8a297/src/components/Icon/Icon-story.js. Hope it helps!

Going to close this as this seems more like a usage question at this point. Feel free to reach out in the #carbon-react slack channel if you have additional questions around how the <Icon> component works!


Proposal for API

Use RESTful routes
Use filtering as per JSON API recommendations (http://jsonapi.org/recommendations/)

Nice! :+1:


Fix postgres tests

Fixed all the broken postgres tests.

Awesome! This looks like it would do it but it does not run against Postgres on CI. Could you branch off https://github.com/feathersjs/feathers-sequelize/pull/108 and apply your changes to that in a new PR?

I will re-branch of #108

@daffl I am not familiar with the CI tooling but it looks like it is already running against Postgres? I actually branched off your postgres branch btw.

Are you sure? It should show the diff from https://github.com/feathersjs/feathers-sequelize/pull/108/files in here then as well. I can merge your branch into that one as well if that makes it easier for you.

Well that is a diff between your postgres branch and master, this is a pull request from my postgres fixes branch into your postgres branch (not master). So it wont show that diff. :-)

And here is the output from the CI tests:
https://travis-ci.org/feathersjs/feathers-sequelize/jobs/265682341#L1208

Oh sorry, you're pulling into that branch as well. Great! I'll see if there is anything I need to do for my comment and then we can release it. Thanks a lot for doing this!


feat: shorten list of completions for TM names to just the next matching full path segment

feat: shorten list of completions for TM names to just the next matching full path segment

really nice job. Couldn't find any weird edge cases.


When i try to use tdlin in tomcat library native crash

Hi, I'm trying to run the example on a tomcat application server to be able to send telegram messages. What happens is that when the library tries to reload "tdblib" I get the following error. And so that it does not happen again I have to restart the tomcat.

See https://stackoverflow.com/questions/36936948/java-lang-unsatisfiedlinkerror-native-library-xxx-so-already-loaded-in-another.

I tried to do that and it didn't work, the posts are very old.

The answers on StackOverflow are correct and exactly descibe the cause of the issue with some solutions. You can find the code, which loads libtdjni at https://github.com/tdlib/td/blob/66234ae2537a99ec0eaf7b0857245a6e5c2d2bc9/example/java/org/drinkless/tdlib/Client.java#L16-L22
You need to modify the code as suggested in the answers.

Hi @levlam , we try to do that.
Here is the code:

Inside conf, in file catalina.properties, we have this:

In /opt/tomcat/shared/lib we put the native library "libtdjni.so".

When we deploy the war in tomcat the first time, it's all ok, but when we try to deploy again (cp ...war /opt/tomcat/fastprg/), we have the next error:

If we remove this load, we have the problema that the tomcat never load the library

The error we have when we try to create the client is:

You must load the library manually from a proper place.


Backport "Update amd script" PR(#1540) to 2.9 release branch

not sure if 2.9 really needs it, but better to be prepared than sorry

closing this one, because we don't need to test AMD with 2.9 and the CI will work with old ODS-CI script as well. If needed we can re-open


Imprint and Data protection

We should add a footer with links to Imprint etc.
Further, allow something in Config to specify the link to imprint etc.

Done


Fixes places where we didn't use provided scope

Provided helps us not interfere with user-defined versions

cc @jorgheymans

:+1:

about your comment on p6spy..

tend to agree for very common libs like guava / commons-* / jackson etc .. but very likely p6spy is not present in a project that was not already tracing so in this case it's probably ok to more lean towards convenience.

it actually makes sense. I can take out provided and put rationale instead (ex unlikeliness that users are already using it w/o tracing, so leave as compile scope) cc @felixbarny

I also chose to use compile scope for p6spy in stagemonitor.

Cool will note and continue. Thx for the feedback!


Delete project fails if the database doesn't exist

It seems like it should still delete the project. Perhaps the user already deleted the database?

Fixed.


Type inference bug (need better title!)

While fixing compilation errors in the compiler for #6154, I've found the following type bug:
abstract class Foo
end

module Bar
end

class IncludeBar < Foo
  include Bar
end

# init vars:

as_foo = IncludeBar.new.as(Foo)
as_bar = IncludeBar.new.as(Bar)

mix = rand > 0.5 ? as_foo : as_bar

# check the types:

pp typeof(mix)    # => (Bar | Foo)
pp mix.is_a?(Foo) # => true
pp mix.is_a?(Bar) # => true

# use in a restriction:

def use_a_foo(a_foo : Foo)
  puts a_foo
end

use_a_foo(mix)

Error:
# Error in line 30: no overload matches 'use_a_foo' with type (Bar | Foo)
# Overloads are:
#  - use_a_foo(a_foo : Foo)
# Couldn't find overloads for these types:
#  - use_a_foo(a_foo : IncludeBar)

https://carc.in/#/r/479d
There is an overload for a_foo : Foo, and it can't find overload for a_foo : IncludeBar even though IncludeBar < Foo.
This is definitely a bug.
Also, someone please find a good title for this :smiley: thank you

For the actual use case, see: https://carc.in/#/r/4796 it uses some classe names from the compiler, but it's not reduced at all.

But not every Bar is a Foo. Or, well, a Bar could potentially not be a Foo. That's why it fails.
 My solution back then was to cast the thing to Type, and for some reason that works.
Or maybe the restriction should work if every known Bar is a Foo, I have no idea...

I see, it makes sense to explain why Bar | Foo is not simplified to Foo.
But I don't understand the logic for the method selection: it's not trying to find a use_a_foo(a_foo : Bar) but tries to find a prototype for each types including Bar (in this case: IncludeBar).
What is weird is that when trying to find a use_a_foo for IncludeBar it fails to see that IncludeBar < Foo, and so that use_a_foo(a_foo : Foo) is a valid candidate.
(kinda hard to explain clearly)
Do you see what I mean?
Said differently: Why when looking for an overload for IncludeBar it doesn't use the overload for Foo ?
I don't think that the fact that a Bar could potentially not be a Foo (as you said) should impacts this method selection (if it does).

I really don't think this is a bug. At least, it shouldn't compile. The error message is wrong though, it should just say no overload for Bar.


update broken incremental adoption links in readme

Noticed that incremental adoption readme was missing so I updated the links where necessary.

Thanks! @all-contributors add @0xMySt1c for maintenance


Add reusable Framework features from lighthouse

Framework.ExecWithOptions function
Service-related functions
Deployment-related functions

There's some double imports of core/v1, sometimes as v1 and sometimes as corev1, and I think we need to consistently name it corev1 (since there's also apiv1 imports)

yeah that was unintentional resulting from the copy - thanks for noticing it.


"Expected a dict config and got None"

When I have skill-ovos-setup installed the ovos-core log is spammed with the following:
2023-06-23 14:14:04.393 - skills - ovos_utils.signal:get_ipc_directory:26 - WARNING - Deprecation version=0.1.0. Caller=ovos_utils.sound:277. Expected a dict config and got None.

Transferring this to skill-ovos-setup as that's where this should be fixed


[Wait #844] [ini] add trainable property for layer

#844 commit 1
commit 2
Enable trainable property to layer

Set trainable value to false in constructor in activation layer, flatten_layer
Signed-off-by: hyeonseok lee<EMAIL_ADDRESS>

:memo: TAOS-CI Version: 1.4.20191203. Thank you for submitting PR #845. Please a submit 1commit/1PR (one commit per one PR) policy to get comments quickly from reviewers. Your PR must pass all verificiation processes of cibot before starting a review process from reviewers. If you are new member to join this project, please read manuals in documentation folder and wiki page. In order to monitor a progress status of your PR in more detail, visit http://nnsuite.mooo.com/.

:memo: TAOS-CI Version: 1.4.20191203. Thank you for submitting PR #845. Please a submit 1commit/1PR (one commit per one PR) policy to get comments quickly from reviewers. Your PR must pass all verificiation processes of cibot before starting a review process from reviewers. If you are new member to join this project, please read manuals in documentation folder and wiki page. In order to monitor a progress status of your PR in more detail, visit http://nnsuite.mooo.com/.

@lhs8928 Please rebase.

@lhs8928 Please rebase.

Could you remove [wait #844] since it is already merged?

Could you remove [wait #844] since it is already merged?


[stable/prometheus] fix remoteRead/Write defaults

What this PR does / why we need it:
#20056 has added the options to set remote_read and remote_write configs but ueses a wrong standard value.
Using this value as list works but shows this warning:
Warning: Merging destination map for chart 'prometheus'. Cannot overwrite table item 'remoteRead', with non table value: map[]

The config is a list of objects not an object:
https://prometheus.io/docs/prometheus/latest/configuration/configuration/#configuration-file
# Settings related to the remote write feature.
remote_write:
  [ - <remote_write> ... ]

# Settings related to the remote read feature.
remote_read:
  [ - <remote_read> ... ]

Checklist

[x] DCO signed
[x] Chart Version bumped]
[x] Variables are documented in the README.md
[x] Title of the PR starts with chart name

/assign @gianrubio

/ok-to-test

/assign

/lgtm

@zanhsieh can you review again and merge/release it? 😃

/lgtm

/test pull-charts-e2e

Bumped again :)

/lgtm


wheel.urdf.xacro: swap iyy, izz inertias

Fixes #34.
The cylinder collision has a 90 degree roll rotation on line 42, so that the cylinder axis of symmetry should be the Y axis, instead of the Z. I noticed this when visualizing the inertia in gazebo7. I can attach a screenshot if desired.

Shouldn't you be changing the inertial values for all wheels?

@oars I don't understand. This is a xacro file that is used to represent each wheel. I think this one change is sufficient.

Sorry for the confusion. You are totally right.

Thanks for catching this @scpeters


Fix grass never spawning if cache started out empty

Discovered this one while lazily loading grass from a tag I put on a GLTF.

Can you explain the solution? I currently don't see what the problem was

In my use case, the grass is spawned at some random point during the game. So, before that, for instance_data in cache.values_mut() ran a noop and instance_data.uniform_bindgroup was left at None. Later on, this is not updated because of the early return, so it stayed at None forever. This change makes sure that the last_texture_id stays at None until we actually spawned anything, so that the early return cannot be triggered.

Ok sure thanks. Seems a bit hacky but totally fine for now


elastalert.py does not work

Hi,I'm a begginer of elastalert.I have a question.
I can execute elastalert-test-rule, but elastalert.py does not  work. Could you give me the reason?
I set yaml file under "rules" directory like this.
\
name: Example frequency rule
type: frequency
index: alert
num_events: 2
timeframe:
minutes: 120
query_key: RESULT
filter:

term:
RESULT: "0"
alert:
"command"
command: ["xclock"]
\\

And when I execute elastalert-test-rule ,xclock command is excuted completely.
But,I execute elasticalert.py,nothing is executed.
I set config.yaml like this.
\
rules_folder: rules
run_every:
minutes: 1
buffer_time:
minutes: 1
es_host: <IP_ADDRESS>
es_port: 9200
writeback_index: elastalert_status
alert_time_limit:
days: 2
\
Are there something wrong?
I use elasticstack ver.6.7.0 and python ver.2.7.6.
Thank you.

I want to add some information.
When I execute elastalert.py, the displays are like those.
\
/usr/local/lib/python2.7/dist-packages/cryptography-2.6.1-py2.7-linux-x86_64.egg/cryptography/hazmat/primitives/constant_time.py:26: CryptographyDeprecationWarning: Support for your Python version is deprecated. The next version of cryptography will remove support. Please upgrade to a 2.7.x release that supports hmac.compare_digest as soon as possible.
utils.PersistentlyDeprecated2018,
/home/hoge/elastalert/elastalert/config.py:31: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
rule_schema = jsonschema.Draft4Validator(yaml.load(open(os.path.join(os.path.dirname(file), 'schema.yaml'))))
\\

Run elastalert with --verbose, post logs showing the time period when it should have alerted, and then show an example JSON of a matching document.

Thank you for replying.I use --verbose option for the first time!
In elasticsearch, There are five  documents  like this.
They all have " @timestamp" value "2019-05-08T01:38xxx"
\
"_index" : "alert",
"_type" : "doc",
"_id" : "2019/05/08 10-948",
"_score" : 1.0,
"_source" : {
"@version" : "1",
"tags" : [
"multiline"
],
"host" : "nekamodel",
"aaa_time_result" : "2019/05/08 10:38:35.590",
"aaa_time_id_result" : "2019/05/08 10",
"@timestamp" : "2019-05-08T01:38:35.590Z",
"message" : "[2019/05/08 10:38:35.590] CMD_ID=948 RESULT=0\nWed Apr  3 13:06:49 JST 2019\nh2019/05/08 10:38:36.590] CMD_ID=949 RESULT=0\nWed Apr  3 13:11:14 JST 2019",
"RESULT" : 0,
"CMD_ID" : 948,
"RESULT_Detail" : "Wed Apr  3 13:06:49 JST 2019\nh2019/05/08 10:38:36.590] CMD_ID=949 RESULT=0\nWed Apr  3 13:11:14 JST 2019"
\\
When I run elastalert-test-rule ,I get this.
\
INFO:elastalert:Queried rule Example frequency rule from 2019-05-08 10:37 JST to 2019-05-08 10:38 JST: 0 / 0 hits
INFO:elastalert:Queried rule Example frequency rule from 2019-05-08 10:38 JST to 2019-05-08 10:39 JST: 5 / 5 hits
INFO:elastalert:Queried rule Example frequency rule from 2019-05-08 10:39 JST to 2019-05-08 10:40 JST: 0 / 0 hits
\\
But when I run elasticalert.py with --verbose, I get this
\
INFO:elastalert:Queried rule Example frequency rule from 2019-05-08 10:38 JST to 2019-05-08 10:39 JST: 0 / 0 hits
INFO:elastalert:Queried rule Example frequency rule from 2019-05-08 10:39 JST to 2019-05-08 10:40 JST: 0 / 0 hits
INFO:elastalert:Queried rule Example frequency rule from 2019-05-08 10:40 JST to 2019-05-08 10:41 JST: 0 / 0 hits
INFO:elastalert:Queried rule Example frequency rule from 2019-05-08 10:41 JST to 2019-05-08 10:42 JST: 0 / 0 hits
\\
Why does the difference occur?
And another question is  this,
When I run elasticaler.py, why  is  the time span checking the rule different from the one I set  "timeframe" in yaml file?
Thank you.


test: guard part of stdlib/StaticBigInt.swift for 32-bit at compile-time

To avoid integer literal overflows at compile-time

Ah, I overlooked it. Thanks.
Unfortunately, wasm32 ci is still only available on our fork. We are continuously trying upstreaming patches to make it possible.


Question: Is there any way to turn a schema nullable if it has required fields inside?

Hello everyone! I have a schema like this:
const firstSchema = z.object({
  field1: z.string().required(),
  field2: z.string().required(),
  field3: z.string().required(),
});

const secondSchema = z.object({
  myField: myCondition ? firstSchema : firstSchema.nullable(); // make a schema nullable() doesn't work because it has required fields inside.
});

Is there any chance to make a schema fully nullable and "override" the required conditions of it? If not, would you suggest any workaround or ideas?
Thank you for your help! 💜

This isn't your question, but there is no .required() method in Zod. All schemas are "required" unless you make them optional with .optional().
Given that, I'm confused by what the problem is. If you call .nullable() on your schema, it will allow null no matter what.


Problem retrain decoder

Description
Hi, I am currently using the transformer model and I am wondering if is available that I first train the transformer as the pre-train model. And retrain the decoder with other dataset while fixing the encoder weight.

I am trying to do the same thing - any lucn @seasa2016 ?


Base name configuration needs to be optional

The implementation and the definition of the configuration file should be optional.
This avoids the MissingServiceLoaderConfigurationException when it is not defined.

Investigate how we can achieve the octopus config features on top of the standard META-INF/microprofile-config.properties


Reduce pull times to meta server

Done
Add two more return code:
kWait means no need to pull, just wait and try again
kMove means no need to pull, update the meta info with the redirect msg back from server


Posthog connection is broken

Let's verify that analytics events are being sent to PostHog. This makes it seem like they aren't.

fixed


feature proposal| flagged enum

In many programming languages flags are used to encode options via parameters to functions.
It provides a way to eliminate the need of multiple option parameters.
My suggestion is to have another feature called "flagged enum".
These special enums will have member that get  auto assign  to the power of 2.
Example:
flaggedEnum AnimalFlags{HasClaws , CanFly  ,EatsFish , Endangered }
will be as to  call:
enum AnimalFlags{     HasClaws       = 1 << 0,     CanFly         = 1 << 1,     EatsFish       = 1 << 2,     Endangered     = 1 << 3 }
the different that it will be made automatically of course.
Example of usage can be read here:
https://basarat.gitbooks.io/typescript/docs/enums.html#enums-as-flags

This doesn't seem to solve any problems that people aren't comfortably solving today with existing syntax. Not everything needs a sugared form.


In multi select , the label given to multi select is not read by the screen reader.

Steps to reproduce :

Create select that supports multiple selection and add a Label for it.
The  tag's "for" value should be given has the "id" of the select tag.
Then when we Focus on the Label through tab key, the value of the label has to be read by the screen reader.

Actual behavior:
On the  focus of  Label its value  has not been read by the screen reader. Instead it is being focused on the select tag on the entire div is  read by the screen reader.
Expected behavior:
On the  focus of  Label its value  has to be read by the screen reader.
Libraries
jQuery version: 2.1.3 (used in the codepens)
Select2 version: 4.0.13
Environment:
Google Chrome/Windows/NVDA screen reader.

in my case, the  shows me ID instead of TEXT. The  tag is ok. How can i fix this?


add ability to view alpha bitplanes

the alpha option is only given if the image has at least one transparent pixel

Awesome! Thx :)


FM "first" variant option 2

related: #109
Closes #70
see the first commit for a description
TODO

[ ] figure out a name for the algorithm
[ ] measure scaling of the movement loop, on RCB and on a random partition,
[x] do not update the edge cut globally
[x] do not push back a vertex into the cut queue after a move
[x] make cut and part0_weight thread local
[x] find a way for threads to have the same amount of work (steal from other cut queues, or split queues after having computed the cut set)
[x] Lazy gain computation: actually do not maintain a gain table
[ ] Allow threads to move vertices before the cut set is fully computed
[ ] Iterate from neighbor to neighbor
[ ] correct end condition: sometimes it stops doing moves too early, surely because there is not enough vertices per thread

When not using log scales, it really show this algorithm doesn't scale past ~20 threads..
Red is from https://github.com/LIHPC-Computational-Geometry/coupe/pull/114/commits/fe472077af54a4222bd65f88c7fa19b6ec4b9872
Blue is from https://github.com/LIHPC-Computational-Geometry/coupe/pull/114/commits/ec42beb833d44724defd36ad8056cf0526e93a90


Container component in not locked horizontally

When user drags the container element to left or right the container is dragged towards left or right direction:

Kindly provide suggestion to lock the Container element before closing the issue

Could you please tell us the version of native-base you are using? Did you try replacing Container with regular RN View and test? Could attach a gif (if possible)?

The native base version is was 0.5.15. You can have a look at entire app source at
https://github.com/smhatre59/todoapp
The issue occurred on Asus zenfone android version 6
It might be due to use of navigator for handling navigation

Closing this as it's not related to native-base


Is the changelog for v2.0.3 accurate?

Expected behaviour
The diff between https://github.com/karma-runner/karma/compare/v2.0.2...v2.0.3 shows only 55 commits, over 91 files.
Actual behaviour
The release notes/changelog for v2.0.3 seems uncharacteristically large (compared to prior releases), particularly for a simple patch version bump.
The change log includes items such as https://github.com/karma-runner/karma/commit/1082f35 (the restartOnFileChange option), which was committed back in 2015 and has been available since v0.13.11.
Environment Details
N/A
Steps to reproduce the behaviour

View CHANGELOG.md for v2.0.3
View diff from v2.0.2...v2.0.3 (https://github.com/karma-runner/karma/compare/v2.0.2...v2.0.3)
Note the discrepancy
Note that the link for v2.0.3 in the changelog actually points to https://github.com/karma-runner/karma/compare/v0.12.16...v2.0.3

I think is it wrong, I think the CHANGELOG generation was messed up by my tag change:
https://github.com/karma-runner/karma/releases/tag/1.7.1
which I did to fix another issue. Sorry, I guess it won't happen next time, we'll see.

The 2.0.4 Changelog looks ok.


puppeteer-fx TypeError on Click

Steps to reproduce
Tell us about your environment:

Puppeteer version:1.12.2
Platform / OS version: mac
URLs (if applicable):
Node.js version:v11.6.0

What steps will reproduce the problem?
Please include code that reproduces the issue.
I am trying to get puppeteer-fx to work, code below is launching the firefox browser, but i get the TypeError: scope.context.currentPage.click is not a function. Works in Chrome, no issues.
Looks like its not including puppeteer with puppeteer-fx during the runtime? Any suggestions please?
const b = process.env.PUPPETEER_BROWSER || 'chrome';
const puppeteer = b === 'firefox' ?
require('puppeteer-fx') : require('puppeteer')
const World = function() {
scope.driver = puppeteer;
scope.context = {};
};
await scope.context.currentPage.goto(CREDS.url);
await scope.context.currentPage.click(loginpage.loginfields.USERNAME_SELECTOR);
What is the expected result?
works in chrome, does not work when run on puppeteer-fx
What happens instead?
TypeError: scope.context.currentPage.click is not a function.

Hey @bbandla,
We have no relation to puppeteer-fx project; I'd recommend filing over to their repository.
P.S. we have an experimental Firefox support via puppeteer-firefox, please give it a try.


Accessing dashboard - Unable to access grafana dashboard via either static IP nor hostname on DietPi

I have installed the standalone internet monitoring without fail (the ansible way was causing far too many issues). The output showed no errors however when I go try to visit the address of the dashboard I get  "Can’t establish a connection to the server at XYZ:3030" no matter what I do.

System details

Dietpi v7.6.2 (with fully updated APT and applicable patches
Python 3.9.2 with Pip 21.2.4 that targets
Docker (20.10.8) and Docker Compose (1.29.2) both installed via DietPi's software config tool (built specifically for DietPi)
Pihole and Unbound are installed
Static IP granted to the pi via DHCP.

Steps taken:

git clone https://github.com/geerlingguy/internet-monitoring
cd internet-monitoring
docker-compose up -d
Visited https://<IP_ADDRESS>:3030/d/o9mIe_Aik/internet-connection or some other variant address my searching led me to via Firefox and Edge. Neither worked.
Edited the resolveconf.conf thinking docker might not be able to look up DNS but no benuo.  #12

Previous history can be seen in #243 where upon suggestion from another member I swapped to standalone install.
Any ideas? Been at this for about two days and have exhausted all the potential google searches I can think of

So I have dug into this a bit and I cannot seem to get things working. It appears that there is something up with the entry point, but I am able to run that just fine with docker exec.
I have even tried a rebase of the internet-monitoring and i am still running into this issue. My next step will be a complete rebase and see what happens.

Interested to see how it goes, at the same point I was in my last comment.. Have not been able to make any progress. I am slowly getting to the point where its probably more efficient to make my own (seen a few guides)

So full rebase worked. Grafana is now running and everything appears to be good. I have 1 problem of not being able to log into Grafana now. even with the default password.....not sure what is up with that.

So full rebase worked. Grafana is now running and everything appears to be good. I have 1 problem of not being able to log into Grafana now. even with the default password.....not sure what is up with that.
edit: That can be resolved easily enough by just cli'ing into the grafana container and reseting the password to admin. It seems Grafana doesn't like special characters in passwords.

Amazing, what exactly did you do to rebase?
My experience with Git goes up to commits and clones unfortunately and I lack the context to figure it out myself even with some reading: https://git-scm.com/book/en/v2/Git-Branching-Rebasing

What is your experience with Docker?
Basically you need to stop all docker containers. Delete all docker images. Delete all directories relating to the Internet-Pi project. then clone the repo again.

Also I just reread the steps you listed in your first post. You did run the ansible-playbook main.yml, right?

Also I just reread the steps you listed in your first post. You did run the ansible-playbook main.yml, right?

When I was initially trying to install via the Ansible way I did run it (see https://github.com/geerlingguy/internet-pi/issues/243#issuecomment-932763865)
However now given I am going for just standalone, no ansible is being used 😀

Update - I've again scrapped attempting to use the standalone method as suggested in #243. Getting the same connection timed out error when connecting to the dashboard. Closing this issue and opening a new one.


Too much Xp, very few Stardust. Anyone can HELP me?

Hi! I would like to catch the pokemon with the "usual" XP points. Bot always catch them with 210 XP, and then, the Stardust is not equilibrated, in my opinion. How can I set the bot to catch the Pokémon with the usual Xp (100-110-150...etc) ?
I will be very grateful to give me a simple answer, since I'm not a programmer, I'm just a user.
Sorry for my english, thanks.
We are aware that there are mass bans of different magnitudes being experienced by a lot of the bot users with symptoms such as:

Bot being able to login, and catch pokemon but NOT spin forts
Bot being able to login, NOT catch pokemon (vanishing) but able to spin forts
Some accounts not being able to login at all

We are also aware of the getting stuck between 2 forts and getting caught in an infinite loop
If any issues are created relating to the above KNOWN issues they will be closed without reason
Stop!  Use http://jsonlint.com/ to check.
Have you searched to see if there are other issues for the same issue? If so, comment on that issue instead.
Are you running master? We work on the dev branch and then add that functionality to master. Your issue may be fixed on dev and there is no need for this issue, just wait and it will eventually be merged to master.

Expected Behavior
Actual Behavior
Your config.json (remove your credentials and any other private info)
your config here

Steps to Reproduce
Other Information
OS:
Branch: dev or master
Git Commit: (run 'git log -n 1 --pretty=format:"%H"' and paste it here)
Python Version: (run 'python -V' and paste it here)

Did you try
https://github.com/PokemonGoF/PokemonGo-Bot/issues/3746#issuecomment-239515961
?
There you can set probability of each catch result in your config.json.

This is not a bot issue, configuration problems should be discussed in the slack chat


Add support for Swift 4

Changed respective .swift-version files.
Added visibility to Objective-C code through @objc.
Fixed compiler errors due renames in Swift 4.

@trein It looks CI, died with your PR, would you be willing to fix it?

@syky27 Sorry about that. It's fixed now.

--------------------------------------------------------------------------------
 🎉  Congrats

 🚀  JSSAlertView (4.0.0) successfully published
 📅  October 16th, 21:35
 🌎  https://cocoapods.org/pods/JSSAlertView
 👍  Tell your friends!
--------------------------------------------------------------------------------


Add Private Only Template

Add a private IP,subnet, etc only template to this GitHub repo.  Note we don't want to list that in Marketplace due to usability issues.

Strongly disagree with sentiment that private IP alone qualifies this as a separate template or that it should not be in marketplace.  Private ought to be one of many configuration options that provide flexibility and which avoid customers having to roll their own, which is what happens today.

This has now been completed and is available at:
https://github.com/neo4j-partners/amazon-cloud-formation-neo4j)/custom-templates/
We are unlikely to attempt to roll this feature into the main marketplace template but plan on producing other custom templates in the same location as the need arises.


Can't get any examples working

I'm new to PureScript and Thermite. I'm running a fresh Arch install (I set it up yesterday).
I tried running the "Actions" lesson from Try Thermite by doing the following:

mkdir thermite-test && cd thermite-test
pulp init
bower i purescript-thermite --save
copying and pasting the code from that lesson into src/Main.purs
pulp build

but I get a huge bunch of errors, mostly to do with unexpected "qualified"statements in the dependencies like Data.Lazy.
I think this may have to do with some changes in PureScript syntax, since when I do the bower installation, I'm asked to choose between Prelude versions 0.1.5 and 1.0.0 or something similar because of a dependency conflict.
Any ideas?

What version of the compiler are you using?
I would recommend waiting a couple of days, at which point I hope to have a v1.0.0 release of Thermite which will work with the latest 0.9.1 compiler.

I just downloaded the latest versions of everything from npm today.
On Sun, Jun 19, 2016, 10:34 PM Phil Freeman<EMAIL_ADDRESS>wrote:

What version of the compiler are you using?
I would recommend waiting a couple of days, at which point I hope to have
a v1.0.0 release of Thermite which will work with the latest 0.9.1 compiler.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/paf31/purescript-thermite/issues/63#issuecomment-227008241,
or mute the thread
https://github.com/notifications/unsubscribe/ANhd7lnHH-ks5bZ15rt2FgLSln6vf8JTks5qNXaPgaJpZM4I5HF9
.

The released version of Thermite doesn't work with 0.9.1 yet. You could try building master.

Sure, I can try that.

@paf31: master builds fine, but doing an npm test and opening html/index.html gives me a near-empty page with nothing but the "Fork me on GitHub" banner.
html/index.html source

Do you see any errors in the console?

Never mind, I just forgot to do an npm install. The example renders perfectly now.
Thanks for the help. :smile:


Only functions on first load

I have implemented this standard from bower and it works fine on the first load. However when I change the view and come back into the same page it does not work (nothing shows, there are no errors).

Hello @rodneyjoyce  can you share your code snippet, So that i can reproduce the issue and solve it

Hi,
It's a pretty standard Angular app:
Here is the code for the html View (there's nothing in the View JS Controller):
        <p hm-read-more hm-text="{{vm.slogan}}"
           hm-limit="200"
           hm-more-text="read more"
           hm-less-text="show less"
           hm-dots-class="dots"
           hm-link-class="links">
        </p>

This is where I delcare it in the app.js:
var app = angular.module('app', [

...
'hm.readmore',...
]);
and this is where I include it in the index.html:
script src="bower_components/angular-read-more/dist/readmore.min.js">
When I navigate to the View  (call it X) it works fine the first time (after a browser refresh).

Hi hjmodha, did you manage to find the problem?

I can provide more code snippers if neccessary?

Closing because of inactivity. Please reopen if still applicable, and provide an working code example (by use of Codepen for instance)


Clear memory cache when switching model and mode

Using the global objects instead of creating one for each mode, so it won't create extra pipeline object when switching modes. Also clearing the cache when switching models to avoid memory leak.

@powderluv jinchen doesnt have access to a machine so if we can rebase this on top of my exe test patch the ci can test it for him

is this good to land ?


TypeError: ifdefPlugin is not a function

First of all, I'm extremely happy this plugin exists. It really extends the possibilities of building a client.
I could be wrong, but I think I stumbled upon a bug. My setup:
const esbuild = require("esbuild");
const ifdefPlugin = require("esbuild-ifdef");

esbuild.build({
    entryPoints: ["./app.ts"],
    bundle: true,
    outfile: "./out/bundle.js",
    minify: false,
    sourcemap: true,
    plugins: [
        ifdefPlugin({
            variables: {
                Client: "DESKTOP"
            },
            requireTripleSlash: false
        })
    ]
}).catch(() => process.exit(1));

I have esbuild v0.15.11 and esbuild-ifdef v0.2.0
Executing this code with node gives the error:
TypeError: ifdefPlugin is not a function
This is fixed by changing the first line into
const ifdefPlugin = require("esbuild-ifdef").default;
I'm not sure whether that is the expected behavior. I did not stumble upon it when searching the README.

Hi! I'll have a look at the this issue shortly, there's probably some problem with separating esmodules and commonjs versions in built package.


DiT Licence?

What is the Licence for using DiT? I am seeing the whole repository is under MIT  Licence, but some of the projects contains difference licensing. As there's no info mentioned for DiT, can you update it?

What is the Licence for using DiT? I am seeing the whole repository is under MIT Licence, but some of the projects contains difference licensing. As there's no info mentioned for DiT, can you update it?

Unless otherwise indicated non-commercial, no info means it is under the MIT license.

@wolfshow, nothing is mentioned in the DiT folder, means it is MIT? and we can use it for our custom usage after training?


Net shell utilities do not work with NET_SOCKET_OFFLOAD

Describe the bug
When using a SARA-R4 modem with the NET_OFFLOAD driver, I would expect the net shell utilities to work. Unfortunately they depend on NET_NATIVE to work.
To Reproduce
Steps to reproduce the behavior:

Build Zephyr with a NET_OFFLOAD=y, NET_NATIVE=n, NET_SHELL=y
Attempt to use any of the net shell utilities
Observe that utilities have no effect and are non functional

Expected behavior
Net shell utilities (ping, tcp) should be able to utilize NET_OFFLOAD interfaces
Impact
I must write a custom application to test/evaluate Zephyr's networking functionality when using a NET_OFFLOAD interface, or compile in the native network stack which significantly increases image size.
Screenshots or console output

Environment (please complete the following information):

OS: Linux
Toolchain gnuarmemb
tag v2.3.0-rc1

Atm net-shell tcp command still uses net_context API instead of BSD socket API. So currently tcp command will not work with CONFIG_NET_OFFLOAD_SOCKET but should work with  CONFIG_NET_OFFLOAD so we could allow that. The best option would be to convert the tcp command to use normal BSD socket APIs so that it could work with all options.

The ping net-shell command was recently made to support offloading in commit e3fb634e7afa1a14121559e6a0b3ddbeb947c5c5
The udp and tcp are still using net_context and there is currently no plan convert them to use BSD socket API.


[SPARK-10278][MLlib][PySpark] Add @since annotation to pyspark.mllib.tree

Merged build triggered.

Merged build started.

Test build #42244 has started for   PR 8685 at commit 232ec8b.

Test build #42244 has finished for   PR 8685 at commit 232ec8b.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42244/
Test PASSed.

Jenkins, retest this please.

Merged build triggered.

Merged build started.

Test build #42251 has started for   PR 8685 at commit 1783198.

Test build #42251 has finished for   PR 8685 at commit 1783198.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42251/
Test PASSed.

Merged build finished. Test PASSed.

Just minor fixes needed - change addedversion to versionadded + one version number alteration.

Merged build triggered.

Merged build started.

Test build #42532 has started for   PR 8685 at commit 400b7f4.

Test build #42532 has finished for   PR 8685 at commit 400b7f4.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42532/
Test PASSed.

Merged build finished. Test PASSed.

Thanks for the changes - LGTM!

@noel-smith thank you for reviewing it.

Merged into master. Thanks!


Provide the rust bindings via crates.io

Hey,
coming here from https://github.com/denoland/deno/issues/12217#issuecomment-939349448
It might be helpful to have rust bindings.
You might be able to more or less copy my work from tree-sitter-elm
https://github.com/elm-tooling/tree-sitter-elm/blob/main/.github/workflows/publish.yml
https://github.com/elm-tooling/tree-sitter-elm/blob/main/Cargo.toml
You'll also need to update tree-sitter, as the latest version is able to automatically create the needed rust bindings.

I've working on generating rust bindings for yaml grammar here. I can open a PR if the maintainer like. :)


Add conlist type

Change Summary
Added a conlist type, which allows you to restrict the number of items in a list
Related issue number
#161 Is related to this
Checklist

[x] Unit tests for the changes exist
[ ] Tests pass on CI and coverage remains at 100%
[X] Documentation reflects the changes where applicable
[X] HISTORY.rst has been updated

if this is the first change since a release, please add a new section
include the issue number or this pull request number #<number>
include your github username @<whomever>

I have no clue why all the tests are failing and why the coverage is reduced. I cannot really reproduce it locally except for the Cython issue... It seems Cython doesn't like the Type[T] type, without type arguments however I get another error

Hmm one test is still failing on 3.6.. I don't have access to 3.6 atm. So it is a bit hard to debug that one. I am going to leave this open untill I have time for this or untill someone else finishes this...

If you fix the current test that's failing on all versions, I'll fix the 3.6 test as I have it running locally.

If you fix the current test that's failing on all versions, I'll fix the 3.6 test as I have it running locally.

Thanks. I fixed the test..

Hmm fixing the Cython issue seems to have fixed 3.6...

awesome. Thanks so much.


Use web app user in logs and process management

Description
This PR adresses #111 by passing the web app username - from the request object available in views - to function signatures where the username is relevant to the function i.e. logs and process management.
Fixes #111
Type of change

[ ] Documentation (non-breaking change that adds or improves the documentation)
[x] New feature (non-breaking change which adds functionality)
[ ] Optimization (non-breaking, back-end change that speeds up the code)
[ ] Bug fix (non-breaking change which fixes an issue)
[ ] Breaking change (whatever its nature)

Key checklist

[ ] All tests pass (eg. python -m pytest)
[ ] The documentation builds and looks OK (eg. python -m sphinx -b html docs docs/build)
[ ] Pre-commit hooks run successfully (eg. pre-commit run --all-files)

Further checks

[ ] Code is commented, particularly in hard-to-understand areas
[ ] Tests added or an issue has been opened to tackle that in the future. (Indicate issue here: # (issue))

Codecov Report
Attention: Patch coverage is 66.66667% with 7 lines in your changes missing coverage. Please review.

Project coverage is 81.58%. Comparing base (0f5fc3e) to head (6198ae7).
Report is 2 commits behind head on main.

Files with missing lines
Patch %
Lines

process_manager/process_manager_interface.py
58.82%
7 Missing :warning:

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #208      +/-   ##
==========================================
+ Coverage   81.53%   81.58%   +0.04%
==========================================
  Files          29       29
  Lines         390      391       +1
==========================================
+ Hits          318      319       +1
  Misses         72       72

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


debug: initial support of breakpoint modes

This supports breakpoint modes on exception, instruction, and source
breakpoints. It doesn't yet do data breakpoints since I was having
trouble figuring out a good user flow for that. You can test this on the
connor4312/breakpoint-modes branch of mock-debug, which I'll merge in
after the next DAP release.
I also refactored a bit of how breakpoint data is passed around to reduce argument proliferation and add some more type-safety in serialization and DAP emissions.,

Refs https://github.com/microsoft/debug-adapter-protocol/issues/454

im sorry again pls help


Add structural analysis links & workflow

This was specifically for Caschlatsch, but now we should consider for general use.
RFM/ Rstab seems to be the prefered software for timber. Ania had an interface for Rstab, maybe we can upstream to compas_fea2...

As a partially side note, it would be great if we (as a whole COMPAS ecosystem dev community) could come up with an "ecosystem public interface diagram" that clearly outlines the expected input and output interfaces of each package, at a quite high level, so that we can have more informed discussions about what can be integrated where, and how pieces are supposed to fit in together.  /cc @chenkasirer @tomvanmele


Improve backup info message

The readability was not optimal.
The logs link is https://console.cloud.google.com/logs/viewer?project=github-tracker-b5c54&service=cloudfunctions.googleapis.com&key1=backup&key2=us-central1.

This might be the last adjustment for backups for now, but #147 might reveal that I want to adjust it once more :)


New package: Bioinformatics v0.1.1

Registering package: Bioinformatics
Repository: https://github.com/mrtkp9993/Bioinformatics.jl
Created by: @mrtkp9993
Version: v0.1.1
Commit:<PHONE_NUMBER>babb64d2df19013e657820ab574048
Reviewed by: @mrtkp9993
Reference: https://github.com/mrtkp9993/Bioinformatics.jl/commit/5021806941babb64d2df19013e657820ab574048#commitcomment-34677731

I wrongly edit the version. You can close this PR.


Choose floating-base (or not) when creating a robot wrapper

Hello,
I wanted to create a robot from a pinocchio model using the constructor RobotWrapper(const Model & m, bool verbose=false) (or more precisely its Python binding).
However, the robot is considered to have a floating base by default and mine hasn't. I didn't find a way to change it using the current code, so I wrote those 2 lines of code : 7d795cf4a7293f25e0df4bd523b203082c104b51 .
Should I PR this change, or was there already a way to do it ?
If I PR, is this the good way to give the user a choice ?
Should I also update for the 2 other constructors (and bindings)?

Dear @EtienneAr , thanks for your message. There's already a way to use fixed-base robots with TSID:
https://github.com/stack-of-tasks/tsid/blob/master/exercizes/ex_0_ur5_joint_space_control.py#L25
You just need to set the third (optional) input argument of the constructor of RobotWrapper to false, as in the example above.

Yes, but this works only if you create a robot from a file.
In my case, I would like to create a robot wrapper from a pinocchio model (it doesn't rely on any urdf file).
There is only one constructor in this case, and it assumes a floating base : https://github.com/stack-of-tasks/tsid/blob/b0d6bff80292fb3451ca7ca438a4ab84b5b8c022/src/robots/robot-wrapper.cpp#L47

Ok, now I see. In this case you can do a PR to merge your contribution in TSID. However, I would suggest following the same approach used for the other constructor, that is to take as input parameter a const pinocchio::JointModelVariant & rootJoint (rather than a bool).

Closing since #154 has been merged.
Thank you.


Settings (both server and client

Is your feature request related to a problem? Please describe.
The one thing missing that we need is a system to store setting both application and user.
Describe the solution you'd like
Settings would need to be available on the server and the client for the UI (local storage?) If you are not planning this would you be able to suggest how this would best be done in Blazor?
Describe alternatives you've considered
Have you seen the system implemented in ASP Boilerplate?

What kind of settings do mean?

Currently we are storing the darkMode and the Language Preferences to the LocalStorage

It’s a pleasure to be chatting with you.
We have many settings for UI layout, feature flags etc. in our current app.  I have been waiting to reimplement is blazer with clean architecture and came across your project.  Mighty impressive!
Actually we have our own settings system in place so the examples of Dark Mode and Language should educate us on how to approach this.
From: Mukesh Murugan @.>
Sent: Sunday, 18 April 2021 4:11 PM
To: blazorhero/CleanArchitecture @.>
Cc: Ian Gold @.>; Author @.>
Subject: Re: [blazorhero/CleanArchitecture] Settings (both server and client (#70)
Currently we are storing the darkMode and the Language Preferences to the LocalStorage
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/blazorhero/CleanArchitecture/issues/70#issuecomment-821940721, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ACCK53T55CUNZSS4RNIEF3DTJJZY3ANCNFSM43D3VRVA.

This is an example of settings
https://aspnetboilerplate.com/Pages/Documents/Setting-Management#about-isettingstore
From: Mukesh Murugan @.>
Sent: Sunday, 18 April 2021 4:11 PM
To: blazorhero/CleanArchitecture @.>
Cc: Ian Gold @.>; Author @.>
Subject: Re: [blazorhero/CleanArchitecture] Settings (both server and client (#70)
What kind of settings do mean?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/blazorhero/CleanArchitecture/issues/70#issuecomment-821940673, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ACCK53QCSJGPMBDYMLBSUTDTJJZWVANCNFSM43D3VRVA.

I added base interfaces and classes: IPreference.cs, ServerPreference.cs, IPreferenceManager.cs, IServerPreferenceManager.cs, ServerPreferenceManager.cs, PreferencesController.cs to store the settings on the server side in #69 .
It's need to be implemented ILocalStorageService methods in CustomLocalStorageService.cs


Ethers library not documented for Near BOS and not working [BUG]

Describe the bug 🐞
Following the Ethers and Lido Tutorial for Near BOS.
When I call Ethers.send("eth_requestAccounts", [])[0]; nothing happens.
Also,Ethers is not documented anywhere in the BOS API
Expected behavior
A metamask popup should come that asks me to connect my wallet to the dApp.
Screenshots
If applicable, add screenshots to help explain your problem.
Location 🎯
You can find my source code here: https://near.social/#/mob.near/widget/WidgetSource?src=tomiwa1a1.near/widget/TransferNFT

So I've solved it using Web3Connect which I found from one of the ETHGlobal Waterloo hackathon winners
https://near.org/near/widget/ComponentDetailsPage?src=a_liutiev.near/widget/button_web3connect
But Web3Connect is not documented anywhere, so what props does it accept? How can I get the result of the logged-in user?

Hi @ademidun , thanks for the report! 👍
We are working on adding more documentation around BOS, and all the tools and libraries that can be used with it.
If by chance you want to improve any of our docs, all contributions from the community are welcome!
About Ether-JS, you can check: https://docs.ethers.org/v5/
and I found this Web3connect repository: https://github.com/TotlePlatform/web3connect


breaking changes for Trixi.jl v0.5

This includes a first set of breaking changes for Trixi.jl v0.5 described in https://github.com/trixi-framework/Trixi.jl/issues/938.
@jlchan Could you please check that I removed only the DGMulti code that you intended to be removed?
I will leave this in draft mode until we are ready for the breaking release of Trixi.jl. We also need to update the compat bounds of Trixi.jl at Trixi2Vtk.jl to create our documentation here.

@ranocha thanks for organizing this.
For DGMulti, it would be nice to make the DGMultiMesh constructors consistent so that dg is the first argument. This would be a breaking change. If there is some time before v0.5, I can take care of that sometime next week.

That sounds good to me - it would be great if you could introduce the corresponding deprecations next week :+1:

@ranocha I added the deprecations, along with some internal cleanup.
I removed a constructor in https://github.com/trixi-framework/Trixi.jl/pull/1302/commits/2a0205dad2b024dc779b997ff9233c24c32af435 which is, as far as I can tell, unused. I wasn't sure how to deprecate this properly - do we need to?

I added the deprecations, along with some internal cleanup.

Thanks!

I removed a constructor in 2a0205d which is, as far as I can tell, unused. I wasn't sure how to deprecate this properly - do we need to?

No, I think its okay. Was it documented, e.g., via a docstring? If so, it would be great if you could mention it in NEWS.md.

No docstring. I'll add it to the news file soon

Thanks!


Internal Server Error on /report/example.com

Internal Server Error on /report/example.com
This used to work until a week ago for any domain I would try.
If you need any help, I'll be happy to provide.

Hi @Satyros19 !
Thanks for the report!
Please see #2


Implemented PFADD, PFCOUNT, PFMERGE

Could you take a look at my implementation for issue #182 ?

Looks good, thanks!


Allow Redefining Builtins

First off, I think we should consider this optional. Although Erwig wants it in place, this fix is just kind of glossing over the real issue of hiding/showing builtins selectively. I'll open up an issue elaborating what I found for doing this for builtins, and this PR will be separate for now.
This just changes one line of code, which is a list of Name, this is all that constitutes what is or isn't already defined and available in terms of functions. By making this an empty list, the user can freely redefine any functions in the builtin list, as they are unchecked during parsing. If not redefined absolutely nothing changes, as the startState is just a superficial construct that doesn't factor into what happens later.
With this it's possible to actively hide builtins by simply redefining them to be nop or something that is effectively non-functional. This isn't exactly what I was looking for (or what Martin has in mind maybe), but that could work to selectively remove builtins?
Martin asked to be able to redefine builtins on Monday, so this in response to that, but I want to see what you all think first here. Perhaps there are some (like input) that we don't necessarily want the user to ever be able to change. Anyways, let me know.

Closing as it seems this isn't desired.


Sample config file changes

Rename config.yml to dev-config.yml
Add example-config.yml, a simple configuration file for the official
This was originally made for the the distribution-library-image repo,
but is being moved here to make sure it stays in sync.
Update Dockerfile and docs for the rename.
Signed-off-by: Aaron Lehmann<EMAIL_ADDRESS>

LGTM

LGTM


Add a CI job running on PHP 8.1

I'm not familiar with the error, but I wonder if this would pass now if we re-ran it :)

@weaverryan this happens being symfony/phpunit-bridge was installing PHPUnit 9.3 instead of the latest 9.x (i.e. 9.5). this has been fixed in https://github.com/symfony/symfony/commit/b177c08ecb7765803a8de774e8c615efae40d102


Error thrown out at LINE:  from scispacy.linking import EntityLinker

I am trying out scispacy on Mac M1:

conda env with python=3.8 OK
pip install scispacy OK
pip install the models OK
run sample code in section AbbreviationDetector OK

But when I run sample code in section EntityLinker, error thrown out:
zsh: illegal hardware instruction
and it looks the error is from line:
from scispacy.linking import EntityLinker
Any suggestion is appreciated.
RJ

This is likely to be an issue with nmslib (see https://github.com/nmslib/nmslib/issues/476 for example). Could you see if anything over there works for you?
To verify if it is nmslib, it would also be great if you could try out some example.code from nmslib and see if that works.
Unfortunately I don't have an M1, so I can't really test anything myself.

Thank you Daniel @dakinggg
It looks the solution from this thread works for me:
https://github.com/allenai/scispacy/issues/372
pip install --no-binary :all: nmslib

Great!


show the great idea at Tartu Mini Maker!

The news in Estonian is here - http://makerfairetartu.ee/?p=301
It says that at 20th September 2015 there will be next event at Tartu's Science Park AHHAA about self-made projects. For registering write an e-mail to<EMAIL_ADDRESS>or register directly at: https://goo.gl/qYgwjW

Didn't make it :/


fix: isMultiAzDeploymentEnabled caller to evaluate promise response

PlatformManager.isMultiAzDeploymentEnabled is promisified function, whose value was being assigned as is, without the evaluation of the promise to a boolean attrib. So this made multi-az true by default. Fixing it by evaluating the promise and then proceeding with manifest generation.

Again we got the same error :
 1 failing
  1) #DirectorService instances director #bind no context : returns 201 Created:
     Uncaught AssertionError: expected false to be true
      at Function.verify (test/test_broker/mocks/index.js:48:3)
      at Timeout.setTimeout (test/test_broker/operators.DirectorService.spec.js:973:23)

i retrigger travis for now.

Pull Request Test Coverage Report for Build 2058

20 of 22 (90.91%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.004%) to 89.158%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

operators/bosh-operator/DirectorService.js
20
22
90.91%

Totals

Change from base Build 2054:
0.004%

Covered Lines:
8294

Relevant Lines:
9002

💛  - Coveralls


Performance of typeahead/select2 with thousands of users

As an enterprise user I want to work with arbitrary colleagues from my company whithout performance / memory issues. (e.g., US DoD has 3.2 million employees) ;-)

Make performance test with 1000; 5000; 10,000, 50,000 users. How behaves memory / performance? Still "realtime"?
If we have problems with 10,000 users in DB, then change typeahead & select2 to use lazy loading after at least 3 letters entered

Typeahead: Used on Meeting Series Editor for Invited/Informed
http://twitter.github.io/typeahead.js/examples/
Select2: Used on Responsibles for Topics / ActionItems
https://select2.org/

Team estimation for effort: 4 days


mj-social attribute for adjusting icon's width and height

Hi!
Is there a way for controlling icon's size without hacking it using images?
Something like this:

It would be really awesome. Thanks!

Hi @maherelaridi !
Does icon-size doesn't work for you ? https://mjml.io/try-it-live/B1WIPRJVZ

Hi @maherelaridi any news on that or can I close ? :)

Hi @iRyusa The icon-size cases the social media icon to show pixelated.
I was able to do this and it worked fine, even though I saw an error saying attributes are illegal.
<mj-column>
  <mj-text font-size="18" align="center" color="#FFFFFF" letter-spacing="-1">Connect with us!
  </mj-text>
  <mj-social
             mode="horizontal"
             icon-size="40px"
             text-mode="false"
             padding-bottom="20"
             inner-padding="5"
             display="facebookc twitterc linkedinc youtubec"
             facebookc-icon-color="none"
             facebookc-icon="path-to-icon/icon_fb.png"
             twitterc-icon-color="none"
             twitterc-icon="path-to-icon/icon_tw_2x.png"
             linkedinc-icon-color="none"
             linkedinc-icon="path-to-icon/icon_li_2x.png"
             youtubec-icon-color="none"
             youtubec-icon="http://go.pardot.com/l/218812/2017-06-23/rqg1/218812/40932/icon_yt_2x.png"
             facebookc-href="https://www.facebook.com/my-company"
             twitterc-href="https://twitter.com/my-company"
             linkedinc-href="https://www.linkedin.com/company-beta/my-company/"
             youtubec-href="https://www.youtube.com/user/my-company"/>
</mj-column>


"Sudiți" is listed in the drop-down menu

Description:
When user writes "Sudiți" the location appears in the drop-down menu next to the comune and the county witch is a part according to the law
Precondition:
The website is up an running.

Step 1
Write in the search bar "Sudiți"
Expected results
The location appears in the drop-down menu as "Comuna Sudiți, ** IALOMIȚA**"


Possible Regression with tx pool size in 22.10.4/23.1.0-RC1

Possible regression with upcoming 22.10.4
Looking at a couple of updated instances (and a report from @benjaminion), it seems that much less transactions are filling the txpool.

For example the graph above show how instance tagged with 1 after the upgrade is very slowing adding transactions to the pool, while for comparison restarting an instance (tagged with 2) still on 22.10.3 result in the txpool filled nearly immediately.
There are no specific changes on the txpool between .3 and .4, but there are some changes to the peers code, so we should look to revert some of them to see if we can found the regression.
In our testing, it seems the txpool behavior changed with this commit. It seems unrelated to the txpool, so requires investigation.

Fixed in #4964


Switch from pager to proper HTML output for code highlighting

Currently, running commands like :info creates some pretty weird HTML output. It contains a huge chunk of CSS (much of it unnecessary), then a textarea containing the actual content. Worst of all, it then contains Javascript like this:
<script>CodeMirror.fromTextArea(document.getElementById('code'), {mode: 'haskell', readOnly: 'nocursor'});</script>

All we want to do is highlight some Haskell code here.
As a result, the current approach needs to use the pager to work properly, which creates a subpar user experience, as documented in https://github.com/IHaskell/IHaskell/issues/1394.
This PR takes a different approach. Using the ghc-syntax-highlighter library, we parse the Haskell code within IHaskell, and then we output simple HTML with classes indicating the colors to use.
The PR adds 2 new options to IHaskell: --html-code-wrapper-class and --html-code-token-prefix, for controlling the way the classes are determined. Out of the box the classes should show up properly in Jupyter notebook/lab.

I appreciate the effort you put into this PR, but there are a couple of issues that prevent me from merging this PR in without substantial changes:

ghc-syntax-highlighter only works with GHC 8.4 onwards, so we would either need to use a different library, drop support for GHC < 8.4 (which is something I would want to discuss separately instead of doing it as part of this PR), or do some ungodly conditional dependency thing and keep both approaches (which sounds like the worst of both worlds).
Possibly related to the above, the tests don't pass.
It looks like you're plumbing things through to the workhorse evaluate command and its related commands, which seems smelly to me. IMO that's a pretty invasive change only to support HTML output, and I wonder if we could do it another way that makes use of existing kernel state/options.

In general I would really like it if you would open an issue or otherwise discuss large PRs like this before doing all of this work, especially because it puts me in an awkward position to have to say no or request substantial changes. I realise I've been unresponsive lately but a large contribution like this also creates additional work for me going forward when I have to:

modify this code in response to changing requirements
keep it up-to-date with newer GHC versions
maintain backwards compatibility

I do agree that the current HTML output is far from ideal and I hope we can figure out something that works for everyone here.

In general I would really like it if you would open an issue or otherwise discuss large PRs like this before doing all of this work, especially because it puts me in an awkward position to have to say no or request substantial changes.

It's okay, I'm not trying to pressure you to merge. I'm going to use my fork for my own purposes whether this change gets upstreamed or not. I'm also happy to work with you until you're happy with it.
I think I need to bring a flake change over from another branch to fix the Nix test.
I'm very open to suggestions on how to structure the extra arg with the kernel options and handle GHC < 8.4.

I'm still thinking about the other issue, but in the meantime I've fixed the test suite so it's running again.

What if we stop highlighting code cells for GHC < 8.4? I'd be okay with that.

That sounds good! I was thinking the same, we could just provide plaintext output for older GHCs. I'll take a stab at that when I get a moment.

If you look at the definition of KernelState: https://github.com/IHaskell/IHaskell/blob/7de07ec3a3b11153ed23b83ce20df2a96229c92c/src/IHaskell/Types.hs#L181-L193
It already has configuration values for things such as useSvg and kernelDebug. I think it would be relatively straightforward for you to put your HTML options there too. What do you think?

I did consider putting the options in the KernelState, but my thought process was as follows:
We want these options to be configurable as flags, which means they should be parsed alongside the other flags in parseKernelArgs:
https://github.com/IHaskell/IHaskell/blob/7de07ec3a3b11153ed23b83ce20df2a96229c92c/main/Main.hs#L91
Thus, the options need to go into KernelSpecOptions to start with. At that point I had two options,

Add the options to KernelState as well and copy them there when it gets constructed, or
Just plumb the KernelSpecOptions through to the evaluation function.

On balance I preferred 2), because 1) means putting the options in two separate data structures. Also, KernelState is supposed to be "state stored in the kernel between executions" -- it contains things that are meant to be mutable, via commands like :option no-svg. It seemed to me that these options are static configuration, not state. And there's no reason such configuration shouldn't be made available, and it may even make future configuration easier to add. I did consider whether hiding the plumbing in a reader monad might be nicer.
So yeah, that's my long-winded rationale! I'll make the change if you prefer of course.

I think I see where you're coming from, but IMO option 2) is more consistent with the way other configurable parameters work, e.g. --debug (which I don't think we can change when a kernel is running). I agree that separating static and dynamic configuration is conceptually cleaner but since we already aren't doing that AFAICT I don't think that starting here is a good idea.

Okay, I've done the KernelState refactor and the selective HTMLification for GHC >= 8.4, and rebased on master.
I stuck a couple quality-of-life commits on the end, one to fix some Cabal warnings and one to make it easier to work with this on NixOS. (I've found that leaving out the nix.enable field in stack.yaml works better because then Stack will autodetect if it's running on NixOS and enable the flag automatically if so.) I can remove these commits or move them to separate PRs if you like.
I haven't tested the Stack build for GHC 8.0 and 8.2 yet due to errors like the one below. But let's see what the CI says...
ghc: panic! (the 'impossible' happened)
  (GHC version 8.0.2 for x86_64-unknown-linux):
        Prelude.chr: bad argument:<PHONE_NUMBER>

Thanks for making those changes! I'm broadly happy with everything except the modifications to the test code, which seem a little strange to me (renaming etc. is fine, commenting tests out is not). I'll merge once we get the CI passing. One note on this: we'll probably want to disable the integration test for GHC 8.2 (it's already disabled for 8.0).

It looks like some of the test failures are due to -Werror, you're welcome to remove that from stack.yaml wherever it's an issue. It was introduced to improve code quality, but I personally think it's incompatible with how we support multiple GHCs, since imports e.g. differ so significantly across versions.

Right, I still need to get those commented tests passing -- it was behaving flakily in a way that seemed to affect other tests.
I've been chipping away at the -Werror issues one CI run at a time. It's pretty tricky to test locally due to https://gitlab.haskell.org/ghc/ghc/-/issues/19452. I think it'll all be passing soon but I agree it's fragile. Maybe we could just disable the unused imports warning in CI but keep Werror for everything else.
I was kind of thinking that if the behavior for different GHC versions is going to continue to diverge, it might make sense to split the integration test from being one big notebook file into many little notebooks, each with ~1 cell. Then it would be more straightforward to enable/disable specific ones for specific compilers, or even perhaps provide different expected outputs for different compilers. And it would make failures more granular and easy to diagnose.

It sounds like you might want to do some janky git-worktree thing in order to have everything in its own directory to avoid this issue, alternatively you could create release.nix files for each version you want to test.

I was kind of thinking that if the behavior for different GHC versions is going to continue to diverge, it might make sense to split the integration test from being one big notebook file into many little notebooks, each with ~1 cell.

Yes, that seems like a good idea to me, although I don't see why the notebooks have to be 1 cell instead of many cells each like it is now. A related change I've been thinking about is completely getting rid of CPP in the codebase and using cabal conditionals à la http://blockscope.com/posts/2022-02-23-iffy-diffy.html, but it would be a huge undertaking and it wouldn't be as easy to fix bugs in the resulting codebase (since we'd have to do it in each version instead of in one place), so I'm undecided on whether it's a good idea.

It sounds like you might want to do some janky git-worktree thing in order to have everything in its own directory to avoid this issue, alternatively you could create release.nix files for each version you want to test.

Pretty sure that would only work if I also abstract the home directory, because I think some problematic interface files go into ~/.stack. I do like the idea of doing more release.nix files though. I have a separate branch with some changes where I'm working on organizing all the stack.yaml files and release.nix into their own directories and making it all more systematic, if you're open to it.

A related change I've been thinking about is completely getting rid of CPP in the codebase and using cabal conditionals

I haven't seen this approach before, looks promising. I think the first step in such an undertaking would be to refactor large modules like IHaskell.Eval.Evaluate into smaller pieces so as to isolate the different conditional paths. Maybe after doing that step the CPP wouldn't feel so unmanageable anymore and it wouldn't be necessary to actually go further...

I have a separate branch with some changes where I'm working on organizing all the stack.yaml files and release.nix into their own directories and making it all more systematic, if you're open to it.

Definitely open to considering other approaches (in a separate PR please :smile:), although I think the root of the issue is that we don't have an explicit backwards compatibility guarantee and so I've been stubborn about supporting GHC 8.0 onwards. If we bit the bullet and e.g. dropped pre-9.0 support we would have a lot fewer files to worry about and it might not be as important to reorganise them. Again, that is something I would like to address separately to this.
It looks like you're pretty close to having this completed, I'm excited to merge it soon!

I wonder if DisplayData could be given a less opaque Show instance? I'm guessing it doesn't have one now because the output can be arbitrarily long, but it makes it hard to debug the failures that are happening now. In a few cases these same tests are passing locally for me in the Docker container I jury-rigged to test GHC 8.x versions. If not a Show instance that prints everything, maybe one that truncates after a few hundred characters?

When I was trying to fix the tests earlier, I used the ToJSON instance to meaningfully represent DisplayData in IHaskell.Test.Eval. If you like you can include this in your changes:
diff --git a/ihaskell.cabal b/ihaskell.cabal
index dc840bb..4e08b81 100644
--- a/ihaskell.cabal
+++ b/ihaskell.cabal
@@ -179,6 +179,7 @@ Test-Suite hspec
         IHaskell.Test.Hoogle
     default-language: Haskell2010
     build-depends:
+        aeson,
         base,
         ghc,
         ghc-paths,
diff --git a/src/tests/IHaskell/Test/Eval.hs b/src/tests/IHaskell/Test/Eval.hs
index 8ec1310..638a651 100644
--- a/src/tests/IHaskell/Test/Eval.hs
+++ b/src/tests/IHaskell/Test/Eval.hs
@@ -4,6 +4,7 @@ module IHaskell.Test.Eval (testEval) where

 import           Prelude

+import           Data.Aeson (encode)
 import           Data.List (stripPrefix)
 import           Control.Monad (when, forM_)
 import           Data.IORef (newIORef, modifyIORef, readIORef)
@@ -47,7 +48,7 @@ becomes string expected = evaluationComparing comparison string
     comparison (results, _pageOut) = do
       when (length results /= length expected) $
         expectationFailure $ "Expected result to have " ++ show (length expected)
-                                                           ++ " results. Got " ++ show results
+                                                           ++ " results. Got " ++ show (encode results)

       forM_ (zip results expected) $ \(ManyDisplay [Display result], expect) -> case extractPlain result of
         ""  -> expectationFailure $ "No plain-text output in " ++ show result ++ "\nExpected: " ++ expect

Merged, thanks so much for working on this!

My pleasure, thanks for pushing through with me

Thanks @thomasjm :heart:


[BUG] broken link on Azure storage hub doc page

Library name and version
Azure.Storage
Describe the bug
There is a broken link on https://docs.microsoft.com/en-us/azure/storage/
Expected behavior
link works
Actual behavior
404 returned.
Reproduction Steps
Go to https://docs.microsoft.com/en-us/azure/storage/
cLick on "Review options for storage in Azure"
Environment
No response

@KrzysztofCwalina Can you please check now and let us know if you are able to access the link.  I am able to access the link.

@KrzysztofCwalina We are still waiting for your response.  Please let us know if you are still facing error accessing the link.

@KrzysztofCwalina We are closing this issue as we have not heard back.


ARM64 support?

I wanted to ask if theres arm64 support? I'm trying to run a python script but it fails because of a missing arm64 file.
2023-05-06 22:06:31.145 Uncaught app exception
Traceback (most recent call last):
File "/home/pi/.local/lib/python3.9/site-packages/streamlit/runtime/scriptrunner/script_runner.py", line 565, in _run_script
exec(code, module.dict)
File "/home/pi/gpt4free/streamlit_app.py", line 7, in
from gpt4free import you
File "/home/pi/gpt4free/gpt4free/init.py", line 4, in
from gpt4free import forefront
File "/home/pi/gpt4free/gpt4free/forefront/init.py", line 10, in
from tls_client import Session
File "/usr/local/lib/python3.9/dist-packages/tls_client-0.2.1-py3.9.egg/tls_client/init.py", line 15, in
from .sessions import Session
File "/usr/local/lib/python3.9/dist-packages/tls_client-0.2.1-py3.9.egg/tls_client/sessions.py", line 1, in
from .cffi import request, freeMemory
File "/usr/local/lib/python3.9/dist-packages/tls_client-0.2.1-py3.9.egg/tls_client/cffi.py", line 20, in
library = ctypes.cdll.LoadLibrary(f'{root_dir}/dependencies/tls-client{file_ext}')
File "/usr/lib/python3.9/ctypes/init.py", line 452, in LoadLibrary
return self._dlltype(name)
File "/usr/lib/python3.9/ctypes/init.py", line 374, in init
self._handle = _dlopen(self._name, mode)
OSError: /usr/local/lib/python3.9/dist-packages/tls_client-0.2.1-py3.9.egg/tls_client/dependencies/tls-client-arm64.so: cannot open shared object file: No such file or directory

check out my fork it has support python-tls-client-arm32

Check if the file is missing from the directory. If it is, download tls-client-arm64.so from https://github.com/FlorianREGAZ/Python-Tls-Client/tree/master/tls_client/dependencies and it should work.


🚀 Feature: catalogProcessingExtensionPoint supports addEntityPolicy

🔖 Feature description
Within the New Backend System, the new concept of Extension Points are introduced and called out to be used when defining plugin Modules
As of the latest release (currently v1.9.1), the catalogProcessingExtensionPoint that allows modules to hook into the catalog processing setup only allows for adding new Processors and Entity Providers.
The CatalogBuilder itself supports addition of Entity Policies and as a plugin module developer, it would be nice to be able to add Entity Policies from backend catalog module plugins
🎤 Context
Entity Policies are beneficial and a key concept of the Entity Processing pipeline within the life of an entity.
Adding Entity policies is the only key concept in the life of an entity that is missing from the current catalogProcessingExtensionPoint.
As such, it feels prudent to include it for module development.
✌ Possible Implementation
Add addEntityPolicy to the CatalogProcessingExtensionPoint
# plugins/catalog-node/src/extensions.ts

export interface CatalogProcessingExtensionPoint {
  addProcessor(
    ...processors: Array<CatalogProcessor | Array<CatalogProcessor>>
  ): void;
  addEntityProvider(
    ...providers: Array<EntityProvider | Array<EntityProvider>>
  ): void;
+ addEntityPolicy(
+   ...policies: Array<EntityPolicy | Array<EntityPolicy>>
+ ): void;
}

Then add the addition of added policies from the extension point during backend plugin initialization
# plugins/catalog-backend/src/service/CatalogPlugin.ts

class CatalogExtensionPointImpl implements CatalogProcessingExtensionPoint {
  #processors = new Array<CatalogProcessor>();
  #entityProviders = new Array<EntityProvider>();
+ #entityPolicies = new Array<EntityPolicy>();

  addProcessor(
    ...processors: Array<CatalogProcessor | Array<CatalogProcessor>>
  ): void {
    this.#processors.push(...processors.flat());
  }

  addEntityProvider(
    ...providers: Array<EntityProvider | Array<EntityProvider>>
  ): void {
    this.#entityProviders.push(...providers.flat());
  }

+ addEntityPolicy(
+   ...policies: Array<EntityPolicy | Array<EntityPolicy>>
+ ): void {
+   this.#entityPolicies.push(...policies.flat());
+ }

  get processors() {
    return this.#processors;
  }

  get entityProviders() {
    return this.#entityProviders;
  }

+ get entityPolicies() {
+   return this.#entityPolicies;
+ }
}

...

# in `export const catalogPlugin = createBackendPlugin({`

 const winstonLogger = loggerToWinstonLogger(logger);
 const builder = await CatalogBuilder.create({
   config,
   reader,
   permissions,
   database,
   logger: winstonLogger,
 });
 builder.addProcessor(...processingExtensions.processors);
 builder.addEntityProvider(...processingExtensions.entityProviders);
+builder.addEntityPolicy(...processingExtensions.entityPolicies);
 const { processingEngine, router } = await builder.build();

 await processingEngine.start();
 lifecycle.addShutdownHook({
   fn: async () => {
     await processingEngine.stop();
   },
 });
 httpRouter.use(router);

👀 Have you spent some time to check if this feature request has been raised before?

[X] I checked and didn't find similar issue

🏢 Have you read the Code of Conduct?

[X] I have read the Code of Conduct

Are you willing to submit PR?
Yes I am willing to submit a PR!

Yep makes sense! 👍
Could be that we want to split this out into a separate extension point though. Potentially something like a catalogModelExtensionPoint, what do you think?
CC @backstage/maintainers, @backstage/catalog-core

catalogModelExtensionPoint

As in the entity model? Hm. Since the entity model mainly is driven by processors today, that might be confusing.
I think the mechanism of policies might be one of the first to be revised (or removed / folded into processors) when the catalog processing model evolves in the future. They are a bit of an odd one out at this point and should be looked at some time down the line. So from THAT point of view I can see a temptation to have it as a separate extension point, one which easily can be changed / deprecated in isolation. But apart from that... As long as we don't yet have the time to spend on overhauling the model, it's probably fine to keep with the others in the existing extension point I'd say.

I'm happy to help push forward either way if y'all would like. Also happy to let y'all discuss best path forward.
Let me know how I can help!

We are interested in keeping this alive 😄

We took an initial stab a while back at sorting the different customization points that the catalog builder exposes and how it would be mapped to the new system. Let us know what you think!
Options

set processing interval callback
set the allowed location types

Extension Points
ProcessingExtensionPoint

set entity data parser, which is available to all processors
install entity providers
install entity processors
replace all existing entity processors, except for BuiltinKindsEntityProcessor and PlaceholderProcessor (maybe?)
get the default set of processors so that they can be used when replacing
set a custom placeholder resolver

CatalogModelExtensionPoint

add additional entity policies
replace all entity policies with a new set
override field format validators, e.g. isValidTag

LocationAnalysisExtensionPoint

set a custom location analyzer
add location analyzers

CatalogPermissionsExtensionPoint - maybe this one should be an option instead?

install additional permission rules

Config

set processing interval in seconds
can decide whether to start processing engine or not (based on config)


Please add a LICENSE

Hi, could you please add a LICENSE file to your project indicating its open-source license? Big companies (like mine) can't use your code without an explicit statement of license.
Thanks!

Looks like I added this a while ago in fac647373825384dc320eada4fddeac2fea66b92 but forgot to close this ticket.


LICENSE

what is the license of the repository?

it can be MIT

Is it possible to formalize it with the LICENSE.md
https://github.com/Open-Pix/developers/pull/213

fixed, tks


ssh2 vs ssh-pool

Not suggesting that we should switch for no reason, but just curious is dropping ssh-pool in favor of ssh2 is on the table at all?
Just one less thing to manage, and ssh2 seems to have  lots of features that may be useful (like key authentication)

@timkelty why not, I chose to make a module that run command because it was simpler.

Hi guys. Maybe I missed something, but I thought that Shipit supports key authentication. Is it true?
Actually I have issues with Jenkins + Shipit. When I try to run Shipit script on my local machine and deploy application to target host using ssh-key authentication, everything works fine. But when I run Shipit script from Jenkins job (on a different server), it fails to connect to target host. BUT i'm prety sure that Jenkins server keys are authorized on target host, as simple ssh command works well. So I'm curious whether this is due to lack of some functionality in ssh-pool or I need to dig deeper with Jenkins server configuration.
Thanks.

Ah, sorry. I solved the issue - I should have specified full path to private key, not to public key. So this config option finally worked both locally and in Jenkins:
shipit.initConfig({
  default: {
    ...
    key: process.env['HOME'] + '/.ssh/id_rsa', // Path to PRIVATE file
    ...
  }
}

Good!
We should probably update the README to note this.


Release link

Why does the releases in README link to https://github.com/RangerMauve/csv-to-prolly-db/releases/tag/v0.0.3 that's not the same repo is it?

Latest releases are found here: https://github.com/RangerMauve/ipti/releases


Make Fail: build.h no such file or directory

Issue Description
I follow Steps to Make & Make install wormhole:
./autogen
./configure
make
make install

but in step make it fail:
build.h no such file or directory

Screenshot

What can I do to fix this problem?

you can fix it follow below steps:
cd share
./genbuild.sh ../src/obj/build.h

then make your project

you can fix it follow below steps:
cd share
./genbuild.sh ../src/obj/build.h

then make your project
No genbuild.sh file in the share directory

Thanks, now if you want to build wormhole, you can follow the document : https://github.com/copernet/wormhole/blob/master/doc/build-in-docker.md.
This is a closed issue with the problem : https://github.com/copernet/wormhole/issues/2.
At 2019-05-13 17:01:44, "Yoge"<EMAIL_ADDRESS>wrote:
you can fix it follow below steps:
cd share
./genbuild.sh ../src/obj/build.h
then make your project
No genbuild.sh file in the share directory
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.


Use input hashing instead of randomness inside 8ball

Description

This PR make the .8ball command use hashing instead of random.choice()
Reasoning

This makes the outcome always the same for the same question, so a user cannot brute-force the 8ball until they obtain the answer they want :grin:.
Did you:

[X] Join the Python Discord Community?
[X] If dependencies have been added or updated, run pipenv lock?
[X] Lint your code (pipenv run lint)?
[X] Set the PR to allow edits from contributors?

so a user cannot brute-force the 8ball until they obtain the answer they want

This is pretty much how I and everyone I know has ever used an actual magic 8ball.

I think the randomness and the chance of getting a different answer for the same question is part of the 8ball experience. It's just a random answer generator, which is often implemented purely in hardware form using a container of fluid and a floating die. Brute-forcing your answer has been a feature since its introduction in 1950.
As such, I don't think we have a desire to make ours a non-standard implementation that deterministically tries to divine the Truth.