Feature request: Filtering the text in the body

I'm wanting to use Mailrise to forward email to Telegram, but the emails I'm forwarding are formatted with HTML. Apprise properly converts that HTML, but that HTML also includes styling so that while it looks fine when rendered in a browser, it isn't as nice without that styling. When that HTML (and styling) is removed, the email ends up with a lot of unnecessary content.
What I'm looking for to solve that is to take an email like this:

Here's an email!

This is the real message!

and apply a conversion such that we'd end up calling Apprise with something like:
apprise --body="This is the real message!"

HTML isn't regular but I think regex will likely enough for most use-cases since I imagine most people will only need to get a few lines of text from an email if they need to use it.
Something in the config like:
configs:
  "*@*":
    mailrise:
      body_pattern: '(?<=
).+?(?=<\/p>)'
    urls:
      - tgram://...

That regex means "see text starting with
 but don't include it, get all text after it, see text ending with
 but don't include it". So applying that pattern to the message, we'd get my desired "This is the real message!" as the body that is sent to Apprise.
Things I've considered:

Putting this in Apprise instead.

Feels wrong since Apprise just wants to deal with content directly, not map it to some other format.

Changing the email before it gets to Apprise.

Possible, by writing some sort of SMTP forwarder. I don't think such a thing currently exists but that's the approach I'll take if this is a poor fit for Mailrise.

Alternative approaches:

Instead of supplying a pattern, supplying a file that can be executed with the text of the email in its args and outputs the new text as output.

Seemed overly complicated but does allow the most flexibility.

It's been a while since I've written some Python, but if you think this is a useful feature, I don't mind writing it up myself. I recognize that body_pattern can be confusing when body_template already exists but I can't think of anything better.

So I have a working branch following my initial message I'll push up in the morning for your thoughts on (it's even got tests!) but thinking more about this, maybe it's better to instead extend the existing templating logic with extra variables?
So something like:
configs:
  "*@*":
    mailrise:
      extra_body_variables:
        - name: '(?<=
).+(?=<\/h1>)
        - type: '(?<=
).+(?=<\/p>)'
       body_template: '$name, $type'
    urls:
      - tgram://...

Where then giving it an email body of:

Wardell

Super cool programmer

Would then call Apprise like:
apprise --body="Wardell, Super cool programmer"

Ooh, I appreciate the PR, and the tests. I'm also pleased that you had a chance to work with the code that I had just finished refactoring.
But to be honest, I'm not keen on adding any additional options to the YAML configuration file. I'd like to keep that format simple, so any homelabber can hit the ground running with it—what I'd like to do instead is make it possible to supply your own Python class to determine the processing logic. (If you're the type to delve into regexes, you most likely aren't afraid of getting your hands dirty with a little Python, methinks.) In short, you'd be able to write your own SimpleRouter.
I'll have it done soon; I've just been debating the semantics. I'm thinking something like:
mailrise.conf:
python:
  router: /path/to/my/router.py
...

router.py:
class MyCustomRouter():
    async def email_to_apprise(self, logger, email):
        ...
        yield AppriseNotification(...)

I believe such custom routers will provide the most flexibility for users interested in fine-tuning their notifications.

Hahaha, wow, great minds do think alike!
I love your custom_router approach here and I'm fully okay with just waiting for that to get in.
That being said, while I think that's a great fit for anyone building from source, it'll be a little weird for anyone using Docker. Mainly because they'll likely have to check out the project anyway to get the right typings and then have their Dockerfile copy over their custom router.
Of course, it's Python and the types don't actually matter but it's going to feel a little odd to write a custom router against one version of Mailrise that might end up running in a different version. That's going to be on the users to keep in sync and I don't think it's overly-difficult, just something to remember as updates happen.

That being said, while I think that's a great fit for anyone building from source, it'll be a little weird for anyone using Docker. Mainly because they'll likely have to check out the project anyway to get the right typings and then have their Dockerfile copy over their custom router.

Not necessarily. You'll be able to passthrough the .py file just like you can do with the config file itself:
-v /path/to/my/config.yml:/etc/mailrise.conf
-v /path/to/my/pluggable.py:/etc/mailrise_logic.py

That's going to be on the users to keep in sync and I don't think it's overly-difficult, just something to remember as updates happen.

Of course. It's important to design an API that will be unlikely to change.

Now available with b76b164271ceacf9dbaa9184d25f47eb092e4cbc. 👍


Update USB HAL to use GPIOv2

Summary
Trivial update types in USB HAL to use GPIOv2.
Checklist

[na] CHANGELOG.md for the BSP or HAL updated
[x] All new or modified code is well documented, especially public items
[ ] No new warnings or clippy suggestions have been introduced (see CI or check locally)

If Adding a new Board

[ ] Board CI added to crates.json
[ ] Board is properly following "Tier 2" conventions, unless otherwise decided to be "Tier 1"

Not needed due to #570 I believe


Release: alpha to master

TODO:

[x] Fix hub auth slowness
[x] Test with FE
[ ] Point to released versions of Textile libs (SKIPPED to do in next pr)
[x] Add PRD secrets

Closing this, going to create a new PR from the alpha-release-dev branch to master now that there are no conflicts.


DevTools close when opened while stuff is loading

run scripts/code.sh
reload the window
while that happens press cmd+alt+i to open dev tools
wait a little and see how dev tools are closed again

this happens because of https://github.com/Microsoft/vscode/blob/362e69ad832813977a97de2ebc89c301fe9f185d/src/vs/platform/menubar/electron-main/menubar.ts#L701-L709

@jrieken does this still happen? I pushed a change to trigger actions earlier (e.g. not waiting for workbench to have opened all editors).

Yes - still happens

I see why I am not seeing it because I have F12 assigned as keybinding and that one is not taken by the bootstrap-window.js already. For me the devtools only open when the workbench has started and for you they open right from the beginning but also they close again due to the second delayed invocation...


Evaluation of new cloudwatch search expression

I am not 100% sure if this is already in the API but this could allow us to get data more easy.
https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/search-expression-examples.html

Won't fix currently.


Datagen AutoPilot agent getting stuck

Hi!
Thank you for the open source project :)
We are trying to generate data for training using your data generation scripts. Note that we have upgraded to CARLA version 0.9.14 and thus had to change some code in our InterFuser fork, but no changed were done to the auto pilot agent. We are also using another car than the default lincoln mkz 2017 (the have similar dimensions).
While inspecting the data it generates, we see that the ego vehicle sometimes gets stuck when trying to do a turn. After a while it either despawns the incoming vehicle, or the scenario ends with a "Failed - Agent timed out"-error.
See videos below showcasing the problem. Would it for example be possible to change som variables in the code to increase the distance threshold between the ego vehicle and incoming cars during a turn?
https://user-images.githubusercontent.com/45951843/233123007-a9ec7b4b-bceb-4b59-a97d-41b127521401.mp4
https://user-images.githubusercontent.com/45951843/233123022-395f2f6e-9956-4d6c-b860-f6208b9c38f1.mp4
https://user-images.githubusercontent.com/45951843/233123033-a479612e-5d8c-4918-8fe5-ed64659a2e56.mp4

Hi!
This problem is very common in the process of collecting data. In our code, we do two things to walk around this problem:

Here(        if self.destory_hazard_actors:), we detect the actors that stay still for a long time and destroy them.
Although we have destoried some stationary actors, the collected dataset exists a lot of frames which are almost the same (the actors which stay still for 1500 game frames will be destoried). We provide some tools (tools/data/batch_rm_haze_data.py, tools/data/batch_recollect_blocked_data.py, tools/data/batch_stat_blocked_data.py) to delete these duplicated frames of the collected dataset.

But i don't konw whether CARLA 0.9.14 increases the probability of this problem. Hope the above can help you!

Thank you, will look into this! :)


⚠ Bofrost.lu has degraded performance

In 440f06e, Bofrost.lu (https://www.bofrost.lu) experienced degraded performance:

HTTP code: 200
Response time: 1361 ms

Resolved: Bofrost.lu performance has improved in a2d3e1a after 47 minutes.


to determine which pairs of points from either cloud correspond

This function does not attempt to determine which pairs of points from either cloud correspond. Instead, it infers them from the order of the arrays.
I wonder if there exisits methods that determine which pairs of points from either cloud correspond, if true, could you please give me a link?

Hi Chen Sheng
In the context of bioinformatics, yes.  When comparing the shapes of two proteins, people are sometimes trying to infer (from their shapes) which amino acids from either protein were probably inherited from a common ancestor.  So they superimpose the two protein structures and pick nearby pairs of points (one from either protein).  I wrote one of these algorithms, although the source code hosted there no longer compiles with modern compilers.  (I no longer work there but I can email anyone with updated code.)  Since then, at least one or two newer algorithms have been published which may perform better on some kinds of proteins.  All of these protein-structure-comparison algorithms that I know of exploit the assumption that the cloud of points is ordered (one point per amino acid), and successive points (amino acids) from one protein are always matched with successive amino acids from the other protein (since insertion or deletion mutations preserve the order of the remaining amino acids).  This makes it possible to perform an exhaustive, optimal search for matches.
In the more general case, there are several approaches, like ICP which work on general 3D point clouds (without ordering).  If my understanding is correct, these algorithms are not exhaustive or deterministic, and they are not guaranteed to pick the optimal pairs of points from either cloud.  But they aim to do a reasonably good job.  I am not an expert on this topic, but after a quick google search, I noticed a few links which might be helpful:
https://en.wikipedia.org/wiki/Point_set_registration
https://en.wikipedia.org/wiki/Iterative_closest_point
https://arxiv.org/abs/2001.07715
I hope this is not too late to be useful.
-Andrew

Thank you very much!
Andrew Jewett @.***> 于2021年9月14日周二 上午2:07写道：

Hi Chen Sheng
In the context of bioinformatics, yes. When comparing the shapes of two
proteins, people are sometimes trying to infer (from their shapes) which
amino acids from either protein were probably inherited from a common
ancestor. So they superimpose the two protein structures and pick nearby
pairs of points (one from either protein). I wrote one of these algorithms
http://www.rbvi.ucsf.edu/Research/projects/minrms/, although the source
code hosted there
http://www.rbvi.ucsf.edu/Research/projects/minrms/minrms.tar.gz no
longer compiles with modern compilers. (I no longer work there but I can
email anyone with updated code.) Since then, at least one or two newer
algorithms have been published which may perform better on some kinds of
proteins. All of these protein-structure-comparison algorithms that I know
of exploit the assumption that the cloud of points is ordered (one point
per amino acid), and successive points (amino acids) from one protein are
always matched with successive amino acids from the other protein (since
insertion or deletion mutations preserve the order of the remaining amino
acids). This makes it possible to perform an exhaustive, optimal search for
matches.
In the more general case, there are several approaches, like ICP which
work on general 3D point clouds (without ordering). If my understanding is
correct, these algorithms are not exhaustive or deterministic, and they are
not guaranteed to pick the optimal pairs of points from either cloud. But
they aim to do a reasonably good job. I am not an expert on this topic, but
after a quick google search, I noticed a few links which might be helpful:
https://en.wikipedia.org/wiki/Point_set_registration
https://en.wikipedia.org/wiki/Iterative_closest_point
https://arxiv.org/abs/2001.07715
I hope this is not too late to be useful.
-Andrew
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/jewettaij/superpose3d/issues/2#issuecomment-918445002,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ATAD4MSJZ4QJ5RQEPHQHN33UBY4V7ANCNFSM5CH7NFSQ
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

Another github user has posted an answer to this question:
https://github.com/jewettaij/superpose3d/issues/5
I'll go ahead and close this issue.


Prototype movie saving

Problem
Closes #240
Solution
Bare-bones test implementation -- Use the MediaRecorder API to capture canvas frames as a webm video and ffmpeg.wasm to convert it to an mp4 file before downloading it to the user's machine.
Some questions that were answered through prototyping:

Can we output videos of satisfactory quality?

Yes it seems we can raise the quality of the output video by raising videoBitsPerSecond where we instantiate a new MediaRecorder

Can we output videos as mp4 files?

Yes it is possible with ffmpeg.wasm (web version of ffmpeg)

Can we display the clock duration of the recording to the user while recording?

Yes I have implemented a duration indicator using basic setInterval() but there might be a better way to do this. I found sometimes I'm off by 1 second with the current implementation.

Can we display file size in a modal before the user confirms they want to download the file?

Yes, we should be able to, but depending on the user's browser setting the browser will also do this for us automatically.

Can we display a progress indicator while the file is processing?

Yes it seems like we should be able to with ffmpeg (the transcoding to mp4 makes up almost all of the processing time): https://github.com/ffmpegwasm/ffmpeg.wasm/blob/master/docs/api.md#createffmpegoptions-ffmpeg

Remaining issues to address

ffmpeg requires SharedArrayBuffer to be enabled which requires a page to be "cross-origin isolated"... I was able to make it with the dev server work by supplying in the necessary headers but not sure how it would work for non-dev environment. See note under "Browser" in the ffmpeg readme
I think these two issues only arise with ffmpeg in use but I'm not 100% positive:

Current implementation breaks the page if I stop recording while a trajectory is still playing. I got around this for now by forcing the trajectory to pause first when "Stop Recording" button is pressed
Current implementation fails (output video is empty) if I start playing the trajectory before pressing the "Start Recording" button. I tried one solution which was to pause the trajectory, start recording, then resume the trajectory playback anytime the Start Recording button is clicked, but that resulted in videos with a slo-mo part in the middle. I think this might be some kind of race condition? And/or something to do with a variable frame rate: https://video.stackexchange.com/questions/24576/output-of-ffmpeg-has-a-slow-motion-part-what-is-it-and-how-to-avoid/24578#24578

Type of change
Please delete options that are not relevant.

Proto-New feature (non-breaking change which adds functionality)

Screenshots (optional):

some suggested video bitrates: https://support.google.com/youtube/answer/1722171?hl=en#zippy=%2Cbitrate (5 MBps is still on the low side!)

https://github.com/allen-cell-animated/nucmorph-colorizer/issues/33 has a solution that works without any shared memory requirements or workers.   The solution is only Chrome-compatible (and must be used in a secure https session only)  but it was straightforward to implement.  It's using a web API which could be implemented in the future in other browsers.


feat(API): Unify return values of routes

This PR does some housekeeping on the api routes. Changes all return value keys to data
⚠  BREAKING CHANGES: This will break some existing implementation in the frontend

@ff6347 @vogelino, I took the liberty to change this in the frontend calls as well. The breaking changes should now be handled already.

Could you already try if this works? @dnsos

Could you already try if this works?

Yes, it does!

:tada: This PR is included in version 1.0.0-staging.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


UNDERTOW-853 SPDY: SpdyClientConnection.sendRequest() shouldn't be synchronized

Revert "SPDY Connection: Make synchronized requests"
This reverts commit 595322a869494ba03610773b2e8084da8d4a8372.

Can one of the admins verify this patch?

ping

this is ok to test

The issue is that without the sync the requests can be sent out of order which will break the connection.
This really needs a fix similar to https://github.com/undertow-io/undertow/commit/91417fa220ccf9b58968b2505d0bb34086e2c622, however I am not sure when I will get time to look at it (SPDY is a dying protocol, so it is not high on my priority list)

OK, let's close this one and track https://github.com/undertow-io/undertow/pull/512 instead.


minor: sort keys in releases field of json api

What's the problem this feature will solve?
releases keys are currently not version / release sorted.
Here's a specific example using pre-commit's versions (note 0.10.x is sorting before 0.2.x):
$ curl -s https://pypi.org/pypi/pre_commit/json | jq '.releases | to_entries | .[].key'
"0.10.0"
"0.10.1"
"0.11.0"
"0.12.0"
...
"0.18.1"
"0.18.2"
"0.18.3"
"0.2.0"
"0.2.1"
"0.2.10"
"0.2.11"
"0.2.2"
...
"0.9.2"
"0.9.3"
"0.9.4"
"1.0.0"
"1.0.1"
"1.1.0"
"1.1.1"
...
"1.8.1"
"1.8.2"

Describe the solution you'd like
Ideally these would be version-sorted (similar to what is done on the /simple page)
Additional context
yes, I realize maps technically shouldn't have an ordering -- though it would be much more convenient for my usecase if these were sorted :)

As you said, I'm not sure it really makes sense to attempt to order the mapping (either in Python or in JSON).
A better approach might be to add a new field (perhaps something like release_ordering) which provides the the versions for each release in an ordered list.
It might be worth mentioning that if you need to order versions, the packaging module provides a canonical way to do it as well: https://packaging.pypa.io/en/latest/version/

Yep! See #4049

That patch does use packaging like suggested.  I think changing the api is a bit out of scope for a cosmetic issue.  It seems according to the code that the ordering is intentional here (I had to modify an existing orderby to correct the issue) and that the current output is a bug.  Fortunately, warehouse only targets python3.6+ so orderings of mappings are maintained.  Or do you disagree, notably that an improvement to ordering here is not actually an improvement at all?
I see this issue as almost an identical issue to #2574 (which was considered a bug), just with a different view.

@asottile Ah, sorry for being unclear. I was suggesting that you use the packaging module in whatever is consuming this API instead.
The /simple page is a bit different because HTML is inherently ordered.
That said I'm not opposed to adding a new field to the API here, but perhaps it would be more reasonable to just expect consumers to do the sorting themselves.

Are you opposed to my current patch?  It's clearly sorted today just sorted wrong.

@asottile Yes. While most times keys in JSON seem deterministic, there's nothing actually guaranteeing that a given serializer/deserializer maintains that ordering, so attempting to enforce it here and suggesting that consumers trust that ordering doesn't really make sense.

There is a guarantee though, warehouse is running python3.6 which has ordered mapping types.

There is a guarantee though, warehouse is running python3.6 which has ordered mapping types.

While Python has ordered data types, there is no guarantee that the json module is going to retain the ordering of the mapping, or that in the general case whatever is parsing the JSON is going to retain the ordering of the keys in the JSON.
This is an important maintainability question, because while dicts are guaranteed ordered now, since the JSON module doesn't guarantee it will follow that order that means potentially any upgrade to Python, even a point release, may break this functionality (and thus anyone depending on it).
I also believe the patch in question isn't going to work, because our JSON serializer calls the json module with sort_keys=True, In order to get deterministic output from the JSON.

That said, json is specced to respect the order of mappings passed so I don't think there's a maintainability issue there: bpo-6015 / PEP0372 (^F "json module")

while possible, and I think an improvement -- I no longer need this


Use --with-libxml instead of --enable-libxml for PHP 7.4

Fixes #1019.

Coverage increased (+0.07%) to 40.23% when pulling b84eb447831ed15e0b97553494408e9a54a7efb8 on morozov:issues/1019 into 93e8d0a97862c4e4cac85462861ae17a8cacd5ce on phpbrew:master.


[no-jira] Update raw strings to fpo and remove alert composables

📲 What
We found a few more strings that need to be localized. to make swapping them out easier, i removed the string literals and replaced with the xml fpo.
Also removed the flags compose functions, since they are unused because they're now largely generated by the backend
🤔 Why
PPO!
📋 QA
Proof read the strings, make sure theyre correct
Story 📖

no-jira

:warning: Please install the  to ensure uploads and comments are reliably processed by Codecov.
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 67.69%. Comparing base (209c7d1) to head (83d6261).

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@             Coverage Diff              @@
##             master    #2123      +/-   ##
============================================
+ Coverage     67.59%   67.69%   +0.09%
- Complexity     2194     2199       +5
============================================
  Files           367      367
  Lines         22619    22619
  Branches       3255     3255
============================================
+ Hits          15290    15311      +21
+ Misses         5575     5553      -22
- Partials       1754     1755       +1

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


custom relational widget

Is there a way to access the state of other widgets via props on a custom widget?
How does the relational widget achieve this?

You can't access the state of other widgets currently. The relation widget uses the query and queryHits props to access the values of other entries, but not other values within the current entry.
Closing, but please reach out on Gitter with any other questions!


Update James' PPP

Some minor edits

Wait ah don't merge this first

Oh next time use the draft-pr, didn't know you still updating it.


chore: update ViewInspector dependency

Codecov Report

Merging #39 (e2f3619) into main (a3506d4) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main      #39   +/-   ##
=======================================
  Coverage   61.74%   61.74%
=======================================
  Files           4        4
  Lines         149      149
=======================================
  Hits           92       92
  Misses         57       57

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a3506d4...e2f3619. Read the comment docs.


Add heapless benchmark comparison

https://crates.io/crates/heapless provides heapless::IndexMap  and IndexSet

@pinkforest good idea! can you please submit a PR?

PR's up

#123

@pinkforest looks like we are losing :) any idea, how to fix this?

heapless uses buffer via it's stack Vec for all of it's insert()
Side note: It also uses safe mem::swap to find / replace existing but that doesn't affect this bench
e.g.
pub fn insert(&mut self, key: K, mut value: V) {
        if let Some((_, v)) = self.iter_mut().find(|&(k, _)| *k == key) {
            mem::swap(v, &mut value);
            return;
        }
        let target = self.next;
        self.pairs[target].write(Some((key, value)));
        if target == self.next {
            self.next += 1;
        }
    }

Side note 2: heapless also provides Result<T, E> as it's fallible


Using NHNetworkTime for Cocoa application

Hi there—I'm looking to use NHNetworkTime for a macOS application. Other than removing references to UIKit, do you have any other suggestions for my conversion? I replaced the UIApplicationSignificantTimeChangeNotification with NSSystemClockDidChangeNotification and commented out similarly replaced the foreground/background notifications.

This open source doesn't support other platform than iOS. So please forked it or add it manually then update it as you mentioned. Thank you!


Error with enable_diag.py

Hello,
I'm trying to execute enable_diag.py on board CYW920819EVB-02 but I had this error
Traceback (most recent call last):
File "enable_diag.py", line 5, in
s.send(b"\x07\xf0\x01")
socket.error: [Errno 22] Invalid argument
Any idea of this error?
Thank you

Hi
I faced to the same issue, I think you need to rebuild a edited Linux kernel to fix it.
you can see here:
https://github.com/francozappa/bias/issues/3
Hope it will help you

@DuCkBlAcK thanks for answering!


Feature: Handle RediSearch version specific feature

Add a feature to detect RediSearch version to handle RediSearch capability depending on the version.
Some RediSearch features are not available in all versions of RediSearch 2.x
To prevent sending incompatible request to RediSearch server, it would be create to catch those incompatibilities at the lib level.

To get the RediSearch version the command INFO Modules with a bit of filtering should give all the needed information, or a generic configuration added to all objects

This protective behavior should be deactivable, as it can cost (especially the RediSearch version requesting in Redis)

The RediSearch version detection is implemented (since c904606f4800c803216587b3d4349c84a907e754) in: https://github.com/MacFJA/php-redisearch/blob/c904606f4800c803216587b3d4349c84a907e754/src/Redis/Initializer.php#L93
(Usage: $version = \MacFJA\RediSearch\Redis\Initializer::getRediSearchVersion($redisClient))

All Redis commands for RediSearch have a parameter in their constructor to specify the version of RediSearch

High level classes (\MacFJA\RediSearch\Index and \MacFJA\RediSearch\Suggestions) use the version detection internally.

Issue is kept open until the release of the version 2.0.0


Expandr-4736 update SDK to match a bug fix in the api

LGTM, if you could manually test the changes, that would be awesome - thanks!


Implement get_absolute_url() on BaseModel

Proposed Changes
Base models should always provide get_absolute_url() so that each model doesn’t have to hard-code this as well.
e.g. This should suffice:
class BaseModel(models.Model):
    def get_absolute_url(self):
        return reverse(get_route_for_model(self), args=[self.pk])

Justification
Since we’re aligning around pk for all objects, then this is even easier in that we know the app_label and model_name for the model, so we can automatically have something like above. We could just as easily align around the natural_key_slug (see: #2900) as well (e.g. args=self.natural_key_slug should we so desire).
More importantly, this is another boiler plate reduction. The majority of model objects are using {app_label}.{model} as their detail route name, and pk as the unique identifier in detail routes, so this would eliminate most places where get_absolute_url() is required to be defined in the common case.

Models that currently do not have a detail view at all, and hence no immediately appropriate get_absolute_url implementation:

RelationshipAssociation
All ComponentTemplateModel subclasses (RearPortTemplate, etc.)

Models that currently do not have a detail view at all, and hence no immediately appropriate get_absolute_url implementation:

RelationshipAssociation
All ComponentTemplateModel subclasses (RearPortTemplate, etc.)

Can we implement this in BaseModel and just pass/throw exceptions for these two cases until we have detail views for these (or reverse to a more sane detail view to view these?).

Closed with #3632


GitHub embed cards have apostrophes and other symbols rendered in HTML code

Steps to Reproduce

Embed a GitHub card with descriptions that have things like apostrophes—words like "don't"
Observe that they're rendered in HTML code (')

Attachments

What platform(s) does this occur on?
Android
Device Info
Google Pixel 8
What version of the app are you using?
Build version: <IP_ADDRESS>3; Bundle info: 0ac7c0962 (prod); Bundle date: 24111005; Platform: android
Additional Information
No response

Had a chance to look into this a little. It looks like it might be something related to the data parsing on bluesky's side. I can see the request URL going to the cardyb.bsky.app/v1 endpoint and we're getting the partially encoded string back in the response body. I'm wondering if the correct move here is to fix this in the API layer rather than try and compensate in the front end.
{
    "error": "",
    "likely_type": "html",
    "url": "https://github.com/bluesky-social/social-app/pull/6307",
    "title": "Increase strength of check for post stats guard by estrattonbailey · Pull Request #6307 · bluesky-social/social-app",
    "description": "Some folks noticed during the outage earlier today that quoteCount wasn\u0026#39;t returned on responses, which caused this section to display with no contents. This PR checks for the existence of these...",
    "image": "https://cardyb.bsky.app/v1/image?url=https%3A%2F%2Fopengraph.githubassets.com%2Fbd8c9e278981dbeaabe5b7a5cc572e73d1518422bb0aeff69ec9de8afa330601%2Fbluesky-social%2Fsocial-app%2Fpull%2F6307"
}


Fix adding private repository

imageRepos field was removed and the project no longer tries to compose image strings. Now the libraries use $.values.common.images to override default images.

Thanks! :100:


Shrink/expand selection isn't working corretly in Python

Issue Type: Bug
When shrinking/expanding the selection (Shif+Alt+Left/Right) within a function in Python, the expansion isn't working correctly.
This is an example:
def start_hash_checker():
    # type: () -> None
    """Start hash checker using prog_launcher.

    () -> None
    """
    if not lcl.msgs['SELECT_HASHES_FILE'] in top_level_windows():
        script_name = ('uniclave_hash_checker.py'
                       if isfile('uniclave_hash_checker.py')
                       else 'uniclave_hash_checker.pyc')  # type: str

        # cmd_line = sys.executable + ' ' + base.APP_DIR + script_name  # type: str
        cmd_line = (dirname(sys.executable) + r'\pythonw.exe ' + base.APP_DIR
                    + script_name)  # type: str

        fops.save_txt(cmd_line, bpl.PROGS_TO_LAUNCH_PN)
        # TODO: Error handling.

If I'm on the cmd_line and press Shift+Alt+Right several times, it should select the current line (including the continuation), then the current block inside if (including) and then the current block inside def (including).
But that is not what is happening.
It starts be selecting portions of the line then the continuation of the line and then it jumps to select the all file.
And the opposite (when shrinking) also occurs (Shift+Alt+Left).
VS Code version: Code 1.30.0 (c6e592b2b5770e40a98cb9c2715a8ef89aec3d74, 2018-12-11T22:29:11.253Z)
OS version: Windows_NT x64 6.1.7601

System Info

Item
Value

CPUs
Intel(R) Core(TM) i7 CPU       Q 720  @ 1.60GHz (8 x 1596)

GPU Status
2d_canvas: enabledchecker_imaging: disabled_offflash_3d: enabledflash_stage3d: enabledflash_stage3d_baseline: enabledgpu_compositing: enabledmultiple_raster_threads: enabled_onnative_gpu_memory_buffers: disabled_softwarerasterization: unavailable_softwarevideo_decode: enabledvideo_encode: enabledwebgl: enabledwebgl2: unavailable_off

Memory (System)
7.93GB (0.83GB free)

Process Argv

Screen Reader
no

VM
0%

Extensions (6)

Extension
Author (truncated)
Version

Bookmarks
ale
10.0.0

vscode-great-icons
emm
2.1.46

git-project-manager
fel
1.7.1

python
ms-
2018.12.1

partial-diff
ryu
1.4.0

code-settings-sync
Sha
3.2.4

We are in the process of defining extension API for this. Once that's is done, extensions can provide correct data. Something our heuristics cannot.


cover with tests the SeleneCollection features as being Enumerable, e.g. Linq's .First method, etc.

SeleneCollection does not have .First property as a shortcut for [0], but it implements Enumerable, and so all Linq methods should work. Question - will it work as expected including all "dynamic and lazy" nature of Selene? Cover all such features with tests to ensure proper behavior ;)

https://github.com/yashaka/NSelene/pull/66

https://github.com/yashaka/NSelene/pull/66


Tutorial about adding Oauth?

I would like to build apps with Adonis.js that feature "Login with Linkedin" or "Login with Spotify".
Is there a tutorial out there to help developers build oauth applications with Adonis? What are the steps involved?
Thank you!
PS
I followed the Auth0 tutorial by @unicodeveloper and it was very helpful with adding email/password auth. Now wondering about social login

@connor11528 Ofcourse you can build Oauth login using the vendor specific SDK's. If you are looking for a more streamline in-built solution, I am afraid there is no official package for that.
I am currently working on it and you can expect it to be launched in next 15-20days.

Awesome thank you so much!

@thetutlage are you still working on the OAuth implementation, for Facebook specific?

@theobouwman Yes, it is at the top of my tasks list after 3.1 release.

@thetutlage can you give me an indication how long we have to wait for it? I'm willing to help

@theobouwman May be around a week or 10days.

@thetutlage okay nice.

Any updates on this question?

Adonis ally has been released a while ago http://adonisjs.com/docs/3.1/social-auth


(Feature Request) Default particle for classes/wands

I'm wondering if it would be possible to assign a default particle to certain classes or wands, the same way players can set their 'effect color' for the Redstone/Dust particles in the survival configs.
I ask because I'm currently working on a spell-crafting interface (i.e. letting players create their own entirely custom spells in-game through the use of variables, attributes, & checkrequirements) and the only thing I can see getting in the way currently is letting them choose their spell's effects.
It would be really handy if we could either set default particles the same way 'effect color' works so that by not including a particle in the spell config, it will default to whatever the player has chosen to set their default particle to!
better yet, though likely more complex, would be to see if adding String variables/attributes is possible as asked here, as this could mean defining particle names such as 'flame' or 'end_rod' inside of attributes or variables, to be called back in the spell's config. something like:
  effects:
    cast:
      - particle: $chosen_particle
        location: target
        particle_count: 9

This is pretty much exactly what i was looking for, thank you so much!! I'll run some tests to see if I can work this into the spell-crafting via ModifyProperties and changing the wand's effect_particle. Thanks again!!


SVG file not imported correctly

Preflight Checklist

[x] I agree to follow the Code of Conduct that this project adheres to.
[x] I have searched the issue tracker for a feature request that matches the one I want to file, without success.

Describe the bug
I have 2 valid and almost identical SVG files, one can be imported as expected, but the other one looks empty after import.
This is not a visual issue with the editor, the result is the same when I export the diagram as pdf.
To Reproduce
Steps to reproduce the behavior:

File > Import from > Device ...
Select svg file

Expected behavior
I expect both images to appear.
Screenshots

draw.io version:

18.0.7

Desktop:

Firefox for Ubuntu
Version  100.0 (64-bit)

Additional context
Not working SVG:

Working SVG:

I don't find any issue with these files, they are both working well with other applications.

Thanks for the report. This will be fixed in the next release.


[ADLS Gen2] Filesystem - Set Properties support in storage SDK

https://docs.microsoft.com/en-us/rest/api/storageservices/datalakestoragegen2/filesystem/setproperties
Current blocker:
Setting headers from Request to Http client.
Setting headers from Http client to Response.
Http pipeline support.

Scope:
Validation and Documentation API support is included.

Done.


[SELF-HOSTED]

Bot does not respond to commands.
I have given the discord bot full permissions, and have added it to my server (when adding, the console logs of the bot being on also showed this) however the bot does not respond to any commands. I am trying in the general channel of my server

I have now tested the same bot in discord developer panel, but used a old program I wrote in python instead of the aternos bot. And it works.

Reload discord. Commands can take a while to register.

I have tried that and it does not work. However when I add the public bot it registers commands instantly

It's the exact same binary program though. Are you sure the bot is online and has proper permissions to access the channel? Maybe it does register the commands but you just can't see them.

I created a new basic discord server, and generated the link to give the bot for admin privileges, started the bot, it registers the joining of the server, but does not register any commands, or respond to them.

You probably forgot to set the correct permission in the oauth url when you added the bot to the server.
See https://github.com/sleeyax/aternos-discord-bot/issues/14#issuecomment-1107033646


Only run check tests on nightly

@bors: r+

:pushpin: Commit 9f78add has been approved by alexcrichton

r? @brson
(rust_highfive has picked a reviewer for you, use r? to override)

:hourglass: Testing commit 9f78add with merge 3262934...

:broken_heart: Test failed - status-appveyor

@bors: retry
On Sun, Dec 25, 2016 at 3:25 PM bors<EMAIL_ADDRESS>wrote:

💔 Test failed - status-appveyor
https://ci.appveyor.com/project/rust-lang-libs/cargo/build/1.0.703
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/rust-lang/cargo/pull/3457#issuecomment-269141535, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAD95J3E7mR3HMMlYXYQ2Ewas0dY8roVks5rLvtQgaJpZM4LVeaC
.

:hourglass: Testing commit 9f78add with merge eb4a93c...

:sunny: Test successful - status-appveyor, status-travis
Approved by: alexcrichton
Pushing eb4a93c87be05889fdd32496f6ca45f884e5b803 to master...


This plugin is currently broken

The plugin does everything except paste the image file into the folder of the MD file. I am on the latest version of vs code as of today.

Claiming the plugin to be broken with no context is not very helpful, unfortunately.  If you can use a standardized issue reporting format, we might be able to help:
# <title>
<!--- Provide a general summary of the issue in the Title above -->

## Expected Behavior
<!--- Tell us what should happen -->

## Current Behavior
<!--- Tell us what happens instead of the expected behavior -->

## Possible Solution
<!--- Not obligatory, but suggest a fix/reason for the bug, -->

## Steps to Reproduce
<!--- Provide a link to a live example, or an unambiguous set of steps to -->
<!--- reproduce this bug. Include code to reproduce, if relevant -->
1.
2.
3.
4.

## Context (Environment)
<!--- How has this issue affected you? What are you trying to accomplish? -->
<!--- Providing context helps us come up with a solution that is most useful in the real world -->

<!--- Provide a general summary of the issue in the Title above -->

## Detailed Description
<!--- Provide a detailed description of the change or addition you are proposing -->

## Possible Implementation
<!--- Not obligatory, but suggest an idea for implementing addition or change -->

@harrisitservices Could you offer the context information of you computer?
@stvhwrd I like your reporting template very much! It would very help when fix problem.


Support auto-generated FP8 meta for CKPT converters.

Thanks for the PR! Can we also update the README to reflect these changes?

Updated


[Fix] mount: children: include text nodes

Fixes #2265.

cc @hahnbi

Thank you for the quick turnaround!

The test changes mean that this might be considered a breaking change for mount .children() specifically, but I'm considering it a bugfix.


[CI] Upgrade cuda versions

Stack from ghstack (oldest at bottom):

-> #1068

Not needed for now


Failure: 'Not a test file' is misleading when the executable is missing

I have a python test file that I'm running through vim-test. Once in a while I forget to source my virtual environment which sources the libraries installed, like nosetests. I don't have it installed globally.
https://github.com/vim-test/vim-test/blob/fd9fb9b29c265d86fa30c672df1fea9a5a757860/autoload/test/python/nose.vim#L5-L13
I manually debugged this function and confirmed that I stepped into if fnamemodify(a:file, ':t') =~# g:test#python#nose#file_pattern, meaning that the test file was valid according to nose.
I also found out that it returns executable('nosetests') which returns 0. Which makes the test#determine_runner ignore that runner.
https://github.com/vim-test/vim-test/blob/fd9fb9b29c265d86fa30c672df1fea9a5a757860/autoload/test.vim#L114-L128 (test#base#test_file(runner, fnamemodify(a:file, ':.')) is 0 so the runner is not determined.
I find that it's slightly misleading to error Not a test file since it passed the regex validation but did not found the executable.
https://github.com/vim-test/vim-test/blob/fd9fb9b29c265d86fa30c672df1fea9a5a757860/autoload/test.vim#L14

Thank you for raising this, I see your point and will investigate if there is a way to return a different message if the executable is not present

Same here. Till not activated the virtual environment (through vim-virtualenv) I got error Not a test file. As soon as activated, all it's fine.
Even with unittest, which is global (and default).

Same here. Till not activated the virtual environment (through vim-virtualenv) I got error Not a test file. As soon as activated, all it's fine.
Even with unittest, which is global (and default).

A got a similar issue with a JS test, because the executable jest was not in the path. It took a while to understand that, because the error message was misleading.


Increase the minimum-matching threshold

Description:
In the below line:
https://github.com/ballerina-platform/ballerina-lang/blob/fc34e7ad5e2bec97dc2372d442da3606c21f3e92/compiler/ballerina-parser/src/main/java/io/ballerinalang/compiler/internal/parser/AbstractParserErrorHandler.java#L86
Consider increasing the threshold. That will help to remove junk tokens, as opposed to trying to match them to a possible grammar-rule. It will act as a noise filtering.
Some possible threshold: 20% matches out of total traversed distance.

Requires to add
case EOF:
    return ParserRuleContext.EOF;

For XML parser's getNextRule() method.

This issue has been marked as "Deferred" and will be revisited in the future when resources are available.


Rsync exclude/include rules

Our current implementation allows for configuration based rsync include and exclude patterns, but has a very confusing strategy of re-rooting the source copy based on the inclusion pattern, and then only specifying the exclusion patterns in the rsync format. We have discussed that allowing for a backup to have a relative root at a subdirectory on a target machine causes some other issues with exclusion rules, and also then backup destination hierarchies.
For these reasons, and to reduce confusion when writing rules, I'd like to adjust the way that we specify these inclusion and exclusion patterns. I personally feel like the exclusion and inclusion rules for rsync are challenging to understand (order matters) and I'd like to adjust our configuration in an attempt to meet typical backup strategy needs with a bit more ease. I'm open to discussion on this before any implementation, but my current thinking on this subject follows:

Our config files don't need a 1-to-1 match to the rsync parameters. I am thinking we have 3 categories of settings:

The top-level directories to be added to the backup. (Ideally top-level, but really any level can be specified). All of these patterns need to be inspected to ensure absolute paths, and adjusted to contain trailing double stars.
The file extensions to be ignored always. These need to be inspected to never specify absolute paths, and adjusted begin with wildcards (single star).
Specific file or directories to be ignored. Ex] /home/sgdavis/.steam. These patterns need to be inspected to ensure absolute paths, and no wildcards.

Require users to opt-in any top-level directories that they want to include in the backup. For example, most everyone will want /home and probably /etc/ but generally other top-level directories can be skipped.

To achieve this, always append --exclude="*" as the last exclude pattern
Ensure pattern order is correct, these includes need to follow any file extension excludes, specific file excludes, and precede the final exclude wildcard.
Also, this behavior could be overridden if desired, by specifying --include="/**" to include all top-level directories

From the rsyncwrapper module, it looks like anything provided as a src attribute in rsyncOptions will be pushed onto the arguments list first, then excludeFirst options, then include attributes, then finally, exclude attributes.
So we will have to change how we define src since we currently have it containing the array of all include options.
Current solution is to provide the src as user + '@' + machineIP, include as the top level inclusion patterns appended to user + '@' + machineIP + ':' , excludeFirst as both file extensions and specific files/directories to ignore, and exclude as --exclude="*"

These options have been implemented and pushed to code base.


Build(deps): Bump react-icons from 5.2.0 to 5.2.1 (#5795)

Pull request opened by the merge tool on behalf of #5795

Merged in 37a065d8c4fb0f4cf6c8b59d6d8429227514cd03


Align 'justified' in text gameobject

Version

Phaser Version: last Phaser 3 Sandbox

Operating system: Windows 10 64 bit

Browser: Chrome 71.0.3578.98 (64 bit)

Description

Justified style not work in Text GameObject.
In Phaser docs:
https://photonstorm.github.io/phaser3-docs/Phaser.GameObjects.Text.html
setAlign(align)
Set the text alignment.
Expects values like 'left', 'right', 'center' or 'justified'.
Example Test Code

Open Phaser3 labs
http://labs.phaser.io/edit.html?src=src/game objects/text/static/multi line text with alignment.js
Replace text style with    align: 'justified'
Align becomes like align left
Expected text bocomes justified

Additional Information

Thank you for submitting this issue. We have fixed this and the fix has been pushed to the master branch. It will be part of the next release. If you get time to build and test it for yourself we would appreciate that.

Works perfect.
Usage: set text style { fontFamily: 'Arial', color: '#00ff00', align: 'justify' }
Pay attention for align: 'justify' NOT 'justified'


Function make_widget is deprecated

Using the mininified version of your library I get the following warning:
gridstack.js: Function `make_widget` is deprecated as of v0.2.5 and has been replaced with `makeWidget`. It will be **completely** removed in v1.0.

Regarding the problem with the debugger, I see that in the gridstack-angular.min.js, there is the following line:
 this.addItem = function(t) {
            return r ? (r.make_widget(t),
            t) : null
        }

Similar for remove_widget.

Some methods were marked as deprecated in gridstack v0.2.5. I've already fixed that in master. :+1:

Cool, but could you make that these changes also are reflected in bower install ? If you could that would be awesome!

@Tiagojdferreira Done. https://github.com/kdietrich/gridstack-angular/releases/tag/v0.4.0


PT Whois Domain Reg Skipped

Domain reg detail is skipping PT Whois results when direct Whois fails, and falling through to VT Whois.
Order is Direct Whois -> PT Whois -> VirusTotal .whois

fixed in 1fdaba0


HTTP sink connector not working

      input_data_format             = "JSON",
      connector_name                = "http-sink-connector",
      tasks_max                     = "1",
      connector_class               = "HttpSink",
      behavior_on_error             = "ignore",
      http_url                      = "https://xyz",
      http_method                   = "POST",
      auth_type                     = "BASIC",
      user                          = "@then@",
      password                      = "@@@@"

How to work with HTTP Sink Connector?
Whenever i'm posting some events on the topic, all the messages are going to the error queue and say these errors:
% Headers: [input_record_offset="10" input_record_timestamp="1688039068207" input_record_partition="0" input_record_topic="cns-test" error_message="Exception while processing HTTP request for a batch of 1 records." exception="Error while processing HTTP request with Url : htt"(1665 more bytes) response_content=nil status_code=nil payload="{name=xyz}" reason_phrase=nil url="https://xyz"(17 more bytes)]
"Retry time lapsed, unable to process HTTP request. HTTP Response code: null, Reason phrase: null, Url: https://xyz, Exception: javax.net.ssl.SSLHandshakeException: No appropriate protocol (protocol is disabled or cipher suites are inappropriate), Error message: Exception while processing HTTP request for a batch of 1 records."
% Headers: [input_record_offset="11" input_record_timestamp="1688039180931" input_record_partition="0" input_record_topic="cns-test" error_message="Exception while processing HTTP request for a batch of 1 records." exception="Error while processing HTTP request with Url : htt"(1709 more bytes) response_content=nil status_code=nil payload="{name=dummy}" reason_phrase=nil url="https://xyz"(17 more bytes)]

Actually, previously it was giving javax.net.ssl.SSLProtocolException but when i disabled SSL, now it's giving me this javax.net.ssl.SSLHandshakeException

Update: After changing the TLS version to TLSv1.2, somehow it worked.


Simplify get_func(); don't bother importing local functions

Codecov Report

Merging #557 into master will not change coverage.
The diff coverage is 100%.

@@           Coverage Diff           @@
##           master     #557   +/-   ##
=======================================
  Coverage   87.62%   87.62%
=======================================
  Files           5        5
  Lines         509      509
  Branches       85       85
=======================================
  Hits          446      446
  Misses         50       50
  Partials       13       13

Impacted Files
Coverage Δ

taggit/utils.py
91.56% <100%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f040c5f...ba82642. Read the comment docs.


Next features to build

Salam!
I have made a quick survey that you can find here and sent it to people that wrote to support with the assumption they'd be more receptive. Here is the top 3 features people really care about:

Copy with tashkeel. This is the #1 request
Go to ayah, and only that ayah
Social media sharing (share range of ayahs or one ayah).

These are obviously somewhat missing from the new Quran.com that was in legacy.
Annoying things people are complaining about:

Site stability
Audio (I have NO idea why audio is an issue, but it seems like it is and we need to fix this)

What do people want built next on Quran.com?
It's scattered. But right now seems that website speed and stability is a common trend, then people want nice things like bookmarking and better search.
What other products next?
ask.quran.com
audio.quran.com
learn.quran.com
These are the top picks so far. ask.quran.com is a problem I personally face and wish it was solved in a better and more effective way, I think we could most definitely build a prototype for it and see where it goes.
What to do next:

There are things we need to address right away: speed and stability.
Add the requested features (copy/paste, and the single ayah). Social media needs a little more thought and we should probably consult someone
Put up links or beta email collection pages to gauge interest for the next products to build

Let me know if you'd like to see the results yourself

@reshadn @ahmedre @sharabash @bshama @redhae @dsog

Salams. Thanks for this breakdown. I'd love to see the results and I'm curious how many people filled out the survey, did we capture email addresses? I'm new so I apologize for the noob questions. Do we have an email list for "beta" testers or active users who are willing to test things out and give more feedback?
re: site speed and stability - have we been able to determine if the main issues are on mobile browsers? slow networks? specific browsers? heavy load times (not sure what our numbers are like today). Some of this should be easier to capture via pagespeed on the client or other tools on the BE.
Looking forward to it iA!

@reshadn: https://docs.google.com/spreadsheets/d/1_7GNyB1fyiQo3IGfz_1JlnMuADvJhiRnrcoDcGkTmzc/edit?usp=sharing
Now about 25% of people emailed filled it out. We don't have a list of beta testers to be honest, we previously just subdomained things. I wanted to use optimizely to feature flag things but unfortunately our traffic is so high that we fall under many top tier plans for many products.
I have a deploy coming up that will help with site speed and stability (we kept crashing cause of a search bug).
I will test it more too

I don't know how happy people will be about their emails being publicly available like that  (Y) Else looking good

Good catch. I am going to hide this then..

Email me personally for results<EMAIL_ADDRESS>

1# Focus on making the site stable! The bismillah is still broken :'( it's heart breaking to see, as this is most likely the most used quran website, and having that part broken is very critical...
Feature suggestions:
#1. Memorization module. (& encouragment to learn&study X ayah a day)
#2. One guy requested being able to turn word-by-word off (this should ofcourse be possible / and / or change to bangladesh as we have this data , also we have the translitteration word-by-word data.).
#2.1 Wordmorphology integrated (the corpus.quran data).. Do this through the API so others can use it...
3. Copy arabic text (also with tashkeel)
4. Geolocation (and put the standard languages accordingly). Ask for permissions to geolocation OR use IP.
5. Maybe prompt a guide? (look at the way intro.js does it here on github)  as I see some people are having a hard time changing language.
6. Maybe some kind of "share" button, where when clicked, it asks to share through, email, pinterest, facebook, twitter, etc.
7. Provide documentations for API
8. People are requesting more translations and tafseer. I really think you should all translations etc. to Github in a seperate REPO, and keep note of all typo etc. fixes there.  Maybe make a site like Tanzil (i don't know if tanzil still is updating their site!!) or start working with them!
9. More reciters. Do we have all reciters from "versebyverse" ?
10. Many requests for Apps. Since you're already using angular, would it be too much of an hassle  to make an iOS, Windows and Android app in a framework like ionic ?
11. A lot of requests on improving the Search feature!! Have a look at alfanous  and their search engine :-)
12. Speed requests... Make sure all is gzip, minified, cached, on cdn, etc.
13. Tag and bookmark. Do loginsystem and let users signup fast with Facebook, Twitter, Steam, Github, etc.  This way we can also engage them when not being active for long time (and they should be able to turn this off)
15. For now, tajweed font is not possible with the current setup (the fonts), but should not be forgot :-)
Bug list:

People complaining about audio not working. Maybe this is on mac osx / safari??
Last word is jumping in readmode on mouseover, which is really annoying, i see another guy complained about this AND emailed you about it. I also complained about this :P

About new concepts:
There seem to be a majority that wants you to focus on quran untill it is completely stable and perfect.
Also I think the ask.quran.com unless we can acquire trustworthy scholars, it would be a very bad idea to facilitate bad knowledge.  Marriage platform, could risk to much fitnah as well... Food & Masjid could be VERY nice . But let's focus on the quran site for now!! Please do give feedback about the feature suggestions and if it is something you plan to do! Maybe set up everything in a CRM system so there is better structure of tasks, and add team members to control who should do what (so you do not forget).
Most of feature suggestions is review of the excel sheet :-)

@ATouhou all look good!
Perhaps let's find the most important 3 things and perhaps you can help us with getting the data and I can clean/download it?

Bugs have been fixed... we are literally just waiting to push and deploy. Stability is because:
legacy.quran.com has seen no changes in a very very long time. Quran.com is changing every week and we dont have the proper infrastructure or time for it! We need more time :(

Indexed English tafseer ibn kathir and word-by-word audio in arabic (with tajweed and just standalone word) on recitequran.com ! I've contacted them a couple of times and they said they will consider making everything open-source.  The alim.org refused to share their tafseer ibn katheer.
I think if you contact them with a @quran.com email they might share it...
I have a danish translation of the Qu'ran that was recently released and I cleaned it so that each ayah is on 1 line. But I am looking for an approval from a "scholar" in Denmark, before releasing it, so it does not contain anything wrong!! (The translation is called "Den klare koran")
We sadly have mostly only translations done by kufaar in Denmark.
Another translation by a danish "scholar" (Shahid Mehdi islamqa.dk) is awaiting approval and will then be released. I can make sure to "clean it" when it is released :-)
The turkish translitteration would be a great add. GlobalQuran.com have resources to download for free. Also word-by-word translitteration and bangladesh was provided by the other github guy :-)
Have you considered putting up all tasks on a CRM system to monitor what to do, so nothing falls "between the cracks" ?
For the 80% of words:
https://drive.google.com/file/d/0B4VHPzkqEV3KUjZNN2VEajdfXzQ/view?usp=sharing
https://drive.google.com/file/d/0B4VHPzkqEV3KOGotbUJ5enI2b2s/view?usp=sharing

Yeah I contacted recitequran.com and no luck with that. They don't want to share it.
Alim.org sent me an email today and said contact the original authors, CC: @ahmedre

@mmahalwy  Actually original author has put the site on github hhhhhhhhhhhhhhh it's based on joomla but has everything except the tafseer!

i could scrape everything, i have done it before, but we like to be cool with others and not be the evil people with a flashy domain. So, I like the scratch each other's back than scrape!
And I really want the english ibn kathir :(

There is nothing wrong with scraping the public data. We share it fisabillilah and are not making 1cent on it!  If you search github you will see there is already 2-3 Scrapers for sunnah.com as there is a demand for the informations even though the terms of conditions says don't scrape! .
Anyway we can copy+paste tafseer ibn kathir for each ayah / page manually from a PDF (I have it and can provide it) or do the process automaticly and scrape the data....
Really up to you.
Also the brother over at muflihun.com  have some good tafseer and translations.
We should also be carefull to not add any tafseer that Ahlus sunnah wal jama3a have warned against!!

Hmm, it's a tough decision that I don't have an answer for. On one side, we can create our own data for everything (scrapping, etc etc + paying a qari for the audio) and on the other is trying to push through and convince people to share their data. It's annoying, I mean we say and are happy to share our database, for example, only if someone personally requests it (so we have some small control over what happens). Last thing we want to do is people take it and use it in the wrong way, or take it and try to rebuild quran.com with ads!
I think it's an interesting conversation and I really hope with our good intentions we can solve this problem within the community.
As for the Ibn Kathir, I don't know if there is a good PDF scrapper? Maybe that will help? Have you searched to see if there is Ibn Kathir scrappers? I previously scrapped all the word-by-word audio for Recitethequran but now refused to use it unless they just say 'OK'. That's all I need!

Ofcourse. I really think we should continue to push the guys at recitequran and alim.org.
I really do not understand a muslim, refusing such an opportunity to gain free hasanat by others work...
I understand having some control over it, like the decision  by the android app team, removing the source code to prevent people to releasing verisons with ads / malware etc.
I think all data should be so widely accessible that people can choose whatever platform they wish. At any point in Sha Allah we get hasanat even from the works of others when sharing our data.
Also providing the API for people, will ensure some authentic data for all and easy setup for other connected platforms .
The tafseer (ibn kathir) isen't , verse by verse, but it is more build up in chapters for verses/pages. The question also relies how to structure the data. Append each aya to a "chapter id" and maybe also an offset to this.  -> or bind some data to a signle ayah... I think the first example is best..  We can take the data from PDF or from an existing site. I don't really care, as long as our intentions are pure and to provide a service for the ummah, fisabillilah.
I also scraped all pictures and sound from recitequran.com :-)  The audio I got for verse-by-verse was is 1.10 GB on 18,079 files while the tajweed audio files is 0.99GB and 14,905 files.
Maybe we should contact Wisam Sheriff who recorded the audio and hear his opinion and make him talk to the "shareislam" team?
How is your current translation & tafseer files set up?? could you share the SQL structure so I know how to set it up if it becomes relevant?

so here are some random thoughts about scraping and what not:

for said people specifically, this is not an option - Mohamed tried taking some data from one of these sites before and we got a very strongly worded angry email about it (and rightfully so, since we didn't ask permission) - they asked us to remove the content. they were unwilling to negotiate anything, unless we accepted joining underneath their organization (i.e. being "acquired" by them).

you give the example of sunnah - since i am friends with the brothers who run it, i can tell you that they are unhappy about scraping, especially because lots of the people who scrape the data put it in apps that they add ads to (or sell for profit) - it feels unjust for them to spend all this effort getting lots of volunteers to type up these books and then give them for free, only to have someone take them and sell them and make money on their work and the work of the volunteers.

one of the other issues with data is that you can't easily propagate changes when people are using your data and mistakes are found (ex in translations, etc). another issue is copyright - even though i don't like the idea of islamic copyright, this is a concern i have (especially since some of the translations we have in Quran Android and quran.com have copyrights, and we weren't able to convince their owners to let us use them - we left them though because we were never asked to explicitly take them down). we have been asked to remove content from quranicaudio before, and that we did do, however.

for Android, we never closed the data (the repository for the pages is still open, and the rest of our data is coming from tanzil and other sites that we link to in the about) - we just closed the actual app to try to decrease the shady things people do or have done with it.

one last point which i do understand - even if you're only in it for thawab and zero worldly reasons for things, you want people to come to your site (i.e. it costs $0 to visit a website - why should they visit website x instead of our website?) - and the same with their team.
given that we are bigger than them (by virtue of having the domain alone), they have little reason to give us their data, because it basically causes them to have no use for their website.
regarding speaking with br Wessam - this was one of the things we were planning on doing, and, as a fallback, we're thinking about how we can get our own recording from a sheikh to put on quran.com.

@ahmedre

If we scrape the data (can be done behind VPN if anxious about being tracked),  they can't track the origin of the data. Those groups shareislam and alim do not own the tafseer ibn kathir, nor the publishing right or anything. It will just save us some headache to index the data by scraping their site. The volunteers should be happy that the work is shared and their hasanat is multiplied by the billions!

If the brother made it open-source more people could develop applications for it,  his rewards will be multiple even more!  Even if the sick people who shares it does it solely to sell the data for a small price.
2&3.Also if he made it accessibly more easy, he could make an email signup to download the data! If any changes/fixes/new releases he can just send an email to all the developers asking them to fix it ASAP.

Okay yes. Makes sense :-)

I think any muslim should strive to make it the best and collaborate in doing so.  In the specific case with recitequran.com  ,  quran.com won't be able to use the tajweed sounds nor make an coloured tajweed font  due to the technology chosen to solve it (recitequran.com is using images and not fonts).
Personally I use recitequran mostly to read and quran.com to lookup ayah fast / share ayah / light reading.
At any point a muslim should do the best to help his "competitor" as we all do it fisabillilah and for the ummah!!!   Is it not pure nifaaq to call yourself "shareislam" yet to refuse to share islam??!!
I'm so mad right now!! may Allah protect us and make our intentions solely for his sake.  Ameen

My opinion on some of the issues discussed on this thread:

GitHub issues is the best CRM or project management system that I have seen yet, so let's stick with it.
Let's do one thing and do it well (or perfect), instead of trying to do lots of things but none of them is OK. So, let's focus first on doing right the Quran (fixing bugs and some neccessary basic features), and then we can think about "ask", "audio", "learn", and other advanced features.
It is a good thing that the back-end (data) and the front-end (UI) are clearly separated and communicate through an API. This allows for other applications to be built on the future, using the same API. But I think that this API should be well defined and well documented (maybe I am not properly informed about this).
I think that the data should have such a licence that allows the others to reuse it, but forbids them to abuse it. Maybe somebody will try to abuse it, but they should know that they are violating the licence and someday they may be taken into account for it. Maybe Creative Commons or something like this can be suitable, but I am not an expert on licence issues.

I am eager to learn about and use the quran.com api mentioned in this thread, and once I figure it out, I can dedicate time to document it (if not documented already). I am very detail oriented, and can do a good job in that.
I want to build a site for quranic arabic learners, and for the sake of ease (details mentioned to br @mmahalwy in email) I plan to start out with https://github.com/idris/django-quran. But I do want to be part of this circle as well, and contribute wherever I can. I am a long time follower of the quranic corpus.
By the way, I am still looking for the word by word english translation that was used on quran.com (and many other site). I would appreciate if you could share it, or point to me to elsewhere that I can obtain it.
Thanks for all and keep up the good work (sorry for kind'a out of subject post)
Mehmet

I plan to start out with https://github.com/idris/django-quran

Thanks for pointing this out. I can find there the Arabic text and English translations of the Quran.

Not the word by word one.

Have you checked this: http://corpus.quran.com/wordbyword.jsp
There is also an API: http://corpus.quran.com/java/
Maybe this is what you need.

Yes, I have. I don't want to clutter this thread (as this out of subject), but, that seems like a downloadable java archive. Does not include data, or information on how to hoop up to a live server. Thanks for trying to help.

@mmattdugan I can give you a dump of the word translations and Arabic words
and stuff like that, I.e. the relevant tables in postgresql. basically the
translations we scraped from Quranic corpus many years ago so it might be
out of date/out of sync with the current corpus but in sha Allah I can
provide you with a sql dump or plain text utf8 CSV dump of a relevant view
for you to parse. will this work?
On Tue, May 17, 2016, 8:24 PM Dashamir Hoxha<EMAIL_ADDRESS>wrote:

Have you checked this: http://corpus.quran.com/wordbyword.jsp
There is also an API: http://corpus.quran.com/java/
Maybe this is what you need.
—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
https://github.com/quran/quran.com-frontend/issues/145#issuecomment-219773165

Please. Thanks a lot.

Assalamu alaykum ikhwaani,
Akhi @mmahalwy, you seem to have some control over decisioins. Here are my 2 cents. I developed https://muflihun.com from scratch and collected a lot of data and displayed only authentic tafaaseer and translations (as far as I know) (as you can see on the site) so if you need any data to improve quran.com, I will in shaa Allah share it.
We are one ummah (on top I am not author of anything or anyone who can claim 100% copyright on any islamic resource) and only Allah subhaanahu wa ta'ala can reward us in true sense and on Him we truly rely.

@mkhan3189 mashallah! That's awesome! You have a great website :) I can definitely see how we can collaborate in terms of content. Have you checked out github.com/quran/quran.com-api ?

@mmahalwy no not yet but will in shaa Allah check it later

OK everybody my little Quran application is live here: http://quran4.me/
It consists of two packages which are open sources in my github account:
https://github.com/doganmeh/quranfal
https://github.com/doganmeh/django-quran
What does it do?
Helps people who try to understand quran. Mark the words that you know and don't and it gives you report of i) the frequency of the word ii) what percentage of the Quran you understand and not. Basically click UNDER the word to mark as KNOWN, and ABOVE the word to add to your STUDY list. Click ON the word itself to go to details such as grammar information as well as other places that the word is in the Quran. There is also word-by-word meaning that you see if you HOVER over the word, but of course it does not work on the touch devices such as smartphones. There is also whole-aya meaning given when hovered over the aya-end marks.
I am also working on a flash card widget that will help review words in the study list. It is at its infancy  as I deployed it a few days back, but I hope it will grow up to include just about everything for Quranic Arabic learners and help people learn Quran's meaning by reading it.. Please check it out and let me know what you think..
ps. It is in beta stage, but I will do my best to preserve data... so you can go ahead and start using it..
Mehmet


DbtLocalArtifactProcessor attempts to access dbt_project["target-path"] but target-path is not present in the dbt_project dictionary

Having the same error as the issue #533, but i am not using OpenLineage. I am running airflow on EKS.
Setting the target-path in the dbt_project.yml is deprecated as described in docs. I also tried to set it in dbt_cmd_global_flags but did not worked.
[2024-02-26, 12:39:55 -03] {log.py:232} WARNING - [[34m2024-02-26T15:39:55.020+0000[0m] {[34msubprocess.py:[0m94} INFO[0m - [35m(astronomer-cosmos)[0m - [0m15:39:55  Done. PASS=1 WARN=0 ERROR=0 SKIP=0 TOTAL=1[0m
[2024-02-26, 12:39:55 -03] {subprocess.py:94} INFO - [0m15:39:55  Done. PASS=1 WARN=0 ERROR=0 SKIP=0 TOTAL=1
[2024-02-26, 12:39:55 -03] {log.py:232} WARNING - [[34m2024-02-26T15:39:55.521+0000[0m] {[34msubprocess.py:[0m98} INFO[0m - [35m(astronomer-cosmos)[0m - Command exited with return code 0[0m
[2024-02-26, 12:39:55 -03] {subprocess.py:98} INFO - Command exited with return code 0
[2024-02-26, 12:39:55 -03] {taskinstance.py:1935} ERROR - Task failed with exception
Traceback (most recent call last):
  File "/root/.local/lib/python3.8/site-packages/cosmos/operators/base.py", line 246, in execute
    self.build_and_run_cmd(context=context, cmd_flags=self.add_cmd_flags())
  File "/root/.local/lib/python3.8/site-packages/cosmos/operators/local.py", line 370, in build_and_run_cmd
    result = self.run_command(cmd=dbt_cmd, env=env, context=context)
  File "/root/.local/lib/python3.8/site-packages/cosmos/operators/local.py", line 244, in run_command
    self.calculate_openlineage_events_completes(env, Path(tmp_project_dir))
  File "/root/.local/lib/python3.8/site-packages/cosmos/operators/local.py", line 281, in calculate_openlineage_events_completes
    openlineage_processor = DbtLocalArtifactProcessor(
  File "/home/airflow/.local/lib/python3.8/site-packages/openlineage/common/provider/dbt/local.py", line 58, in __init__
    absolute_dir, dbt_project["target-path"], "manifest.json"
KeyError: 'target-path'
[2024-02-26, 12:39:55 -03] {taskinstance.py:1398} INFO - Marking task as UP_FOR_RETRY. dag_id=dbt_cosmos_datamarts, task_id=dm_busca_parcelas_run, execution_date=20240226T150634, start_date=20240226T153908, end_date=20240226T153955
[2024-02-26, 12:39:55 -03] {standard_task_runner.py:104} ERROR - Failed to execute job 724 for task dm_busca_parcelas_run ('target-path'; 65190)
[2024-02-26, 12:39:55 -03] {local_task_job_runner.py:228} INFO - Task exited with return code 1
[2024-02-26, 12:39:55 -03] {taskinstance.py:2776} INFO - 0 downstream tasks scheduled from follow-on schedule check

Hey @PrimOox, do you mind setting the env var OPENLINEAGE_DISABLED to True? That should stop the open lineage code from running if you're not using it.

it's already setted but did not make difference

@PrimOox which version of openlineage-integration-common do you have? This is likely to have been fixed in openlineage-integration-common>=1.2.0
https://github.com/astronomer/astronomer-cosmos/issues/533#issuecomment-1720907853

@PrimOox which version of openlineage-integration-common do you have? This is likely to have been fixed in openlineage-integration-common>=1.2.0 #533 (comment)

openlineage-integration-common==1.9.1
openlineage-python==1.9.1
openlineage_sql==1.9.1
opentelemetry-api==1.20.0
astronomer-cosmos==1.3.2

@PrimOox, there is something strange. Your stack trace has the error:
"/home/airflow/.local/lib/python3.8/site-packages/openlineage/common/provider/dbt/local.py", line 58, in __init__
    absolute_dir, dbt_project["target-path"], "manifest.json"
KeyError: 'target-path'

I checked in multiple versions of the OpenLineage package being used, and the latest version of the code does not have this code in line 58:
https://github.com/OpenLineage/OpenLineage/blob/1.9.1/integration/common/openlineage/common/provider/dbt/local.py
I tried to map to older versions; the "newest" one I could find with this was 1.1.0:
https://github.com/OpenLineage/OpenLineage/blob/1.1.0/integration/common/openlineage/common/provider/dbt/local.py
Is there any chance you're using an older version of the package openlineage-integration-common in your deployment? The error you're facing does look like a duplicate of #533.
Cosmos 1.3.2 uses this OpenLineage to define the inlets/outlets URIs, regardless of whether OpenLineage is enabled. As a workaround, you could set in the render config:
RenderConfig.emit_datasets = False

However, I'd love to have more details about this error - since the package version code you shared does not match the stack trace.

I confirmed with @PrimOox that the file
/home/airflow/.local/lib/python3.8/site-packages/openlineage/common /__init__.py

I confirmed with @PrimOox that the file /home/airflow/.local/lib/python3.8/site-packages/openlineage/common /__init__.py
Contains __version__ = "1.1.0"
Upgrading this to a release => 1.2 will solve the issue.

in fact I had old packages that were conflicting, so I cleaned everything, re-installed and now it's working.
Also, a workaround is to set target-path: "target" in dbt_project.yml instead of target-path: ["target"]. But the best practice is to clean old packages.
Thanks for the help @tatiana !


feat: Added Several Datasources Part 2

Part 2 of #618  (Sorry in advanced for the big PR)
Implemented following DataSources (which can be later on used to iterate over other resources):

Stages
File Formats
Sequences
Streams
Tasks
Pipes
Masking Policies
External Functions
External Tables
Warehouses
Resource Monitors
Storage Integrations

Test Plan

[x] acceptance tests

References
https://docs.snowflake.com/en/sql-reference/sql/show.html
*

/ok-to-test sha=a0fc150

@alldoami Streams Acceptance Test fixed. Not sure why the warehouses, resource_monitors and storage_integrations are failing. Locally against my Snowflake account it works (see screenshot below), can you take a look if it fails again?

/ok-to-test sha=0ac99db

@alldoami Can you take a look why the warehouses, resource_monitors and storage_integrations are failing? Locally against my Snowflake account it works

@alldoami Did some research and it seems that the depends_on in the acceptance tests is triggering it, maybe it works locally on my side because I'm using TF 1.02? I found that there is a Test parameter for this PreventPostDestroyRefresh and I've added this, it still works locally on my side. Maybe you can run the integrations tests again to see if that helps? Thanks in advance.

/ok-to-test sha=94a8884

@alldoami I was able to reproduce this locally. This tests are failing indeed due to the depends_on  in datasource but ONLY  in Terraform prior to 0.13. This was solved in version 0.13 (See https://github.com/hashicorp/terraform/issues/17034) . When I use terraform prior to 0.13 like 0.12.31 I get the same error as in the integration run.
What are the options here, is it possible to upgrade to >0.13 ? If not what do you suggest we do to make these tests pass? I really do need these datasources atm.

I'll upgrade tf for testing! Could you get rid of your workaround 😅

@alldoami Done!

/ok-to-test sha=6887b89

@alldoami Can you run it again? Seems it failing for no apparent reason?

/ok-to-test sha=6887b89


ja: Make docs/concepts/overview/working-with-objects/labels.md follow v1.17 of the original text

This is a Feature Request

What would you like to be added
Update docs/concepts/overview/working-with-objects/labels.md to follow v1.17 of the original (Englist) text.
Why is this needed
content/ja/docs/concepts/overview/working-with-objects/labels.md is outdated.
Comments
/language ja
/good-first-issue
File to update
https://github.com/kubernetes/website/blob/dev-1.17-ja.2/content/ja/docs/concepts/overview/working-with-objects/labels.md
Original
https://github.com/kubernetes/website/blob/release-1.17/content/en/docs/concepts/overview/working-with-objects/labels.md
diff between translated and v1.17
https://gist.github.com/7766686ac8ed380d7e0bb9382b1c3f1d
Note
Currently, we use dev-1.17-ja.2 branch. Please open a PR targeting the branch.
ref
How To Contribute
翻訳スタイルガイド
If you have a question, feel free to ask us at slack.k8s.io #kubernetes-docs-ja channel.

/assign @ryokotmng

マージしていただいたのでクローズしておきますね！

/close

ぬ、できなかった😇すみませんがおまかせします。

/close


Buttons component is very weird

OS Windows
Node.js 8.12.0
Vuesax 3.5.10
Browser Chrome
Which package manager did you use for the install? npm Vue CLI

The icons it's not centralized when i use vs-radius. When i remove the class below it's back to normal
 .includeIconOnly {     width: 38px!important;     height: 38px!important; }
Maybe it has to do with using 'pixels' and 'important'. Should not be use 'rem' to be responsive and decrease along with the browser?
And when we click in the button the color be over the icon... You can see it in your own docs.

In version 3.5.12 the icon in button not appear anymore

@periscuelo The acronyms were deleted in the properties vs for example of vs-icon now it is only icon please try to see

In version 3.5.7 The icons it's not centralized anymore. But yes, appear in 3.5.12 when i adjust the acronyms.
Thanks

Could you pass me an image of the error?

I made a small project using vuesax. Maybe you can make download and run in localhost with Vue CLI 3 before update the version 3.5.6 and after in 3.5.12 Maybe it can be more pratice to you see if the problem exists or if i made something wrong. Can be?

Vue Spotify

I use rem and not pixels to get the sizes, to work better when its be responsive. That's the cause above.
When i seted material icons font size to 16px, everything works normaly. Thanks.


Crypto benchmark

Benchmarking suite for the cardano-crypto-praos and cardano-crypto-class packages. Currently benchmarks only the Simple and Praos VRF implementations.

Merged via https://github.com/input-output-hk/cardano-base/pull/180


Option to exclude -azdata from appname suffix

Is your feature request related to a problem? Please describe.
I would like to connect to a controlled database that only allows specific application names
Describe the solution or feature you'd like
Please add an option to exclude the "-azdata" from the suffux when using a custom Application Name in an MSSql connection
Describe alternatives you've considered
No alternative, this is hard-coded?
Additional context
Code is here, sorry I do not know the typescript language so well. Is there a way to specify the suffix?: string in the adjustForMssqlAppName function?
src/sql/platform/connection/common/connectionProfile.ts
Line 78:
this.options[Constants.mssqlApplicationNameOption] = adjustForMssqlAppName(model.options[Constants.mssqlApplicationNameOption]);

and
src/sql/platform/connection/common/utils.ts
export function adjustForMssqlAppName(currentAppName: string, suffix?: string): string {
	let appName = suffix ? applicationName + '-' + suffix : applicationName;
	let finalSuffix = '-' + appName;
	return (currentAppName && currentAppName !== appName && !currentAppName.endsWith(finalSuffix))
		? currentAppName + finalSuffix
		: currentAppName ?? appName;
}

Hi @rayzinnz
This is by design. Azdata in appname is used for telemetry purposes.


Better footer

- Summary

- Test plan

- Description for the changelog

- A picture of a cute animal (not mandatory but encouraged)

Deploy preview processing.
Built with commit 2946feb9284afdaedd647a2f7ff69f4220f1cabc
https://app.netlify.com/sites/open-sauced/deploys/594378758ebdd905eeafa847