Thread safe

I am building a recommendation system with tensorrec on a tornado server. When i run the system sync, it works fine. But when i run this async tornado server, i get an error saying:
    ValueError: Fetch argument <tf.Operation 'make_initializer_3' type=MakeIterator> cannot be interpreted as a Tensor. (Operation name: "make_initializer_3"     op: "MakeIterator"     input: "TensorSliceDataset_3"     input: "Iterator_3"     attr {       key: "_class"       value {         list {           s: "loc:@Iterator_3"         }       }     }      is not an element of this graph.)
Is it the problem that the library is not thread safe? or am i missing something here?

Hey @alimaan2935 -- Thanks for reporting! Is there a full stack trace for that error? The lack of thread safety may be within TensorRec or within the TensorFlow ops themselves, so I'd like to isolate the culprit.

Thanks for quick reply. This is the the complete stack trace:
`[I 180830 08:31:34 tensorrec:589] Processing interaction and feature data
[E 180830 08:31:34 base_events:1259] Future exception was never retrieved
future: <Future finished exception=ValueError('Fetch argument <tf.Operation 'make_initialize
3' type=MakeIterator> cannot be interpreted as a Tensor. (Operation name: "make_initializer_3"\n
: "MakeIterator"\ninput: "TensorSliceDataset_3"\ninput: "Iterator_3"\nattr {\n  key: "_class"\n
lue {\n    list {\n      s: "loc:@Iterator_3"\n    }\n  }\n}\n is not an element of this graph.)'

Traceback (most recent call last):
  File "C:\Python35\lib\site-packages\tensorflow\python\client\session.py", line 282, in __in

__
fetch, allow_tensor=True, allow_operation=True))
File "C:\Python35\lib\site-packages\tensorflow\python\framework\ops.py", line 3339, in as_g
ph_element
return self._as_graph_element_locked(obj, allow_tensor, allow_operation)
File "C:\Python35\lib\site-packages\tensorflow\python\framework\ops.py", line 3423, in as
aph_element_locked
raise ValueError("Operation %s is not an element of this graph." % obj)
ValueError: Operation name: "make_initializer_3"
op: "MakeIterator"
input: "TensorSliceDataset_3"
input: "Iterator_3"
attr {
key: "_class"
value {
list {
s: "loc:@Iterator_3"
}
}
}
is not an element of this graph.
During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Python35\lib\site-packages\tornado\gen.py", line 1141, in run
    yielded = self.gen.throw(*exc_info)
  File "C:\Users\aliir\Desktop\WorkFiles\recommender-api\app\handler.py", line 55, in predict
    results = yield self._blocking_predict(data)
  File "C:\Python35\lib\site-packages\tornado\gen.py", line 1133, in run
    value = future.result()
  File "C:\Python35\lib\asyncio\futures.py", line 294, in result
    raise self._exception
  File "C:\Python35\lib\concurrent\futures\thread.py", line 55, in run
    result = self.fn(*self.args, **self.kwargs)
  File "C:\recommender-api\app\handler.py", line 49, in _blocki

_predict
results = get_real_time_recommendations(data, model)
File "C:\recommender-api\apis\recommendations.py", line 43, i
get_real_time_recommendations
model.fit(user_data, properties_data, interactions, columns_metadata_dict)
File "C:\recommender-api\algos\prediction_model.py", line 85,
n fit
epochs=self.epochs, learning_rate=self.learning_rate, n_sampled_items=self.n_sampled_item
verbose=self.verbose)
File "C:\Python35\lib\site-packages\tensorrec\tensorrec.py", line 539, in fit
n_sampled_items=n_sampled_items)
File "C:\Python35\lib\site-packages\tensorrec\tensorrec.py", line 602, in fit_partial
_, n_user_features = get_dimensions_from_tensorrec_dataset(first_batch[1])
File "C:\Python35\lib\site-packages\tensorrec\input_utils.py", line 67, in get_dimensions_f
m_tensorrec_dataset
session.run(initializer)
File "C:\Python35\lib\site-packages\tensorflow\python\client\session.py", line 877, in run
run_metadata_ptr)
File "C:\Python35\lib\site-packages\tensorflow\python\client\session.py", line 1085, in _ru
self._graph, fetches, feed_dict_tensor, feed_handles=feed_handles)
File "C:\Python35\lib\site-packages\tensorflow\python\client\session.py", line 427, in __in
__
self._fetch_mapper = FetchMapper.for_fetch(fetches)
File "C:\Python35\lib\site-packages\tensorflow\python\client\session.py", line 253, in for
tch
return _ElementFetchMapper(fetches, contraction_fn)
File "C:\Python35\lib\site-packages\tensorflow\python\client\session.py", line 289, in __in
__
'Tensor. (%s)' % (fetch, str(e)))
ValueError: Fetch argument <tf.Operation 'make_initializer_3' type=MakeIterator> cannot be in
rpreted as a Tensor. (Operation name: "make_initializer_3"
op: "MakeIterator"
input: "TensorSliceDataset_3"
input: "Iterator_3"
attr {
key: "_class"
value {
list {
s: "loc:@Iterator_3"
}
}
}
is not an element of this graph.)
`


Update index.js

Sending dataset.async to typeahead to the bundle to it identifies the asynchronous connection.
Now is great:

@raphox thanks for PR!


Mobile API keys design minor fixes

Fixed header navigation missing text.

Removed non-interactive radios options in mobile app edit form.

Added mobile icon in no results view.

Review the design @josecruz please :)

Superb @MariaCheca 💃 !!

✨


Popup improvements

This PR fixes https://github.com/CartoDB/cartodb/issues/11430 and https://github.com/CartoDB/cartodb/issues/10993.
It relays on https://github.com/CartoDB/cartodb.js/pull/1782.

retest this please


use within other scripts

hey there,
I'm writing a grunt task that generates docs and I was thinking of using groc. I was wondering if it's possible to use groc within another script as opposed to on the CLI.

I have a very rough API that you could use, though it's definitely going to be a moving target for a while.  (I'm totally happy to work with you to solidify it over time though :))
Take a look at where the CLI code builds a Project object for the low level API.
Alternatively, you can fake a command line call w/o the shell as an intermediary by including the CLI module directly, and calling it similar to the bin file - this interface is less likely to change, but is definitely more awkward.

Thinking further on this, a better and probably relatively stable API would be to decouple the argument parsing, and have a call that takes the resultant options hash - easy to configure, and also plays nicely with the .groc.json file


amend: updated deps

:tada: This PR is included in version 1.10.131 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


login/signup page creation

login/signup page for maintaining travel history and past bookings with the site. it can also store the personal info required if user makes a booking

@apu52 Please assign me this issue.
I am from JWoC'24.

@Hansawani @Sruti-sahini Welcome to the repo.
Sorry to close this issue.
Make sure to open the issues after coding period starts


Forward mouse events from the pie slice text labels so they are not lost

When PieSeries.DataLabels=True, this allows the Chart.DataClick event to be fired when clicking on the label just like clicking on the pie slice.  It also prevents the slice animation from resetting when mousing over the label.

Simple solution, I like it, I will merge, then I need to apply this solution to all charts.


Bind to observable list

What kind of change does this PR introduce?
This is primarily viewed as a bug fix since it was not expected that the existing code did not already behave this way.
What is the current behavior?
There is no way to bind out to a read-only derived data bucket and have that bucket continue to emit refresh notifications from the upstream source.
What is the new behavior?
Adds a new API for IChangeSet<T> & IChangeSet<T, K>: .BindToObservableList(out observableList). Same idea as .Bind(out readOnlyCollection).
Provides a way to bind out to a read-only derived data bucket. The new part is that this read-only derived data bucket emits refreshes from the source rather than ignore them in the case of ReadOnlyObservableCollection
What might this PR break?
This mostly adds new APIs to bind to an IObservableList. Changes have been made to RemoveKeyEnumerator<TObject, TKey> to support Refresh and Move changes. Any code that uses RemoveKeyEnumerator<TObject, TKey> has the potential to be effected. However, the changes should only be improvements rather than changing an existing expected result.
Please check if the PR fulfills these requirements

[x] Tests for the changes have been added (for bug fixes / features)
[x] Docs have been added / updated (for bug fixes / features)

Other information:

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: ryanholden8 sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

Looks great at a glance. I will look in more detail tomorrow.

Hey guys, thank you for the quick responses! I should be able to look these change requests early next week.

I will run through testing this branch this week and see if I run into any problems. If not and haven't heard any disagreement from @RolandPheasant  will merge it in.
Want to run it through it's paces just to make sure it works before merging.


Clarify why high TX Power causes intermittent operation (insufficient 3.3V LDO)

… LDO)

Thank you for this contribution.


Report errors in a way that does not hide traceback information

This approach to reporting errors:
https://github.com/pglet/pglet-python/blob/fb46af7cb63c0209ca1ac764da71bd722693af22/pglet/pglet.py#L85
... hides the tracebacks, making it hard to locate simple errors without debugging.
Alternatives would be to print the traceback explicitly (print(traceback.format_exc())), or probably better, just raise after setting the error on page.

Fair enough - thanks for the catch! I'm still new to Python 😳. I'm going to try raise approach.

Oh, well, exception raised in a separated thread is not visible to the main one. traceback.format_exc() worked though.

Yes, sorry, did not check the wider context. You could subclass Thread and store & relay exceptions, but hard to see the added value.
As a workaround for anyone waiting for the next pglet-python release, you can try-except in the main function and format_exc the traceback.

Sure, here you are: https://pypi.org/project/pglet/0.4.7/

Thanks 👍🏻


404 not found error on  Canto help docs/ swap canto help docs over

(I need to find instructions!)
https://pombase.github.io/canto_tutorial/phenotypes/genes_alleles_genotypes.md

Where was this link?

It's in @manulera  tutorial
its the link
"how to add genotypes" on this page
https://pombase.github.io/canto_tutorial/phenotypes/
We still need to switch this to be the main documentation, currently it is not linked prominently.
I needed to check that nothing was missing.
MAnu  can you remind me where the instructions are how to do the editing? I can't find them (my bad housekeeping!)

Hi @ValWood, I have fixed the broken link.
There is documentation in how to add content in the project wiki.
And the project readme shows how to run the site locally to verify that what you add will look as you expect.
If you try to work with it and don't manage, let me know and we can do a Zoom session together or something like that.
Have a nice weekend!

Thanks Manu, and you!
I might delegate this task to @PCarme !
For now, I checked to the old documentation and I don't think anything is missing. @kimrutherford  I think we should go ahead and replace all of the Canto documentation links   Manu's.
One possible addition would be "advanced mode" in the "productivity tips" but I'm not so fussed about this,  because I would rather novices did the "drill down" only.
@manulera  sorry it took me so long to review this. It is on my "big todo list" and I haven't looked at that for a while!

reopening until Kim swaps over the docs

I think we should go ahead and replace all of the Canto documentation links

PHI-Canto has customised documentation so this will need to be configurable.
@jseager7 I'll let you know what the configuration is once it's implemented.
Are there website links that need fixing too?  This issue is on the website tracker.

No I just put it on the wrong tracker!


*: rename storage package to mvcc

sorry, could you rebase after this https://github.com/coreos/etcd/pull/5188?

@gyuho ok all rebased

LGTM. Thanks. /cc @xiang90

LGTM

merging on greenlight


CMake build dependency

Since the update of oneio that switches to flate2 with zlib-ng backend, bgpkit-parser requires cmake as a build environment requirement, which is a surprise addition that might break some automatic build. We should investigate switching back to flate2 with default Rust dependency, which then revert build depedency back to only cc.
Required changes:

[x] update oneio to add feature switching between c-based zlib-ng and default rust backend
[x] test and decide which zlib backend to use in bgpkit-parser

changed to flate2 as default rust backend for gzip: https://github.com/bgpkit/bgpkit-parser/commit/7dac747908a1792bf714d5729f06fe365ff64062


Example is outdated and not runnable

Example is outdate.
For example, the correct way to get key credential now is cred := azcore.NewKeyCredential(cfg.APIToken).
And I assumed the message should have been azopenai.ChatRequestMessage, though I cannot get it work.
Pleas fix.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 4833a089-660d-364f-82a4-1fc26522b6ec
Version Independent ID: 2c415b16-f888-a44b-64d7-a9d1732dacb6
Content: Quickstart - Get started using GPT-35-Turbo and GPT-4 with Azure OpenAI Service - Azure OpenAI Service
Content Source: articles/ai-services/openai/chatgpt-quickstart.md
Service: azure-ai-openai
GitHub Login: @mrbullwinkle
Microsoft Alias: mbullwin

@ZhiyuanChen
Thanks for your feedback! We will investigate and update as appropriate.

@ZhiyuanChen
I've delegated this to  @mrbullwinkle, a content author, to review and share their valuable insights.

Thanks for the feedback. The update to the docs to address this issue have been merged internally and will go-live in the public docs tomorrow.

#please-close


Directory Handler for static files

First of all, thanks for this really good library!
With this setup:
let server = HTTPServer(port: 8080)

let root = URL(fileURLWithPath: "/Users/myUser/myStaticDir")

let route = HTTPRoute(method: .GET, path: "/static/*")
let handler = DirectoryHTTPHandler(root: root, serverPath: "static")

await server.appendRoute(route, to: handler)

try await server.start()

When I perform:
curl -L -vv http://localhost:8080/static/index.html

I'm always getting a 404.
That's because:
https://github.com/swhitty/FlyingFox/blob/8ef9eddda8f4ea370233454eded2ceded1fb76ee/FlyingFox/Sources/Handlers/DirectoryHTTPHandler.swift#L51
never matches, because request.path will always be /static/index.html, so I find this example to be wrong: https://github.com/swhitty/FlyingFox#directoryhttphandler
To make it work I had to write the handler like this:
let handler = DirectoryHTTPHandler(root: root, serverPath: "/static/")

But then I found out that if I want to also handle the default file to be index.html when not explicitly specifying it:
curl -L -vv http://localhost:8080/static/

or

curl -L -vv http://localhost:8080/static

I have to also add:
let fileRoute = HTTPRoute(method: .GET, path: "/static")
let fileHandler = FileHTTPHandler(path: root.appendingPathComponent("index.html"), contentType: "text/html")
await server.appendRoute(fileRoute, to: fileHandler)

Then I thought this is a very common scenario one would expect to work with minimal work, so I written this extension:
extension HTTPServer {
    func appendStaticRoute(_ route: String, root: URL, defaultFileName: String = "index.html", withContentType contentType: String = "text/html") {
        appendRoute(HTTPRoute(method: .GET, path: "/\(route)/*"), to: DirectoryHTTPHandler(root: root, serverPath: "/\(route)/"))
        appendRoute(HTTPRoute(method: .GET, path: "/\(route)/"), to: FileHTTPHandler(path: root.appendingPathComponent(defaultFileName), contentType: contentType))
        appendRoute(HTTPRoute(method: .GET, path: "/\(route)"), to: .redirect(to: "/\(route)/"))
    }

    func appendStaticRoute(_ route: String, bundle: Bundle = .main, defaultFileName: String = "index.html", withContentType contentType: String = "text/html") throws {
        guard let root = bundle.resourceURL else { throw HTTPUnhandledError() }
        appendStaticRoute(route, root: root, defaultFileName: defaultFileName, withContentType: contentType)
    }
}

Which allows you to achieve the same with only:
let server = HTTPServer(port: 8080)

let root = URL(fileURLWithPath: "/Users/myUser/myStaticDir")

await server.appendStaticRoute("static", root: root)

try await server.start()

And so here I am, posting this. If you think it's a valuable addition, feel free to add it in the library 🍻

Excellent! Just what I needed! Many thanks.

Thank you for reporting this discrepancy in the docs and annoyance.
I have merged a change that is more lenient when processing the serverPath making the leading and trialing / delimiters optional.
https://github.com/swhitty/FlyingFox/pull/55
I will have a think about severing a default file within the handler.


Configuration cache issue with Realm analytics

How frequently does the bug occur?
Always
Description
I get compile time error for configuration cache for the plugin.
Using REALM_DISABLE_ANALYTICS = "true" hides the issue, mentioned in https://github.com/realm/realm-kotlin/issues/1390
Stacktrace & log output
Configuration cache problems found in this build.

1 problem was found storing the configuration cache.
- Plugin 'io.realm.kotlin': external process started 'wmic csproduct get UUID'
  See https://docs.gradle.org/8.3/userguide/configuration_cache.html#config_cache:requirements:external_processes

See the complete report at file:///C:/Users/x/StudioProjects/x/build/reports/configuration-cache/39j22f6t5aki07g06f05klw9c/d8gfjfz1mjgu525rhqjspl3au/configuration-cache-report.html
> Starting an external process 'wmic csproduct get UUID' during configuration time is unsupported.

Can you reproduce the bug?
Always
Reproduction Steps
No response
Version
1.10.2
What Atlas App Services are you using?
Local Database only
Are you using encryption?
No
Platform OS and version(s)
Windows 11 Pro 10.0.22621 Build 22621
Build environment
Android Studio version: Hedgehog 2023.1.1 Beta 1
Android Build Tools version: 34
Android Gradle Plugin version: 8.2.0-beta01
Gradle version: 8.3

Hi @datikaa. Thanks for the report. I am currently looking into some other updates in the Gradle plugin, so will try to see if I can address this.

Seems to be a duplicate of #1390. I will try to see if I can reproduce it this time around 😅

Same problem here.
Environment:
Android Studio Giraffe | 2022.3.1 Patch 1
Windows 10
androidGradlePlugin = "8.1.1"
gradlePlugin = "8.1.1"
distributionUrl=https://services.gradle.org/distributions/gradle-8.3-bin.zip
realmKotlin = "1.10.0"
gradle.properties file:
# Speed up the build
org.gradle.caching=true
org.gradle.parallel=true
org.gradle.unsafe.configuration-cache=true


[New parser] Move round-trip checking logic into ASTGen

This removes one bit of code dependency on SwiftCompilerSupport, which we want to eliminate.

@swift-ci please smoke test


Change Editor to use the Changeset Diff Upload

Change from using the Element API  to instead use the Changeset Diff Upload
Per @pnorman at SOTMUS 2015 the single Element is not preferred and likely will be going away in the future

The future is not going to be the immediate future, but the diff upload should be faster with fewer individual requests as well as more resilient in cases of interrupted connections.

This functionality is already implemented under the "Bundle Data Upload(s)" parameter for the uploader geoprocessing tool. It should be the recommended way to upload local edits. If you run into upload error the user can uncheck the option so the conflict resolution editor can detect and address the potential versioning issues.


Fix timeline metric None value

Motivation
Opening PR to resolve https://github.com/patroni/patroni/issues/3164 metric bug
Added

An hba_conf entry for standby user using loopback address to resolve authentication issue in Patroni on K8's example demo environment
Ensure replica_cached_timeline returns 0 on exception to prevent patroni_postgres_timeline returning a None value as a failsafe

Testing

Tested both changes in the K8 demo environment

Resulted in successful timeline metric

postgres@patronidemo-1:~$ curl localhost:8008/ | jq .
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   456    0   456    0     0   190k      0 --:--:-- --:--:-- --:--:--  222k
{
  "state": "running",
  "postmaster_start_time": "2024-09-15 20:54:55.826305+00:00",
  "role": "replica",
  "server_version": 160004,
  "xlog": {
    "received_location": 67108960,
    "replayed_location": 67108960,
    "replayed_timestamp": null,
    "paused": false
  },
  "timeline": 1,
  "replication_state": "streaming",
  "dcs_last_seen":<PHONE_NUMBER>,
  "database_system_identifier": "7414976246274842650",
  "patroni": {
    "version": "4.0.1",
    "scope": "patronidemo",
    "name": "patronidemo-1"
  }
}

patroni_postgres_timeline{scope="patronidemo",name="patronidemo-1"} 1
# HELP patroni_dcs_last_seen Epoch timestamp when DCS was last contacted successfully by Patroni.
# TYPE patroni_dcs_last_seen gauge

Understood, thank you for pointing that out!

Pull Request Test Coverage Report for Build<PHONE_NUMBER>6
Warning: This coverage report may be inaccurate.
This pull request's base commit is no longer the HEAD commit of its target branch. This means it includes changes from outside the original pull request, including, potentially, unrelated coverage changes.

For more information on this, see Tracking coverage changes with pull request builds.
To avoid this issue with future PRs, see these Recommended CI Configurations.
For a quick fix, rebase this PR at GitHub. Your next report should be accurate.

Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 99.874%

Totals

Change from base Build<PHONE_NUMBER>2:
0.0%

Covered Lines:
14318

Relevant Lines:
14336

💛  - Coveralls


Improve LogSupport signatures w/generics

Avoid need to cast return types out of withInfo and friends.
Changelog formatting for consistent line length, .editorconfig to set automatically.

Great pick up


Mongos as systemd service

Pull Request (PR) description
Cleanup mongos setup switching from old init.d script to systemd unit.
Bumping default repo version to 4.4 for redhat++ and default version for debian-10 to 4.4.29 was necessary to siplify the code.
As 4.4 is the oldest minor version supported by mongodb this should be OK.

This change might break the mongos service in environments that are not on the latest 4.4 patch.
Although Ubuntu 20.04 distro version ( 3.8.6 ) does not break.

Would be nice if someone with SLES environment could test this. ( not covered by beaker/gitnub actions )


Using the URL of an old session without login

When I use the URL of an old session (restarted NIS/NCC) everything inside the wallet is displayed (balance, last transactions etc.). There is a warning that the node is not booted and if I try to boot it via the popup dialog, it says:
"Oops!
ERROR 106
Before you can work with a wallet, it has to be opened. To ensure that you are eligible for accessing the wallet, you have to provide the password for that wallet."
Of course I didnt expect it to work, but this is a major issue in my opinion. When you are using a URL of an opened wallet (example: http://<IP_ADDRESS>:8989/ncc/web/dashboard.html?wallet=username&account=TABCDEFGHIJKLMNOPQRSTUVWXYZ1234567890000) you should immediately be forwarded to the landing page where you can log in.

I am aware that this is no security issue, because you can't do anything with the wallet. And all the information you can see are public in the blockchain anyway.
But it is not comfortable esepcially for unexperienced users to close the wallet manually and log back in to solve the ERROR 106.
So, I would really like to have at least a forward to the landing page after ERROR 106 occurs. Or if easy to implement: Immediate forward to the landing page if URL of old session is used.

Still true for 0.5.13-BETA
Other side effects of using an old session URL without logging into the wallet:

An importance transaction (in transaction list) appears as "self transaction"
account labels are missing

http://s16.postimg.org/xhzai48ol/no_wallet_login.png


Updating the installation directory

It appears the Sketch Plugins directory location has changed since this
script was originally authored. I updated the installation location to
point to the correct directory.

Thanks!


[5.2] Str::slug and Ampersand

Just a thought, when using Str::slug it strips all special characters from a string, but it might be neat for it to replace ampersands with the word and (or localised version of the word) rather than just stripping them. Willing to create a PR if you think this is a good idea.
E.g.
// Current behaviour:
$slug = Str::slug('Training & Development'); // training-development

// New behaviour
$slug = Str::slug('Training & Development'); // training-and-development

Could be cool. Would need to go to 5.4 though.

Maybe you should just be converting the string yourself because it presents some security concerns when dealing with speciel characters.

What concerns?

I think it's a good idea.

Just notice that & translation differs (it's localized) so if this is gonna change we should be able to translate this.
But it would be cool ;)

I'm thinking this might be better handled in the app than in the framework itself.  Then localization could be used.
Something like...
$slug = Str::slug(str_replace('&', 'and', 'Training & Development');

@fernandobandeira Add a language file to laravel/laravel and then in the Str class check for the presence of a translator, and if it's there try and pull a translation for and. When no translator is present or it can't translate, just fall back to english (or maybe don't execute the replacement).

@GrahamCampbell I don't think it necessarily needs to go to 5.4. We could add it but without the translation so that in 5.2 & 5.3 it keeps the default behaviour, unless some one explicitly adds the translation? Just a thought.

Localization of single words are very hard to build correctly since there is no sentence context. You will run into agreement (a.k.a concord) which "happens when a word changes form depending on the other words to which it relates" - https://en.wikipedia.org/wiki/Agreement_(linguistics)
That Wikipedia page shows many examples in where it would be impossible to correctly translate single words from another language to English, how would you translate the Swedish "är" (something is) into Englishwithout knowing the context? You would be unable to decide between "am" (I am), "are" (you are) or is "He/she/it is".
So, if we cannot build something that can properly support translation to English; what makes us qualified to build something that would support translation to other languages? Even if we limit us to the usual western languages without pictograms and junk (read: Finnish), how would that work out?
From the Wikipedia page; "in Scandinavian languages, adjectives are declined according to the gender, number, and definiteness of the noun they modify. In some cases, predicative adjectives appear to disagree with their subjects. This phenomenon is referred to as Pancake sentences." (I wont go into pancake sentences here, but I found the term funny enough to include)

An example with an English source word; "player". What is a player? Are we talking about a video player, hockey player, someone that plays an instrument, a gambler, or someone into dating? They may all be translated differently.

There are differences between American English and British English; is it "the team has arrived" or "the team have arrived"?

A Swedish-specific issue; "A1 & A2 & B1 & B2 & C1 & C2", where you list pairs of stuff, should become "A1 och A2, B1 och B2 samt C1 och C2" because "samt" is used when dealing with pairs...

Regarding finnish:
http://i.imgur.com/nykjLZY.jpg
http://i.imgur.com/pQREfQw.jpg
https://imgur.com/gallery/NdqH7
TL;DR: Avoid localization of single words.

Third example does show issues with the word "and" so maybe let's not localise this.


Invalid SSL certificate for dpaste.de with OpenSSL

It seems dpaste.de works fine with Firefox/Chromium, but OpenSSL 1.0.2g fails to verify the certificate as it gets one with dpaste.org as common name?
$ openssl s_client -verify 1 -connect dpaste.de:443

verify depth is 1
CONNECTED(00000003)
depth=0 CN = dpaste.org
verify error:num=20:unable to get local issuer certificate
verify return:1
depth=0 CN = dpaste.org
verify error:num=21:unable to verify the first certificate
verify return:1
---
Certificate chain
 0 s:/CN=dpaste.org
   i:/C=US/O=Let's Encrypt/CN=Let's Encrypt Authority X3
 1 s:/C=US/O=Let's Encrypt/CN=Let's Encrypt Authority X1
   i:/O=Digital Signature Trust Co./CN=DST Root CA X3
---
Server certificate
-----BEGIN CERTIFICATE-----
[...]
-----END CERTIFICATE-----
subject=/CN=dpaste.org
issuer=/C=US/O=Let's Encrypt/CN=Let's Encrypt Authority X3
---
No client certificate CA names sent
Peer signing digest: SHA512
Server Temp Key: ECDH, P-256, 256 bits
---
SSL handshake has read 3662 bytes and written 433 bytes
---
New, TLSv1/SSLv3, Cipher is ECDHE-RSA-AES128-GCM-SHA256
Server public key is 4096 bit
Secure Renegotiation IS supported
Compression: NONE
Expansion: NONE
No ALPN negotiated
SSL-Session:
    [...]

    Start Time:<PHONE_NUMBER>
    Timeout   : 300 (sec)
    Verify return code: 21 (unable to verify the first certificate)
---

Thank you, and ... weird. I dont see how that could be mixed up in that direction, from .org to .de is a redirect but not the other way around. https://github.com/bartTC/dpaste/blob/master/server/nginx.conf
@The-Compiler if I try this I get this, what am I doing wrong?
verify depth is 1
CONNECTED(00000003)
write:errno=54```

Hmm, that's odd. What does openssl version say for you?
I assume the certificate is valid for both dpaste.org and dpaste.de? Maybe my OpenSSL somehow only checks the first common name in the certificate?

No they are both individual certs by LetsEncrypt and (successfully) updated at the first of every month.

Oh yeah, that was the old 0.9 version from Mac OSX. Using 1.0 from Homebrew works, and I can see a domain mismatch:
$ /usr/local/Cellar/openssl/1.0.2f/bin/openssl s_client -verify 1 -connect dpaste.de:443
verify depth is 1
CONNECTED(00000003)
depth=0 CN = dpaste.org
verify error:num=20:unable to get local issuer certificate
verify return:1
depth=0 CN = dpaste.org
verify error:num=21:unable to verify the first certificate
verify return:1
---
Certificate chain
 0 s:/CN=dpaste.org
   i:/C=US/O=Let's Encrypt/CN=Let's Encrypt Authority X3
 1 s:/C=US/O=Let's Encrypt/CN=Let's Encrypt Authority X1
   i:/O=Digital Signature Trust Co./CN=DST Root CA X3
---
Server certificate
-----BEGIN CERTIFICATE-----
MIIF+DCCBOCgAwIBAgISA50YevXoCb3GCWxq+mOm70xYMA0GCSqGSIb3DQEBCwUA
MEoxCzAJBgNVBAYTAlVTMRYwFAYDVQQKEw1MZXQncyBFbmNyeXB0MSMwIQYDVQQD
ExpMZXQncyBFbmNyeXB0IEF1dGhvcml0eSBYMzAeFw0xNjAzMzEyMzAwMDBaFw0x
NjA2MjkyMzAwMDBaMBUxEzARBgNVBAMTCmRwYXN0ZS5vcmcwggIiMA0GCSqGSIb3
DQEBAQUAA4ICDwAwggIKAoICAQC6KQkFHYxm1m9oC7gR0kYgyMnOBviv0i73c6ZD
yPZ9DOG9x2lurWdIJEFslk6nZ2A8muGd55//Y9+F3GmV6z9OcH2tgUsbNbrmu8DI
RnG0dNBhIceRapCg+zPagMte3hRtjyutRWK0yy1Sq6wDt8IjTUDDSteKdK0juEX3
zHKuJ4MSA0Ot6uW4nyd+pGxxX6LXGhMLZLaAZrkGb5ZImLxsCp2leOm2gHQehGZW
amk3+tZ8EMAzzF6FEo1XPhsJbLibwFvABTZBgOnHZO4psnUWO8Dts5t1PrE7Od2p
vzB3a70tFs65c1HRU+56OZOVuG2F3HIctLpa9bIyAfjkwojGAozh29+fR8bpPPxf
RJoJTn1h2d4lzZscght9zLbw5kxLsmYJlqxE+c4cyK2vIOhYNKdsn7W/CyxqDV7E
JDBdSRc0MSVXQ78ITYxdmccmBWUu3AcQM0pm53eKksYbUw4vlTY0ZIcz6/YYjFFb
XqJmf1ePp98fa+S9JTxmcy4xtSYll6Uk8xx//cViOqrWKVIT1YiV8701miBZdv75
xn9z6uRNisoYSx6JpFi1FHgFZwknjXorEpNISd+4/UTV0k+dp8aCrxJQug0ySoOi
NyokR2RPyFBPAy1hYup6RdpV1fqKoBiJ8NAXOY3Ugy6Q6xgksD4vcJFo4Xnr/211
FsmPQQIDAQABo4ICCzCCAgcwDgYDVR0PAQH/BAQDAgWgMB0GA1UdJQQWMBQGCCsG
AQUFBwMBBggrBgEFBQcDAjAMBgNVHRMBAf8EAjAAMB0GA1UdDgQWBBS0k3JfFe7U
zMWTUlEX96FjJz6ZBTAfBgNVHSMEGDAWgBSoSmpjBH3duubRObemRWXv86jsoTBw
BggrBgEFBQcBAQRkMGIwLwYIKwYBBQUHMAGGI2h0dHA6Ly9vY3NwLmludC14My5s
ZXRzZW5jcnlwdC5vcmcvMC8GCCsGAQUFBzAChiNodHRwOi8vY2VydC5pbnQteDMu
bGV0c2VuY3J5cHQub3JnLzAVBgNVHREEDjAMggpkcGFzdGUub3JnMIH+BgNVHSAE
gfYwgfMwCAYGZ4EMAQIBMIHmBgsrBgEEAYLfEwEBATCB1jAmBggrBgEFBQcCARYa
aHR0cDovL2Nwcy5sZXRzZW5jcnlwdC5vcmcwgasGCCsGAQUFBwICMIGeDIGbVGhp
cyBDZXJ0aWZpY2F0ZSBtYXkgb25seSBiZSByZWxpZWQgdXBvbiBieSBSZWx5aW5n
IFBhcnRpZXMgYW5kIG9ubHkgaW4gYWNjb3JkYW5jZSB3aXRoIHRoZSBDZXJ0aWZp
Y2F0ZSBQb2xpY3kgZm91bmQgYXQgaHR0cHM6Ly9sZXRzZW5jcnlwdC5vcmcvcmVw
b3NpdG9yeS8wDQYJKoZIhvcNAQELBQADggEBAEl/sl3njlyNEW+VLUnr+utKhiT7
7g+ipEW3sggromC/R+g5/cqQ6WKN4MjhF1xzHjib9wKVjI/uOf6J0sJGiJo1PWx1
2SBR5WWBHajOTNKIOT5Olhyfxn/SHpzP7K52dsJzEEfKycoDXJynGG9FheIOlXG2
Q3uSVTjmA2z7A5fp0t/2NAu3Slv3Av5DYwn1Rav4NSF1+11SLn1y6jKZZAQ8zJaK
O5NRnf3vk7k64qSbfQOBvMxyuOKEi0AJn2bO9k/MztSGhV3IJ3P2AeAyMG5CnOCv
C7vC6+LHP9um0a0BNLqgEbx0mVhfwfg3jTPb1uauAfa0j0b1L3RrYpmJmTI=
-----END CERTIFICATE-----
subject=/CN=dpaste.org
issuer=/C=US/O=Let's Encrypt/CN=Let's Encrypt Authority X3
---
No client certificate CA names sent
Peer signing digest: SHA512
Server Temp Key: ECDH, P-256, 256 bits
---
SSL handshake has read 3662 bytes and written 444 bytes
---
New, TLSv1/SSLv3, Cipher is ECDHE-RSA-AES128-GCM-SHA256
Server public key is 4096 bit
Secure Renegotiation IS supported
Compression: NONE
Expansion: NONE
No ALPN negotiated
SSL-Session:
    Protocol  : TLSv1.2
    Cipher    : ECDHE-RSA-AES128-GCM-SHA256
    Session-ID: 13BED30E2A81D656E6B99AE0777CB43E6F57D9E05FF7F25A8940A2D13B16115D
    Session-ID-ctx:
    Master-Key: 89F58273A82333717A1D77223DE274A533E4FB6E097F1471D6C7966CC3D91CD4A202271E8D443861646AF6B84870E009
    Key-Arg   : None
    PSK identity: None
    PSK identity hint: None
    SRP username: None
    TLS session ticket lifetime hint: 600 (seconds)
    TLS session ticket:
    0000 - b7 c7 2a 8a 1f 9e a8 2e-69 3b d4 b8 31 24 58 cb   ..*.....i;..1$X.
    0010 - 80 9e 05 34 76 cf c6 c2-74 a6 46 4e 9b e7 75 be   ...4v...t.FN..u.
    0020 - 56 38 1b fe 0b e7 6b 94-aa 74 31 83 9b c1 6e 4f   V8....k..t1...nO
    0030 - fb 6f 8e c9 2a 15 a3 9b-40 5e 2d 6a 02 9d d5 09<EMAIL_ADDRESS>    0040 - bc eb 55 31 28 f0 64 72-45 91 15 dd 1f b9 25 b2   ..U1(.drE.....%.
    0050 - a7 28 ae 29 71 05 35 12-1f b4 77 51 b0 de 5c 75   .(.)q.5...wQ..\u
    0060 - ab 70 14 39 ac ab 28 05-8d fb 82 09 15 3f 7f 94   .p.9..(......?..
    0070 - ea 32 c0 a9 eb 71 f5 ea-a8 fb 0a 2c 23 0f 27 55   .2...q.....,#.'U
    0080 - ea 2b c3 a6 79 35 60 f6-42 98 61 84 64 1e db 78   .+..y5`.B.a.d..x
    0090 - 2d 67 56 d1 31 f8 e2 52-e7 b4 28 ea 01 c7 b0 68   -gV.1..R..(....h
    00a0 - 61 44 a2 d8 6e f8 53 92-96 1e 8f 61 4a d9 b2 47   aD..n.S....aJ..G

    Start Time:<PHONE_NUMBER>
    Timeout   : 300 (sec)
    Verify return code: 21 (unable to verify the first certificate)
---```

I'll changed the intermediate cert. Can you try again and let me know?

Looks good now - thanks for the quick fix!


Access: Approve my own CL

Hi,
I have "+2" and "try-bot" permissions, so I can review loong64-related CLs uploaded by others. However, my loong64-related CLs need to be reviewed by others because they are working on more important things. Therefore, it takes a long time to review and merge my loong64-related CLs.
Can I "+2" my own CLs (which have been "+1" by relevant people and deployed in production)?

Unfortunately self reviews are not allowed, I think it's hardcoded in the set of gerrit rules that regulate submitting. Closing as not feasible.

Thanks!


Mobile - create global nav component

Acceptance criteria

Before tapping menu button

Logo, which leads back to home page (same as desktop)
Menu button on left

The icon is 24px by 24px by ideally the click target would be 40px by 40px but without making the padding or alignment off

When user taps menu button on right, full screen overlay appears

X button takes place of menu button
If user taps X button they return to previous screen
If user taps "Articles" (make click target the entire rectangle, not just the text), load the articles dropdown mobile page

This functions the same as the desktop articles dropdown (somehow would be nice to reference the same component?)
If the user taps back arrow, go to previous screen (original menu screen)
If the user taps X, go back to the original screen before they tapped the menu button

Links
https://www.figma.com/file/qqfeYAh6Z7QdyJXsQjIUfh/Stampy?type=design&node-id=2807%3A20106&mode=dev&t=zTwTmuq08p9ZfsM1-1

Update: mostly done, the articles dropdown part is still left

Update: Buddy needs to fix something, then he'll merge this (replace current header with new header when on mobile)

@buddy-web3 QA linked here
https://www.figma.com/file/qqfeYAh6Z7QdyJXsQjIUfh/Stampy?type=design&node-id=3076%3A9158&mode=dev&t=2noQmv2mn8MJRgSu-1

@melissasamworth please review/approve PR: https://github.com/StampyAI/stampy-ui/pull/501

update: PR pending


Gorm resolves an Object which should be nil with an unrelated other one

Reproduction given in #519 AND #520(simpler)
Description
This Bug occurs in go v1.23.10 with postgres v1.3.10.
The Bug does not appear in Gorm v1.23.4 with postgres v1.3.5

We got an User struct with ID, a Revision, a name and one Embedded Struct, which is Referenced by a pointer
type User struct {
	ID       string
	Revision int `gorm:"primaryKey"`
	Name     string
	Embed    *Embed `gorm:"embedded;embeddedPrefix:embed_"`
}
type Embed struct {
	FieldName string
}

The goal is to get the newest Object (with the highest revision) for given userIDs
In SQL (PostgreSQL) this should look like this:
SELECT "users"."id", "users"."revision", "users"."name", "users"."embed_field_name"
FROM "users"
         RIGHT JOIN (SELECT MAX(revision) AS latest, id
                     FROM "users"
                     WHERE users.id IN <userIDs>
                     GROUP BY "id") AS r ON r.latest = users.revision

Gorm generates exactly that SQL Statement. So far, so good.
In the Testcase we Create 3 Users in our Database:
	testuser := []User{
		{
			ID:       "ID1",
			Revision: 1,
			Name:     "otherName",
			Embed: &Embed{
				FieldName: "Field",
			},
		},
		{
			ID:       "ID1",
			Revision: 2,
			Name:     "jinzhu",
			Embed: &Embed{
				FieldName: "Field",
			},
		},
		{
			ID:       "ID2",
			Revision: 3,
		},
	}

I expect to get the following Response after asking for the newest Users with IDs <ID1, ID2>:
{
	ID:       "ID1",
	Revision: 2,
	Name:     "jinzhu",
	Embed: &Embed{
		FieldName: "Field",
	},
},
{
	ID:       "ID2",
	Revision: 3,
}

The problem is that Gorm actually returns following:
		{
			ID:       "ID1",
			Revision: 2,
			Name:     "jinzhu",
			Embed: // Reference to 0xc00023cb30
		},
		{
			ID:       "ID2",
			Revision: 3,
			Name:     "",
			Embed: // Reference to 0xc00023cb30
		},

Both Embed points to the same Object, even if the SQL-Statement returns Embed of ID2 as nil

@jinzhu  I created another more simple reproducer here: https://github.com/go-gorm/playground/pull/520

Any updates on this? I'm having the same issue. When joining an Association which is a pointer, it will assign the same object previously found when the result should be nil.

Upgrade gorm version, duplicated of https://github.com/go-gorm/gorm/issues/5575

The upgrade fixed the problem. Thank you.


Suggested symbols

asciimathml already supports , so why not? One usage is showing adjoint functors. Suggested input would --|, to mirror |--

This is used for showing normal subgroups, but there might also other uses. Suggested input would be <|, and |>.

Thanks for the suggestion.  For the triangle operators, my only concern would be that it might cause backwards compatibility issues, for someone who's written something like |x|>3 without leaving spaces.
FWIW, if you're using MathJax for display, you could add these symbols yourself using a custom config like:
<script type="text/x-mathjax-config">
  MathJax.Hub.Register.StartupHook("AsciiMath Jax Ready",function () {
    AM = MathJax.InputJax.AsciiMath.AM;
    AM.newsymbol({input:"--|", tag:"mo", output:"\u22A3", tex:"dashv", ttype:AM.TOKEN.CONST});
  });
</script>

I consider it a golden rule to always surround operators with spaces, but anyway ;)
And thanks for the suggestion. But because 99% of the time I look at my markup through a text editor anyway, I don't mind too much, but I would to love to see the syntax be expanded to cover more use cases.


Optional mesos_role configuration and tags

Required config to use mesos roles in marathon!
ps: We need to change some more marathon configs from the defaults.
For this I propose a generic solution to write simple string $value
to the file `/etc/marathon/conf/$key' (where the user just has to be careful not to overwrite any existing config, by a bad $key setting).
Would this be a good solution?
@ernestas-poskus ?

:ok: but would be more elegant if you would use https://github.com/AnsibleShipyard/ansible-marathon/pull/28 marathon_additional_configs

I guess 'my mistake' that I didn't wait to get this PR (27) merged before even opening https://github.com/AnsibleShipyard/ansible-marathon/pull/28  (that feature I just created today afternoon btw).
But anyway I'ld like the above PR get (stash)merged also because it is more stable in case you want to remove that  role option again  (in which case the additional configs might still need an extension, for ex. to remove config-files where an empty value was set  (instead of writing the file empty.. where I wonder what marathon is doing !) )

I see, ok thank you for contribution merging this and will release under 0.4.0


Controls not working

Hi,
I tried your code by adding myself and then downloaded your sample code also. The controls are still not working on google docs page. I tried to select radio box, but its not working.
Can you please help me, what to do?
Thanks

@hims889 I waited some time after I loaded the Google Forms pages, and the controls became responsive to actions.


FromInterface support

I found that the FromInterface interface does not support types such as [] string and [] int. If such types are passed in, you need to do the conversion yourself to [] interface {}. I would like to ask if there are any suggestions besides doing the conversion yourself.

I think the correct approach is to use reflect to obtain the type of interface like the JSON library, instead of directly using swith v. (type), which makes pointer types, arrays, and other types incompatible


create prototype for a link registry service

Create a service that accepts streams from https://github.com/bio-guoda/preston-pattern-registry
and enable the request of these streams using a microservice.
This is to enable client to listen in on the datasets that contain values that match specific pattern.
This would answer the question:
List all datasets that contain values that match pattern [any regex pattern]

hey @mielliott - I created a kafka install on preston server using steps documented at https://github.com/bio-guoda/preston-scripts/tree/master/server . This includes examples of creating a topic and sending/receiving messages.

Thanks for making this @jhpoelen! I'll check it out.

we've established that preston can be used as a basis for web services.


Add remove_volume functionality to geconfigureassetroot

It would be convenient to have an option in geconfigureassetroot to remove volumes from the list, rather than editing volumes.xml manually.

Closed via PR #737.


Include key in cloud code fails to even return the property, let alone the full data of the pointer

Calling an 'include' constraint on a query from a cloud function as defined with: Parse.Cloud.define("discovery") - makes it so the included pointer does NOT get returned in the result. As in, the property doesn't exist on the returned result. Removing the 'include' constraint, the same objects return with the property, however without the data. Code sample, below.
Running a simple query:
`var Member = Parse.Object.extend("Member");
var query = new Parse.Query(Member);

// If I comment out the include key constraints, the properties are
// returned without data. If I uncomment, the properties are not even included at     all.
query.include("chat"); // chat is a relational pointer object, Chat
query.include("user"); // user is a relation pointer object, Parse.User/PFUser

return query.find().then(function(members){
    _.each(members, function(member){
        // Chat property doesn't even
        if (member.get("chat")) {
            // Prints 100% of the time if I don't call include("chat");
            // But no data is attached.
            console.log(member.get("chat").id);
        } else {
            // Prints 100% of the time if I don't call include("chat");
            // But no data is attached.
            console.log("Member with no chat:? "+ member.id);
        }
    });
    return Parse.Promise.as(true);
});`

Make sure these boxes are checked before submitting your issue -- thanks for reporting issues back to Parse Server!

[x] You've met the prerequisites.

[x] You're running the latest version of Parse Server.

[x] You've searched through existing issues. Chances are that your issue has been reported or resolved before.

Environment Setup
Steps to reproduce
Logs/Trace

FYI - this is still running in main Parse server environment, so I assume that's running the lastest version of Parse Server.

You're running on parse.com cloud code?

@kevflynn Parse.com hosted applications do not run Parse Server.
These are "Pointer" columns?  Not relations...   This should work, if the user making the query has access to read the pointed-to objects.  You can override security by passing { useMasterKey: true } into the find() call.
Closing this as it is unrelated to parse-server.  Bug reports for hosted parse can still be opened through http://parse.com/help --  Thanks.

Thanks


Optimize fuzzer value generation to prevent duplicate values and improve coverage

Component
Forge
Describe the feature you would like
After doing some testing with the basic fuzzer I've found out the fuzzer generates lots of duplicate values.
In order to test this I created the following test which generates a .csv file with both forge fuzzer ouput and bound function ouput:
function testGenerateUint(uint a) public {
  uint b = bound(a, 0, 1_000_000*10e18);

  string memory path = "./results/FuzzUintGenerationResults.csv";
  string memory line = string.concat(string.concat(vm.toString(a), ","), vm.toString(b));
  vm.writeLine(path, line);
}

Then post-processed this information and this are the results:

Out of 256 runs, 101 of them are duplicate runs with a value already tested, I've also tried with other type of value such as bytes32 and obtained similar results.
For example, the max value of uint256 was run 33 times,  althoughI believe the number of duplicate runs may decrease in functions with more than one parameter. Focusing on numbers near 0 and near the max value for uint256 might be useful to trigger edge cases however, the fuzzer is not generating much values in mid ranges. Also, given that most deApps use 18 decimals I think it would be better to focus more on generating values in a range of for example, between 1e17 and 100_000_000e18.
I think a better approach could be:

20% of values generated should be values near 0 and max uint256 including both, to trigger edge cases.
60% of values between 1e17 and 1e25.
The remaining 20% throughout the whole uint256 range.

I could also prepare a pull request if any of the more senior contributors agrees this should be addressed.
Additional context
No response

Did not know that this was the case. Perhaps the random generation is biased (which it should be), but each draw is independent (it shouldn't be). Probably need some state per fuzzed input to know whether an extreme value was already tried.
How does the "OG" Quickcheck from Haskell draw random values?

IIRC the cause is due to the fact that the edge bias strategy is chosen too frequently relative to the number of values the edge bias strategy can actually generate. More info in https://github.com/foundry-rs/foundry/issues/3521 with my proposed fix in https://github.com/foundry-rs/foundry/issues/3521#issuecomment-1445529404
Draws are independent like you said, changing that is also a possible solution but requires tracking more data which increases memory usage and incurs a performance penalty, especially as number of fuzz runs grows, which is why my proposed solution avoids that by leveraging the dictionary

I'm closing the issue, let's keep the discussion on #3521


KAFKA-10588 update console consumer arguments for KIP-629

draft PR, more changes needed in order to ensure backwards compatibility

This was done by https://github.com/apache/kafka/pull/11008. Closing it.


Solution Testing - Staging

Hopefully, this will start by 7/23 or 7/26.  We'll ask Carlos for training but also to work through each step of the process to assist us not only with getting the 1st schema correct, but also to move Reddy forward as fast as possible.

Our target is to start moving to Staging and begin testing is Monday, July 26th.

Training and walk through of Staging setup and testing is scheduled for Friday, 7/23/21.  Setup of Reddy in Staging will be completed.

There have been multiple training sessions with Jim Duff.  Jim Duff will approve the pull request created by Joel and move Reddy into Staging.  We should find out next steps today.

Joel completed the move into Staging last week.


Work on Encodeing.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

1188 of 1204 (98.67%)  changed or added relevant lines in 27 files are covered.
6 unchanged lines in 5 files lost coverage.
Overall coverage decreased (-0.4%) to 92.797%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

src/codec/encode.rs
3
4
75.0%

imap-types/src/imap4rev1/flag.rs
0
3
0.0%

src/codec/decode.rs
223
235
94.89%

Files with Coverage Reduction
New Missed Lines
%

imap-types/src/extensions/compress.rs
1
96.23%

imap-types/src/extensions/idle.rs
1
25.0%

imap-types/src/extensions/quota.rs
1
87.5%

imap-types/src/imap4rev1/flag.rs
1
62.5%

imap-types/src/extensions/literal.rs
2
25.0%

Totals

Change from base Build<PHONE_NUMBER>:
-0.4%

Covered Lines:
8438

Relevant Lines:
9093

💛  - Coveralls


⚠ Bofrost.lu has degraded performance

In 055f1d3, Bofrost.lu (https://www.bofrost.lu) experienced degraded performance:

HTTP code: 200
Response time: 1731 ms

Resolved: Bofrost.lu performance has improved in dd91244.


Scaling of phylogeny Sagart 2019

Are we sure the scaling of Sagart 2019 is years? Computing constraints for the tree from it yields
sagart_et_al2019
Sino-Tibetan = normal(0.01, 0.00)
Kuki-Chin-Naga = normal(0.00, 0.00)
originate(Sino-Tibetan) = lognormal(-0.33, 0.97)
macr1268 = normal(0.00, 0.00)
brah1260,sini1245 = normal(0.01, 0.00)
brah1260,kuki1245,sini1245 = normal(0.01, 0.00)

Ahh, yes, oops, should be 10x


New libraries for plots

Updates:
op_plotspec (FID-A) - nice colors and shifts for different groups
osp_plotLoad - Update for GUI
osp_plotProcess - Update for GUI
osp_plotFit - Update for GUI and nice residual plot
Added:
osp_plotCoreg - Coregistration image
osp_plotSegment - Segemntation image
osp_plotScatter - Scatter plot for Osprey Overview and GUI
osp_plotRaincloud - Raincloud plot

Upps thats the right description
This adds needed libraries all the osp_plot functions and the GUI.
cbrewer - nice colors
RainCloudPlots - for osp_plotRaincloud
regression_line_ci - for confidence intervals in osp_plotScatter
uimulticollist - for Quantify tables in the G


Kubernetes Vulnerabilities New Issues

I have found new security vulnerabilities issues for Kubernetes Driver PFB fix required:-
CVE-2021-45960:-In Expat (aka libexpat) before 2.4.3, a left shift by 29 (or more) places in the storeAtts function in xmlparse.c can
lead to realloc misbehavior (e.g., allocating too few.)
CVE-2021-46143:-In doProlog in xmlparse.c in Expat (aka libexpat) before 2.4.3, an integer overflow exists for m_groupSize.
CVE-2022-22827:-storeAtts in xmlparse.c in Expat (aka libexpat) before 2.4.3 has an integer overflow.
CVE-2022-22826:-nextScaffoldPart in xmlparse.c in Expat (aka libexpat) before 2.4.3 has an integer overflow.
CVE-2022-22825:-lookup in xmlparse.c in Expat (aka libexpat) before 2.4.3 has an integer overflow.
CVE-2022-22824:-defineAttribute in xmlparse.c in Expat (aka libexpat) before 2.4.3 has an integer overflow.
CVE-2022-22823:-build_model in xmlparse.c in Expat (aka libexpat) before 2.4.3 has an integer overflow.
CVE-2022-22822:-addBinding in xmlparse.c in Expat (aka libexpat) before 2.4.3 has an integer overflow.
CVE-2021-33198:- In Go before 1.15.13 and 1.16.x before 1.16.5, there can be a panic for a large exponent to the math/big.Rat
SetString or UnmarshalText method.
CVE-2021-34558:- The crypto/tls package of Go through 1.16.5 does not properly assert that the type of public key in an X.509
certificate matches the expected type when doing a RSA.
CVE-2021-27918:- encoding/xml in Go before 1.15.9 and 1.16.x before 1.16.1 has an infinite loop if a custom TokenReader (for
xml.NewTokenDecoder) returns EOF.
CVE-2021-3114:- In Go before 1.14.14 and 1.15.x before 1.15.7, crypto/elliptic/p224.go can generate incorrect outputs, related to
an underflow of the lowest limb during the final.
CVE-2021-36221:-Go before 1.15.15 and 1.16.x before 1.16.7 has a race condition that can lead to a net/http/httputil ReverseProxy
panic upon an ErrAbortHandler abort.
CVE-2021-44716:- net/http in Go before 1.16.12 and 1.17.x before 1.17.5 allows uncontrolled memory consumption in the header
canonicalization cache via HTTP/2 requests.
CVE-2020-28367:- Go before 1.14.12 and 1.15.x before 1.15.5 allows Argument Injection.
CVE-2020-15586:- Go before 1.13.13 and 1.14.x before 1.14.5 has a data race in some net/http servers, as demonstrated by the
httputil.ReverseProxy Handler, because it reads.
CVE-2021-29923:- Go before 1.17 does not properly consider extraneous zero characters at the beginning of an IP address octet,
which (in some situations) allows attackers to bypass
CVE-2020-16845:- Go before 1.13.15 and 14.x before 1.14.7 can have an infinite read loop in ReadUvarint and ReadVarint in
encoding/binary via invalid inputs.
CVE-2021-33195:- Go before 1.15.13 and 1.16.x before 1.16.5 has functions for DNS lookups that do not validate replies from DNS
servers, and thus a return value may contain an
CVE-2021-41771:- ImportedSymbols in debug/macho (for Open or OpenFat) in Go before 1.16.10 and 1.17.x before 1.17.3 Accesses
a Memory Location After the End of a Buffer, aka
CVE-2020-29510:- The encoding/xml package in Go versions 1.15 and earlier does not correctly preserve the semantics of
directives during tokenization round-trips, which allows.
CVE-2021-38297:- Go before 1.16.9 and 1.17.x before 1.17.2 has a Buffer Overflow via large arguments in a function invocation
from a WASM module, when GOARCH=wasm.
CVE-2021-33197:- In Go before 1.15.13 and 1.16.x before 1.16.5, some configurations of ReverseProxy (from net/http/httputil)
result in a situation where an attacker is able to drop.
CVE-2020-24553:- Go before 1.14.8 and 1.15.x before 1.15.1 allows XSS because text/html is the default for CGI/FCGI handlers that
lack a Content-Type header.
CVE-2021-33194:-golang.org/x/net before v0.0.0-20210520170846-37e1c6afe023 allows attackers to cause a denial of service
(infinite loop) via crafted ParseFragment input.
CVE-2021-33196:-In archive/zip in Go before 1.15.13 and 1.16.x before 1.16.5, a crafted file count (in an archive's header) can
cause a NewReader or OpenReader panic.
CVE-2021-41772:- Go before 1.16.10 and 1.17.x before 1.17.3 allows an archive/zip Reader.Open panic via a crafted ZIP archive
containing an invalid name or an empty filename.
CVE-2020-14039:- In Go before 1.13.13 and 1.14.x before 1.14.5, Certificate.Verify may lack a check on the VerifyOptions.KeyUsages
EKU requirements (if VerifyOptions.Roots equals.
CVE-2021-31525:- net/http in Go before 1.15.12 and 1.16.x before 1.16.4 allows remote attackers to cause a denial of service
(panic) via a large header to ReadRequest.
CVE-2020-28366:- Go before 1.14.12 and 1.15.x before 1.15.5 allows Code Injection.
CVE-2020-28362:- Go before 1.14.12 and 1.15.x before 1.15.4 allows Denial of Service.
CVE-2021-44716:- net/http in Go before 1.16.12 and 1.17.x before 1.17.5 allows uncontrolled memory consumption in the header
canonicalization cache via HTTP/2 requests.
CVE-2021-29923:- Go before 1.17 does not properly consider extraneous zero characters at the beginning of an IP address octet, which (in some situations) allows attackers to bypass.
Best Regards
Prem

Thanks Prem.
alm-docker-local.artifactory.swg-devops.com/kubernetes-driver:1.4.1.dev1     --------> Helm version 3.7.2  ( 2 issues are not fixed in the image 1.4.1.dev1 - CVE-2021-44716 , CVE-2021-29923)
Tested with above image and all lifecycle of kubedriver working as expected. Below are the evidences and the test rail link
http://testrail.mul.ie.ibm.com/testrail/index.php?/tests/view/115355
Kubedriver testing for 1.4.1.dev1.zip

Link : https://github.ibm.com/TNC/tnc-o-tracking/issues/3394
The above link contains information on the latest changes made to remove the vulnerabilities

@manojn97 please don't post links to internal systems/sites here as this repository and all issues on it are public.


yarn2nix: parse "integrity" lines as SRI hashes

Fixes a bug where yarn.lock may contain multiple hashes with different algorithms
See #198312
Description of changes
yarn2nix generates invalid hash when yarn.lock lists multiple tokens in a package's integrity field. This patch introduces the npm ssri module to more exactingly parse this line
Things done

Built on platform(s)

[x ] x86_64-linux
[ ] aarch64-linux
[x] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.11 Release Notes (or backporting 22.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[ ] Fits CONTRIBUTING.md.

@moretea

https://github.com/NixOS/nixpkgs/pull/197185 hmph, just found this

closing in favour of https://github.com/NixOS/nixpkgs/pull/197185


Fixed bugs

fixed deposit function when doesn't lock in enough money than Min staking.
fixed block reward distribution name typos
Edited env constants

LGTM


don't destroy unicode environment variables

I see the problem this is solving - if you have a unicode path in your environment for example it would get smashed by the ANSI conversion.
While it looks straight forward, maybe we should clean up the path handling from fixed buffers here. The stack frame for the execute function now has 128 + 256 kb of text data, which is starting to get huge. I can merge this and put in a cleanup issue.


python missing requirement opencv

When I try to install requirements from txt it cannot find opencv==1.0.1 I looked up pypi doesnt shot package named as opencv, is it from another source?

Installing opencv-python with pip should suffice.


Incorrect unreserve destination when removing an anonymous proxy

Step to reproduce the issue

A creates an anonymous proxy B

A may get 2 DOT locked

A can then send some funds to B and add a normal proxies to B (e.g. grant C the ANY access to B)

B may get 1.5 DOT locked

Call remove_proxy to remove A's access to B

Expected behavior
A got its reserved deposit released (2 DOT)
Actual behavior
B got its reserved deposit released (1.5 DOT) by the amount of A's reservation (2 DOT, usually larger than B's reserve for C's ANY proxy), but now A is already removed from the proxy list. So its funds were locked forever.
Analysis
When creating the anonymous proxy, the creator (proxy) pays the reserve deposit, while the deposit of a regular proxy is paid by the real account. However, in the code the both deposits are summed up together and stored in the proxy info. The owner of the reservation is not distinguished. So when we remove the proxy from the original creator, the code assumes the release target is still the real account. As a result, the proxy is removed, but the creator's fund is never released and will be locked forever.
To fix the problem, I suggest to record the owner reservation and the real account reservation separately. So when removing a proxy, we can unreserve the correct amount in the right account.
Probably relevant: #9794

CC @shawntabrizi

real example

+1
This is a real issue because it creates inconsistency in the "reserve" amounts :(


Fix compatibility with redux-form v7

When using redux-form flow complains about not finding Dispatch from redux.
The only diff between flow doc and the redux def was the export keyword.
I tried my change locally and it stops complaining.
The redux-form project host its dot flow defs that's why it is not easy to
test ( it might be a flow-bin related issue) Nevertheless my PR seems a
straightforward workaround.
Le 13 oct. 2017 5:00 PM, "Georges-Antoine Assi"<EMAIL_ADDRESS>a écrit :

@GAntoine requested changes on this pull request.
Can you explain the reason behind this change? Seems the tests aren't
currently failing, and you haven't modified them alongside this change.
In definitions/npm/redux_v3.x.x/flow_v0.33.x-/redux_v3.x.x.js
https://github.com/flowtype/flow-typed/pull/1344#discussion_r144578026:

declare function createStore<S, A, D>(reducer: Reducer<S, A>, enhancer?: StoreEnhancer<S, A, D>): Store<S, A, D>;
declare function createStore<S, A, D>(reducer: Reducer<S, A>, preloadedState: S, enhancer?: StoreEnhancer<S, A, D>): Store<S, A, D>;

declare export function createStore<S, A, D>(reducer: Reducer<S, A>, enhancer?: StoreEnhancer<S, A, D>): Store<S, A, D>;

declare export function createStore<S, A, D>(reducer: Reducer<S, A>, preloadedState: S, enhancer?: StoreEnhancer<S, A, D>): Store<S, A, D>;
declare function applyMiddleware<S, A, D>(...middlewares: Array<Middleware<S, A, D>>): StoreEnhancer<S, A, D>;

Did you also mean to export applyMiddleware?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/flowtype/flow-typed/pull/1344#pullrequestreview-69256384,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAUzNaz85aDykNskh1RBo2zYMl4CHoiyks5sr3slgaJpZM4P4J9Y
.


add pre-commit hooks

Set-up pre-commit to automatically apply formatters. Once pre-commit is installed, the hooks are run automatically before any commit. Only the diff are checked, no the full code basis. If at least one hook fails, the commit is rejected. The files are left in the state imposed by the formatter, so that one just needs to git add the changes and run again git commit.
ref : https://pre-commit.com/
There are 3 commits here with different hooks added. I ran pre-commit on all files after adding a hook.

the first one install hooks to check .toml, .yaml, merge-conflicts and julia-format. No file is modified outside of .pre-commit-config.yaml
the second one adds trailing-whitespace hook. Many files are modified.
the third one adds end of files hook. Again, many files are modified.

As many files are modified, this will appear as a large commit in history, but it only needs to be done once. We may also discard some of these hooks to avoid adding too many constraints.

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (92645d9) 84.05% compared to head (2a7535c) 53.28%.

:exclamation: Current head 2a7535c differs from pull request most recent head d791018. Consider uploading reports for the commit d791018 to get more accurate results

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@             Coverage Diff             @@
##             main    #1321       +/-   ##
===========================================
- Coverage   84.05%   53.28%   -30.77%
===========================================
  Files         100       97        -3
  Lines        8544     7996      -548
===========================================
- Hits         7182     4261     -2921
- Misses       1362     3735     +2373

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

Looks good, thanks. That sounds like it will make it easier for contributors to apply the formatter. My main concern would be if it confuses novice git users, but it sounds better than the current system where it only tells you about a formatting issue after the fact. Another concern I have is if the formatter has a bug (which it occasionally does, though I haven't seen one in a while) it could block a commit, but you can tell the formatter to ignore pieces of code (https://domluna.github.io/JuliaFormatter.jl/stable/skipping_formatting/), we would just need to tell people how to do that if there are issues with the formatter. But let's try this out and see how it works in practice.

@ogauthe, I see this removed whitespace from some unicode visualization files stored in .txt files which are being used as reference images to test that functionality. I think we should have skipped .txt here, could you fix that and revert those reference images?


CRUD buttons malfunctioning when navigating from FlashcardAdd

See title please

Basically when you try to edit the decks, it brings you to FlashcardAdd screen where you can choose which flashcards to include in the list etc, and if you make edits and hit submit, it takes you to the FlashcardScreen, but it basically makes CRUD not function.

Resolved


Assignment 1

What changes are you trying to make? (e.g. Adding or removing code, refactoring existing code, adding reports)
Modified the Anagrams function to complete the assignment
What did you learn from the changes you have made?
Sometimes problems like this consider data structure first instead of algorithm, like the sorted function save a lot brain cells
Was there another approach you were thinking about making? If so, what approach(es) were you thinking of?
Were there any challenges? If so, what issue(s) did you face? How did you overcome it?
How were these changes tested?
A reference to a related issue in your repository (if applicable)
Checklist

[ Yes] I can confirm that my changes are working as intended

You have unfortunately made a pull request to the wrong repo. You shouldn't be making a pull request to uoft-dsi/python, but rather your own forked python repo.
Please read the instructions on your onboarding Assignment Submission Guide more carefully.

You have unfortunately made a pull request to the wrong repo. You shouldn't be making a pull request to uoft-dsi/python, but rather your own forked python repo.
Please read the instructions on your onboarding Assignment Submission Guide more carefully.

Hi Daniel sorry this is by accident I realized that after I submit so I redo the pull request after this, thank you!


Closes: #1

Updated validations.py python script.
Fixed the behavior of validate_user function in validations.py.
Fixes #<issue_number_goes_here>

It's a good idea to open an issue first for discussion.

[ ] Tests pass
[ ] Appropriate changes to README are included in PR

It was a very great experience for starting git!


Azure Integration with OrgChart Article Outdated

Hello,
My name is Kimmie, and I'm the Product Manager at OrgChart Now.
The article below is years out of date, and has been confusing for Azure AD customers looking to integrate with OrgChart Now.
I have updated documentation that is available on our site. I'm happy to update this documentation here, but I want to make sure that I have the permissions to do so, so that these updates can go live as soon as possible.
Please let me know the best way to go about this, as it is high priority for us to make sure information about our product and product integrations remains consistent across all platforms. You can email me at<EMAIL_ADDRESS>Thank you,
Kimmie Meunier

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: c3a5ed39-7544-ea51-d634-d9b320bd03ff
Version Independent ID: ae75ad56-9194-9b68-b4fe-330f68640839
Content: Tutorial: Azure Active Directory integration with OrgChart Now
Content Source: articles/active-directory/saas-apps/orgchartnow-tutorial.md
Service: active-directory
Sub-service: saas-app-tutorial
GitHub Login: @jeevansd
Microsoft Alias: jeedes

The changes are done and article is up to date as ISV confirmed.
So #please-close


[Iwara] Add new metadata extractors

Please follow the guide below

You will be asked some questions, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your pull request (like that [x])
Use Preview tab to see how your pull request will actually look like

Before submitting a pull request make sure you have:

[x] At least skimmed through adding new extractor tutorial and youtube-dl coding conventions sections
[x] Searched the bugtracker for similar pull requests
[x] Checked the code with flake8

In order to be accepted and merged into youtube-dl each piece of code must be in public domain or released under Unlicense. Check one of the following options:

[x] I am the original author of this code and I am willing to release it under Unlicense
[ ] I am not the original author of this code but it is in public domain or released under Unlicense (provide reliable evidence)

What is the purpose of your pull request?

[ ] Bug fix
[x] Improvement
[ ] New extractor
[ ] New feature

Description of your pull request and other information
Adds upload_date, uploader, description, comment_count, like_count, and view_count metadata extraction. New pull request opened for changes requested in #13779 as the original request referred to a deleted repo.

@dstftw Please review at your leisure.

With the recent iwara update a week or so ago, downloading from iwara with youtube-dl was broken. This was fixed in https://github.com/rg3/youtube-dl/commit/edb0e17188a1197afae1a0d594e4aab7d27bbcf2 (thank you, dstftw), but updating to that made meta-data extraction broken for me.
Using AlexAplin's extractor with the fix above pasted in made everything work perfectly again.
Not being a coder, I can't attest to how well it's actually made, but I can attest to it making everything working again, at least. Just like last time he fixed the extractor.
Thank you so much, AlexAplin!

With the recent iwara update a week or so ago, downloading from iwara with youtube-dl was broken. This was fixed in https://github.com/rg3/youtube-dl/commit/edb0e17188a1197afae1a0d594e4aab7d27bbcf2 (thank you, dstftw), but updating to that made meta-data extraction broken for me.
Using AlexAplin's extractor with the fix above pasted in made everything work perfectly again.
Not being a coder, I can't attest to how well it's actually made, and it seems that metadata extraction doesn't work for public but unlisted videos (like this one), but I can attest to it making everything working for listed videos again, at least. Just like last time he fixed the extractor.
Thank you so much, AlexAplin!

I see no problems with metadata on that specific video.

Interesting that that specific video works for you. I'll post a log of an example video that doesn't work for me, though I cut out other links from the batch file, because it doesn't seem relevant.
I'm not sure whether this one is a listed (= normal videos you find by browsing) or unlisted (= public and not set to private, but can only be found by knowing the link) one, and whether this really matters.
But this one doesn't work for me either way.
(Maybe I should post this on the issue tracker instead, though.)

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.07.21. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

[X] I've verified and I assure that I'm running youtube-dl 2018.07.21

Before submitting an issue make sure you have:

[X] At least skimmed through the README, most notably the FAQ and BUGS sections
[X] Searched the bugtracker for similar issues including closed ones
[X] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

[X] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

Full verbose output:

C:\Users\USERNAME>py -m youtube_dl -o "F:/HT/HT/VID/youtube-dl_automatic/iwara/%(uploader)s/%(upload_date)s --- %(id)s --- %(uploader)s --- %(title)s.%(ext)s" --batch-file="F:/HT/HT/VID/youtube-dl_automatic/dl_list.txt" --verbose
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-o', u'F:/HT/HT/VID/youtube-dl_automatic/iwara/%(uploader)s/%(upload_date)s --- %(id)s --- %(uploader)s --- %(title)s.%(ext)s', u'--batch-file=F:/HT/HT/VID/youtube-dl_automatic/dl_list.txt', u'--verbose']
[debug] Batch file urls: [u'https://ecchi.iwara.tv/videos/ej2xwf7nzqckvp1gg?language=en']
[debug] Encodings: locale cp932, fs mbcs, out cp932, pref cp932
[debug] youtube-dl version 2018.07.21
[debug] Python version 2.7.14 (CPython) - Windows-10-10.0.15063
[debug] exe versions: ffmpeg N-90710-gaedbf1640c, ffprobe N-90710-gaedbf1640c
[debug] Proxy map: {}
[Iwara] ej2xwf7nzqckvp1gg: Downloading webpage
[Iwara] ej2xwf7nzqckvp1gg: Downloading JSON metadata
WARNING: unable to extract upload_date; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
WARNING: unable to extract uploader; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on u'https://ruko.iwara.tv/file.php?expire=1532988348&hash=646f188d50aff30d3b112b14cd970f4a0699cf72&file=2018%2F07%2F17%2F1531830792_ej2Xwf7NzQcKvp1gG_Source.mp4&op=dl&r=0'
[download] Destination: F:\HT\HT\VID\youtube-dl_automatic\iwara\NA\NA --- ej2xwf7nzqckvp1gg --- NA --- 【r18MMD】回レ!雪月花【つみミクさん】.mp4
[download] 100% of 120.84MiB in 01:20

...
<end of log>

Example URLs:

Single video: https://ecchi.iwara.tv/videos/ej2xwf7nzqckvp1gg?language=en

Description of your issue, suggested solution and other information
The video downloads fine, but some of the video's metadata isn't able to be downloaded, specifically upload_date and uploader. I'd like these to download, too.
The file ID and filename seem to download.

Interesting that that specific video works for you. I'll post a log of an example video that doesn't work for me, though I cut out other links from the batch file, because it doesn't seem relevant.
I'm not sure whether this one is a listed (= normal videos you find by browsing) or unlisted (= public and not set to private, but can only be found by knowing the link) one, and whether this really matters.
But this one doesn't work for me either way.
(Maybe I should post this on the issue tracker instead, though.)

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.07.21. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

[X] I've verified and I assure that I'm running youtube-dl 2018.07.21

Before submitting an issue make sure you have:

[X] At least skimmed through the README, most notably the FAQ and BUGS sections
[X] Searched the bugtracker for similar issues including closed ones
[X] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

[X] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

Full verbose output:

C:\Users\USERNAME>py -m youtube_dl -o "F:/HT/HT/VID/youtube-dl_automatic/iwara/%(uploader)s/%(upload_date)s --- %(id)s --- %(uploader)s --- %(title)s.%(ext)s" --batch-file="F:/HT/HT/VID/youtube-dl_automatic/dl_list.txt" --verbose
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-o', u'F:/HT/HT/VID/youtube-dl_automatic/iwara/%(uploader)s/%(upload_date)s --- %(id)s --- %(uploader)s --- %(title)s.%(ext)s', u'--batch-file=F:/HT/HT/VID/youtube-dl_automatic/dl_list.txt', u'--verbose']
[debug] Batch file urls: [u'https://ecchi.iwara.tv/videos/ej2xwf7nzqckvp1gg?language=en']
[debug] Encodings: locale cp932, fs mbcs, out cp932, pref cp932
[debug] youtube-dl version 2018.07.21
[debug] Python version 2.7.14 (CPython) - Windows-10-10.0.15063
[debug] exe versions: ffmpeg N-90710-gaedbf1640c, ffprobe N-90710-gaedbf1640c
[debug] Proxy map: {}
[Iwara] ej2xwf7nzqckvp1gg: Downloading webpage
[Iwara] ej2xwf7nzqckvp1gg: Downloading JSON metadata
WARNING: unable to extract upload_date; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
WARNING: unable to extract uploader; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on u'https://ruko.iwara.tv/file.php?expire=1532988348&hash=646f188d50aff30d3b112b14cd970f4a0699cf72&file=2018%2F07%2F17%2F1531830792_ej2Xwf7NzQcKvp1gG_Source.mp4&op=dl&r=0'
[download] Destination: F:\HT\HT\VID\youtube-dl_automatic\iwara\NA\NA --- ej2xwf7nzqckvp1gg --- NA --- 【r18MMD】回レ!雪月花【つみミクさん】.mp4
[download] 100% of 120.84MiB in 01:20

...
<end of log>

Example URLs:

Single video: https://ecchi.iwara.tv/videos/ej2xwf7nzqckvp1gg?language=en

Description of your issue, suggested solution and other information
The video downloads fine, but some of the video's metadata isn't able to be downloaded, specifically upload_date and uploader. I'd like these to download, too.
The file ID and filename seem to download.

Third video is a problem with the way the comment count is extracted, easy enough to fix. Language causes metadata to change because the extraction depends on the language. That can be fixed by forcing the webpage retrieval to be JP. I'll fix it eventually.

Any updates?


code health ideatest

[x] tests are added or updated

Update ideatest to use the test infrastructure

Constant sizes replaced with sizeof's

Pushed. Thanks.


Build error: Undeclared inclusions of various numpy header files

Please make sure that this is a build/installation issue. As per our GitHub Policy, we only address code/doc bugs, performance issues, feature requests and build/installation issues on GitHub. tag:build_template
System information

OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Linux Ubuntu 18.04
TensorFlow installed from (source or binary): source
TensorFlow version: r1.13
Python version: 3.6
Bazel version (if compiling from source): 0.21.0
GCC/Compiler version (if compiling from source): gcc (Ubuntu 7.3.0-27ubuntu1~18.04) 7.3.0
CUDA/cuDNN version: 10.0/7.5
GPU model and memory: GeForce GTX 1070, Compute Capability 6.1, totalMemory: 7.90GiB

Describe the problem
I'm trying to build tensorflow from source to have both GPU and CPU instruction set support but I'm facing a perplexing build error about undeclared inclusions.
Provide the exact sequence of commands / steps that you executed before running into the problem
./configure
bazel build --verbose_failures -c opt --copt=-mavx --copt=-mavx2 --copt=-mfma --copt=-mfpmath=both --copt=-msse4.1 --copt=-msse4.2 //tensorflow/tools/pip_package:build_pip_package --cxxopt="-D_GLIBCXX_USE_CXX11_ABI=0"

Any other info / logs
Include any logs or source code that would be helpful to diagnose the problem. If including tracebacks, please include the full traceback. Large logs and files should be attached.
The error obtained:
ERROR: /home/nagreme/tensorflow/tensorflow/python/eager/BUILD:10:1: undeclared inclusion(s) in rule '//tensorflow/python/eager:pywrap_tfe_lib':
this rule is missing dependency declarations for the following files included by 'tensorflow/python/eager/pywrap_tensor.cc':
  'bazel-out/host/genfiles/external/local_config_python/python_include/numpy/arrayobject.h'
  'bazel-out/host/genfiles/external/local_config_python/python_include/numpy/ndarrayobject.h'
  'bazel-out/host/genfiles/external/local_config_python/python_include/numpy/ndarraytypes.h'
  'bazel-out/host/genfiles/external/local_config_python/python_include/numpy/npy_common.h'
  'bazel-out/host/genfiles/external/local_config_python/python_include/numpy/numpyconfig.h'
  'bazel-out/host/genfiles/external/local_config_python/python_include/numpy/_numpyconfig.h'
  'bazel-out/host/genfiles/external/local_config_python/python_include/numpy/npy_endian.h'
  'bazel-out/host/genfiles/external/local_config_python/python_include/numpy/npy_cpu.h'
  'bazel-out/host/genfiles/external/local_config_python/python_include/numpy/utils.h'
  'bazel-out/host/genfiles/external/local_config_python/python_include/numpy/_neighborhood_iterator_imp.h'
  'bazel-out/host/genfiles/external/local_config_python/python_include/numpy/__multiarray_api.h'
  'bazel-out/host/genfiles/external/local_config_python/python_include/numpy/npy_interrupt.h'
  'bazel-out/host/genfiles/external/local_config_python/python_include/numpy/ufuncobject.h'
  'bazel-out/host/genfiles/external/local_config_python/python_include/numpy/npy_math.h'
  'bazel-out/host/genfiles/external/local_config_python/python_include/numpy/npy_common.h'
  'bazel-out/host/genfiles/external/local_config_python/python_include/numpy/arrayobject.h'
  'bazel-out/host/genfiles/external/local_config_python/python_include/numpy/__ufunc_api.h'
Target //tensorflow/tools/pip_package:build_pip_package failed to build

My bazel build configuration:
./configure
WARNING: --batch mode is deprecated. Please instead explicitly shut down your Bazel server using the command "bazel shutdown".
INFO: Invocation ID: 78f3e435-9b41-440d-a973-946b3e60fa25
You have bazel 0.21.0 installed.
Please specify the location of python. [Default is /usr/bin/python]: /usr/bin/python3
Found possible Python library paths:
  /usr/lib/python3/dist-packages
  /usr/local/lib/python3.6/dist-packages
Please input the desired Python library path to use.  Default is [/usr/lib/python3/dist-packages]
Do you wish to build TensorFlow with XLA JIT support? [Y/n]:
XLA JIT support will be enabled for TensorFlow.
Do you wish to build TensorFlow with OpenCL SYCL support? [y/N]:
No OpenCL SYCL support will be enabled for TensorFlow.
Do you wish to build TensorFlow with ROCm support? [y/N]:
No ROCm support will be enabled for TensorFlow.
Do you wish to build TensorFlow with CUDA support? [y/N]: y
CUDA support will be enabled for TensorFlow.
Please specify the CUDA SDK version you want to use. [Leave empty to default to CUDA 10.0]: 10.0
Please specify the location where CUDA 10.0 toolkit is installed. Refer to README.md for more details. [Default is /usr/local/cuda]:
Please specify the cuDNN version you want to use. [Leave empty to default to cuDNN 7]: 7.5
Please specify the location where cuDNN 7 library is installed. Refer to README.md for more details. [Default is /usr/local/cuda]: /usr/lib/x86_64-linux-gnu/
Do you wish to build TensorFlow with TensorRT support? [y/N]:
No TensorRT support will be enabled for TensorFlow.
Please specify the locally installed NCCL version you want to use. [Default is to use https://github.com/nvidia/nccl]:
Please specify a list of comma-separated Cuda compute capabilities you want to build with.
You can find the compute capability of your device at: https://developer.nvidia.com/cuda-gpus.
Please note that each additional compute capability significantly increases your build time and binary size. [Default is: 6.1]: 6.1
Do you want to use clang as CUDA compiler? [y/N]:
nvcc will be used as CUDA compiler.
Please specify which gcc should be used by nvcc as the host compiler. [Default is /usr/bin/gcc]:
Do you wish to build TensorFlow with MPI support? [y/N]:
No MPI support will be enabled for TensorFlow.
Please specify optimization flags to use during compilation when bazel option "--config=opt" is specified [Default is -march=native -Wno-sign-compare]:
Would you like to interactively configure ./WORKSPACE for Android builds? [y/N]:
Not configuring the WORKSPACE for Android builds.
Preconfigured Bazel build configs. You can use any of the below by adding "--config=<>" to your build command. See .bazelrc for more details.
	--config=mkl         	# Build with MKL support.
	--config=monolithic  	# Config for mostly static monolithic build.
	--config=gdr         	# Build with GDR support.
	--config=verbs       	# Build with libverbs support.
	--config=ngraph      	# Build with Intel nGraph support.
	--config=dynamic_kernels	# (Experimental) Build kernels into separate shared objects.
Preconfigured Bazel build configs to DISABLE default on features:
	--config=noaws       	# Disable AWS S3 filesystem support.
	--config=nogcp       	# Disable GCP support.
	--config=nohdfs      	# Disable HDFS support.
	--config=noignite    	# Disable Apacha Ignite support.
	--config=nokafka     	# Disable Apache Kafka support.
	--config=nonccl      	# Disable NVIDIA NCCL support.
Configuration finished

We see that you are using old version of Tensorflow which is officially considered as end of life, We recommend that you upgrade to 2.5  version or later and let us know if the issue still persists in newer versions .Please open a new issue in case you face any errors, we will get you the right help .Thanks!


LN address changed from custom to random after update or recovery

Hello,
I donate for my custom LN address on version v0.1.6. After update to v0.1.7 my custom LN address changed to a random. Then I tried to enter my donated LN address and get the information this address is available and I have to make a donation of 500 SATs.
Is it possible to recover my LN address?
Edit1:
Two weeks before update I recover my wallet. I don't know if my LN address was recovered too.
I decided to donate the 500 SATs for the LN address again because I would like to support the development of Minibits. Good job team.
Edit2:
After OTA from v0.1.7 beta5 to 0.1.7 beta12 all my ecash and my LN address are away. Then I delete the internal memory oft the APP and try to recover but I get always an error:
Recovery failed
Recovery ended with errors
(show errors)
[object Object]
https://mint.minibits.cash/bitcoin
Any suggestion?

Unfortunately, there are cases where data migrations related to upgrade to v0.1.7 failed. Not happy about that and sorry for troubles, it simply did not happen while testing (More then once tried on 4 different brand devices).
I'll try to help with minimizing the impacts with general procedure to try to get sats and wallet address back:

Update to last version beta.13 version - I've released it as a native APK + Google Play release as well, because it prevents the loss of lightning address even in case, that migration fail and wallet state shows no balances
Go to Backup and Recovery > Recovery tool - You should see backed up ecash proofs. Local backup in separate database intends to cover cases, when wallet's primary storage gets corrupted. Try recover back to wallet.
If it fails for some reason, copy proofs as encoded tokens instead. This is the ecash backup in format, that can be one by one received to any other ecash wallet. As it needs to be copied and pasted multiple times, best option is to move them to the PC, and import them to some web wallet, e.g. wallet.cashu.me.
In case user had turned the backup off (default is on) and it is not available, last resort is recovery of ecash using the seed. There are some reports that recovery returns errors, I will investigate it shortly - until then I suggest to recover from another wallet.


Add "Assign Admin" button to the rooms

This adds a new "Assign Admin" button to:

Rooms list
Rooms view
Room View page (Members tab)
Users view page (Rooms tab)
Room Directory list

That button allows adding room administrator, if there is at least one local member with power level == 100 (room administrator).
Limitations: https://github.com/matrix-org/synapse/issues/2372
Fixes #22

fixes #22 and https://github.com/Awesome-Technologies/synapse-admin/issues/356


The downloader error causes the program to crash

That channel may be closed if the tgclient.Disconnect() was called a second time without connecting (tgclient.InitAndConnect()). Was it so?

这是来自QQ邮箱的假期自动回复邮件。您好，我最近正在休假中，无法亲自回复您的邮件。我将在假期结束后，尽快给您回复。


Update timeout for .github/workflows/sast.yml

This is an automated pull request to update default timeouts for all jobs in .github/workflows/sast.yml that do not currently contain a default timeout property.
Please review these changes closely to ensure that all jobs have sufficient time to run. If a job needs more time, please add a timeout property to that job to override the organization default.
Additionally, please be attentive to unintended changes to the workflow YAML file, as the parser is not perfect.
Lastly, note that it is up to the reviewer to merge this pull request and delete the PR branch once they are satisfied with the changes.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Potential Initialization race condition?

I'm running an API through a sort of load testing scenario and encountering an issue around mighty orm, here's the stack trace:
System.ArgumentException: An item with the same key has already been added. Key: Mighty.DataContracts.DataContractKey
   at System.Collections.Generic.Dictionary`2.TryInsert(TKey key, TValue value, InsertionBehavior behavior)
   at System.Collections.Generic.Dictionary`2.Add(TKey key, TValue value)
   at Mighty.DataContracts.DataContractStore.Get(Boolean IsGeneric, Type type, String columns, SqlNamingMapper mapper)
   at Mighty.MightyOrm`1.Init(String xconnectionString, String tableName, String primaryKeys, String sequence, String columns, Validator xvalidator, SqlNamingMapper xmapper, DataProfiler xprofiler, ConnectionProvider connectionProvider)
   at Mighty.MightyOrm`1..ctor(String connectionString, String table, String primaryKeys, String sequence, String columns, Validator validator, SqlNamingMapper mapper, DataProfiler profiler, ConnectionProvider connectionProvider)

The above occurs if I have freshly started my API, with no calls having occurred that would have created a MightyOrm connection, then hitting an endpoint that does create a MightyOrm connection from 20 separate requests more or less simultaneously.
The same does not seem to occur, at least in a reproduceable manner, if I have previously opened a connection using MightyOrm on an application run.

I think this is not the latest version of Mighty. Can you double check
that you're using 3.1.2?
I had similar issues in my own 'dog fooding' (as I think they say!) project
just recently, and made a couple of changes; in particular I updated two
instances of Dictionary, which could be written (not just read) in
different threads, to ConcurrentDictionary and even more specifically I
updated the Dictionary.Add call which seems to be what is failing for you
to a ConcurrentDictionary.GetOrAdd (i.e. ~ add if not already present).
Could you let me know which version you're on, and whether updating to
3.1.2 (if you're not already on it) fixes the problem?

I think this is not the latest version of Mighty. Can you double check that you're using 3.1.2?
I had similar issues in my own 'dog fooding' (as I think they say!) project just recently, and made a couple of changes; in particular I updated two instances of Dictionary, which could be written (not just read) in different threads, to ConcurrentDictionary and even more specifically I updated the Dictionary.Add call which seems to be what is failing for you to a ConcurrentDictionary.GetOrAdd (i.e. ~ add if not already present).
Could you let me know which version you're on, and whether updating to 3.1.2 (if you're not already on it) fixes the problem?

it did seem to be because I was on the version prior to 3.1.2, I just tried several times to reproduce on the latest and am unable, thanks!


Merge is deprecated in latest version of keras i got import error

Traceback (most recent call last):
File "test.py", line 33, in
from keras.layers import LSTM, Embedding, Input, Merge
ImportError: cannot import name 'Merge'
error at line no.33 and 239

How to solve this when using Lambda instead of Merge.
 TypeError: __init__() missing 1 required positional argument: 'function'
@pru007 @rupak-118

How to solve this when using Lambda instead of Merge.
 TypeError: __init__() missing 1 required positional argument: 'function'
@pru007 @rupak-118


Supporting Https for publishing data

Pushpin supports https for the proxy process, however there is no option on pushin-handler. When push data, It's only supporting http. Can you support https? Or is there any secure socket that I can use?

That's correct. The control ports are meant to be used from the server-side within a private network. If you need additional security (and I assume you'd want not just https but also authentication), you'll need to add your own layers.