Failed to save modifications to the server. Error returned: 'OLE DB or ODBC error: [DataSource.Error] ERROR [HY000] Incomplete input stream, expected at least 28 more bytes.

Hi! I've got an error when I try to get data to Power BI from Clickhouse through ODBC connector. It can be seen that the data starts to load, but after a few seconds this error appears:
Failed to save modifications to the server. Error returned: 'OLE DB or ODBC error: [DataSource.Error] ERROR [HY000] Incomplete input stream, expected at least 28 more bytes.
Timeout ODBC = 900000
Query is really simple, like:
SELECT *
FROM scheme1.table1
LIMIT 1000000
scheme1.table1 has about 15 mln of rows.
Could you suggest what is the reason of that issue?

Have the same problem!

So annoying, the same issue. It can sometimes happen sometimes not.

Hey guys, try to NOT use SQL Query in Power Query. Use native buttons for that. Get Source - Additional - ODBC - OK (don't write any SQL query).
It should help you. Try and get feedback

Same problem but with Informatica PowerCenter.

Same problem. Error OLE DB or ODBC: [DataSource.Error] ERROR [HY000] Incomplete input stream, expected at least 201 more bytes. Does anyone have a solution?

Same problem.
Error: PipelineException: ERROR [HY000] Incomplete input stream  expected at least 4 more bytes
Have no idea what's the reason... It sometimes happen sometimes not.

Same problem with SSAS Tabular.

Similar problem here, trying to get data to Qlik Sense from Clickhouse through ODBC connector.
The following error occurred:
QVX_UNEXPECTED_END_OF_DATA: SQL##f - SqlState: HY000, ErrorCode: 1, ErrorMsg: Incomplete
input stream, expected at least 1192 more bytes

It can sometimes happen sometimes not. When load is finished without error, the number of rows doesn't match the table rows number in database (not all rows are loaded), also getting different number of records each load.
ODBC version - Release <IP_ADDRESS>20905
ClickHouse - <IP_ADDRESS>
tabe DDL:
CREATE TABLE db_name.table_name
(
    `id` UInt64,
    `title` Nullable(String),
    `item_price` Nullable(Float64),
    `description` Nullable(String),
    `image_url` Nullable(String),
    `product_url` Nullable(String),
    `manufacturer_code` Nullable(String),
    `article_number` Nullable(String),
    `sale_price` Nullable(Float64),
    `manufacturer` Nullable(String),
    `short_message` Nullable(String),
    `specs` Nullable(String),
    `brand` Nullable(String),
    `categories` Nullable(String),
    `margin_priority` Nullable(String),
    `eans_values` Nullable(String),
    `updated_at` DateTime
)
ENGINE = MergeTree
PARTITION BY toYYYYMM(updated_at)
ORDER BY id
SETTINGS index_granularity = 8192;

I am getting the same error. For some context:

I got a fact model with ~ 26M records.
The error only occurs when I add an additional column via Power Query. The column is simply multiplying the units with the price.
I am currenly using the import mode, since we are stumbling upon a Clickhouse 500 ERROR when creating relationships between fact tables and bridge tables (we are following Kimballs architecture).

When adding the given column I get the following error:

Found a workaround; I noticed when adding the column via DAX, the error doesn't appear. Note, I think adding a column via DAX might sometimes be less efficient. Also, I don't think this column is included in the data model but only created in the report. So if you are creating a single data model with multiple dashboards, you might need to add the DAX column multiple times.
Hopefully this will be fixed soon!

, have same issue

To start the investigation, we need more information to reproduce the problem:

ClickHouse and driver versions
OS
query log for the period when the problem happens
the driver logs for the period when the problem happens. The logging might be enabled via DriverLog and DriverLogFile DSN parameters:
https://github.com/ClickHouse/clickhouse-odbc/blob/2f55d016420af9dfbd503ba122c0c1549c180363/packaging/odbc.ini.sample#L36-L37
DDL for a query target table

@mshustov ,
could you please specify how to enable logging in Windows Server 2016 STD ? The settings in the screenshot don't seem to log anything.

It would be great if you could resolve this issue, as it's an essential functionality of the driver.  I can assist with gathering more detailed information and reproducing scenarios where data is not fully captured, as we can easily replicate such situations.

Can you please try adding the following to the connection string? This should enable logging at the specified path

The log file with the error is attached. There was no error on the BI client side, but only a portion of the data was read, not the full table.
clickhouse-odbc_incomplete input stream.zip

@MindaugasDatanome,  Thank you for reporting your DDL! Would it be possible to provide a small dataset to help us reproduce the problem? You can use https://github.com/ClickHouse/ClickHouse/blob/master/programs/obfuscator/Obfuscator.cpp to hide sensible data.  Unfortunately, the logs aren't that helpful for troubleshooting 😞

I'm attaching a snippet of data from this table. What's also interesting is that each time when read the same table, a different number of records is read before it stops.
3 attempts to read:
842700 out of 31647840;
831500 out of 31647840;
843100 out of 31647840.
data_for_investigation.zip

@paulorijnberg  thanks! In my case this error did not appear again when I deleted additional column in PowerQuery.
@mshustov could you please look at the proccess of adding new columns not in sql but PowerQuery driver?

@mshustov could you please look at the proccess of adding new columns not in sql but PowerQuery driver?

@glebbuk could you elaborate?

@MindaugasDatanome, we tried to run your dataset in ODBC driver tests and couldn't reproduce the problem. Would you mind adding a test case demonstrating the problem (see CONTRIBUTING.md) or contact @mshustov and @slvrtrn in public Slack to have a direct troubleshooting session


v1 Wallets

[ ] Have all addresses be attached to a wallet ID. Wallets can be keyed on [wallet ID] + [user ID], so everyone will have a wallet with ID 0 to start.
[ ] When adding a new paybutton, allow them to select the desirede wallet to attach it to in a dropdown. If they only have 1 wallet, grey out the dropdown so it just shows as being attached to the default wallet.
[ ] List all wallets on the Wallets page.
[ ] Allow creation of a new wallet, where all they do is choose the name and network.
[ ] Wallets will have an (wallet) ID, user ID, name, network, createdAt, updatedAt (new DB table).
[ ] When a user account is created, they're assigned a wallet call "Default Wallet" with an ID (index) of 0.
[ ] Allow existing wallets to have their names changed.

Should Address <-> Wallet be one-to-many? As in: it is possible for different users have different wallets pointing to the same address; but each wallet will only point to one address.

many to many for the addresses <-> wallets feels right to me -- give people more freedom to do what they want.
also, allowing them to have more than 1 currency in a wallet also seems totally fine to me. So for example for our company, we'd have a "Coin Dance" wallet which has both XEC and BCH (addresses) in it.


Add syntax option to trim insignificant zeros

This PR solves #54.
It introduces a new option (t) in the specifier syntax that enables trimming of insignificant zeros across all format types.
Example:
d3.format("s")(1500);  // "1.50000k"
d3.format("st")(1500); // "1.5k"

Also added test cases and a paragraph in the docs.
Fully backwards compatible with the current syntax. The default format type (none) behavior remains the same and is equivalent to the new gt format.

Thanks for picking this up!
A potential concern with t as the trim indicator is that it looks like a format type rather than an option. (And we might want a t format type in the future.) What if we picked something outside the a-z range to be less ambiguous, and didn’t put it at the end, say extending the grammar as:
[[fill]align][sign][symbol][0][width][,][.precision][~][type]

So, ~s would trim insignificant zeroes, and (none) would be equivalent to ~g.

@mbostock I like that. I had the same concern myself, just didn't think of a better way. I'll update the PR.

Ok, here's the behavior with tilde:
d3.format("")(1500); // "1500"
d3.format("g")(1500); // "1500.00"
d3.format("~g")(1500); // "1500"
d3.format("s")(1500); // "1.50000k"
d3.format("~s")(1500); // "1.5k"
d3.format("%")(.015); // "1.500000%"
d3.format("~%")(.015); // "1.5%"

Thanks for merging and all the prompt changes! Would you consider publishing a new NPM version, so the new feature can be used downstream?

Yes, I will publish soon.


please include sources, javadoc in release

please include sources, javadoc in release
http://search.maven.org/#browse|1695976265
http://search.maven.org/#artifactdetails|org.scala-tools|scala-stm_2.9.1|0.3|jar

thank you!


Fixed: Running tests break meme_generator service

Closes #115
Fixed: checkPreprocess() in test processed ./data directory which included the logo images. Now its tweaked to run the test on the sub dir ./data/got_memes. This will ensure that the preprocessing routine runs fine without breaking up the meme_generation service.

Looks great 😍
Hope you are enjoying your journey 🚆  with OpenGenus


Get followed documents not working anymore

The endpoint _/api/social.following/my/followed(types=2) is returning sites (ActorType=2) instead of documents (ActorType=1).
types=4 also returns sites only
types=6 is returning sites and documents
According to documentation, types allows bitwise combinations where Users = 1, Documents = 2, Sites = 4, Tags = 8.
This was working fine until 2 weeks ago when something was changed.
Has this change been properly communicated?
Is the /_api/social.following endpoint still supported?
I am aware of this announcement (https://developer.microsoft.com/en-us/office/blogs/upcoming-api-changes-to-sharepoint-social-feed-apis-and-following/) but it doesn't make sense to mess with this endpoint until there is an alternative (Microsoft Graph doesn't have a way to retrieve followed documents).

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 10ba3673-5f22-a56d-de66-838d114eb641
Version Independent ID: 67b35cf8-ea9f-6ac3-2ba0-d936f8e76056
Content: Follow documents, sites, and tags by using the REST service in SharePoint
Content Source: docs/general-development/how-to-follow-documents-sites-and-tags-by-using-the-rest-service-in-sharepoint-2.md
Product: sharepoint
Technology: sharepoint-framework
GitHub Login: @spdevdocs
Microsoft Alias: spdevdocs

@Rafaelki After looking for alternatives myself yesterday I found that there is a Graph endpoint for following documents, albeit not sites as far as I can see. Maybe you can use /following for sites and graph for documents? I'm hoping to implement this myself.
https://docs.microsoft.com/en-us/graph/api/drive-list-following?view=graph-rest-1.0&tabs=http
https://docs.microsoft.com/en-us/graph/api/driveitem-follow?view=graph-rest-1.0&tabs=http

Thank you @siljemda for your quick answer.
At this point, I am only interested in Followed documents and I need exactly the same documents that appear under "Docs I'm following" in https://[YOUR TENANT]-my.sharepoint.com/personal/[USER_LOGON]/Social/FollowedContent.aspx.
The endpoint /me/drive/following is not returning any results for me.
I have several clients that are using my megamenu (application customizer for modern sites, control in masterpage for classic sites) which display this information, and they are very upset that suddenly this information is not available.

@JeremyKelley ... possible change in REST API behavior?

Dupe of #5630


How to define selected item of search dropdown

{{#ui-search apiSettings=searchConfig.fromCountryAirports.apiSettings }}
     <input class="prompt" type="text" placeholder="Search">

{{/ui-search}}

I'm not sure what you mean, could you provide further information?


Disable SceneMode picker in Terrain Clipping Planes demo

Since clipping planes don't work in 2D and CV, we should disable the mode picker in the demo: http://localhost:8080/Apps/Sandcastle/index.html?src=Terrain Clipping Planes.html&label=All

This is as simple as setting scene3dOnly to true in the Viewer contructor.

Fixed in https://github.com/CesiumGS/cesium/pull/8087


Multiple tests broken when not using htmlParser around the native document.write

It's a follow up to the issue #33. The unit tests were added to prove postscribe works correctly with the following code:
postscribe('#someelement', '
' +
  '<embed></embed>' +
  '
Should be yellow in red box, right?
' +
'
');

When tested manually this is clearly broken. Use the postscribe tested I created to see why:
http://roy.lastlook.pl/~quake/postscribe-tester.html?code=

++<embed><%2Fembed>
++
Should+be+yellow+in+red+box%2C+right%3F<%2Fdiv>
<%2Fdiv>
I noticed that the expected.js has the wrong HTML (the one generated by postscribe in it), so the passed test doesn't prove anything. I noticed there's a ?generate_expected=1 URL param for the test.html, that I used and I found out it actually generates the same HTML as PostScribe does.
Then I started digging and I found out even for the native document.write htmlParser (with autoFix: true option) is run against the code to write, so it modified the HTML written by the browser.
I commented out the part (see #109) doing that and many more tests failed with ?generate_expected=1. I started checking the failed use cases manually, and yes they are HTML handled in a way that differs from how browser handles it. A simple example:

foo

http://roy.lastlook.pl/~quake/postscribe-tester.html?code=
<%2Fdiv>foo

We believe this has been fixed in 2.0.0.  Please retest and raise a new issue according to the Contributing Guidelines if the issue persists.  Thanks.


Update the CUDA implementation of AddforcingTerms with the CudaVectorMatrix class

This PR updates the input type for the CUDA implementation of AddforcingTerms function with the CudaVectorMatrix class.
I have to comment out the test_cuda_rosenbrock test for now because it requests me to update all the other CUDA kernels to pass. The other 40 tests all passed on Derecho's A100 GPU by using nvhpc/23.7

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 94.65%. Comparing base (fb71ae6) to head (8411f57).

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #439   +/-   ##
=======================================
  Coverage   94.65%   94.65%
=======================================
  Files          38       38
  Lines        3051     3051
=======================================
  Hits         2888     2888
  Misses        163      163

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Ecto parsing database URL is broken

Elixir version
1.13.4
Database and Version
Mysql 8
Ecto Versions
ecto 3.8.4
Database Adapter and Versions (postgrex, myxql, etc)
myxql 0.6.2
Current behavior
This is how my DB_URL looks like:
DB_URL="mysql://user:password@dev-rds.us-west-2.rds.amazonaws.com:3306/db_name?charset=utf8&parseTime=True&loc=Local"

defmodule Nefarious.Application do
  # See https://hexdocs.pm/elixir/Application.html
  # for more information on OTP Applications
  @moduledoc false

  use Application

  @impl true
  def start(_type, _args) do
    config = Vapor.load!(Nefarious.Config)

    children = [
      {Nefarious.Metadata.Repo, [url: config.db.url]} # tried, `protocol: :tcp` here as well
    ]

    opts = [strategy: :one_for_one, name: Nefarious.Supervisor]
    Supervisor.start_link(children, opts)
  end
end

iex -S mix
I have tried all kinds of URL's but nothing works and there is no documentation.
Most of the libraries in elixir are not documented given the application setup in mind. Just some random writeup to use it in isolation.
I keep getting this error:
** (Ecto.InvalidURLError) invalid url "mysql://user:password@dev-rds.us-west-2.rds.amazonaws.com:3306/db_name?charset=utf8&parseTime=True&loc=Local", host is not present. The parsed URL is: %URI{authority: nil, fragment: nil, host: nil, path: "\"mysql://user:password@dev-rds.us-west-2.rds.amazonaws.com:3306/db_name", port: nil, query: "charset=utf8&parseTime=True&loc=Local&pool_size=10\"", scheme: nil, userinfo: nil}
            (ecto 3.8.4) lib/ecto/repo/supervisor.ex:92: Ecto.Repo.Supervisor.parse_url/1

I have tried ecto://, ecto:mysql:// nothing works. even I put nothing.
Expected behavior
To connect properly

I cannot reproduce it:
iex(1)> Ecto.Repo.Supervisor.parse_url "mysql://user:password@dev-rds.us-west-2.rds.amazonaws.com:3306/db_name?charset=utf8&parseTime=True&loc=Local"
[
  hostname: "dev-rds.us-west-2.rds.amazonaws.com",
  username: "user",
  password: "password",
  database: "db_name",
  port: 3306,
  loc: "Local",
  parseTime: "True",
  charset: "utf8"
]

Do you have any warnings when you start the VM?

no, only the error message. right at the start.

If you try the same call as above from within your project iex -S mix, does it raise or does it work?

When I try with this: Ecto.Repo.Supervisor.parse_url  it works. But with this:
def start(_type, _args) do
    config = Vapor.load!(Nefarious.Config)

    children = [
      {
        Nefarious.Metadata.Repo, [url: config.db.url]
      }
    ]

    opts = [strategy: :one_for_one, name: Nefarious.Supervisor]
    Supervisor.start_link(children, opts)
  end

when I do iex -S mix , it doesn't work. saying invalid url, host not present.

Hmm, looks. like after 7 hours, From the remote config the DB URL is coming as a quoted string. Probably that's why it's not working.

Yeah, stripping the quotes made it work. Thanks for the quick help.


#190: Select Category for New Specification

Changes in this PR

Add new routes, view and controller for Categories
Update dashboard to link to /categories where a new specification can be started
Update /journey-maps to include the category list, which then loads the right Contentful data based on the category

Screenshots of UI changes

If you haven't played with the JSON fixtures yet reach out to @AndrewCowle


Zephyr documentation on document generation has error in instructions

Describe the bug
Zephyr documentation on documentation generation has a step in the installation section to run
pip install -r %HOMEPATH$\zephyrproject\zephyr\doc\requirements.txt
This requirements.txt file does not exist in this directory?
https://docs.zephyrproject.org/latest/contribute/documentation/generation.html
Environment (please complete the following information):

OS: ALL

nevermind... I was on an older version of Zephyr


Check semver

Try to use https://crates.io/crates/cargo-semver-checks in Github workflow

Partially done, but still not working.


Android Warning: new NativeEventEmitter()

Getting a console warning for only android when enabling the redux-flipper middleware. If I remove the middleware, the warning does go away.
react-native: 0.65.1
react-native-flipper: 0.110.0
redux-flipper: 2.01

This is caused by the native module react-native-flipper. There is nothing can be done by here so far. Can let this issue open until the problem fixes.
https://github.com/facebook/flipper/issues/2707

Fixed in Flipper v0.119.0


#330 - Update FileUpload component with extension limiting

Adds the new changes in the file upload component to support limiting the extensions uploaded.

@warrensearle #724 :smile:


Call for maintainer(s)

Hi all, it's been four years now since I released<EMAIL_ADDRESS>and I feel truly privileged to have contributed to the NextJs ecosystem, and hopefully helped save some other devs' precious time.
Due to other projects and a sheer lack of time, I'll now pass the torch. Hopefully we can find a committed and competent maintainer to continue active development, otherwise I will put the project into archival.
Alternatively, there are several other NextJs i18n packages which are popular these days, so another option would be to simply merge projects, or create an easy migration path for users. I do hope that eventually, NextJs as a framework will support i18n first-class.
Pinging some relevant names, but feedback from anyone is appreciated!
@adrai @kachkaev @aralroca @amannn

Thank you Isaac for all your work and all your patience.
It saddens me to hear you made that choice, but that's just the nature of things.
Since I'm one of the i18next maintainer, I would be very happy if someone would agree to continue with next-i18next.
I am still available for support on topics related to i18next. Additionally, I would also offer a small sponsorship (GitHub sponsors or similar).
Wishing you all the best Isaac.

Pinging other names that contributed in the past:
@capellini @MathiasKandelborg @felixmosh @lucasfeliciano @prokopsimek @StarpTech @skrivanos @eraygundogmus @mweibel

Hi all, I am interested to contribute in the project. But this is my first in an open-source project and I did not know things work. Let me know how I can help with the project. :)  @eraygundogmus

Just discussed this with @adrai - if people agree we would suggest moving next-i18next to the i18next organization and start maintaining it like we do for react-i18next.
We (i18next and locize team) could help with issues, support and documentation - any help from devs using this module would be helpful and could be compensated through sponsoring coming through our locize.com).
This way we could assert this module stays well maintained in the years coming.

Moving next-i18next under the i18next org sounds like a great solution. @jamuhl and @adrai are more than competent in handling all internationalisation issues, and hopefully the community can lend some support in regards to the trickier aspects of NextJs.
Perhaps in the end, this shift could lead to a great simplification of the code – let's see.
I'll speak to the i18next team privately to start the process.
Thanks everyone!


Bluetooth: controller: Add range delay calculations

Add implementation in controller to use range delay
alongwith the active clock accuracy jitter.
Range has been hard coded to 1000 meters, suffices
modules out in the market.
Signed-off-by: Vinayak Kariappa Chettimada<EMAIL_ADDRESS>

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@054e1be). Click here to learn what that means.
The diff coverage is 100%.

@@            Coverage Diff            @@
##             master   #13344   +/-   ##
=========================================
  Coverage          ?   48.64%
=========================================
  Files             ?      319
  Lines             ?    46537
  Branches          ?    10756
=========================================
  Hits              ?    22638
  Misses            ?    19313
  Partials          ?     4586

Impacted Files
Coverage Δ

...oth/controller/ll_sw/nordic/lll/lll_tim_internal.h
60% <ø> (ø)

subsys/bluetooth/controller/ll_sw/ctrl.c
44.89% <100%> (ø)

...s/bluetooth/controller/ll_sw/nordic/lll/lll_conn.c
60.06% <100%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 054e1be...69630b3. Read the comment docs.

recheck

@thoh-ot Updated.


iPad only: Change in user location does not immediately update representative list

In the views for the iPad app, the user can set a location with a pop-up style window while viewing an issue. This is convenient.
If the user changes location in the "Set your location" window, ideally the list of representatives shown at the bottom of the issue view would update immediately to reflect the new location. In the current version of the iPad app, the representatives in the "Call your representatives" list reflect the previous location until a new issue is tapped.

I can take this one.
Posting this mostly for my own future self: I know why this is happening, but I haven't decided yet how I would want to fix it.  The IssueDetailViewController is setting itself as the delegate for the EditLocationViewController when it is launched via a segue on the IssueDetailViewController but that only happens when the device is a particular size. Subscribing to notifications might be better, but will have to be reconciled with the delegate code so the two aren't stepping on each other.

@erikkrietsch Sounds like we need to set the delegate in the other case maybe when the popup is launched?
If that seems too hard to do properly, I'd be game for listening for a notification across the app for this. Will make it easier going forward to adding setting location from other places in the future.

There actually already is a notification for when a user changes their location, so I was going to just tap into that. I've got the fix just about ready, I just need to extract out a common function for the two scenarios.

It's actually a little more complicated than I initially thought, and my original assessment wasn't quite right. If the user hasn't yet set their location, then they can do that via a special table cell in the IssueDetailViewController. That's when the IDVC sets itself as the delegate for the location controller. This can happen on any size device. The iPad can also set the location through a specially added button to the header in the navigation controller, but the IDVC has no direct interaction with it. Subscribing to the notification works well in this case, but in the prior scenario, we double dip and wind up hitting the network twice—once for the delegate call and once for the notification.
I'm still working on it. I think what I'm going to do is separate out the work that was happening on the delegate call and move the networking and UI refresh into the notification handler.


fix(raiko): avoid duplicate image uploads

The block proof ELF is approximately 8 MB, and is being uploaded every time. Using an initialization-once approach to avoid redundant uploads

Oh, yes, risc0 checked the image id. I update sp1 logic and thought the risc0 maybe the same.
Please help to double check the sp1 part. I will revert risc0 changes.

seems sp1 can not easily bypass the upload, although only optimizing the setup part makes the process slightly better.

seems sp1 can not easily bypass the upload, although only optimizing the setup part makes the process slightly better.

https://github.com/succinctlabs/sp1/pull/1875 implement the v2 sdk, which gracefully handle the image upload: register_program
We can switch to the new version of SDK once it becomes stable.

cool, so far we rely on their network service, let's see when they will update the service, probably in 4.0.0.


Hanging on generateDiffRows

The code:
    List<String> original = Files.readAllLines(oldFile);
    List<String> revised = Files.readAllLines(file);

    DiffRowGenerator generator = DiffRowGenerator.create()
        .showInlineDiffs(true)
        .mergeOriginalRevised(true)
        .inlineDiffByWord(true)
        .oldTag(f -> f ? "<s style=\"background-color: #bbbbbb\">" : "</s>")
        .newTag(f -> f ? "<b style=\"background-color: #aaffaa\">" : "</b>")
        .build();

    List<DiffRow> rows = generator.generateDiffRows(original, revised);

The files:  test.zip
generator.generateDiffRows is hanging for me with these 2 files.
System

Java version: 17
java-diff-utils version: 4.12

Still hoping for a fix.

Still hoping for a fix.

Sorry, that I was unavailable for so long.
I build a test around your data. May I introduce it into the project or are there any bits of non-publishable data in it?
One first remark. The difftools some time ago introduced a second diff algorithm: a variant of Myers algorithm with linear space usage which performs usually better for large datasets. You could try this one. Using the following snipped you introduce a different algorithm into the library:
List<DiffRow> rows = generator.generateDiffRows(original, DiffUtils.diff(original, revised, new MyersDiffWithLinearSpace<String>() ));

Btw, you could set the default algorithm using DiffUtils.withDefaultDiffAlgorithmFactory().
However, after digging around I was not able to do the diff with the original algorithm. The line normalizer and word splitter inflate the dataset so drastically, that it is not usable. The linear space algorithm generates other change sets.

You should know the the linear space algorithm is not tested as deeply as the original implementation.

Thanks for looking into this.

I build a test around your data. May I introduce it into the project or are there any bits of non-publishable data in it?

Yes, go ahead.
I'll try your suggestion of the alternate algorithm the next time I return to that particular project, but sadly won't get to it any time soon.


Correct type for priority field

Description of changes:
Other normalized string fields that map to an enum are strings, not integers. The sample data API generates a string for the priority field, which fails the JSON schema validation. This corrects the type to reflect the paradigm in the rest of the schema.
Delete once you have confirmed the following:

Have you assigned appropriate labels to the PR?

This is definitely a bug, thanks for fixing it!


[1.12rc3] No backwards-compatible way to force-tag images?

1.12rc3 hard-dropped the -f flag from docker tag (#23090). There now appears to be no way to force-tag images in a way that is compatible with older Docker versions (before 1.10, only 5 months old).
This works on 1.12rc3, fails on versions before 1.10 (e.g. 1.9.1):

docker tag <some-image> my-test
docker tag <some-other-image> my-test

Fails on 1.12rc3, works on versions before it:

docker tag -f <some-image> my-test
docker tag -f <some-other-image> my-test

The only way we can safely stop using the -f flag is if we can assume all of our hosts are using Docker 1.10 or newer.
Please consider leaving the deprecated flag in-place for 1.12 final. 1.10 was only released 5 months ago. Dropping the flag is not only going to break a lot of places that use -f for tagging, but means we can't deploy 1.12 at all until we've upgraded all of our hundreds of hosts running Docker to at least 1.10 (some of which are out of our control; for example, Travis and CircleCI are both still on Docker 1.8.2).

Thanks for reporting @chriskuehl; wondering; you mention that some of your hosts are updated, and some not, so you probably don't make use (yet) of newer features (introduced in newer versions). Would using an old "client" solve your use-case? i.e. update the daemons, but still use an older client, so that you can keep using the -f flag for now?
In general; we decided on a two-release deprecation policy; do you think that's too short of a time for users to adopt?

@thaJeztah yes, we're not using a lot of new features yet (mostly just upgrading for the stability improvements). In this case, we're hoping to use overlay2 from 1.12 since we've found it performs significantly better than aufs for some of our workloads.
I don't know much about the Docker project itself, but for something that's a critical piece of a lot of  production infrastructure, I think it's worth being a little lenient in deprecating things when they're not really adding significant technical debt to Docker itself. Especially since Docker is moving quickly, upgrading hundreds of production hosts to newer versions of Docker can take a lot of time and planning. Unfortunately a lot of people are still on Docker pre-1.10 (even things like Travis/Circle).

@chriskuehl thanks; running a 1.12 daemon on overlay2, and using a (e.g.) 1.10 client should still work, as the storage driver is defined as a daemon option.
Perhaps we could consider to use a default 3 release cycle (roughly 6~7 months) instead of 2 for the deprecation policy. Could you open a separate issue for that?

FYI, Packer's docker-tag post-processor is breaking because of this. https://github.com/mitchellh/packer/issues/3771

It looks like this issue went stale. Let me close it.


Implement NSData.description

Ugh. Whitespace. 😅

Did you want to fix up the whitespace diffs before I merge?

Whitespace fixed. :+1:

Thanks!


Rearrange columns so they match the order specified in the story for …

…the new moves queue
Description
Arranges columns for new moves queue on the office site so they match what's requested in the story.
Setup
Generate some data to use:
make db_dev_e2e_populate

Start up the office site, head on over there, look at the new moves queue.
Code Review Verification Steps

[ ] Code follows the guidelines for Logging
[ ] The requirements listed in
Querying the Database Safely
have been satisfied.
Any new migrations/schema changes:

[ ] Follow our guidelines for zero-downtime deploys (see Zero-Downtime Deploys)
[ ] Have been communicated to #dp3-engineering
[ ] Secure migrations have been tested using scripts/run-prod-migrations

[ ] There are no aXe warnings for UI.
[ ] This works in Supported Browsers and their phone views (Chrome, Firefox, IE, Edge).
[ ] Tested in the Experimental environment (for changes to containers, app startup, or connection to data stores)
[ ] User facing changes have been reviewed by design.
[ ] Request review from a member of a different team.
[ ] Have the Pivotal acceptance criteria been met for this change?

References

Pivotal story for this change

Screenshots

Note: There's content in this merged from another branch: 'ig-166413391-needs-attention-column'. It'd probably be best for that to land to master first to avoid conflicts.

It looks like the other branch is now in master. I've pulled those changes over, now the scope of this PR is the right size.


Move namespace controller to new queue type

Fixes https://github.com/istio/istio/issues/36823
28265 runs so far, 0 failures (100.00% pass rate). 1.379571661s avg, 2.703746358s max, 709.820229ms min

@howardjohn: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name
Commit
Details
Required
Rerun command

lint_istio
687e9c53f2dc4550a5efeb60b620c92c35f76707
link
true
/test lint_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.


Telegram task : Ordering by date

Fix the chat_handler class to allow the ordering by date (parameter "dated") for those Telegram task:
/top
/evolved
/hatched
/caught
/released
/vanished

@DBa2016 : I update the documentation


Replace gcloud with individual libraries

Fixes #74
@jonparrott @jmdobry Care to review?

Current coverage is 79.77% (diff: 100%)

Merging #79 into master will not change coverage

@@             master        #79   diff @@
==========================================
  Files            47         47
  Lines          1775       1775
  Methods         398        398
  Messages          0          0
  Branches        255        255
==========================================
  Hits           1416       1416
  Misses          359        359
  Partials          0          0

Powered by Codecov. Last update bec07f3...664e493


Resolving relative paths with custom project destination

Motivation and Context
closes #260
In the situation generating with --project option different with spec's directory, All containing files are missing on the generated projects.
$ xcodegen -p ./GeneratedProjects

There is following directory structure.
.
├── GeneratedProjects
│   └── MyFramework.xcodeproj
├── MyFramework
│   ├── SubGroup
│   │   └── A.swift
│   └── main.swift
└── project.yml

Description
This PR solve this issue. Top Level group's location must be the relative path from the generated project.

Before
After

Before : MyFramework group's location was MyFramework. This value comes from a relative path from the project spec. It should be a relative path from PROJECT_ROOT.
After: MyFramework group's location chages to ../MyFramework. It's a relative path from PROJECT_ROOT.

Looks good apart from a minor param name comment. Would be good to to know if this fixes this issue https://github.com/yonaskolb/XcodeGen/issues/260

@yonaskolb Merging is blocked because of minor changes after approval....
https://github.com/yonaskolb/XcodeGen/pull/681/commits/80808d69c8ff9d3d2e970f93ed83605c090cc9d1
Could you approve this again?


Lint

Replace Octoface icon with toast icon - Icon was droppped
Clean up parse-backticks
Make conversation-activity-filter faster

Note: This is the last lint before dropping refresh. 🎉

Clean up parse-backticks

Does that close #4135?

Make conversation-activity-filter faster

Does this fix https://github.com/sindresorhus/refined-github/issues/4365?

Does this fix #4365?

Will check.

Another lint can be changing repeated :not(a):not(b) to :not(a,b), increasing the minimum browser version to what's specified in this table for "selector list" https://developer.mozilla.org/en-US/docs/Web/CSS/:not#specifications
It seems to work in Safari so it might be worth checking in other browsers as well

It seems to work in Safari so it might be worth checking in other browsers as well

Does not work in firefox yet

It seems to work in Safari so it might be worth checking in other browsers as well

Does not work in firefox yet

It does work in all major desktop browsers according to https://caniuse.com/css-not-sel-list.

My bad looks like I was on an old version of firefox 😨


chore: demo Chinese

Description
Please provide a brief summary of the changes. If it is related to an issue, please bring the issue number, like fixes #${number}.
Type of change
Please select the relevant option.

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[x] This change requires a documentation update

Codecov Report

Merging #147 (3a5fc8e) into master (89cc0ab) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #147   +/-   ##
=======================================
  Coverage   90.77%   90.77%
=======================================
  Files         155      155
  Lines        7379     7379
  Branches     2042     2042
=======================================
  Hits         6698     6698
  Misses        560      560
  Partials      121      121

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 89cc0ab...3a5fc8e. Read the comment docs.

LGTM~


[flutter_tools] unpin SDK deps when upgrading packages

Description
When run update-packages --force-upgrade, tell pub to use a flutter SDK with only any constraints. This prevents the prior version of the flutter SDK pubspecs from affecting the update packages version solve.
Fixes https://github.com/flutter/flutter/issues/53350
Fixes https://github.com/flutter/flutter/issues/36511

Thanks much @jonahwilliams !


Issues with loading bootstrap_css and bootstrap_javascript

The application is causing isssues when loading the bootstrap_css on the template. The Quick setup mentioned on the doc fail when loading any other tag than bootstrap3. Saying that no such tag exist. Is there something that needs to  be declared somewhere else?

Maybe is missing this line one your template:
{% load bootstrap3 %}

I did had load bootstrap3 and then load bootstrap_css similar to the quick example here:
http://django-bootstrap3.readthedocs.org/en/latest/quickstart.html#example-template
http://i.imgur.com/9ENCYqb.png

You are using incorrectly the tag is suppossed to be:
{% bootstrap_css %}
And you are using :
{% load bootstrap_css %}


Asks for neovim-python update every run

deoplete-clang asks me to update neovim-python using pip3, however I did it (multiple times).
I'm using latest stable version of neovim, deoplete and deoplete-clang.

Sorry, misinterpretered the install section.


Question about adding Recipes via IMC

Mekanism: 1.10.2-2.1.298
I'm working on a small modpack and am currently trying to add some recipes to Mekanism machines, given there is no CraftTweaker or ModTweaker support, I've opted to instead make a mod myself to handle it.
I've run into a small problem however. Recipes when added via IMC do not show up in JEI. They still work and function as expected, there's just no way to tell that the recipe was registered. If there any way to make them show up properly when using IMC, or should I ignore the warning at the top of the RecipeHelper class  in the MDK about it being depreciated?

This may be because JEI loads recipes before IMC messages are handled.  Take a look and see if JEI has any kind of helper method to reload or add recipes.

So for the record if anyone sees this at a later point, the answer seems to be no, at least not with how Mekanism's JEI support is done.
If you want your recipes to show up in game, you may as well make a mod and manually add them ignoring IMC all together.


Disaggregation subsetting issues

The disaggregation layout for some of the indicators is incorrect.
I think that the site generation uses edges.py via the open-sdg build script to specify how the disaggregations are read (path.py may also play a role).
Can we amend these to fix the disaggregation problems reported by the Data team (details TBC).

An example of the problem can be seen in indicators 5.2.1, 5.2.2 and 16.1.3.
The Data team said that the disaggregations in 16.1.3 have become a subset underneath Sex, and in 5.2.1 the Ethnic group category is listed as a sub category of Abuse category which is pretty questionable!

Moved to sdg-indicators: https://github.com/ONSdigital/sdg-indicators/issues/2916


change the Stat links.

Currently the stat link is referring to other repo stats. change to the current repo

@sanjay-kv assign me this issue


Patch pyopenssl broken dependency

Force use of version 22.0.0 to avoid the error: "AttributeError module 'lib' has no attribute 'X509_V_FLAG_CB_ISSUER_CHECK"

No updates for a long time. Closing PR


update jackson version

and allow for different version for databind
Signed-off-by: Sally MacFarlane<EMAIL_ADDRESS>

the problem is this plugin id "io.swagger.core.v3.swagger-gradle-plugin"
it pulls in an earlier version of jackson-databind which doesn't respect the constraint


Minitest failed with status (1)

Coverage report generated for Unit Tests to /app/coverage. 5422 / 26782 LOC (20.24%) covered.

rake aborted!

Command failed with status (1)

/usr/local/bundle/gems/knapsack-1.15.0/lib/knapsack/runners/minitest_runner.rb:28:in `run'

/usr/local/bundle/gems/knapsack-1.15.0/lib/tasks/knapsack_minitest.rake:5:in `block (2 levels) in <top (required)>'

/usr/local/bundle/gems/rake-12.0.0/exe/rake:27:in `<top (required)>'

/usr/local/bundle/bin/bundle:104:in `load'

/usr/local/bundle/bin/bundle:104:in `<main>'

Tasks: TOP => knapsack:minitest_run

(See full trace by running task with --trace)

Is there something wrong here?

Hey @Daniel-ltw
Was the test suite executed? Did any test fail?
What version of minitest do you use? What version of Rails.
Maybe coverage report has an impact on exit code from minitest?
Do you have any non-standard configuration of minitest?
It looks like just minitest rake task failed,
https://github.com/ArturT/knapsack/blob/ad3e159d6724a89d4af936abdb66fd5d3c1cdd01/lib/knapsack/runners/minitest_runner.rb#L28
Maybe try to run minitest with verbose flag to see what exactly is failing.
$ bundle exec rake "knapsack:minitest[--verbose]"

I guess previously, we did not have that issue.
Will have a run with the verbose to see if that makes any difference.

I guess it is the test failures that is causing the problem, knapsack should have a way to handle Command failed with status (1)
Might need a rescue for that invoke and handle the error nicely?

After 20 days, I think this step is necessary to address this issue.
https://github.com/ArturT/knapsack/blob/master/lib/knapsack/runners/minitest_runner.rb#L28
Add a rescue StandardError after this or maybe the following:
https://github.com/seattlerb/minitest/blob/master/lib/minitest/test.rb#L19
This might be the appropriate way to deal with this.
In test failing scenario, the error should be handle nicely and not throw an error.

Hey @Daniel-ltw, sorry for late reply, I was busy with work in recent weeks.
You are thinking about something like:
def self.run(args)
  # other code
  Rake::Task[task_name].invoke
rescue StandardError
  raise
end

in order to reraise error from minitest so you will see in the output what actually failed inside of one of your minitest test files, right?
Right now the error output you added in the first post does not say much about what failed so you are hoping that by reraising error we will get the info what failed in a test file?
BTW Could you share example test file that would trigger this behavior so I could reproduce the error.
Here it is an example repo with minitest test suite I use for testing https://github.com/KnapsackPro/rails-app-with-knapsack
What version of ruby and minitest do you use?

@ArturT Could you try adding a failing test and see what does happen in your output?
class FailTest < ActiveSupport::TestCase
  def test_failure
    assert_equal 1, 2
  end
end

My ruby version is 2.5.0 and minitest version is 5.10.2.

@Daniel-ltw What version of rails do you use?

Rails 5.1

I was able to reproduce it. Actually, it's expected behavior. It's just extra info about rake task output and it does not affect how minitest works. All tests were executed. The minitest produces output info which tests failed. The final exit code from knapsack is 1 which indicates that test suite failed - that's expected.
The error you that can see:
rake aborted!

Command failed with status (1)

is produced probably by the way how rake works. If you like you can do some research and see if we actually should handle the info about non zero exit code from rake. I did not find anything helpful by doing a quick search.
I tried to do:
# lib/knapsack/runners/minitest_runner.rb
        begin
          Rake::Task[task_name].invoke
        rescue StandardError => e
          puts e.inspect
        end

but there is a question what to do with the exception. Should I print it on the output to give user option to know what happened. But this is  how it works already. Or I could hide the exception info but this might lead to some implicit errors hard to track. I would probably leave it as it is now.

I guess in design, you are trying to focus on how knapsack should behave with

The final exit code from knapsack is 1 which indicates that test suite failed - that's expected.

but test suite failure should not mean that knapsack has fail, or should it?
From a user perspective, knapsack ran fine with no issue. The failure is in the test, not within knapsack.
Anyway found this question from 2015
https://stackoverflow.com/questions/29966486/how-to-catch-rake-task-exit-status-in-another-rake-task
@ciembor

but test suite failure should not mean that knapsack has fail, or should it?
test suite failure should mean the knapsack failed because we want to return exit code 1 so thanks to that the CI providers will know that test suite is failing.
The minitest exit code is also 1 when test suite is failing.

The question is: should I hide the exception from the minitest rake task to just make finally knapsack output nicer? I feel like I can by mistake hide too much. I'm not sure if it would be a good assumption to rescue all StandardError and hide the info that something failed. Because this way I would assume all exceptions will be related to test assertions or bugs in test suite. Theoretically, something else could be a reason for failure and we would not know about it by hiding the exception info.

So in that case, we should not rescue StandardError which might encapsulate too many other errors.
rescue SystemExit => e

Like the answer in the Stackoverflow post, that might be what we might be looking for?

The SystemExit is not a good option because the RuntimeError is raised instead.
The exception looks like:
#<RuntimeError: Command failed with status (1): [ruby -I"lib:test" -I"/Users/artur/.rvm/gems/ruby-2.4.2/gems/rake-11.2.2/lib" "/Users/artur/.rvm/gems/ruby-2.4.2/gems/rake-11.2.2/lib/rake/rake_test_loader.rb" "test/controllers/articles_controller_test.rb" "test/minitest/fail_test.rb" ]>

I don't see an easy option to extract info about the exit code from the exception. The info is in a text message so I would have to parse it in order to know that the exit code is 1 or I could assume the exit code should always be 1 when something went wrong. I need to exit knapsack with exit code 1 in order to make CI build to fail.
I would keep the knapsack gem as it is now because it works. If your test suite fails you already see what's wrong in the minitest output. Then you make fixes to your tests and when the test suite is green all is good again.
I don't see a new value in changing that other than just hiding the error from rake task.

I reviewed it again, and I don't see an action point here. If there is any new information we should consider, please share it.
There was no activity here, so I'm closing this issue for now.


"sudo apt-get update && apt-get upgrade ; fuck" makes an error

I updated thefuck and checked other issues.
Running on GNU bash, version 4.4.19(1)-release (x86_64-pc-linux-gnu) and ubuntu 18.04.1 LTS updated.
 Done
E: Could not open lock file /var/lib/dpkg/lock - open (13: Permission denied)
E: Unable to lock the administration directory (/var/lib/dpkg/), are you root?
Traceback (most recent call last):
File "/home/thibaut/.local/lib/python3.6/site-packages/thefuck/output_readers/rerun.py", line 22, in _wait_output
else settings.wait_command)
File "/home/thibaut/.local/lib/python3.6/site-packages/psutil/init.py", line 1262, in wait
return self._proc.wait(timeout)
File "/home/thibaut/.local/lib/python3.6/site-packages/psutil/_pslinux.py", line 1459, in wrapper
return fun(self, *args, **kwargs)
File "/home/thibaut/.local/lib/python3.6/site-packages/psutil/_pslinux.py", line 1637, in wait
return _psposix.wait_pid(self.pid, timeout, self._name)
File "/home/thibaut/.local/lib/python3.6/site-packages/psutil/_psposix.py", line 104, in wait_pid
delay = check_timeout(delay)
File "/home/thibaut/.local/lib/python3.6/site-packages/psutil/_psposix.py", line 66, in check_timeout
raise TimeoutExpired(timeout, pid=pid, name=proc_name)
psutil._exceptions.TimeoutExpired: psutil.TimeoutExpired timeout after 3 seconds (pid=20029)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/thibaut/.local/lib/python3.6/site-packages/psutil/init.py", line 1170, in _send_signal
os.kill(self.pid, sig)
PermissionError: [Errno 1] Operation not permitted
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/bin/thefuck", line 11, in
sys.exit(main())
File "/home/thibaut/.local/lib/python3.6/site-packages/thefuck/entrypoints/main.py", line 25, in main
fix_command(known_args)
File "/home/thibaut/.local/lib/python3.6/site-packages/thefuck/entrypoints/fix_command.py", line 36, in fix_command
command = types.Command.from_raw_script(raw_command)
File "/home/thibaut/.local/lib/python3.6/site-packages/thefuck/types.py", line 82, in from_raw_script
output = get_output(script, expanded)
File "/home/thibaut/.local/lib/python3.6/site-packages/thefuck/output_readers/init.py", line 20, in get_output
return rerun.get_output(script, expanded)
File "/home/thibaut/.local/lib/python3.6/site-packages/thefuck/output_readers/rerun.py", line 47, in get_output
if _wait_output(result, is_slow):
File "/home/thibaut/.local/lib/python3.6/site-packages/thefuck/output_readers/rerun.py", line 26, in _wait_output
child.kill()
File "/home/thibaut/.local/lib/python3.6/site-packages/psutil/init.py", line 285, in wrapper
return fun(self, *args, **kwargs)
File "/home/thibaut/.local/lib/python3.6/site-packages/psutil/init.py", line 1244, in kill
self._send_signal(signal.SIGKILL)
File "/home/thibaut/.local/lib/python3.6/site-packages/psutil/init.py", line 1181, in _send_signal
raise AccessDenied(self.pid, self._name)
psutil._exceptions.AccessDenied: psutil.AccessDenied (pid=20030)

This seems weird to me, anyway this is an error.

I just experienced this exact same problem, on Mint 19 Cinnamon.
 This is kinda expected behavior, for the previous command takes longer than 3s to finish and times out. Only that AccessDenied exception needs to be excepted. Fix is on its way.
 This is already fixed and should have been closed by one of those merged commits.


Weights are not of the same shape, "Shapes are incompatible" error

Hi
model = keras.Sequential()
model.add(tf.keras.layers.Conv2D(filters=32,kernel_size= (11,11), activation='relu', name='C1', input_shape=(152,152,3)))
model.add(tf.keras.layers.MaxPooling2D(pool_size=3, strides= 2, padding= 'same', name='M2'))
model.add(tf.keras.layers.Conv2D(filters=16, kernel_size=(9,9), activation='relu', name='C3' ))
model.add(tf.keras.layers.LocallyConnected2D(filters=16, kernel_size=(9,9), activation='relu', name='L4'))
model.add(tf.keras.layers.LocallyConnected2D(filters=16, kernel_size=(7,7), activation='relu', name='L5'))
model.add(tf.keras.layers.LocallyConnected2D(filters=16, kernel_size=(5,5), activation='relu', name='L6'))
model.add(tf.keras.layers.Flatten(name='F0'))
model.add(tf.keras.layers.Dense(4096, activation='relu', name='F7')) #representation layer
model.add(tf.keras.layers.Dropout(0.5, name='D0'))
#Output layer #change units number depending on the number of classes,
#this is if we want to retrain the whole model on our dataset
model.add(tf.keras.layers.Dense(8631, activation='softmax', name='F8' )) #this is the layer that will be dropped

sgd_opt = tf.keras.optimizers.SGD(learning_rate= 0.001, momentum= 0.9)
model.compile(optimizer= sgd_opt, loss= 'categorical_crossentropy', metrics=['accuracy'])

#load the weights
model.load_weights('/content/VGGFace2_DeepFace_weights_val-0.9034.h5')

I get the following error message, when I run the code:
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-9-e3e69a625b6a> in <module>()
     41
     42 #load the weights
---> 43 model.load_weights('/content/VGGFace2_DeepFace_weights_val-0.9034.h5')
     44
     45

5 frames
/usr/local/lib/python3.6/dist-packages/tensorflow/python/framework/tensor_shape.py in assert_is_compatible_with(self, other)
   1115     """
   1116     if not self.is_compatible_with(other):
-> 1117       raise ValueError("Shapes %s and %s are incompatible" % (self, other))
   1118
   1119   def most_specific_compatible_shape(self, other):

ValueError: Shapes (2401, 784, 16) and (625, 784, 16) are incompatible

Hi,
Did go through your code. Appears to me that layer L5 (LocallyConnected2D) has an argument (strides=2) missing which is causing the error in shape while loading the weights of the pre-trained network.
Please make sure to use this as the layer L5 (as per the source code provided):
model.add(tf.keras.layers.LocallyConnected2D(filters=16, strides=2, kernel_size=(7,7), activation='relu', name='L5'))

A simpler workaround (and little easier way) of what you are trying to implement would be equivalent to these few lines of code:
pip install git+https://github.com/swghosh/DeepFace.git

from deepface import deepface
from tensorflow import keras  # should well support TFv1.15+ as well as TFv2.x

base_model = deepface.create_deepface()
weights_path = deepface.get_weights()  # will auto-download pre-trained weights
base_model.load_weights(weights_path)

base_model.summary()

Also, I'm hoping that you are looking forward to use the pre-trained model with a custom dataset (new classifier trained on images of new people), for which you can refer to this notebook (FineTuning DeepFace on a smaller dataset.ipynb) which can act like an end-to-end guide.

Hello Swarup,
Thanks for your message.
The time taken for recognition is about 30 secs, is there a way to decrease the time taken by the classifier.
Another question is, do I just use the weights provided, without the need for training.
Regarding localization, I wanted to know more about how to localize the face (face location) in an image, can this be achieved using this classifier.
Thank you.

@alhusseindev, the DeepFace network is a really bulky though because of the presence of three Locally Connected layers and  two terminal Dense layers. You can reduce the recognition time using a GPU, if you have one available; otherwise I do agree that the model is quite computationally expensive to run even for inference.
As of now, DeepFace feature vectors (output of F7 layer, refer paper) can be treated as high quality face specific features. There isn't any workaround to skip training process, you'll need a linear classifier to train these features for a new face recognition classification task. If you're looking for something that requires no training and does face verification consider reading the last part of this comment for FaceNet. Probably, you should go through this, the package would help you verify 2 faces are of same person or not using similarity matching of face feature vectors, it uses the same weights from my repo when used with `model='DeepFace'.
Lastly, for the face localization task (detect faces, cropping them and aligning them) consider using dlib.get_frontal_face_detector with dlib.get_face_chips. More information and code is available in this issue.


[Navigator 2.0] replace function doesn't actually work as expected.

replace() shouldn't allow moving back from the browser back button. However, when we move from Page 1 to Page 2 using replace(), here the back button will be disabled. Now move from Page 2 to Page 3 using push(). Now click back and reach to Page 2. Here, the back button will be enabled and you can reach Page 1 (which shouldn't be allowed).
Steps to reproduce the behaviour:

Move from Page1 to Page2 using replace()
Move from Page2 to Page3 using push()
Click back on Page3 and reach Page2
Click back once again on Page2 and you can reach Page1 (Shouldn't be allowed)

Expected behaviour
There should be no way to reach Page 1 if we are using replace() to move to the next page.
Desktop (please complete the following information):

OS: Windows 10 and Big Sur
Browser: Chrome and Edge

Reproducible code
https://github.com/AbhishekDoshi26/navigator_test

Added a hack in v3.1.0 to manipulate the issue. It is a framework issue.


[Bug]: Panic occurred if require.context can not resolve the dir

System Info
System:
OS: macOS 13.6.7
CPU: (10) arm64 Apple M1 Pro
Memory: 386.00 MB / 32.00 GB
Shell: 5.9 - /bin/zsh
Binaries:
Yarn: 1.22.19 - ~/Library/Application Support/fnm/node-versions/v18.19.0/installation/bin/yarn
npm: 10.2.3 - ~/Library/Application Support/fnm/node-versions/v18.19.0/installation/bin/npm
pnpm: 9.1.3 - ~/Library/Application Support/fnm/node-versions/v18.19.0/installation/bin/pnpm
bun: 1.1.8 - ~/.bun/bin/bun
Browsers:
Chrome: 125.0.6422.142
Safari: 16.6
npmPackages:
@rspack/cli: ^0.7.0 => 0.7.1
@rspack/core: ^0.7.0 => 0.7.1
Details
Panic occurred if require.context can not resolve the dir, it is expected to throw an resolve error like webpack:

webpack

Rspack

Reproduce link
https://github.com/chenjiahan/rspack-repro-require-context-panic
Reproduce Steps

pnpm i
pnpm dev:rspack

relate to https://github.com/web-infra-dev/rspack/issues/6474

Yeah these two issues are the same, maybe we can close one


Improve HttpClient possible error

Improve configuration to avoid the following case : https://github.com/AirVantage/av-backend/issues/150

https://github.com/AirVantage/av-sched/tree/feature/24_httpclient-retry-strategy


fixed-missing-testimonials

What this PR do?
fixed #66 , This PR fixes the missing testimonials section.
Step to verify

go to home page
scroll down
after the About us section you will see the testimonials section

Additional info

please review, this PR and kindly tell if any changes are required.

Hii @vashukashyap  please resolve merge conflicts.

Hi @vashukashyap thank you for your contribution😇.


Expanded fix for edge case with code obfuscaters and inner classes

Made the condition a little more precise, and added the check to another spot where StringIndexOutOfBoundsExceptions were at risk
#2002

Good find @nmck257 !


Key Renaming and skip null values are not Working

Hello,
Something is not ok when I make according changes with MongoDbSink because

Json Keys are not renamed
Deny insert into mongo json with null values is not working even if is set to true

Bellow you find attached my conf.properties
name=MyMongoDbSinkConnector
topics=test,testkafka
tasks.max=1
#key.converter=io.confluent.connect.avro.AvroConverter
#key.converter.schema.registry.url=http://localhost:8081
#value.converter=io.confluent.connect.avro.AvroConverter
#value.converter.schema.registry.url=http://localhost:8081
key.converter=org.apache.kafka.connect.json.JsonConverter
key.converter.schemas.enable=false
value.converter=org.apache.kafka.connect.json.JsonConverter
value.converter.schemas.enable=true
connector.class=at.grahsl.kafka.connect.mongodb.MongoDbSinkConnector
#specific MongoDB sink connector props
#listed below are the defaults
mongodb.connection.uri=mongodb://localhost:27017/kafka?w=1&journal=true
mongodb.collection=kafkatopic
mongodb.max.num.retries=3
mongodb.retries.defer.timeout=5000
mongodb.value.projection.type=none
mongodb.value.projection.list=
mongodb.document.id.strategy=at.grahsl.kafka.connect.mongodb.processor.id.strategy.BsonOidStrategy
mongodb.document.id.strategies=
mongodb.key.projection.type=none
mongodb.key.projection.list=
mongodb.field.renamer.mapping=[{"oldName":"key.myta","newName":"key.batteryVoltage"}]
mongodb.field.renamer.regexp=[]
mongodb.post.processor.chain=at.grahsl.kafka.connect.mongodb.processor.field.renaming.RenameByM$
#mongodb.field.renamer.regexp=[{"regexp":"^key\..my.$","pattern":"my","replace":""},{"regexp$
mongodb.change.data.capture.handler=
mongodb.delete.on.null.values=true
mongodb.replace.one.strategy=at.grahsl.kafka.connect.mongodb.writemodel.filter.strategy.ReplaceOneDefaultFilterStrategy
Also I tried with
mongodb.field.renamer.mapping=[{"oldName":"myta","newName":"batteryVoltage"}] but still nothing the json data is same.
What I send to topic is
{"schema":{"type":"struct","fields":[{"type":"string","optional":true,"field":"myta"}]},"payload":{"myta": "myta"}
Please can someone help me on that matter ?
I must tell that except that part were json data is not postprocessed by the connector,  data that is fetched from those 2 topics is inserted in collection succesfully
Also I have a question regarding method of how this connector insert data to MongoDb.
For each message that appears in broker topic this connector creates a insert cmd ? or data received in topic si stored in a buffer for 10 seconds for example and then this buffer is pushed to database with a bulk write operation ?
If bulk write is available is there a chance to change parameter ? batch size, time untill batch expires and then bulk write data to database ?
Thank you in advance,

Hi @durduliu2009
Thanks for reaching out. I quickly looked into this

Hi @durduliu2009
Thanks for reaching out. I'll quickly look into this later today. From what I've seen so far and if I understood you correctly it's some misconfiguration that most likely causes you trouble. Field renaming definitely works. Will check and get back to you.

Also please if you are kind to respond my question

Also I have a question regarding method of how this connector insert data to MongoDb.
For each message that appears in broker topic this connector creates a insert cmd ? or data received in topic si stored in a buffer for 10 seconds for example and then this buffer is pushed to database with a bulk write operation ?

If bulk write is available is there a chance to change parameter ? batch size, time untill batch expires and then bulk write data to database ?

Hi again,
So with regard to your:

problem = renaming of fields

As I said the renaming works fine. What's important is that you configure the renaming settings properly and also take care that you do it for the key and/or value structure of the kafka sink record. To take your example you could e.g. use the following configuration settings:
Make sure to put the correct renamer in the post processor chain settings like so:
mongodb.post.processor.chain=at.grahsl.kafka.connect.mongodb.processor.field.renaming.RenameByMapping
Also define the renaming itself
mongodb.field.renamer.mapping=[{"oldName":"key.myta","newName":"batteryVoltage"}]
This will then cause a field named myta in the key(!) struct of the record to be renamed to batteryVoltage. if the field is in the value struct then go with 'value.myta' instead.

problem = using the mongodb.delete.on.null.values=true

Maybe you misunderstood what this setting is supposed to do. The idea is that the sink connector will try to delete a mongodb document from the collection iff the whole value struct is null. Deletion will be done based on the _id field. But in your case you are using the BsonOidStrategy which will always create a new _id for each sink record which effectively means it will never delete anything, since you get a unique _id for every sink record which is processed. This setting can only be reasonably applied when you have an _id field based on a different DocumentIdStrategy. Hope this is clearer now.

And finally about your comment about error handling. Short answer NO(!) you cannot simply ignore such severe issues which result from a parse error of the whole message - this would also make no sense. Also such errors affect the connect framework code meaning they happen before the specific sink connector code kicks in. You have several options to configure how the key and value struct are encoded. In your config example above your are doing the following:
key.converter=org.apache.kafka.connect.json.JsonConverter
key.converter.schemas.enable=false
This means the key is encoded as JSON string but without(!) explicit schema information.
value.converter=org.apache.kafka.connect.json.JsonConverter
value.converter.schemas.enable=true
This means the value is encoded as JSON string but with(!) explicit schema information.
Thus, whenever a kafka record in the corresponding topic would violate this configuration the connector cannot parse and handle the record correctly. You should absolutely make sure that you don't let producers send "garbage data" (i.e. invalid records) to your topics :)

Ok i will try as you said and then i will come back with a feedback. Please let this topic open for few days. Thank you

As I promised I'm coming back with confirmation for key/value renaming. Yes it is functional :)
Also many thanks for your advice(s). Sorry if I'm asking again but I saw in your documentiation that The sink records are converted to BSON documents which are in turn inserted into the corresponding MongoDB target collection. The implementation uses unorderd bulk writes.. OK this responds to one of my questions if this connector uses bulk writes as main write to MongoDb BUT how it does it ? (in which interval ms or batch size ? Can I change somehow those settings if exists (batch ms or batch size) ?
Thank you again for your support.

Good. Many thanks for these usefull informations. I'm curios regarding #45 (https://github.com/hpgrahsl/kafka-connect-mongodb/issues/45) if  you plan to develop this kind of feature. Also I tried to give you a good exemple of why and how we can use this kind of feature. Thank you again.


Fix directory separator replacement on Windows

This change fixes issue https://github.com/techno-express/node-7z/issues/7 and includes the list test improvements from PR https://github.com/techno-express/node-7z/pull/6 , creates a new utility function for conversion from paths with the native directory separator (on Windows: a\b\c\d.txt) to paths with slashes (a/b/c/d.txt), and uses it instead of <string>.replace(path.sep, '/')

Codeclimate is complaing about code I didn't write. Can you bypass it?


Can I get a build for VS on windows?

hey there,
I'd really like to try your library in my windows x86_64 project
Is there a way I could get a build with the .lib and .dll files from msvc?

What we have on GitHub is all we can offer to try under Apache 2.0 license. If you are working on a commercial project, feel free to fill out a request form on our website here, and we might be able to develop and offer these under our development license


Hide duration (current time) if using actual time in seek time component

When using the actualLiveTime feature on a live stream, currently the duration will be shown as the current time. This removes this as I don't think it's really useful.
@cowai you happy with this change? If you still want to be able to show the actual time as the duration it could be changed to be another config option instead.

once again tks


Update Smart Scroll to v4.0.7

Thank you for the contribution. It was merged directly as 7381ad74057e2c09ae5c3d4b08bfdccfb1d291c1 to keep commit history cleaner. Your contribution is still credited to you.


add it to luarocks.org ?

hi,
thanks for writing this plugin. I've long dreamt about it and you made it !
It depends on several plugins  https://github.com/danielfalk/smart-open.nvim?tab=readme-ov-file#requirements and as such is a perfect candidate for a luarocks package, which recent plugin managers such as  https://github.com/nvim-neorocks/rocks.nvim or https://github.com/folke/lazy.nvim can leverage to autoinstall dependencies.
Also since you've already have 0.1 and 0.2 branches, looks like you care about versioning.
See https://github.com/nvim-neorocks/rocks.nvim/wiki/Plugin-support how to do this and let me know if you want help.

I've added it: https://luarocks.org/modules/neorocks/smart-open.nvim but now I have:

Unable to find native fzy native lua dep file. Probably need to update submodules!

even though the README marks the dependency as optional. I dont mind either way but if it's optional, the plugin should not display this distracting warning.

Thanks for doing this!  Let me see if I can look into the warning.


Tag function improvement

What feature or improvement do you think would benefit Files?
seems like the tag function is not fully functioning. tag only works on the current window, when I open a new window or tab tag disappears. I wish tags could be recognized throughout the whole file system. not only on the current window.
and also I was using quicklook, and it's been very glitchy with the app, let me know if this is a known issue.
Requirements

This proposal will accomplish X
This proposal will accomplish Y
This proposal will accomplish Z

Files Version
<IP_ADDRESS>
Windows Version
10.0.19045.3448
Comments
No response

Thanks for the report. Please use the bug report option including the location of files/folder you are applying the tags too. Also any issue you have with Quick look make a separate bug report.


add ‘frugally-deep’ package

add machine-learning documentation section
note move xgboost and caffe to machine-learning
note: dlib is listed in both computer-vision and machine-learning

I've followed this guide
step by step carefully. [Yes]

I've tested this package remotely and have excluded all broken builds.
Here is the links to the Travis/AppVeyor with status "All passed":

https://travis-ci.org/headupinclouds/hunter/builds/341894883 [updated]
https://ci.appveyor.com/project/headupinclouds/hunter-8w0rs/build/1.0.10 [updated]

I have submitted CI configs to https://github.com/ingenue/hunter targeting pkg.template branch,
see this merged pull request https://github.com/ingenue/hunter/pull/195 [IN PROGRESS]

Testing:

https://ci.appveyor.com/project/ingenue/hunter/build/1.0.3356
https://travis-ci.org/ingenue/hunter/builds/341916312?utm_source=github_status&utm_medium=notification

Upload:

https://ci.appveyor.com/project/ingenue/hunter/build/1.0.3357
https://travis-ci.org/ingenue/hunter/builds/342080886?utm_source=github_status&utm_medium=notification

Follow-ups: https://github.com/ruslo/hunter/commit/78f356c878a42a3ace38ad8cf0599426563eebc0 https://github.com/ruslo/hunter/commit/2089e17300153bad7e9ae9ab1870b75d12908816
Released: https://github.com/ruslo/hunter/releases/tag/v0.20.9


[Vue Beautifier] Add option to let it indent first child in .vue files'

I'm working on a Vue.js project with some coworkers, where some of us use Atom (with atom-beautify package) and the other ones use Visual Studio Code (with Vetur extension). I'm trying to fit my project's extensions/settings so that I can get the same formatting rules for both editors, but I simply can't make them indent <template> sections the same way. VSCode/Vetur treats this section as an ordinary HTML code, indenting it as usual:
<template>
  <div> <-- indented as usual
    (...)
  </div>
</template>

On the oher hand, atom-beautify seems to treat the very first <template> tag in .vue files specially, not indenting its first child:
<template>
<div> <-- NOT indented
  (...) <-- indented as usual
</div>
</template>

Would it be possible to add an option to Vue Beautifier allowing it to indent <template>'s first child as the first example above shows, so that I can format code consistently in either Atom or VSCode?
By the way, I've just opened another issue for the converse behaviour in VSCode: https://github.com/octref/vetur/issues/198

I think <template> 、<script> 、'

This would also help with the issue that Atom only allows you to fold indented code.
Atom folding will work as expected if there is a leading indent...
<template lang="pug" >
    .main-section
        p Lorem Ipsum
</template>

collapses, as expected, to
<template lang="pug" >
</template>

But atom-beautify removes that indent.
The output after code has been "beautified". Atom will not recognize the template tag as an indent point
<template lang="pug" >
.main-section
    p Lorem Ipsum
</template>

I'm still experiencing this issue ...

Having this problem currently. Found no setting to indent first child.

Still experiencing this issue as well. Would love to have this option.

This is something I would also be interested in seeing.

Having this problem, no settings to indent first child.

Having this problem as well, sad.


Shadows existing notebook on port 8888

Description
If you have JupyterLab Desktop + Jupyter Notebook/Lab installed via PyPI, launching JupyterLab Desktop will hijack the existing port 8888.
Reproduce

Launch Jupyter notebook -> launched on port 8888 -> use with configured access token / pw -> works fine via browser
Launch JupyterLab Desktop -> works fine
Try to use Jupyter notebook via browser on port 8888 again -> access token / pw no longer work -> this is actually the JupyterLab web server shadowing the already-running Jupyter notebook on port 8888
Close JupyterLab Desktop
Jupyter notebook works fine on browser via port 8888 again

Expected behavior
JupyterLab Desktop does not hijack an existing port.
Context

Operating System and version: Windows 10
JupyterLab-Desktop version: 3.2.4-3
Installer:  .exe

Jupyter notebook installed via pip, configuration at %USERPROFILE\.jupyter
JupyterLab Desktop installed via .exe installer, not in PATH

Thank you for reporting this. I could not reproduce it on Linux - it might be Windows specific. Could you please provide some more information to help narrow it down?

How do you start Jupyter Notebook? (jupyter notebook, jupyter nbclassic, jupyter server?) Does it happen for every of this options?
What is the output of jupyter --version?
What port does JupyterLab Desktop show in %USERPROFILE%\AppData\Roaming\jupyterlab-desktop\logs\main.log (the last few entries) when the problem occurs?

Jupyter notebook was started via nbopen shell extensions.
Output: jupyter --version jupyter core     : 4.6.3 jupyter-notebook : 6.4.6 qtconsole        : 4.7.3 ipython          : 7.14.0 ipykernel        : 5.2.1 jupyter client   : 7.0.1 jupyter lab      : 2.1.2 nbconvert        : 6.1.0 ipywidgets       : 7.6.5 nbformat         : 5.0.6 traitlets        : 5.0.5
%USERPROFILE%\AppData\Roaming\jupyterlab-desktop\logs\main.log does not indicate a port:

[2021-12-20 15:54:28.653] [info]  In production mode
[2021-12-20 15:54:28.658] [info]  Logging to file (C:\Users\username\AppData\Roaming\jupyterlab-desktop\logs\main.log) at 'false' level
[2021-12-20 15:54:28.723] [error] (node:18240) DeprecationWarning: findLogPath() is deprecated and will be removed in v5.
(Use `JupyterLab --trace-deprecation ...` to show where the warning was created)
[2021-12-20 15:54:37.691] [info]  Jupyter Server initialization message: C:\JupyterLab\resources\jlab_server\lib\site-packages\traitlets\traitlets.py:2202: FutureWarning: Supporting extra quotes around strings is deprecated in traitlets 5.0. You can use '' instead of '""' if you require traitlets >=5.
  warn(
C:\JupyterLab\resources\jlab_server\lib\site-packages\traitlets\traitlets.py:2202: FutureWarning: Supporting extra quotes around strings is deprecated in traitlets 5.0. You can use '*' instead of '"*"' if you require traitlets >=5.
  warn(
[I 2021-12-20 15:54:37.691 ServerApp] jupyterlab | extension was successfully linked.

[2021-12-20 15:54:38.512] [info]  Jupyter Server initialization message: [I 2021-12-20 15:54:38.516 ServerApp] nbclassic | extension was successfully linked.

[2021-12-20 15:54:38.588] [info]  Jupyter Server initialization message: [I 2021-12-20 15:54:38.596 ServerApp] nbclassic | extension was successfully loaded.

[2021-12-20 15:54:38.590] [info]  Jupyter Server initialization message: [I 2021-12-20 15:54:38.596 LabApp] JupyterLab extension loaded from C:\JupyterLab\resources\jlab_server\lib\site-packages\jupyterlab

[2021-12-20 15:54:38.591] [info]  Jupyter Server initialization message: [I 2021-12-20 15:54:38.596 LabApp] JupyterLab application directory is C:\JupyterLab\resources\jlab_server\share\jupyter\lab

[2021-12-20 15:54:38.597] [info]  Jupyter Server initialization message: [I 2021-12-20 15:54:38.606 ServerApp] jupyterlab | extension was successfully loaded.

[2021-12-20 15:54:38.599] [info]  Jupyter Server initialization message: [I 2021-12-20 15:54:38.606 ServerApp] Serving notebooks from local directory: C:\Users\username

Thank you. I am very surprised by this It should not be possible to bind to the same port twice.

Could you also run jupyter server list before and after the starting JupyterLab Desktop, while Notebook is already running and share the outputs, contrasting them with jupyter notebook list?
Are you using the default environment that ships with JupyterLab Desktop, or your own environment?
Could you try to install jupyter-server and nbclassic and see if this is also happens when starting the notebook using jupyter nbclassic?

jupyter server was not installed, if I install it in my system python installation and run jupyter server list, it shows no running servers at any point.
JupyterLab Desktop conda environment is not in $PATH, my standard python installation is (which also runs Jupyter Notebook/Lab regularly, packages managed by pip)
I will try it.

@krassowski is there any way I can enter the installed conda environment or even better, see the console/logging output from the JupyterLab Desktop electron application and jupyter server etc.?

So it is an issue with jupyter server itself.

Thanks for following up on this in https://github.com/jupyter-server/jupyter_server/issues/659!


linux-yocto-artik: Use new artik-next branch

This branch contains a new code drop from Samsung with changes
for MIPI screen support mainly.
Signed-off-by: Florin Sarbu<EMAIL_ADDRESS>

@agherzan @telphan @petrosagg

SGTM


API bug: /renter/files returns "files": null when zero files exist

BUG REPORT
Stack Trace or error message
N/A
How to reproduce it (as minimally and precisely as possible)
Start siad
Call /renter/files
$ curl -A "Sia-Agent" "localhost:9980/renter/files"
{"files":null}

Expected Behavior
/renter/files should return {"files":[]}
Actual Behavior
/renter/files returns {"files":null}
From a client perspective, null is unexpected. It's more natural for it to return an empty array.
/renter/contracts/ has intuitive behavior for this:
$ curl -A "Sia-Agent" "localhost:9980/renter/contracts"
{"contracts":[]}

Environment

Sia version: latest master, as of 2018-02-12 (77bc1a0ac5a00a83e3cabc6ad788625a71966c52)
OS: Ubuntu 16.04

this is due to dumb behavior in Go's JSON encoder. Basically:
var slice []int
json.Marshal(slice) // => "null"
slice = []int{}
json.Marshal(slice) // => "[]"

Internally, the difference is that the first slice is completely zero-valued; the underlying pointer that normally points to the slice data is 0. Whereas the second slice has a valid pointer, just with zero length.
There is some merit to encoding them differently, since otherwise, you can't distinguish between a missing value and an empty value. But for our purposes, we want [] pretty much everywhere, not null.
AFAIK our API docs don't specify whether such values return [] or null, so maybe we can get away with breaking compatibility here. If we do that, I'd like to do it everywhere null appears, and then commit to not introducing it anywhere else.


fix create job summary job in Github actions

https://github.com/bosonprotocol/interface/actions/runs/4616885744/jobs/8162616456

I'll wait for fleek to work again before closing this https://github.com/bosonprotocol/interface/actions/runs/4617483459/jobs/8163918484


Web application becomes unresponsive at higher container counts

I've got scope v0.11.1 (running locally, not using web service) set up on a cluster of 5 hosts, with ~60-70 containers and the web ui seems to be completely unresponsive. The initial scope page loads, but immediately causes the browser tab to lock up and start consuming >100% cpu. I've noticed that this problem goes away when I run on only 1 or 2 hosts (so the container count is only around 20).
Has anyone else seen similar client-side performance issues with larger topologies?
Relevant Info:
Docker version: Docker version 1.9.1, build a34a1d5
Weave version: 1.4.2
Scope command: docker run --privileged -d --name=weavescope --net=host --pid=host -v /var/run/docker.sock:/var/run/docker.sock weaveworks/scope:0.11.1 --probe.docker true
Browser: Chrome version 47.0.2526.106 (64-bit)

Hi Brian - thanks for the bug report.  We'll take a look at it right away.  /ping @foot

Thanks for the bug report!

Wow you guys are fast :stuck_out_tongue_closed_eyes: Thanks for the quick fix! Looking forward to the next release

Thanks Bryan! We're working on getting the next release out asap.
On Tuesday, 19 January 2016, Brian Dentino<EMAIL_ADDRESS>wrote:

Wow you guys are fast [image: :stuck_out_tongue_closed_eyes:] Thanks for
the quick fix! Looking forward to the next release
—
Reply to this email directly or view it on GitHub
https://github.com/weaveworks/scope/issues/830#issuecomment-173091101.


DropdownMenu is very slow when using large lists

Is there an existing issue for this?

[X] I have searched the existing issues
[X] I have read the guide to filing a bug

Use case
When using large lists of options in the DropdownMenu, the UI starts to slow down terribly, loading the list itself is very slow.
Unable to use.
We need to add something like virtualization so that only those options that should be visible at the moment are drawn.
Proposal
Add virualization to the options list.

Hi @dam-ease
Thank you for the answer.
To begin, I need a widget that allows me to select one item from a long list (let's say a list of cryptocurrencies existing in the world, and this is 10-13 thousand items). But this widget should be compact, not in the form of a ListView. At the same time, this control should filter this list when entering a text, showing the user in the drop-down list only those elements that match the input.
As a result, it boils down to the fact that DropdownMenu is the closest of the standard controls. But it is very slow. You can try to put a list of 12000 elements on it yourself and try to filter it with input.
There are alternative packages/widgets that I have looked at. All of them work incorrectly in some way or the style is not configured.
Also, I tried the AutoComplete Flutter widget, but it doesn't have customizable input field. For example, it is not possible in "Material 3" theme mode to set it up as an outlined field. Also, it has a bug with a list of options that is too wide, longer than the field itself, right up to the edge of the window.
I also tried third party packages, they all have a problem with the appearance, which can not be properly configured.
The DropdownMenu seems the closest. But it has too slow functionality of the list of options. And the best thing, and the right thing to do, would be to improve it.
As for how best to do this, I can’t really tell you, because I don’t really know all the variety of low-level Flutter components yet, and which is better to use for this.
But, for example, there is an AutoCompleteTextField widget from autocomplete_textfield package, in which this list of options is very fast, regardless of the length of the list. And even with a list of 12000 items, it opens instantly as you type. You could take a look at this package, for example.

Hi @yegor-pelykh. Thanks for the detailed explanation.

Absolutely not suitable. I do not like its customization and the inability to write a text filter. In addition, its styles need to be completely rewritten, if it is doable at all.
You already have a cool widget that is perfect for this. Why not just improve/optimize the loading/display of its data?

Absolutely not suitable. I do not like its customization and the inability to write a text filter. In addition, its styles need to be completely rewritten, if it is doable at all. You already have a cool widget that is perfect for this. Why not just improve/optimize the loading/display of its data?
As I said before, I already saw the widget with very fast loading and display (AutoCompleteTextField widget from autocomplete_textfield package). You can investigate how it is implemented there. So, at least, it is doable.

Optimize your code, why must you load 20000 at once

Hi @teewhydope
I described above why this is needed and for what cases. It's strange that you don't know situations where widgets need to work with long lists.

By the way, let's go the other way.
Flatter also has an autocomplete widget. It also loads a large list quickly. Why did its developer do it normally, but in the case of the D-menu, you don’t want to bother?
I would use this autocomplete widget, it is perfect in this regard. But! It also has bugs that are critical for me, as for any other developer, and I'm going to create a request to fix them. I'm even interested to see how your developers react to these bugs, do you also say "just don't use this widget"?
Flutter is probably the only project for which not a single feature request I created or a reported bug was properly resolved. No one. For example, one feature is still hanging in the open state for more than a year. Although many people need it, and its essence is in the functionality that has long been implemented on other frameworks. But you saw it as "not urgent." The same goes for handling each bug. If you have so many plans of your own, and you don’t care about community requests, then maybe you shouldn’t have opened the issues section then?
Of course, I understand that I've gone off topic, but it's just annoying that developers spend a lot of time writing issues for you, giving code examples, creating various simple examples for you, they still have to justify themselves for using certain widgets, and then just get denied to promote those issues.

By the way, let's go the other way. Flatter also has an Autocomplete widget. It also loads a large list quickly. Why did its developer do it in the best way, but in the case of the DropdownMenu, you don’t want to bother? I would use this Autocomplete widget, it is perfect in this regard. But! It also has bugs that are critical for me, as for any other developer, and I'm going to create a request to fix them. I'm even interested to see how your developers will react to these bugs, do you also say "just don't use this widget"?
Flutter is probably the only project for which not a single feature request I created or a reported bug was properly resolved. No one. For example, one feature is still hanging in the open state for more than a year. Although many people need it, and its essence is in the functionality that has long been implemented on other frameworks. But you saw it as "not urgent." The same goes for handling each bug. If you have so many plans of your own, and you don’t care about community requests, then maybe you shouldn’t have opened the issues section then?
Of course, I understand that I've gone off topic, but it's just annoying that developers spend a lot of time writing issues for you, giving code examples, creating various simple examples for you, they still have to justify themselves for using certain widgets, and then just get denied to promote those issues.

check this if it will this solve your issue
https://gist.github.com/teewhydope/d347610bf2caf5db8c4a710f5df9b71c

Have you even tried it yourself? This is not only not work, but the code that you sent is not prepared at all, and doesn't work "as is", it has a lot of errors.
Final conclusion: It doesn't work for me.
Could you please just focus on improving the DropdownMenu widget?
Why does Autocomplete work fine with long lists?
Just see how it's done there and improve the DropdownMenu widget.

Have you even tried it yourself? This is not only not working, but the code that you sent is not prepared at all, and doesn't work "as is", it has a lot of errors. Final conclusion: It doesn't work for me.
Could you please just focus on improving the DropdownMenu widget? Why does Autocomplete work fine with long lists? Just see how it's done there and improve the DropdownMenu widget.

 A good developer would have easily fixed the error in the snippet i shared. I'm not in anyway affiliated with the flutter team, i'm just a normal user trying to provide you a fix. Flutter is open-source, you can actually contribute/fix the issue instead of whining...

Firstly, if you are not a developer, then there is no point in discussing this with you. I asked the developers of the widget to improve it. How do you feel about this and why then are you taking my time? And what's the point for you? Do you want them not to improve existing widgets? So, what is the point of your being here at all?
As for the code you provided, I fixed the bugs in it myself, and already told you that it doesn't fit and just doesn't work. And before you send something, first try it yourself and make a normal simple example that works, or don't write at all. The essence of creating an issue is not to make your own widget, but to appeal to developers with a request to improve third-party widget.
The GitHub community, and in particular the "issues" section, is just created in order, as you say, to complain about problems in existing code and improve projects.
Of course, I can write such a control myself, but any developer first uses what is already there, and if it does not work well enough, he will suggest improving it. What I am doing. If I make such a widget, and it turns out to be very similar to the existing one in flutter, but with one minor improvement, then this will be a strange investment of time from a third-party developer, when a team that only needs to improve the existing one a little, could not do it and did not want to. Then there are big questions to the project. Therefore, I do everything according to the correct procedure provided by the community.

This would be a very nice addition.
We have a table view with Dropdown in a columns cells, and it seems that because the entries are are list of widgets and not added in a builder style they are all rendered even when it is not open, so this affects the performance of table scrolling as well

I have this same issue as well - dropdown lists of 150,000 take a long time to load.
I understand that the way to handle this with a Listview is to use Listview.builder to render only the items visible on the screen: https://api.flutter.dev/flutter/widgets/ListView/ListView.builder.html.
Could the same be added to DropdownButton so that only the DropdownMenuItems visible on the screen will be rendered?  Or, is that the intent of DropdownButton.selectedItemBuilder?

Easy solution:
Just use a custom dropdown that's it
I had the same problem from API to dropdown with 2000 documents API  it was so slow and just when made custom dropdown and used it made blazing fast performance xd

I just want to make an addition to this issue, I find it quite bad that we render the whole list despite search being disabled. (Notice that the enableFilter option shouldn't have an impact on whether we can or cannot render the list without feature restrictions)
It's possible to have both filter and search enabled, whilst rendering only required items (by view extent), if the itemExtent was known (ref: #140057).

Is there any progress？

@yegor-pelykh @kcjian I had the same problem with just a list of 10000 Strings. The difficult part with other solution was the decoration. Finally, I managed to use this https://pub.dev/packages/search_choices which has a fieldDecoration field and helped me to recreate the same UI result (same button decoration as the other fields).

How about, draw shorter list when filter not applied or filtered result is too large.
Example: total list is 10000, dropdown show first 10 only, when filter applied, get first 10 results from filtered list.
`
filterCallback: (entries, filter) {
final String trimmedFilter =
filter.trim().toLowerCase();
if (trimmedFilter.isEmpty) {
//limit count of visible non-filtered results
return entries.sublist(
0,
entries.length > 10 ? 10 : entries.length,
);
}
List filteredList = universityList
.where((String universityStr) => universityStr
.toLowerCase()
.contains(trimmedFilter))
.toList();
  //limit count of visible filtred results
  filteredList = filteredList.sublist(
    0,
    filteredList.length > 10 ? 10 : filteredList.length,
  );
  return stringListToMenuItems(filteredList);
}

`

Makes sense. Will try it for comparison reasons. I have also consider the decoration thing too.


Error appearing in home assistant logs

Logger: homeassistant.components.climate
Source: components/climate/init.py:367
integration: Climate (documentation, issues)
First occurred: 1:57:02 AM (1 occurrences)
Last logged: 1:57:02 AM
Entity None (<class 'custom_components.smartrent.climate.SmartrentThermostat'>) implements HVACMode(s): heat, cool, off, heat_cool and therefore implicitly supports the turn_on/turn_off methods without setting the proper ClimateEntityFeature. Please create a bug report at https://github.com/ZacheryThomas/homeassistant-smartrent/issues

Should be fixed when you download the latest release!
https://github.com/ZacheryThomas/homeassistant-smartrent/releases/tag/v0.4.6


[Packager] Packager is bundling modules with conflicting names

When requiring an npm package that depends on invariant from npm (https://www.npmjs.com/package/invariant), the packager creates a bundle that contains __d('invariant', ...) twice because the npm package also declares @providesModule invariant in its docblock. Instead of defining two modules with the same name, the packager should namespace them differently. This is on master (pre 0.14-rc).

@ide this should be able to be avoided by blacklisting the node module invariant. On the new cli you should be able to define a file called rn-cli.config.js with a function named getBlacklistedRE which returns a regular expression for blacklisted modules. I'll close the issue but feel free to re-open it if you think this is not the right solution :)


Ensure secure access to storage account containers - Disable Anonymous Access for Storage Accounts

Implmented in https://github.com/Azure/gpt-rag-frontend/tree/pdfview/secure_view.
Needs to create pull request and review it before merge.

Completed.


[suggestion] config to hold key

Rather than switching between modes

I will likely not implement this unless there is more demand for it.


feat: add error boundaries and suspense usage with TRPC

Problem
Problem 1
Our current method of fetching data for pages with query params utilize getServerSideProps. We noticed a trend of slow initial load times for these pages as long as ~7s. This is likely (but not confirmed) attributed to Chakra's huge bundle size which slows down the time needed to build the server rendered page.
Solutions considered to root problem
We had two options

Attempt to fix getServerSideProps's bundle issues with Chakra - possibly looking into how we can treeshake chakra for server rendered pages to reduce build times
Introduce CSR patterns in our application

We went with option 2 as that was already in the existing roadmap.
Problem 2
Existing CSR patterns with page based routing was cumbersome as we could not use React 18's Suspense and the default ErrorBoundary from react-error-boundary.
This led to 2 dx issues:

In every component where we use query, we had to track isLoading and isError states and render the fallback components accordingly
There was a lack of a top level ErrorBoundary which would catch any errors thrown within child components which useSuspenseQuery

Solution

The inability to use React's Suspense component was due to the fact that any child component which calls the useRouter hook erroring out during server side rendering as the router had not mounted. T

To mitigate this, we created our own Suspense wrapper that keeps track of a isMounted state.

If the router is ready, we will render React's Suspense with the children
If router is not ready, fallbackComponent will render.

Created our own ErrorBoundary wrapper which catches error boundary states to render the correct fallback components

Improvements:

Refactored all queries to utilise useSuspenseQuery
Updated logic to handle redirects between sign-in and dashboard
Updated centralised logic for unauthorised errors redirecting to sign-in. This logic for this is now located in the ErrorBoundary component whenever a TRPCError has a code of UNAUTHORIZED

Tests

[x] Navigating to dashboard without logging in succesfully redirects me to sign-in
[x] Navigating to sign-in whilst authed redirects me to either callbackUrl or dashboard
[x] ErrorBoundary fallback component renders on different TRPCError codes
[ ] Suspense fallback renders when data is suspending

e2e tests failing, but fixed in #94. Can rebase/merge develop in first?

e2e tests failing, but fixed in #94. Can rebase/merge develop in first?

done