feature: columnar layout in Section

Is it possible to create columns in a document? I don't mean table columns, I mean columns within the body text, according to this documentation.
For example:

There is not yet API-level support for this in python-docx. Was that what you were asking?

Yes that's what I was wondering. Thanks! Should I leave this open for the future?

Yes, please

+1 for this feature

Is anyone working on this feature now or is there any show-stopper in development? I had an urgent need in this feature and it took less than 20 minutes to figure out a working solution so I'd share if it helps anyone. Is there anything fundamentally wrong with the solution below and if not - what would be the right way to integrate it (apart from the tests)?
For those needing this now here is a quick solution:
WNS_COLS_NUM = "{http://schemas.openxmlformats.org/wordprocessingml/2006/main}num"

def set_number_of_columns(section, cols):
    """ sets number of columns through xpath. """
    section._sectPr.xpath("./w:cols")[0].set(WNS_COLS_NUM, str(cols))

use example:
from docx import Document
from docx.enum.section import WD_ORIENT, WD_SECTION

doc = Document()
doc.add_paragraph("this page should be normal 1 column")
doc.add_page_break()
section = doc.add_section(WD_SECTION.NEW_PAGE)
set_number_of_columns(section, 2)
doc.add_paragraph("this page should have 2 columns and it seems to work ok")

Well, just offhand, I'd say you'd need to account for the case when w:cols is not already present, if it's an optional element, which, of course, most of them are. To determine that, you'd need to have the relevant parts of the XML schema, which is part of what goes on the enhancement proposal, aka. "analysis page".
Then the element name is more elegantly handled by the internal function qname(), like qname('w:num'). That function lives in docx.oxml I believe.
Also, of course, it would need to become a method on section, or more likely a set of properties or perhaps an object of its own, depending on the scope of things that can eventually be done to columns, like perhaps set their width, margin, or space between.
So you can see there would be a lot of additional details to attend to before it could be merged, and of course the tests. Best to start off with the enhancement proposal page if you want to pursue it. There would be specified the API and all the required background collected. All of this affects the implementation so best to get that discussed and merged before going more of the implementation than you'd like to redo :)

@scanny  is the two-column or even three-column feature implemented?

Is anyone working on this feature now or is there any show-stopper in development? I had an urgent need in this feature and it took less than 20 minutes to figure out a working solution so I'd share if it helps anyone. Is there anything fundamentally wrong with the solution below and if not - what would be the right way to integrate it (apart from the tests)?
For those needing this now here is a quick solution:
WNS_COLS_NUM = "{http://schemas.openxmlformats.org/wordprocessingml/2006/main}num"

def set_number_of_columns(section, cols):
    """ sets number of columns through xpath. """
    section._sectPr.xpath("./w:cols")[0].set(WNS_COLS_NUM, str(cols))

use example:
from docx import Document
from docx.enum.section import WD_SECTION

doc = Document()
doc.add_paragraph("this page should be normal 1 column")
doc.add_page_break()
section = doc.add_section(WD_SECTION.NEW_PAGE)
set_number_of_columns(section, 2)
doc.add_paragraph("this page should have 2 columns and it seems to work ok")

How awesome! Is there any solution to set width of each column, or set the width of line space area between two columns?

I have the same question! "Is there any solution to set width of each column, or set the width of line space area between two columns?"

It is possible to set width oh column with this code
...
WNS_COLS_WIDTH = "{http://schemas.openxmlformats.org/wordprocessingml/2006/main}space"
...
section._sectPr.xpath("./w:cols")[0].set(WNS_COLS_WIDTH, str(481))

where 481 is your desired width.


parseChallenge erroring out with Digest "charset" set

If the Digest contains a "charset" directive, (or anything not covered by the switch statement) it will throw a ErrBadChallenge Error. ("Challenge is bad").
One can add the additional cases into the switch to solve this of course, but for anyone wondering why the error appears...

The RFC states that unrecognised parameters MUST be ignored. This is a bug in the library.


Usage examples in C & asm include with track info.

Hi! I added a little example code for using sointu in C under Windows and Linux.
I also took the opportunity to sneak a generated asm include file with the track information (similiar to the C header) into the diff, which comes in really handy for my intro code :D
Let me know if you'd like some x86 asm code examples as well.

Thanks! This is exactly what we need so people know how to use sointu. I'll review & merge asap when I have time

Merged. Had to change the tests workflow to not build examples as a part of the workflow as it was complaining about missing alsa.
I guess we could also use CI to check that the examples build, but tests workflow feels wrong place for that.


Coda Daemon crashed

2020-09-13 05:47:49 UTC [Info] Producing block in 0 slots
2020-09-13 05:47:49 UTC [Fatal] Unhandled top-level exception: $exn
Generating crash report
exn: "(monitor.ml.Error\n  (Failure\n    "Failed to apply transiton frontier diffs to persistent database correctly: target hash was 777775fa5615b44143b5b5ba56f15893dc03140c95c57789514b41242b22b5e0, resulting hash was b6e1645e5e028b2e83f98ecee30b6c6b05d9a9f6b524d26abd32c92f25c59afe")\n  ("Raised at file \"stdlib.ml\", line 33, characters 17-33"\n    "Called from file \"src/deferred1.ml\", line 17, characters 40-45"\n    "Called from file \"src/job_queue.ml\" (inlined), line 131, characters 2-5"\n    "Called from file \"src/job_queue.ml\", line 171, characters 6-47"\n    "Caught by monitor coda"))"
2020-09-13 05:47:49 UTC [Info] would have validated but it's from us!
☠  Coda Daemon crashed.
The Coda Protocol developers would like to know why!

Closing this issue as it is stale for a long time.


test: add unit test case for static_locator.go

Signed-off-by: Guangwen Feng<EMAIL_ADDRESS>
Ⅰ. Describe what this PR did
Add unit test case for static_locator.go
Ⅱ. Does this pull request fix one issue?

NONE
Ⅲ. Why don't you add test cases (unit test/integration test)? (你真的觉得不需要加测试吗？)
Ⅳ. Describe how to verify it
Ⅴ. Special notes for reviews

Codecov Report

Merging #1374 into master will increase coverage by 0.10%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #1374      +/-   ##
==========================================
+ Coverage   51.88%   51.98%   +0.10%
==========================================
  Files         135      135
  Lines        8803     8803
==========================================
+ Hits         4567     4576       +9
+ Misses       3859     3850       -9
  Partials      377      377

Impacted Files
Coverage Δ

dfget/locator/static_locator.go
80.82% <0.00%> (+12.32%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5981693...3e51fda. Read the comment docs.

@zhouhaibing089 Thanks for the review, done, PTAL.

LGTM


Make BKG_PLOT faster

@paulray following your suggestion in #33
Let me know how I can help.
Looking at bkg_plots.py, most plots already come from the MKF file, except the overshootrate and undershootrate plots., right?

Yep, I think the changes are quite small. It just needs to extract those rates from the mkf instead of the events. The main complexity might be different time binning in the .mkf than in the science data (which I think is hkmet in the code).

I am not sure which columns of the mkf are needed for that:
TOT_UNDER_COUNT is for the undershoot rate, right ?
But TOT_OVER_COUNT does not seem to show the overshoot rate (when I compare the .mkf file with a prefilt_bkg.png plot)...
And I don't see where to get the Over+Under flags in the .mkf.
And the ratio of rejected events is FPM_RATIO_REJ_COUNT?

See the email I just forwarded to you.

To do:

[ ] Change the cartographer.py to use the over/under shoots from the .mkf file
[ ] Clean up the geteventshoots functions to make par-pipe faster.
[ ] anything else?

There is probably still some clean up to do. For example, I think the calls to quickhkshootrate and hkshootrate in NicerFileSet.py are not really needed anymore.  Except that I am not sure about the use of reset_rates.  This is sometimes set to None, sometimes by summing the MPU_UNDER_COUNT, and sometimes calculated from the event file self.etable (this one seems to be the slowest).  I am a bit confused about what the reset_rates is use for.


storybook show source code

storybook should show source code

I'll chime in - you have a few approaches to this right now
For them, some nice to haves would be to

Add PropTypes to each component, or at least the table (package is now installed but it is not being used). I think you can even force the StickyTable children to be Row, and Row children to be only Cell.
Add defaultProp to each component, or at least the table. This also gets rid of a few =1 inside the table
Use it as PropsTable of the story
Optionally, you can add comments in the PropTypes to show the descriptions
Replace the code inside each story for the actual return values of the classes you reference (if you render <Basic /> you get the output in the image below, if you put a the code that's in the return() inside the render() of Basic, the code gets show). Using functional components might help.

Now, the addons that help with this:
The first one is to use the info addon. Codewise changes are minimal, add the addon, register it, done.

The second one is to go for the docs addon, which will replace info in the coming storybook.
For this approach, although the storiesOf syntax might remain, they offer two new ways of writting stories, CSF (Component Story Format) and MDX (A JSX/MD mix). CSF is nice to write, MDX I didn't really like so did not check. This is the official example of it. This approach also can eliminate the need for the knobs addon in storybook 6.
A third option is the jsx addon but it is not officialy supported so I did not try it anywhere.

Thanks! PropTypes would be good - but I'm thinking the source code of each example would be nice to get below the functioning example, in-case you wanted to straight-up copy and paste the example into a project or see some detail of how it worked.
I tried info addon and it didn't seem to work - but it sounds like it's supposed to do what I'm hoping for.
docs addon seemed more complex, so I didn't try

my not-working PR: https://github.com/henrybuilt/react-sticky-table/pull/99


Allow to start FLP directly from the flow logs producer

Description

New "InProcess" ingest stage
New entry point to start the whole FLP in-process: pipeline.StartFLPInProcess
Add some tests
Also moved the code to start prometheus into a new function/package to avoid repetitions

The idea behind is to reduce some of the overhead when the agent producing flows, and the FLP workload are running on the same host: in that case, the network connection between them could be avoided, saving resources.

Dependencies

n/a
Checklist
If you are not familiar with our processes or don't know what to answer in the list below, let us know in a comment: the maintainers will take care of that.

[ ] Will this change affect NetObserv / Network Observability operator? If not, you can ignore the rest of this checklist.
[ ] Is this PR backed with a JIRA ticket? If so, make sure it is written as a title prefix (in general, PRs affecting the NetObserv/Network Observability product should be backed with a JIRA ticket - especially if they bring user facing changes).
[ ] Does this PR require product documentation?

[ ] If so, make sure the JIRA epic is labelled with "documentation" and provides a description relevant for doc writers, such as use cases or scenarios. Any required step to activate or configure the feature should be documented there, such as new CRD knobs.

[ ] Does this PR require a product release notes entry?

[ ] If so, fill in "Release Note Text" in the JIRA.

[ ] Is there anything else the QE team should know before testing? E.g: configuration changes, environment setup, etc.

[ ] If so, make sure it is described in the JIRA ticket.

QE requirements (check 1 from the list):

[ ] Standard QE validation, with pre-merge tests unless stated otherwise.
[ ] Regression tests only (e.g. refactoring with no user-facing change).
[x] No QE (e.g. trivial change with high reviewer's confidence, or per agreement with the QE team).

/approve


something about examples

Examples available here: http://clauderic.github.io/react-sortable-hoc/
like basic usage, there has the code of this example.
Support all of the examples with it's code ?

For some of the examples there is a <> icon in the top right, linking to the example code.
I was expecting the rest to be in gh-pages branch, but it doesn't expose more examples.


Support arbitrary event message types for synthetic event generation.

This allows overriding the event message used by the EDP simulator when using the synthetic generator event source. This is done by specifying the event_message_type_url field in SyntheticPopulationSpec and the --event-message-descriptor-set command-line option for the EDP simulator.

This change is

CC @kungfucraig @uakyol


varlens-allele-support doesn't acceptable positional BAM argument

I currently have to use the named parameter --reads since varlens-allele-support doesn't interpret its first argument as a BAM.

Agree it's confusing. varlens-reads takes bams as positional arguments and variants as --variants whereas varlens-variants takes VCFs positionally (and reads with --reads), i.e. the convention is the primary kind of input to each tool is positional and the others are named options. However, it's kind of a tossup whether variants or reads are the "primary" input the varlens-allele-support, since typically it would be called with both, so I went with just having them both be named arguments.
Given that logic, think it would be clearer if allele support took the reads as positional? It's true that the reads are always required whereas the variants are optional (you could specify --locus instead of giving a VCF)

I would err on the side of consistency, even if it's a little awkward for one of the commands. Alternatively, I'd be happy with just always specifying --reads; the current mixed state is most confusing.


Add UTF-8 meta-tag to academix

Is your feature request related to a problem?
Symbols are not working properly. Such as copyright symbol in footer is showing with some other character.
Describe the solution you'd like
Add UTF-8 meta tag to index.html
Screenshots

The issue is still there


Making checkbox accessible via keyboard

before: https://main--helix-website--adobe.hlx.live/tools/bot/register
after: https://checkbox--helix-website--vdua.hlx.page/tools/bot/register

Fixes #187
Description
The checkbox was hidden from the view causing it not be accessible by keyboard as well as it cannot participate in showing validations.
Made it visible and styled as per the requirement.
Related Issue
#187
Motivation and Context
How Has This Been Tested?
Tested manually on Chrome/Safari/Firefox
Screenshots (if appropriate):

Types of changes

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[x] I have signed the Adobe Open Source CLA.
[x] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[x] I have read the CONTRIBUTING document.
[ ] I have added tests to cover my changes.
[x] All new and existing tests passed.

URL for testing:

https://checkbox--helix-website--vdua.hlx.page/

The linter is complaining about -webkit-appearance but it is required as appearance property is not getting honored in safari. Please see the screenshots.

Please install the Helix bot on your fork and adjust the preview URL, I'm getting a 404 for your preview right now.

@trieloff I have added the bot. The main branch is available but the checkbox branch is giving 404
https://main--helix-website--vdua.hlx.page/tools/bot/register
https://checkbox--helix-website--vdua.hlx.page/tools/bot/register

Updated the codebus of the checkbox branch. It should work now.

I can't get the keyboard to navigate to the checkbox in your new version.


Creating a database entry should return an instance of the entity

Scenario:
You want to return an entity and if it doesn't exist, it should be created.
This means you have to look it up (search()). If it's null, you call create(). The return of the create()-Call is an instance of EntityWrittenContainerEvent and I didn't find a way to get an actual entity of this newly created entry.
This means, after I created it, I have to look it up (search()) again.
This results in 3 database actions.
Another way would be calling upsert() at the beginning and after it, I look it up (search()). But this would mean, that I have always 2 database actions.
Therefore the return of a create() should offer me the actual entity of the freshly created entry.
To avoid breaking changes, this could be done with an additional property for EntityWrittenContainerEvent, which can be accessed with getEntity().

I don't think, this will be implemented because right now, you have 1 db request for your creation and one for the search of the new entity. If the event returns an entity this is a hidden request for every creation regardless if the result is used or not.

Why do you need it, when it does not exist? I assume you want to refer to it in a relation. When you want to refer you can use the primary key. You can make up your own primary key with Uuid::randomHex() and use it in the relation directly without the need of loading the entry again.
Do you have a different use-case? I can think of so many different expectations on that behaviour right now :)

Why do you need it, when it does not exist?

After I created it, it does exist.
From other ORMs it's usual that creating an entry will return the created entity.

please be aware that our data abstraction layer (DAL) should not be considered as full featured ORM.
In ORMs it is easy to return the entity while creating it, because usually you use the entity object for this.
Our DAL only creates objects while reading from the database. there is no way from the entity to database direction.

Alright. Then I will close this.

Why do you need it, when it does not exist?

Was meant as an introduction to my assumption: why you need that entity. Probably for linking it to sth else
Just to clarify some confusion 😓


Issue/119: Add docstrings

Thanks for the update. Now we wait for those test to pass and then merge it.

I guess, I will have to review it before merging because you made the PR


Update Redocly config validation

Redocly CLI should validate the universal Redocly config correctly. We have to update the type tree to be in sync with JSONSchema we use to validate the config in Portal.

Would this include changing the configuration to expect theme config like:
features:
  openapi:
    theme:

Currently this tool expects theme.openapi.theme rather than features.openapi.theme. Similarly, the command line options are in the format --theme.options.theme.*... - Looking at the other configuration docs, I think that should be --features.openapi.theme.*....
My question is whether we'd cover that change in this issue, or if I should open another to follow up on that.
Related issues: #1065 #1073 #982

@lornajane Yes, this about supporting things that aren't directly related to Redocly CLI. In the end we should see correct warnings about wrong fields in CLI/VSCode.

Does this mean that I can do redocly lint redocly.yaml, or does the tool always validate the config when it's linting something else? I am not exactly sure how to use the feature.

@lornajane sorry, I somehow missed your question.  It means that whenever you use a redocly command (i.e. redocly lint openapi.yaml) we validate your config (if we can find one) and warn if something is wrong in the config.


[Enhancement] Add diff feature for the assert errors.

Enhancement
For example, I want to obtain diff information from the error message in the following code.
import yaml
import testing

test_merge = lambda {
    original = {
        "metadata": {
            "name": "my-deployment",
            "labels": {
                "app": "my-app",
            },
        },
        "spec": {
            "replicas": 3,
            "template": {
                "spec": {
                    "containers": [
                        {
                            "name": "my-container-1",
                            "image": "my-image-1",
                        },
                        {
                            "name": "my-container-2",
                            "image": "my-image-2",
                        },
                    ],
                },
            },
        },
    }

    patch = {
        "metadata": {
            "labels": {
                "version": "v1",
            },
        },
        "spec": {
            "replicas": 4,
            "template": {
                "spec": {
                    "containers": [
                        {
                            "name": "my-container-1",
                            "image" = "my-new-image-1",
                        },
                        {
                            "name": "my-container-3",
                            "image" = "my-image-3",
                        },
                    ],
                },
            },
        },
    }
    expected = yaml.decode("""\
metadata:
  name: my-deployment
  labels:
    app: my-app
    version: v1
  spec:
    replicas: 4
    template:
      spec:
        containers:
        - name: my-container-1
          image: my-new-image-1
        - name: my-container-2
          image: my-image-2
        - name: my-container-3
          image: my-image-3
""")

    got = merge(original, patch)
    diff = testing.diff(got, expected)
    assert str(got) == str(expected), "expected ${expected}, got ${got}, the diff is ${diff}"
}

Hey @Peefy, I would like to work on this.
Share some more details that helps, if you can.

Hey @Peefy, I would like to work on this. Share some more details that helps, if you can.

Hi @professorabhay. Thank you for contributing to the KCL community. The expectation is to provide a diff library written by KCL to display the differences between KCL configurations at the module repo: https://github.com/kcl-lang/modules

Hello @professorabhay If you have any difficulties, please feel free to communicate at any time. According to that the issue has been open for over two weeks.

Hey @Peefy, I have my exams ongoing but will try to resolve it and raise a PR by the end of Thursday.
Sorry for the inconvenience.


NzProgressComponent - Add an input for displayed text (separate percent input from label input)

What problem does this feature solve?
Using "dashboard" progress, I would need to display a computed percentage from a temperature and the original input as label.
The problem: I have a very low temperature and want to display it using the dashboard progress, but the value is so low the progress is always almost empty. To fix that issue, I calculate a percentage from that temperature using a simple algorithm and the progress displays perfectly. However, the displayed text below is the computed percentage but it should be the temperature.
As a dashboard component, we should be able to display any data in all units. But it only allows to display a percentage.
What does the proposed API look like?
You could achieve this by adding a "label" input in the component. Actually, the best would be to change nzFormat type from a lambda to a string. It adds control over the label in the calling component. It would break things for actual users, but they would just need to change the nzFormat input in the template and add the parameter.
An additional input wouldn't break things for actual users, it would complexify the component's API BUT I think it would simplify the component's logic.
Additional input usage:
    <nz-progress [nzPercent]="getTemperaturePercent(state.temperature)"
        [nzFormat]="tempFormat"
        [label]="state.temperature  | number:'0.0-2'"
        nzType="dashboard"
        nzWidth="65">

NzFormat change usage
    <nz-progress [nzPercent]="getTemperaturePercent(state.temperature)"
        [nzFormat]="tempFormat(state.temperature)"
        nzType="dashboard"
        nzWidth="65">

@Simon-Bru Have you tried [nzFormat]? Is this what you need? https://stackblitz.com/edit/angular-thdovz?file=src%2Fapp%2Fapp.component.ts

I don't know what you mean. Are you trying to do this? https://stackblitz.com/edit/angular-thdovz?file=src%2Fapp%2Fapp.component.ts
Certainly we won't introduce breaking changes in 1.* versions.

Yeah kind of, but it didn't work in my case for 2 reasons:
First: It doesn't work on the "dashboard" progress element
Secondly, I understand the use case of that input, but I think it should adapt the jauge so it is filled when that successPercent is reached.
I think this can be used but it doesn't fit my requirements. Here's my exact use case: I have a temperature between -10 and 10 and I have a range of 0 to 5 so I calculate a percentage out of the temperature according to the minimum and maximum of my range. That percentage makes the progress fills perfectly as I want but the wrong temperature is displayed then. I would just like to change that displayed text so I can represent my measures with the scale I wish.
Moreover, I think the nzFormat input isn't that convenient and could easily be replaced so it is executed in the caller's component at least. (eg: as a string and not a lambda). I understand about breaking changes, so I would suggest a new input as in my first solution.
Thank you for reading me. Let me know if it makes sense or not
Simon

Reopen for more discussions from others.

@Simon-Bru Thanks for your detailed explanation. I have just updated the demo. As I can tell, if you can calculate the percentage according to the temperature, of course you can do it backwards. Is this your case? If not, a reproduce link would be preferred.

Hi again !
Thank you very much your solution actually works for me, I tried to use a similar approach with nzFormat but i actually passed a component's function and not a lambda..... I just noticed it works with the syntax
formatter = (val) => '${this.temprature} *C'
But not with this one:
formatter(val) { return '${this.temprature} *C'}
I'm sorry I should have tried harder I guess..
Anyway thanks a lot for the help !!

@Simon-Bru Yeah, this binding works differently in arrow functions.

It was a good opportunity to learn about the difference between closure and non closure functions ;)


Prepare changelog for 0.3.3

Summary
Prepare for 0.3.3.
Metadata

Question
Answer

Did you use a meaningful pull request title?
yes

Did you apply meaningful labels to the pull request?
yes

Did you perform a self review first?
yes

Documentation reflects changes?
no

CHANGELOG reflects changes?
yes

Unit/Functional tests reflect changes?
n/a

Did you perform browser testing?
no

Risk level
Low

Relevant links
RIG-6

Looks good!
/approved


load MOM from PiwikTracker class's bundle

Prevents exceptions when integrated as a framework (e.g. using CocoaPods with use_frameworks!).

Great, nice catch.


Java: Make Kernel and KernelFunction API fluent

Fluent style API is much more Java idiomatic for the SK for Java, change this API to suite the users expectations.

Fixed by #4908


Use composer 2.x

Ubuntu 20.04 will offer composer 1.10.x only.
If developers would like to use 2.x, should they have it preinstalled and be able to do self-update easy, or should they be in charge of installing it, in home bin folder (which ubuntu makes it prio versus /bin, /usr/bin or /usr/local/bin)?
Personally I tend to use strictly LTS software, as I don't want to dedicate time each few weeks on updates that might break my setup, my applications etc. Using LTS has helped me to give major upgrades a few weeks only when happen.
I'll keep this topic opened, until enough feedback would come, or composer 2.x is in Ubuntu.

I took the decision to add composer from the official website and keep it updated on latest version. After using it for a short amount of time, I was impressed with it's speed and did not caused any issue with Laravel projects.

I took the decision to add composer from the official website and keep it updated on latest version. After using it for a short amount of time, I was impressed with it's speed and did not caused any issue with Laravel projects.


Remove colon from directory name

This makes it possible to clone this repository to partitions with filesystems that don't support : in filenames (e.g. NTFS).

Patch doesn't update the Xcodeproject.

Oops, sorry. Should be OK now.

@nathanhosselton please merge


Circles rotating when they shouldn't

Circles are rotating when coliding with concave polygons. This shouldn't happen because there is no reason for circles to rotate because no friction is applied yet.

It was caused by a wrong collision Point calculation.


panic/crash in windows7, 64 bit.

What is the problem you are having with rclone?
panic while trying to copy 3 gb drive contents.  Issue continues to happen after a retries.
What is your rclone version (eg output from rclone -V)
v1.42 (reproduceable in 1.39)
Which OS you are using and how many bits (eg Windows 7, 64 bit)
win7, 64 bit
Which cloud storage system are you using? (eg Google Drive)
google drive
The command you were trying to run (eg rclone copy /tmp remote:tmp)
"./rclone.exe" "--config" "rclone.conf" "-vv" "--transfers=16" "--checkers=32" "copy" "--drive-upload-cutoff=32M" "--drive-chunk-size=32M" "g:\" "google_drive_encrypted:/j1/2018/mybook/" "--log-file=mybook.txt"
(i tried sizes of 64M, 128M and same issues)
A log from the command with the -vv flag (eg output from rclone -vv copy /tmp remote:tmp)
panic: runtime error: slice bounds out of range

goroutine 1769 [running]:
github.com/ncw/rclone/lib/readers.(*RepeatableReader).Read(0xc04343e8d0, 0xc04bdd3000, 0x1000, 0x1000, 0xc0420f7a60, 0xc0420f7a50, 0xc046363
aa0)
        C:/gopath/src/github.com/ncw/rclone/lib/readers/repeatable.go:56 +0x267
net/http.transferBodyReader.Read(0xc0421f00a0, 0xc04bdd3000, 0x1000, 0x1000, 0xd86, 0x0, 0xc04207c888)
        C:/go/src/net/http/transfer.go:60 +0x5d
io.(*LimitedReader).Read(0xc0422b2200, 0xc04bdd3000, 0x1000, 0x1000, 0xd86, 0x0, 0x0)
        C:/go/src/io/io.go:446 +0x6a
bufio.(*Writer).ReadFrom(0xc04207c880, 0x1187ae0, 0xc0422b2200, 0x4db00c0, 0xc04207c880, 0x1)
        C:/go/src/bufio/bufio.go:703 +0xd4
io.copyBuffer(0x1186a80, 0xc04207c880, 0x1187ae0, 0xc0422b2200, 0x0, 0x0, 0x0, 0xf5f8c0, 0xc0421a0c01, 0xc0422b2200)
        C:/go/src/io/io.go:386 +0x321
io.Copy(0x1186a80, 0xc04207c880, 0x1187ae0, 0xc0422b2200, 0xc04bdd3268, 0x1073084, 0x2)
        C:/go/src/io/io.go:362 +0x61
net/http.(*transferWriter).WriteBody(0xc0421f00a0, 0x1186a80, 0xc04207c880, 0x2, 0x2)
        C:/go/src/net/http/transfer.go:337 +0x601
net/http.(*Request).write(0xc046330700, 0x1186a80, 0xc04207c880, 0x0, 0xc04343ed50, 0x0, 0x0, 0x0)
        C:/go/src/net/http/request.go:622 +0x6b9
net/http.(*persistConn).writeLoop(0xc0421b2fc0)
        C:/go/src/net/http/transport.go:1825 +0x1f1
created by net/http.(*Transport).dialConn
        C:/go/src/net/http/transport.go:1238 +0x986

Hmm, I think that looks like http transport reading from a finished with handle somehow.
You say it only happens on retries?  So I guess that means that Seek has been called on the repeatable buffer.
Maybe it is Seek racing with Read somehow.
There is no locking on Seek and Read.
Can you see if you can reproduce with the latest beta please?  I suspect it will reproduce but it is possible fixes to the go1.11 runtime have fixed this too.

sorry, I meant to say, a retry of the full copy eventually fails as well.  normally around 9gigs gets transferred, then I can try again to see if more files get transferred and so on.
I'll try latest beta tonight and see.

@ljr9600 did you mean to close this?  How did the testing with the beta go?

Sorry, i didn't mean to close it.  But the beta does seem to be better,  and no more panics.

OK, I'll leave this closed then, but let me know if it happens again with the beta - thanks.

Looks like I just encountered the same problem. On a subsequent execution of the same command line on the same data everything went fine so this is probably not something I'll be able to reproduce.
Note that the local storage system on my end is known to be flaky. This might simply be a case of missing error handling.
What is your rclone version:
1.44
Which OS you are using and how many bits:
CentOS 7.5 64bit
The command you were trying to run:
rclone copy -v --transfers=25 /local/path remote:
panic: runtime error: slice bounds out of range

goroutine 1337 [running]:
github.com/ncw/rclone/lib/readers.(*RepeatableReader).Read(0xc0002c0810, 0xc027062000, 0x1000, 0x1000, 0x0, 0xc02700a1e0, 0xc02700a1d0)
        /home/travis/gopath/src/github.com/ncw/rclone/lib/readers/repeatable.go:56 +0x255
net/http.transferBodyReader.Read(0xc02706bcc0, 0xc027062000, 0x1000, 0x1000, 0x1000, 0x0, 0x0)
        /home/travis/.gimme/versions/go1.11.1.linux.amd64/src/net/http/transfer.go:62 +0x56
io.(*LimitedReader).Read(0xc000718440, 0xc027062000, 0x1000, 0x1000, 0x1000, 0x0, 0x0)
        /home/travis/.gimme/versions/go1.11.1.linux.amd64/src/io/io.go:448 +0x63
bufio.(*Writer).ReadFrom(0xc000a04d00, 0x1327ac0, 0xc000718440, 0x7fc0d8bfb0a8, 0xc000a04d00, 0xc0000dfc01)
        /home/travis/.gimme/versions/go1.11.1.linux.amd64/src/bufio/bufio.go:707 +0xe4
io.copyBuffer(0x1326180, 0xc000a04d00, 0x1327ac0, 0xc000718440, 0x0, 0x0, 0x0, 0x106a5a0, 0xc02700a101, 0xc000718440)
        /home/travis/.gimme/versions/go1.11.1.linux.amd64/src/io/io.go:388 +0x303
io.Copy(0x1326180, 0xc000a04d00, 0x1327ac0, 0xc000718440, 0x270, 0x0, 0x0)
        /home/travis/.gimme/versions/go1.11.1.linux.amd64/src/io/io.go:364 +0x5a
net/http.(*transferWriter).writeBody(0xc02706bcc0, 0x1326180, 0xc000a04d00, 0x2, 0x2)
        /home/travis/.gimme/versions/go1.11.1.linux.amd64/src/net/http/transfer.go:362 +0x5b8
net/http.(*Request).write(0xc01a859800, 0x1326180, 0xc000a04d00, 0x0, 0xc0210563c0, 0x0, 0x0, 0x0)
        /home/travis/.gimme/versions/go1.11.1.linux.amd64/src/net/http/request.go:645 +0x6e8
net/http.(*persistConn).writeLoop(0xc026fea000)
        /home/travis/.gimme/versions/go1.11.1.linux.amd64/src/net/http/transport.go:1888 +0x1b8
created by net/http.(*Transport).dialConn
        /home/travis/.gimme/versions/go1.11.1.linux.amd64/src/net/http/transport.go:1339 +0x966

Hmm, I'll re-open this.
It looks very much like Read() and Seek() are being called concurrently so what I'll do is add a mutex which should fix the issue.

I merged the fix to master - it will be in the latest beta in 15-30 mins and in v1.45.
Please let me know if it happens again!

I've updated to v1.44-080-g16f797a7 and will let you know if it happens again.

I've updated to v1.44-080-g16f797a7 and will let you know if it happens again.

Thanks :-)


ERROR: type cannot be constructed

Some new updates today broke Winston.  As I have found, the errors relate to Int(b) and Char(digits[1]) in winston.jl.  Changing them to lower case solved the problem.  Do they need to be in cap case in 0.4?
| | || | | | (| |  |  Version 0.3.8 (2015-04-30 23:40 UTC)
/ |_'|||_'_|  |  Official http://julialang.org release
|__/                   |  x86_64-linux-gnu

Fixed with "@compat" in the master branch


RxJava latest version not used.

Hello ,
This library does not contain RxJava latest version so is it good to used in project ? Because there are several RxJava methods changed that's why i am asking to use this library in project or not?

Hi, there is rx2 version is available, currently in beta: https://github.com/konmik/nucleus/issues/111


Incompatible with oauth2client 2.0?

I'm trying out this library for the first time and ran into an error using the build() function.
In [1]: from googleapiclient.discovery import build

In [2]: service = build('youtube', 'v3')

Traceback (most recent call last):
  File "/usr/local/lib/python3.5/site-packages/googleapiclient/discovery_cache/__init__.py", line 38, in autodetect
    from . import file_cache
  File "/usr/local/lib/python3.5/site-packages/googleapiclient/discovery_cache/file_cache.py", line 32, in <module>
    from oauth2client.locked_file import LockedFile
ImportError: No module named 'oauth2client.locked_file'

It looks like oauth2client released v2.0.0 a few days ago and moved a bunch of stuff into a contrib module. At first glance it looks like a quick fix to be compatible with oauth2client v2.0.0. I'm willing to create a pull request if it helps.

Yes, a pull request would be very welcome!

Done did it already.

Think I fixed all the sample code; made pull request.

This was fixed in #182.


test: add a test to demonstrate an issue with soft deletes in GraphQL

Contributor checklist
No fix but a test that once fixed should hopefully compile and test the functionality.
Might want to be able to check that is is indeed still left in the database too?

[x] Bug fixes include regression tests
[ ] Features include unit/acceptance tests

Beautiful
🚀 Thank you for your contribution! 🚀


GEODE-8112: Add --member option in query command.

Update to the gfsh query command documentation has been pushed. Should we also add something about intended usage in the Developing -> Querying section of the User Guide? For example, “Querying a Partitioned Region on a Single Node”, https://geode.apache.org/docs/guide/112/developing/query_additional/query_on_a_single_node.html#concept_30B18A6507534993BD55C2C9E0544A97


Logical replication

Fixes https://github.com/citusdata/citus_docs/issues/1085

@rajeshkt78 thanks for the review!


Truncate table not working

What happened?
String q = String.format("truncate table %s.%s",  getDatasetId(),  getTableId());
runQuery(bigQuery, q)
Error
failed to truncate DELETE FROM `test-dataset.records`: no such table: test-dataset.records

What did you expect to happen?
table should be truncated
How can we reproduce it (as minimally and precisely as possible)?
create a table and try to truncate it
Anything else we need to know?
No response

String q = String.format("delete from `test-dataset.records` where true",  getDatasetId(),  getTableId());
runQuery(bigQuery, q)

this works as expected


feat: add arrow

hi~,I have unified the code style, please check if this PR can be merged into master

@zakjan Could this PR be merged?I still have a PR that supports force graph calculation and I want to submit

Hi, I'm archiving this repository as read-only. Feel free to continue in your own fork.


can not insert a normal character  after the link

bug
insert a link first and can not insert a normal character  after the link

@chengzhenping - I cannot repro this. Please give more details for us to be able to help you here.

@niveditc Perhaps this is referring to a problem editing an entity.  I am seeing the same issue.
Steps to reproduce:

open the link example: examples/draft-0-10-0/link/link.html
Add the text "This is a link."
Select "link" in the text
Click Add Link and enter any URL
Select elsewhere in the text to deselect.
Move the cursor to the end of "link" (between k and .)
Enter any character.  Ex, s.

Expected: the entire word "links" will be part of the entity (the entityRanges will change)
Actual: the characters of the link entity remains as "link"

.

@skinandbones I think this is the expected behavior. It got changed in the latest release, from the changelog:

Fix issue where typing at the end of a link caused the link to continue. (Ian Jones in d16833b3)

See https://github.com/facebook/draft-js/issues/430#issuecomment-391657504 and the whole issue for more details.

Closing this issue since this is the expected behavior. We can discuss further on #430 if needed.


campaign status field TAKE 2

What's this PR do?

Disables the campaign status field on campaign nodes so editors can not use it.
Makes the campaign status field on campaign nodes translatable.
Adds a presave hook to campaign runs that will update campaign status when a user saves a campaign run node.
Creates a helper function that takes a start and end date and determines if a campaign is active or not
Slightly outside of the scope of this issue, but I was getting some preprocess errors on pages without subtitle and partners fields that I fixed up.
Creates a cron job that updates the campaign status field based on run dates.

Where should the reviewer start?
The main business is in these here files, there rest is feature export stuff.
dosomething_campaign_run.module
dosomething_helpers.module
dosomething_campaign_run.cron.inc
How should this be manually tested?
Create or edit a campaign run, and run dates, hit save. Go to the campaign you tied the run to, the campaign status field should be disabled, but you should be able to see the current status of the campaign per translation.
Status would be active when the run has a start date and no end date
Status would be closed when the run end date is before now
The cron job is a bit trickier to test, it really only comes in handy when there is a campaign run dates set in the future or past. The cron job should update the status of the campaign node to closed or active based on the dates without a use having to manually save the campaign run again.
Any background context you want to provide?
Campaign runs...amirite?
What are the relevant tickets?
Fixes #5989

@angaither sorry I opened a new PR cause I got deep in a git hell hole on that other one.

@angaither This PR has been updated to use a new query in the cron job that uses the entity_translation table.
I also had to make a slight change to the update hook that @chloealee wrote. The date format for the generated nodes was causing issues in the presave hook (to update campaign status) that gets called when campaign runs get saved. The update hook erred out and no runs were generated.
I updated it to use the same date format drupal would store the date as if you filled out those fields through the CMS (using - instead of /). Apparently the DateTime class can't create dates from strings in the format y/m/d because if there is slashes it assumes it is in the American format `d/m/y'.

one comment, not needed for merge :+1:
but let's hold off on merging until the fix for #6016 is in

@angaither we can merge this now, si?

@angaither I made an update to this that only updates the status if the current run is being saved. see dbd09f9
Let me know when this is good to merge

:+1:


Remove EPUB from ReadTheDocs output formats

Pull Request Checklist:

[ ] This PR addresses an already opened issue (for bug fixes / features)

This PR fixes #xyz

[ ] Tests for the changes have been added (for bug fixes / features)

[ ] (If applicable) Documentation has been added / updated (for bug fixes / features)

[ ] HISTORY.rst has been updated (with summary of main changes)

[ ] Link to issue (:issue:number) and pull request (:pull:number) has been added

[ ] bumpversion patch has been called on this branch
[ ] The relevant author information has been added to .zenodo.json

What kind of change does this PR introduce?

Removed EPUB as an output from the ReadTheDocs version of the documentation
Added some LaTeX elements to help build the PDF version of documentation
Fixed a badly-written formula

Does this PR introduce a breaking change?
No.
Other information:

Coverage remained the same at 90.218% when pulling 3556c1e18183287455e8f46146be3532e2d7692a on remove_epub into b66482d704604de54a302529621913734375265e on master.


Silent switch keeps DDU open after uninstall

On <IP_ADDRESS> the silent switch worked as expected, uninstall whatever specified alongside -Silent and DDu closes itself after its done.
From <IP_ADDRESS> and newer, the uninstall process happens, but after its done the apps keeps open in the background, never closes itself.

Thanks for reporting I will look at this.

Fixed with 98b18d33f79637762a9702c949fdff57282a643e
Will be part of <IP_ADDRESS> that will be release soon.


chore(deps): upgrade dependencies

Upgrades project dependencies. See details in workflow run.

Automatically created by projen via the "upgrade-k8s-24-main" workflow

⚪ Backport skipped
The pull request was not backported as there were no branches to backport to. If this is a mistake, please apply the desired version labels or run the backport tool manually.
Manual backport
To create the backport manually run:
backport --pr 1420

Questions ?
Please refer to the Backport tool documentation


Java 11

The minimum recommended version of Java for Superfields should be Java 11, the current LTS.
This does not mean Java 8 branch will go out of favour right now. But at some point it will ;)

closed with #281


Fix for duplicated dns domain in host search line

See https://github.com/kubernetes-incubator/kubespray/issues/1718

Please see my comment in https://github.com/kubernetes-incubator/kubespray/issues/1718

Closing after discussion in #1718


PHP8 support

GD image is not a resource anymore, using instanceof \GdImage instead

Thanks for the contribution! I'm going to close this in favor of #74, only because that also includes test suite fixes that we'll want, but I do appreciate the help here!


Relative paths

I'm uncertain how to create a style using a relative path to a tm2source.
I have my style in /home/pnorman/foo/bar.tm2 and source in /home/pnorman/foo/bar.tm2source. /home/pnorman/foo is a git repository.
If I define my source as tmsource:///home/pnorman/mq-carto-style-vector/mq-carto-style.tm2source it works, but this is non portable.
I tried both ./mq-carto-style.tm2source and ../mq-carto-style.tm2source, but both were rejected by the UI.
What's the way to specify a relative location?
Cross-ref RFC 3986 4.2

This would be a really useful feature for us as well. It shouldn't be too hard to resolve something like tmsource://../../my-source.tm2source from the current script right? Or am I missing the complexity in this?

@springmeyer - Is this related to mapbox studio or is this more of a mapnik core feature?


Add basic docs to readme, close #39

This should fix it, certainly would have helped me first time I tried to get something working. FYI @dabreegster in case you don't get auto notifications on this.


Could not find a valid gem 'saxon-xslt' in any repository

Am I doing something wrong:
$ gem install saxon-xslt
ERROR:  Could not find a valid gem 'saxon-xslt' (>= 0) in any repository
ERROR:  Possible alternatives: saxondale

saxon-xslt is JRuby only - you'll get that error if you use MRI's gem and not JRuby's.

@fidothe any chance to port this library to Ruby?

It is a Ruby library already. To run with MRI would need a port of Saxon from Java to C, with a license that would allow building and using in an open source project, and that doesn't exist. (There is a C version, but it's compiled from Java using a proprietary toolchain which means it can't be distributed
So, unfortunately it's physically impossible at the moment.
The best you could manage would be a wrapper that shells out to Java in the background - and that's something you can easily do yourself, with no need for a gem.


Upstream DBE changes to omnisci master branch

WE need to have all our dbe changes in omnisci master

Looks like all the tasks in this epic have been completed. @Garra1980 should we close this issue?

Yes, closing


Can't make an optional reference

Currently you can't mix references and basic types, so [ReferencedModel, null] won't work the way you might expect. Not really sure how to accomplish this, but if it's necessary I'm sure I can find a way.

I don't think it's a good idea to have an optional reference in your schema.


Chore/update examples

Fixes the recently issued security vulnerability for tar and also updates some packages using npm audit

Codecov Report

Merging #834 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #834   +/-   ##
=======================================
  Coverage   94.47%   94.47%
=======================================
  Files          81       81
  Lines        3475     3475
  Branches      532      532
=======================================
  Hits         3283     3283
  Misses         66       66
  Partials      126      126

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0f9b593...14c2b6c. Read the comment docs.


Assignment-2

List Exercise problems Solved

You need to make some changes:

List Exercise: Cell 8 there is an error int(MLCC)
Cyclic means 1, 2, 3, 1, 2, 3.....

Do in the same notebook we provided which has questions in it. Simply write codes in the given cell and execute. That would be more convinient in checking.

Also Complete numpy examples and send a pull request

Clean your repository it should only include the three files(list, numpy examples, numpy exercises) of assignment 2

Clean your repository it should only include the three files(list, numpy examples, numpy exercises) + LICENCE and README.md of assignment 2 there are multiple copies of each which one is the final copy of your ans??

I have submitted assignment 3 in it's own repo and i think i have already
deleted the assignment 3 files from assignment 2 repo.
On Sun, Sep 30, 2018, 6:09 PM Sushil Maurya<EMAIL_ADDRESS>wrote:

Clean your repository it should only include the three files(list,
numpy examples, numpy exercises) + LICENCE and README.md of assignment 2
there are multiple copies of each which one is the final copy of your ans??
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/MLCCKolkata/Assignment-2/pull/6#issuecomment-425717992,
or mute the thread
https://github.com/notifications/unsubscribe-auth/Ak5DqHpJE8a2k_oI6q5FdLvuzQ7W1c49ks5ugLtqgaJpZM4W326w
.


[FLINK-26957][BP-1.15][runtime] Removes flush in FileSystemJobResultStore.createDirtyResultInternal

1.15 backport (excluding some minor hotfix commits) for parent PR #19304

I forgot to add the commit that renamed NonClosingOutputStreamDecorator which caused the ci failure -.-


allOf/oneOf component schemas are not rendered correctly.

When using version 0.8.291, this model is shown for an endpoint:

After I change for newer version, 0.9.355, the content in array is empty

The endpoint is Evento - Listar - GET /dte/{chave}/eventos
https://doc.dte-hml.infraestrutura.gov.br/api/v1/openapi_bundle.yaml

Hmm, it isn't showing as an array either. Thanks for the reference spec. It's worth noting we had to switch some internal libraries to better support 3.1. No idea what's going on yet, but we'll take a look.

It was a bit challenging to make sure I caught all of the problem without a minimal repro spec, but #86 should have resolved almost everything. If you are still seeing an issue, it would help provide a minimal spec with the problem so that we can better investigate.

resolved almost everything.
The only issue is a few properties without types and descriptions.
When I make a minimal spec with the problem I will open another issue.
Thanks.

Glad to hear it.


Add module help tests to Plaster and template(s)

Add module help tests to the plaster module, as well as the NewModuleTemplate.
The help tests themselves come from @juneb, with a couple of edits to fit. The tests are pretty awesome at covering all the standard help cases for modules and I thought they would be a good fit for what plaster is trying to achieve by enforcing good practice through the testing framework.
I know the plan is to remove the current module template, I used it for testing the slightly different test file structure to make sure it all worked as expected once the template was deployed. The test additions could easily be merged into the official template once we're happy with it.

Of course. I thought that might be the case from PR #139 but the work needed doing to check the tests were running in a deployed template before I created the PR. This can definitely wait until the other PR is merged.

And you'll need to reapply the changes to the files in src/Templates/NewModule/plasterManifest.xml as I made quite a few changes. You won't want to blast over that with the version in this PR.
Also, I like the idea of having Pester tests for documentation for Plaster.  But should we put those in the New Module template.  I'd probably feel better about that if perhaps the doc tests were turned off by default.  I would get a bit annoyed by failing Pester tests for a module I'm developing for my own personal use.  Which actually begs the question, do we need two templates e.g.: "New Module" and "New PowerShell Gallery Module"?  I would see having the doc tests enabled by default for the latter template.

Sure. I suppose we could either have two templates, or conditionally deploy these types of tests, so that you could come back later and re-run plaster to add them if you wanted to make the module more formal. That could potentially have it's own host of problems if a user changed the base test structure though, so the two templates is probably better..

That's great, @davegreen. If you have any problems with the tests or help, just ping me.

@davegreen BTW, sorry for the inconvenience man.

Absolutely no worries, I'd rather things get done right :)


Fluentd blocked by 'Too many open files' error, triggered by prolonged downstream failure

Describe the bug
The bug is that Fluentd appears to try and open all existing buffer files simultaneously before attempting to flush existing logs / accept new logs (create new buffer files).
This is a problem because, if the downstream component (that Fluentd is sending logs to) goes down for a sufficiently long time, then the number of local buffer files will keep increasing until it exceeds the max # of file descriptors (i.e. max # of files that Fluentd can have open simultaneously -- i.e. LimitNOFILE).
At this point, Fluentd throws a 'Too many open files' error
Eg.
Connection error Errno::EMFILE: Too many open files - getaddrinfo
Connection error Errno::EMFILE: Too many open files - socket(2)

When that occurs, it looks like this is what happens:

Even if the downstream component eventually recovers, Fluentd will never be able to flush its existing buffered logs!
This is because, before it can even get to the flushing stage, it keeps trying, and failing, to open every single buffer file at the same time.
Similarly, all new logs sent to Fluentd will be lost, even if Fluentd has enough disk space for new buffer files!
This is because, before it can even get to the 'create new buffer file' stage, it keeps trying, and failing, to open every single existing buffer file at the same time.

To Reproduce
I have a Fluentd agent that sends logs to Kafka. In case Kafka goes down, to prevent loss of logs, I've assigned it 500 GB of disk space for its buffer.
Recently, that downstream Kafka went down for a long time (~12 hours I think) -- however, despite having 500 GB to use, Fluentd stopped creating new buffer files after only using 168 GB. Furthermore, it didn't seem to be attempting to flush those local buffer files anymore.
In other words, even though Fluentd had enough buffer disk space, it did not seem to create any more buffer files. Furthermore, it apparently could not flush the existing buffered logs -- they were effectively trapped in Fluentd.
Based on the 'Too many open files' error messages, I eventually realized that this was because the number of existing local buffer files (~392,700) was far higher than Fluentd's LimitNOFILE value at the time (65,536).
Thankfully, my system's hard limit (ulimit -Hn) was even greater than the number of buffer files, so I was able to 'fix' the issue by manually raising Fluentd's LimitNOFILE value.
Other, less fortunate people have apparently had to just give up and throw away those buffered logs (see #1612) to make Fluentd usable again, which of course defeats the whole point of having a buffering mechanism in the first place -- the buffer, which is meant to provide resiliency and prevent log loss, is now actually acting as a liability and effectively causing log loss by blocking Fluentd.
Expected behavior
Fluentd should not naively assume that the number of local buffer files will always be < LimitNOFILE, and thus insist on opening every single buffer file at the same time.
Instead, for safety, it should open them in batches.
Eg. In my case, Fluentd should have opened the first 65,536 buffer files first, tried to process them, then closed them and opened the next 65,536 buffer files, etc. instead of trying to open all 392,700 buffer files in one shot.
Your Environment

td-agent version: 3.7.0
Operating system: Ubuntu 18.04.4 LTS
Kernel version: 4.15.0-88-generic

Bump

Bump

Bump

Hmm, though it vary on configuration, It may be useful if we can estimate the number of file descriptor at some extent with given parameters.

I think this is related to https://github.com/fluent/fluentd/issues/3610
Seeing the time when this was created gives me little hope to be fixed soon...


tservers hosting metadata could not complete shutdown

User reports that [the issue reported in #3368] has been observed again. They don't know if it is the same reason.
These are tservers that are exclusively handling accumulo.metadata tablets. They were stuck spamming the following messages:
SessionManager INFO : Closing idle session from user=!SYSTEM, client=<manager node>
Tablet DEBUG: Waiting to completeClose for ..., 0 writes 1 scans

This was seen with ACCUMULO 2.1.1-RC2 (which was released as 2.1.1)
Originally posted by @ivakegg in https://github.com/apache/accumulo/issues/3368#issuecomment-1601322659

While examining the code looking for causes I found one possible candidate cause for this.  It may not be the cause of this problem, but it needs to be fixed.  Scan sessions register a cleanup call if the session is not accessed in a certain amount of time.  This cleanup code calls session.cleanUp which returns a boolean, however that return value is not checked.  When it returns false the session was not cleaned up and clean up needs to be attempted again later.  Below is the line where the return value was not checked.
https://github.com/apache/accumulo/blob/260fde4370c06a4059fd62b5658124d61532d729/server/tserver/src/main/java/org/apache/accumulo/tserver/session/SessionManager.java#L285
I will work on a fix for this.

I may have been able to reproduce this. I was running the following in jshell because I suspected an issue with isolated scans.  I currently have a tablet stuck in close waiting to scan. I am investigating the stuck tablet.
        client.tableOperations().create("foo");

        try(var writer = client.createBatchWriter("foo")) {
            for(int i = 0; i < 1000000; i++) {
                Mutation m = new Mutation(String.format("%08d", i));
                m.put("","","");
                writer.addMutation(m);
            }
        }

        client.tableOperations().flush("foo",null,null,true);

        Runnable task = new Runnable() {
            @Override
            public void run() {
                while(true) {
                    try (var scanner = new IsolatedScanner(client.createScanner("foo"))) {
                        // TODO maybe do not close scanner?  The following limit was placed on the stream to
                        //  avoid reading all the data possibly leaving a scan session active on the tserver
                        System.out.println(new Date()+" "+scanner.stream().limit(500000).count());
                    } catch (Exception e) {
                        e.printStackTrace();
                        break;
                    }
                }
            }
        };

        ExecutorService service = Executors.newFixedThreadPool(10);
        for(int i =0; i< 10; i++){
          service.execute(task);
        };

        // do periodic splits to force tablet to close.. TODO eventually splitting tablet we are not scanning above
        for(int i = 0; i < 1000000; i+=1000) {
            String split = String.format("%08d", i);
            client.tableOperations().addSplits("foo", new TreeSet<>(List.of(new Text(split))));
            System.out.println(new Date()+" added split "+split);
            Thread.sleep(500);
        }

One way to fix this is to have single method like the following in SessionManager that is used for all session cleanup.
void cleanup(Collection<Session> sessions){
 for(var session : sessions){
    if(!session.cleanup()){
        // Queue session for defered clean up at later time.  This could be done by scheduling a
        // task to run later or adding it a collection that is periodically inspected by a scheduled
        // task.  The sweep() method in session manager method handles deferred cleanup for
        // itself it, this could be generalized for the entire class.  The sweep() method is already
        // called periodically.
   }
}

Looking at the implementations of Session.cleanup(), only SingleScanSession and SummarySession can return false. SummarySession just returns the return value of Future.cancel(true), which I think in most cases will end cancelling the future. The SingleScanSession case is more complicated as it calls Scanner.close which will return false if it doesn't obtain a lock within 10ms.

Should Scanner.close call isolatedDataSource.interrupt() before trying to obtain the scannerSemaphore ?

Should Scanner.close call isolatedDataSource.interrupt() before trying to obtain the scannerSemaphore ?

I think the interruptFlag that it does set to true is also passed to the scanner data source when its created, so should be that same.

@keith-turner @jmark99 - I turned your jshell test into an IT in https://github.com/dlmarion/accumulo/commit/cfb428d8a7bc351720685fd6353d140171fff5ba. I was able to reproduce the tablet server shutting down, but I think the cause may be different. What I'm seeing in the logs is that the Manager requests that the root and test table tablet be unloaded from the tablet server. The TabletGroupWatcher for the metadata table however never requests that the metadata table tablet be unloaded. The TabletGroupWatcher for the metadata table appears to be waiting at MetadataTableScanner.hasNext(), possibly due to the root tablet being unloaded?
Anyway, I'm not sure that what I'm seeing is related to this specific issue, but I wanted to provide the information just in case.

I was able to reproduce the tablet server shutting down, but I think the cause may be different. What I'm seeing in the logs is that the Manager requests that the root and test table tablet be unloaded from the tablet server.

That sounds like an additional bug possibly, I opened as #3569 as a fix for the problem of sessions not being cleaned up.  We should not close this issue for #3569 w/o figuring out the TGW problem or opening an issue for it.

With #3571, it looks like this can be closed. Is there something keeping this issue open?

I talked with @ivakegg , he said we are good to close this and they will open a new issue if needed.


Feature Request - Publish binaries

It would be great if we could publish the reactivecouchbase-rs-core library so that users did not have to clone / build / publish these locally.

It's already published
https://github.com/ReactiveCouchbase/reactivecouchbase-rs-core#if-you-want-to-try-it
just add
resolvers += "reactivecouchbase-rs-snapshots" at "https://raw.github.com/ReactiveCouchbase/reactivecouchbase-rs-core/master/repository/snapshots"

libraryDependencies += "org.reactivecouchbase" %% "reactivecouchbase-rs-core" % "1.0.0-SNAPSHOT"

to your sbt build

Hey @mathieuancelin - Sorry for the late reply here. That makes sense. Can we start tagging versions of this library when new code is added? Its particularly hard to use the SNAPSHOT here because the code changes very often. It would be great to have minor version updates with our commits, e.g. 0.0.1, 0.0.2, etc.

Awesome. Thanks!!


Docker improvements

Split from comments on #749
The Docker infrastructure should work out-of-the-box.
For this, we need (I think):

Docker-specific configuration overrides to default things like the database settings and the AMQP settings to the containers, but allowing overrides of other (any?) settings.
Automated configuration of the RabbitMQ instance to work with the domain targets (IMHO, this should be any routing key delivered to one queue, with a sensible TTL on messages in the queue so it doesn't grow indefinitely)

Mostly a note to myself: Might be cool to also pull in a simple mail sink service into the docker-compose infra so mail can be tested in a similar fashion to RabbitMQ


Enable temporary bare metal (BM) CI for X2 ethernet tests

post-commit push split across VM / BM:
BM CI:
just R + multi-chip tests
VM CI:
anything just L / pytests

fyi @jliangTT @abhullar-tt @aliuTT

Action items:

@tt-rkim add t3004 to constant CI, not just nightly
Install new SMI on 2x2 cloud machine and t3004
Dependent issues for enabling this over all CI:

https://github.com/tenstorrent/cloud/issues/2053
https://github.com/tenstorrent-metal/metal-internal-workflows/issues/94
https://github.com/tenstorrent-metal/metal-internal-workflows/issues/108

cc: @ttmchiou  @TT-billteng @jliangTT

meeting tomorrow to look at network isolation

+1 for this!! I see the meeting. This is gonna be great for both development and CI!

Unblocked models and FD people, moving to P1

@davorchap People can now add X2 tests depending on 800 MHz flash with ethernet resets into the nightly pipeline.
we will be slowly adding them into post-commit capacity once they are all converted by cloud to Q35.


How is the .on() function being added to the WaveSurfer object?

Trying to understand the code. I can't figure how the .on() is being added.

Nevermind it's in utils


Read files from helmchart in yaml file in dependency

I created a helm chart to read the content of json files into a ConfigMap. With everything in 1 chart, I have no issues.
This looks like this:
{{ range $path, $content :=  .Files.Glob  "**.json" }}
apiVersion: v1
kind: ConfigMap
metadata:
  labels:
    grafana_dashboard: "1"
data:
  {{$path}}: |-
{{ $.Files.Get $path |indent 4}}
---
{{- end }}

But I want to re-use the logic of creating the ConfigMap in more then 1 chart, so I moved the ConfigMap logic to a dedicated chart and added a dependecy in the original chart. The new chart is downloaded with a helm dependency build as a tgz file in the charts folder of the original chart.
But from this point, the .Files.Glob seems to work from the directory of the dependency chart instead of the parent chart. How can I get the json files from the parent chart and the logic from the dependency chart?
Output of helm version:
λ helm version
version.BuildInfo{Version:"v3.13.3", GitCommit:"c8b948945e52abba22ff885446a1486cb5fd3474", GitTreeState:"clean", GoVersion:"go1.20.11"}

Helm (I believe for security reasons, docs have details somewhere I believe) only allows reading files from within that chart's directory.
You could read the files in the parent chart, and pass the contents to the child chart's logic.


Add dependencies on jest-util and jest-config

Closes https://github.com/kulshekhar/ts-jest/issues/108.

Thanks @blakeembrey :)


Saving With RxJava and the Repository Pattern

Hi, I have been reading the other issues and they all seem to be related to data retrieval rather than saving data. Both UseCases in the project are for retrieval also.
My question is:
What should I return (if anything) upon saving an entity and should this be an Observable?
At the moment, following the whole separation of concerns and mapping entities at boundaries we get:
UserModel > User > UserEntity - (save in repo) - (return saved entity) - UserEntity > User > UserModel
Is this correct or is there a different pattern I should be following for insert and  update operations?

In my opinion, if it is just in order to save entities or stuff like that, I would suggest to return an Observable<Void>, then you wouldn't really need to remap it, unless you want to get a fresh copy.
Anyway, if the purpose is only for that, you could also use your own thread executor instead of subscribing to an Observer, therefore you can avoid to return nothing after all.

You can return some kind of object wrapped in an Observable that reflects the result of your operation, for instance you could continue composing your stream of data based on this operation.
Something like this:
Observables<OperationResult> doSomething(SomeObject);

Hi,
How to use the UseCase to create a new entry ? In all UseCase sample, we get the data, so we use execute and pass extra data from constructor. If we create a screen to create a new user, we need to add a new method in UseCase like execute(Data, Subscriber), right ? Or we create a new layer from presenter when user click on create button, we use a factory who create UseCase and in this case we can provide data from constructor ?


Error: Cannot find module '***/protractor/bin/webdriver-manager'

Error while running 'bower install & npm install'  to install the required dependencies. Error log below.

111332 verbose cwd /home/ubuntu/workspace/app
111333 error Linux 4.2.0-c9
111334 error argv "/home/ubuntu/.nvm/versions/node/v6.0.0/bin/node" "/home/ubuntu/.nvm/versions/node/v6.0.0/bin/npm" "install"
111335 error node v6.0.0
111336 error npm  v3.10.2
111337 error code ELIFECYCLE
111338 error<EMAIL_ADDRESS>postinstall: node ./node_modules/gulp-protractor/node_modules/protractor/bin/webdriver-manager update
111338 error Exit status 1
111339 error Failed at the<EMAIL_ADDRESS>postinstall script 'node ./node_modules/gulp-protractor/node_modules/protractor/bin/webdriver-manager update'.
111339 error Make sure you have the latest version of node.js and npm installed.
111339 error If you do, this is most likely a problem with the app package,
111339 error not with npm itself.
111339 error Tell the author that this fails on your system:
111339 error     node ./node_modules/gulp-protractor/node_modules/protractor/bin/webdriver-manager update
111339 error You can get information on how to open an issue for this project with:
111339 error     npm bugs app
111339 error Or if that isn't available, you can get their info via:
111339 error     npm owner ls app
111339 error There is likely additional logging output above.
111340 verbose exit [ 1, true ]

Change gulp-protractor/node_modules/protractor/ in package.json to protractor/.
You'd best wait for next release...

Thanks , it worked.


Make the repo commitizen-friendly

Add https://github.com/commitizen/cz-cli to repo's dependencies.
Add config for commitizen to use https://www.npmjs.com/package/cz-conventional-changelog
This will provide the git cz command which makes creating conventional-changelog commits easy
This also needs we will need to adjust our contributing instructions for the community

Closing this as I think we decided to use the github's releases for the changelog.


⚠ Bofrost.at has degraded performance

In 6856022, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 3050 ms

Resolved: Bofrost.at performance has improved in 4430bc2.


(JS-0417) Avoid .bind() or local functions in JSX properties

Description
Avoid using .bind() or passing a callback local to the render function of a react component. This is bad for performance.
Occurrences
There are 3 occurrences of this issue in the repository.
See all occurrences on DeepSource → deepsource.io/gh/w3bdesign/dfweb-v3/issue/JS-0417/occurrences/

https://dmitripavlutin.com/dont-overuse-react-usecallback/


Comparison with other Actor frameworks

Description
Add comparison of backstage with other Actor frameworks in the ecosystem to the readme. I think it's very interesting to read about where it differs, what are its advantages over the others, and where might have disadvantages (if there are any).
Motivation
This will help people deciding on an Actor framework implementation.
Are you planning to do it yourself in a pull request?
No.

This is an interesting one, will start with actix!


Babbage: Reference scripts

resolves https://github.com/input-output-hk/cardano-ledger/issues/2465

https://github.com/input-output-hk/cardano-ledger/runs/5059981296?check_suite_focus=true#step:20:2261 this failure seems unrelated

I'm not sure what is going on with ormolu, I'll try to restart the github action


Failed to process, please exclude the tableName or statementId.

version: 3.4.1
SQL:

SELECT
ticket.EINVOICECODE as ticketCode,
ticket.EINVOICENUMBER as ticketNumber,
ticket.SERIANUMBER as bizCode,
ticket.MAINTYPE as mainType,
ticket.PATIENTNUMBER visitNumber,
ticket.STATUS as ticketStatus,
ticket.KPDATE as kpDate,
CASE WHEN ticket.REDCODE is Null THEN 0 ELSE 1 END AS isRed,
ticket.REDCODE as redCode,
ticket.REDNUMBER as redNumber,
CASE WHEN ticket.MAINTYPE = 1 then
(select CONCAT(@pName:=mz.PAYERPARTYNAME, @pIdCard:=mz.PAYERPARTYCODE, @pMoney:=mz.TOTALAMOUNT)
from cz_fet_main_mz mz where mz.ORGID = ticket.ORGCODE and mz.EINVOICECODE = ticket.EINVOICECODE
and mz.EINVOICENUMBER = ticket.EINVOICENUMBER limit 1)
ELSE
(select CONCAT(@pName:=zy.PAYERPARTYNAME, @pIdCard:=zy.PAYERPARTYCODE, @pMoney:=zy.TOTALAMOUNT)
from cz_fet_main_zy zy where zy.ORGID = ticket.ORGCODE and zy.EINVOICECODE = ticket.EINVOICECODE
and zy.EINVOICENUMBER = ticket.EINVOICENUMBER limit 1)
END AS temp4,
@pName as patientName ,
@pIdCard as idCard ,
@pMoney as invoiceAmount,
ticket.ORGCODE
FROM cz_fet_pjkj ticket
where 1
and date_format(ticket.KPDATE,'%Y-%m-%d') >='2010-09-10'
and date_format(ticket.KPDATE,'%Y-%m-%d') <= '2020-09-30'
and ticket.MAINTYPE = 1
and ticket.STATUS = 1
and ticket.EINVOICECODE = '41060120'
and ticket.ORGCODE = '416046926'

@Mapper
public interface TestMapper {
List<HashMap<String, Object>> testFun1();
}
@Bean
CommandLineRunner runner(TestMapper mapper) {
    return args -> {
        System.out.println(mapper.testFun1());
    };
}

Caused by: org.mybatis.spring.MyBatisSystemException: nested exception is org.apache.ibatis.exceptions.PersistenceException:
Error querying database.  Cause: com.baomidou.mybatisplus.core.exceptions.MybatisPlusException: Failed to process, please exclude the tableName or statementId.
Error SQL: SELECT
ticket.EINVOICECODE as ticketCode,
ticket.EINVOICENUMBER as ticketNumber,
ticket.SERIANUMBER as bizCode,
ticket.MAINTYPE as mainType,
ticket.PATIENTNUMBER visitNumber,
ticket.STATUS as ticketStatus,
ticket.KPDATE as kpDate,
CASE WHEN ticket.REDCODE is Null THEN 0 ELSE 1 END AS isRed,
ticket.REDCODE as redCode,
ticket.REDNUMBER as redNumber,
CASE WHEN ticket.MAINTYPE = 1 then
(select CONCAT(@pName:=mz.PAYERPARTYNAME, @pIdCard:=mz.PAYERPARTYCODE, @pMoney:=mz.TOTALAMOUNT)
from cz_fet_main_mz mz where mz.ORGID = ticket.ORGCODE and mz.EINVOICECODE = ticket.EINVOICECODE
and mz.EINVOICENUMBER = ticket.EINVOICENUMBER limit 1)
ELSE
(select CONCAT(@pName:=zy.PAYERPARTYNAME, @pIdCard:=zy.PAYERPARTYCODE, @pMoney:=zy.TOTALAMOUNT)
from cz_fet_main_zy zy where zy.ORGID = ticket.ORGCODE and zy.EINVOICECODE = ticket.EINVOICECODE
and zy.EINVOICENUMBER = ticket.EINVOICENUMBER limit 1)
END AS temp4,
@pName as patientName ,
@pIdCard as idCard ,
@pMoney as invoiceAmount,
ticket.ORGCODE
FROM cz_fet_pjkj ticket
where 1
and date_format(ticket.KPDATE,'%Y-%m-%d') >='2010-09-10'
and date_format(ticket.KPDATE,'%Y-%m-%d') <= '2020-09-30'
and ticket.MAINTYPE = 1
and ticket.STATUS = 1
and ticket.EINVOICECODE = '41060120'
and ticket.ORGCODE = '416046926'
The error may exist in file [E:\code\ticket\unify-spring-boot-platform\unify-platform-biz\target\classes\mapper\TestMapper.xml]
The error may involve com.xyhsoft.spring.boot.platform.biz.mapper.TestMapper.testFun1
The error occurred while executing a query
Cause: com.baomidou.mybatisplus.core.exceptions.MybatisPlusException: Failed to process, please exclude the tableName or statementId.

How can I solve this problem ？

jsqlparser not support your sql

jsqlparser not support your sql

sql 太复杂了，会遇到jsqlparser无法解析的问题。 建议太复杂的sql自己写xml，或者提PR来处理极其复杂下jsqlparser无法解析的问题，或者给jsqlparser提ISSUE

sql 太复杂了，会遇到jsqlparser无法解析的问题。 建议太复杂的sql自己写xml，或者提PR来处理极其复杂下jsqlparser无法解析的问题，或者给jsqlparser提ISSUE


Nuget Package Creation - v1.8.10

Gmail API dependency update ('<IP_ADDRESS>50' -> '<IP_ADDRESS>50').
Nuget package creation - v1.8.10.

Codecov Report
Patch coverage has no change and project coverage change: -0.52 :warning:

Comparison is base (e3971c3) 99.48% compared to head (db48b06) 98.97%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
Additional details and impacted files
@@            Coverage Diff             @@
##             main      #37      +/-   ##
==========================================
- Coverage   99.48%   98.97%   -0.52%
==========================================
  Files           1        1
  Lines         782      782
  Branches      183      183
==========================================
- Hits          778      774       -4
- Misses          2        4       +2
- Partials        2        4       +2

see 1 file with indirect coverage changes
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Correcting version numbers for packages.config examples

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/Reference/Package-Versioning.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Nativescript support

I'm submitting a ...  (check one with "x")
[ ] bug report => search github for a similar issue or PR before submitting
[x] feature request
[ ] support request

Current behavior

initial work https://github.com/formly-js/ng-formly-nativescript

@aitboudad Hi Abdellatif, is it still on the roadmap to support Nativescript?

@geraldapeoples yes still on the roadmap with a low priority for now :)

@aitboudad thank you for the update, I will have a look at the original plugin and see if I can get my head around it, if so then hopefully I can contribute

I've played with text field type a little bit, so let me to push an initial work and then you can follow the same direction for other types

Cheers :)

Done, to give it a try in a nativescript app:

install npm packages

npm install @ngx-formly/core<EMAIL_ADDRESS>--save

import FormlyModule:

import { NgModule, NO_ERRORS_SCHEMA } from "@angular/core";
import { NativeScriptModule } from "nativescript-angular/nativescript.module";

import { ReactiveFormsModule } from '@angular/forms';
import { FormlyModule } from '@ngx-formly/core';
import { FormlyNativescriptModule } from '@ngx-formly/nativescript';

import { AppComponent } from "./app.component";

@NgModule({
  declarations: [AppComponent],
  bootstrap: [AppComponent],
  imports: [
    NativeScriptModule,

    ReactiveFormsModule,
    FormlyNativescriptModule,
    FormlyModule.forRoot({
      validationMessages: [
        { name: 'required', message: 'This field is required' },
      ],
    }),
  ],
  schemas: [NO_ERRORS_SCHEMA],
})
export class AppModule {}

edit app.component.ts

import { Component } from "@angular/core";
import { FormGroup } from '@angular/forms';
import { FormlyFormOptions, FormlyFieldConfig } from '@ngx-formly/core';

@Component({
  selector: "my-app",
  template: `
    <ActionBar title="Ngx Formly" class="action-bar"></ActionBar>
    <StackLayout class="form" sdkExampleTitle sdkToggleNavButton>
      <form [formGroup]="form">
        <formly-form [model]="model" [fields]="fields" [options]="options" [form]="form">
        </formly-form>
      </form>
    </StackLayout>
  `
})
export class AppComponent {
  // Your TypeScript logic goes here
  form = new FormGroup({});
  model: any = {};
  options: FormlyFormOptions = {};
  fields: FormlyFieldConfig[] = [
    {
      key: 'firstname',
      type: 'text-field',
      templateOptions: {
        label: 'firstname',
        hint: 'TEST',
        required: true,
      },
    },
  ];
}

Output

@geraldapeoples right now only field-text is supported the source code is in https://github.com/formly-js/ngx-formly/tree/master/src/nativescript/text-field,  all new types should follow the same way so it up to you now :) for adding more features.

Hi @aitboudad, thanks for this.
Could you please advise if to add the additional field types/question types, whether on Nativescript we can still do the same as on the web version similar to the date picker example here; or is there a recommended way?

Another question, could you advice how can I get the reference classes for the labels and the actual field?

@amoswachanga your last question is not clear could you elaborate please and for  datepicker basically it should be similar


Update CZML validation document.

This adds the extension properties from https://github.com/AnalyticalGraphicsInc/czml-writer/pull/184 which don't have any significant assertions here.

Thanks for the pull request @shunter!

:heavy_check_mark: Signed CLA found.
:grey_question: CHANGES.md was not updated.

If this change updates the public API in any way, please add a bullet point to CHANGES.md.

Reviewers, don't forget to make sure that:

[ ] Cesium Viewer works.
[ ] Works in 2D/CV.
[ ] Works (or fails gracefully) in IE11.

Thanks @shunter!


Saved Keypairs: show balance or fund account button

Preview is available here:http://laboratory-pr1147.previews.kube001.services.stellar-ops.com/

Preview is available here:http://laboratory-pr1147.previews.kube001.services.stellar-ops.com/


Add analysis of multiple emojis

So we want to have a match to multiple emojis that can be stored in the db then incorporated in the generator
Changes
Database
The new Database structure will go
 "Word" : {                  Single : {                                 " :smile:" : 1,                                 " :relieved:" : 2                  },                  Multi : {                               " :smile::relieved:" : 1                  } }
Scraper
The plan is to analyse the set of posts as normal then take all the results in the multi section and condense them to common strings so if you had 3 strings of emojis
☹☹🙌😠😣😟  ,
👏🎬☹☹🙌😠😣 ,
👏🎬☹☹🙌😠
They all have the string
☹☹🙌😠
in common

Simple do that then

Yeah not quite that simple I need to work on a way to actually do that
Server

[ ] Change the response to pick the top single and top multi emoji then randomly decide what one to use, this randomness should be global to the output in the sense we pre-decide 80% single 20% multi emojis, then stick to that.

Website

[ ] Add checkbox for multi or single emojis

[ ] (Optional) Add % multi's - an option to decide how many of the words should have multi emojis on them

If anyone want's to help feel free to reply also feel free to make suggestions and issues on this github

This whole thing needs a re-write I'm getting rid of the old issues for that.


Update instructions for building the example

Issue: I ran across this repo and wanted to build it locally to play around with, but ran into an issue where the example resources I expected to be generated didn't exist after following the README.md directions.
Solution: Update the README.md with the correct title of the script for building the example, example-build.

@csarsam whoops/awesome! thanks for the pull request!


istiod getting scheduled on windows nodes.

Bug description
I have a mixed linux/windows node cluster. I specified the following
global:
      # Ensure that the Istio pods are only scheduled to run on Linux nodes
      defaultNodeSelector:
        kubernetes.io/os: linux

but this does not seemls to be taken into consederation when deploying addons nor istiod
[ ] Docs
[X] Installation
[ ] Networking
[ ] Performance and Scalability
[ ] Extensions and Telemetry
[ ] Security
[ ] Test and Release
[ ] User Experience
[ ] Developer Infrastructure
Expected behavior
When setting default nodeselector  to kubernetes.io/os: linux that it takes it into consuderation
Steps to reproduce the bug
deploy with the above snippet
Version (include the output of istioctl version --remote and kubectl version and helm version if you used Helm)
isitoctl 1.6.8
How was Istio installed?
istioctl
Environment where bug was observed (cloud vendor, OS, etc)
Azure

when u kbctl edit the deployment and add the node selector manually it does work

I am also facing this issue by running the following (I also have a mixed Windows/Linux cluster on Azure [AKS]):
istioctl install --set profile=default --set values.global.defaultNodeSelector.beta\\.kubernetes\\.io/os=linux --log_output_level=installer:info
istioctl version: 1.7.3
My command is specifically failing here (As the deployment is being run against the Windows node pool):
✘ Istiod encountered an error: failed to wait for resource: resources not ready after 5m0s: timed out waiting for the condition
Just thought I'd share I am facing the same error but please feel free to delete this comment if it is not useful.
Cheers
Marc

This has just been opened: #29269

I haven't tried this solution, yet, but it seems that Windows nodes can have a taint to prevent existing Linux containers from scheduling on them: https://kubernetes.io/docs/setup/production-environment/windows/user-guide-windows-containers/#taints-and-tolerations

This is how I fixed it. I tainted the windows nodes so no linux workloads get scheduled and I added tolerations on the windows workloads. but its a workaround and not a fix :)


Fix library path version on rsession.conf file

Related to: https://github.com/red-hat-data-services/notebooks/pull/149
Missed one bit here to be totally fixed...
End to end image testing shows only one folder as expected

/cherrypick release-2023b


Add the setup script from the 'lncm/zero' project into this one

Add the setup scripts from the lncm/zero project into this one.
They seem quite solid, and can be easily tailored. In my fork I've added stuff to it such as adding swap (and updating the fstab).
We can also further extend it with my setup scripts (and lightningd database bootstrap) from the lncm/dockerfiles contrib folder.

If still used, perhaps consider turning this repo into a variant within the pi-factory.

Deleting this repo since we are moving to pi-factory and ideas


Is there anyway to call "jshint" on multiple files?

I know I can call jshint app.js from my terminal when jshint is globally installed, but I would like to call it on multiple files like jshint server.js,app.js, is there any way to do it?

There sure is! Just specify those files as a whitespace-delineated list:
jshint server.js app.js

And if you want to lint all the files contained in a directory, you can specify the name of the directory itself:
jshint src

Does that help?

@jugglinmike
Yes, thank you!


fix setup precommit directory bug

Fixes #446

Codecov Report
Attention: Patch coverage is 0% with 1 lines in your changes are missing coverage. Please review.

Project coverage is 46.57%. Comparing base (c9fcd60) to head (c6acbb8).
Report is 226 commits behind head on main.

Files
Patch %
Lines

dbt_coves/tasks/setup/pre_commit.py
0.00%
1 Missing :warning:

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #447      +/-   ##
==========================================
+ Coverage   44.65%   46.57%   +1.91%
==========================================
  Files          34       42       +8
  Lines        2770     3605     +835
==========================================
+ Hits         1237     1679     +442
- Misses       1533     1926     +393

Flag
Coverage Δ

unittests
46.57% <0.00%> (+1.91%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Images not displaying possibly because of URLs not being encoded

Hi, consider the following markdown:
https://raw.githubusercontent.com/Adeel-Ali/Uber-API-JAVA/master/README.md
All the svg images render as links. The reason can be that these links does not have a .png / .svg extension at the end.
Please fix this. Thankyou

No, the problem is that the urls aren't properly encoded (and possibly wrong). I've removed the space between uber and api and the images display properly.
Check the example

As a sidenote, showdown does not encode/decode urls automatically. But it might be a useful feature/enhancement.

After looking through this for a while, I couldn't find a sure way of automatically encoding URLs.
For starters, there's no foolproof way of knowing if a URL is encoded or not. For instance, this URL http://example.com/20foo%20bar might be an encoded form of http://example.com/20foo bar or not be encoded at all. The only way to know is through testing the URL itself or thwough human intervention.
So, i'm afraid this feature won't be implemented, at least in the near future, so i will be closing this.


redirect to checkout from server api

First, thanks for having a bunch of samples to play around.
would like to redirect the checkout session created at the server (node).
Could you please help in creating checkout api endpoint with session at server. If we have this endpoint, we shall enforce the response to redirect from the server rather than the client initiating the redirectToCheckout({ sessionId }).
Thanks.

yesplease

Hey @saravanakj! Sorry for the delay in responding. We don't actually have a way to redirect from the server currently. All redirection requires passing the ID to the client and using Stripe.js to redirect.


[Sample Issue] It appears the example Python script is not working

Link to sample
No response
Library name and version
Python
Language of the Sample

[ ] C#/.NET
[ ] Java
[ ] JavaScript/TypedScript
[X] Python
[ ] Golang
[ ] Other - Please specify in Issue details field

Sample Issue Type

[X] Sample not working
[ ] Sample missing
[ ] Do not understand sample

Issue details
The script provided on this page (https://learn.microsoft.com/en-us/rest/api/trafficmanager/endpoints/update?tabs=Python) for Python is not working.  It was tested by a customer and not successful.  The customer provided a sample of code that is working for them.
`from  azure.identity  import DefaultAzureCredential
from  azure.mgmt.trafficmanagerimport  TrafficManagerManagementClient
def  update_tm_endpoint(target: str):
subscription_id = "subscription_id"
resource_group_name = "rg-name"
profile_name = "trafficmanager-profile-name"
endpoint_type = "azureEndpoints"
endpoint_name = "trafficmanagerendpointname"
target = "/subscriptions/subscription_id/resourceGroups/rg-name/providers/Microsoft.Web/sites/website-name"
weight = "1"
endpoint_status = "Enabled"
credentials = DefaultAzureCredential()
traffic_manager_client = TrafficManagerManagementClient(
credentials, subscription_id
)
endpoint = traffic_manager_client.endpoints.get(
resource_group_name, profile_name, endpoint_type, endpoint_name
)
endpoint.target_resource_id = target
endpoint.weight = weight
endpoint.endpoint_status = endpoint_status
res = traffic_manager_client.endpoints.create_or_update(
resource_group_name, profile_name, endpoint_type, endpoint_name, endpoint
)
return  res, datetime.now()`
Expected behavior
No response
Actual behavior
No response
Reproduction Steps
No response
Environment
No response

from azure.identity import DefaultAzureCredential
from azure.mgmt.trafficmanager import TrafficManagerManagementClient

def update_tm_endpoint(target: str):
    subscription_id = "subscription_id"
    resource_group_name = "rg-name"
    profile_name = "trafficmanager-profile-name"
    endpoint_type = "azureEndpoints"
    endpoint_name = "trafficmanagerendpointname"
    target = "/subscriptions/subscription_id/resourceGroups/rg-name/providers/Microsoft.Web/sites/website-name"
    weight = "1"
    endpoint_status = "Enabled"
    credentials = DefaultAzureCredential()
    traffic_manager_client = TrafficManagerManagementClient(
        credentials, subscription_id
    )
    endpoint = traffic_manager_client.endpoints.get(
        resource_group_name, profile_name, endpoint_type, endpoint_name
    )
    endpoint.target_resource_id = target
    endpoint.weight = weight
    endpoint.endpoint_status = endpoint_status
    res = traffic_manager_client.endpoints.create_or_update(
        resource_group_name, profile_name, endpoint_type, endpoint_name, endpoint
    )
    return res, datetime.now()

Hi @msyyc .  Thanks for the response and update!
I have to admit that I do not have the ability to personally test the code submission and am relying upon the information provided by them.  At the heart of the customer's ask is that the Python code provided in the documentation does not work.  This led to them writing their own method (which may have its own bugs).  So we don't need to necessarily need to use the customer's code as-is, or in general.
Are you able to tell if there are any errors in the method from the docs?

Hi @robertspears Could you suggest customer to open issue in https://github.com/Azure/azure-sdk-for-python/issues ? If they can provide detailed context, SDK team will try to provide solution.

Hi @msyyc .  I checked - what I earlier sent was the result of after the customer opened a support case.  The case already closed.  After reviewing the notes, it looks to me that there is confusion in what was trying to be accomplished and some of syntax.  Thanks for pointing out the bug.
So just to wrap up, may I confirm you're not seeing errors on the current code on this page?

Yeah.


feat(sample_data): Added Elasticsearch Mapping Check

Please Review
@seenusuvarna
@J-Fid

PR will prevent below error to occur
== Creating Air Mail Listings
 POST /appsmall/listings/1/_update?refresh=true [status:400 request:0.006s]
 Exception while running run() in 'ozpcenter.scripts.sample_data_generator'
 Traceback (most recent call last):
 File "manage.py", line 13, in <module>
 execute_from_command_line(sys.argv)
 File "/usr/local/ozp/python-env/lib/python3.4/site-packages/django/core/management/_init_.py", line 338, in execute_from_command_line
 utility.execute()
 File "/usr/local/ozp/python-env/lib/python3.4/site-packages/django/core/management/_init_.py", line 330, in execute
 self.fetch_command(subcommand).run_from_argv(self.argv)
 File "/usr/local/ozp/python-env/lib/python3.4/site-packages/django_extensions/management/email_notifications.py", line 63, in run_from_argv
 super(EmailNotificationCommand, self).run_from_argv(argv)
 File "/usr/local/ozp/python-env/lib/python3.4/site-packages/django/core/management/base.py", line 390, in run_from_argv
 self.execute(*args, **cmd_options)
 File "/usr/local/ozp/python-env/lib/python3.4/site-packages/django_extensions/management/email_notifications.py", line 75, in execute
 super(EmailNotificationCommand, self).execute(*args, **options)
 File "/usr/local/ozp/python-env/lib/python3.4/site-packages/django/core/management/base.py", line 441, in execute
 output = self.handle(*args, **options)
 File "/usr/local/ozp/python-env/lib/python3.4/site-packages/django_extensions/management/utils.py", line 71, in inner
 ret = func(self, *args, **kwargs)
 File "/usr/local/ozp/python-env/lib/python3.4/site-packages/django_extensions/management/commands/runscript.py", line 172, in handle
 run_script(mod, *script_args)
 File "/usr/local/ozp/python-env/lib/python3.4/site-packages/django_extensions/management/commands/runscript.py", line 80, in run_script
 mod.run(*script_args)
 File "/usr/local/ozp/backend/ozpcenter/scripts/sample_data_generator.py", line 414, in run
 listing.save()
 File "/usr/local/ozp/backend/ozpcenter/models.py", line 1065, in save
 elasticsearch_util.update_es_listing(current_listing_id, record, is_new)
 File "/usr/local/ozp/backend/ozpcenter/api/listing/elasticsearch_util.py", line 361, in update_es_listing
 body={"doc": record_clean_obj}
 File "/usr/local/ozp/python-env/lib/python3.4/site-packages/elasticsearch/client/utils.py", line 69, in _wrapped
 return func(*args, params=params, **kwargs)
 File "/usr/local/ozp/python-env/lib/python3.4/site-packages/elasticsearch/client/_init_.py", line 452, in update
 doc_type, id, '_update'), params=params, body=body)
 File "/usr/local/ozp/python-env/lib/python3.4/site-packages/elasticsearch/transport.py", line 327, in perform_request
 status, headers, data = connection.perform_request(method, url, params, body, ignore=ignore, timeout=timeout)
 File "/usr/local/ozp/python-env/lib/python3.4/site-packages/elasticsearch/connection/http_urllib3.py", line 109, in perform_request
 self._raise_error(response.status, raw_data)
 File "/usr/local/ozp/python-env/lib/python3.4/site-packages/elasticsearch/connection/base.py", line 113, in _raise_error
 raise HTTP_EXCEPTIONS.get(status_code, TransportError)(status_code, error_message, additional_info)
 elasticsearch.exceptions.RequestError: TransportError(400, 'strict_dynamic_mapping_exception', 'mapping set to strict, dynamic introduction of [approved_date] within [listings] is not allowed')
 Starting ozpRunning gunicorn as: gunicorn --daemon --bind=<IP_ADDRESS>:4433 --pid=/usr/local/ozp/gunicorn_ozp.pid --workers=2 --user=ozp --log-file=/usr/local/ozp/gunicorn_ozp.log --keyfile /usr/local/ozp/server_certs/private/server.key --certfile /usr/local/ozp/server_certs/server.crt --ca-certs /usr/local/ozp/ca_certs/rootCA.pem ozp.wsgi:application