Option's fromNullable() confuses TS

Option's fromNullable has TS thinking the resulting Option's value is possibly equivalent to a new Some(null) or new Some(undefined):
import { option } from 'fp-ts';

console.log(
  option
    .fromNullable(null) // or undefined
    .map(x => x.toUpperCase())
    //        ^ tsc: TS2531: Object is possibly 'null'.
    //          (or 'undefined', if we have fromNullable(undefined).)
    .fold("default", x => x)
);
// This prints out "default".

Everything works as expected when you actually run the code, though.
(Tested on TypeScript 2.7.2, 2.8.)

That's because in this case type of the input is just null (instead of A | null for some A)
// likely you have something typed like this
declare const x: string | null

console.log(
  option
    .fromNullable(x)
    .map(x => x.toUpperCase())
    .fold('default', x => x)
)

alternatively you can add a hint
console.log(
  option
    .fromNullable<string>(null)
    .map(x => x.toUpperCase())
    .fold('default', x => x)
)

Ah, okay. I'm guessing TypeScript is both too aware (always null) and oblivious (not realising the null is eliminated via the type guard) to give us a sensible result for this input-is-null case.
Thanks for your patience; closing this issue.

In recent code, using TypeScript v3.7.2 and fp-ts v2.3.0
declare const x: string | null

console.log(
  option
    .fromNullable(x)
    .map(x => x.toUpperCase())
    .fold('default', x => x)
)

Throws a TypeScript warning:
Property 'map' does not exist on type 'Option<string>'.
  Property 'map' does not exist on type 'None'.ts(2339)

Likewise the error message appears on these code samples too:
https://davetayls.me/blog/2018/05/20/fp-ts-01-working-with-nullable-values
@gcanti @damncabbage any insight here?

Because you are using fp-ts 2, and your code is for fp-ts 1.

Thanks! Yea after looking through the repo for the last few hours I've figured something major changed.
How would one translate this to fp-ts@2+?

@camsjams Something like this. Read issues, please.
import * as O from 'fp-ts/lib/Option';
import { pipe } from 'fp-ts/lib/pipeable';

return pipe(
    error,
    O.fold(constNull, error => {
      const message = intl.formatMessage(messages[error]);
      return <FormErrorMessage>{message}</FormErrorMessage>;
    }),
  )

Thanks @steida that's helpful.
For people that don't want to be fooled by outdate blog posts on Dev.to and the like, please review:
https://github.com/gcanti/fp-ts/pull/881
https://gcanti.github.io/fp-ts/introduction/upgrade-to-v2.html


Support dynamically changing the visibility timeout for S3 Source with SQS queue

Is your feature request related to a problem? Please describe.
As a user of the s3 source with sqs, I have messages/objects that differentiates in size. This means that there is not an optimal visibility timeout for the SQS queue, as too small a timeout cause issues with large messages, and too large a timeout could cause delays on processing files if data prepper were to crash.
Describe the solution you'd like
Making timely calls to the ChangeMessageVisbility API of SQS from the S3 source. This could be an optional parameter for the sqs queue.
source:
  s3:
    sqs:
      visibility_timeout: "dynamic"

The S3 source would be responsible for keeping track of the time that it has been processing a message, and would make an API call if it couldn't process the message in time. For example, if the visibility timeout of the queue is 2 minutes, and the S3 source pulls this message, and finds it won't be able to process it in time, an API call to ChangeMessageVisbility would be made to increase the visibility timeout for the message by another 2 minutes. This would continue until the message is fully processed, or until the instance of Data Prepper crashes, which means the visibility timeout would not be increased again, and another instance of data prepper could grab the message as intended.
Describe alternatives you've considered (Optional)
Defaulting the visibility timeout to a much larger value (maybe even the max of 12 hr), and then if Data Prepper is going to shutdown, to call a ChangeMessageVisibility with a value of 0 to allow another instance of Data Prepper to immediately

Resolved by #3565

The configuration we implemented is as follows:
source:
  s3:
    sqs:
      visibility_duplication_protection: true
      maximum_visibility_timeout_extension: 1h


[Question] How is the mod's meta data parsing done?

Hi, first of all thank you for this amazing tools. I have a MacBook and I want to run the game on it but with mods too. I know that the mod manager only supports Windows so I have an idea of making a Python script for that.
I think I have a brief understanding of the progress, read all the .pak files in order, parse the meta.lsx or meta.lsf to get the mod's info, then write it to modsetting.xml
But how is the parsing meta.lsx or meta.lsf part done? I didn't learn C# so I couldn't really understand much from reading the source code (I looked at DivinityModDataLoader.cs)
Looking for a detailed explanation on that, thanks!

Hi. Basically the mod manager uses lslib to open/read the .pak file, then it looks for a meta.lsx file in the Mods folder within the pak. If that exists, it then parses it like an xml file (since it basically is), and looks to get the attributes out of root/children/ModuleInfo.
For a python script, the tricky part would be reading the pak so you can get to the meta.lsx, since the actual reading of the xml file itself is pretty straightforward.
You may want to ask over at the lslib repo, and here's some links to the related classes:
PackageReader.cs
LSPKHeader16
BinUtils
BG3 uses this v16 package format.

Thank you for the quick response, by "using lslib" do you mean using codes from it? Or calling it via CLI?
Because I have an idea where maybe I don't have to deal with reading .pak and parse them from binary, I can try to unpack a single file from them (meta.lsx) as temp file then get their data & info via CLI commands using divine.exe
However I found CLI command might have some bugs and it doesnt work, currently waiting for the author's response

by "using lslib" do you mean using codes from it? Or calling it via CLI?

lslib is a C# .NET framework library, so the mod manager uses the code directly. Not sure if it would work on Mac. It definitely wouldn't work inherently at least, since .NET Framework isn't cross-platform, but I imagine the package-specific code could probably work in a Net 6/7 library with some tweaks, which would be cross-platform.

I see, thank you info. I will try and see if lslib works on Linux/Mac.
Worst case I might actually need to deal with the binaries and parse them into Python classes 😭
Something totally new to me and it sounds challenging, I will give it a try.


Multischema query Error

Which version of ShardingSphere did you use?
4.0.0-RC1 error
3.1.0 normal
Which project did you use? Sharding-JDBC or Sharding-Proxy?
sharding-jdbc
Expected behavior
rewrite sql contains schema,so can right run.
Actual behavior
rewrite sql doesn't contain schema.
Reason analyze (If you can)
Steps to reproduce the behavior, such as: SQL to execute, sharding rule configuration, when exception occur etc.
I have three schemas: ds0, ds1, test
test also default datasource
at ds0 create table test_a:
CREATE TABLE test_a (
name varchar(20) DEFAULT NULL COMMENT '名称',
code varchar(20) DEFAULT NULL COMMENT '编码',
id varchar(36) NOT NULL DEFAULT '',
PRIMARY KEY (id)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;
at ds1 create table test_b:
CREATE TABLE test_b (
name varchar(20) DEFAULT NULL COMMENT '名称',
code varchar(20) DEFAULT NULL COMMENT '编码',
id varchar(36) NOT NULL DEFAULT '',
PRIMARY KEY (id)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;
at test execute sql (test_a, test_b all not sharding tables):
select e.* from (
SELECT
c.id AS idStr,
c.code AS code,
c.name AS name
FROM
ds0.test_a c
UNION ALL
SELECT
a.id AS idStr,
a.code AS code,
a.name AS name
FROM
ds1.test_b a
) e
error info as bellow:
2019-10-31 09:25:36.838  INFO 9720 --- [nio-8084-exec-1] ShardingSphere-SQL                       : Actual SQL: test :::
select e.* from (
SELECT
c.id AS idStr,
c.code AS code,
c.name AS name
FROM
test_a c
UNION ALL
SELECT
a.id AS idStr,
a.code AS code,
a.name AS name
FROM
test_b a
) e
com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Table 'test.test_a' doesn't exist
Example codes for reproduce this issue (such as a github link).

Hi, duplicate with #3405


LUIS SDK is 0.7.0? - that makes no sense

Package Name: azure-cognitiveservices-language-luis
The current LUIS team has 3 versions of their rest API available right now for authoring. The GA version is the API is 2.x, and the preview is labeled 3.x, and the version after that, is 4.x. These are referenced in the docs and have significantly different features for building models.
How is a customer supposed to understand there is only one python package and its version isn't a 1.0 yet? What is a customer supposed to understand about the python package based on this versioning? Not GA, just peview with no support?

@cahann , @kayousef , @lmazuel - Following up to see if there is any update on the above feedback? - Thank you

Feedback noted with the coming SDK version. Thanks.


removes dead code -> increases code coverage

removes unreachable methods

Coverage increased (+3.2%) to 99.876% when pulling 999732b240a9f43796d59dcd5adadd0d502f7171 on LeFnord:master into a7dc0e2baaccf0bc3342d00c6ad62b87f810fd3c on ruby-grape:master.

Coverage increased (+3.2%) to 99.876% when pulling 999732b240a9f43796d59dcd5adadd0d502f7171 on LeFnord:master into a7dc0e2baaccf0bc3342d00c6ad62b87f810fd3c on ruby-grape:master.

Coverage increased (+3.2%) to 99.876% when pulling 999732b240a9f43796d59dcd5adadd0d502f7171 on LeFnord:master into a7dc0e2baaccf0bc3342d00c6ad62b87f810fd3c on ruby-grape:master.

Coverage increased (+3.2%) to 99.876% when pulling 999732b240a9f43796d59dcd5adadd0d502f7171 on LeFnord:master into a7dc0e2baaccf0bc3342d00c6ad62b87f810fd3c on ruby-grape:master.

Coverage increased (+3.2%) to 99.876% when pulling 999732b240a9f43796d59dcd5adadd0d502f7171 on LeFnord:master into a7dc0e2baaccf0bc3342d00c6ad62b87f810fd3c on ruby-grape:master.

Coverage increased (+3.2%) to 99.876% when pulling 999732b240a9f43796d59dcd5adadd0d502f7171 on LeFnord:master into a7dc0e2baaccf0bc3342d00c6ad62b87f810fd3c on ruby-grape:master.

Coverage increased (+3.2%) to 99.876% when pulling 0100a8afa9dde391df08c47c02260273d4f9d1fd on LeFnord:master into a7dc0e2baaccf0bc3342d00c6ad62b87f810fd3c on ruby-grape:master.

Coverage increased (+3.2%) to 99.876% when pulling 0100a8afa9dde391df08c47c02260273d4f9d1fd on LeFnord:master into a7dc0e2baaccf0bc3342d00c6ad62b87f810fd3c on ruby-grape:master.

Coverage increased (+3.2%) to 99.876% when pulling 0100a8afa9dde391df08c47c02260273d4f9d1fd on LeFnord:master into a7dc0e2baaccf0bc3342d00c6ad62b87f810fd3c on ruby-grape:master.

Coverage increased (+3.2%) to 99.876% when pulling 0100a8afa9dde391df08c47c02260273d4f9d1fd on LeFnord:master into a7dc0e2baaccf0bc3342d00c6ad62b87f810fd3c on ruby-grape:master.

Coverage increased (+3.2%) to 99.876% when pulling 0100a8afa9dde391df08c47c02260273d4f9d1fd on LeFnord:master into a7dc0e2baaccf0bc3342d00c6ad62b87f810fd3c on ruby-grape:master.

Coverage increased (+3.2%) to 99.876% when pulling 0100a8afa9dde391df08c47c02260273d4f9d1fd on LeFnord:master into a7dc0e2baaccf0bc3342d00c6ad62b87f810fd3c on ruby-grape:master.

Coverage increased (+3.2%) to 99.876% when pulling 0100a8afa9dde391df08c47c02260273d4f9d1fd on LeFnord:master into a7dc0e2baaccf0bc3342d00c6ad62b87f810fd3c on ruby-grape:master.

Coverage increased (+3.2%) to 99.876% when pulling 0100a8afa9dde391df08c47c02260273d4f9d1fd on LeFnord:master into a7dc0e2baaccf0bc3342d00c6ad62b87f810fd3c on ruby-grape:master.

Coverage increased (+3.2%) to 99.876% when pulling 0100a8afa9dde391df08c47c02260273d4f9d1fd on LeFnord:master into a7dc0e2baaccf0bc3342d00c6ad62b87f810fd3c on ruby-grape:master.

Coverage increased (+3.2%) to 99.876% when pulling 0100a8afa9dde391df08c47c02260273d4f9d1fd on LeFnord:master into a7dc0e2baaccf0bc3342d00c6ad62b87f810fd3c on ruby-grape:master.


Allow to have a different directory and project name

What problem does this feature solve?
Full stack projects might use a project structure where the web is only a certain part amongst e.g. the server, scripts, database definitions. Consider for example the default Go project structure. For such a project it is desirable to have the output of vue-cli generated in a specific folder (web/ in the case. of go) that is not named just as the whole project, while the actual name (package.json) should still be the one of the application. As of now, I would need to manually rename the folder:
# create a web named 'my-cool-app'
$ vue create my-cool-app
# rename the target folder to a more generic name
$ mv my-cool-app web

IMHO it would be a great benefit to allow to (optionally) provide a different project name to vue-cli, while the standard behaviour should remain (i.e. derive the project name from the output folder's name).
What does the proposed API look like?
#  create the web 'my-web' in the 'web' directory
$ vue create --name my-web web

I personally think renaming a folder is straightforward and was enough.
Adding another option for this does not add any considerable value.

@LinusBorg Adding another option for this does not add any considerable value.

IMHO the value is to have the code generator (that's how I see vue-cli) configurable in a way the output fits a common use-case without the need for additional interaction.
You could have argued the same for the --git <commit message>, which is probably not used most times and could be easily done manually. Having name and output directory configurable isn't really something extraordinary, is it?

The --git option exists because vue-cli does the first commit for you, and this immand allows you to change the default message that is used. so actually, you can't do that manually as the commit already happened.
Anyway, I stated this is a personal opinion. I just feel like adding lots and lots of these "tiny" options to the cli will make it harder to find the ones that do more important/advanced things.
It may be argued that this is an arbitrary point to draw the line and that would be correct and I do not care too much either way.

[...] you can't do that manually as the commit already happened

well, even though you can of course change the last (first) commit message as easy as renaming a directory (i.e. git commit --amend), I must admin that my example wasn't chosen very well. My though was that adding files to a VCS isn't such a basic task as defining the output directory. It is easy, fast and can be done by any developer himself the way he/she wants it :wink:.

I just feel like adding lots and lots of these "tiny" options to the cli will make it harder to find the ones that do more important/advanced things.

I can fully understand your point, and in general I'd agree with it. My use case arose from the situation that developers in a company I'm working for went through the options and as the only one was the output directory used that for the final name, instead of renaming the directory afterwards. We ended with lots of web webs...

I'd prefer vue create my-app --dir web as a more convienient way to do this.


NIFI-627 incorporates mwmoser patch and some minor formatting tweaks and eliminates use of exception handling for flow control

NIFI-627 incorporates mwmoser patch and some minor formatting tweaks and eliminates use of exception handling for flow control

Reviewed and +1 from me.  Thanks!


feat: erase actions

Actions can be 'erased' which will remove their undo/redo capability. Erased action are still included on the undo stack but can't be reverted or applied. When using Undo/Redo, erased actions act like a barrier and cannot be passed.
The erase function is useful to reduce the stack size but keep the undo history messages.

@florian-bluemel Maybe we can find a better wording than 'erase'. 🤔


Amir/refactor out pca

Created pull request to:

move pca code out of notebook and into package.
split pca code by quanta and maths useccases. (Majority seemed to fall into latter bucket). Created a new maths_tools folder.
Make the calc_pca generic function accept selected inputs, and not be hard coded to the tricase questions always.
Move save_plt_to_file into quanta_file_utils.

I tried doing this for the auto case as well, but ran into some errors, where it seems like the test data doesn't fully work properly with latest sub model, at least that used for Issue 29. Ended up reverting that bit of the conversions.

Great stuff!


New version: Gruntwork.Terragrunt version 0.68.9

Checklist for Pull Requests

[x] Have you signed the Contributor License Agreement?
[ ] Is there a linked Issue?

Manifests

[x] Have you checked that there aren't other open pull requests for the same manifest update/change?
[x] This PR only modifies one (1) manifest
[x] Have you validated your manifest locally with winget validate --manifest <path>?

[x] Does your manifest conform to the 1.6 schema?

Note: <path> is the directory's name containing the manifest you're submitting.

Microsoft Reviewers: Open in CodeFlow

Automatic Validation ended with:

Installation failed with exit code -1978335187
2024-11-09 06:38:47.863 [FAIL] Installer failed security check. Url: https://github.com/gruntwork-io/terragrunt/releases/download/v0.68.9/terragrunt_windows_386.exe Result: 0x80004005

Automated error analysis suggests -1978335187 may mean Installer failed security check. Another script should retry this every 18 hours.
Automated error analysis suggests 80004005 may mean Resource missing
(Automated response - build 897.)

@wingetbot run


⚠ Bofrost.be has degraded performance

In 8da1c46, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 2134 ms

Resolved: Bofrost.be performance has improved in fbd18a6.


How long did the project take to train?

Also, how do I set up multi-GPU training?
When I use the training code you provided, I find that only one GPU is working.

Hi @liujiaqi-666,

The duration of training correlates directly with the number of epochs specified. With only 10,000 training data, SlimSAM-50 achieves satisfactory results post 20 epochs, equating to roughly 1～2 days on a single Titan RTX. Similarly, SlimSAM-77 reaches a satisfactory level of performance after 60 epochs, which translates to approximately three days on a single Titan RTX. Enhancing the dataset size and incrementing the epoch count further can lead to improvements in the performance of the compressed model.

It's possible to designate the computing device via the command line for multi-GPU training. For instance, setting “CUDA_VISIBLE_DEVICES=0,1" enables training across two GPUs. It's important to remove gradient accumulation when employing multi-GPU setups. Nonetheless, the current implementation of our multi-GPU training code exhibits some inefficiencies. Following the completion of numerous deadlines, we anticipate having the opportunity to refine and optimize the code for multi-GPU training. Thank you.


Fix multiple Onfido screens

Details
iOS: Onfido screen present multiple time when app pushed to Background
Fixed Issues
$ https://github.com/Expensify/App/issues/23642
PROPOSAL: https://github.com/Expensify/App/issues/23642#issuecomment-1658980686
Tests

Go to setting.
Go to any workspace.
Set up a Bank account.
On the last step, click Save & continue.
It will present Onfido | Real identity screen.
Push the app in background.
Again, open the app.
Click on the back button on Onfido screen
Verify that the previous screen is not Onfido screen

[x] Verify that no errors appear in the JS console

Offline tests

N/A
QA Steps
Same as tests

[x] Verify that no errors appear in the JS console

PR Author Checklist

[x] I linked the correct issue in the ### Fixed Issues section above
[x] I wrote clear testing steps that cover the changes made in this PR

[x] I added steps for local testing in the Tests section
[x] I added steps for the expected offline behavior in the Offline steps section
[x] I added steps for Staging and/or Production testing in the QA steps section
[x] I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
[x] I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
[x] I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).

[x] I included screenshots or videos for tests on all platforms
[x] I ran the tests on all platforms & verified they passed on:

[x] Android / native
[x] Android / Chrome
[x] iOS / native
[x] iOS / Safari
[x] MacOS / Chrome / Safari
[x] MacOS / Desktop

[x] I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
[x] I followed proper code patterns (see Reviewing the code)

[x] I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
[x] I verified that the left part of a conditional rendering a React component is a boolean and NOT a string, e.g. myBool && <MyComponent />.
[x] I verified that comments were added to code that is not self explanatory
[x] I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
[x] I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method

[x] If any non-english text was added/modified, I verified the translation was requested/reviewed in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:

[x] I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
[x] I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is approved by marketing by adding the Waiting for Copy label for a copy review on the original GH to get the correct copy.
[x] I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
[x] I verified the JSDocs style guidelines (in STYLE.md) were followed

[x] If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
[x] I followed the guidelines as stated in the Review Guidelines
[x] I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
[x] I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
[x] I verified any variables that can be defined as constants (ie. in CONST.js or at the top of the file that uses the constant) are defined as such
[x] I verified that if a function's arguments changed that all usages have also been updated correctly
[x] If a new component is created I verified that:

[x] A similar component doesn't exist in the codebase
[x] All props are defined accurately and each prop has a /** comment above it */
[x] The file is named correctly
[x] The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
[x] The only data being stored in the state is data necessary for rendering and nothing else
[x] For Class Components, any internal methods passed to components event handlers are bound to this properly so there are no scoping issues (i.e. for onClick={this.submit} the method this.submit should be bound to this in the constructor)
[x] Any internal methods bound to this are necessary to be bound (i.e. avoid this.submit = this.submit.bind(this); if this.submit is never passed to a component event handler like onClick)
[x] All JSX used for rendering exists in the render method
[x] The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions

[x] If any new file was added I verified that:

[x] The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory

[x] If a new CSS style is added I verified that:

[x] A similar style doesn't already exist
[x] The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(themeColors.componentBG))

[x] If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
[x] If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
[x] If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
[x] If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
[x] If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.
[x] I have checked off every checkbox in the PR author checklist, including those that don't apply to this PR.

Screenshots/Videos

Web
https://github.com/Expensify/App/assets/13113013/c9476053-5127-40e5-ad00-2ba26aee6782

Mobile Web - Safari
https://github.com/Expensify/App/assets/13113013/fedf1257-8e17-43de-94ea-fae2b3585141

Mobile Web - Chrome
https://github.com/Expensify/App/assets/13113013/075eb9d9-5e79-4a65-a99b-af5292305607

Desktop
https://github.com/Expensify/App/assets/13113013/48f7cd4d-1ff3-4690-af2d-b3669f298ed2

iOS
https://github.com/Expensify/App/assets/13113013/10bfc82b-2a0f-4dc2-9ec1-40ed72395333

Android
https://github.com/Expensify/App/assets/13113013/12c41b61-4243-441f-98e8-d1d19bb9e08a

@allroundexperts sounds good, can you post the same in the issue as well so that if someone references that issue in the future it's easy to track down why Android will have different behavior?
@ginsuma could you update the QA steps to reflect the different behavior on Android so that this doesn't end up failing QA after being deployed?

Ah sorry! I thought I merged this. @ginsuma you've got merge conflicts but if you update this PR  I'll merge it ASAP

:hand: This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

🚀 Deployed to staging by https://github.com/NikkiWines in version: 1.3.56-0 🚀

platform
result

🤖 android 🤖
failure ❌

🖥 desktop 🖥
success ✅

🍎 iOS 🍎
success ✅

🕸 web 🕸
success ✅

🚀 Deployed to production by https://github.com/roryabraham in version: 1.3.56-24 🚀

platform
result

🤖 android 🤖
success ✅

🖥 desktop 🖥
success ✅

🍎 iOS 🍎
failure ❌

🕸 web 🕸
success ✅


Post from block #775203 when starting service with post-to parameter

I started ordhook server V2.0.1 like this: ordhook service start --post-to=http://post_to_server/ --config-path=./Ordhook.toml. In V1.3 it will post the latest processed block to the post-to server, but in V2.0.1 it posted from block #775203. I can not figure out if it is a bug or new feature, please check it. And I want to know how to post the latest processed block to the server but not from block #775203.
Thank you very much!
logs:
Jan 16 07:13:28.919 INFO Block received from pre-processor
Jan 16 07:13:28.953 INFO Evaluating 0 bitcoin chainhooks registered
Jan 16 07:13:28.953 INFO 0 bitcoin chainhooks positive evaluations
Jan 16 07:13:28.953 INFO 0 bitcoin chainhooks will be triggered
Jan 16 07:13:28.953 INFO 0 bitcoin chainhooks to deregister
Jan 16 07:13:29.602 INFO Processing block #775203 through http://post_to_server/ predicate revealed 21 new inscriptions [5012, 5013, 5014, 5015, 5016, 5017, 5018, 5019, 5020, 5021, 5022, 5023, 5024, 5025, 5026, 5027, 5028, 5029, 5030, 5031, 5032] and 0 transfers
Jan 16 07:13:29.624 INFO Trigger http://post_to_server/ successful
Jan 16 07:13:30.457 INFO Processing block #775204 through http://post_to_server/ predicate revealed 5 new inscriptions [5033, 5034, 5035, 5036, 5037] and 0 transfers
Jan 16 07:13:30.490 INFO Trigger http://post_to_server/ successful
Jan 16 07:13:31.442 INFO Processing block #775205 through http://post_to_server/ predicate revealed 0 new inscriptions [] and 2 transfers
Jan 16 07:13:31.459 INFO Trigger http://post_to_server/ successful
Jan 16 07:13:32.228 INFO Processing block #775206 through http://post_to_server/ predicate revealed 8 new inscriptions [5038, 5039, 5040, 5041, 5042, 5043, 5044, 5045] and 2 transfers
Jan 16 07:13:32.249 INFO Trigger http://post_to_server/ successful
Jan 16 07:13:33.007 INFO Processing block #775207 through http://post_to_server/ predicate revealed 11 new inscriptions [5046, 5047, 5048, 5049, 5050, 5051, 5052, 5053, 5054, 5055, 5056] and 0 transfers
Jan 16 07:13:33.033 INFO Trigger http://post_to_server/ successful
Jan 16 07:13:33.924 INFO Processing block #775208 through http://post_to_server/ predicate revealed 7 new inscriptions [5057, 5058, 5059, 5060, 5061, 5062, 5063] and 1 transfers
Jan 16 07:13:33.940 INFO Trigger http://post_to_server/ successful

Hey @MikaelBTC! This is a feature, but I think you're right and we should allow the developers to set their first height.
I'll add a command flag for this, in the meantime you can tweak you observers.sqlite db and manually set the block height of the observer you registered to the one you'd like.

Hey @MikaelBTC! This is a feature, but I think you're right and we should allow the developers to set their first height. I'll add a command flag for this, in the meantime you can tweak you observers.sqlite db and manually set the block height of the observer you registered to the one you'd like.

Thanks @lgalabru . I think we really need the command flag for the first height.

Hi @MikaelBTC  I have some problem with post-to param. Could you share post endpoint definition?

Hey @MikaelBTC! This is a feature, but I think you're right and we should allow the developers to set their first height. I'll add a command flag for this, in the meantime you can tweak you observers.sqlite db and manually set the block height of the observer you registered to the one you'd like.

Hi Igalabru,
I also need to set the start block, may I ask how can I set it in observers.sqlite. I tried to query it, it only has an empty table called observers. Please kind point out. Thanks a lot!

Hey @MikaelBTC! This is a feature, but I think you're right and we should allow the developers to set their first height. I'll add a command flag for this, in the meantime you can tweak you observers.sqlite db and manually set the block height of the observer you registered to the one you'd like.

Hi Igalabru, I also need to set the start block, may I ask how can I set it in observers.sqlite. I tried to query it, it only has an empty table called observers. Please kind point out. Thanks a lot!

It seems, chainhook uuid is the key, but I don't know how to find out which uuid I should insert into the observers table. Thanks!


chore: update theme docs

update theme docs

Pull Request Test Coverage Report for Build<PHONE_NUMBER>2
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.005%) to 82.302%

Totals

Change from base Build<PHONE_NUMBER>8:
-0.005%

Covered Lines:
10634

Relevant Lines:
11793

💛  - Coveralls


rails c raises in dokku run

Getting the following error (using latest dokku master, and latest buildstep)
dokku run my_rails_app /bin/bash
RAILS_ENV=production bundle exec rails c
/app/vendor/ruby-2.1.2/lib/ruby/2.1.0/irb/completion.rb:9:in `require': libreadline.so.5: cannot open shared object file: No such file or directory - /app/vendor/ruby-2.1.2/lib/ruby/2.1.0/x86_64-linux/readline.so (LoadError)
	from /app/vendor/ruby-2.1.2/lib/ruby/2.1.0/irb/completion.rb:9:in `<top (required)>'
	from /app/vendor/bundle/ruby/2.1.0/gems/railties-4.1.1/lib/rails/commands/console.rb:3:in `require'
	from /app/vendor/bundle/ruby/2.1.0/gems/railties-4.1.1/lib/rails/commands/console.rb:3:in `<top (required)>'
	from /app/vendor/bundle/ruby/2.1.0/gems/railties-4.1.1/lib/rails/commands/commands_tasks.rb:128:in `require'
	from /app/vendor/bundle/ruby/2.1.0/gems/railties-4.1.1/lib/rails/commands/commands_tasks.rb:128:in `require_command!'
	from /app/vendor/bundle/ruby/2.1.0/gems/railties-4.1.1/lib/rails/commands/commands_tasks.rb:59:in `console'
	from /app/vendor/bundle/ruby/2.1.0/gems/railties-4.1.1/lib/rails/commands/commands_tasks.rb:40:in `run_command!'
	from /app/vendor/bundle/ruby/2.1.0/gems/railties-4.1.1/lib/rails/commands.rb:17:in `<top (required)>'
	from bin/rails:8:in `require'
	from bin/rails:8:in `<main>'

To solve the problem I need to open the file /app/vendor/bundle/ruby/2.1.0/gems/railties-4.1.1/lib/rails/commands/console.rb, and remove line 3: require 'irb/completion'
I guess the problem is that libreadline.so is not correct installed, any clue why is that? any guidance in where should I try to fix this problem? I am glad to send a PR,.

We updated the buildstep image in use, and also added the build-env plugin to allow devs to customize their env vars during a container build. Closing, but feel free to comment if the issue persists on the latest release.


[Kernel][Defaults] Add support for timestamp_ntz in Parquet writer

Description
This is a Parquet writer-only change.
How was this patch tested?
Added a column of timestamp_ntz to the existing golden tables, which are read and written by the tests.

LGTM but can we update the protocol to include only INT64 for timestamp_ntz?

Some context. Spark always writes as INT64, but supports reading INT96.
As of now, we don't need the protocol update but require a change in Kernel to support reading INT96. Given that the timestamp as INT96 is being deprecated and Spark is not writing as INT96, it is not a priority to add it now. Will create an issue track it.


modify customSetOutput to update latest.Spec fields where possible

Description of changes:
In many cases, latest.Spec doesn't reflect the latest observed state for fields that the Elasticache API does not directly return. For example, we have to count the replicas from the NodeGroups portion of the API response to update latest.Spec.ReplicasPerNodeGroup, and we have to make an DescribeCacheClusters API call to retrieve information like the engine version (another field in latest.Spec.
The point of this PR is to initiate the process of updating all latest.Spec fields via customSetOutput so that latest.Spec actually reflects the latest observed state of the resource, therefore allowing the resource manager's Update to be invoked when appropriate. This logic was previously (and for the most part, still is) handled within the replication group resource manager's Update.
Spec fields covered:

ReplicasPerNodeGroup
EngineVersion

Changes were tested via the make test-cover target, and via a new e2e test in test_replicationgroup.py.
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Closing this PR as #29 addresses it.


Rework git elegant configure command

Issue #130 implemented
1. git elegant configure renamed to configure-repository
2. command git configure-repository works like git elegant configure --local
3. Tests and README updated

@rultor please merge.

@rultor please merge.

@extsoft OK, I'll try to merge now. You can check the progress of the merge here

@rultor please merge.

@extsoft Done! FYI, the full log is here (took me 2min)


fix bug #7340

Hi @yufeng04 . You need to add more detail in the title and description of pull request


Bump Go to 1.17.5 and start using modules

This is needed for moby/moby#43075

Was this to fix the vendor failure on that PR?

Yes. Just trying to address the issue with zookeeper client and it's dead camlistore.org dependency... I'm still quite confused about these. Will report back once I have a slightly clearer idea.

wondering if we should start with adding (if needed) replace lines in the Moby PR

I tried, and it didn't work. I think I'll need to update this repo to use the new client, make it work and go back to Moby.
It also looks like the issue in Moby PR comes to surface when go mod tidy runs and doesn't actually matter for any other steps of the build.

I tried, and it didn't work. I think I'll need to update this repo to use the new client, make it work and go back to Moby.

Gotcha; so I didn't initially notice (thanks @crazy-max) that CI wasn't running on this PR, and thought no local changes were needed (besides the go module versions)

Gotcha; so I didn't initially notice (thanks @crazy-max) that CI wasn't running on this PR, and thought no local changes were needed (besides the go module versions)

I was hoping CI would run... I ran go test ./... locally, but not sure if failures I'm seeing are to do with lack of proper setup or not. I can dig into it, but I thought of trying to make switch to new ZK client first and see if the code even builds without changes or now.

Gotcha; so I didn't initially notice (thanks @crazy-max) that CI wasn't running on this PR, and thought no local changes were needed (besides the go module versions)

I was hoping CI would run... I ran go test ./... locally, but not sure if failures I'm seeing are to do with lack of proper setup or not. I can dig into it, but I thought of trying to make switch to new ZK client first and see if the code even builds without changes or now.

Yeah zookeeper, etcd and consul bins seems to be required.

Can we re-enable Travis for this repo?

Coming for now in favour of https://github.com/docker/libkv/pull/219. Switching to modules wasn't as helpful as I originally thought it might be :)


Docs: Enterprise Edition hint boxes

Hint box for EE note, always call it Enterprise Edition
Related PRs:

https://github.com/arangodb-helper/arangodb/pull/185
https://github.com/arangodb/arangosync/pull/432

yes, in the kube repo

Changed locally and created PR in remote repo: https://github.com/arangodb/kube-arangodb/pull/222
Can be merged without further testing.


Feat: backend + alerting enabled

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.Antonio Perez Barrero seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


MM-14575: Automatically serve static files for plugins

Added sample public file
Added HAS_PUBLIC to Makefile to test for public folder
Added "static_files" config setting
Related to:
https://github.com/mattermost/mattermost-server/pull/10476
https://github.com/mattermost/mattermost-server/issues/10447

@happygaijin @hanzei This can be merged regardless of the other PRs, right?

@levb Yes


Support typescript's fixName code action property

Add support for the new fixName property ts is adding to code actions https://github.com/Microsoft/TypeScript/pull/23350

@mjbvz please provide verifications steps. thanks

Thanks for taking a look. This was only for telemetry and I just verified that the fixNameproperty is being sent properly myself:
RawEventsVSCodeExt
| where EventName contains 'typescript'
| where EventName contains 'quickfix'
| project Fix = tostring(Properties['fixname'])
| summarize count(Fix) by Fix


Livox+px4

Hello author, thank you for your open source. Can DLIO be implemented using livox+px4?

Hi @Joosoo1 -- yes, try using the feature/livox-support branch! I haven't tested it out with real data though, so let me know if it works or not.

Yes, thanks, I'll try it soon.

Well, I just tested DLIO on a livox mid-360 (built-in imu) and it doesn't seem to work, but it doesn't show any errors, then I tested DLO and DLO works fine, so I don't know where the error is happening, but it shouldn't be the reason for the timestamp being out of sync, because the mid-360 should be in sync. I don't know where the error occurred, but it shouldn't be the reason for the timestamp being out of sync, because mid-360 should be in sync! As you can see below, there is no next step!
+-------------------------------------------------------------------+ | Direct LiDAR-Inertial Odometry v1.2.0 | +---- -------------------- -------------------------------------------+
Calibrate IMU for 3 seconds... Done
Acceleration Deviation [xyz]: 0.01453409, -0.00895136, -8.81063747
Gyroscope Deviation [xyz]: -0.00210290, 0.00037739, 0.00247880
DLIO initialization!

Hmm, think you could upload a bag for me? I haven't tested that branch out since I don't have any Livox data, so I can take a look if you provide some data. Thank you.

ok,经过我的测试。livox-mid360可以成功运行DLIO，只需要把livox_ros_driver2中的点云发布形式“xfer_format”改为“2”，就可以成功运行DLIO，如下：


removing travis and pandas docs

I was trying to figure out why the build says it's failing on master. It was our travis build, and looking at the travis config file, it seems that all it's doing is building the pandas docs (and trying to deploy them on master, which fails).
This PR removes the pandas docs + the travis build, with the following assumptions:

the pandas docs are a carry-over from earlier on, and removing them from this repo won't change the pandas website
we have enough material in our demo folder to highlight all the stuff we'd want to preview w/ this theme
the travis build was only for building and pushing the pandas docs, which we don't need anymore since we're building with circleci

Yes! Some time ago I added some more content to the demo docs, with one long page mostly taken from the pandas docs. So that should suffice. Time to get rid of this :)


[WIP] Replace coveralls with codecov.io for code coverage reports

This pull request proposes to replace coveralls coverage reports with codecov.io coverage reports.
My main reasons for the proposed change of service are:

codecov.io has a much nicer and better UI.
Right now we have coverage comments enabled which means coveralls posts a comment on the pull request on every push. Imo, this adds a lot of noise, but very little value. It discourages people to push often (which is a good practice) and adds noise to the pull request which makes actual valuable review feedback harder to see / find.

Codecov.io can be configured to add only a single comment which is then updated when code and coverage changes. Imo, that's much better than comment spam on every push.

Codecov Report

:exclamation: No coverage uploaded for pull request base (trunk@099b228). Click here to learn what that means.
The diff coverage is n/a.

@@           Coverage Diff            @@
##             trunk    #1109   +/-   ##
========================================
  Coverage         ?   85.33%
========================================
  Files            ?      342
  Lines            ?    65695
  Branches         ?     5856
========================================
  Hits             ?    56060
  Misses           ?     7250
  Partials         ?     2385

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 099b228...787a4f6. Read the comment docs.

Coverage increased (+0.003%) to 88.97% when pulling 787a4f637ed10f619f89dfed58aeaa488fbc065f on Kami:codecov_experiment into 099b2289df483888e1e75e1ff81efc2ba035a996 on apache:trunk.

Coverage increased (+0.003%) to 88.97% when pulling 58d6252008fb486dbbc023a0d3f007ca98c136b2 on Kami:codecov_experiment into 099b2289df483888e1e75e1ff81efc2ba035a996 on apache:trunk.

@tonybaloney what do you think?

+1 to the change. You might need to ask the infrastructure team to make the switch. Agree that the constant update on coverage is annoying

👍

@tonybaloney Nice thing about codecov also is that you don't need to configure hooks manually on Github.
It works "out of the box" for public repos which use Travis CI or a similar service.


New repository to discuss the project as a whole

What do you think about making a repo to discuss the project as a whole? Things that apply to every app or to talk about possible future apps?
You're doing great work.

might be useful, created one at https://github.com/SimpleMobileTools/General-Discussion


[app] Quick Updates to Info page

https://app.klimadao.finance/#/info

[ ] Add these
UBO: 0x2B3eCb0991AF0498ECE9135bcD04013d7993110c
NBO: 0x6BCa3B77C1909Ce1a4Ba1A20d1103bDe8d222E48
NCT: 0xD838290e877E0188a4A44700463419ED96c16107
[ ] Bonus points if you add the token icons to all

@Atmosfearful @rstycedar looks like UBO and NBO are now there but not NCT


BIGTOP-3010: juju bundle refresh (feb 2018)

Charms were refreshed back when 1.2.1 was released, but the bundle revisions and READMEs in the upstream source were not updated.  This PR fixes that.

Picked up new changes for hive (#344) and zookeeper (#341).  We should be g2g, but I'll let CWR finish on these latest revs before merging upstream.


Unable to publish by selecting 'hex'

Hi, I am using SSL connection for MQTT. The connect is successful.  To Publish/ Subscribe, I have added the respective samplers and the required 'topic' name.
In Payloads, I have selected ' Hex' string and put the required data, however getting below error :
at net.xmeter.samplers.PubSampler.hexToBinary(PubSampler.java:86) ~[mqtt-xmeter-2.0.2-jar-with-dependencies.jar:?]
Am I missing something here, also tried to convert the same to 'String' but still not able to get this working.

In our case, the problem was that java version > 8 not including jaxb anymore
this was the solution.
https://stackoverflow.com/questions/49880678/error-with-jdbc-using-java-9-and-jmeter-4-0
"Add jaxb-api jar to JMeter lib folder and restart JMeter to load jar with missing class"


Investigate icon prompting

When linking to a post on Reddit, it picks a random image as a thumbnail, which is often "random face icon". This is suboptimal and should be fixed if possible.

http://stackoverflow.com/questions/10864208/how-do-i-get-facebook-to-show-my-sites-logo-when-i-paste-the-link-in-a-post-sta

Relatedly: getting Discord to show a proper embed when constellation links are used.
I would prefer to have the description text be relatively short, because large embeds on discord are annoying, and it would be useful to have the embed so we know what thread a link points to etc. It looks like this is og. GitHub has quite a lot of og metas in its head, so that seems useful as an example of what we want to aim for.


no such element error

Thank you for the project.
I tried to run it, but I got the following error.
[INFO]: Please enter the username or hashtag you want to scrap from: *********
====== WebDriver manager ======
Current google-chrome version is 90.0.4430
Get LATEST driver version for 90.0.4430
There is no [mac64] chromedriver for browser 90.0.4430 in cache
Get LATEST driver version for 90.0.4430
Trying to download new driver from https://chromedriver.storage.googleapis.com/90.0.4430.24/chromedriver_mac64.zip
Driver has been saved in cache [/Users/**********/.wdm/drivers/chromedriver/mac64/90.0.4430.24]
[INFO]: Getting access to the user or hashtag website ..
[ERROR]: Message: no such element: Unable to locate element: {"method":"xpath","selector":"/html/body/div[2]/div/div/button[1]"}
(Session info: headless chrome=90.0.4430.212)
Do you have any idea to fix this error?
Thanks in advance.

Hi! I just tried to run my code, and it's working perfectly fine, are u trying to scrap a hashtag?

@aahouzi No. I tried to scrap my own account for testing. It returns the same error.

I tried to find why the error occurs.
It successfully get the main url (line 261). I looked at the page source by driver.page_source, and the page source looks okay.
When I run "driver.find_element_by_xpath("/html/body/div[2]/div")", no error.
But when I run driver.find_element_by_xpath("/html/body/div[2]/div/div"), no such element error occurs.

Sorry for replying late to your issue, I just got time to fix the bugs u mentioned before. For example, I tried to scrap your instagram page and here are the logs:
[INFO]: Please enter the username or hashtag you want to scrap from: yunhwankim2
[WDM] - Current google-chrome version is 92.0.4515
[WDM] - Get LATEST driver version for 92.0.4515
[WDM] - Driver [/Users/anasahouzi/.wdm/drivers/chromedriver/mac64/92.0.4515.107/chromedriver] found in cache
[INFO]: Getting access to the user or hashtag website ..
[ERROR]: Instagram redirected us to a login page
[INFO]: Failed once, now trying to access from the login page to which we were redirected.
[INFO]: Please type a username and its password seperated by one space for login: testtest7530 testtest753
[SUCCESS]: Logged into the website.
[SUCCESS]: Got into the user or hashtag page.
[INFO]: Start scrolling to the bottom of the page to get all the content.
[SUCCESS]: Finished scrolling, it took 1354.19s.
[INFO]: 41 graphql responses were extracted.
[INFO]: Number of Instagram posts: 514.
[SUCCESS]: Scrapped 12 first posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 10 posts.
[SUCCESS]: Finished scrapping 502 posts, it took 143.99s.
You can also check the file feed.pkl where u can find the data I scraped from your account ;)

Thank you for your response. I tried to do the same work as you did above, but the result is weird to me.
In the first try, it seemed work fine but it keeps asking username and password, and I entered several times without no success. Below is the log of first try.

INFO]: Please enter the username or hashtag you want to scrap from: yunhwankim2
====== WebDriver manager ======
Current google-chrome version is 92.0.4515
Get LATEST driver version for 92.0.4515
There is no [mac64] chromedriver for browser 92.0.4515 in cache
Get LATEST driver version for 92.0.4515
Trying to download new driver from https://chromedriver.storage.googleapis.com/92.0.4515.107/chromedriver_mac64.zip
Driver has been saved in cache [/Users/yunhwankim/.wdm/drivers/chromedriver/mac64/92.0.4515.107]
[INFO]: Getting access to the user or hashtag website ..
[SUCCESS]: Got into the user or hashtag page.
[INFO]: Start scrolling to the bottom of the page to get all the content.
[SUCCESS]: Finished scrolling, it took 486.33s.
[INFO]: 25 graphql responses were extracted.
[INFO]: Number of Instagram posts: 514.
[SUCCESS]: Scrapped 12 first posts.
[SUCCESS]: Scrapped 12 posts.
[INFO]: Failed extracting a graphQl response, now trying to access from the login page to which we were redirected.
[INFO]: In order to carry on scraping, type a username and its password seperated by one space: ****** ******
[INFO]: Logged into the website.
[INFO]: Failed extracting a graphQl response, now trying to access from the login page to which we were redirected.
[INFO]: In order to carry on scraping, type a username and its password seperated by one space: ****** ******
[INFO]: Logged into the website.
[INFO]: Failed extracting a graphQl response, now trying to access from the login page to which we were redirected.
[INFO]: In order to carry on scraping, type a username and its password seperated by one space: ****** ******
[INFO]: Logged into the website.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[SUCCESS]: Scrapped 12 posts.
[INFO]: Failed extracting a graphQl response, now trying to access from the login page to which we were redirected.
[INFO]: In order to carry on scraping, type a username and its password seperated by one space: ****** ******
.........
(Repeated to ask username and password)
In my second try, it only scraped first 12 post and ended. Below is the log.

[INFO]: Please enter the username or hashtag you want to scrap from: yunhwankim2
====== WebDriver manager ======
Current google-chrome version is 92.0.4515
Get LATEST driver version for 92.0.4515
Driver [/Users/yunhwankim/.wdm/drivers/chromedriver/mac64/92.0.4515.107/chromedriver] found in cache
[INFO]: Getting access to the user or hashtag website ..
[SUCCESS]: Got into the user or hashtag page.
[INFO]: Start scrolling to the bottom of the page to get all the content.
[SUCCESS]: Finished scrolling, it took 3.03s.
[INFO]: 0 graphql responses were extracted.
[INFO]: Number of Instagram posts: 514.
[SUCCESS]: Scrapped 12 first posts.
[SUCCESS]: Finished scrapping 12 posts, it took 0.0s.

I'll keep trying. Thank you for your response.

Yes, it happens to collect only a small number of graphqls, that's because sometimes the internet is slow and when scrolling the page down to load content it takes so much time that the stopping condition for my while loop is achieved. I did a small fix, please give it a try and show me ur logs, for me it works just as before.

Thank you, it works now.
And could you please recommend some reference (books) which was helpful for you to develop this project? I want to study about dealing with HAR file.
Anyway, please delete pkl files in the collected_data folder. It might be generated in your previous test.
Thank you again.

I saw a video of a guy on Youtube telling how har files can be useful to get information of GET requests, and then I got the idea to convert this into code to scrap instagram. I deleted ur feed.pkl, btw I pushed another version to reduce scrolling time :)

Okay. Thank you so much.


bedtools genomecov with -bga option places 0 coverage chromosomes at the end

Hi,
I'm using version 2.27.1 and noticed that chromosomes with 0 coverage get sorted
to the end of a bedgraph file when running bedtools genomecov on a bam file with -bga option.
This is only the case if there are absolutely no reads mapping to the respective chromosomes. Otherwise sequence records are placed in order as expected.
Not a critical issue but in my case created some issues with downstream processing (especially when sorting the resulting bedgraph file is not an option).
Great if that could be fixed.
Cheers!

This is a bit difficult to address and since sorting the output is a simple solution, I think I will close this.


Error with Rails 5.2

Hi I was trying to upgrade to Rails 5.2
I pointed the gem to github master
gem 'activerecord-jdbcpostgresql-adapter', github: 'jruby/activerecord-jdbc-adapter'
The bundle install completed and installed all the gems.
But when I tried to run rails console, I got an error. Below is the stack trace of error
NameError: uninitialized constant ActiveRecord::ConnectionAdapters::PostgreSQL::ColumnDumper
                   load_missing_constant at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/dependencies.rb:542
                           const_missing at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/dependencies.rb:193
               <class:PostgreSQLAdapter> at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/bundler/gems/activerecord-jdbc-adapter-a33baa1c0e6a/lib/arjdbc/postgresql/adapter.rb:647
             <module:ConnectionAdapters> at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/bundler/gems/activerecord-jdbc-adapter-a33baa1c0e6a/lib/arjdbc/postgresql/adapter.rb:643
                                  <main> at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/bundler/gems/activerecord-jdbc-adapter-a33baa1c0e6a/lib/arjdbc/postgresql/adapter.rb:637
                                 require at org/jruby/RubyKernel.java:970
                         block in (root) at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/dependencies.rb:1
                                 require at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/dependencies.rb:283
                         load_dependency at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/dependencies.rb:249
                                  <main> at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/dependencies.rb:283
                                 require at org/jruby/RubyKernel.java:970
                         block in (root) at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/bundler/gems/activerecord-jdbc-adapter-a33baa1c0e6a/lib/arjdbc/postgresql.rb:2
                                  (root) at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/dependencies.rb:1
                                 require at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/dependencies.rb:283
                                  <main> at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/dependencies.rb:249
                                 require at org/jruby/RubyKernel.java:970
                        block in require at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/dependencies.rb:283
                                  (root) at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/bundler/gems/activerecord-jdbc-adapter-a33baa1c0e6a/lib/active_record/connection_adapters/postgresql_adapter.rb:1
                                  (root) at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/dependencies.rb:1
                                 require at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/dependencies.rb:283
                         load_dependency at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/dependencies.rb:249
                                 require at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/dependencies.rb:283
                           block in spec at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activerecord-5.2.0/lib/active_record/connection_adapters/connection_specification.rb:191
                           instance_eval at org/jruby/RubyBasicObject.java:2605
           block in establish_connection at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activerecord-5.2.0/lib/active_record/connection_adapters/abstract/connection_pool.rb:950
                    establish_connection at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activerecord-5.2.0/lib/active_record/connection_handling.rb:60
                                 Railtie at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activerecord-5.2.0/lib/active_record/railtie.rb:136
                   block in execute_hook at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/lazy_load_hooks.rb:71
                                    each at org/jruby/RubyArray.java:1801
                  with_execution_control at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/lazy_load_hooks.rb:62
                   block in execute_hook at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/lazy_load_hooks.rb:67
                           instance_exec at org/jruby/RubyBasicObject.java:2677
                                 on_load at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/lazy_load_hooks.rb:43
                        block in on_load at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/lazy_load_hooks.rb:42
                        block in Railtie at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activerecord-5.2.0/lib/active_record/railtie.rb:132
                            block in run at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/railties-5.2.0/lib/rails/initializable.rb:32
                        run_initializers at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/railties-5.2.0/lib/rails/initializable.rb:61
                     block in tsort_each at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/stdlib/tsort.rb:228
                                    each at org/jruby/RubyArray.java:1801
                                    call at org/jruby/RubyMethod.java:129
       each_strongly_connected_component at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/stdlib/tsort.rb:350
  each_strongly_connected_component_from at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/stdlib/tsort.rb:431
       each_strongly_connected_component at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/stdlib/tsort.rb:349
       each_strongly_connected_component at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/stdlib/tsort.rb:347
                              tsort_each at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/stdlib/tsort.rb:226
                                  <main> at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/stdlib/tsort.rb:205
                                 require at org/jruby/RubyKernel.java:970
               block in run_initializers at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/railties-5.2.0/lib/rails/initializable.rb:60
                             initialize! at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/railties-5.2.0/lib/rails/application.rb:361
                                  (root) at /Users/ckgagan/dev/office/insurance/config/environment.rb:5
                                  (root) at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/dependencies.rb:1
                                 require at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/dependencies.rb:283
                         load_dependency at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/dependencies.rb:249
                                 require at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/activesupport-5.2.0/lib/active_support/dependencies.rb:283
                    require_environment! at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/railties-5.2.0/lib/rails/application.rb:337
    require_application_and_environment! at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/railties-5.2.0/lib/rails/command/actions.rb:18
                                 perform at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/railties-5.2.0/lib/rails/commands/console/console_command.rb:95
                                     run at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/thor-0.20.0/lib/thor/command.rb:27
                                  <main> at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/thor-0.20.0/lib/thor/invocation.rb:126
                                 require at org/jruby/RubyKernel.java:970
                                  <main> at /Users/ckgagan/.rbenv/versions/jruby-<IP_ADDRESS>/lib/ruby/gems/shared/gems/thor-0.20.0/lib/thor.rb:387

I believe that the currently higest supported Rails version is 5.1

@rsov The master gemspec has support for ActiveRecord 5.2. So I tried with Rails 5.2

@rsov is correct, there's some 5.0 / 5.1 releases out there. 5.2 is a work in progress (on master) atm ...

Closing this as the master branch should now run. There are still a bunch of tests to clean up but it should at least start now.

There's an error with bundle install from master branch. Build native extensions failed
Gem::Ext::BuildError: ERROR: Failed to build gem native extension.

current directory:
/Users/prvithani/.rvm/gems/jruby-<IP_ADDRESS>/bundler/gems/activerecord-jdbc-adapter-4aca742c4a17
/Users/prvithani/.rvm/rubies/jruby-<IP_ADDRESS>/bin/jruby -rrubygems
<EMAIL_ADDRESS>RUBYARCHDIR=/Users/prvithani/.rvm/gems/jruby-<IP_ADDRESS>/bundler/gems/extensions/universal-java-10/2.5.0/activerecord-jdbc-adapter-4aca742c4a17
RUBYLIBDIR=/Users/prvithani/.rvm/gems/jruby-<IP_ADDRESS>/bundler/gems/extensions/universal-java-10/2.5.0/activerecord-jdbc-adapter-4aca742c4a17
rake aborted!
NoMethodError: undefined method `split' for nil:NilClass
/Users/prvithani/.rvm/gems/jruby-<IP_ADDRESS>/bundler/gems/activerecord-jdbc-adapter-4aca742c4a17/Rakefile:240:in
`block in (root)'
/Users/prvithani/.rvm/gems/jruby-<IP_ADDRESS>/bundler/gems/activerecord-jdbc-adapter-4aca742c4a17/Rakefile:239:in
`block in (root)'
/Users/prvithani/.rvm/gems/jruby-<IP_ADDRESS>@global/gems/rake-12.3.1/exe/rake:27:in
`<main>'
Tasks: TOP => default => jar => lib/arjdbc/jdbc/adapter_java.jar
(See full trace by running task with --trace)

rake failed, exit code 1

Gem files will remain installed in
/Users/prvithani/.rvm/gems/jruby-<IP_ADDRESS>/bundler/gems/activerecord-jdbc-adapter-4aca742c4a17
for inspection.
Results logged to
/Users/prvithani/.rvm/gems/jruby-<IP_ADDRESS>/bundler/gems/extensions/universal-java-10/2.5.0/activerecord-jdbc-adapter-4aca742c4a17/gem_make.out

I looked at the error line in Rakefile. It seems 'sun.boot.class.path' is not set in ENV_JAVA.

@ckgagan Ah indeed.  I never notice this because we build releases and I generally dev with Java 8 accept for acceptance testing (which I now realize I build release stuff using Java8 as well).  We will need to figure out an alternative to this.

@enebo, For now, I've found an alternate way to make this work in java 10.
Passing -J-Dsun.boot.class.path=$HOME/rvm/rubies/jruby-<IP_ADDRESS>/lib/jruby.jar to JRUBY_OPTS OR -Dsun.boot.class.path=$HOME/.rvm/rubies/jruby-<IP_ADDRESS>/lib/jruby.jar to JAVA_OPTS sets the class path to jruby.jar, which is required to build the gem.

@prashantvithani Java 8 is another workaround.

Moved this Java 9+ thing to a new issue.


Feature Request: Option to emit relative paths for "file" field in Bib(La)Tex export

In Short
When we export a bibtex without exporting the files, the path in the "file" field is absolute. Which does make a lot of sense as we can possible save this exported bibtex anywhere.
Would it be possible to emit the relative paths for (at least) those attachments which are located in the "Base Directory" option of Zotero. Internally Zotero does appear to use relative paths for links to files that are in the tree of this directory.
It seems that this is possible as some discussion in Issue #21 shows.
In Detail
I am using Zotero as a reference manager while finetuning a workflow for writing academic papers using pandoc. Pandoc requires a bibtex file for reference management, hence the need to export from Zotero to bibtex. I also intend to use docear, possibly from a different computer.
I am using Zotero in combination with zotfile, zotero-better-bibtex and zotero-bib-autoexport. Zotero allows me to quickly retrieve metadata for my PDFs. Then zotfile allows me to move all the PDFs to a common folder (say "Literature") and renaming them to "AuthorYYYY.pdf", while modifying the zotero entry to have a link to the file. I then use BBT to generate bibtex keys compatible with the filename (an option for this could also be a cool feature, but I digress). Now if the bibtex had relative paths, I could simply pop the generated .bib file in my Literature folder, and Voila, I would have a self contained folder with a .bib file having the PDFs linked, while still retaining all functionality of Zotero itself.
This allows me to put the Literature folder on dropbox and use (view, no point in modifying the bibtex as it would get overwritten by zotero-bib-autoexport) it from any computer with basic bibtex support. Also allows docear to function seamlessly with Zotero.
Considerations

I would like to avoid multiple copies of the PDF at all costs, if possible. I use my home and lab computers almost equally.
A WebDAV account is not an option I would like to consider at the moment.
I hate zotero's policy of having PDF files nested really deep in some structure. I would like to keep my literature as I please.

Thanks a lot for considering this feature request. I am willing to help with any coding/testing if required, though I know awful little about coding.

The target directory is simply the directory where the BibTeX file is exported to.

Could you try https://dl.dropboxusercontent.com/u/5300806/zotero-better-bibtex-0.7.27.xpi ?

Hello,
Just saw this today. And tried it on a Mac (OSX Yosemite). The export still seems to have absolute paths. My Literature folder is arranged by Journal/Year, and I am exporting to the top level. As per your comment of 22nd December, I was expecting the paths to be relative from the top level folder.
Example:
Literature
|
|----------- Journal of Management
|                             | -------------------- 2005
.                                                            | ---------------- ABC.pdf
I was expecting to see the file path: ./Journal of Management/2005/ABC.pdf
What I see is the full path from /Users/XYZ/Download/Literature/Journal of Management/2005/ABC.pdf
Do I need to make any changes to the preferences?

Sorry, yes, this has an as of yet GUI-less preference called extensions.zotero.translators.better-bibtex.attachmentRelativePath, which needs to be set to true for this to work.

Hello,
The feature doesn't seem to work as of now. Below I give what I did and what happened.
I disabled the version of BBT I had, and installed the one you have linked to (0.7.27), with this I get an error "An error occurred while trying to export the selected file", this happens whether the GUI-less preference is TRUE or FALSE. i.e. it makes no difference. I have pasted the error I get at the end of this message.
With the latest version installed (0.7.33), I get the absolute path with the preference set to FALSE, as expected, and with the preference set to TRUE, I get the path as if I had exported with the "Export Files" checkbox selected. I get:
file = {Yu.pdf:files/666/Yu.pdf:application/pdf}
I have shortened the name of the file so as to make it clear.
Sorry it took me so long to test, but I am stuck with an analysis. Do let me know what else I can check.
The lines between the dashes are what the "zotero error report" has. I get this by selecting Help -> Report Errors to Zotero.
[JavaScript Error: "[Exception... "Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [mozIStorageConnection.createStatement]"  nsresult: "0x80004005 (NS_ERROR_FAILURE)"  location: "JS frame :: chrome://zotero/content/xpcom/db.js :: Zotero.DBConnection.prototype.getStatement :: line 298"  data: no] [QUERY: select citekey, citeKeyFormat from keys where itemID=? and libraryID = ?] [ERROR: no such column: libraryID] [QUERY: select citekey, citeKeyFormat from keys where itemID=? and libraryID = ?] [ERROR: no such column: libraryID]"]
[JavaScript Error: "[Exception... "Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [mozIStorageConnection.createStatement]"  nsresult: "0x80004005 (NS_ERROR_FAILURE)"  location: "JS frame :: chrome://zotero/content/xpcom/db.js :: Zotero.DBConnection.prototype.getStatement :: line 298"  data: no] [QUERY: select citekey, citeKeyFormat from keys where itemID=? and libraryID = ?] [ERROR: no such column: libraryID] [QUERY: select citekey, citeKeyFormat from keys where itemID=? and libraryID = ?] [ERROR: no such column: libraryID]"]
[JavaScript Error: "[Exception... "Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [mozIStorageConnection.createStatement]"  nsresult: "0x80004005 (NS_ERROR_FAILURE)"  location: "JS frame :: chrome://zotero/content/xpcom/db.js :: Zotero.DBConnection.prototype.getStatement :: line 298"  data: no] [QUERY: select citekey, citeKeyFormat from keys where itemID=? and libraryID = ?] [ERROR: no such column: libraryID] [QUERY: select citekey, citeKeyFormat from keys where itemID=? and libraryID = ?] [ERROR: no such column: libraryID]"]
[JavaScript Error: "[Exception... "Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [mozIStorageConnection.createStatement]"  nsresult: "0x80004005 (NS_ERROR_FAILURE)"  location: "JS frame :: chrome://zotero/content/xpcom/db.js :: Zotero.DBConnection.prototype.getStatement :: line 298"  data: no] [QUERY: select citekey, citeKeyFormat from keys where itemID=? and libraryID = ?] [ERROR: no such column: libraryID] [QUERY: select citekey, citeKeyFormat from keys where itemID=? and libraryID = ?] [ERROR: no such column: libraryID]"]
version => <IP_ADDRESS>, platform => Win32, oscpu => Windows NT 6.3; WOW64, locale => en-US, appName => Zotero, appVersion => <IP_ADDRESS>, extensions => Zotero automatic export (<IP_ADDRESS>, extension), ZotFile (4.1.3, extension), Zotero LibreOffice Integration (3.5.9.SA.<IP_ADDRESS>, extension), Zotero Word for Windows Integration (3.1.18.SA.<IP_ADDRESS>, extension), Zotero Better Bib(La)Tex (0.7.27, extension), Google Update (<IP_ADDRESS>, plugin), Shockwave Flash (<IP_ADDRESS>5, plugin), Java(TM) Platform SE 8 U31 (<IP_ADDRESS>, plugin), Java Deployment Toolkit 8.0.310.13 (<IP_ADDRESS>, plugin), Adobe Acrobat (<IP_ADDRESS>, plugin), PDF-XChange Viewer (2.5.311.0, plugin), VLC Web Plugin (<IP_ADDRESS>, plugin), Microsoft Office 2013 (15.0.4420.1017, plugin), Microsoft Office 2013 (15.0.4420.1017, plugin)

Can you check if the updated release does what you want?

Even though I am subscribed to notifications, I am not getting any email when you update this issue, I need to check back to find that you had updated this 8 days ago. :-)
I will check and update this issue today itself.

With version 0.8.40 of BBT. It still doesn't seem to work.
When I set extensions.zotero.translators.better-bibtex.attachmentRelativePath to false, I get absolute paths as expected, when I set it to true, I still get absolute paths. There appears to be no difference in the bibtex file generated.
I also tried exporting just a single item as bibtex to the same directory that contained the PDF file. Still I got the absolute path.
I can't think of how I could help you debug this issue. Thanks a lot for working on it.
In case the option of "relative directory when path of document is under path of target directory of exported file" appears not easy, you could possibly try the "relative to Base Directory option" given in zotero itself. This is under Preferrences -> Advanced -> Files and Folders -> Linked Attachment Base Directory

OK, I think I have replicated your setup, and I think it works now. I've just pushed it out as .41

Sir. You have just blown me away. :-) Works exactly as expected. When the option is set to true, the bib file contains relative paths as long as the document is under the directory to which I export, otherwise it gives me absolute paths. With the option set to false it gives the absolute path. Great work!
Thanks a lot. This issue can now be considered closed. You might want to document the option and the behavior though, if you plan on making it generally available. Let me know if you need help in the documentation.
p.s. I have currently tried with a collection of a few items and an individual item.

I believe I can close the issue now?

I'm actually considering making this the fixed behavior rather than adding another option. It is only triggered when you don't save the attachments and they happen to live under the directory the export is under; I can't imaging why you'd want to change this. When I decide on this, the hidden preference will just go away.

I am not getting this to work (I am using BBT v. 1.0.19 with standalone Zotero). Option attachmentRelativePath does not exist, which I think is expected based on the thread above. However, I am having the files with the complete path.
The bib file is being exported to /home/ramon/Zotero-data/storage/zotero.bib. And that is where Zotero places all the attachements. For example, one entry in the bibfile shows
file = {Attachment:/home/ramon/Zotero-data/storage/J5TSKG2N/Schmidt2010-gpzzggah.pdf:application/pdf}
I was expecting that the /home/ramon/Zotero-data/storage would not be there. (In case it matters, but I think it shouldn't, storage is a symbolic link to another location, which is synced between computers, so I keep the database in sync via Zotero, but the attachements themselves, and the bib file, by other means ---syncthing, actually).
Looking at some of the other options under about:config I have extensions.zotero.saveRelativeAttachmentPath but setting it to true or false makes no difference.
What am I doing wrong?

The behaviour has since become the default behaviour, so the option is no longer there. Sorry for the late reply -- I don't commonly review closed issues. If you are still experiencing this on 1.2.34, could you please re-open this issue?

I've got all of this working (including the renaming of filenames to match the citekey) so that the desired workflow at the top ALMOST works perfectly.
If my export directory is ExpDir, my bibfile is Exp.bib, and the citekey-and-pdf-name is myPaper, the entry for myPaper in Exp.bib is
File                     = {MyPaper.pdf:/MyPaper.pdf:application/pdf}
which JabRef interprets literally as saying that the file is in my root directory /.
This can be fixed by hand by adding the comment
@comment{jabref-meta: fileDirectory:.;}
to the Exp.bib file.  But I can't figure out any way to automatically add that comment to the file.  And, having to do it by hand every time I (automatically) export, or every time I use the bib file, kind of defeats the purpose (which is to have a fully automatic process).
I guess this seems like maybe a question for the ZotFile developer, but the context comes from this thread so I'm posting here.

No, that's an error in BBT I think. Zotfile doesn't affect the paths exported by BBT. I'm a little surprised by the generated path though; are you exporting the bib file to a location within the zotero storage directory? If so, I'd still expect the paths to be <giberish>/myPaper.pdf.

Could you open a new issue for this please?

1.3.1 is out.

For what is worth, and using v. 1.4.2, I am getting the full path (which is what I actually really want). I am exporting to /home/ramon/Zotero-storage/zotero.bib. Under ~/Zotero-data I have a directory storage which is a symlink to  /home/ramon/Zotero-storage/. So I get paths as /home/ramon/Zotero-data/storage/KUC65AEA/somefile.pdf.  The point is that the export, in BBT, is not a file explicitly under the Zotero-data directory, but to a different one (Zotero-storage), even if this is symlinked from storage under zotero-data.

I don't think there's any way I can prevent that. I don't get told about symlinks.

@llorracc-git: I could either try to fix what's happening (unless it's the symlink issue), or it can be done with a bit of injected Javascript. Either way, if your still interested, please do open a new issue. Love to fix it, but I prefer a clean context for each issue, hence my request to open a new one.

Sure, I think I understand the issue about symlinks. And I was not complaining; sorry if I was not clear. The current behavior I think I understand, and it is fine with me (I do want full paths). I was trying to explain that I can actually get the full path, which I thought was something that @llorracc-git might want (full paths, I mean; regardless of symlinks). Apologies for the noise.

I don't know exactly what @llorracc-git prefers; I thought instead he
wanted relative paths.
It's not noise, we're just having a discussion.


Implement search API

Overview
Changes
Impact range
Operational Requirements
Related Issue
Supplement

Codecov Report
Patch and project coverage have no change.

Comparison is base (a32b038) 0.00% compared to head (0c73bc2) 0.00%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
Additional details and impacted files
@@          Coverage Diff           @@
##           master     #89   +/-   ##
======================================
  Coverage    0.00%   0.00%
======================================
  Files           8       8
  Lines         897     919   +22
======================================
- Misses        897     919   +22

Impacted Files
Coverage Δ

app/interfaces/controller/post.go
0.00% <0.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Extension installed and configured but not working (no output)

Please provide us with the following information:

This issue is for a: (mark with an x)
- [x] bug report -> please search issues before submitting
- [ ] feature request
- [x] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

Minimal steps to reproduce

Install the extension and configured the service url and API key, tried to generate test cases, nothing generated.

Any log messages given by the failure

Nothing

Expected/desired behavior

Test cases generated based on acceptance criteria

OS and Version?

Windows 7, 8 or 10. Linux (which distribution). macOS (Yosemite? El Capitan? Sierra?)

Versions

Mention any other details that might be useful

Thanks! We'll be in touch soon.

Could you provide a screenshot ?

If you are still experiencing this issue, kindly re-open and add a screenshot or more information. Thanks.


Video Banner- Mobile View Background video issue

Hi Team,
On the mobile view, I have noticed that the background video for the Video Banner block is not playing.
Please refer to the URL and snapshots
https://main--aldevron--hlxsites.hlx.page/qe-test/video-banner-25
https://www.aldevron.com/25th-anniversary

Hi Kumaresan,
This is agreed with Client and in mobile view, we are using background image and not playing video for performance gain.

As per the above thread, we are using background image and not playing video for performance gain.
Hence closing the ticket.


Carwash not connected to payroll

When running payroll carwash is not being run so nothing is been added to database

Fixed patch002


Have page counter set pdf metadata

Description
If I generate a typst document with page 1 twice it sets only the number in the footer:
play.pdf
But with latex I can have the same number on multiple pages in the metadata as well, e.g. in this file:
https://github.com/pdfpc/pdfpc/releases/latest/download/pdfpc-demo.pdf
Use Case
This is for example used by pdfpc to handle overlays in slides, but it is also generally useful to have the number in your pdf viewer match with the number shown in the pdf.

As an example in latex one can use:
% Don't count pages in this environment
\newcounter{nopage}
\newenvironment{nopage}
{\clearpage\stepcounter{nopage}\addtocounter{page}{-1}
  \renewcommand{\thepage}{\arabic{page}.\arabic{nopage}}%
  \thispagestyle{empty}}
{\clearpage\setcounter{nopage}{0}}

and later use with
\begin{nopage}
    \tableofcontents
    \thispagestyle{empty}
    \cleardoublepage
\end{nopage}

to alter the page counting

The below is a demonstration that shows that latex allows setting this number to an arbitrary Unicode value (including negatives, letters, and emojis):
\documentclass[12pt, a4paper]{article}

% GEOMETRY
\usepackage[
    headheight=15pt,
]{geometry}

% HYPERLINKS
\usepackage{hyperref}
\hypersetup{
    colorlinks=true,
    linktoc=all,
    linkcolor=blue,
}

% HEADERS and FOOTERS
\usepackage{lastpage}
\usepackage{fancyhdr}
    \pagestyle{fancy}
    \rfoot{\thepage \ of \pageref{LastPage}}
\usepackage{etoolbox}  % Define chapter page to use fancy
    \patchcmd{\chapter}{\thispagestyle{plain}}{\thispagestyle{fancy}}{}{}

\newenvironment{scoped}{}{}

\begin{document}

\begin{scoped}
    \renewcommand{\thepage}{👍 123\_page}
    \thispagestyle{empty} % Can't include the unicode at the bottom of the page.
    Weird numbered page.
    \cleardoublepage
\end{scoped}

Normal counter again.
\cleardoublepage

\addtocounter{page}{-1000000}
Very negative valued page numbering.
\cleardoublepage

\begin{scoped}
    \renewcommand{\thepage}{∑ ∫ π² ∞ ⪋}
    \thispagestyle{empty} % Can't include the unicode at the bottom of the page.
    more weird page numbering
    \cleardoublepage
\end{scoped}
\end{document}

Yes, this is especially useful for documents that have, e.g., a preamble using roman numbers, but Arabic numbers for the body.

Implemented in https://github.com/typst/typst/pull/1933


大佬大佬，超时用不了了，希望可以维护一下

报错信息:
file:///Users/lion/Library/pnpm/global/5/.pnpm/puppeteer-core@21.3.1/node_modules/puppeteer-core/lib/esm/puppeteer/common/WaitTask.js:56
void this.terminate(new TimeoutError(Waiting failed: ${options.timeout}ms exceeded));
^
TimeoutError: Waiting failed: 30000ms exceeded
at Timeout. (file:///Users/lion/Library/pnpm/global/5/.pnpm/puppeteer-core@21.3.1/node_modules/puppeteer-core/lib/esm/puppeteer/common/WaitTask.js:56:37)
at listOnTimeout (node:internal/timers:573:17)
at process.processTimers (node:internal/timers:514:7)
Node.js v20.8.1

0.7.5


Unsupported secret Mtproto TLS

I'm trying to check an MTProto TLS proxy but I keep revising this error
{'@type': 'error', 'code': 400, 'message': 'Unsupported secret', '@extra': {'request_id': '5c4164bace2f4772804f43caf1eab104'}}
my secret is : "ee32b920dffb51643028e2f6b878d4eac16661712e77686174736170702e636f6d"
it's work fine with normal secret like "dd00000000000000000000000000000000" but When I try to check an mtproto proxy with fake tls is said :  Unsupported secret

You are using very old TDLib version.


Dataset source

Hi, I saw you recently changed the dataset source from kaggle to the official website, however I note it is not actually available there and moreover there appear to be many unanswered requests for access on https://competitions.codalab.org/forums/15208/
You could suggest both locations with the above caveat.
Cheers

Thanks @robmarkcole! I will update that.


Support markdown treesitter groups

I'll try poking at this sometime soon and submit a PR… but according to the author's reddit post we need to implement highlights for:

[ ] TSTitle
[ ] TSLiteral
[ ] TSEmphasis
[ ] TSStrong
[ ] TSURI
[ ] TSTextReference
[ ] TSPunctSpecial
[ ] TSStringEscape

https://www.reddit.com/r/neovim/comments/rg97j4/treesitter_for_markdown/hoje1mg/?utm_source=reddit&utm_medium=web2x&context=3

Sounds good. Looking forward to the PR.


handle null array

Bot works great!
Small fix to handle empty metadata array.

Should not be necessary, as allSettled works with an empty array and the array is initialized before, but thanks for your contribution :)


fix: NetworkStart not called for respawned objects.

:tada: This PR is included in version 9.2.4 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Unwrap UV2

I have issues baking lightmaps due to the generated meshes not being unwrapped for UV2. It's possible to let Godot do the unwrapping; it does this only for currently selected MeshInstances via "Unwrap UV2 for LightMap/AO" in the "Mesh" popup menu:

The unwrapping code isn't exposed to the scripting API, as far as I know. While it's not a huge hassle to find and select all the MeshInstances via script and then click "Unwrap UV2 for LightMap/AO", it gets old. I think it'd be nice to have 1) a "Unwrap UV2" button that gets and unwraps all the generated MeshInstances, and 2) an option for automatic unwrapping.

I have added an option to TBLoader to do this automatically when building:

Maybe it makes sense to put it in the toolbar too, though?

Nice! That's wonderful.
No, I think you got it right. It makes sense that the auto unwrap setting belongs in TBLoader. And for those odd cases where you'd want to unwrap UV2 only for a specific MeshInstance you can still use the ol' manual "Unwrap UV2 for LightMap/AO".
Does TBLoader set GI Mode to static for all MeshInstances? I think it's reasonable that GI Mode have default values, like Static for structural brushes or Dynamic for door_func (and other moving entities which will probably use AnimatableBody3D), it should be possible for users to manually set the GI Mode on a brush/entity basis. Thinking about it,

Yes, currently every mesh instance is set to static. Brush entities could have a property to override this inside of TrenchBroom to set this to none or dynamic.
Feel free to make a separate issue for that so I don't forget!


Internal error when there is a bitwise operation in order by clause (SQLancer)

Describe the bug
Bitwise operations are producing various inconsistent behavior during fuzzing.
The root cause seems to be bitwise operation evaluation (maybe related to https://github.com/apache/datafusion/issues/11260)
However, when bitwise operations are used in the ORDER BY clause, other SORT-related errors show up.
We could investigate if this bitwise operation bug might propagate into the SORT logic.
To Reproduce
Reproduce in datafusion-cli
This is a potential bug in bitwise operation, | of two DOUBLE type should not be allowed, it should yield a planning error, but in this case it produces an internal error (https://github.com/apache/datafusion/issues/11249)
> select (0.7|0.8);
Internal error: Data type Float64 not supported for binary operation 'bitwise_or' on dyn arrays.
This was likely caused by a bug in DataFusion's code and we would welcome that you file an bug report in our issue tracker

However, when this expression is placed in order by clause, some query can execute successfully, some query can trigger another internal error in sort logic.
> /*DML*/CREATE TABLE t1(v0 BOOLEAN);
/*DML*/CREATE TABLE t3(v0 BOOLEAN, v1 BIGINT);
0 row(s) fetched.
Elapsed 0.058 seconds.

0 row(s) fetched.
Elapsed 0.002 seconds.

> SELECT * FROM t3 NATURAL JOIN t1 ORDER BY (0.7 | 0.8);
+----+----+
| v1 | v0 |
+----+----+
+----+----+
0 row(s) fetched.
Elapsed 0.084 seconds.

> SELECT * FROM t3 NATURAL JOIN t1 ORDER BY (0.7 | 0.8) > 0;
Internal error: Sort expressions cannot be empty for streaming merge.
This was likely caused by a bug in DataFusion's code and we would welcome that you file an bug report in our issue tracker

Expected behavior
No response
Additional context
Found by SQLancer https://github.com/apache/datafusion/issues/11030

take


QN randomMPS not meeting requested linkdim

Apparently sometimes the randomMPS function which takes an initial state vector is not meeting the requested linkdim value. This was reported for an input state which was a S=1/2 Neel state and a linkdim of 4 in this forum post:
http://itensor.org/support/2186/questions-random-initial-conservation-randommps-linkdim

Just for added clarity, I have put the code here as well. This was code that I wrote up to attempt to answer this question on the Support Q&A (http://itensor.org/support/2140/implementing-local-gauge-symmetries):
ferm_full = QN("Sz",-1) => 1
ferm_vac = QN("Sz",0) => 1
antiferm_full = QN("Sz",+1) => 1
antiferm_vac = QN("Sz",0) => 1
even_link_p1 = QN("Sz",+2) => 1 # p1 = "positive 1"
even_link_0 = QN("Sz",0) => 1
even_link_n1 = QN("Sz",-2) => 1 # n1 = "negative 1"
odd_link_p1 = QN("Sz",-2) => 1
odd_link_0 = QN("Sz",0) => 1
odd_link_n1 = QN("Sz",+2) => 1

function Kogut_Susskind_sites(num_spatial_sites)
  sites = Index[]
  for i = 1:num_spatial_sites
    push!(sites, Index(ferm_full,ferm_vac; tags="Site,S=1/2,n=$(4*i-3)"))
    push!(sites, Index(odd_link_p1,odd_link_0,odd_link_n1; tags="Site,S=1,n=$(4*i-2)"))
    push!(sites, Index(antiferm_full,antiferm_vac; tags="Site,S=1/2,n=$(4*i-1)"))
    push!(sites, Index(even_link_p1,even_link_0,even_link_n1; tags="Site,S=1,n=$(4*i)"))
  end
  return sites
end

function Schwinger_Hamiltonian(sites, num_spatial_sites, x, μ)
  N = num_spatial_sites * 2
  ampo_H = AutoMPO()
  for j=0:N-1
    add!(ampo_H, 1, "Sz2", 2*j+2)
    add!(ampo_H, (μ/2)*(-1)^j * 2, "Sz", 2*j+1)
    if j != N-1
      add!(ampo_H, x * 2*2/sqrt(2), "S+", 2*j+1, "S-", 2*j+2, "S-", 2*j+3)
      add!(ampo_H, x * 2*2/sqrt(2), "S+", 2*j+3, "S+", 2*j+2, "S-", 2*j+1)
    end
  end
  add!(ampo_H, x * 2*2/sqrt(2), "S+", 2*N-1, "S-", 2*N, "S-", 1)
  add!(ampo_H, x * 2*2/sqrt(2), "S+", 1, "S+", 2*N, "S-", 2*N-1)
  H = MPO(ampo_H, sites)
  return H
end

function Schwinger_DMRG(num_spatial_sites)
  sites = Kogut_Susskind_sites(num_spatial_sites)
  H = Schwinger_Hamiltonian(sites, num_spatial_sites, x, μ)
  sweeps = Sweeps(10)
  maxdim!(sweeps, 10,20,100,100,200)
  cutoff!(sweeps, 1E-10)

  # construct initial state as completely empty
  init_state = ["Up" for n = 1:4*num_spatial_sites] # just to initialize
  for n = 1:4*num_spatial_sites
    if n % 4 == 1
      init_state[n] = "Dn" # empty fermion sites
    elseif n % 4 == 3
      init_state[n] = "Up" # empty antifermion states
    else # n % 4 == 2 || n % 4 == 0
      init_state[n] = "Up" # flux = 0 at all links
    end
  end
  psi0 = randomMPS(sites, init_state, 100)
  energy, psi = dmrg(H, psi0, sweeps)
  println("Ground state energy = $energy")
  return energy
end

Noting a related issue shared by a user in this forum post.
Briefly, the issue is that for certain initial states using "Fermion" sites (representing "split" up and down electrons), randomMPS always returns a product state even when a larger bond dimension is requested, and even though when keeping the sites together as "Electrons" a larger bond dimension is possible for the randomMPS algorithm.


Customize template for input field

I have created a template
<template name="afArrayField_customRows">
  ...
</template>

which is a customization of https://github.com/aldeed/meteor-autoform/blob/devel/templates/bootstrap3/components/afArrayField/afArrayField.html
I thought I could just swap this component template with my new template with
{{> afQuickField name="rows" template="afArrayField_customRows"}}

but it seems I can only swap the entire form template and not just this field's template.
How should this be done correctly? Do I have to create a new input type if I just want a slightly modified version of https://github.com/aldeed/meteor-autoform/blob/devel/templates/bootstrap3/components/afArrayField/afArrayField.html ?

I think the template name only needs to be 'customRows'  not the actual template name, just the part after the component name.

this is correct: template name="afArrayField_customRows"
but the param on the field needs to be  {{... Template="customRows"}}