etc_query: all things Textpattern

juanjo · 2013-08-18 17:34:06

Thanks Oleg, my mistake!

But I still can not get the data from fields like {swell/minBreakingHeight?} e.g., from the specific timestamp. I try this query:

query="//localTimestamp[. ='1376784000']"/*

But it does not work, obviously.

etc · 2013-08-18 17:43:29

Yes, because swell is a sibling of localTimestamp, not its child. Try

query="//localTimestamp[.='1376784000']/following-sibling::swell/minBreakingHeight"

if you wan just this data, or

query="//localTimestamp[.='1376784000']/.."

to match the parent of the desired timestamp, then {swell/minBreakingHeight?} and other selectors inside etc_query.

juanjo · 2013-08-18 18:10:03

Thanks a lot again, Oleg! it works perfectly :)

juanjo · 2013-08-18 18:30:46

Oleg, sorry for being such a pain in the ass, but it would be possible to replace the datestamp in the query for the current datestamp using something like this?

<txp:php>
        $now = time();
        $date = date('m/d/Y H', $now) . ':00';
        $currenttime = strtotime($date);       
</txp:php>

then

query="//localTimestamp[. =misterious code $currenttime]/.."

etc · 2013-08-18 21:56:33

Sure, the usual parsing rules apply, just mind the quotes. You can even do it etc_query-way, calling query="//localTimestamp[.='{?||strftime(%F %H:00).strtotime}']/..". However, there is no guarantee that this timestamp will be present in the feed. Edit: you can use query="//localTimestamp[.>='{?||strftime(%F %H:00).strtotime}']/.." to find the immediate successor of the current timestamp.

Last edited by etc (2013-08-18 22:09:32)

gaekwad · 2013-08-25 08:45:44

Hi Oleg.
If you have time (and inclination), I’d appreciate a pointer on where I’m going wrong with the following. I want to query and display database contents, specifically the ip field of txp_discuss with a provided discussid. My SQL syntax is correct, I think, but this isn’t outputting anything when used in a comment form:

<txp:etc_query data="SELECT ip FROM txp_discuss WHERE discussid = <txp:comment_id />">{ip?}</txp:etc_query>

Thank you in advance.

etc · 2013-08-25 09:16:44

Hi Pete, I think that’s just double quotes:

<txp:etc_query data='SELECT ip FROM txp_discuss WHERE discussid = <txp:comment_id />'>{ip?}</txp:etc_query>

or even

<txp:etc_query data='SELECT ip FROM txp_discuss WHERE discussid = <txp:comment_id />' />

should be ok.

gaekwad · 2013-08-25 09:18:15

etc wrote:

Hi Pete, I think that’s just double quotes:

Guh! The one thing I didn’t try!

Thank you, Oleg.

etc · 2013-09-04 09:58:09

Version 1.2.7: minor update to enable LDAP queries (data is composed of ;-separated rdn, filter and only fields):

<txp:etc_query markup="ldap" url="ldaps://my.ldap.server:636" data="ou=people,dc=org; uid=ol*; uid,sn" query="count" />

Works for me, but testers are more than welcome.

Edit: also tightened the security a little bit: only privileged users can import data from url or databases.

Last edited by etc (2013-09-04 10:49:30)

etc · 2013-09-12 19:14:57

Version 1.2.8: few changes inspired by this thread:

new save attribute, allowing to save the imported and transformed dom tree, that can be quickly reused later with markup="data";
new {!variable} pattern, that will be actualized on each call, and not only once like {?variable} pattern;
new {##} pattern for internal nodelist number;
more secure: requires php privileges for all advanced operations.

mrdale · 2013-09-26 15:34:51

Here’s one. I want to reformat a mail chimp archive called on a page with javacript… it looks like this…

document.write("<div class=\"display_archive\"><div class=\"campaign\">09\/19\/2013 - <a href=\"http:\/\/us7.campaign-archive1.com\/?u=999&id=888\" title=\"Title 1\" target=\"_blank\">Title 1<\/a><\/div><div class=\"campaign\">09\/12\/2013 - <a href=\"http:\/\/us7.campaign-archive1.com\/?u=777&id=666\" title=\"Title 2\" target=\"_blank\">Title 2<\/a><\/div><\/div>");

So obviously I point the query field at the url of the script, but in order to process this properly I need to do two things first:

strip escape characters
remove document.write(" and "0;

At that point I’m confident that I can do the reformatting I need.

etc · 2013-09-26 16:33:40

Hi Dale,

if you import this script from external url and are quite sure about its structure, try this:

<!-- save the script in "some_script" variable -->
<txp:etc_query url="script_url" markup="raw" name="some_script" />

<!-- now clean up and query -->
<txp:etc_query data="{?some_script||trim.preg_replace(/^document\.write\(|\);$/i,,$)}" argsep="," markup="json" />

If it is inside the page itself, you can go the same “save then transform” way, but the optimal solution depends on how many they are, and what has to be extracted.

mrdale · 2013-09-26 17:34:22

Awesome! Did the trick, now I need to do the following. gonna give it a shot myself, just posting here for reference.

The dataset

<div class="display_archive">
  <div class="campaign">09/19/2013 - <a href="#" title="Item 1" target="_blank">Item 1</a></div>
  <div class="campaign">09/12/2013 - <a href="#" title="Item 2" target="_blank">Item 2</a></div>
</div>

In theory (etc check my logic)

match div.campaign /display_archive/campaign/
extract the date from instances of the date /display_archive/campaign/text() into a variable
remove the “ – “ in the variable
use <txp:if_different> to insert an h4 for the month name when it is different from the preceding (converting 1-12 to month names)
echo .campaign

Now for the Implementation

…

etc · 2013-09-26 18:39:04

For some ~~weird~~ good reason, <> get encoded when importing JSON to XML. This seems to work:

<txp:etc_query data="{?some_script||trim.preg_replace(/^document\.write\(|\);$/i,,$).json_decode}"
	argsep="," wraptag="div" class="display_archive" functions="strtotime,date"
	query="//div[@class='campaign']"
>
	<txp:if_different><h4>{date('m', strtotime(translate(text(), ' -', '')))}</h4></txp:if_different>
	{.}
</txp:etc_query>

Edit: added date functions.

Last edited by etc (2013-09-27 10:26:34)

mrdale · 2013-09-26 21:21:57

This is awesome! Thanks… trying very hard to grok this her’s my line by line.

<txp:etc_query data="{?some_script||trim.preg_replace(/^document\.write$|$;$/i,,$).json_decode}"

{get data from the variable|no default value|transformation chain}

get the variable and apply a transformation chain to it and use that for data (through php functions?)

trim: trims whitespace from start and end of the following
preg_replace: matches the two parts of the unwanted text searching case-insensitive
json_decode decodes the output into an array (why do I need this?)

argsep="," wraptag="div" class="display_archive" functions="strtotime,date" query="//div[@class='campaign']"

argsep: separates the arguments of which part with a comma?
wraptag: and class are txp behaviors
functions: allow the following php functions to be used inside this tag
query: limit the output of this tag to all divs who’s class is “campaign”

<txp:if_different><h4>{date('F', strtotime(translate(text(), ' -', '')))}</h4></txp:if_different>

if_different: behaves as it should ony showing unique values for the inner text returned from the query (inner text of “div.campaign”)
date: returns the date “Month Name” (F) of the enclosed string (make sure to use the code for date not strftime)
strtotime: transforms the text “mm-dd-yyyy” to a timestamp for the enclosed string
translate: this is an Xpath function to do a quick find and replace for unanted text on text()

{.}

Now just return all of the items that are output by the tag’s query from the dataset, rinse, repeat.

Last edited by mrdale (2013-09-27 15:30:09)

Textpattern CMS

Textpattern CMS support forum

#181 2013-08-18 17:34:06

Re: etc_query: all things Textpattern

#182 2013-08-18 17:43:29

Re: etc_query: all things Textpattern

#183 2013-08-18 18:10:03

Re: etc_query: all things Textpattern

#184 2013-08-18 18:30:46

Re: etc_query: all things Textpattern

#185 2013-08-18 21:56:33

Re: etc_query: all things Textpattern

#186 2013-08-25 08:45:44

Re: etc_query: all things Textpattern

#187 2013-08-25 09:16:44

Re: etc_query: all things Textpattern

#188 2013-08-25 09:18:15

Re: etc_query: all things Textpattern

#189 2013-09-04 09:58:09

Re: etc_query: all things Textpattern

#190 2013-09-12 19:14:57

Re: etc_query: all things Textpattern

#191 2013-09-26 15:34:51

Re: etc_query: all things Textpattern

#192 2013-09-26 16:33:40

Re: etc_query: all things Textpattern

#193 2013-09-26 17:34:22

Re: etc_query: all things Textpattern

The dataset

In theory (etc check my logic)

Now for the Implementation

#194 2013-09-26 18:39:04

Re: etc_query: all things Textpattern

#195 2013-09-26 21:21:57

Re: etc_query: all things Textpattern

Board footer